[ebxml-iic-msg] Re: ebXML IIC 5/22/2002: [ebxml-iic] CTTF and TestDocuments

[Matthew MacKenzie <matt@xmlglobal.com>]

Monica,

Sorry it took so long to reply to this.

On Wednesday, May 22, 2002, at 01:32  PM, Monica Martin wrote:

> I am quite impressed with what I've seen so far on the CTTF site in the
> detail associated with the automation of the test requirements, test
> cases, trace, etc.
>
> I have a few questions or suggestions, which may perhaps be discussed
> this week while you are all in Barcelona.
>
> *	Suggest versioning for drivers (MT and AT)

We didn't discuss this, but it is a solid suggestion which should be 
worked into our spec.

> *	Versioning and date stamp (for creation, last update,
> enablement, etc) could apply to any files used for requirements, test
> step definition, processing, etc.

Yes & No.  I think it would be sufficient to version the test suite and 
test requirements with the specification version in question.  That 
means we need to have a specRef attribute at the TestRequirement and 
TestSuite element level.  Is there any other reasons to do more granular 
versioning?  Please explain.

> *	Specification to test suite consistency - As the specification
> changes (and if we assume the drivers and supporting suite goes by
> standards released), those test artifacts will also change.  Suggest we
> discuss a capability to cross check the specification against those
> artifacts for changes (Could XPath assist in this regard? A Trace Log
> could be the output if discrepancies were detected).

I anticipate a new test suite and requirements be done for each 
specification release.  We would copy the stuff from the previous 
version, then make changes to support the specification.

> *	At what level do we pose to check against SOAP or SWA? I had
> seen some conversation on the elist about that.  Would it bounded by the
> scope of the requirements in the specification?

We agreed to have untested requirements during our recent meeting, 
meaning that the requirements document would state SOAP 1.1 conformance 
as a requirement, but we wouldn't test it.  In the case of SOAP 1.1, we 
would expect vendors to run SOAP conformance tests (when/if available) 
prior to running our suite.  In short, TestSuite scope is more narrow 
than TestRequirement scope.

> *	If you use the concept of a draft test case and/or step, may
> wish to consider the capability to enable a function.  For example, a
> draft item may not be active or available for use if it is under
> development.  This is primarily focused on the metadata support and
> controls on what gets used.

Please clarify...

> *	Where would the profile definition be housed?
>

Please clarify...

> I hope you will humor me a bit with my questions, as I have not been in
> the details of your development, but have been reviewing most of the
> documentation and keeping track of your progress.  Thank you.  Your
> comments are surely welcome.
>

...and your comments are _greatly_ appreciated.  Thank you for taking 
the time to consider our work.  Keep the suggestions coming!



-Matt


> Monica J. Martin
>
> Program Manager
>
> Drake Certivo, Inc.
>
> 208.585.5946
>
> 	-----Original Message-----
> 	From: Jacques Durand
> 	Sent: Thu 5/16/2002 11:45 AM
> 	To: 'Karl F. Best'; ebxml-iic@lists.oasis-open.org
> 	Cc:
> 	Subject: [ebxml-iic] RE: [ebxml-msg] speak in Barcelona?
> 	
> 	
>
> 	Karl:
>
> 	I can help here - presenting both DGI approach to interop, and
> IIC work.
> 	If Rik has some material prepared, I'll present it if no-one
> from DGI is there.
>
> 	I'm also open to sharing the slot with someone from DGI
> 	who knows Rik's material better, if there is.
>
> 	Regards,
>
> 	Jacques
>
> 	-----Original Message-----
> 	From: Karl F. Best [ mailto:karl.best@oasis-open.org]
> 	Sent: Thursday, May 16, 2002 10:17 AM
> 	To: ebxml-iic@lists.oasis-open.org;
> ebxml-msg@lists.oasis-open.org
> 	Subject: [ebxml-msg] speak in Barcelona?
>
>
> 	IIC and Messaging TC members:
>
> 	Is there anyone who will be in Barcelona next week who could
> talk about
> 	the Messaging spec at our ebXML Day conference?
>
> 	Rik Drummond was on the the Barcelona ebXML Day program on
> Thursday
> 	speaking about the Messaging specification and
> interop/implementation
> 	issues, but he's had to cancel because he can't make the trip
> for
> 	business reasons. I need to find someone to fill his slot. I
> suspect
> 	that Rik probably has something put together; perhaps you could
> just
> 	present that. It's a 20 minute slot.
>
> 	Please let me know right away so I know whether I need to keep
> looking.
>
> 	</karl>
> 	
> =================================================================
> 	Karl F. Best
> 	OASIS - Director, Technical Operations
> 	+1 978.667.5115 x206
> 	karl.best@oasis-open.org  http://www.oasis-open.org
>
>
> 	----------------------------------------------------------------
> To subscribe or unsubscribe from this elist use the subscription
> 	manager: < http://lists.oasis-open.org/ob/adm.pl>
>
>
--
Matthew MacKenzie
XML Global R&D
PGP Key available upon request.