OASIS Mailing List ArchivesView the OASIS mailing list archive below
or browse/search using MarkMail.

 


Help: OASIS Mailing Lists Help | MarkMail Help

sca-policy message

[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index] | [List Home]


Subject: Comments on Test Suite Review



Hi Folks,

Following are the comments I have for the Policy Test suite.  I would like
to discuss some of these points on the June 7 telecon.  Email discussion on
the questions would also be appreciated.  Some of these points I will knock
off in the coming days.

1) 3001, 3002 - uses an IBM owned namespace to create a non SOAP WSDL
binding extension, what should we do?
2) 3020 - attached the wrong policySet - fixed in SVN
3) POL-TA-40001 has no testcases.  Could write one where the non-ignored
policySet has an error (but the ignored policySet does not) and then test
for an error.
4) 4002, 4003 - are very weak - a runtime could ignore the attached
policySet and still pass the test - what do others think?
5) POL-TA-40004-40009, 40015-40016, 40018, 40024-40025. 40039 need test
cases - I've thought of ways to test these with interesting combinations of
valid and invalid policySets.
6) POL-TA-40013 needs a better testcase than 3007
7) testcase 4013 should be re-instated as it satisfies POL-TA40014
8) 4024 tests two preferred TAs, do we want testcases for "Preferred" TAs?
9) TA-40036 is preferred, we have testcase 3007 for it. Is that what we
want?
10) 4027 needs to be deleted from the test suite
11) 4033 needs to be adjusted to use <externalAttachment/> instead of
policySet/@attachTo
12) POL-TA-70001-70007 and POL-TA-80001-80004 and POL-TA-9003-90008,
90010-11, 90016-20, 90027-28 are marked as mandatory in the TA spec, but
are marked as optional in the testcase document. I believe the TA spec is
wrong because none of the std intents have to supported.
13) 9019 introduces an interesting precedent in the test cases in that it
handles runtimes which might throw up an error for 9006 regarding the lack
of a policySet to provide the transactedOneWay and managedTransaction
intents.  Do we need to apply this precedent to other policy testcases?
14) POL-TA-10006 is should be optional and POL_10002_TestCase should be
deleted from the test suite?

And I also made editorial updates to the testcases document [1,2].

[1]
http://www.oasis-open.org/apps/org/workgroup/sca-policy/download.php/38033/sca-policy-1.1-testcases-wd04.odt
[2]
http://www.oasis-open.org/apps/org/workgroup/sca-policy/download.php/38034/sca-policy-1.1-testcases-wd04.pdf

Thanks

Dave Booz
STSM, BPM and SCA Architecture
Co-Chair OASIS SCA-Policy TC and SCA-J TC
"Distributed objects first, then world hunger"
Poughkeepsie, NY (845)-435-6093  or  8-295-6093
e-mail:booz@us.ibm.com



[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index] | [List Home]