[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index] | [List Home]
Subject: Comments on Test Suite Review
Hi Folks, Following are the comments I have for the Policy Test suite. I would like to discuss some of these points on the June 7 telecon. Email discussion on the questions would also be appreciated. Some of these points I will knock off in the coming days. 1) 3001, 3002 - uses an IBM owned namespace to create a non SOAP WSDL binding extension, what should we do? 2) 3020 - attached the wrong policySet - fixed in SVN 3) POL-TA-40001 has no testcases. Could write one where the non-ignored policySet has an error (but the ignored policySet does not) and then test for an error. 4) 4002, 4003 - are very weak - a runtime could ignore the attached policySet and still pass the test - what do others think? 5) POL-TA-40004-40009, 40015-40016, 40018, 40024-40025. 40039 need test cases - I've thought of ways to test these with interesting combinations of valid and invalid policySets. 6) POL-TA-40013 needs a better testcase than 3007 7) testcase 4013 should be re-instated as it satisfies POL-TA40014 8) 4024 tests two preferred TAs, do we want testcases for "Preferred" TAs? 9) TA-40036 is preferred, we have testcase 3007 for it. Is that what we want? 10) 4027 needs to be deleted from the test suite 11) 4033 needs to be adjusted to use <externalAttachment/> instead of policySet/@attachTo 12) POL-TA-70001-70007 and POL-TA-80001-80004 and POL-TA-9003-90008, 90010-11, 90016-20, 90027-28 are marked as mandatory in the TA spec, but are marked as optional in the testcase document. I believe the TA spec is wrong because none of the std intents have to supported. 13) 9019 introduces an interesting precedent in the test cases in that it handles runtimes which might throw up an error for 9006 regarding the lack of a policySet to provide the transactedOneWay and managedTransaction intents. Do we need to apply this precedent to other policy testcases? 14) POL-TA-10006 is should be optional and POL_10002_TestCase should be deleted from the test suite? And I also made editorial updates to the testcases document [1,2]. [1] http://www.oasis-open.org/apps/org/workgroup/sca-policy/download.php/38033/sca-policy-1.1-testcases-wd04.odt [2] http://www.oasis-open.org/apps/org/workgroup/sca-policy/download.php/38034/sca-policy-1.1-testcases-wd04.pdf Thanks Dave Booz STSM, BPM and SCA Architecture Co-Chair OASIS SCA-Policy TC and SCA-J TC "Distributed objects first, then world hunger" Poughkeepsie, NY (845)-435-6093 or 8-295-6093 e-mail:booz@us.ibm.com
[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index] | [List Home]