OASIS Mailing List ArchivesView the OASIS mailing list archive below
or browse/search using MarkMail.


Help: OASIS Mailing Lists Help | MarkMail Help

sca-assembly message

[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index] | [List Home]

Subject: Assembly test contributions containing invalid composites

I don't know if we should be discussing this on the assembly list or  
elsewhere but here goes....

I may have come across an issue with the way the test suites are  
structured. Currently, the language-specific contributions (e.g.  
General_Java) contain invalid composite files used for negative  
testing. The problem I am faced with is the  language specific  
contribution is installed prior to running the tests, resulting in the  
correct behavior of errors being thrown. However, the errors are  
thrown at installation, prior to the test cases being run. I believe  
it is still valid for a runtime to refuse contributions in this manner  
as this issue was discussed in the TC a while back.

It seems as if there are two options:

1. Tell test suite users to deal with it themselves and modify the  
suite to fit the way their runtime works

2. Decompose implementation-specific contributions so that they can be  
installed as the individual negative tests are run.

#1 doesn't seem very palatable and will place a large burden on test  
suite users as they will be forced to sync their modified test suite  
with the OASIS one to accommodate changes and bug fixes.

Is there another option available or do people have a suggestion on  
how to handle this?


[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index] | [List Home]