Re: [tosca] key_schema in TOSCA 1.3?

[Tal Liron <tliron@redhat.com>]

On Wed, Sep 18, 2019 at 4:22 PM Chris Lauwers <lauwers@ubicity.com> wrote:

I find that the biggest challenge is to create ânegativeâ test cases (i.e. TOSCA files with specific errors that the TOSCA parser/validator is expected to flag). Itâs challenging to automate such tests without standardizing output formats.

One solution could be to write all the tests in a nice dynamic language (Python?) which would make it easy to implement an output-fetching-API. So, essentially ever parser would have to write their own custom adapter for the test suite.

I agree that it's extremely challenging to create a test suite for a language. I would even say that it's an art form, due to the infinite complexity of possibilities. But it's not impossible to create something useful. :)