OASIS Mailing List ArchivesView the OASIS mailing list archive below
or browse/search using MarkMail.

 


Help: OASIS Mailing Lists Help | MarkMail Help

cgmo-webcgm message

[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index] | [List Home]


Subject: Updated static10 and dynamic10 matrices


Hello all,

I have added the test results.  If there are any last minute corrections
please let me know.  I should have off and on email access Monday and
Tuesday. 

--
Stuart Galt
SGML Resource Group
stuart.a.galt@boeing.com
(206) 544-3656

Title: WebCGM 2.0 "static10" Implementation Matrix

WebCGM 2.0 "static10" Implementation Matrix
dd MMM 2006

Latest version:
http://docs.oasis-open.org/webcgm/test-materials/static10-matrix.html
This version:
http://docs.oasis-open.org/webcgm/test-materials/s10matrix-2006mmdd.html
Previous version:
http://docs.oasis-open.org/webcgm/test-materials/s10matrix-2006mmdd.html

This document describes the results of WebCGM 2.0 implementations tested against those static-graphics tests of the WebCGM 2.0 Test Suite that are derived from and mostly identical to the static tests of the WebCGM 1.0 Test Suite (whose ZIP file can be downloaded directly at this location.)

Information about the implementations and a legend explaining the table are found after the table.

A column represents full results for the 232 static tests only if there is a "(!)" in the column header. (Otherwise, it is just table initialization, or partial results.)

WebCGM 1.0/2.0 static tests
Test Name IsoView(!)   VizEx   SDI Reader(!) MetaWeb       TI       Comments
ALLELM01 Ok Ok Ok Ok Ok
APNTXT01 Ok Ok Ok Ok Ok
APNTXT02 Ok Ok Ok Ok Ok
ARCFUL01 Ok Ok Ok Ok Qualified (ti1)
ARCTST01 Ok Ok Ok Ok Ok
ARCTST02 Ok Ok Ok Ok Ok
ARCTST03 Ok Ok Ok Ok Ok
ARCTST04 Ok Ok Ok Ok Ok
ARCTST05 Ok Ok Ok Ok Ok
ARCTST06 Ok Ok Ok Ok Ok
BGCOLR01 Ok Ok Ok Ok Ok
BGCOLR02 Ok Ok Ok Ok Ok
BGCOLR03 Ok Ok Ok Ok Ok
BGCOLR04 Ok Ok Ok Ok Ok
BIGCGM01 Ok Ok Ok Ok Ok
BIGCGM02 Ok Ok Ok Ok Ok
BIGCGM03 Ok Ok Ok Ok Ok
BIGCGM04 Ok Ok Ok Ok Ok
BIGCGM05 Ok Ok Ok Ok Ok
CELARY01 Ok Ok Ok Ok Fail
CELARY02 Ok Ok Ok Ok Fail
CELARY03 Ok Ok Ok Ok Fail
CELARY04 Ok Ok Ok Ok Fail
CELARY05 Ok Ok Ok Ok Fail
CELARY06 Ok Ok Ok Ok Ok
Test Name IsoView(!)   VizEx   SDI Reader(!) MetaWeb       TI       Comments
CELARY07 Ok Ok Ok Ok Ok
CHRHGT01 Ok Ok Ok Ok Ok
CHRHTLN Ok Ok Ok Ok Ok
CHRORI01 Ok Ok Ok Ok Ok
CHRSET01 Ok Ok Ok Ok Ok
CHRSET02 Ok Ok Ok Ok Ok
CHRSPA01 Ok Ok Fail(indef) Ok Fail
CIRARC01 Ok Ok Ok Ok Ok
CIRARC02 Ok Ok Ok Ok Ok
CIRARC03 Ok Ok Ok Ok Ok
CIRCLE01 Ok Ok Ok Ok Ok
CIRCLE02 Ok Ok Ok Ok Ok
CIRCLE03 Ok Ok Ok Ok Ok
CLIPNG01 Ok Ok Ok Ok Qualified (ti2)
CLIPNG02 Ok Ok Ok Ok Qualified (ti2)
CLIPNG03 Ok Ok Ok Ok Qualified (ti2)
CLIPNG04 Ok Ok Ok Ok Fail
CLIPNG05 Ok Ok Ok Ok Fail
COLIPR01 Ok Ok Ok Ok Ok
COLIPR02 Ok Ok Ok Ok Ok
COLLVL01 Ok Ok Ok Ok Ok
COLLVL02 Ok Ok Ok Ok Ok
COLLVL03 Ok Ok Ok Ok Ok
COLLVL04 Ok Ok Ok Ok Ok
COLRMD01* Ok Ok Ok Ok Fail
Test Name IsoView(!)   VizEx   SDI Reader(!) MetaWeb       TI       Comments
COLRMD02* Ok Ok Ok Ok Fail
COLRPR01 Ok Ok Ok Ok Ok
COLRPR02 Ok Ok Ok Ok Ok
COLTAB01 Ok Ok Ok Ok Ok
COLTAB02 Ok Ok Ok Ok Ok
COLVAL01 Ok Ok Ok Ok Ok
COLVAL02 Ok Ok Ok Ok Ok
COLVAL03 Ok Ok Ok Ok Ok
COLVAL04 Ok Ok Ok Ok Ok
CRAR3C01 Ok Ok Ok Ok Qualified (ti3)
CRAR3C02 Ok Ok Ok Ok Ok
CRAR3C03 Ok Ok Ok Ok Ok
CRARC301 Ok Ok Ok Ok Ok
CRARC302 Ok Ok Ok Ok Ok
CRARC303 Ok Ok Ok Ok Ok
CRARCC01 Ok Ok Ok Ok Qualified (ti3)
CRARCC02 Ok Ok Ok Ok Ok
CRARCC03 Ok Ok Ok Ok Ok
DEFVAL01 Ok Ok Ok Ok Qualified (Partial pass)
DESORD01 Ok Ok Ok Ok Ok
DGNTST01 Ok Ok Ok Ok Fail (06-08-31)
DGNTST02 Ok Ok Ok Ok Fail (06-08-31)
DGNTST03 Ok Ok Ok Ok Fail
DGNTST04 Ok Ok Ok Ok Qualified (ti4)
DGNTST06 Ok Ok Ok Ok Ok
Test Name IsoView(!)   VizEx   SDI Reader(!) MetaWeb       TI       Comments
DIRCOL01 Ok Ok Ok Ok Ok
DPLYLN01 Ok Ok Ok Ok Fail (ti5)
EDGCOL01 Ok Ok Ok Ok Ok
EDGSTL01 Ok Ok Ok Ok Ok
ELARCC01 Ok Ok Ok Ok Qualified (ti6)
ELARCC02 Ok Ok Ok Ok Qualified (ti6)
ELARCC03 Ok Ok Ok Ok Qualified (ti6)
ELARCC04 Ok Ok Ok Ok Ok
ELARCC05 Ok Ok Ok Ok Ok
ELLARC01 Ok Ok Ok Ok Ok
ELLARC02 Ok Ok Ok Ok Ok
ELLARC03 Ok Ok Ok Ok Ok
ELLARC04 Ok Ok Ok Ok Ok
ELLARC05 Ok Ok Ok Ok Ok
ELLIPS01 Ok Ok Ok Ok Ok
ELLIPS02 Ok Ok Ok Ok Ok
ELLIPS03 Ok Ok Ok Ok Ok
EMTPCT01 Ok Ok Ok Ok Fail
EMTPCT02 Ok Ok Ok Ok Fail
ESCAPE01 Ok (iv1) Ok Fail(06-09-01) Ok Fail
ESCAPE02 Ok Ok Ok Ok Fail
FIGURE01 Ok Ok Ok Ok Ok
FIGURE02 Ok Ok Ok Ok Ok
FIGURE03 Ok Ok Ok Ok Qualified (Partial pass)
FIGURE04 Ok Ok Ok Ok Ok
Test Name IsoView(!)   VizEx   SDI Reader(!) MetaWeb       TI       Comments
FIGURE05 Ok Ok Ok Ok Ok
FIGURE06 Ok Ok Ok Ok Ok
FIGURE07 Ok Ok Ok Ok Ok
FNTLST01 Ok Ok Ok Ok Ok
FNTLST02 Ok Ok Ok Ok Ok
FNTLST03 Ok Ok Ok Ok Qualified (Partial pass)
FNTLST04 Ok Ok Ok Ok Ok
FNTLST05 Ok Ok Ok Ok Ok
FNTLST06 Ok Ok Ok Ok Ok
FNTLST07 Ok Ok Ok Ok Ok
INTSTL01 Ok Ok Ok Ok Ok
INTSTL02 Ok Ok Ok Ok Ok
INTSTL03 Ok Ok Ok Ok Ok
INTSTL04 Ok Ok Ok Ok Ok
INTSTL05 Ok Ok Ok Ok Fail
INTSTL06 Ok Ok Ok Ok Fail
INTSTL07 Ok Ok Ok Ok Fail
INTSTL08 Ok Ok Ok Ok Fail
LINCAP01 Ok Ok Ok Ok Qualified (ti7)
LINCAP02* Ok Ok Ok Ok Qualified (ti7)
LINCOL01 Ok Ok Ok Ok Ok
LINSTD01 Ok Ok Ok Ok Qualified (ti8)
LINSTD02 Ok Ok Ok Ok Ok
LINSTD03 Ok Ok Ok Ok Qualified (ti8)
LINSTL01 Ok Ok Ok Ok Ok
Test Name IsoView(!)   VizEx   SDI Reader(!) MetaWeb       TI       Comments
LINSTL02 Ok Ok Ok Ok Ok
LINSTL03 Ok Ok Ok Ok Ok
LINSTL04 Ok Ok Ok Ok Ok
LINSTL05 Ok Ok Ok Ok Ok
LINSTL06 Ok Ok Ok Ok Fail
LINSTL07 Ok Ok Ok Ok Fail
LINSTL08 Ok Ok Ok Ok Fail
LINSTL09 Ok Ok Ok Ok Ok
LINSTL10 Ok Ok Ok Ok Ok
LINSTL11 Ok Ok Ok Ok Ok
LINSTL12 Ok Ok Ok Ok Fail
LINSTL13 Ok Ok Ok Ok Ok
LINSTL14 Ok Ok Ok Ok Ok
LINSTL15 Ok Ok Ok Ok Ok
LNJOIN01 Ok Ok Ok Ok Qualified (ti9)
MDRTST01 Ok Ok Ok Ok Ok
MDRTST02 Ok Ok Ok Ok Fail
MFDESC01 Ok Ok Ok Ok Ok
MFELLS01 Ok Ok Ok Ok Ok
MFELLS02 Ok Ok Ok Ok Ok
MITRLM01* Qualified Ok Qualified Ok Ok Reference result uncertain.
NOGTXT01 Ok Ok Ok Ok Ok
PATTBL01 Qualified
(iv2)
Ok Fail
(indef)
Ok Fail
PATTBL02 Qualified
(iv2)
Ok Fail
(indef)
Ok Fail
PLGSET01 Ok Ok Ok Ok Ok
Test Name IsoView(!)   VizEx   SDI Reader(!) MetaWeb       TI       Comments
PLGSET02 Ok Ok Ok Ok Ok
PLGSET03 Ok Ok Ok Ok Ok
PLGSET04 Ok Ok Ok Ok Ok
PLGSET05 Qualified
Ok Ok Ok Ok
PLGSET06 Ok Ok Ok Ok Ok
POLYBZ01 Ok Ok Ok Ok Ok
POLYBZ02 Ok Ok Ok Ok Ok
POLYBZ03 Ok Ok Ok Ok Ok
POLYBZ04 Ok Ok Ok Ok Fail
POLYBZ05 Ok Ok Ok Ok Ok
POLYBZ06 Ok Ok Ok Ok Qualified (Partial pass)
POLYGN01 Ok Ok Ok Ok Ok
POLYGN02 Ok Ok Ok Ok Ok
POLYGN03 Ok Ok Ok Ok Ok
POLYGN04 Ok Ok Ok Ok Ok
POLYLN01 Ok Ok Ok Ok Ok
POLYLN02 Ok Ok Ok Ok Ok
POLYLN03 Ok Ok Ok Ok Ok
POLYLN04 Ok Ok Ok Ok Ok
POLYMK01 Ok Ok Ok Ok Ok
POLYMK02 Ok Ok Ok Ok Ok
POLYMK03 Ok Ok Ok Ok Ok
RCTNGL01 Ok Ok Ok Ok Ok
RCTNGL02 Ok Ok Ok Ok Ok
REALPR01 Ok Ok Ok Ok Ok
Test Name IsoView(!)   VizEx   SDI Reader(!) MetaWeb       TI       Comments
REALPR02 Ok Ok Ok Ok Ok
RESTXT01 Ok Ok Ok Ok Ok
RESTXT02 Ok Ok Ok Ok Ok
ROTTXT01 Ok Ok Ok Ok Ok
ROTTXT02 Ok Ok Ok Ok Qualified (Partial pass)
SCHEMA01 Ok Ok Ok Ok Ok
SCHEMA02 Ok Ok Ok Ok Ok
SCHEMA03 Ok Ok Ok Ok Ok
SCHEMA04 Ok Ok Ok Ok Ok
SCHEMA05 Ok Ok Ok Ok Qualified (Partial pass) PNG wrong --
missing some shading
SCLMOD01 Ok Ok Ok Ok Ok
SPECMD01 Ok Ok Ok Ok Ok
SPECMD02 Ok Ok Ok Ok Ok
SPECMD03 Ok Ok Ok Ok Fail
SPECMD04 Ok Ok Ok Ok Qualified (Partial pass)
SPECMD05 Ok Ok Ok Ok Fail pc1 -- PNG comment
TABTNL01 Ok Ok Ok Ok Ok
TABTNL02 Ok Ok Ok Ok Ok
TXTALN01 Ok Ok Ok Ok Ok
TXTALN02 Ok Ok Ok Ok Ok
TXTALN03 Ok Ok Ok Ok Ok
TXTALN04 Ok Ok Ok Ok Ok
TXTALN05 Ok Ok Ok Ok Fail
TXTALN06 Ok Ok Ok Ok Ok
TXTALN07 Ok Ok Ok Ok Fail
Test Name IsoView(!)   VizEx   SDI Reader(!) MetaWeb       TI       Comments
TXTALN08 Ok Ok Ok Ok Ok
TXTALN09 Ok Ok Ok Ok Ok
TXTALN10 Ok Ok Ok Ok Ok
TXTALN11 Ok Ok Ok Ok Ok
TXTALN12 Ok Ok Ok Ok Ok
TXTALN13 Ok Ok Ok Ok Ok
TXTALN14 Ok Ok Ok Ok Fail
TXTALN15 Ok Ok Ok Ok Fail
TXTALN16 Ok Ok Ok Ok Fail
TXTALN17 Ok Ok Ok Ok Ok
TXTALN18 Ok Ok Ok Ok Ok
TXTALN19 Ok Ok Ok Ok Ok
TXTALN20 Ok Ok Ok Ok Ok
TXTALN21 Ok Ok Ok Ok Ok
TXTALN22 Ok Ok Ok Ok Ok
TXTALN23 Ok Ok Ok Ok Ok
TXTCOL01 Ok Ok Ok Ok Ok
TXTLEN01 Ok Ok Ok Ok Ok
TXTPTH01 Ok Ok Ok Ok Ok
TXTPTH02 Ok Ok Ok Ok Ok
TXTPTH03 Ok Ok Ok Ok Ok
VDCEXT01 Ok Ok Ok Ok Ok
VDCEXT02 Ok Ok Ok Ok Ok
VDCEXT03 Ok Ok Ok Ok Ok
VDCEXT04 Ok Ok Ok Ok Ok
Test Name IsoView(!)   VizEx   SDI Reader(!) MetaWeb       TI       Comments
VDCEXT05 Ok Ok Ok Ok Ok
VDCEXT06 Ok Ok Ok Ok Ok
VDCEXT07 Ok Ok Ok Ok Ok
VDCINT01 Ok Ok Ok Ok Ok
VDCRPR01 Ok Ok Ok Ok Ok
VDCRPR02 Ok Ok Ok Ok Ok
ZEROSZ01 Ok Ok Ok Ok Ok

Implementations Tested

The following table lists the implementations that are covered by the test results.

Company Name** Product Version Platform
Itedo Software IsoView IsoView 6.0 Windows XP
Larson Software Technology VizEx VizEx [tbd] [tbd]
System Development Inc SDI Reader SDI Reader [tbd] [tbd]
Ematek GmbH MetaWeb MetaWeb 3.0 Windows XP
Auto-trol Technology
(viewer portion for static gfx)
TI Tech Illustrator [tbd] Windows XP

** Nickname used for the viewer in the below tables (to distinguish multiple viewers from a Company).

"(!)" after the product nickname in the table headers indicates complete actual results. Otherwise, it is just table initial value, or incomplete results.

Legend

Type Description
Ok Implementation passes test
Fail(date) Implementation does not pass test. (Committed pass date)***
Qualified(date) Implementation passes part of the test, but not enough to give a full pass.
(Committed pass date.)***
Unknown The implementation behavior is unknown or indeterminate for the test.
Inactive An implementation is planned, but not yet advanced enough for testing.

*** 'indef' means that vendor cannot estimate or commit, when it will pass.

Comments from table

  • iv1 -- this test and several others show variation in pattern size. However that is not part of the verdict criteria of the test, so it's status is "Ok" (Pass).
  • iv2 -- for PATTBL02, it is clear that the implementation uses the correct patterns, but the size is off. "Partial" is probably the best status, as the size is related to the verdict criteria, if only indirectly. PATTBL01 is similar, except the reference PNG is too-low resolution to discern the exact pattern(s).
  • pc1 -- the test admits to variation in exact rendering of dashes, hence where corners fall in dash pattern, hence presence/absence of mitres on some corners.
  • ti1 -- Partial pass, the two upper left arcs are missing.
  • ti2 -- Partial pass, cell array is not the correct size.
  • ti3 -- Partial pass, the pattern interiors are not correctly rendered.
  • ti4 -- Partial pass, the two upper left arcs are missing.
  • ti5 -- Note. The PNG image is incorrect. In the upper right of the picture there are Disjoint Polylines with line types 2, 3, 4, and 5 (two of the latter). None of these lines are correctly rendered. The type 3 (dot) line appears as a type 2 (dash) line. The other line types 2, 4, and 5 all appear to be the same type and most closely resemble registered type 10 (chain). We fail because we do not handle the degeneracy at 350, 200.
  • ti6 -- Partial pass, the pattern interiors are not correctly rendered.
  • ti7 -- Partial pass, butt OK, other two fail.
  • ti8 -- Partial pass. The PNG is incorrect. Line type -7 has 0 for the dash lengths in the LETD element. According to CGM99, these are supposed to be drawn as dots. A line of this type occurs in the CGM file beginning at (700,500) and nothing is visible at that location in the PNG file. Also line type -4 has a dot in its definition, and a line of this type occurs beginning at (900,800). Again, the dot is not apparent in the PNG file.
  • ti9 -- Partial pass, mitre OK, other two fail.

Title: WebCGM 2.0 "dynamic10" Implementation Matrix

WebCGM 2.0 "dynamic10" Implementation Matrix
dd MMM 2006

Latest version:
http://docs.oasis-open.org/webcgm/test-materials/dynamic10-matrix.html
This version:
http://docs.oasis-open.org/webcgm/test-materials/d10matrix-2006mmdd.html
Previous version:
http://docs.oasis-open.org/webcgm/test-materials/d10matrix-2006mmdd.html

This document describes the results of WebCGM 2.0 implementations tested against those dynamic-graphics tests of the WebCGM 2.0 Test Suite that are derived from and mostly identical to the dynamic tests of the WebCGM 1.0 Test Suite, with updates to nine tests to adjust for some changed rules. (The 1.0 ZIP file can be downloaded directly at this location.)

Information about the implementations and a legend explaining the table are found after the table.

WebCGM 1.0/2.0 dynamic tests
Test Name IsoView(9)   VizEx   SDI Reader(9) MetaWeb Comments
linking-basicH2C-BE-01 Ok Ok Ok Ok
linking-basicC2H-BE-02 Ok Ok Ok Ok
linking-basicC2C-BE-03 Ok Ok Ok Ok
linking-basicC2P-BE-04 Ok Ok Ok Ok
linking-selectId-BE-05+ Ok Ok Fail Ok
linking-selectName-BE-06+ Ok Ok Fail Ok
linking-anyURI-BE-07+ Ok Ok Ok Ok
linking-multiLink-BE-08 Ok Ok Ok Ok
behavior-picBlankC2C-BE-01 Ok Ok Ok Ok
behavior-picReplaceC2C-BE-02 Ok Ok Ok Ok
behavior-picBlankC2H-BE-03 Ok Ok Ok Ok
behavior-picTargetC2H-BE-04 Ok Ok Ok Ok
behavior-objHighlight-BE-05+ Fail Ok Ok Ok
behavior-objHighlightAll-BE-06+ Fail Ok Ok Ok
behavior-objViewContext-BE-07+ Qualified Ok Ok Ok
fragment-idC2H-BE-01 Qualified Ok Ok Ok
fragment-fiveForms-BE-03 Ok Ok Ok Ok
interact-pick-BE-01 Ok Ok Ok Ok
interact-pickRegion-BE-02 Ok Ok Ok Ok
interact-screenTip-BE-03+ Ok Ok Ok Ok
otherAPS-para-BE-01+ Ok Ok Fail Ok
otherAPS-para-BE-02+ Ok Ok Fail Ok

Implementations Tested

The following table lists the implementations that are covered by the test results.

Company Name** Product Version Platform
Itedo Software IsoView IsoView 6.0 Windows XP
Larson Software Technology VizEx VizEx [tbd] [tbd]
System Development Inc SDI Reader SDI Reader [tbd] [tbd]
Ematek GmbH MetaWeb MetaWeb 3.0 Windows XP
Auto-trol Technology
(viewer portion for static gfx)
TI Tech Illustrator [tbd] Windows XP

** Nickname used for the viewer in the below tables (to distinguish multiple viewers from a Company).

"(!)" after the product nickname in the table headers indicates complete actual results. Otherwise, it is just table initial value, or incomplete results.

Legend

Type Description
Ok Implementation passes test
Fail(date) Implementation does not pass test. (Committed pass date)***
Qualified(date) Implementation passes part of the test, but not enough to give a full pass.
(Committed pass date.)***
Unknown The implementation behavior is unknown or indeterminate for the test.
Inactive An implementation is planned, but not yet advanced enough for testing.

*** 'indef' means that vendor cannot estimate or commit, when it will pass.



[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index] | [List Home]