Fwd: Notes on the test suite

[Lofton Henderson <lofton@rockynet.com>]

All,

Rob sent these notes to me.  Long story short, the js/html harness is out 
of date, in about 20 descriptions.

For background, the harness is for static10 only, and was slapped together 
by a NIST intern, and I'm afraid I've done a poor job of keeping its 
"operator script" descriptions current.  While it is not as nice as 
subsequent harnesses, that present subject and reference image 
side-by-side, on the other hand it is useful in that it contains a 
statement of each Test Purpose, plus the "verdict criteria" for the test.

Some day ... in spare time ... I'll try to get these harness updates 
done.  (Might be a good use for long airplane flight.)

-Lofton.


>From: Robert Orosz <roboro@auto-trol.com>
>To: "Lofton Henderson (E-mail)" <lofton@rockynet.com>
>Cc: "Stuart A Galt (E-mail)" <stuart.a.galt@boeing.com>
>Subject: Notes on the test suite
>Date: Fri, 11 Aug 2006 13:13:01 -0600
>
>Lofton,
>
>My tester has completed the task of testing TI with all of the static tests
>in the test suite. I am going through the results and will send you a report
>as soon as possible. He also found some errors and omissions in the test
>suite which I thought that I'd pass along first.
>
>ARCFUL01 - Check Points are "...TBD..." in the HTML test harness.
>[...cut COLLVL03.png report...]
>CHRHTLN - CGM Purpose and Check Points are "...TBD..." in the HTML test
>harness.
>COLRMD01 - Check point 6 in the HTML test harness states that the green
>rectangle should have a red edge. This disagrees with both the original PNG
>image and the new one that Forrest generated.
>DGNTST05 - This is missing from the HTML test harness.
>DGNTST06 - CGM Purpose and Check Points are "...TBD..." in the HTML test
>harness.
>FNTLST03 - Check Point 3 says that there are 8 strings, however, the CGM
>file only has 4 (not counting the test identification strings).
>INTSTL07 - CGM Purpose and Check Points are "...TBD..." in the HTML test
>harness.
>INTSTL08 - CGM Purpose and Check Points are "...TBD..." in the HTML test
>harness.
>LINSTD01 - CGM Purpose and Check Points are "...TBD..." in the HTML test
>harness.
>LINSTD02 - CGM Purpose and Check Points are "...TBD..." in the HTML test
>harness.
>LINSTD03 - CGM Purpose and Check Points are "...TBD..." in the HTML test
>harness.
>PLGSET06 - Check Point 2 in the HTML test harness says "Verify that the test
>case identification string containing PLGSET05 ..."
>POLYBZ06 - Check Point 3 in the HTML test harness is incorrect. The line
>type of polybezier 2 is dash, not dash-dot.
>POLYMK01 - Check Point 3 in the HTML test harness is incorrect. It should
>say: "Verify that the picture contains 5 polymarkers: a white dot; a black
>asterisk, circle, and two crosses."
>POLYMK02 - Check Point 3 in the HTML test harness is incorrect. It should
>say: "Verify that the picture contains 5 polymarkers: a yellow plus; blue
>asterisk, green circle, red cross, and black cross."
>SPECMD04 - Check points 4 and 5 were unclear to my tester ( size(of
>what?)/width(of what?) ). They are unclear to me also. I have not had a
>chance to look at the CGM yet.
>TABTNL01 - CGM Purpose and Check Points are "...TBD..." in the HTML test
>harness.
>TABTNL02 - CGM Purpose and Check Points are "...TBD..." in the HTML test
>harness.
>TXTPTH03 - Check Points 3 and 4 in the HTML test harness are incorrect. They
>mention text strings that do not exist in the CGM file.
>VDCINT01 - Check Point 3 in the HTML test harness is incorrect. It states
>that the black line crosses through the identification string. It does not.
>ZEROSZ01 - CGM Purpose and Check Points are "...TBD..." in the HTML test
>harness.
>
>Regards,
>
>Rob