xslt-conformance message

Subject: [xslt-conformance] Reviewed Tests and reports

From: Carmelo <carmelo@nist.gov>
To: xslt-conformance@lists.oasis-open.org
Date: Tue, 19 Mar 2002 16:05:46 -0500

Hi All:

    I finished evaluating all the Lotus/IBM tests and Microsoft.
(Please see committee page).

I also incorporated David's ideas on the anchor links and
Ken's comments (see attached files).  The Microsoft catalogue
contains inconsistent data and the anchors do not get build.
I can change the catalogue file (my local copy), however
the catalogue file included on prototype 10 seems to be
the one that needs changing.

Any comments,

Carmelo

<?xml version = "1.0"?>

<documentation>
 <headings>
  <heading id = "topHeading">
   <p></p>
    <center>
     <table width="90%" border="4">
      <tr>
       <td>
        <table>
         <tr>
          <td width="40%"><center><img height="125" width="350" src="images/a_oasis-logo.gif"></img></center></td>
         </tr>
        </table>
       </td>
      </tr>
     </table>
    </center>
    <p></p>
    <h4>OASIS XSLT/XPath Conformance Subcommittee<br>XSLT/XPath Test Suite, Version 1.0</br><br>19 March 2002</br></h4>
    <dl>
     <dt>
      <b>This version:</b>
     </dt>
     <dd>
      <ul>
       <li>
        <a href="http://www.oasis-open.org/committees/xslt/xsltconf-20020314.html">
		   http://www.oasis-open.org/committees/xslt/xsltconf-20020314.html</a>
       </li>
      </ul>
     </dd>
     <p></p>
     <dt>
      <b>Current Version:</b>
     </dt>
     <dd>
      <ul>
       <li>
         <a href="http://www.oasis-open.org/committees/xslt/xsltconf-20020314.html">
		   http://www.oasis-open.org/committees/xslt/xsltconf-20020314.html</a>
       </li>
      </ul>
     </dd>
     <p></p>
     <dt>
      <b>Validation Package:</b>
     </dt>
     <dd>
      <ul>
       <li>
         <a href="http://www.oasis-open.org/committees/xslt/call4sub-20011213.zip">
		   http://www.oasis-open.org/committees/xslt/call4sub-20011213.zip</a>
       </li>
      </ul>
     </dd>
     <p></p>
     <dt>
      <b>Test Archive:</b>
     </dt>
     <dd>
      <ul>
       <li>
        <a href="http://www.oasis-open.org/committees/xslt/contributions/proto10-result.zip">http://www.oasis-open.org/committees/xslt/contributions/proto10-result.zip</a>
       </li>
      </ul>
     </dd>
     <p></p>
     <dt>
      <b>OASIS XSL Conformance Technical Committee:</b>
     </dt>
     <dd>
      <ul>
       <li>
        <a href="http://www.oasis-open.org/committees/xslt/index.shtml">http://www.oasis-open.org/committees/xslt/index.shtml/</a>
       </li>
      </ul>
     </dd>
     <p></p>
      <dt>
       <b>Comments:</b>
      </dt>
      <dd>
      <ul>
       <li>G Ken Holman, Individual Member <a href="mailto:gkholman:gkholman@CraneSoftwrights.com">&lt;gkholman@CraneSoftwrights.com&gt;</a></li>
      </ul>
     </dd>
    <p></p>
   </dl>
  </heading>

  <heading id = "toc" value = "Table of Contents" level = "h2">
   <item id = "introd" value = "Introduction"></item>
   <item id = "categories" value = "Test Case Categories"></item>
   <item id = "descrip" value = "Test Case Descriptions">
    <sub-item id = "xsltdmt" value = "XSLT-Data-Manipulation Tests"></sub-item>
    <sub-item id = "xsltdmot" value = "XSLT-Data-Model Tests"></sub-item>
    <sub-item id = "xsltext" value = "XSLT-Extendability Tests"></sub-item>
    <sub-item id = "xsltot" value = "XSLT-Output Tests"></sub-item>
    <sub-item id = "xsltrtt" value = "XSLT-Result-Tree Tests"></sub-item>
    <sub-item id = "xsltst" value = "XSLT-Structure Tests"></sub-item>
    <sub-item id = "xslttt" value = "XSLT-Template Tests"></sub-item>
    <sub-item id = "xpathcft" value = "XPath-Core-Function Tests"></sub-item>
    <sub-item id = "xpathdmot" value = "XPath-Data-Model Tests"></sub-item>
    <sub-item id = "xpathexpt" value = "XPath-Expression Tests"></sub-item>
    <sub-item id = "xpathlpt" value = "XPath-Location-Path Tests"></sub-item>
    <sub-item id = "mixed" value = "Mixed Tests"></sub-item>
   </item>
   <item id = "contrib" value = "Contributors"></item>
  </heading>

 <heading id = "introd" value = "1 Introduction" level = "h2">
  <content>
  
   The OASIS XSLT/XPath Conformance Subcommittee is concerned with
   improving the quality of XSLT/XPath processors.  The tests
   described in this document provide an initial set of metrics
   to determine how well a particular implementation conforms to
   the W3C XSLT/XPath 1.0 Recommendations.
   <p>
    The XSLT/XPath Conformance Test Suite is intended to complement the W3C XSLT/XPath Recommendations.
    All interpretations of this Recommendations are subject to confirmation
    by the <a href="http://www.w3.org/Style/XSL/">W3C XSL Working Group</a>. 
   </p>
   Conformance tests can be used by developers, content creators, and users alike
   to increase their level of confidence in product quality. In circumstances where
   interoperability is necessary, these tests can also be used to determine that differing
   implementations support the same set of features. This report provides supporting
   documentation for all of the tests contributed by members of the OASIS XSLT/XPath 
   Conformance Subcommittee, and the public at large. Sources from which these tests have been collected include: 
   Lotus Development Corporation, Microsoft Corporation, and the National Institute of Standards and Technology (NIST). It is anticipated that this
   report will supplement the actual tests, which are available from
   <a href="http://www.oasis-open.org/committees/xslt/contributions/proto10-result.zip">http://www.oasis-open.org/committees/xslt/contributions/proto10-result.zip</a>.
   At the present time only XSLT Number tests are described in this report.
   <p>
    Comments/suggestions should be forwarded to the XSLT/XPath Conformance member, Ken Holman <a href="mailto:gkholman@CraneSoftwrights.com">&lt;gkholman@CraneSoftwrights.com&gt;</a>
   </p>
  </content>
 </heading>

 <heading id = "categories" value = "2 Test Categories" level = "h2">
  <content>
   Each test case must be associated with one of the categories that have been defined by
   the Committee. The categories are listed in the table below.
   No other categories are permitted; if a test applies to more than one category, then the
   catgeory is specified as "Mixed".  The following table lists the categories initially defined for XSLT/XPath
   tests. However, submitters should always consult the newest copy of the "howtosub.htm" file, which is part of the
   distribution package, for an up-to-date list. 
  </content>
 </heading>

 <heading id = "allowable" value = "Table 2.1 Allowable Categories of Test Cases" level = "h4">
  <table border="1">
   <colgroup>
    <col/>
    <col/>
   </colgroup>
   <tbody>
    <tr>
     <td>CATEGORY</td><td>DEFINITION</td>
    </tr>
    <tr>
     <td>Mixed</td><td>Tests that fit into more than one category</td>
    </tr>
    <tr>
     <td>XPath-Core-Function</td><td>All XPath functions</td>
    </tr>
    <tr>
     <td>XPath-Data-Model</td><td>All XPath not covered by the categories listed here</td>
    </tr>
    <tr>
     <td>XPath-Expression</td><td>Operators, type conversion</td>
    </tr>
    <tr>
     <td>XPath-Location-Path</td><td>
      <p>Axes, node tests, predicates</p>
     </td>
    </tr>
    <tr>
     <td>XSLT-Data-Manipulation</td><td>
      <p>Sort, for-each, conditionals, variables, keys</p>
     </td>
    </tr>
    <tr>
     <td>XSLT-Data-Model</td><td>
      <p>Treatment of source XML, text and whitespace, entities</p>
     </td>
    </tr>
    <tr>
     <td>XSLT-Extendability</td><td>Functions and instructions related to extendability</td>
    </tr>
    <tr>
     <td>XSLT-Output</td><td>Output, message</td>
    </tr>
    <tr>
     <td>XSLT-Result-Tree</td><td>
      <p>Creation of nodes in result</p>
     </td>
    </tr>
    <tr>
     <td>XSLT-Structure</td><td>
      <p>Stylesheet/transform, namespace, import, include</p>
     </td>
    </tr>
    <tr>
     <td>XSLT-Template</td><td>Matching, call named, priority</td>
    </tr>
   </tbody>
  </table>
 </heading>

 <heading id = "descrip" value = "3 Test Case Descriptions" level = "h2">
  <content>
    This section of this report contains descriptions of test case, each
    of which fits into the categories noted above.  In some cases, an output
    file will also be associated with a test. If such a file exists, it will
    be noted at the end of the description of the input document. The description
    for each test case is presented as a two part table. The right part describes
    what the test does.  The left part includes: 
    <ul>
     <li>An entry describing the Sections and/or Rules from the XSLT/XPath 1.0 Recommendations which this case excercises. </li>
     <li>The unique Test ID within a given Collection for this test. </li>
     <li>The Collection from which this test originated. </li>
    </ul>
    Note that the output format of this report is subject to change. 
  </content>
 </heading>

 <heading id = "xsltdmt" value = "3.1 XSLT-Data-Manipulation Tests" level = "h4">
  <content>
    This category of tests includes all of section 8 (repetition), all of section 9
   (conditional processing with xsl:if and conditional processing with xsl:choose), section 10 (sorting),
   and section 11 (variables and parameters) of the XSLT 1.0 Recommendations
  </content>
 </heading>
 <heading id = "xsltdmot" value = "3.2 XSLT-Data-Model Tests" level = "h4">
  <content>
    This category of tests inlcludes all of section 3.0 of the XSLT 1.0 Recommendations
    (Root Node Children, Base URI, Unparsed Entities and Whispace Stripping).
  </content>
 </heading>
 <heading id = "xsltext" value = "3.3 XSLT-Extendability Tests" level = "h4">
  <content>
   This category of tests includes all of section 14.0 of the XSLT 1.0 Recommendations
   (Extension Elements and Extension Functions) as well as any other extension instructions.
  </content>
 </heading>
 <heading id = "xsltot" value = "3.4 XSLT-Output Tests" level = "h4">
  <content>
   This category of tests includes all of section 16.0 of the XSLT 1.0 Recommendations
   (XML Output Method and HTML Output Method).  It also includes section 13.0 (message)
   as well as any other output related
   instructions/issues.
  </content>
 </heading>
 <heading id = "xsltrtt" value = "3.5 XSLT-Result-Tree Tests" level = "h4">
  <content>
   This category of tests includes all of section 7 of the XSLT 1.0 Recommendations 
   (Creating Elements and Attributes, Creating Text, Creating Processing Instructions,
    Creating Comments, Copying, Computing Generated Text, Numbering).
  </content>
 </heading>
 <heading id = "xsltst" value = "3.6 XSLT-Structure Tests" level = "h4">
  <content>
   This category of tests includes all of section 2.0 of the XSLT Recommendations
   (XSLT Namespace, Stylesheet Element, Literal Result Element as Stylesheet,
    Qualified Names, Forwards-Compatible Processing, Combining Stylesheets,
   Embedding Stylesheets).
  </content>
 </heading>
 <heading id = "xslttt" value = "3.7 XSLT-Template Tests" level = "h4">
  <content>
   This category of test inlcludes all of section 5.0 of the XSLT 1.0 Recommendations
   (Processing Model, Patterns, Defining Template Rules, Applying Template Rules, Conflict
   Resolution for Template Rules, Overriding Template Rules, Modes, Build-in Template Rules).
   It also includes all of section 6.0 (Named Templates).
  </content>
 </heading>
 <heading id = "xpathcft" value = "3.8 XPATH-Core-Function Tests" level = "h4">
  <content>
   This category of tests inludes all of section 4.0 of the XPath Recommendations
   (Node Set Functions, String Functions, Boolean Functions, Number Functions).
  </content>
 </heading>
 <heading id = "xpathdmot" value = "3.9 XPATH-Data-Model Tests" level = "h4">
  <content>
   This category of tests includes all of section 2.0 of the XPath 1.0 Recommendations
   (Location Steps, Axes, Node Tests, Predicates and Abbreviated Syntax)
  </content>
 </heading>
 <heading id = "xpathexpt" value = "3.10 XPATH-Expression Tests" level = "h4">
  <content>
   This category of tests includes all of section 3.0 of the XPath Recommendations
   (Basics, Function Calls, Node-sets, Booleans, Numbers, Strings and Lexical Structure)
  </content>
 </heading>
 <heading id = "xpathlpt" value = "3.11 XPATH-Location-Path Tests" level = "h4">
  <content>
   This category of tests inlcudes all of section 2.0 of the XPath Recommendations
   (Location Steps, Axes, Node Tests, Predicates, Abbreviated Syntax)
  </content>
 </heading>
 <heading id = "mixed" value = "3.12 Mixed Tests" level = "h4">
  <content>
   This category include tests that evaluates more than one feature of the XSLT/XPath Recommendations. 
  </content>
 </heading>

 <heading id = "contrib" value = "4 Contributors (Non-Normative)" level = "h3" itemNumber = "4.0">
  <content> A team of volunteer members have participated in the
             development of this work.  Contributions have come from:
  </content>

  <contributor>Mr. Ken Holman, CraneSoftwrights LTD.</contributor>
  <contributor>Mr. Carmelo Montanez, NIST</contributor>
  <contributor>Mr. David Marston, Lotus Development Corporation</contributor>
  <contributor>Mr. Lofton Henderson, Expert Contributor</contributor>
  <contributor>Mr. Pranav Kandula, Microsoft</contributor>
  <contributor>Mr. Norman Walsh, Sun Microsystems</contributor>
  <contributor>Mr. Stan Swaren, Pelican Inquiry</contributor>
  <contributor>Mrs. Lynda Van Vleet, Expert Contributor</contributor>
  <contributor>Mr. Eduardo Gutentag, Sun Microsystems Inc.</contributor>
  <contributor>Mr. Tony Graham, Sun Microsystems Inc.</contributor>
  <contributor>Mr. Kirill Gravrylyuk, Microsoft</contributor>
  <contributor>Mr. Crisman Cooley, Overdomain LCC</contributor>
 </heading>
 </headings>
</documentation>

OASIS XSLT/XPath Conformance Subcommittee
XSLT/XPath Test Suite, Version 1.0

19 March 2002

This version:

http://www.oasis-open.org/committees/xslt/xsltconf-20020314.html

Current Version:

http://www.oasis-open.org/committees/xslt/xsltconf-20020314.html

Validation Package:

http://www.oasis-open.org/committees/xslt/call4sub-20011213.zip

Test Archive:

http://www.oasis-open.org/committees/xslt/contributions/proto10-result.zip

OASIS XSL Conformance Technical Committee:

http://www.oasis-open.org/committees/xslt/index.shtml/

Comments:

G Ken Holman, Individual Member <gkholman@CraneSoftwrights.com>

Introduction
Test Case Categories
Test Case Descriptions

XSLT-Data-Manipulation Tests
XSLT-Data-Model Tests
XSLT-Extendability Tests
XSLT-Output Tests
XSLT-Result-Tree Tests
XSLT-Structure Tests
XSLT-Template Tests
XPath-Core-Function Tests
XPath-Data-Model Tests
XPath-Expression Tests
XPath-Location-Path Tests
Mixed Tests

Contributors

1 Introduction

The OASIS XSLT/XPath Conformance Subcommittee is concerned with improving the quality of XSLT/XPath processors. The tests described in this document provide an initial set of metrics to determine how well a particular implementation conforms to the W3C XSLT/XPath 1.0 Recommendations.

The XSLT/XPath Conformance Test Suite is intended to complement the W3C XSLT/XPath Recommendations. All interpretations of this Recommendations are subject to confirmation by the W3C XSL Working Group.

Conformance tests can be used by developers, content creators, and users alike to increase their level of confidence in product quality. In circumstances where interoperability is necessary, these tests can also be used to determine that differing implementations support the same set of features. This report provides supporting documentation for all of the tests contributed by members of the OASIS XSLT/XPath Conformance Subcommittee, and the public at large. Sources from which these tests have been collected include: Lotus Development Corporation, Microsoft Corporation, and the National Institute of Standards and Technology (NIST). It is anticipated that this report will supplement the actual tests, which are available from http://www.oasis-open.org/committees/xslt/contributions/proto10-result.zip. At the present time only XSLT Number tests are described in this report.

Comments/suggestions should be forwarded to the XSLT/XPath Conformance member, Ken Holman <gkholman@CraneSoftwrights.com>

2 Test Categories

Each test case must be associated with one of the categories that have been defined by the Committee. The categories are listed in the table below. No other categories are permitted; if a test applies to more than one category, then the catgeory is specified as "Mixed". The following table lists the categories initially defined for XSLT/XPath tests. However, submitters should always consult the newest copy of the "howtosub.htm" file, which is part of the distribution package, for an up-to-date list.

Table 2.1 Allowable Categories of Test Cases

CATEGORY	DEFINITION
Mixed	Tests that fit into more than one category
XPath-Core-Function	All XPath functions
XPath-Data-Model	All XPath not covered by the categories listed here
XPath-Expression	Operators, type conversion
XPath-Location-Path	Axes, node tests, predicates
XSLT-Data-Manipulation	Sort, for-each, conditionals, variables, keys
XSLT-Data-Model	Treatment of source XML, text and whitespace, entities
XSLT-Extendability	Functions and instructions related to extendability
XSLT-Output	Output, message
XSLT-Result-Tree	Creation of nodes in result
XSLT-Structure	Stylesheet/transform, namespace, import, include
XSLT-Template	Matching, call named, priority

3 Test Case Descriptions

This section of this report contains descriptions of test case, each of which fits into the categories noted above. In some cases, an output file will also be associated with a test. If such a file exists, it will be noted at the end of the description of the input document. The description for each test case is presented as a two part table. The right part describes what the test does. The left part includes: An entry describing the Sections and/or Rules from the XSLT/XPath 1.0 Recommendations which this case excercises. The unique Test ID within a given Collection for this test. The Collection from which this test originated. Note that the output format of this report is subject to change.

3.1 XSLT-Data-Manipulation Tests

This category of tests includes all of section 8 (repetition), all of section 9 (conditional processing with xsl:if and conditional processing with xsl:choose), section 10 (sorting), and section 11 (variables and parameters) of the XSLT 1.0 Recommendations

No tests are available for this category.

3.2 XSLT-Data-Model Tests

This category of tests inlcludes all of section 3.0 of the XSLT 1.0 Recommendations (Root Node Children, Base URI, Unparsed Entities and Whispace Stripping).

No tests are available for this category.

3.3 XSLT-Extendability Tests

This category of tests includes all of section 14.0 of the XSLT 1.0 Recommendations (Extension Elements and Extension Functions) as well as any other extension instructions.

No tests are available for this category.

3.4 XSLT-Output Tests

This category of tests includes all of section 16.0 of the XSLT 1.0 Recommendations (XML Output Method and HTML Output Method). It also includes section 13.0 (message) as well as any other output related instructions/issues.

No tests are available for this category.

3.5 XSLT-Result-Tree Tests

This category of tests includes all of section 7 of the XSLT 1.0 Recommendations (Creating Elements and Attributes, Creating Text, Creating Processing Instructions, Creating Comments, Copying, Computing Generated Text, Numbering).

Sections/Places	7.7
Test ID:	LotusIBM_numbering_numbering01
Collection:	Lotus/IBM

Test of numbering of multi-level document with no attributes specified.