QT3TS_Conformance

QT3TS Conformance Summary

This page provides an overview of the QT3TS X(ml)² XPath engine test harness results. The QT3Testsuite contains a huge number of XPath and XQuery test cases. Some of them are relevant for the X(ml)² XPath engine, some not (e.g. XQuery tests) and some are skipped for other reasons. This page(s) lists all QT3TS test cases and the exclude reasons for those that are skipped.

For performance improvements the test cases of the QT3TS are splitted into test groups by subjects. Each test group has its own page, listing all test cases. This page just provides a summary.

Test Group	Tests	Passed	Skipped
All groups	31819	22041	9778
Functions	11133	9657	1476
Map-Functions	220	219	1
Array-Functions	209	183	26
Math-Functions	149	149	0
Operators	4366	3544	822
Basic XPath Language	12207	7038	5169
Use Cases and Applications	2157	942	1215
XSD-Features	164	137	27
Serializations	343	0	343
Miscellaneous	871	172	699

Ignore Reasons

The following table gives an overview of all reasons to exclude a test case of the QT3 Testsuite from being executed. The reasons are referanced on the detail pages by there Reason Code.

Reason Code	Description	Number of Ignored Tests
OTH-CMT	Comment nested in comments are ignored by the XPM parser...	1
SHE-XQY	XQuery evaluation is not supported by Saxon-HE	75
BBO-CPP	Issue with cp protocol: see https://github.com/cmarchand/cp-protocol/issues/1	12
BBO-TSB	Bug in the QT3 testsuite: https://github.com/w3c/qt3tests/issues/64	2
BBO-FOUT	Saxon-HE throws FOUT1170 instead of FOUT1190! See https://saxonica.plan.io/issues/5952#note-8	1
SHE-LNG	Saxon-HE does not support out of the box other languages than "en"	18
RES-XML1-1	X(ml)² does not support XML version 1.1	33
RES-STY	Static typing is not supported by the XPath engine	75
OTH-MEM	Java heap size problems	1
RES-XP1	XPath 1.0 compatibility mode is not supported by the XPath engine	5
SHE-XSD	Schema-awareness is not supported by Saxon-HE	959
SHE-UNC	FULLY-NORMALIZED is not supported by Saxon: "Saxon supports normalization forms NFC, NFD, NFKC, and NFKD" (https://www.saxonica.com/documentation12/index.html#!functions/fn/normalize-unicode).	2
RES-XP3-1	The XPath engine supports only XPath 3.1.	9329
TST-ENV	Its hard to ensure that an env variable is set by the calling system...	1
SHE-COL_1	Saxon-HE does not support the advanced UCA collation format	31
SHE-COL_2	Saxon-HE does not support this collation format	22
TST-SUT	requires: Feature.STABLE_UNPARSED_TEXT that leads to problems with other test cases...	2
TST-XSLT	This testcase handles behavior of the processor if XSLT is not supported. The feature XSLT by the XPath engine is always active.	4

Find the details of the skipped test cases for each test group:

• Functions* Map-Functions* Array-Functions* Math-Functions* Operators* Basic XPath Language* Use Cases and Applications* XSD-Features* Serializations* Miscellaneous