Approved tests only.
Passes: 248
Failures: 99
Skipped: 81
Tested:
- GIT f6dc577f44caaf47da739354595153d2b6553824
- Thu Nov 27 10:22:33 2014 -0800
- with PCRE regex library for Unicode
Against SPARQL 1.1 tests:
- GIT a39d47f7cdc0104b80c0049225356278dd9c3600
- Wed Nov 27 14:41:05 2013 -0800
aggregates 3
bind 1
csv-tsv-res 3
exists 5
functions 11
grouping 1
json-res 4
negation 11
property-path 24
service-description 3
service 6
subquery 2
syntax-query 15
syntax-update-1 9
Requires passing sections (* = failures above):
aggregates bind bindings construct exists functions grouping
negation project-expression property-path subquery syntax-query
Currently pass:
bindings construct grouping project-expression
Requires passing sections (* = failures above):
add basic-update clear copy delete-data delete-insert
delete-where delete drop move syntax-update-1 syntax-update-2
update-silent
Currently pass: (most tests such as those of type ut:UpdateEvaluationTest are skipped)
syntax-update-2
aggregates/manifest#agg08b "grouping by expression, done correctly"
-
Variable scoping of O12 defined in SELECT and GROUP BY
check-sparql: 'COUNT 8b' FAILED (Expected 5 results, got 1) roqet -d debug -W 0 -i sparql11 -D agg08.ttl agg08b.rq Difference is: --- result.out 2012-03-24 21:06:10.000000000 -0700 +++ roqet.out 2012-03-24 21:06:10.000000000 -0700 @@ -1,5 +1 @@ -result: [O12=string("0"^^http://www.w3.org/2001/XMLSchema#integer), C=string("1"^^http://www.w3.org/2001/XMLSchema#integer)] -result: [O12=string("1"^^http://www.w3.org/2001/XMLSchema#integer), C=string("2"^^http://www.w3.org/2001/XMLSchema#integer)] -result: [O12=string("2"^^http://www.w3.org/2001/XMLSchema#integer), C=string("3"^^http://www.w3.org/2001/XMLSchema#integer)] -result: [O12=string("3"^^http://www.w3.org/2001/XMLSchema#integer), C=string("2"^^http://www.w3.org/2001/XMLSchema#integer)] -result: [O12=string("4"^^http://www.w3.org/2001/XMLSchema#integer), C=string("1"^^http://www.w3.org/2001/XMLSchema#integer)] +result: [O12=string("4"^^http://www.w3.org/2001/XMLSchema#integer), C=string("9"^^http://www.w3.org/2001/XMLSchema#integer)]
aggregates/manifest#agg-groupconcat-02
-
???? variable scope???
check-sparql: 'GROUP_CONCAT 2' FAILED (exited with status 1) roqet -d debug -W 0 -i sparql11 -D agg-groupconcat-1.ttl agg-groupconcat-2.rq roqet: Error - URI file:///Users/dajobe/dev/redland/testing/sparql11/data-sparql11/aggregates/agg-groupconcat-2.rq:1 - Variable c was not bound and not used in the query (where is it from?) ...
aggregates/manifest#agg-min-02
-
Wrong double format
check-sparql: 'MIN with GROUP BY' FAILED roqet -d debug -W 0 -i sparql11 -D agg-numeric.ttl agg-min-02.rq --- result.out 2012-03-24 21:06:14.000000000 -0700 +++ roqet.out 2012-03-24 21:06:14.000000000 -0700 -result: [s=urihttp://www.example.org/mixed2, min=string("2.0E-1"^^http://www.w3.org/2001/XMLSchema#double)] +result: [s=urihttp://www.example.org/mixed2, min=string("2E-1"^^http://www.w3.org/2001/XMLSchema#double)]
bind/manifest#bind07
-
Variable scoping of binding ?z in two parts of a UNION ????
check-sparql: 'bind07 - BIND' FAILED roqet -d debug -W 0 -i sparql11 -D data.ttl bind07.rq -result: [s=urihttp://example.org/s1, p=urihttp://example.org/p, o=string("1"^^http://www.w3.org/2001/XMLSchema#integer)] -result: [s=urihttp://example.org/s1, p=urihttp://example.org/p, o=string("1"^^http://www.w3.org/2001/XMLSchema#integer)] -result: [s=urihttp://example.org/s2, p=urihttp://example.org/p, o=string("2"^^http://www.w3.org/2001/XMLSchema#integer)] -result: [s=urihttp://example.org/s2, p=urihttp://example.org/p, o=string("2"^^http://www.w3.org/2001/XMLSchema#integer)] -result: [s=urihttp://example.org/s3, p=urihttp://example.org/p, o=string("3"^^http://www.w3.org/2001/XMLSchema#integer)] -result: [s=urihttp://example.org/s3, p=urihttp://example.org/p, o=string("3"^^http://www.w3.org/2001/XMLSchema#integer)] -result: [s=urihttp://example.org/s4, p=urihttp://example.org/p, o=string("4"^^http://www.w3.org/2001/XMLSchema#integer)] -result: [s=urihttp://example.org/s4, p=urihttp://example.org/p, o=string("4"^^http://www.w3.org/2001/XMLSchema#integer)] +result: [s=urihttp://example.org/s1, p=urihttp://example.org/p, o=string("1"^^http://www.w3.org/2001/XMLSchema#integer), z=string("2"^^http://www.w3.org/2001/XMLSchema#integer)] +result: [s=urihttp://example.org/s1, p=urihttp://example.org/p, o=string("1"^^http://www.w3.org/2001/XMLSchema#integer), z=string("3"^^http://www.w3.org/2001/XMLSchema#integer)] +result: [s=urihttp://example.org/s2, p=urihttp://example.org/p, o=string("2"^^http://www.w3.org/2001/XMLSchema#integer), z=string("3"^^http://www.w3.org/2001/XMLSchema#integer)] +result: [s=urihttp://example.org/s2, p=urihttp://example.org/p, o=string("2"^^http://www.w3.org/2001/XMLSchema#integer), z=string("4"^^http://www.w3.org/2001/XMLSchema#integer)] +result: [s=urihttp://example.org/s3, p=urihttp://example.org/p, o=string("3"^^http://www.w3.org/2001/XMLSchema#integer), z=string("4"^^http://www.w3.org/2001/XMLSchema#integer)] +result: [s=urihttp://example.org/s3, p=urihttp://example.org/p, o=string("3"^^http://www.w3.org/2001/XMLSchema#integer), z=string("5"^^http://www.w3.org/2001/XMLSchema#integer)] +result: [s=urihttp://example.org/s4, p=urihttp://example.org/p, o=string("4"^^http://www.w3.org/2001/XMLSchema#integer), z=string("5"^^http://www.w3.org/2001/XMLSchema#integer)] +result: [s=urihttp://example.org/s4, p=urihttp://example.org/p, o=string("4"^^http://www.w3.org/2001/XMLSchema#integer), z=string("6"^^http://www.w3.org/2001/XMLSchema#integer)]
csv-tsv-res/manifest#csv01
- blank node comparison
csv-tsv-res/manifest#csv02
- blank node comparison
csv-tsv-res/manifest#tsv03
- double 'e' vs double 'E'
exists/manifest#exists01
- exists syntax not supported
exists/manifest#exists02
- exists syntax not supported
exists/manifest#exists03
- exists syntax not supported
exists/manifest#exists04
- exists syntax not supported
exists/manifest#exists05
- exists syntax not supported
functions/manifest#ceil01
- decimal format differences
functions/manifest#concat01
- plain literal != ""xsd:string
functions/manifest#concat02
- decimal format differences
functions/manifest#floor01
- decimal format differences
functions/manifest#plus-1
- decimal format differences
functions/manifest#plus-2
- decimal format differences
functions/manifest#round01
- decimal format differences
functions/manifest#seconds
- decimal format differences
functions/manifest#strafter01a
- ?
functions/manifest#strafter02
- ?
functions/manifest#strbefore02
- ?
grouping/manifest#group04
- Failure to implement SAMPLE(?v) correctly - no Sample() algebra node. Fails to ignore non-agg vars in SELECT when grouping Sample algebra
json-res/manifest#jsonres01 json-res/manifest#jsonres02 json-res/manifest#jsonres03 json-res/manifest#jsonres04
- cannot read JSON results
negation/manifest#exists-01 negation/manifest#set-equals-1 negation/manifest#subset-01 negation/manifest#subset-02 negation/manifest#subset-03 negation/manifest#temporal-proximity-by-exclusion-nex-1
- NOT is not implemented
negation/manifest#exists-02
- EXISTS is not implemented
negation/manifest#full-minuend negation/manifest#partial-minuend negation/manifest#subset-by-exclusion-minus-1 negation/manifest#subset-by-exclusion-nex-1
- ????
property-path/manifest#pp01 property-path/manifest#pp02 property-path/manifest#pp03 property-path/manifest#pp06 property-path/manifest#pp07 property-path/manifest#pp08 property-path/manifest#pp09 property-path/manifest#pp10 property-path/manifest#pp11 property-path/manifest#pp14 property-path/manifest#pp28 property-path/manifest#pp30 property-path/manifest#pp31 property-path/manifest#pp32 property-path/manifest#pp33 property-path/manifest#pp34 property-path/manifest#pp35
- Property Path: not implementing
service-description/manifest#conforms-to-schema service-description/manifest#has-endpoint-triple service-description/manifest#returns-rdf
SERVICE test 1 SERVICE test 2 SERVICE test 3 SERVICE test 5 SERVICE test 6 SERVICE test 7
- Test framework cannot substitute manifest data (was not implemented)
subquery/manifest#subquery02 "sq02 - Subquery within graph pattern, graph variable is bound"
- GRAPH with variable from subquery
subquery/manifest#subquery10 "sq10 - Subquery with exists"
- EXISTS not implemented
syntax-query/manifest#test_24 syntax-query/manifest#test_25 syntax-query/manifest#test_26 syntax-query/manifest#test_27 syntax-query/manifest#test_28 syntax-query/manifest#test_29
- EXISTS failures
syntax-query/manifest#test_53 syntax-query/manifest#test_54 syntax-query/manifest#test_pn_04 syntax-query/manifest#test_pn_05 syntax-query/manifest#test_pn_06 syntax-query/manifest#test_pn_07 syntax-query/manifest#test_pn_09 syntax-query/manifest#test_pp_coll
- Prefix name failures such as backslashes, hex, colons
syntax-query/manifest#test_63
- Property Path: not implementing
syntax-update-1/manifest#test_25
- GRAPH in INSERT DATA
syntax-update-1/manifest#test_27
- Empty INSERT DATA
syntax-update-1/manifest#test_28
- Empty INSERT DATA GRAPH
syntax-update-1/manifest#test_31
- GRAPH in DELETE DATA
syntax-update-1/manifest#test_32
- Complex DELETE INSERT USING
syntax-update-1/manifest#test_38
- Empty document
syntax-update-1/manifest#test_39
- BASE and empty
syntax-update-1/manifest#test_40
- PREFIX and empty
syntax-update-1/manifest#test_53
- GRAPH in INSERT DATA syntax.
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/aggregates/manifest#agg08b
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/aggregates/manifest#agg-groupconcat-02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/aggregates/manifest#agg-min-02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/bind/manifest#bind07
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/csv-tsv-res/manifest#csv01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/csv-tsv-res/manifest#csv02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/csv-tsv-res/manifest#tsv03
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/exists/manifest#exists01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/exists/manifest#exists02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/exists/manifest#exists03
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/exists/manifest#exists04
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/exists/manifest#exists05
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#ceil01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#concat02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#floor01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#plus-1
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#plus-2
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#round01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#seconds
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#strafter01a
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#strafter02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#strbefore02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/grouping/manifest#group04
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/json-res/manifest#jsonres01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/json-res/manifest#jsonres02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/json-res/manifest#jsonres03
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/json-res/manifest#jsonres04
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#exists-01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#exists-02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#full-minuend
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#partial-minuend
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#set-equals-1
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#subset-01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#subset-02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#subset-03
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#subset-by-exclusion-minus-1
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#subset-by-exclusion-nex-1
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#temporal-proximity-by-exclusion-nex-1
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp03
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp06
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp07
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp08
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp09
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp10
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp11
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp12
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp14
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp16
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp21
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp23
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp25
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp28a
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp30
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp31
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp32
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp33
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp34
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp35
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp36
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp37
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service-description/manifest#conforms-to-schema
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service-description/manifest#has-endpoint-triple
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service-description/manifest#returns-rdf
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service/manifest#service1
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service/manifest#service2
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service/manifest#service3
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service/manifest#service5
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service/manifest#service6
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service/manifest#service7
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/subquery/manifest#subquery02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/subquery/manifest#subquery10
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_24
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_25
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_26
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_27
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_28
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_29
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_53
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_54
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_63
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_pn_04
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_pn_05
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_pn_06
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_pn_07
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_pn_09
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_pp_coll
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_25
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_27
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_28
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_31
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_32
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_38
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_39
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_40
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_53