Skip to content

Latest commit

 

History

History
501 lines (349 loc) · 18.9 KB

sparql11.md

File metadata and controls

501 lines (349 loc) · 18.9 KB

Rasqal SPARQL 1.1 testing

Approved tests only.

Passes: 248

Failures: 99

Skipped: 81

Tested:

Against SPARQL 1.1 tests:

Failures by section summary

aggregates             3
bind                   1
csv-tsv-res            3
exists                 5
functions             11
grouping               1
json-res               4
negation              11
property-path         24
service-description    3
service                6
subquery               2
syntax-query          15
syntax-update-1        9

SPARQL 1.1 Query Language conformance

Requires passing sections (* = failures above):

aggregates bind bindings construct exists functions grouping
negation project-expression property-path subquery syntax-query

Currently pass:

bindings construct grouping project-expression

SPARQL 1.1 Update conformance

Requires passing sections (* = failures above):

add basic-update clear copy delete-data delete-insert
delete-where delete drop move syntax-update-1 syntax-update-2
update-silent

Currently pass: (most tests such as those of type ut:UpdateEvaluationTest are skipped)

syntax-update-2

aggregates: 3

aggregates/manifest#agg08b "grouping by expression, done correctly"

aggregates/manifest#agg-groupconcat-02

  • ???? variable scope???

    check-sparql: 'GROUP_CONCAT 2' FAILED (exited with status 1) roqet -d debug -W 0 -i sparql11 -D agg-groupconcat-1.ttl agg-groupconcat-2.rq roqet: Error - URI file:///Users/dajobe/dev/redland/testing/sparql11/data-sparql11/aggregates/agg-groupconcat-2.rq:1 - Variable c was not bound and not used in the query (where is it from?) ...

aggregates/manifest#agg-min-02

bind: 1

bind/manifest#bind07

csv-tsv-res: 3

csv-tsv-res/manifest#csv01

  • blank node comparison

csv-tsv-res/manifest#csv02

  • blank node comparison

csv-tsv-res/manifest#tsv03

  • double 'e' vs double 'E'

exists: 5

exists/manifest#exists01

  • exists syntax not supported

exists/manifest#exists02

  • exists syntax not supported

exists/manifest#exists03

  • exists syntax not supported

exists/manifest#exists04

  • exists syntax not supported

exists/manifest#exists05

  • exists syntax not supported

functions: 11

functions/manifest#ceil01

  • decimal format differences

functions/manifest#concat01

  • plain literal != ""xsd:string

functions/manifest#concat02

  • decimal format differences

functions/manifest#floor01

  • decimal format differences

functions/manifest#plus-1

  • decimal format differences

functions/manifest#plus-2

  • decimal format differences

functions/manifest#round01

  • decimal format differences

functions/manifest#seconds

  • decimal format differences

functions/manifest#strafter01a

  • ?

functions/manifest#strafter02

  • ?

functions/manifest#strbefore02

  • ?

grouping: 1

grouping/manifest#group04

  • Failure to implement SAMPLE(?v) correctly - no Sample() algebra node. Fails to ignore non-agg vars in SELECT when grouping Sample algebra

json-res: 4

json-res/manifest#jsonres01 json-res/manifest#jsonres02 json-res/manifest#jsonres03 json-res/manifest#jsonres04

  • cannot read JSON results

negation: 11

negation/manifest#exists-01 negation/manifest#set-equals-1 negation/manifest#subset-01 negation/manifest#subset-02 negation/manifest#subset-03 negation/manifest#temporal-proximity-by-exclusion-nex-1

  • NOT is not implemented

negation/manifest#exists-02

  • EXISTS is not implemented

negation/manifest#full-minuend negation/manifest#partial-minuend negation/manifest#subset-by-exclusion-minus-1 negation/manifest#subset-by-exclusion-nex-1

  • ????

property-path: 24

property-path/manifest#pp01 property-path/manifest#pp02 property-path/manifest#pp03 property-path/manifest#pp06 property-path/manifest#pp07 property-path/manifest#pp08 property-path/manifest#pp09 property-path/manifest#pp10 property-path/manifest#pp11 property-path/manifest#pp14 property-path/manifest#pp28 property-path/manifest#pp30 property-path/manifest#pp31 property-path/manifest#pp32 property-path/manifest#pp33 property-path/manifest#pp34 property-path/manifest#pp35

  • Property Path: not implementing

service-description: 3

service-description/manifest#conforms-to-schema service-description/manifest#has-endpoint-triple service-description/manifest#returns-rdf

service: 6

SERVICE test 1 SERVICE test 2 SERVICE test 3 SERVICE test 5 SERVICE test 6 SERVICE test 7

  • Test framework cannot substitute manifest data (was not implemented)

subquery: 2

subquery/manifest#subquery02 "sq02 - Subquery within graph pattern, graph variable is bound"

  • GRAPH with variable from subquery

subquery/manifest#subquery10 "sq10 - Subquery with exists"

  • EXISTS not implemented

syntax-query: 15

syntax-query/manifest#test_24 syntax-query/manifest#test_25 syntax-query/manifest#test_26 syntax-query/manifest#test_27 syntax-query/manifest#test_28 syntax-query/manifest#test_29

  • EXISTS failures

syntax-query/manifest#test_53 syntax-query/manifest#test_54 syntax-query/manifest#test_pn_04 syntax-query/manifest#test_pn_05 syntax-query/manifest#test_pn_06 syntax-query/manifest#test_pn_07 syntax-query/manifest#test_pn_09 syntax-query/manifest#test_pp_coll

  • Prefix name failures such as backslashes, hex, colons

syntax-query/manifest#test_63

  • Property Path: not implementing

syntax-update-1: 9

syntax-update-1/manifest#test_25

  • GRAPH in INSERT DATA

syntax-update-1/manifest#test_27

  • Empty INSERT DATA

syntax-update-1/manifest#test_28

  • Empty INSERT DATA GRAPH

syntax-update-1/manifest#test_31

  • GRAPH in DELETE DATA

syntax-update-1/manifest#test_32

  • Complex DELETE INSERT USING

syntax-update-1/manifest#test_38

  • Empty document

syntax-update-1/manifest#test_39

  • BASE and empty

syntax-update-1/manifest#test_40

  • PREFIX and empty

syntax-update-1/manifest#test_53

  • GRAPH in INSERT DATA syntax.

Failure URLs

http://www.w3.org/2009/sparql/docs/tests/data-sparql11/aggregates/manifest#agg08b
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/aggregates/manifest#agg-groupconcat-02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/aggregates/manifest#agg-min-02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/bind/manifest#bind07
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/csv-tsv-res/manifest#csv01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/csv-tsv-res/manifest#csv02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/csv-tsv-res/manifest#tsv03
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/exists/manifest#exists01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/exists/manifest#exists02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/exists/manifest#exists03
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/exists/manifest#exists04
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/exists/manifest#exists05
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#ceil01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#concat02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#floor01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#plus-1
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#plus-2
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#round01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#seconds
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#strafter01a
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#strafter02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/functions/manifest#strbefore02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/grouping/manifest#group04
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/json-res/manifest#jsonres01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/json-res/manifest#jsonres02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/json-res/manifest#jsonres03
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/json-res/manifest#jsonres04
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#exists-01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#exists-02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#full-minuend
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#partial-minuend
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#set-equals-1
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#subset-01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#subset-02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#subset-03
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#subset-by-exclusion-minus-1
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#subset-by-exclusion-nex-1
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/negation/manifest#temporal-proximity-by-exclusion-nex-1
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp01
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp03
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp06
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp07
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp08
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp09
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp10
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp11
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp12
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp14
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp16
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp21
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp23
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp25
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp28a
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp30
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp31
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp32
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp33
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp34
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp35
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp36
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/property-path/manifest#pp37
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service-description/manifest#conforms-to-schema
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service-description/manifest#has-endpoint-triple
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service-description/manifest#returns-rdf
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service/manifest#service1
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service/manifest#service2
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service/manifest#service3
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service/manifest#service5
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service/manifest#service6
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/service/manifest#service7
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/subquery/manifest#subquery02
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/subquery/manifest#subquery10
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_24
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_25
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_26
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_27
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_28
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_29
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_53
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_54
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_63
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_pn_04
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_pn_05
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_pn_06
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_pn_07
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_pn_09
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-query/manifest#test_pp_coll
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_25
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_27
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_28
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_31
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_32
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_38
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_39
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_40
http://www.w3.org/2009/sparql/docs/tests/data-sparql11/syntax-update-1/manifest#test_53