New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
SHACL - Larger DCAT benchmark #1375
Comments
Current benchmarks for additive transactions are not that great:
They should all be ~50 ms. |
…ex benchmark shacl rules Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
BulkedExternalXXXXXXXX needs to be optimised. Currently, after some crude optimisation of the BulkedExternalInnerJoin code I got these results:
|
This is how it stacks up to an empty store:
|
Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
…ex benchmark shacl rules Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
…ex benchmark shacl rules and optimisations Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
|
Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
* develop: inner joing fix eclipse-rdf4j/rdf4j#1380 innerjoin eclipse-rdf4j/rdf4j#1380 improved maxCount performance eclipse-rdf4j/rdf4j#1378 simplified code eclipse-rdf4j/rdf4j#1378 simple improvements eclipse-rdf4j/rdf4j#1378 benchmarks eclipse-rdf4j/rdf4j#1375 updated benchmarks eclipse-rdf4j/rdf4j#1375 added large benchmark and adjusted the complex benchmark shacl rules and optimisations Signed-off-by: Håvard Ottestad <hmottestad@gmail.com> # Conflicts: # shacl/src/main/java/org/eclipse/rdf4j/sail/shacl/planNodes/BulkedExternalInnerJoin.java # shacl/src/test/java/org/eclipse/rdf4j/sail/shacl/benchmark/ComplexBenchmark.java
Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
Updated results:
|
Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
@barthanssens I'll bring the discussion over here instead of in the PR. Do you have a list of the portals that you collect the data from? |
Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
Signed-off-by: Håvard Ottestad <hmottestad@gmail.com> (+4 squashed commits) Squashed commits: [74e7de9] small benchmark file Signed-off-by: Håvard Ottestad <hmottestad@gmail.com> [8d52fa1] eclipse-rdf4j/rdf4j#1375 parallel sort if list is big Signed-off-by: Håvard Ottestad <hmottestad@gmail.com> [d2d07bc] fixes for benchmark file that jena reported Signed-off-by: Håvard Ottestad <hmottestad@gmail.com> [8cd93c5] merge conflict fix Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
…nd option for logging performance per shape during validation Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
* develop: (40 commits) optimize imports and format eclipse-rdf4j/rdf4j#1375 bigger benchmark based on a generated file and option for logging performance per shape during validation potential bug fix and performance optimization formatter nicer query plans formatter eclipse-rdf4j/rdf4j#1388 configurable caching eclipse-rdf4j/rdf4j#1388 moved auto batched flushing moved added further reduce memory allowance in benchmark update benchmark eclipse-rdf4j/rdf4j#1388 clean up benchmark eclipse-rdf4j/rdf4j#1388 allow for cache less validation more utf8 and formatting eclipse-rdf4j/rdf4j#1388 periodically flush when loading big files in a single transaction without isolation formatting eclipse-rdf4j/rdf4j#1388 create benchmark clean up use of utf-8 and various other code cleanup eclipse-rdf4j/rdf4j#1384 bug fix eclipse-rdf4j/rdf4j#1384 optimize ... Signed-off-by: Håvard Ottestad <hmottestad@gmail.com> # Conflicts: # shacl/pom.xml # shacl/src/main/java/org/eclipse/rdf4j/sail/shacl/AST/PropertyShape.java # shacl/src/main/java/org/eclipse/rdf4j/sail/shacl/ShaclSailConnection.java # shacl/src/test/java/org/eclipse/rdf4j/sail/shacl/benchmark/ComplexBenchmark.java
* develop: (57 commits) optimize imports and format eclipse-rdf4j/rdf4j#1375 bigger benchmark based on a generated file and option for logging performance per shape during validation potential bug fix and performance optimization formatter nicer query plans formatter eclipse-rdf4j/rdf4j#1388 configurable caching eclipse-rdf4j/rdf4j#1388 moved auto batched flushing moved added further reduce memory allowance in benchmark update benchmark eclipse-rdf4j/rdf4j#1388 clean up benchmark eclipse-rdf4j/rdf4j#1388 allow for cache less validation more utf8 and formatting eclipse-rdf4j/rdf4j#1388 periodically flush when loading big files in a single transaction without isolation formatting eclipse-rdf4j/rdf4j#1388 create benchmark clean up use of utf-8 and various other code cleanup eclipse-rdf4j/rdf4j#1384 bug fix eclipse-rdf4j/rdf4j#1384 optimize ... Signed-off-by: Håvard Ottestad <hmottestad@gmail.com> # Conflicts: # shacl/src/test/java/org/eclipse/rdf4j/sail/shacl/Utils.java
Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
Signed-off-by: Håvard Ottestad <hmottestad@gmail.com>
Use the DCAT file that Bart mentions to do create a new benchmark.
We are interested in both:
The text was updated successfully, but these errors were encountered: