New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improvements to write performance #31
Merged
grahamtriggs
merged 21 commits into
vivo-project:develop
from
brianjlowe:writePerformance
May 3, 2016
Merged
Improvements to write performance #31
grahamtriggs
merged 21 commits into
vivo-project:develop
from
brianjlowe:writePerformance
May 3, 2016
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
… selective recomputing, for major improvement to RDF uploading speed. A few unit tests related to retraction with sameAs aren't passing yet.
…meAs still needs fixing; will flunk tests.
… reasoner's individual queue between concurrent writing threads
Conflicts: api/src/main/java/edu/cornell/mannlib/vitro/webapp/dao/jena/ABoxJenaChangeListener.java api/src/main/java/edu/cornell/mannlib/vitro/webapp/dao/jena/JenaChangeListener.java api/src/main/java/edu/cornell/mannlib/vitro/webapp/rdfservice/impl/jena/ListeningGraph.java
chenejac
pushed a commit
to chenejac/Vitro
that referenced
this pull request
Sep 29, 2022
… vivo-1915 (vivo-project#31) Partial resolution to: https://jira.lyrasis.org/browse/VIVO-1915
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Submitting this from December as a pull request since it constitutes a fairly substantial change and is not associated with specific open issues.
This work was supported by the National Agriculture Library of the United States Department of Agriculture through a cooperative agreement with Cornell University and Ontocale SRL.
Highlights:
With this code I've observed speedups to writes of an order of magnitude or more compared to 1.8, depending on how much inference is required. The improvements are typically the most dramatic with the SPARQL API and with deletion of RDF files or clearing of graphs through the GUI. The only things I observed to be slower were some of the reasoner unit tests, which operate with small sets of data purely in memory and benefited from the original triple-by-triple reasoning approach.