Skip to content

Latest commit

 

History

History
966 lines (713 loc) · 48.5 KB

CHANGELOG.md

File metadata and controls

966 lines (713 loc) · 48.5 KB

[0.5.5] - 2026-02-14

Added

  • JSON-LD: JSON-LD 1.1 is now implemented and enabled by default.
  • JavaScript: the parse method that allows to parse a RDF file from a buffer, an iterator of buffers or and async iterator of buffers (including streams).
  • oxrdf: the Dataset.quads_for_pattern method allowing to iterate only on quads matching a given pattern.
  • oxjsonld: The JsonLdParser.with_processing_mode method to select the JSON-LD 1.0 or 1.1 processing mode.

Changed

  • RocksDB fixes a panic when ulimit -n is set to a very large number.

[0.5.4] - 2026-01-24

Added

  • RDF/XML: support of the current 1.2 draft behind the rdf-12 cargo feature (directional language strings and triple terms).
  • RDFC 1.0 canonicalization algorithm on the Graph and Dataset containers.

Changed

  • oxrdf: the default Unstable canonicalization algorithm has been changed for a variant of RDFC 1.0. It seems much faster in a lot of cases.
  • HTTP: always set sd:endpoint in the served service description (the value is guessed from the incoming request values).
  • spareval: make QueryTripleIter::new public.
  • JSON-LD: lots of internal changes in preparation of JSON-LD 1.1 support (might affect some edge cases of 1.0 parsing).

[0.5.3] - 2025-12-19

Added

  • SPARQL 1.2: support VERSION declaration.

Changed

  • SPARQL: fixes parsing of HAVING when there are multiple conditions.
  • SPARQL: compute ordering values for ORDER BY only once (allows ORDER BY RAND() to work properly).

[0.5.2] - 2025-10-25

Changed

  • SPARQL: fixes evaluation of RDF 1.2 annotation syntax (e.g. SELECT * WHERE { ?s ?p ?o {| ?p2 ?o |}).
  • Bump RocksDB to 10.7.5 (requires a C++ 20 compiler).
  • Built Linux Python wheels now require Glibc 2.28.

[0.5.1] - 2025-10-11

Added

  • spargebra: standard-unicode-escaping feature that unescape \u and \U sequences everywhere in the query, following to the SPARQL specification.
  • spareval: QueryEvaluator.prepare method that allows to prepare a query then execute it. Injecting variable bindings and customizing the query dataset is possible on the prepared query. FROM and FROM NAMED clauses are taken into account by this API, opposite to the older QueryEvaluator.execute method.
  • spareval: QueryEvaluator.prepare_delete_insert that allows evaluating easily SPARQL UPDATE DELETE/INSERT operations.
  • CLI: oxigraph load now has a --non-atomic option to load data in a non-atomic way. Allows compaction to happen in the background during loading.

Changed

  • NTriples/Turtle: fixes parsing of language tags with numbers like es-419.
  • SPARQL: fixes evaluation of SELECT * FROM NAMED <ex:> WHERE { GRAPH ?g {} }: all named graphs of the underlying store returned and not only ex:.
  • SPARQL: make parsing fail on duplicated variable names in VALUES like VALUES (?a ?a) {}.
  • spareval: QueryEvaluator.execute and QueryEvaluator.explain are deprecated. Please use QueryEvaluator.prepare instead.
  • bulk loader: avoid duplicated each file. It reduces the storage footprint by half in some cases.
  • bulk loader: improve cleanup on failure and avoid some cases where files where left on disk.

[0.5.0] - 2025-09-13

This release is dedicated to the memory of Gregg Kellogg, author of multiple specifications implemented by Oxigraph and great inspiration.

Changed

  • SPARQL: support double negation !! when SPARQL 1.2 is enabled.
  • SPARQL: allow triple terms in the subject position in more places.
  • spargeo: change API to drop dependency on spareval and `oxigraph.

[0.5.0-beta.5] - 2025-09-07

Added

  • spareval: a CancellationToken to easily cancel a running SPARQL query.
  • CLI: --timeout-s option to the query command to set a timeout for the query.
  • oxttl and oxrdfio: split_file_for_parallel_parsing method to enable easier NTriples and NQuads parallel parsing from a file.
  • oxigraph: parallel_load_from_file and parallel_load_from_slice methods to load RDF data from a file or a slice in parallel.

Changed

  • JSON-LD: fixes parsing of aliased @type
  • oxigraph: bulk_loader method now takes a mut reference and there is a new commit method that is required to save the loaded data.
  • CLI and Python bindings: bulk loading data from a file and a buffer (in Python) is now done in parallel.
  • Bump rand to 0.9 and getrandom to 0.3.

[0.5.0-beta.4] - 2025-08-23

Added

  • spareval: expose QueryEvaluator::evaluate_expression to evaluate expressions

Changed

  • Oxigraph: Transaction has now stronger lifetime bounds to ensure operations on a transaction are not running longer than the transaction itself. It also affects types like QuadIter or GraphNameIter that now carry a lifetime.
  • SPARQL: raise an error when blank nodes are shared between different INSERT DATA statements (follows SPARQL spec).
  • SPARQL: Makes single DELETE/INSERT and LOAD statements slightly faster by not indexing the changes.

[0.5.0-beta.3] - 2025-08-15

Changed

  • Rust: bump MSRV to 1.87.
  • RocksDB: bump to 10.5.1.
  • Turtle: use the longest possible prefix during serialization.
  • Improved error when opening an old RocksDB database in read-only
  • spareval: Add a lifetime to QueryResults
  • spareval: Allow QueryableDataset to be bounded by a lifetime.
  • spareval: QueryableDataset is now implemented by &Dataset and not by Dataset (allows avoiding a bunch of copies).

[0.5.0-beta.2] - 2025-08-07

Added

  • oxrdfio: RdfParser.split_slice_for_parallel_parsing to enable easier NTriples and NQuads parallel parsing.
  • oxigraph: (BulkLoader|Store|Transaction).load_from_slice to load serialized RDF data from a slice.
  • oxigraph: SparqlEvaluator fluent API to customize more easily SPARQL operations and prepare them. The Store.query and Store.update methods are deprecated and QueryOptions and UpdateOptions types are removed.
  • SPARQL: support for xsd:gYear, xsd:gMonth, xsd:gDay, xsd:gMonthDay and xsd:gYearMonth cast functions.
  • Python: add prefixes and custom_aggregate_functions options to Store.query and Store.update methods.

Removed

  • oxigraph: Remove Service, DefaultService, QueryResults and QuerySolutionIter types in favor of spargebra ones.

Changed

  • Turtle: fixes parsing of blank nodes at the end of the files.
  • Turtle/NTriples: fail on "foo"^^rdf:langString and "foo"^^rdf:dirLangString.
  • RocksDB: enable async I/O when RocksDB is built with it.
  • spareval: Service and DefaultService traits now take parameters by reference.
  • oxigraph: the EvaluationError type is now replaced by the QueryEvaluationError and UpdateEvaluationError types.

[0.5.0-beta.1] - 2025-06-20

Added

  • Support for current W3C working drafts RDF 1.2 and SPARQL 1.2, hidden behind the rdf-12 or sparql-12 features. RDF 1.2 includes triple terms using a slightly different syntax as RDF-star and directional language strings using the new Literal.direction attribute.
  • oxrdf: basic serde support behind the serde feature.
  • spargebra: a SparqlParser API allowing setting default prefixes.
  • oxigraph: the Store.start_transaction method that returns a new Transaction object. transactions can be committed with the commit method or rolled back by just dropping the Transaction object.
  • Python: the lenient option to the parse and load method to skip some validations.

Removed

  • RDF-star support is now dropped in favor of RDF 1.2. The rdf-star feature is not available anymore but triple terms are supported using rdf-12. RDF 1.2 does not support triple terms in the subject position anymore. Existing databases are automatically migrated on the first opening with Oxigraph 0.5 to keep most SPARQL queries working. However, serialization in N-Triples/Turtle/... has changed.
  • All deprecated Rust methods in the 0.4.x releases.
  • Rust: support for Rust versions before 1.85.
  • RocksDB: support of versions before 9.10.
  • oxrdf: the Subject enum is now merged into NamedOrBlankNode.
  • spargebra: GroundSubject is now merged into NamedNode.
  • spareval: ExpressionSubject is now merged into NamedOrBlankNode.
  • oxigraph: Store.transaction is replaced by Store.start_transaction.
  • Python: pyoxigraph.__package__ and pyoxigraph.__author__ constants.

Changed

  • oxrdf: deprecate Literal::is_plain (not defined anymore in RDF 1.1 and 1.2).
  • oxrdf: deprecate Literal::destruct (no added value compared to regular assessors).
  • oxttl/oxrdfxml/oxrdfio: rename unchecked() to lenient().
  • oxigraph now relies on oxhttp 0.3. Some optional feature names have changed.
  • oxigraph: the SERVICE setup API has changed. The ServiceHandler trait now defines a single service with a given name whereas the DefaultServiceHandler trait set a default behavior for other service URLs.
  • RDF/XML: keep namespaces in rdf:parseType="Literal" output.
  • RocksDB transactions do not rely anymore on TransactionDB but on the new WriteBatchWithIndex API. It means that some write-write conflicts are not detected anymore (e.g., if a graph is dropped by a transaction while a concurrent one adds a triple to the same graph) but significantly increases update speed and enables things like efficient Store.clear implementation.
  • Bulk loading is now atomic: if it fails no triple will be added to the database.

[0.4.11] - 2025-05-21

Changed

  • Bumps to RocksDB 10.3.0 and fixes a compilation issue with GCC 13+.

[0.4.10] - 2025-05-15

Added

  • oxjsonld crate with JSON-LD 1.0 parsing and serialization. It is exposed in all APIs (Rust, Python, JS, CLI and HTTP server). A faster Streaming JSON-LD parsing is also available if the http://www.w3.org/ns/json-ld#streaming profile is enabled.
  • oxigraph binary is now distributed on Pypi.

Changed

  • Linux pre-built binaries now require at least Ubuntu 22.04.
  • CLI: convert method lenient option now works properly.
  • RDF/XML: reduces copies inside the parser.
  • RDF/XML: do not serialize triples with reserved syntax terms.
  • Turtle: improve some error messages.
  • N-Triples: improve error recovery by always restarting at the next line.
  • Upgrades to RocksDB 10.2.1.

[0.4.9] - 2025-03-09

Changed

  • SPARQL: Fixes a bug that made GROUP_CONCAT(..., SEPARATOR="...") always assume DISTINCT.
  • oxrdfxml: Fixes TokioAsyncWriterRdfXmlSerializer name.

[0.4.8] - 2025-02-14

Changed

  • SPARQL: Fixes a bug in sameTerm implementation on xsd:decimal.
  • Turtle: fixes a parsing ambiguity when a file ends with an integer then a concatenated dot eg. 11..

[0.4.7] - 2025-01-19

Changed

  • SPARQL: GRAPH ?g {} now properly returns all named graph in the queried dataset.
  • SPARQL: ASK { OPTIONAL { X }} now properly returns true even if X raises an error.
  • sparopt: breaking 0.2 release because of the introduction of a Graph algebra node to support GRAPH ?g {} syntax.

[0.4.6] - 2025-01-11

Added

  • spareval crate that provides a stand-alone SPARQL evaluator without dependency on Oxigraph storage systems.
  • Rust/Python: the API now allows to substitute variables with value before evaluating a query. Substitution follows RDF-dev SEP-0007.

Changed

  • Bump RocksDB to 9.10.0.

[0.4.5] - 2024-12-21

Added

  • SPARQL: support for the 'q' regular expression option.

Changed

  • Turtle: do not buffer everything if there is no line jump in the file.
  • RDF/XML: fixes decoding of escaped whitespaces.
  • Bump RocksDB to 9.9.3.
  • Allow compilation on zkvm by removing the dependency on std::time for this platform.

[0.4.4] - 2024-11-21

Added

  • Integrates geosparql in the CLI Docker image and the JS bindings.
  • Python: support for 3.13 free-threaded builds.

[0.4.3] - 2024-11-07

Changed

  • Fixes segfaults on Store drop when using the memory backend on large datasets (drop was doing too many recursive call leading to a stack overflow).
  • Upgrades RocksDB to 9.7.4.
  • Allows thiserror 2.0 and geo 0.29.

[0.4.2] - 2024-10-31

Added

  • spargeo crate providing GeoSPARQL simple features query functions. They are enabled by default in Oxigraph CLI and Oxigraph Python bindings.
  • Turtle, TriG and RDF/XML: allow to set a base IRI during serialization.
  • Python: exposes prefixes and base IRI after parsing.
  • Python: allows to give to Literal constructor a int, float or bool.

Changed

  • SPARQL XML query results: escape whitespaces at the extremities of values to make sure they are not trimmed.
  • Turtle: fixes support of empty local name.
  • N3: properly inject the base IRI before parsing.
  • RDF/XML do not return invalid prefixes after parsing.
  • RDF/XML: properly deduplicate prefixes during serialization and fixes prefix conflicts.

[0.4.1] - 2024-10-13

Added

  • JS: add default_graph and named_graphs query options to set the default and named graphs.
  • HTTP server: return SPARQL service description on GET requests.

Changed

  • NTriples/NQuads error recovery: do not consider the predicate as a possible subject if the subject is invalid.
  • Turtle: prevent line jump in single quoted string (but not in unchecked/lenient mode).
  • Turtle: forbid invalid \u+123 escape sequences.
  • RDF/XML: only ignore possible literal values composed of whitespaces if an other object value is present.
  • SPARQL: fixes regex function evaluation when the regex is not set to a literal.
  • SPARQL: ignore errors in joins if the other side of the join returns no results (the output would be no results anyway if the errors are fixed).
  • SPARQL: make ASK return true if the inner query is returning a valid tuple even if the inner query is also returning errors (fixing these errors would not change the ASK output).
  • SPARQL optimizer: do not attempt to optimize SERVICE (keep them, do not push filter in them...). This was leading to a lot of subtle behavior changes.
  • oxRDF parser: allow spaces between literal value and langtag/datatype, unicode escapes in URIs.

[0.4.0] - 2024-09-22

Changed

  • SPARQL: fixes evaluation of GRAPH ?g { ?s <p1>/<p2> ?o } property paths with ?g and ?s unbound and ?o bound.

[0.4.0-rc.2] - 2024-09-15

Added

  • Rust: Triple::from_str and Quad::from_str.

Changed

  • SPARQL: fixes evaluation of GRAPH ?g { ?s !(...) ?o } property paths with ?g and ?s unbound and ?o bound.
  • NTriples/NQuads: properly mandate that lines must contain at most a single triple/quad.
  • Turtle-like formats: do not allow the empty blank node identifier.
  • Rust: Big renaming in parsers and serializers to get an hopefully nicer API:
    • Use Parser suffix instead of Reader for parsers.
    • Use Writer suffix instead of Serializer for serializers.
    • Rename FromRead to Reader, FromTokioAsyncRead to TokioAsyncReader, FromSlice to Slice, ToWrite to Writer and ToTokioAsyncWrite to TokioAsyncWriter.
    • Rename read_next to parse_next.
    • Rename from_read to for_reader, to_write to for_writer, from_tokio_async_read to for_tokio_async_reader, to_tokio_async_write to for_tokio_async_writer, from_slice to for_slice.
  • CLI: Allows to set default-graph-uri query argument even if the --union-default-graph CLI option is set.

[0.4.0-rc.1] - 2024-08-25

Added

  • CLI: union-default-graph option to the serve and query commands to use by default the union of all graphs as the default graph in SPARQL queries.

Changed

  • RocksDB build: link with the atomic library on armv5te and riscv64gc
  • CLI build: do not generate man pages for help commands.

[0.4.0-alpha.8] - 2024-08-22

Added

  • oxttl, oxrdfxml, sparesults and oxrdfio: new parse_slice method to parse a byte slice directly.
  • oxttl N-Triples, N-Quads and Turtle: new split_slice_for_parallel_parsing method that splits a slice into chunks that can be parsed in parallel.
  • Python: support for custom SPARQL functions.
  • CLI: man pages and shell autocompletion files are now automatically generated on build.

Removed

  • The storage "secondary" mode. It was quite buggy, especially with RocksDB 9. If you need it, please reach out.

Changed

  • Upgrades Rust MSV to 1.75.
  • Bumps RocksDB to 9.5.2.
  • IRI: ipvFuture are now allowed and some characters are now disallowed in some places to follow RFC 3987.
  • sparesults: parse_ and serialize_ functions now take the parser/serializer by value but the parsers and serializers are now Clone.
  • Release builds abort instead of unwind on panics.
  • Turtle-like languages: escaped UTF-16 surrogates are now supported in unchecked/lenient mode.
  • SPARQL: fixes parsing of CONSTRUCT queries when a dot directly follows a semicolon.
  • SPARQL: avoids to return duplicated triples in CONSTRUCT response (the deduplication is only partial, some duplicates may still be returned).
  • JS: better TypeScript types now written by hand.
  • JS: allow any Iterator implementation in Store constructor.
  • Python: Store.bulk_load now properly uses the bulk loader.
  • Python: improves the way the GIL is released. Might fix some weird bugs.
  • HTTP: increases max SPARQL body size to 128MB.

[0.4.0-alpha.7] - 2024-05-18

Added

  • JS: Store.query has now a results_format option to select the format in which the results should be returned. When enabled the return type will be a string.

Changed

  • Default in memory storage is now a brand new implementation based on hash sets and linked list. See description in the wiki. It provides proper transaction rollbacks and allows concurrent reads while a write transaction is happening. It is now used when a Store is created without an underlying storage directory.
  • SPARQL: DESCRIBE now implements Concise Bounded Description.
  • SPARQL: avoids join reordering inside of SERVICE calls.
  • SPARQL: fixes parsing of DESCRIBE query when there is a space between the IRI after FROM and the WHERE keyword.
  • Uses the "fx hash" from Firefox and rustc in the hash maps to make hashing faster.
  • RDF/XML: if unchecked is enabled, rdf:ID distinctness won't be validated.
  • Python: uses Python 0.21 bindings.
  • JS: The load and dump method second argument is now an object with options. The old API is kept for backward compatibility and prints warnings.
  • CLI: removes dependencies on escargot.
  • CLI: uses @zazuko/yasqui instead of @triply/yasqui and vendors the JS and CSS in the built binary.

[0.4.0-alpha.6] - 2024-03-25

Changed

  • Fixes compatibility with OxIRI 0.2.3.

[0.4.0-alpha.5] - 2024-03-23

Added

  • Python: Dataset class

Changed

  • Rust: Dataset::canonicalize and Graph::canonicalize takes for input a CanonicalizationAlgorithm to set which algorithm to use.
  • Upgrades RocksDB to 9.0.0
  • JS: Drops NodeJS 12-16 and older web browsers (Edge before Chromium...) support.

[0.4.0-alpha.4] - 2024-03-07

Added

  • Rust: From<spargebra::Update on Update.
  • sparesults: Tokio Async readers for SPARQL query results (XML, JSON and TSV).
  • oxrdf: Term::from_terms constructor.
  • JS: options to set query and update base IRI and query union default graph.

Changed

  • Uses RocksDB atomic multi-columns flush.
  • Rust: RocksDB is optional but enabled by default.
  • Upgrades RocksDB to 8.11.3.
  • Rust: oxigraph crate has been moved to lib/oxigraph.
  • Rust: QueryResults::write returns the Write impl and not ().
  • Rust: use thierror for errors.
  • Rust: rename oxrdfio::{Parse,Syntax}Error to oxrdfio::Rdf{Parse,Syntax}Error, oxrdfxml::{Parse,Syntax}Error to oxrdfxml::RdfXml{Parse,Syntax}Error, oxttl::{Parse,Syntax}Error to oxttl::Turtle{Parse,Syntax}Error, sparesults::{Parse,Syntax}Error to sparesults::QueryResults{Parse,Syntax}Error and spargebra::SyntaxError to spargebra::SparqlSyntaxError.

[0.4.0-alpha.3] - 2024-01-25

Added

  • oxttl: expose base IRIs.
  • oxttl: allows to inject prefixes for serialization.
  • oxrdf: vocab::geosparql::WKT_LITERAL.

Changed

  • Turtle: Fixes parsing bug with escaped dot at the end of local name.
  • oxttl: Changes prefixes getter return type.
  • JS: simplify build.
  • Python: uses rustls by default all platforms that are not Windows/macOS/iOS/WASM.
  • Strips debug info of the Rust std library in release build.

[0.4.0-alpha.2] - 2024-01-08

Added

  • i686 linux support

Changed

  • Docker: fixes Docker image Glib version error.
  • Docker: tags now use semver e.g. 0.3.22 and not v0.3.22. Preversions are also not tagged latest anymore.
  • Python: QuerySolution is now thread safe.

[0.4.0-alpha.1] - 2024-01-03

Added

  • sparopt crate: A new still quite naive query optimizer.
  • oxttl crate: A N-Triples/N-Quads/Turtle/TriG/N3 parser and serializer compatible with Tokio.
  • oxrdfxml crate: A RDF/XML parser and serializer compatible with Tokio.
  • oxrdfio crate: A stand-alone crate with oxigraph I/O related APIs.
  • Rust: SPARQL results I/O is now exposed in the oxigraph crate (oxigraph::sparql::results module).
  • Rust: It is now possible to dynamically link rocksdb with the rocksdb-pkg-config feature.
  • Python: error location is now included in some SyntaxError exceptions.
  • Python: the file type can be guessed from the file path extension during parsing and serialization.
  • Python: the serialization method returns a bytes value if no output-related argument is given.
  • Python: SPARQL query results I/O is now exposed (parse_query_results function and .serialize method).
  • Python: RdfFormat and QueryResultsFormat enum to encode supported formats.
  • CLI: a convert command to convert RDF file between different formats.

Removed

  • Rust: automated flush at the end of serialization. This should be done explicitly now.
  • oxsdatatypes: Deprecated methods.
  • Python: 3.7 and Musl linux 1.1 support.
  • Python: GraphName.value.

Changed

  • SPARQL: a digit after . is now required for xsd:decimal.
  • SPARQL: calendar subtraction returns xsd:dayTimeDuration and not xsd:duration.
  • SPARQL: Unicode escapes (\u and \U) are now only supported in IRIs and strings and not everywhere.
  • Literal serialization now produces canonical N-Triples according to the RDF 1.2 and RDF Dataset Canonicalization drafts
  • Rust: MSRV is now 1.70.
  • Rust Makes GraphName implement Default.
  • Rust: wasm32-unknown-unknown does not assumes JS platform by default. Enable the js feature for that.
  • Rust: Parsers take Read and not BufRead for input.
  • Rust: GraphFormat and DatasetFormat have been merged into RdfFormat.
  • Rust: GraphParser and DatasetParser have been merged into RdfParser.
  • Rust: GraphSerializer and DatasetSerializer have been merged into RdfSerializer.
  • Rust: query results are now Send and Sync.
  • Rust: Store.load_graph and Store.load_dataset have been merged into a load_from_read method.
  • Rust: Store.dump_graph and Store.dump_dataset have been renamed to dump_graph_to_write and dump_to_write.
  • Rust: BulkLoader.set_* methods have been renamed to BulkLoader.with_*.
  • oxsdatatypes: pass by-values instead of by-reference parameters when relevant.
  • oxsdatatypes: error types have been redesigned.
  • oxsdatatypes: return an error when building not serializable duration (year-month and day-time of opposite signs).
  • sparesults: renames some methods to move closer to the new oxrdfio crate.
  • Python: raise OSError instead of IOError on OS errors.
  • Python: the mime_type parameter have been renamed to format.
  • Python: boolean SPARQL results are now encoded with a QueryBoolean class and not a simple bool.
  • Python: a path parameter has been added to all I/O method to read from a file. The existing input parameter now consider str values to be a serialization to parse.
  • JS: the mime_type parameter have been renamed to format.
  • CLI: the oxigraph_server binary has been renamed to oxigraph.
  • CLI: the --location argument is now part of sub-commands where it is relevant. oxigraph_server --location foo serve is not possible anymore. One need to write oxigraph serve --location foo.
  • CLI: is is now possible to upload gzip encoded files to the HTTP API with the Content-Encoding: gzip header.

[0.3.22] - 2023-11-29

Changed

  • Allows to compile with more recent bindgen and cc
  • Fixes compatibility with spin_no_std feature of lazy_static

[0.3.21] - 2023-11-29

Changed

  • Bulk loader: do not fail when loading empty files.
  • Python: fixes source distribution.
  • Upgrades RocksDB to 7.8.1.

[0.3.20] - 2023-10-23

Changed

  • SPARQL: fixes STR evaluation on small IRI (less than 16 bytes) that was broken.
  • SPARQL update: fixes WHERE clause evaluation that was generating too many solutions in some cases.
  • Upgrades RocksDB to 8.7.1.

[0.3.19] - 2023-08-18

Added

  • Python: allows to give pathlib.Path argument when a path is expected.
  • Cargo.toml: add a documentation field to link to docs.rs documentation.

Changed

  • Upgrades RocksDB to 8.3.2.

[0.3.18] - 2023-06-13

Changed

  • SPARQL: fixes evaluation of || when all alternatives are false. The results must be false and not an error.
  • SPARQL: xsd:duration it is now possible to properly parse and serialize all numbers that can be internally represented by the encoding used by Oxigraph.
  • Python: fixes Store.contains_named_graph return type annotation.

[0.3.17] - 2023-06-11

Added

  • SPARQL: support of xsd:duration to SPARQL SUM aggregate function.
  • Server: support for systemd "notify" service option.
  • Server: uses the target graph name as base URI when POSTing and PUTing data.
  • Python: Store.contains_named_graph method.

Changed

  • SPARQL: xsd:decimal multiplication and division have been improved to avoid raising overflow because of internal operations in some cases.
  • SPARQL: xsd:decimal parser is now able to properly parse all numbers that can be internally represented by the encoding used by Oxigraph.
  • SPARQL: xsd:decimal avoids bad overflow on unary - operator.
  • SPARQL: reduces loss of precision when casting xsd:decimal to xsd:float or xsd:double.
  • SPARQL: improves a bit the AST in case of a lot of &&, || or IN operators.
  • SPARQL: fixes some optimization bugs around MINUS inside OPTIONAL.
  • SPARQL: makes for loop join choice instead of hash join a bit more aggressive.
  • Avoids random crashes when building RocksDB for aarch64.
  • Python: fixes support of text I/O with not-ASCII char.
  • Python: upgrades PyO3 to 0.19.
  • spargebra: GroundTermPattern::Triple is now properly gated behind the "rdf-star" feature.
  • oxsdatatypes: Deprecates is_naan that is renamed to is_nan (we like bread but prefer numbers).
  • oxsdatatypes: Adds checked_neg methods on numerical types.
  • oxsdatatypes: Drops nom dependency and uses hand-written parsers instead.

[0.3.16] - 2023-04-29

Changed

  • Fixes flush and compaction on the GSPO index. It might improve Oxigraph performances and storage space.
  • SPARQL: fixes some optimizations in presence quoted triples with nested variables.
  • SPARQL profiler: adds EXISTS operation to the explanation and profiling tree.
  • Upgrades RocksDB to 8.1.1.

[0.3.15] - 2023-04-18

Added

  • Rust: adds Store.explain_query_opt method that allows to get an explanation of the evaluation with profiling statistics.
  • Server: adds explanation and profiling to the query action (--explain, --explain-file and --stats options).
  • Python: implements the __match_args__ attribute on terms (literals, triples, quads...) to allow match operator usage.
  • Server: adds the --cors option to the serve actions to allow cross-origin resource sharing.

Changed

  • SPARQL: fixes evaluation of empty aggregation without GROUP BY: aggregators now return their default value (0 for COUNT...) and not an empty row.
  • SPARQL: fixes parsing of decimal with more than 19 digits in the fractional part.
  • Server docker image: switch to the smaller distroless base images.
  • Bulk loader: by default only uses 2 concurrent threads and around 2GB of RAM.
  • Server load: progress is now printed to stderr much more regularly.

[0.3.14] - 2023-03-19

Added

  • Read only and secondary RocksDB storage. Allows to open the data as read-only or to follow a primary instance.
  • Server: adds multiple commands:
    • serve-secondary and serve-read-only to serve the HTTP server in secondary and read-only modes.
    • dump to dump the database content to a file.
    • query and update to execute SPARQL query and updates.
    • backup to do a database backup.
    • optimize to optimize the database storage.
  • Server: adds format and graph options to the load command in order to select the loaded data format and the target graph.
  • Python: Store.extend and Store.bulk_extend methods.
  • Python: allows to pickle basic data model classes.

Changed

  • Upgrades RocksDB to 8.0.0.
  • Server: listening to localhost now properly listen to both IPv4 and IPv6.
  • RDF/XML and XML parser results: avoid an ever growing buffer.
  • JSON SPARQL results: allows the "head" key to be at the end of the document.
  • TSV SPARQL results: properly quote \t and print trailing line jumps.
  • Term::from_str: fixes parsing of blank nodes in object position of quoted triples.
  • QuerySolution: implements Eq and Debug.
  • JS: Reduces WASM build size.
  • OxRDF: fixes Graph and Dataset serialization to output proper N-Triples and N-Quads.

[0.3.13] - 2023-02-23

Changed

  • Fixes serialization of times with a decimal number of seconds lower than 10 (now 01:01:01.01 and not 01:01:1.01).
  • Turtle and TriG: fixes parsing for prefixes named after keywords (prefix, base, graph, true and false).

[0.3.12] - 2023-02-18

Added

  • From<NamedOrBlankNode> for GraphName (and similarly for *Ref).
  • Prebuilt Python wheels for Linux with musl libc.

Changed

  • Fixes TriG serialization.
  • QueryDataset is now properly exposed in the public Rust API.

[0.3.11] - 2023-01-18

Added

  • SPARQL: Implementation of the LATERAL operator following SPARQL SEP-0006. Support is behind the sep-0006 feature in spargebra and enabled by default in Oxigraph.
  • SPARQL: Implementation of the ADJUST function following SPARQL SEP-0002. Support is behind the sep-0002 feature in spargebra and enabled by default in Oxigraph.
  • Rust: There is a new stand-alone crate oxsdatatypes implementing Rust structs for the common XML schema datatypes. It was part of the Oxigraph crate and it might be useful for other SPARQL or XPath implementations.
  • Rust: The oxigraph crate can now be compiled for wasm32-wasi with the basic in-memory backend but without RocksDB.

Changed

  • SPARQL: The property path evaluator was sometime emitting duplicates when evaluating disjunctive patterns (a|b). It is now fixed.
  • SPARQL: If written explicitly in the SPARQL query, the regular expressions are now compiled once and not for each row.
  • SPARQL: Property path evaluation with both start and end variables bound has been optimized.
  • SPARQL: Casts to xsd:decimal from xsd:float and xsd:double now properly fails on overflow instead of overflowing the internal 128-bits representation. This follows XPath casting rules.
  • Rust: The minimal supported Rust version is set at 1.60 and enforced using the CI.
  • Python: Local builds will now target the specific Python version instead of abi3. abi3 wheels are still released on Pypi alongside new Python-version specific builds for Linux+GNU.
  • SPARQL: Fixes a panic when the estimated upper bound of the results size was overflowing a usize.
  • Python: Uses typing.IO in Python stubs instead of narrower interfaces.
  • Upgrades RocksDB to 7.9.2, quick-xml to 0.27 and pyo3 to 0.18.

[0.3.10] - 2022-12-21

Added

  • SPARQL: Property path with unbound graph are now evaluated. For example, SELECT * WHERE { GRAPH ?g { ?s ex:p+ ?o } } now works.
  • SPARQL: The query optimizer is now fuzzed for better testing.

Changed

  • SPARQL: Evaluation of zero-length paths with both start and end unbounded now return only terms defined in the current graph but not terms only defined in the query. For example, in SELECT * WHERE { VALUES ?s { 1 } { ?s ex:p? ?o } } the literal 1 won't be returned anymore if not in the queried graph.
  • Python: type stubs are now compatible with Python 3.7 and Mypy strict mode.
  • RDF/XML: allows entities declared using other entities.
  • Upgrades quick-xml to 0.26.

[0.3.9] - 2022-12-07

Added

  • Server: The /store endpoints now has a no_transaction HTTP option for POST and PUT request to get better performances at the cost of transactional guarantees.
  • Server: The /store endpoints now has a lenient HTTP option for POST and PUT request to ignore syntax errors (requires the no_transaction option).
  • Server: allows path that are not valid UTF-8 in file path CLI arguments.
  • Rust: From<spargebra::Query> to oxigraph::Query (thanks to @hobofan).

Changed

  • SPARQL: NOW() function properly returns the current time and not 1970-01-01
  • SPARQL: fixes serialization of SPARQL queries (property path and STRSTARTS function).
  • SPARQL: slightly optimize aggregates by avoiding an unneeded projection.
  • SPARQL: the parser now cleanly fails if invalid VALUES clauses are provided.
  • SPARQL: In DELETE/INSERT UPDATE the currently written values can't be read anymore ("Halloween problem").
  • oxrdf: makes Clippy run without warnings when rdf-star is disable.
  • Python: makes type annotations compatible with Python 3.7.
  • Python: makes sure the parameter default value is always included in the type annotation.

[0.3.8] - 2022-10-22

Changed

  • Python: avoid uploading debug wheels to pypi.

[0.3.7] - 2022-10-22

Added

  • Python type stubs are now generated and distributed alongside wheels.

Changed

[0.3.6] - 2022-08-16

Changed

  • Server: Makes sure body is always sent for all HTTP response codes that are not explicitly to not do that according to the HTTP specification.
  • Python: Adds support of reading from io.TextIOBase.

[0.3.5] - 2022-08-02

Changed

  • Fixes a bug in the SPARQL parser with nested anonymous blank nodes ([]).
  • Migrates the Python documentation skin to Furo.

[0.3.4] - 2022-07-17

Changed

  • Allows multiple value to be given to oxigraph_server --file parameter.
  • Limits parallelism of oxigraph_server file loader to avoid stack overflows.

[0.3.3] - 2022-06-12

Added

  • QueryResults::with_http_redirection_limit that allows to set a limit on the number of HTTP redirection followed (0 by default).

Changed

  • Fixes a bug in SPARQL parser that was always enabling the SILENT option of the SERVICE operator.
  • Allows unknown keys in the objects present in the SPARQL JSON query results. It allows to parse e.g. Virtuoso query results.
  • Allows "typed-literal" as an alias of "literal" in SPARQL JSON query results.
  • Improves the HTTP client error reporting: no silent failures on 4XX and 5XX responses.
  • Upgrades RocksDB to 7.3.1.
  • Upgrades quick-xml to 0.23.

[0.3.2] - 2022-04-24

Changed

  • Fixes a bug in the server bulk loader that crashed on very small files.
  • Upgrades RocksDB to v7.1.
  • Removes some dead code in the bulk loader.

[0.3.1] - 2022-04-02

Changed

  • The default git branch is now main and not master (thanks to @nyurik).
  • Upgrades RocksDB to v7.0.4.
  • Limits the number of bulk loader threads to at most 4 (allows bigger BTree chunks and a better data layout).
  • Limits the number of files opened by RocksDB to the soft file descriptor limit minus 48.

[0.3.0] - 2022-03-19

Changed

  • Fixes compilation on ARM.
  • Moves some lints from errors to warnings in order to avoid compilation failures on different Rust versions.

[0.3.0-rc.1] - 2022-03-14

Added

  • The bulk loader now checks available memory and tries to increase its batch size to make use of it.
  • The Bulk loader provides now a --lenient option to keep loading a file even if invalid data is found (works only with N-Triples and N-Quads). This behavior can be customised in the Rust API using the BulkLoader::on_parse_error method.

Changed

  • Rocksdb has been upgrade to 7.0.2. It now requires a C++17 compatible compiler. This required dropping support of macOS 10.9 to 10.13.

[0.3.0-beta.4] - 2022-02-27

Added

  • JS: Oxigraph NPM package is now also supporting web browsers and WebPack.
  • JS: RDF term related classes now overrides the toString method.
  • Python: It is now possible to directly give a file path to the parse, serialize, Store.load, Store.bulk_load and Store.dump functions.
  • Python: New Store.clear_graph, Store.clear, Store.optimize and Store.flush methods.

Removed

  • sophia_api traits implementation following a request of Sophia maintainer.

Changed

  • SPARQL: fixes evaluation of SPARQL queries with no results but an ORDER BY clause. There should be no group in the output instead of one empty group. This behavior has been changed following this discussion.
  • SPARQL: fixes SPARQL-star evaluation of nested triples with both variables and constants.
  • SPARQL: if results are sorted, literals are now ordered by value, then datatype, then language tag. This ordering is considered as "implementation defined" by the SPARQL specification and is very likely to change in the future.
  • Python: all costly methods now release the python GIL allowing multithreaded usages of pyoxigraph.
  • Rust: SPARQL results writer now flushes the buffer at the end of the results writes. This makes their API less error-prone.
  • Rust: the bulk loader API has been rewritten to allow hooking a progress indicator and set parallelism limit.
  • Server: it is now possible to bulk load gzipped files.

[0.3.0-beta.3] - 2022-02-02

Changed

  • Fixes a bug in the bulk_load_dataset method that was creating an invalid database.
  • Server: Takes into account also URL query parameters if the send SPARQL request body is using form-urlencoded.
  • Upgrades RocksDB to v0.28.2.
  • Generate clean python sdist files compiling Oxigraph from scratch with the proper Cargo.lock.
  • Do not push beta releases to homebrew and python stable documentation.
  • Moves RocksDB binding directory to oxrocksdb-sys.

[0.3.0-beta.2] - 2022-01-29

Changed

  • Fixes release on crates.io of the RocksDB bindings.

[0.3.0-beta.1] - 2022-01-29

Added

  • RDF-star support. Triple is now a possible Term. Serialization formats and SPARQL support have been updated to match the latest version of the specification draft.
  • Fast data bulk load with the Store bulk_load_dataset and bulk_load_graph methods and a special command-line option of the server.
  • It is now possible to quickly backup the database using the backup method.
  • Rust: *Syntax::from_extension to easy guess a graph/dataset/sparql result format from a file extension.
  • Rust: Custom SPARQL functions are now supported using QueryOptions::with_custom_function.
  • Rust: Simple in-memory graph (Graph) and dataset (Dataset) data structures with canonicalization.
  • Nightly build of the server binary and docker image, and of pyoxigraph wheels.
  • Store operations are now transactional using the "repeatable read" isolation level: the store only exposes changes that have been "committed" (i.e. no partial writes) and the exposed state does not change for the complete duration of a read operation (e.g. a SPARQL query) or a read/write operation (e.g. a SPARQL update). the Store transaction method now allows to do read/write transactions. -RDF-star <https://w3c.github.io/rdf-star/cg-spec/2021-12-17.html>_ is now supported (including serialization formats and SPARQL-star). :py:class:.Triple can now be used in :py:attr:.Triple.object, :py:attr:.Triple.object, :py:attr:.Quad.subject and :py:attr:.Quad.object.

Changed

  • SPARQL: It is now possible to compare rdf:langString literals with the same language tag.
  • SPARQL: The parser now validates more carefully the inputs following the SPARQL specification and test suite.
  • SPARQL: Variable scoping was buggy with "FILTER EXISTS". It is now fixed.
  • Rust: RDF model, SPARQL parser and SPARQL result parsers have been moved to stand-alone reusable libraries.
  • Rust: HTTPS is not supported by default with the http_client option. You need to enable the native-tls or the rustls feature of the oxhttp crate to enable a TLS layer.
  • Rust: The error types have been cleaned. Most of the Store methods now return a StorageError that is more descriptive than the previous std::io::Error. The new error type all implements Into<std::io::Error> for easy conversion.
  • Rust: There is now a Subject struct that is the union of NamedNode, BlankNode and Triple. It is The used type of the subject field of the Triple and Quad structs.
  • Rust: The SPARQL algebra is not anymore publicly exposed in the oxigraph crate. The new oxalgebra crate exposes it.
  • Rust: UpdateOptions API have been rewritten. It can now be built using From<QueryOptions> or Default.
  • Server: The command-line API has been redesign. See the server README for more information.
  • Server: The HTTP implementation is now provided by oxhttp.
  • Server: The HTTP response bodies are now generated on the fly instead of being buffered.
  • Python: The SledStore and MemoryStore classes have been removed in favor of the Store class.
  • JS: The MemoryStore class has been renamed to Store.
  • JS: The RDF/JS DataFactory interface is now implemented by the oxigraph module itself and the MemoryStore.dataFactory property has been removed.
  • The implementation of SPARQL evaluation has been improved for better performances (especially joins).
  • The TLS implementation used in SPARQL HTTP calls is now rustls and not native-tls. The host system certificate registry is still used.
  • Spargebra: The basic RDF terms are now the ones of the oxrdf crate.

Removed

  • SledStore and MemoryStore. There is only the RocksDbStore anymore that is renamed to Store.
  • oxigraph_wikibase is now stored in its own repository.
  • Rust: From implementations between oxigraph terms and rio_api terms.

Many thanks to Thad Guidry, James Overton and Jeremiah who sponsored the project during the development of this version.

[0.2.5] - 2021-07-11

Added

Changed

  • The Cargo.lock file is now provided with releases to avoid compilation failures because of changes in dependencies.
  • Uses clap instead of argh for the server arguments parsing.
  • Upgrades PyO3 to v0.14.

[0.2.4] - 2021-04-28

Changed

  • The HTTP server allows to query the union of all graphs using the union-default-graph query parameter and to use the union graph for update WHERE clauses using the using-union-graph parameter.
  • Exposes Sled flush operation (useful for platforms without auto-flush like Windows or Android).
  • Fixes a possible out of bound panic in SPARQL query evaluation.
  • Upgrades RocksDB to 6.17.3.

[0.2.3] - 2021-04-11

Changed

  • Server: Fixes HTTP content negotiation (charset constraints, failure to properly handle */*...).
  • Makes Clippy 1.51 happy.

[0.2.2] - 2021-03-18

Added

  • Support of XML entities to the RDF/XML parser

Changed

  • Serve: Allows unsupported query parameters in HTTP SPARQL requests.
  • Fixes WASM compilation bug and optimises WASM release packages.
  • Fixes named graph creation inside of a SledStore transaction.

[0.2.1] - 2021-01-16

Changed

  • Fixes pyoxigraph build by enforcing a given maturin version.
  • Adds code to build Python wheels for MacOS and Windows.

[0.2.0] - 2021-01-07

Added

  • SPARQL 1.1 Update support for Rust, Python and JavaScript. All store-like classes now provide an update method.
  • SPARQL 1.1 Query Results CSV and TSV Formats serializers and TSV format parser.
  • SPARQL 1.1 Graph Store HTTP Protocol partial support in oxigraph_server. This protocol is accessible under the /store path.
  • The SPARQL Query and Update algebra is now public.
  • The stores are now "graph aware" i.e. it is possible to create and keep empty named graphs.
  • A simple built-in HTTP client. In the Rust library, is disabled by default behind the http_client feature. It powers SPARQL federation and SPARQL UPDATE LOAD operations.
  • std::str::FromStr implementations to NamedNode, BlankNode, Literal, Term and Variable allowing to easily parse Turtle/SPARQL serialization of these terms.
  • Optional Sled storage for oxigraph_server.

Removed

  • The default_graph_uris and named_graph_uris parameters from pyoxigraph query methods.
  • Python 3.5 support.
  • (Memory|RocksDB|Sled)Store::prepare_query methods. It is possible to cache SPARQL query parsing using the Query::parse function and give the parsed query to the query method.

Changed

  • Loading data into oxigraph_server is now possible using /store and not anymore using /. For example, you should use now curl -f -X POST -H 'Content-Type:application/n-quads' --data-binary "@MY_FILE.nq" http://localhost:7878/store to add the N-Quads file MY_FILE.nt to the server dataset.
  • Fixes evaluation of MONTH() and DAY() functions on the xsd:date values.
  • Variable::new now validates the variable name.
  • (Memory|RocksDB|Sled)Store::query does not have an option parameter anymore. There is now a new query_opt method that allows giving options.
  • xsd:boolean SPARQL function now properly follows XPath specification.
  • Fixes SPARQL DESCRIBE evaluation.

Disk data format

The disk data format has been changed between Oxigraph 0.1 (version 0) and Oxigraph 0.2 (version 1). Data is automatically migrated from the version 0 format to the version 1 format when opened with Oxigraph 0.2.

[0.1.1] - 2020-08-14

Added

  • The "sophia" feature implementing the sophia_api traits on Oxigraph terms and stores.
  • Explicit types for quads iterators returned by stores.

Changed

  • QueryOptions::with_default_graph now takes an impl Into<GraphName> instead of an impl Into<NamedNode>.
  • QueryOptions::with_named_graph now takes an impl Into<NamedOrBlankNode> instead of an impl Into<NamedNode>.
  • pyoxigraph query methods now takes two new parameters, default_graph and named_graphs. default_graph_uris and named_graph_uris parameters are deprecated.
  • Fixes a bug in xsd:gYear parsing.

[0.1.0] - 2020-08-09

Added

  • QueryOptions now allows settings the query dataset graph URIs (the SPARQL protocol default-graph-uri and named-graph-uri parameters).
  • pyoxigraph store query methods allows to provide the dataset graph URIs. It also provides an option to use all graph names as the default graph.
  • "default graph as union option" now works with FROM NAMED.
  • pyoxigraph now exposes and documents Variable, QuerySolution, QuerySolutions and QueryTriples

[0.1.0-rc.1] - 2020-08-08

Added

  • oxigraph Rust library with SPARQL 1.1 query support and memory, Sled and RocksDB stores.
  • oxigraph_server standalone SPARQL server.
  • oxigraph_wikibase standalone SPARQL server loading data from a Wikibase instance.
  • pyoxigraph Python library based on Oxigraph.
  • oxigraph NodeJS library based on Oxigraph.