Skip to content

v0.1.0

Choose a tag to compare

@github-actions github-actions released this 03 Feb 12:57
· 261 commits to main since this release
5230f31

Immutable datasets with explicit snapshots and manifests

Summary

v0.1.0 is the first release of Lode: datasets of immutable snapshots, each described by a manifest, on the filesystem or in memory.

Highlights

  • Datasets and readers with immutable snapshots, manifests, and explicit metadata.
  • The default, Hive, and flat layouts, with dataset enumeration and partition pruning.
  • Filesystem and in-memory stores with range reads.
  • A JSON Lines codec and Gzip compression.

Known Limitations

  • Concurrent writers to one dataset can corrupt its history.
  • Objects from failed writes may remain.
  • Data files without a manifest are not found.

Full Changelog: https://github.com/pithecene/lode/commits/v0.1.0