Repository navigation
v0.1.0
Immutable datasets with explicit snapshots and manifests
Summary
v0.1.0 is the first release of Lode: datasets of immutable snapshots, each described by a manifest, on the filesystem or in memory.
Highlights
- Datasets and readers with immutable snapshots, manifests, and explicit metadata.
- The default, Hive, and flat layouts, with dataset enumeration and partition pruning.
- Filesystem and in-memory stores with range reads.
- A JSON Lines codec and Gzip compression.
Known Limitations
- Concurrent writers to one dataset can corrupt its history.
- Objects from failed writes may remain.
- Data files without a manifest are not found.
Full Changelog: https://github.com/pithecene/lode/commits/v0.1.0