Repository navigation
·
234 commits
to main
since this release
Python
- Read Delta tables as PyArrow batches or query them with SQL. Includes column
selection, filters, snapshot refresh, and streaming results.
Quickstart and
API reference. - Python wheels include the native
delta-arrow-readercommand and support
CPython 3.10+ on Linux x86_64, Windows x86_64, and macOS arm64.
Platform requirements.
Command line
- Use
dar inspectto view a table's schema and version, anddar scanto stream
selected rows and columns as Arrow IPC. Supports filters and configurable
resource limits. CLI quickstart. - Run
darfrom standalone Linux amd64 or arm64 archives or container images.
Installation.
Selective reads
- Filtered S3 queries can now download selected values within Parquet pages.
Automatic selection is enabled by default and uses the file layout and measured
network conditions to choose when smaller reads are likely to be faster. - Supports fixed-width numeric and decimal values, plus strings and binary
values in supported file encodings.
Supported layouts and benchmarks.
Upgrading from 0.6
- Opening supported S3 tables now includes network sampling with a five-second
budget, separate from metadata loading. UseWarmupMode::Noneor
WarmupMode::QueryPlanningto skip sampling and partial-page reads.
Configuration. WarmupModeincludes aNetworkvariant with configuration and no longer
supports integer casts such asmode as u8. Code that stores modes as numbers
must use an explicit mapping.
CLI v0.7.0
The CLI binaries and both container platforms passed download verification.
- Version:
0.7.0 - Tested source:
e0c7f9730a6b79b91d5ba46f20b4864bdce68199 - Release commit:
03dc6afc11448de57b6900e411b1bfc1105cc9c9 - Validation: run 38734446398, record artifact
11974462066
Linux amd64 and arm64 require glibc 2.36 or newer, libgcc, and CA certificates. The archives were tested on Debian 12, Ubuntu 24.04, and Fedora 44. Alpine/musl and other platforms are not supported.
| File | SHA256 |
|---|---|
| dar-v0.7.0-linux-amd64-gnu.tar.gz | 5083bbe6eebffa117ff7c704449b72c440a031ec95a2b68ad606f353790dc930 |
| dar-v0.7.0-linux-arm64-gnu.tar.gz | 7079a3b15052732ccebfd5202b15ddc440ade4943f04b25912e770d1c01cd0e1 |
| cli-artifacts.json | 2d0568abc1ab671f9bbb73f7e36fd2603b17053d1718dd70537d77cb59485817 |
| SHA256SUMS | 633523980f744238beb9900fa3d1c5c362e6a84fd5db5a312ab8b530bb0b0181 |
Container: ghcr.io/mag1cfrog/delta-arrow-reader:v0.7.0
Index digest: sha256:9c99e32c0749b9ef61c5157396231b1cfad996245626bbeec647de40d898547f
| Platform | Manifest digest |
|---|---|
| linux/amd64 | sha256:62c30dedb6cd1c0bac6b3865f5d1b127f2abcfd08030d0c10d06f96dbc8b9144 |
| linux/arm64 | sha256:3a3dc906a72e8ade2ec155f39599eff1dad6b926303206175063339629dd8938 |
Use a version or digest when running the image or copying dar into a Go service image. See installation and checksum verification and the Go consumer.