Skip to content

v0.7.0

Latest

Choose a tag to compare

@release-plz-bot-mag1cfrog release-plz-bot-mag1cfrog released this 15 Oct 12:55
· 234 commits to main since this release

Python

  • Read Delta tables as PyArrow batches or query them with SQL. Includes column
    selection, filters, snapshot refresh, and streaming results.
    Quickstart and
    API reference.
  • Python wheels include the native delta-arrow-reader command and support
    CPython 3.10+ on Linux x86_64, Windows x86_64, and macOS arm64.
    Platform requirements.

Command line

  • Use dar inspect to view a table's schema and version, and dar scan to stream
    selected rows and columns as Arrow IPC. Supports filters and configurable
    resource limits. CLI quickstart.
  • Run dar from standalone Linux amd64 or arm64 archives or container images.
    Installation.

Selective reads

  • Filtered S3 queries can now download selected values within Parquet pages.
    Automatic selection is enabled by default and uses the file layout and measured
    network conditions to choose when smaller reads are likely to be faster.
  • Supports fixed-width numeric and decimal values, plus strings and binary
    values in supported file encodings.
    Supported layouts and benchmarks.

Upgrading from 0.6

  • Opening supported S3 tables now includes network sampling with a five-second
    budget, separate from metadata loading. Use WarmupMode::None or
    WarmupMode::QueryPlanning to skip sampling and partial-page reads.
    Configuration.
  • WarmupMode includes a Network variant with configuration and no longer
    supports integer casts such as mode as u8. Code that stores modes as numbers
    must use an explicit mapping.

All changes since 0.6.2.

CLI v0.7.0

The CLI binaries and both container platforms passed download verification.

  • Version: 0.7.0
  • Tested source: e0c7f9730a6b79b91d5ba46f20b4864bdce68199
  • Release commit: 03dc6afc11448de57b6900e411b1bfc1105cc9c9
  • Validation: run 38734446398, record artifact 11974462066

Linux amd64 and arm64 require glibc 2.36 or newer, libgcc, and CA certificates. The archives were tested on Debian 12, Ubuntu 24.04, and Fedora 44. Alpine/musl and other platforms are not supported.

File SHA256
dar-v0.7.0-linux-amd64-gnu.tar.gz 5083bbe6eebffa117ff7c704449b72c440a031ec95a2b68ad606f353790dc930
dar-v0.7.0-linux-arm64-gnu.tar.gz 7079a3b15052732ccebfd5202b15ddc440ade4943f04b25912e770d1c01cd0e1
cli-artifacts.json 2d0568abc1ab671f9bbb73f7e36fd2603b17053d1718dd70537d77cb59485817
SHA256SUMS 633523980f744238beb9900fa3d1c5c362e6a84fd5db5a312ab8b530bb0b0181

Container: ghcr.io/mag1cfrog/delta-arrow-reader:v0.7.0

Index digest: sha256:9c99e32c0749b9ef61c5157396231b1cfad996245626bbeec647de40d898547f

Platform Manifest digest
linux/amd64 sha256:62c30dedb6cd1c0bac6b3865f5d1b127f2abcfd08030d0c10d06f96dbc8b9144
linux/arm64 sha256:3a3dc906a72e8ade2ec155f39599eff1dad6b926303206175063339629dd8938

Use a version or digest when running the image or copying dar into a Go service image. See installation and checksum verification and the Go consumer.