Skip to content

v0.9.1

Choose a tag to compare

@github-actions github-actions released this 21 Aug 14:34
· 3 commits to main since this release
a983c16

Highlights

Patch release: fixes a crash in compact() introduced by 0.9.0's new exchange_ts field. Any bucket of files spanning the 0.9.0 upgrade — older files without exchange_ts alongside newer ones with it — would raise ArrowInvalid: Schema at index N was different when compacted, since compact() previously required byte-identical schemas across every input file. compact() now tolerates an added column across a bucket, filling it with null in the older rows rather than raising. A genuine type conflict on a column both schemas share still raises, as it should — this only relaxes the added-column case.

If you upgraded straight from a pre-0.9.0 version and haven't yet run compact()/compact_tree() over data spanning that boundary, this release is what makes that safe. No schema or behavior changes beyond compact() itself — 0.9.0's timestamp_ms/exchange_ts semantics are unchanged.

Full Changelog: v0.9.0...v0.9.1