python-v0.15.0: check constraints operation, and faster MERGE
·
1767 commits
to main
since this release
New features
- feat: merge using partition filters by @emcake in #1958
- feat: omit unmodified files during merge write by @Blajda in #1969
- feat: check constraints by @hntd187 in #1915
- feat(python): expose
add constraintoperation by @ion-elgreco in #1973 - feat: add kernel ExpressionEvaluator by @roeap in #1829
- feat: implement S3 log store with transactions backed by DynamoDb by @dispanser in #1904
- feat(python): add writer_properties to all operations by @ion-elgreco in #1980
- feat(python): combine load_version/load_with_datetime into
load_as_versionby @ion-elgreco in #1968 - feat: update to include pyarrow-hotfix by @dennyglee in #1930
- feat: cast list items to default before write with different item names by @JonasDev1 in #1959
- feat(python): expose large_dtype param in
merge@ion-elgreco in #2003 - feat(python): expose custom metadata to writers @ion-elgreco in #1994
Bug Fixes
- fix: respect case sensitivity on operations by @Blajda in #1954
- fix: case sensitivity for z-order by @Blajda in #1982
- fix: implement consistent formatting for constraint expressions by @Blajda in #1985
- fix: remove the get_data_catalog() function by @rtyler in #1941
- fix: handle empty table response in unity api by @JonasDev1 in #1963
- fix: flakey gcs test by @roeap in #1987
- fix: enable S3 integration tests to be configured via environment vars by @dispanser in #1966
- fix: properly decode percent-encoded file paths coming from parquet checkpoints by @sigorbor in #1970
Breaking Changes
To control the writer properties in .update you need to pass the deltalake.WriterProperties class instead of a dicationary.
Other Changes
- chore: relocate cast_record_batch into its own module to shed the datafusion dependency by @rtyler in #1955
- chore: break Glue support into its own crate without rusoto by @rtyler in #1825
- docs: add polars integration by @MrPowers in #1949
- docs: add better installation instructions by @MrPowers in #1951
- docs: datafusion integration by @MrPowers in #1993
- fix: add arrow page back by @ion-elgreco in #1944
- refactor: trigger metadata retrieval only during
DeltaTable.metadataby @ion-elgreco in #1979 - docs: add auto-release when docs are merged to main by @r3stl355 in #1962
- chore: fix CI breaking lint issues by @r3stl355 in #1999
New Contributors
- @JonasDev1 made their first contribution in #1963
Full Changelog: python-v0.14.0...python-v0.15.0