v0.4.5 Preview private API for merging columns
Welcome @Mause as our newest contributor! Also, a big thank you for your work on the duckdb extension framework.
In this release we added a preview of the feature to do distributed column additions. This makes it possible to distribute Lance Fragments across nodes, add a new column to each Fragment, and then write a new Lance dataset version manifest with the updated schema and files.
What's Changed
- add support for aws profile by @Renkai in #807
- Upgrade Arrow to 37 by @changhiskhan in #810
- Schema intersection by @eddyxu in #814
- Add a check to make sure field names don't contain periods by @changhiskhan in #816
- fix(docs): correct link to docs.rs by @Mause in #819
- update arrow version in duckdb extension by @changhiskhan in #817
- Do not use lifetime on FileWriter by @eddyxu in #820
- Setting field ID after merging the fields. by @eddyxu in #821
- [Rust] Project schema by schema by @eddyxu in #822
- Merge batches from multiple datafiles in the same Fragment by @eddyxu in #815
- Update README.md by @jaichopra in #809
- [Python] Provide a private / distributed add column api in Python by @eddyxu in #823
New Contributors
Full Changelog: v0.4.4...v0.4.5