v0.33.0
What's Changed
Breaking Changes 馃洜
- feat(python)!: unify Python CreateIndex api with Rust implementation by @chenghao-guo in #4438
- 2.1 format has breaking changes in this version. Files written with earlier versions may not be readable.
New Features 馃帀
- feat: allow creating empty scalar indices by @wjones127 in #4033
- feat(python): release GIL in dataset API by @lorinlee in #4389
- feat: expose decoder config at python side by @Xuanwo in #4335
- feat: allow empty projection by @westonpace in #4340
- feat(java): dataset supports reading transaction by @majin1102 in #4397
- feat: implement
explain_planandanalyze_planformerge_insertoperations by @wjones127 in #4295 - feat(rust): support diff_meta api by @yanghua in #4404
- feat: auto-build Lance namespace and Spark doc in main Lance website by @jackye1995 in #4411
- feat: allow row ids (offsets, addresses) in filters to be translated into an optimized take op by @westonpace in #4394
- feat(java): java transaction supports merge operation by @majin1102 in #4419
- feat(java): transaction supports UpdateConfig operation by @majin1102 in #4406
- feat: allow configuring bss for encoding by @Xuanwo in #4393
- feat(java): java transaction supports rewrite operation by @majin1102 in #4414
- feat(java): java transaction support restore and reserveFragments operation by @majin1102 in #4435
- feat(java): introduce update in transaction by @fangbo in #4408
- feat: support blob encoding in format 2.1 by @Xuanwo in #4449
- feat(java): introduce delete in transaction by @fangbo in #4441
- feat(rust): support update stable rowid without index by @yanghua in #4388
Bug Fixes 馃悰
- fix: limit the depth of filter expression to 500 by @BubbleCal in #4403
- fix: make sure aws feature is applied to code correctly by @vlovich in #4398
- fix: fix target alignment incorrect by using LanceBuffer borrow_to_typed_slice by @Xuanwo in #4413
- fix: wrong OSS path append by @adrian-wang in #4424
- fix: too large data chunk generated by highly compressed yet nested data with RLE by @Xuanwo in #4431
- fix: remove explain in sql by @wojiaodoubao in #4428
- fix: panic message when LanceFileWriter is not closed and then got garbage collected by @wojiaodoubao in #4128
- fix: update broken links by @ddupg in #4447
- fix: fix bss been enabled in wrong by @Xuanwo in #4444
- fix: none ASCII path issue by @majin1102 in #4442
- fix: btree prewarm causes offset overflow by @BubbleCal in #4448
- fix: do not panic when reading slices of bitmap column in 2.0 reader by @westonpace in #4452
Performance Improvements 馃殌
- perf: introduce
assumefor generating better code by @BubbleCal in #4439
Other Changes
- refactor: optimize MiniBlockRepIndex decode by decoding from bytes directly by @Xuanwo in #4440
- refactor: refactor encoding proto for 2.1 to cleanup and future-proof by @westonpace in #4434
New Contributors
- @adrian-wang made their first contribution in #4424
Full Changelog: v0.32.1...v0.33.0