Skip to content

v0.33.0

Choose a tag to compare

@wjones127 wjones127 released this 14 Aug 05:54
· 2645 commits to main since this release

What's Changed

Breaking Changes 馃洜

  • feat(python)!: unify Python CreateIndex api with Rust implementation by @chenghao-guo in #4438
  • 2.1 format has breaking changes in this version. Files written with earlier versions may not be readable.

New Features 馃帀

  • feat: allow creating empty scalar indices by @wjones127 in #4033
  • feat(python): release GIL in dataset API by @lorinlee in #4389
  • feat: expose decoder config at python side by @Xuanwo in #4335
  • feat: allow empty projection by @westonpace in #4340
  • feat(java): dataset supports reading transaction by @majin1102 in #4397
  • feat: implement explain_plan and analyze_plan for merge_insert operations by @wjones127 in #4295
  • feat(rust): support diff_meta api by @yanghua in #4404
  • feat: auto-build Lance namespace and Spark doc in main Lance website by @jackye1995 in #4411
  • feat: allow row ids (offsets, addresses) in filters to be translated into an optimized take op by @westonpace in #4394
  • feat(java): java transaction supports merge operation by @majin1102 in #4419
  • feat(java): transaction supports UpdateConfig operation by @majin1102 in #4406
  • feat: allow configuring bss for encoding by @Xuanwo in #4393
  • feat(java): java transaction supports rewrite operation by @majin1102 in #4414
  • feat(java): java transaction support restore and reserveFragments operation by @majin1102 in #4435
  • feat(java): introduce update in transaction by @fangbo in #4408
  • feat: support blob encoding in format 2.1 by @Xuanwo in #4449
  • feat(java): introduce delete in transaction by @fangbo in #4441
  • feat(rust): support update stable rowid without index by @yanghua in #4388

Bug Fixes 馃悰

  • fix: limit the depth of filter expression to 500 by @BubbleCal in #4403
  • fix: make sure aws feature is applied to code correctly by @vlovich in #4398
  • fix: fix target alignment incorrect by using LanceBuffer borrow_to_typed_slice by @Xuanwo in #4413
  • fix: wrong OSS path append by @adrian-wang in #4424
  • fix: too large data chunk generated by highly compressed yet nested data with RLE by @Xuanwo in #4431
  • fix: remove explain in sql by @wojiaodoubao in #4428
  • fix: panic message when LanceFileWriter is not closed and then got garbage collected by @wojiaodoubao in #4128
  • fix: update broken links by @ddupg in #4447
  • fix: fix bss been enabled in wrong by @Xuanwo in #4444
  • fix: none ASCII path issue by @majin1102 in #4442
  • fix: btree prewarm causes offset overflow by @BubbleCal in #4448
  • fix: do not panic when reading slices of bitmap column in 2.0 reader by @westonpace in #4452

Performance Improvements 馃殌

Other Changes

  • refactor: optimize MiniBlockRepIndex decode by decoding from bytes directly by @Xuanwo in #4440
  • refactor: refactor encoding proto for 2.1 to cleanup and future-proof by @westonpace in #4434

New Contributors

Full Changelog: v0.32.1...v0.33.0