Skip to content

v14.0.0-beta.22

Pre-release
Pre-release

Choose a tag to compare

@lance-community lance-community released this 21 Oct 06:24
· 48 commits to main since this release

What's Changed

Critical Fixes ‼️

  • fix: include overlay-stale rows in indexed merge insert by @app/lance-gatefixer in #9865
  • fix(encoding): read RLE-compressed mini-block dictionary values by @lichuang in #10145

New Features 🎉

  • feat(index): f64 centroids support in streaming coreset k-means by @a-erofeev in #8662
  • feat(format): define provider-managed clustering metadata by @LuQQiu in #9878
  • feat(format): define independent planar metadata for v2.3 by @Xuanwo in #9920
  • feat(encoding): implement planar page execution for Lance 2.3 by @Xuanwo in #9921
  • feat(encoding): add indexed values to sparse planar pages by @Xuanwo in #9925
  • feat(encoding): cap the dictionary size a page may be encoded with by @dshepelev15 in #9939
  • feat(java): expose MinHash LSH indices to Java by @zhangyue19921010 in #9965
  • feat(python): expose the MinHash LSH index to python by @zhangyue19921010 in #9966
  • feat(blob): support managed data file parts and descriptor reuse by @Xuanwo in #10176
  • feat(namespace): add the spec operations LanceNamespace lacked by @twmb in #10192

Bug Fixes 🐛

  • fix: prevent incomplete unordered listings after retry errors by @kamronis in #9691
  • fix(encoding): size full-zip validity by decoded items, not rows by @dshepelev15 in #9906
  • fix(namespace): use POST for REST count_rows, tags/list and stats by @twmb in #9993
  • fix(namespace): tell tables and namespaces apart in the dir manifest by @twmb in #9998
  • fix(io): stop ignoring storage configuration that lance accepts by @LuciferYang in #10008
  • fix(compaction): remap address-domain indices eagerly on stable-row-id tables by @westonpace in #10041
  • fix(index): allow partition rebalancing within explicit merge windows by @BubbleCal in #10076
  • fix(encoding): admit repeated Planar dictionary candidates by @Xuanwo in #10184
  • fix(namespace): conform the REST client and adapter to the spec by @twmb in #10190

Documentation 📚

  • docs(format): allow variable-length zones in version 1 write seeds by @LuQQiu in #10155

Performance Improvements 🚀

  • perf(encoding): bound planar sequence and offset codec selection by @Xuanwo in #9923
  • perf(encoding): reduce composite RLE selection and materialization costs by @Xuanwo in #9924
  • perf(file): decode lazily loaded column metadata from the tail read by @dshepelev15 in #9938
  • perf(index): cache the ownership mask of a vector index segment by @dshepelev15 in #9943
  • perf(index): train and encode PQ codebooks through an f32 SoA centroid table by @dshepelev15 in #9945
  • perf(io): raise the default AIMD ceiling to 10k by @BubbleCal in #10153
  • perf(encoding): dictionary-encode repeated fixed-size vectors by @Xuanwo in #10187

Other Changes

  • refactor(format): remove unstable declarations from stable encoding schema by @Xuanwo in #9922

Full Changelog: v14.0.0-beta.21...v14.0.0-beta.22