Repository navigation
v14.0.0-beta.22
Pre-release
Pre-release
·
48 commits
to main
since this release
What's Changed
Critical Fixes ‼️
- fix: include overlay-stale rows in indexed merge insert by @app/lance-gatefixer in #9865
- fix(encoding): read RLE-compressed mini-block dictionary values by @lichuang in #10145
New Features 🎉
- feat(index): f64 centroids support in streaming coreset k-means by @a-erofeev in #8662
- feat(format): define provider-managed clustering metadata by @LuQQiu in #9878
- feat(format): define independent planar metadata for v2.3 by @Xuanwo in #9920
- feat(encoding): implement planar page execution for Lance 2.3 by @Xuanwo in #9921
- feat(encoding): add indexed values to sparse planar pages by @Xuanwo in #9925
- feat(encoding): cap the dictionary size a page may be encoded with by @dshepelev15 in #9939
- feat(java): expose MinHash LSH indices to Java by @zhangyue19921010 in #9965
- feat(python): expose the MinHash LSH index to python by @zhangyue19921010 in #9966
- feat(blob): support managed data file parts and descriptor reuse by @Xuanwo in #10176
- feat(namespace): add the spec operations LanceNamespace lacked by @twmb in #10192
Bug Fixes 🐛
- fix: prevent incomplete unordered listings after retry errors by @kamronis in #9691
- fix(encoding): size full-zip validity by decoded items, not rows by @dshepelev15 in #9906
- fix(namespace): use POST for REST count_rows, tags/list and stats by @twmb in #9993
- fix(namespace): tell tables and namespaces apart in the dir manifest by @twmb in #9998
- fix(io): stop ignoring storage configuration that lance accepts by @LuciferYang in #10008
- fix(compaction): remap address-domain indices eagerly on stable-row-id tables by @westonpace in #10041
- fix(index): allow partition rebalancing within explicit merge windows by @BubbleCal in #10076
- fix(encoding): admit repeated Planar dictionary candidates by @Xuanwo in #10184
- fix(namespace): conform the REST client and adapter to the spec by @twmb in #10190
Documentation 📚
Performance Improvements 🚀
- perf(encoding): bound planar sequence and offset codec selection by @Xuanwo in #9923
- perf(encoding): reduce composite RLE selection and materialization costs by @Xuanwo in #9924
- perf(file): decode lazily loaded column metadata from the tail read by @dshepelev15 in #9938
- perf(index): cache the ownership mask of a vector index segment by @dshepelev15 in #9943
- perf(index): train and encode PQ codebooks through an f32 SoA centroid table by @dshepelev15 in #9945
- perf(io): raise the default AIMD ceiling to 10k by @BubbleCal in #10153
- perf(encoding): dictionary-encode repeated fixed-size vectors by @Xuanwo in #10187
Other Changes
Full Changelog: v14.0.0-beta.21...v14.0.0-beta.22