Release v15.0.0-beta.6 · lance-format/lance

What's Changed

fix(index): apply segment ownership in shared-scan batch IVF search by @sezruby in #9638

fix: protect fragment reuse history on stable-row-ID tables by @brendanclement in #9769
docs(format): specify PCA model storage and index compatibility by @beautygua in #9968
feat(index): reuse zone map write seeds across zone sizes and make the null bitmap optional by @LuQQiu in #10165
feat: add Dataset::scan_blobs_as_logical and count MemWAL sidecar blob bytes by @xuanyu-z in #10356
feat(table): implement provider-managed clustering metadata at runtime by @LuQQiu in #10383
feat(compaction): let planners set output fragment clustering IDs and metadata by @LuQQiu in #10409
feat(index): add disk cache codec for ngram postings by @BubbleCal in #10423
feat(index): add disk cache codec for rtree entries by @BubbleCal in #10424
feat(index): add disk cache codecs for minhash entries by @BubbleCal in #10425
feat(mem_wal): scope each MemWAL incarnation to its own directory by @hamersaw in #10432
feat(compaction): compact explicitly chosen fragment groups in place by @LuQQiu in #10445

fix: align mem-wal HNSW construction by @app/lance-gatefixer in #8238
fix(btree): reject zero zone and batch sizes by @SteveStevenpoor in #8442
fix(lance-table): reject out-of-range created_at in IndexMetadata by @foobar in #9089
fix(io): add optional local fsync and identify corrupt files by @app/lance-gatefixer in #9609
fix(index): record the JSON wrapper's target index version by @westonpace in #9721
fix(namespace): honor create/drop mode and require existing parent namespace by @hello-peter-tang in #9867
fix(fts): discount code identifier overlaps in BM25 document length by @Ecthlion in #10329
fix(arrow): align sliced child validity during struct merge by @BubbleCal in #10413
fix(test): update IndexMetadata test initializers by @Xuanwo in #10427
fix(table): remove obsolete DataReplacement stability warning by @app/lance-gatefixer in #10434

docs(index): spec row-address domain for json, inverted, vector, ngram, rtree, minhash_lsh by @westonpace in #10299
docs: require downstream review before stable releases by @BubbleCal in #10426
docs: fix user guide inconsistencies and local build placeholders by @Xuanwo in #10449
docs: add indexing and search user guides by @Xuanwo in #10461

perf(linalg): pick the nearest PQ centroid with a SIMD argmin by @jvdd in #10151
perf(table): re-encode inline row ids in the smallest wire form by @dshepelev15 in #10283
perf(update): skip reading the columns an update assigns by @wkalt in #10396
perf(arrow): reuse sufficiently sized validity buffers by @BubbleCal in #10417
perf(index): compile IVF shuffle and split/join once, not per S×Q by @wjones127 in #10442

revert: compaction row-order suffix relabels (#8400, #9769) by @wjones127 in #10440
refactor(arrow): share struct child validity composition by @Xuanwo in #10452
refactor(index): share resolved segment coverage by @Xuanwo in #10455
refactor(encoding): unify decoder drain planning by @Xuanwo in #10456

Full Changelog: v15.0.0-beta.5...v15.0.0-beta.6