v12.0.0-beta.7

What's Changed

New Features 🎉

• feat(python): expose more scanner options on LanceFragment by @keunhong in #8429
• feat(cleanup): support cleaning specific dataset versions by @hfutatzhanghb in #8617
• feat(python): restore index retraining by @ddupg in #8786
• feat(mem_wal): let a writer read its own indexed prefix by @hamersaw in #8835
• fix(mem_wal): honor distance_range in the LSM vector planner by @hamersaw in #8845

Bug Fixes 🐛

• fix: make float filters treat -0.0 and 0.0 as the same value by @LuciferYang in #6236
• fix(index): filter stale vector segment rows before top-k by @app/lance-gatefixer in #8351
• fix: defer blank rows when a fully deleted batch has no row to copy by @LuciferYang in #8612
• fix(sql): include system columns when requested for SQL-based query by @dentiny in #8626
• fix(mem_wal): seal the memtable on max_memtable_rows by @hamersaw in #8837
• fix(linalg): distinguish arrow batch type errors by @app/lance-gatefixer in #8911

Documentation 📚

• docs: classify the fragment's non-Lance referenced files by format by @LuciferYang in #8562
• docs(core): correct AVX tier feature semantics by @app/lance-gatefixer in #8910

Performance Improvements 🚀

• perf: run-optimize roaring bitmaps before persisting by @zhangyue19921010 in #8688
• perf(python): stream reader batches from one producer by @jiaoew1991 in #8714
• perf(commit): skip overlap detection for single-segment indices by @zhangyue19921010 in #8778
• perf(rowids): probe the fragments instead of merging every row id by @dshepelev15 in #8883
• perf(index): open fragment reuse indexes 10-2200x faster by @Xuanwo in #8887
• perf(index): prevent two-file shuffle starvation by @BubbleCal in #8894
• perf(io): read large metadata msgs as concurrent chunked range requests by @dshepelev15 in #8914
• perf(index): accelerate RQ scale search by @BubbleCal in #8924

Full Changelog: v12.0.0-beta.6...v12.0.0-beta.7