v0.8.5: Incremental Index update, Index Compaction, and bug fixes
What's Changed
- chore: object write trait by @eddyxu in #1389
- refactor: fast path to find fragments for flat scan by @eddyxu in #1394
- refactor: move reader trait to lance-core by @eddyxu in #1393
- refactor: move pq to lance-index by @eddyxu in #1400
- refactor: make pq a batch transformer by @eddyxu in #1401
- feat: run pq portion of ivf_pq in parallel by @westonpace in #1386
- feat: generic shuffler over RecordBatchStream by @eddyxu in #1402
- feat: remap indices on compaction by @westonpace in #1403
- chore: remove unused crate by @eddyxu in #1405
- docs: make overwrite row green by @wjones127 in #1409
- feat: add removed_indices to CreateIndex transaction operation by @eddyxu in #1408
- feat(rust): incremental index update by @eddyxu in #1406
- feat(python): expose index optimization via python by @eddyxu in #1412
- test: add test case to ensure optimize returns to flat KNN by @westonpace in #1416
- fix: fix bug in index remapping when plan contained multiple rewrite groups by @westonpace in #1415
- chore: upgrade to datafusion 32 by @wjones127 in #1391
- ci: cross compile arm wheels by @wjones127 in #1407
- test: add new ann scenarios to the python benchmarks by @westonpace in #1411
- chore: instrument various steps in the ann search by @westonpace in #1404
Full Changelog: v0.8.4...v0.8.5