v0.8.7 Vector index performance improvement, customize file size during writing lance dataset, bug fixes
What's Changed
- chore: use arrow 47 function by @eddyxu in #1439
- refactor: move format definitions to lance-core by @eddyxu in #1440
- refactor: migrate object reader and object writer by @eddyxu in #1442
- fix: fix an issue where the GPU index trainer was taking too much data into memory by @westonpace in #1447
- feat: store a separate tensor blob for IVF centroids by @eddyxu in #1446
- refactor: move all Python operations to the same runtime by @wjones127 in #1445
- chore: bump prost version to latest by @eddyxu in #1449
- chore: update half to 2.3.1 by @jacobBaumbach in #1450
- feat: allow prefiltering to be used with an index by @westonpace in #1435
- feat: benchmark and improve L2 partition compute by @eddyxu in #1453
- chore: increase ivf assignment parallism during indexing by @eddyxu in #1451
- feat: support keyboard interrupt in Python by @wjones127 in #1438
- feat: add parameter to split by file size by @wjones127 in #1444
New Contributors
- @jacobBaumbach made their first contribution in #1450
Full Changelog: v0.8.6...v0.8.7