v0.8.0 Initial prefiltering, faster postfiltering, and more
What's Changed
- fix: bump version workflow by @chebbyChefNEQ in #1297
- fix: knn search works after compaction by @wjones127 in #1304
- feat: add naive prefiltering by @westonpace in #1276
- feat: streaming read selective batches in a single Lance data file by @eddyxu in #1306
- fix: take various types as fragments args and test it by @wjones127 in #1248
- refactor: switch to thin LTO for faster builds by @westonpace in #1299
- feat: disk-based shuffle for IVF partition assignment by @eddyxu in #1300
- fix: tell user column and q are required in nearest by @wjones127 in #1249
- fix: make CompactionPlan pickle-able and import-able by @wjones127 in #1307
- perf: improve scan with filter performance by @wjones127 in #1252
- feat: track fragment size and fragments in indices by @wjones127 in #1290
- feat: improve DX for matrix struct by @eddyxu in #1313
- feat(api!): make create_index mutate self by @wjones127 in #1118
- docs: document commit API as basis for distributed writes by @wjones127 in #1157
- chore: add pre-commit config file to make it easier for future devs to setup python commit hooks by @westonpace in #1319
- feat: add prefilter to the to_table method by @westonpace in #1320
- fix: allow limit as k by @wjones127 in #1323
- feat: allow customizing kmean sample rate for IVF and PQ by @eddyxu in #1322
- feat: add basic integration with rust tracing library by @westonpace in #1310
- feat: add python bindings for the cleanup_old_versions function by @westonpace in #1270
- feat: fused argmin and argmax to avoid unnecessary memory allocation by @eddyxu in #1325
- feat: implement wiki cohere benchmark by @chebbyChefNEQ in #1317
- chore: improve dx of wiki benchmark by @eddyxu in #1327
- chore(rust): improve kmean training time complexity by @eddyxu in #1330
- chore: convenience methods for reading and writing local files by @eddyxu in #1329
- fix: make PageTable handle multiple files by @wjones127 in #1332
Full Changelog: v0.7.5...v0.8.0