v5.0.0-beta.3
Pre-release
Pre-release
·
1646 commits
to main
since this release
What's Changed
Breaking Changes 馃洜
- refactor!: cleanup namespace related APIs by @jackye1995 in #6186
- refactor!: align distributed index build around segments by @Xuanwo in #6313
New Features 馃帀
- feat: io_uring based file reader by @westonpace in #5777
- feat: add an arrow-stats crate with the ability to calculate basic stats on arrays by @westonpace in #5967
- feat: change default file format version to 2.1 by @westonpace in #6115
- feat: expose stable row ids by @ivscheianu in #6325
- feat: make MAX_MINIBLOCK_VALUES configurable via env var by @westonpace in #6340
- feat: support bf16 from pytorch dataset by @eddyxu in #6342
- feat: support DataFusion Expr in DeleteBuilder by @wjones127 in #6343
- feat: support distributed IVF_RQ segment builds by @Xuanwo in #6359
- feat: expose branch_identifier in python and java bindings by @majin1102 in #6360
- feat: object store decides scheduler type by @westonpace in #6373
Bug Fixes 馃悰
- fix(python): preserve index details in python index metadata by @Xuanwo in #6279
- fix: use StorageOptions::new() in cloud providers to pick up env vars by @westonpace in #6316
- refactor: remove row-id ordering from vector index merge by @Xuanwo in #6332
- fix: avoid full scan for nullable vector fragment sampling by @Xuanwo in #6341
- fix: respect fragment filters during distributed worker training by @Xuanwo in #6358
Documentation 馃摎
Performance Improvements 馃殌
- perf: remove O(n虏) performance regression in take() with duplicate indices by @YSBF in #6351
- perf: reduce bitmap index build to 1 bitmap in RAM by @wkalt in #6371
Full Changelog: v5.0.0-beta.2...v5.0.0-beta.3