v3.0.0-beta.3

What's Changed

Breaking Changes 🛠

• feat!: support index progress reporting via callbacks by @wkalt in #5910
• perf!: remove shuffle buffer by @wkalt in #5912

New Features 🎉

• feat: support cleanup across branches by @majin1102 in #5009
• feat(python): expose search_filter in scanner by @wojiaodoubao in #5506
• feat(java): support creating IVF_RQ index by @majin1102 in #5648
• feat: add range to External blob by @wojiaodoubao in #5765
• feat: introduce RowIdSet and RowIdMask by @yanghua in #5771
• feat: add LSM scanner with point lookup and vector search support by @touch-of-grey in #5850
• feat: add rename table implementations to REST namespaces by @bryanck in #5874
• feat(python): expose enable_stable_row_ids in commit() by @fecet in #5908
• feat: support aggregate in scanner by @jackye1995 in #5911
• feat: spill page metadata to disk during IVF shuffle by @wkalt in #5921
• feat: add third party licenses lists by @jackye1995 in #5922
• feat(java): support session by @jackye1995 in #5931
• perf: create local writer for efficient local writes by @wkalt in #5939
• feat: add python and java binding for aggregate by @jackye1995 in #5951
• feat: add proto serialization for FilteredReadExec by @LuQQiu in #5954

Bug Fixes 🐛

• fix: handle NULL elements in LABEL_LIST index results and explain_plan by @fenfeng9 in #5867
• fix(java): align version type from i32 to u64 by @majin1102 in #5892
• fix: avoid panic on empty list LABEL_LIST filters by @fenfeng9 in #5914
• fix: correct OR null semantics for nullable masks by @fenfeng9 in #5919
• fix: respect fragment restrictions in vector and FTS searches when requested fragments by @yingjianwu98 in #5924
• fix: don't drop field metadata on merge insert path by @westonpace in #5927
• fix: apply SchemaAdapter in Updater by @westonpace in #5928
• fix: correct OR null handling for BlockList|BlockList by @fenfeng9 in #5944
• fix: remove unnecessary column projection for count aggregate by @jackye1995 in #5950

Documentation 📚

• docs(governance): introduce incubating subproject concept and update subproject list by @jackye1995 in #5847
• docs: add FTS docs by @prrao87 in #5888
• docs: add schema data types and field IDs documentation by @dik654 in #5925
• docs: add lance-trino doc by @jackye1995 in #5943

Performance Improvements 🚀

• perf: change Dataset::sample to sort its random indices by @wkalt in #5915
• perf: build fp16kernels with NEON support on iOS by @chyyran in #5917
• perf: reduce peak memory in nullable training data sampling by @wkalt in #5935

Other Changes

• refactor: correct panic message typos in OrderableScalarValue::cmp by @fenfeng9 in #5913

Full Changelog: v3.0.0-beta.2...v3.0.0-beta.3