v11.0.0-beta.4
Pre-release
Pre-release
·
548 commits
to main
since this release
What's Changed
Breaking Changes 馃洜
New Features 馃帀
- feat(mem-wal): record index catch-up positions and withdraw them on index change by @xuanyu-z in #8263
- feat(fts): show tokenized queries in analyze plan by @BubbleCal in #8414
- feat(python): expose FTS query tokenization by @BubbleCal in #8415
- feat(python): expose LanceFragment.validate by @keunhong in #8428
- feat(python): expose updated_fragment_offsets in the Update operation binding by @pengw0048 in #8447
Bug Fixes 馃悰
- fix: clear stale manifest index section by @app/lance-gatefixer in #8308
- fix(index): release IVF late-search barrier for skipped deltas by @app/lance-gatefixer in #8350
- fix(dataset): prevent deleting branches referenced by tags by @dentiny in #8365
- fix: prevent unsafe COS manifest commits by @app/lance-gatefixer in #8369
- fix(encoding): return errors for unsupported v2.0 field types by @app/lance-gatefixer in #8370
- fix(python): avoid reopening dataset when pickling fragments by @app/lance-gatefixer in #8373
- fix(build): support pre-Haswell x86_64 hosts by @app/lance-gatefixer in #8377
- fix: return error for invalid list page encoding by @app/lance-gatefixer in #8384
- fix(index): correct cosine RabitQ query factor by @app/lance-gatefixer in #8393
- fix: allow empty V1 writes with non-nullable columns by @app/lance-gatefixer in #8394
- fix(index): convert JSON values during index updates by @app/lance-gatefixer in #8404
- fix(storage): report AWS credential failures as I/O by @app/lance-gatefixer in #8406
- fix(java): carry alterColumns cast type across FFI via C Data Interface by @puchengy in #8417
- fix(docs): align integrations nav with website assembly script by @jackylee-ch in #8419
- fix(linalg): drop casts that make clippy::use_self fail off the CI baseline by @LuciferYang in #8424
- fix: report JSON index statistics by @Xuanwo in #8437
- fix: compile the lance tests after the compacted_sstables rename by @wombatu-kun in #8440
Documentation 馃摎
- docs(python): show how to specify row ids in update transactions by @wjones127 in #8357
- docs: explain remote scan concurrency controls by @app/lance-gatefixer in #8387
- docs(format): add FM-Index to scalar index navigation by @jackylee-ch in #8395
- docs: update crate READMEs to lance-format org by @jackylee-ch in #8398
- docs: fix broken observability and tokenizer links by @Xuanwo in #8413
- docs(python): fix docstring parameter names that do not exist by @jackylee-ch in #8420
- docs: trim redundant agent guidance by @Xuanwo in #8439
Performance Improvements 馃殌
- perf: serialize updated_fragment_offsets as RoaringBitmap bytes in proto by @jerryjch in #7432
- perf(fts): lazily score optional boolean clauses by @BubbleCal in #8448
Other Changes
Full Changelog: v11.0.0-beta.3...v11.0.0-beta.4