Skip to content

v11.0.0-beta.4

Pre-release
Pre-release

Choose a tag to compare

@lance-community lance-community released this 11 Aug 04:24
· 548 commits to main since this release

What's Changed

Breaking Changes 馃洜

  • fix(dataset)!: conflict a NOT NULL tightening with concurrent writes by @wkalt in #8347

New Features 馃帀

  • feat(mem-wal): record index catch-up positions and withdraw them on index change by @xuanyu-z in #8263
  • feat(fts): show tokenized queries in analyze plan by @BubbleCal in #8414
  • feat(python): expose FTS query tokenization by @BubbleCal in #8415
  • feat(python): expose LanceFragment.validate by @keunhong in #8428
  • feat(python): expose updated_fragment_offsets in the Update operation binding by @pengw0048 in #8447

Bug Fixes 馃悰

  • fix: clear stale manifest index section by @app/lance-gatefixer in #8308
  • fix(index): release IVF late-search barrier for skipped deltas by @app/lance-gatefixer in #8350
  • fix(dataset): prevent deleting branches referenced by tags by @dentiny in #8365
  • fix: prevent unsafe COS manifest commits by @app/lance-gatefixer in #8369
  • fix(encoding): return errors for unsupported v2.0 field types by @app/lance-gatefixer in #8370
  • fix(python): avoid reopening dataset when pickling fragments by @app/lance-gatefixer in #8373
  • fix(build): support pre-Haswell x86_64 hosts by @app/lance-gatefixer in #8377
  • fix: return error for invalid list page encoding by @app/lance-gatefixer in #8384
  • fix(index): correct cosine RabitQ query factor by @app/lance-gatefixer in #8393
  • fix: allow empty V1 writes with non-nullable columns by @app/lance-gatefixer in #8394
  • fix(index): convert JSON values during index updates by @app/lance-gatefixer in #8404
  • fix(storage): report AWS credential failures as I/O by @app/lance-gatefixer in #8406
  • fix(java): carry alterColumns cast type across FFI via C Data Interface by @puchengy in #8417
  • fix(docs): align integrations nav with website assembly script by @jackylee-ch in #8419
  • fix(linalg): drop casts that make clippy::use_self fail off the CI baseline by @LuciferYang in #8424
  • fix: report JSON index statistics by @Xuanwo in #8437
  • fix: compile the lance tests after the compacted_sstables rename by @wombatu-kun in #8440

Documentation 馃摎

  • docs(python): show how to specify row ids in update transactions by @wjones127 in #8357
  • docs: explain remote scan concurrency controls by @app/lance-gatefixer in #8387
  • docs(format): add FM-Index to scalar index navigation by @jackylee-ch in #8395
  • docs: update crate READMEs to lance-format org by @jackylee-ch in #8398
  • docs: fix broken observability and tokenizer links by @Xuanwo in #8413
  • docs(python): fix docstring parameter names that do not exist by @jackylee-ch in #8420
  • docs: trim redundant agent guidance by @Xuanwo in #8439

Performance Improvements 馃殌

  • perf: serialize updated_fragment_offsets as RoaringBitmap bytes in proto by @jerryjch in #7432
  • perf(fts): lazily score optional boolean clauses by @BubbleCal in #8448

Other Changes

  • refactor: move row id metadata into submodule by @cswpy in #8433

Full Changelog: v11.0.0-beta.3...v11.0.0-beta.4