Skip to content

v6.0.0-beta.1

Pre-release
Pre-release

Choose a tag to compare

@lance-community lance-community released this 16 Apr 02:15
· 1552 commits to main since this release

What's Changed

Breaking Changes 馃洜

  • refactor!: vendor the tokenizer stack into lance by @Xuanwo in #6512

New Features 馃帀

  • feat(dictionary-namespace): support table related operation by @zhangyue19921010 in #6308
  • feat: clean up transaction files on failed commits by @wjones127 in #6319
  • refactor: use exact base-scoped store bindings by @Xuanwo in #6422
  • feat: wire batch_size_bytes to Python and public Rust API by @westonpace in #6428
  • feat(index): support float16 and float64 in IVF_FLAT by @BubbleCal in #6476
  • feat: batch chopping fallback for filtered read by @westonpace in #6482
  • feat: add ANN proto codecs and extract table_identifier module by @LuQQiu in #6503
  • feat: add configurable blob v2 pack file size by @hamersaw in #6508

Bug Fixes 馃悰

  • fix: warn and clamp LANCE_INITIAL_UPLOAD_SIZE instead of panicking by @LuciferYang in #6389
  • fix: keep delete-by-source fast path with scalar indexes by @Xuanwo in #6435
  • fix: include column_metadatas and column_infos in CachedFileMetadata::DeepSizeOf by @jiaoew1991 in #6480
  • fix(index): preserve fts prewarm position codec by @BubbleCal in #6485
  • fix: handle FlatBin quantization in optimize_vector_indices_v2 by @jackye1995 in #6488
  • fix: use logical OR instead of bitwise OR in conflict resolver by @dentiny in #6492
  • fix: bump jieba-rs to 0.9.0 to fix build-no-lock CI by @westonpace in #6518
  • fix: blob projection schema compatibility by @Xuanwo in #6521
  • fix(namespace): serialize manifest mutations by @Xuanwo in #6525
  • fix: missing bumpversion entry for lance-tokenizer by @Xuanwo in #6526

Documentation 馃摎

  • docs: tighten python environment workflow guidance by @Xuanwo in #6520

Performance Improvements 馃殌

  • perf: intern DataFile fields/column_indices to reduce manifest memory by @beinan in #6477
  • perf: intern RowDatasetVersionMeta inline bytes to reduce manifest memory by @beinan in #6499
  • perf: submit I/O requests eagerly in FullZipScheduler by @hushengquan in #6513
  • perf: add SIMD-accelerated u8 L2 and cosine distance kernels by @justinrmiller in #6517

Full Changelog: release-root/6.0.0-beta.N...v6.0.0-beta.1