v0.36.0

What's Changed

Breaking Changes 🛠

• feat!: add target_partition_size vector index param by @BubbleCal in #4616
• feat!: add MERGED state to MemWAL index by @jackye1995 in #4673

New Features 🎉

• feat: build type-aware index for JSON by @Xuanwo in #4626
• feat: add json parser for FtsQuery by @wojiaodoubao in #4605
• feat: build Linux wheels with debug symbols for GitHub releases by @wjones127 in #4647
• feat(java): supports fragment-level mergeColumn interface by @steFaiz in #4649
• feat: support build FTS index distributedly by @chenghao-guo in #4578
• feat: merge indices with provided unindexed fragments by @jackye1995 in #4659
• feat: simplify wheel builds with debug parameter for workflow_dispatch by @wjones127 in #4655
• feat: add LanceFileSession for sharing object store amongst file readers by @westonpace in #4670
• feat(java): extends WriteParams in java with enable_stable_row_ids option by @steFaiz in #4674
• feat: add timestamp precision control to logging and document logging by @westonpace in #4669
• feat: add new cleanup policy to retain latest n versions by @wojiaodoubao in #4614
• feat: add bloom filter filter support by @HaochengLIU in #4530
• feat: allow using bitpacking in zero chunk by @Xuanwo in #4694
• feat: add scalar index support in Java/JNI interface by @beinan in #4683
• feat: create indexes from another source dataset by @jackye1995 in #4658
• feat: add compact functionality to Java/JNI interface by @beinan in #4703
• feat(java): expose merge_insert api by @fangbo in #4685
• feat: add plan summary to lance::execution events by @wjones127 in #4700
• feat: add traces for file level IO by @jaystarshot in #4697
• feat: add use_index option for merge insert by @wjones127 in #4688
• feat(python): pass Session when opening dataset by @wjones127 in #3927

Bug Fixes 🐛

• fix: correctly decode lists with all nulls by @westonpace in #4679
• fix: circular reference in index caching leaks memory by @wkalt in #4680
• fix: resolve deadlock when multiple threads access a single LanceFileWriter by @lorinlee in #4600
• fix(rust): fix duplicated source rows when merge insert by @yanghua in #4687
• fix: use consistent naming for rows_per_zone in zone map index by @jackye1995 in #4692
• fix: don't fail reading variable width full-zip with repetition but no definition by @westonpace in #4698

Documentation 📚

• docs: polish docs for JSON data types by @Xuanwo in #4640
• docs: non-optional enum fields in proto3 do not have explicit presence by @jbapple in #4642
• docs: fix vector search add columns issue by @erik-wang-lancedb in #4690

Other Changes

• refactor(python): refactor take bench and support parametrize compression by @yanghua in #4636
• refactor: remove the 2.2 version requirement for using JSON features by @Xuanwo in #4641

New Contributors

• @steFaiz made their first contribution in #4649
• @jaystarshot made their first contribution in #4697
• @erik-wang-lancedb made their first contribution in #4690

Full Changelog: v0.35.0...v0.36.0