v14.0.0-beta.11

What's Changed

Critical Fixes ‼️

• fix(encoding): use each layer's dimension when flattening nested FSL by @LuciferYang in #9760
• fix(scan): preserve candidates from inexact scalar index results by @app/lance-gatefixer in #9789

New Features 🎉

• feat(datafusion): estimate total_byte_size for Lance scans by @vivek-bharathan in #9430
• feat(mem_wal): make memtable index kinds pluggable by @xuanyu-z in #9803
• feat(mem_wal): answer memtable filters with Lance's scalar expression pass by @xuanyu-z in #9804
• feat(mem_wal): pass writer settings and flush build parameters to memtable index plugins by @xuanyu-z in #9805
• feat(cache): add tier probes and selective entry reads by @BubbleCal in #9829

Bug Fixes 🐛

• fix: write nullable structs that contain a Null-typed field by @breken-ai in #9579
• fix: read back FixedSizeList columns of the Null type by @breken-ai in #9580
• fix(io): resolve cloud option aliases deterministically by @app/lance-gatefixer in #9719
• fix(cleanup): reclaim abandoned temporary data files by @app/lance-gatefixer in #9747
• fix(merge-insert): preserve join columns in horizontal updates by @app/lance-gatefixer in #9765
• fix(mem_wal): cast a point lookup's base struct to the selected child order by @hamersaw in #9788
• fix(python): accept version 0 as the begin of an explicit delta range by @LuciferYang in #9794
• fix(cache): count IndexMetadata::index_details in deep_size_of by @zehiko in #9828
• fix: allow renames alongside column casts by @app/lance-gatefixer in #9854

Performance Improvements 🚀

• perf(table): keep clustered row ID ranges compact in index by @Abhisheklearn12 in #9501
• perf(core): index column names in Schema::project by @LuciferYang in #9711
• perf(mem_wal): answer a filtered LSM scan of memtables from their filter indexes by @xuanyu-z in #9806
• perf(index): add four-chain native u2 and u6 ex-dot kernels by @BubbleCal in #9839
• perf(mem_wal): grow memtable B-tree arena chunks from 4 KiB by @xuanyu-z in #9848
• perf(index): record zone map seed null positions as runs by @LuQQiu in #9860

Other Changes

• refactor(index): expose RaBitQ encoding and factor primitives by @BubbleCal in #9832
• refactor(mem_wal): drop a dead branch and repeated tests, correct stale docs by @xuanyu-z in #9838
• refactor(encoding): reuse generic blocks for sparse structural arrays by @Xuanwo in #9843

Full Changelog: v14.0.0-beta.10...v14.0.0-beta.11