v13.0.0-beta.5

What's Changed

New Features 🎉

• feat(format): feature flag for a fragment reuse index on stable row id tables by @brendanclement in #9119
• feat(io): add dataset label mode for object store metrics by @dshepelev15 in #9350
• feat(io): accept block_size as a storage option by @dshepelev15 in #9380

Bug Fixes 🐛

• fix(encoding): emit NIL control words when rep/def levels are non-empty but zero-width by @lichuang in #9018
• fix(table): surface a malformed manifest size from DynamoDB by @jackylee-ch in #9023
• fix(index): reject RabitQ metadata without a code dimension by @LuciferYang in #9025
• fix(merge_insert): surface a splitter panic as a stream error by @LuciferYang in #9085
• fix(scanner): do not lower a negated InList into a take by @LuciferYang in #9097
• fix(dataset): stop the fragment-reuse index blocking row id migration by @LuciferYang in #9099
• fix(dataset): keep carried index bases through chained shallow clones by @LuQQiu in #9176
• fix(datafusion): size the memory pool by the effective partition count by @LuQQiu in #9183
• fix: preserve deleted row zero in compaction remaps by @app/lance-gatefixer in #9203
• fix: preserve overlays across rebased deletes by @app/lance-gatefixer in #9218
• fix(dataset): reject a zero add_columns batch size instead of panicking by @zhangyue19921010 in #9233
• fix: reject unsupported nulls in the add_columns stream path by @zhangyue19921010 in #9239
• fix(rowids): reject duplicate values in a SortedArray segment by @jackylee-ch in #9245
• fix(dataset): reuse the prefetch window in BlobFile::read by @geruh in #9330
• fix(dataset): correct BlobFile seek semantics by @geruh in #9358
• fix(io): allow goosefs:/// URLs to use site.properties by @XuQianJin-Stars in #9364
• fix(mem_wal): build the transient FTS index with positions by @hamersaw in #9386
• fix(python): normalize Arrow JSON in LanceFileWriter by @app/lance-gatefixer in #9394

Performance Improvements 🚀

• perf: stop reading past the first manifest when resolving the latest version by @app/copilot-swe-agent in #8729
• perf(fts): decode exact-phrase positions from the rarest term first by @mikewhb in #9170
• perf: buffer BlobFile sequential reads in Rust by @geruh in #9251
• perf(python): import the namespace client lazily by @dshepelev15 in #9273
• perf(io): decode large metadata messages straight from fetched chunks by @dshepelev15 in #9274
• perf(table): keep inline row ids as Bytes slices of the manifest buffer by @dshepelev15 in #9275
• perf(table): fold clustered deletions into range segments by @dshepelev15 in #9311
• perf(fts): cut per-window and per-candidate overhead in bulk AND search by @BubbleCal in #9354
• perf(encoding): batch page reads of a structural column into one I/O request by @dshepelev15 in #9379

Full Changelog: v13.0.0-beta.4...v13.0.0-beta.5