Skip to content

feat(encoding): select compressed offset blocks - #8330

Draft
Xuanwo wants to merge 3 commits into
xuanwo/generic-block-v5-6-general-boundsfrom
xuanwo/generic-block-v5-7-offset-selection
Draft

feat(encoding): select compressed offset blocks#8330
Xuanwo wants to merge 3 commits into
xuanwo/generic-block-v5-6-general-boundsfrom
xuanwo/generic-block-v5-7-offset-selection

Conversation

@Xuanwo

@Xuanwo Xuanwo commented Aug 6, 2026

Copy link
Copy Markdown
Collaborator

Stack 7 of 10 for Lance generic block sequence compression.

This adds the variable-width offset statistics and selector that evaluate flat, range, delta, RLE, dictionary, and bitpacked representations by complete serialized cost. Selection is fallible, bounded to u32/u64 offsets, and retains flat data unless a candidate is strictly smaller.

The selector is not wired into a production file-version strategy in this layer, so persisted bytes remain unchanged.

Stack navigation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-encoding Encoding, IO, file reader/writer enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant