Skip to content

perf(encoding): measure compressed mini-block offsets - #8333

Draft
Xuanwo wants to merge 1 commit into
xuanwo/generic-block-v5-9-format-docsfrom
xuanwo/generic-block-v5-10-benchmarks
Draft

perf(encoding): measure compressed mini-block offsets#8333
Xuanwo wants to merge 1 commit into
xuanwo/generic-block-v5-9-format-docsfrom
xuanwo/generic-block-v5-10-benchmarks

Conversation

@Xuanwo

@Xuanwo Xuanwo commented Aug 6, 2026

Copy link
Copy Markdown
Collaborator

Stack 10 of 10 for Lance generic block sequence compression.

This adds representative Criterion workloads for v2.2 flat and v2.3 generic variable-width mini-block offsets. The harness records complete encoded bytes and measures encode, full scan, and cold/warm chunk-local take paths for range-friendly and delta-friendly corpora.

Benchmark

Measured at ae0a49ba2 with the release-with-debug profile over 262,144 UTF-8 rows.

Workload Encoded bytes Encode median Scan median Cold take median Warm take median
Range, v2.2 → v2.3 5,283,840 → 4,218,880 (-20.2%) 1.512 → 6.824 ms 1.330 → 1.170 ms 249.2 → 202.3 µs 233.6 → 186.8 µs
Delta, v2.2 → v2.3 10,436,608 → 9,355,264 (-10.4%) 2.650 → 10.014 ms 2.136 → 2.259 ms 232.4 → 246.3 µs 219.2 → 226.4 µs

Stack navigation

@github-actions github-actions Bot added the A-encoding Encoding, IO, file reader/writer label Aug 6, 2026
@github-actions

github-actions Bot commented Aug 6, 2026

Copy link
Copy Markdown
Contributor

ACTION NEEDED
Lance follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.

For details on the error please inspect the "PR Title Check" action.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-encoding Encoding, IO, file reader/writer performance

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant