Skip to content

Fix table output for random access benchmark#7806

Open
robert3005 wants to merge 1 commit intodevelopfrom
rk/fixrandomaccessbench
Open

Fix table output for random access benchmark#7806
robert3005 wants to merge 1 commit intodevelopfrom
rk/fixrandomaccessbench

Conversation

@robert3005
Copy link
Copy Markdown
Contributor

Signed-off-by: Robert Kruszewski github@robertk.io

Signed-off-by: Robert Kruszewski <github@robertk.io>
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 6, 2026

Merging this PR will improve performance by 17.09%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 1 improved benchmark
✅ 1205 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime cuda/bitpacked_u8/unpack/3bw[100M] 352.7 µs 301.2 µs +17.09%

Comparing rk/fixrandomaccessbench (72a0785) with develop (924409f)

Open in CodSpeed


match display_format {
DisplayFormat::Table => {
render_table(&mut writer, measurements, &targets)?;
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The trouble is here. Even though targets now only has Vortex, Vortex, Arrow, Parquet, and Arrow, Lance, you're sending in way more measurements. Which value is displayed for Dataset A and Vortex, Vortex? The NVME & footer? non-NVME & footer? NVME & non-footer? non-NVME & non-footer?

The Target is not rich enough to capture all the possible ways in which a benchmark is indexed.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting that it continues to display fine for json output. I have made them produce display from the source of data originally and looks like this got broken

Copy link
Copy Markdown
Contributor

@danking danking left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

x

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants