Skip to content

Run vortex-mask benchmarks with codspeed #7804

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
robert3005 merged 1 commit into from
May 5, 2026
+1 −1

Run vortex-mask benchmarks with codspeed

442153e
Select commit
Loading
Failed to load commit list.
Merged

Run vortex-mask benchmarks with codspeed #7804

Run vortex-mask benchmarks with codspeed
442153e
Select commit
Loading
Failed to load commit list.
CodSpeed HQ / CodSpeed Performance Analysis failed May 5, 2026

Performance Regression: -19.16%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

❌ 2 regressed benchmarks
✅ 1178 untouched benchmarks
🆕 26 new benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
🆕 Simulation rank_indices[(0.5, 0.5, "self_dense_rank_dense")] N/A 867.4 µs N/A
🆕 Simulation sparse[(100000, 0.05, "sparse_5pct")] N/A 132.1 µs N/A
🆕 Simulation very_sparse_mask_uncached[(0.1, 0.01, "self_10pct_mask_1pct")] N/A 118.6 µs N/A
🆕 Simulation very_sparse_mask_uncached[(0.5, 0.005, "self_dense_mask_0p5pct")] N/A 432.3 µs N/A
❌ Simulation bitwise_not_vortex_buffer_mut[128] 246.1 ns 304.4 ns -19.16%
❌ Simulation map_new_output[128] 731.1 ns 818.6 ns -10.69%
🆕 Simulation density_matrix[(0.05, 0.5, "self_sparse_mask_dense")] N/A 131.8 µs N/A
🆕 Simulation density_matrix[(0.5, 0.5, "self_dense_mask_dense")] N/A 979 µs N/A
🆕 Simulation rank_indices[(0.01, 0.5, "self_very_sparse_rank_dense")] N/A 54.7 µs N/A
🆕 Simulation rank_indices[(0.05, 0.5, "self_sparse_rank_dense")] N/A 120.1 µs N/A
🆕 Simulation rank_indices[(0.5, 0.01, "self_dense_rank_very_sparse")] N/A 427.9 µs N/A
🆕 Simulation very_sparse_mask_cached[(0.5, 0.005, "self_dense_mask_0p5pct")] N/A 422.3 µs N/A
🆕 Simulation very_sparse_mask_cached[(0.5, 0.02, "self_dense_mask_2pct")] N/A 435.4 µs N/A
🆕 Simulation density_matrix[(0.05, 0.05, "self_sparse_mask_sparse")] N/A 83 µs N/A
🆕 Simulation density_matrix[(0.5, 0.05, "self_dense_mask_sparse")] N/A 482.5 µs N/A
🆕 Simulation intersect_by_rank[(10000, "random")] N/A 103.6 µs N/A
🆕 Simulation intersect_by_rank[(10000, "runs")] N/A 103.6 µs N/A
🆕 Simulation intersect_by_rank[(100000, "random")] N/A 979.4 µs N/A
🆕 Simulation intersect_by_rank[(100000, "runs")] N/A 976.8 µs N/A
🆕 Simulation rank_indices[(0.05, 0.05, "self_sparse_rank_sparse")] N/A 80.8 µs N/A
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Comparing rk/vortex-mask-benchmarks (442153e) with develop (a9dc3a2)

Open in CodSpeed
View more details on CodSpeed HQ