Skip to content

chore: clean up #[inline] annotations#7000

Merged
0ax1 merged 1 commit intodevelopfrom
ad/clean-up-inline
Mar 18, 2026
Merged

chore: clean up #[inline] annotations#7000
0ax1 merged 1 commit intodevelopfrom
ad/clean-up-inline

Conversation

@0ax1
Copy link
Contributor

@0ax1 0ax1 commented Mar 17, 2026

Remove #[inline] from private, pub(crate), and inner functions where the compiler already has full visibility, and from large (>20 line) functions.

Add #[inline] to BitBuffer operator trait impls (BitOr, BitAnd, Not, BitXor) - non-generic impls on a concrete type that are otherwise opaque cross-crate with LTO disabled.

@0ax1 0ax1 requested review from connortsui20 and gatesn March 17, 2026 19:09
@connortsui20 connortsui20 added action/benchmark Trigger full benchmarks to run on this PR changelog/chore A trivial change labels Mar 17, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 17, 2026
@codspeed-hq
Copy link

codspeed-hq bot commented Mar 17, 2026

Merging this PR will degrade performance by 15.51%

❌ 4 regressed benchmarks
✅ 1005 untouched benchmarks
⏩ 1515 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation bench_many_nulls[0.9] 462.9 µs 528.5 µs -12.42%
Simulation bench_many_nulls[0.5] 324.1 µs 360.5 µs -10.1%
Simulation bitwise_not_vortex_buffer_mut[128] 317.8 ns 376.1 ns -15.51%
Simulation bitwise_not_vortex_buffer_mut[1024] 477.2 ns 535.6 ns -10.89%

Comparing ad/clean-up-inline (7e978b8) with develop (002f49e)

Open in CodSpeed

Footnotes

  1. 1515 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@connortsui20
Copy link
Contributor

Seems like there are some things that needed to be inlined in here? related to bitpacking and between eval

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 7e978b8 1 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done 1ffe423 1 Explore Profiling Data
🟢 Done d3bb4ef 1 Explore Profiling Data

Powered by Polar Signals Cloud

@0ax1 0ax1 marked this pull request as draft March 17, 2026 19:19
@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.030x ➖


datafusion / vortex-file-compressed (1.030x ➖, 0↑ 1↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 119271287 115113422 1.04
polarsignals_q01/datafusion:vortex-file-compressed 345258073 341278423 1.01
polarsignals_q02/datafusion:vortex-file-compressed 21919690 21924373 1.00
polarsignals_q03/datafusion:vortex-file-compressed 350647240 345337705 1.02
polarsignals_q04/datafusion:vortex-file-compressed 12505851 12372133 1.01
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17474216 15678208 1.11
polarsignals_q06/datafusion:vortex-file-compressed 19889631 19294560 1.03
polarsignals_q07/datafusion:vortex-file-compressed 12973361 12108053 1.07
polarsignals_q08/datafusion:vortex-file-compressed 450790429 422826415 1.07
polarsignals_q09/datafusion:vortex-file-compressed 10836760 11435416 0.95

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.2%
Vortex (geomean): 0.955x ➖
Parquet (geomean): 0.975x ➖
Shifts: Parquet (control) -2.5% · Median polish -1.5%


datafusion / vortex-file-compressed (0.996x ➖, 1↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 52840717 52734945 1.00
tpch_q02/datafusion:vortex-file-compressed 51074373 51895178 0.98
tpch_q03/datafusion:vortex-file-compressed 27284982 26839854 1.02
tpch_q04/datafusion:vortex-file-compressed 18350628 18419051 1.00
tpch_q05/datafusion:vortex-file-compressed 76583515 76626248 1.00
tpch_q06/datafusion:vortex-file-compressed 9775999 9924297 0.99
tpch_q07/datafusion:vortex-file-compressed 91956511 90441525 1.02
tpch_q08/datafusion:vortex-file-compressed 66159354 65698015 1.01
tpch_q09/datafusion:vortex-file-compressed 88007820 85297757 1.03
tpch_q10/datafusion:vortex-file-compressed 75790217 75985483 1.00
tpch_q11/datafusion:vortex-file-compressed 19447181 19085088 1.02
tpch_q12/datafusion:vortex-file-compressed 33209484 34335857 0.97
tpch_q13/datafusion:vortex-file-compressed 27770152 27516377 1.01
tpch_q14/datafusion:vortex-file-compressed 27565880 26917304 1.02
tpch_q15/datafusion:vortex-file-compressed 🚀 23382095 27246881 0.86
tpch_q16/datafusion:vortex-file-compressed 34078539 34487685 0.99
tpch_q17/datafusion:vortex-file-compressed 73995258 77483521 0.95
tpch_q18/datafusion:vortex-file-compressed 101553493 100711675 1.01
tpch_q19/datafusion:vortex-file-compressed 37595421 34969284 1.08
tpch_q20/datafusion:vortex-file-compressed 48177470 51917828 0.93
tpch_q21/datafusion:vortex-file-compressed 90985680 93726253 0.97
tpch_q22/datafusion:vortex-file-compressed 15757912 14475756 1.09
datafusion / vortex-compact (1.010x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 63486454 63319217 1.00
tpch_q02/datafusion:vortex-compact 54700536 53637761 1.02
tpch_q03/datafusion:vortex-compact 31098250 31598693 0.98
tpch_q04/datafusion:vortex-compact 24191642 23257380 1.04
tpch_q05/datafusion:vortex-compact 83446835 80736407 1.03
tpch_q06/datafusion:vortex-compact 14065665 13710881 1.03
tpch_q07/datafusion:vortex-compact 96624092 94593841 1.02
tpch_q08/datafusion:vortex-compact 73349049 75013465 0.98
tpch_q09/datafusion:vortex-compact 94520429 94788599 1.00
tpch_q10/datafusion:vortex-compact 75944022 78072600 0.97
tpch_q11/datafusion:vortex-compact 20680808 20113935 1.03
tpch_q12/datafusion:vortex-compact 44060896 43545094 1.01
tpch_q13/datafusion:vortex-compact 36215856 36360297 1.00
tpch_q14/datafusion:vortex-compact 30467962 32560560 0.94
tpch_q15/datafusion:vortex-compact 32457035 31699087 1.02
tpch_q16/datafusion:vortex-compact 41367172 39382421 1.05
tpch_q17/datafusion:vortex-compact 80256017 78754644 1.02
tpch_q18/datafusion:vortex-compact 108457436 109184148 0.99
tpch_q19/datafusion:vortex-compact 47982783 43685840 1.10
tpch_q20/datafusion:vortex-compact 54564992 55109980 0.99
tpch_q21/datafusion:vortex-compact 106936946 107536295 0.99
tpch_q22/datafusion:vortex-compact 16840253 16743919 1.01
datafusion / parquet (0.982x ➖, 1↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 105768179 139596350 0.76
tpch_q02/datafusion:parquet 81725863 79613729 1.03
tpch_q03/datafusion:parquet 85499182 87578310 0.98
tpch_q04/datafusion:parquet 53703357 54403810 0.99
tpch_q05/datafusion:parquet 154825447 161877547 0.96
tpch_q06/datafusion:parquet 44687374 48323775 0.92
tpch_q07/datafusion:parquet 179264130 187590457 0.96
tpch_q08/datafusion:parquet 163474512 164667559 0.99
tpch_q09/datafusion:parquet 214031130 211687549 1.01
tpch_q10/datafusion:parquet 186120992 190069748 0.98
tpch_q11/datafusion:parquet 60027549 60137870 1.00
tpch_q12/datafusion:parquet 120230084 121719406 0.99
tpch_q13/datafusion:parquet 199001250 201303245 0.99
tpch_q14/datafusion:parquet 84132570 78691666 1.07
tpch_q15/datafusion:parquet 69984471 69773050 1.00
tpch_q16/datafusion:parquet 53403361 56041271 0.95
tpch_q17/datafusion:parquet 172522574 165952902 1.04
tpch_q18/datafusion:parquet 234115321 237552635 0.99
tpch_q19/datafusion:parquet 95748337 94343802 1.01
tpch_q20/datafusion:parquet 122412234 122203704 1.00
tpch_q21/datafusion:parquet 185023867 181649754 1.02
tpch_q22/datafusion:parquet 40324748 40002204 1.01
datafusion / arrow (0.987x ➖, 1↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 61946681 66228988 0.94
tpch_q02/datafusion:arrow 22417593 22794270 0.98
tpch_q03/datafusion:arrow 36006974 38567806 0.93
tpch_q04/datafusion:arrow 30579360 31554813 0.97
tpch_q05/datafusion:arrow 90662138 97339789 0.93
tpch_q06/datafusion:arrow 21810230 21985272 0.99
tpch_q07/datafusion:arrow 182470726 179847566 1.01
tpch_q08/datafusion:arrow 49062800 46176223 1.06
tpch_q09/datafusion:arrow 76093819 75611263 1.01
tpch_q10/datafusion:arrow 57449003 58446608 0.98
tpch_q11/datafusion:arrow 12523830 11944529 1.05
tpch_q12/datafusion:arrow 58581508 57372696 1.02
tpch_q13/datafusion:arrow 52139313 50490061 1.03
tpch_q14/datafusion:arrow 25470891 25061762 1.02
tpch_q15/datafusion:arrow 50246750 48412219 1.04
tpch_q16/datafusion:arrow 23209453 24126278 0.96
tpch_q17/datafusion:arrow 🚀 79306830 91059981 0.87
tpch_q18/datafusion:arrow 157410675 162108357 0.97
tpch_q19/datafusion:arrow 40884449 41111658 0.99
tpch_q20/datafusion:arrow 40935097 40943513 1.00
tpch_q21/datafusion:arrow 221888577 228072127 0.97
tpch_q22/datafusion:arrow 21102672 21026275 1.00
duckdb / vortex-file-compressed (0.900x ✅, 9↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31905017 34405244 0.93
tpch_q02/duckdb:vortex-file-compressed 26744660 29532619 0.91
tpch_q03/duckdb:vortex-file-compressed 🚀 28054565 33811042 0.83
tpch_q04/duckdb:vortex-file-compressed 29743747 31975816 0.93
tpch_q05/duckdb:vortex-file-compressed 🚀 32823719 36625491 0.90
tpch_q06/duckdb:vortex-file-compressed 🚀 10054196 11976047 0.84
tpch_q07/duckdb:vortex-file-compressed 🚀 35727312 39979613 0.89
tpch_q08/duckdb:vortex-file-compressed 40317354 44283701 0.91
tpch_q09/duckdb:vortex-file-compressed 79600438 87961166 0.90
tpch_q10/duckdb:vortex-file-compressed 36505806 40047841 0.91
tpch_q11/duckdb:vortex-file-compressed 16362129 17935978 0.91
tpch_q12/duckdb:vortex-file-compressed 🚀 23134354 26417317 0.88
tpch_q13/duckdb:vortex-file-compressed 37827910 41716118 0.91
tpch_q14/duckdb:vortex-file-compressed 🚀 21888395 24639688 0.89
tpch_q15/duckdb:vortex-file-compressed 🚀 15508754 17561796 0.88
tpch_q16/duckdb:vortex-file-compressed 29731323 31767528 0.94
tpch_q17/duckdb:vortex-file-compressed 25126508 26452585 0.95
tpch_q18/duckdb:vortex-file-compressed 50649923 52905761 0.96
tpch_q19/duckdb:vortex-file-compressed 🚀 32062621 36711853 0.87
tpch_q20/duckdb:vortex-file-compressed 34346005 37647731 0.91
tpch_q21/duckdb:vortex-file-compressed 🚀 101851339 118185432 0.86
tpch_q22/duckdb:vortex-file-compressed 17855918 19793542 0.90
duckdb / vortex-compact (0.919x ➖, 5↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39757852 42060392 0.95
tpch_q02/duckdb:vortex-compact 37847729 40228215 0.94
tpch_q03/duckdb:vortex-compact 32509079 36018376 0.90
tpch_q04/duckdb:vortex-compact 35342369 38598531 0.92
tpch_q05/duckdb:vortex-compact 37307196 39648747 0.94
tpch_q06/duckdb:vortex-compact 🚀 14638481 16293305 0.90
tpch_q07/duckdb:vortex-compact 43415286 46884386 0.93
tpch_q08/duckdb:vortex-compact 45828834 49667161 0.92
tpch_q09/duckdb:vortex-compact 90898611 93735039 0.97
tpch_q10/duckdb:vortex-compact 40841480 43618110 0.94
tpch_q11/duckdb:vortex-compact 🚀 20150099 23018980 0.88
tpch_q12/duckdb:vortex-compact 38473427 38528849 1.00
tpch_q13/duckdb:vortex-compact 🚀 46281973 51977092 0.89
tpch_q14/duckdb:vortex-compact 31215242 33763874 0.92
tpch_q15/duckdb:vortex-compact 19319556 21252592 0.91
tpch_q16/duckdb:vortex-compact 35277880 38830188 0.91
tpch_q17/duckdb:vortex-compact 🚀 30420639 34598806 0.88
tpch_q18/duckdb:vortex-compact 🚀 50524939 56485167 0.89
tpch_q19/duckdb:vortex-compact 37241409 41178746 0.90
tpch_q20/duckdb:vortex-compact 44670304 47845640 0.93
tpch_q21/duckdb:vortex-compact 110707409 122929155 0.90
tpch_q22/duckdb:vortex-compact 21223566 23144245 0.92
duckdb / parquet (0.968x ➖, 5↑ 3↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 117794919 80258104 1.47
tpch_q02/duckdb:parquet 38905825 39853853 0.98
tpch_q03/duckdb:parquet 70632173 69483270 1.02
tpch_q04/duckdb:parquet 47403124 46971341 1.01
tpch_q05/duckdb:parquet 🚀 66057418 73501947 0.90
tpch_q06/duckdb:parquet 🚀 20224840 31259820 0.65
tpch_q07/duckdb:parquet 81619008 79565796 1.03
tpch_q08/duckdb:parquet 82429720 81711486 1.01
tpch_q09/duckdb:parquet 🚨 156530992 132379253 1.18
tpch_q10/duckdb:parquet 137058046 135348127 1.01
tpch_q11/duckdb:parquet 22414319 22549665 0.99
tpch_q12/duckdb:parquet 45831418 47947245 0.96
tpch_q13/duckdb:parquet 260378960 283047884 0.92
tpch_q14/duckdb:parquet 48873804 50347528 0.97
tpch_q15/duckdb:parquet 🚀 24372465 32513713 0.75
tpch_q16/duckdb:parquet 57595483 56726230 1.02
tpch_q17/duckdb:parquet 53572429 55697454 0.96
tpch_q18/duckdb:parquet 118341261 124706634 0.95
tpch_q19/duckdb:parquet 🚨 87043717 77294830 1.13
tpch_q20/duckdb:parquet 🚀 63587092 78486617 0.81
tpch_q21/duckdb:parquet 🚀 165002245 186660205 0.88
tpch_q22/duckdb:parquet 52598839 54535914 0.96
duckdb / duckdb (0.911x ➖, 6↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15895814 16510780 0.96
tpch_q02/duckdb:duckdb 🚀 11747607 14306087 0.82
tpch_q03/duckdb:duckdb 18423103 19835584 0.93
tpch_q04/duckdb:duckdb 19635441 20702517 0.95
tpch_q05/duckdb:duckdb 20183453 22279501 0.91
tpch_q06/duckdb:duckdb 5174755 5691995 0.91
tpch_q07/duckdb:duckdb 23493986 23955182 0.98
tpch_q08/duckdb:duckdb 20613730 22679506 0.91
tpch_q09/duckdb:duckdb 🚀 52521514 62967303 0.83
tpch_q10/duckdb:duckdb 43892857 48370257 0.91
tpch_q11/duckdb:duckdb 🚀 5678270 6374881 0.89
tpch_q12/duckdb:duckdb 13533418 14740399 0.92
tpch_q13/duckdb:duckdb 37031273 40211577 0.92
tpch_q14/duckdb:duckdb 🚀 15823252 18102005 0.87
tpch_q15/duckdb:duckdb 11800947 12250778 0.96
tpch_q16/duckdb:duckdb 🚀 23555078 26781429 0.88
tpch_q17/duckdb:duckdb 13644417 15129826 0.90
tpch_q18/duckdb:duckdb 37696789 39590902 0.95
tpch_q19/duckdb:duckdb 🚀 25745259 30152416 0.85
tpch_q20/duckdb:duckdb 22836856 23602663 0.97
tpch_q21/duckdb:duckdb 56089410 61786069 0.91
tpch_q22/duckdb:duckdb 23841765 25765889 0.93
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -6.5% +5.5% -11.3% +32.2% ➖ noise
1 datafusion:vortex-compact +0.3% +5.5% -4.9% +29.2% ➖ noise
1 datafusion:vortex-file-compressed +0.2% +5.5% -5.0% +27.0% ➖ noise
1 duckdb:duckdb -3.7% +5.5% -8.7% +26.7% ➖ noise
1 duckdb:vortex-compact -5.5% +5.5% -10.4% +25.5% ➖ noise
1 duckdb:vortex-file-compressed -7.3% +5.5% -12.1% +26.9% ➖ noise
2 datafusion:arrow -1.7% +0.1% -1.8% +20.6% ➖ noise
2 datafusion:vortex-compact +2.0% +0.1% +1.9% +20.6% ➖ noise
2 datafusion:vortex-file-compressed -1.6% +0.1% -1.7% +20.6% ➖ noise
2 duckdb:duckdb -17.9% +0.1% -18.0% +20.6% ✅ faster
2 duckdb:vortex-compact -5.9% +0.1% -6.0% +20.6% ➖ noise
2 duckdb:vortex-file-compressed -9.4% +0.1% -9.5% +20.6% ➖ noise
3 datafusion:arrow -6.6% -0.4% -6.3% +20.6% ➖ noise
3 datafusion:vortex-compact -1.6% -0.4% -1.2% +20.6% ➖ noise
3 datafusion:vortex-file-compressed +1.7% -0.4% +2.0% +20.6% ➖ noise
3 duckdb:duckdb -7.1% -0.4% -6.8% +20.6% ➖ noise
3 duckdb:vortex-compact -9.7% -0.4% -9.4% +20.6% ➖ noise
3 duckdb:vortex-file-compressed -17.0% -0.4% -16.7% +20.6% ➖ noise
4 datafusion:arrow -3.1% -0.2% -2.9% +20.6% ➖ noise
4 datafusion:vortex-compact +4.0% -0.2% +4.2% +20.6% ➖ noise
4 datafusion:vortex-file-compressed -0.4% -0.2% -0.2% +20.6% ➖ noise
4 duckdb:duckdb -5.2% -0.2% -5.0% +20.6% ➖ noise
4 duckdb:vortex-compact -8.4% -0.2% -8.3% +20.6% ➖ noise
4 duckdb:vortex-file-compressed -7.0% -0.2% -6.8% +20.6% ➖ noise
5 datafusion:arrow -6.9% -7.3% +0.5% +20.6% ➖ noise
5 datafusion:vortex-compact +3.4% -7.3% +11.5% +20.6% ➖ noise
5 datafusion:vortex-file-compressed -0.1% -7.3% +7.8% +20.6% ➖ noise
5 duckdb:duckdb -9.4% -7.3% -2.3% +20.6% ➖ noise
5 duckdb:vortex-compact -5.9% -7.3% +1.5% +20.6% ➖ noise
5 duckdb:vortex-file-compressed -10.4% -7.3% -3.3% +20.6% ➖ noise
6 datafusion:arrow -0.8% -22.6% +28.3% +23.8% 🚨 regression
6 datafusion:vortex-compact +2.6% -22.6% +32.6% +25.2% 🚨 regression
6 datafusion:vortex-file-compressed -1.5% -22.6% +27.4% +26.1% 🚨 regression
6 duckdb:duckdb -9.1% -22.6% +17.5% +26.6% ➖ noise
6 duckdb:vortex-compact -10.2% -22.6% +16.2% +23.2% ➖ noise
6 duckdb:vortex-file-compressed -16.0% -22.6% +8.5% +24.2% ➖ noise
7 datafusion:arrow +1.5% -1.0% +2.5% +20.6% ➖ noise
7 datafusion:vortex-compact +2.1% -1.0% +3.2% +20.6% ➖ noise
7 datafusion:vortex-file-compressed +1.7% -1.0% +2.7% +20.6% ➖ noise
7 duckdb:duckdb -1.9% -1.0% -0.9% +20.6% ➖ noise
7 duckdb:vortex-compact -7.4% -1.0% -6.5% +20.6% ➖ noise
7 duckdb:vortex-file-compressed -10.6% -1.0% -9.7% +20.6% ➖ noise
8 datafusion:arrow +6.3% +0.1% +6.2% +20.6% ➖ noise
8 datafusion:vortex-compact -2.2% +0.1% -2.3% +20.6% ➖ noise
8 datafusion:vortex-file-compressed +0.7% +0.1% +0.6% +20.6% ➖ noise
8 duckdb:duckdb -9.1% +0.1% -9.2% +20.6% ➖ noise
8 duckdb:vortex-compact -7.7% +0.1% -7.8% +20.6% ➖ noise
8 duckdb:vortex-file-compressed -9.0% +0.1% -9.0% +20.6% ➖ noise
9 datafusion:arrow +0.6% +9.3% -8.0% +20.6% ➖ noise
9 datafusion:vortex-compact -0.3% +9.3% -8.8% +20.6% ➖ noise
9 datafusion:vortex-file-compressed +3.2% +9.3% -5.6% +20.6% ➖ noise
9 duckdb:duckdb -16.6% +9.3% -23.7% +20.6% ✅ faster
9 duckdb:vortex-compact -3.0% +9.3% -11.3% +20.6% ➖ noise
9 duckdb:vortex-file-compressed -9.5% +9.3% -17.2% +20.6% ✅ faster
10 datafusion:arrow -1.7% -0.4% -1.3% +20.6% ➖ noise
10 datafusion:vortex-compact -2.7% -0.4% -2.3% +20.6% ➖ noise
10 datafusion:vortex-file-compressed -0.3% -0.4% +0.2% +20.6% ➖ noise
10 duckdb:duckdb -9.3% -0.4% -8.9% +20.6% ➖ noise
10 duckdb:vortex-compact -6.4% -0.4% -6.0% +20.6% ➖ noise
10 duckdb:vortex-file-compressed -8.8% -0.4% -8.5% +20.6% ➖ noise
11 datafusion:arrow +4.8% -0.4% +5.3% +20.6% ➖ noise
11 datafusion:vortex-compact +2.8% -0.4% +3.2% +20.6% ➖ noise
11 datafusion:vortex-file-compressed +1.9% -0.4% +2.3% +20.6% ➖ noise
11 duckdb:duckdb -10.9% -0.4% -10.6% +20.6% ➖ noise
11 duckdb:vortex-compact -12.5% -0.4% -12.1% +20.6% ➖ noise
11 duckdb:vortex-file-compressed -8.8% -0.4% -8.4% +20.6% ➖ noise
12 datafusion:arrow +2.1% -2.8% +5.1% +20.6% ➖ noise
12 datafusion:vortex-compact +1.2% -2.8% +4.1% +20.6% ➖ noise
12 datafusion:vortex-file-compressed -3.3% -2.8% -0.5% +20.6% ➖ noise
12 duckdb:duckdb -8.2% -2.8% -5.5% +20.6% ➖ noise
12 duckdb:vortex-compact -0.1% -2.8% +2.8% +20.6% ➖ noise
12 duckdb:vortex-file-compressed -12.4% -2.8% -9.9% +20.6% ➖ noise
13 datafusion:arrow +3.3% -4.6% +8.3% +20.6% ➖ noise
13 datafusion:vortex-compact -0.4% -4.6% +4.4% +20.6% ➖ noise
13 datafusion:vortex-file-compressed +0.9% -4.6% +5.8% +20.6% ➖ noise
13 duckdb:duckdb -7.9% -4.6% -3.4% +20.6% ➖ noise
13 duckdb:vortex-compact -11.0% -4.6% -6.6% +20.6% ➖ noise
13 duckdb:vortex-file-compressed -9.3% -4.6% -4.9% +20.6% ➖ noise
14 datafusion:arrow +1.6% +1.9% -0.2% +20.6% ➖ noise
14 datafusion:vortex-compact -6.4% +1.9% -8.1% +20.6% ➖ noise
14 datafusion:vortex-file-compressed +2.4% +1.9% +0.5% +20.6% ➖ noise
14 duckdb:duckdb -12.6% +1.9% -14.2% +23.6% ➖ noise
14 duckdb:vortex-compact -7.5% +1.9% -9.2% +20.6% ➖ noise
14 duckdb:vortex-file-compressed -11.2% +1.9% -12.8% +20.6% ➖ noise
15 datafusion:arrow +3.8% -13.3% +19.7% +20.6% ➖ noise
15 datafusion:vortex-compact +2.4% -13.3% +18.1% +20.6% ➖ noise
15 datafusion:vortex-file-compressed -14.2% -13.3% -1.0% +20.6% ➖ noise
15 duckdb:duckdb -3.7% -13.3% +11.1% +20.6% ➖ noise
15 duckdb:vortex-compact -9.1% -13.3% +4.8% +20.6% ➖ noise
15 duckdb:vortex-file-compressed -11.7% -13.3% +1.8% +20.6% ➖ noise
16 datafusion:arrow -3.8% -1.6% -2.2% +20.6% ➖ noise
16 datafusion:vortex-compact +5.0% -1.6% +6.8% +20.6% ➖ noise
16 datafusion:vortex-file-compressed -1.2% -1.6% +0.5% +20.6% ➖ noise
16 duckdb:duckdb -12.0% -1.6% -10.6% +20.6% ➖ noise
16 duckdb:vortex-compact -9.1% -1.6% -7.6% +20.6% ➖ noise
16 duckdb:vortex-file-compressed -6.4% -1.6% -4.9% +20.6% ➖ noise
17 datafusion:arrow -12.9% -0.0% -12.9% +20.6% ➖ noise
17 datafusion:vortex-compact +1.9% -0.0% +1.9% +20.6% ➖ noise
17 datafusion:vortex-file-compressed -4.5% -0.0% -4.5% +20.6% ➖ noise
17 duckdb:duckdb -9.8% -0.0% -9.8% +20.6% ➖ noise
17 duckdb:vortex-compact -12.1% -0.0% -12.1% +20.6% ➖ noise
17 duckdb:vortex-file-compressed -5.0% -0.0% -5.0% +20.6% ➖ noise
18 datafusion:arrow -2.9% -3.3% +0.4% +20.6% ➖ noise
18 datafusion:vortex-compact -0.7% -3.3% +2.7% +20.6% ➖ noise
18 datafusion:vortex-file-compressed +0.8% -3.3% +4.3% +20.6% ➖ noise
18 duckdb:duckdb -4.8% -3.3% -1.5% +20.6% ➖ noise
18 duckdb:vortex-compact -10.6% -3.3% -7.5% +20.6% ➖ noise
18 duckdb:vortex-file-compressed -4.3% -3.3% -1.0% +20.6% ➖ noise
19 datafusion:arrow -0.6% +6.9% -7.0% +20.6% ➖ noise
19 datafusion:vortex-compact +9.8% +6.9% +2.7% +21.7% ➖ noise
19 datafusion:vortex-file-compressed +7.5% +6.9% +0.6% +20.6% ➖ noise
19 duckdb:duckdb -14.6% +6.9% -20.1% +20.6% ✅ faster
19 duckdb:vortex-compact -9.6% +6.9% -15.4% +20.6% ➖ noise
19 duckdb:vortex-file-compressed -12.7% +6.9% -18.3% +20.6% ✅ faster
20 datafusion:arrow -0.0% -9.9% +11.0% +20.6% ➖ noise
20 datafusion:vortex-compact -1.0% -9.9% +9.9% +20.6% ➖ noise
20 datafusion:vortex-file-compressed -7.2% -9.9% +3.0% +20.6% ➖ noise
20 duckdb:duckdb -3.2% -9.9% +7.4% +20.6% ➖ noise
20 duckdb:vortex-compact -6.6% -9.9% +3.6% +20.6% ➖ noise
20 duckdb:vortex-file-compressed -8.8% -9.9% +1.3% +20.6% ➖ noise
21 datafusion:arrow -2.7% -5.1% +2.5% +20.6% ➖ noise
21 datafusion:vortex-compact -0.6% -5.1% +4.8% +20.6% ➖ noise
21 datafusion:vortex-file-compressed -2.9% -5.1% +2.3% +20.6% ➖ noise
21 duckdb:duckdb -9.2% -5.1% -4.3% +20.6% ➖ noise
21 duckdb:vortex-compact -9.9% -5.1% -5.1% +20.6% ➖ noise
21 duckdb:vortex-file-compressed -13.8% -5.1% -9.2% +20.6% ➖ noise
22 datafusion:arrow +0.4% -1.4% +1.8% +25.6% ➖ noise
22 datafusion:vortex-compact +0.6% -1.4% +2.0% +20.6% ➖ noise
22 datafusion:vortex-file-compressed +8.9% -1.4% +10.4% +20.6% ➖ noise
22 duckdb:duckdb -7.5% -1.4% -6.2% +20.6% ➖ noise
22 duckdb:vortex-compact -8.3% -1.4% -7.0% +20.6% ➖ noise
22 duckdb:vortex-file-compressed -9.8% -1.4% -8.5% +20.6% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -6.2%
Vortex (geomean): 0.875x ✅
Parquet (geomean): 0.933x ➖
Shifts: Parquet (control) -6.7% · Median polish -11.3%


datafusion / vortex-file-compressed (0.874x ✅, 7↑ 1↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5062801 4460245 1.14
fineweb_q01/datafusion:vortex-file-compressed 26740755 28870019 0.93
fineweb_q02/datafusion:vortex-file-compressed 🚀 27218539 34685628 0.78
fineweb_q03/datafusion:vortex-file-compressed 🚀 81216959 95482517 0.85
fineweb_q04/datafusion:vortex-file-compressed 🚀 245979817 277476988 0.89
fineweb_q05/datafusion:vortex-file-compressed 🚀 195297971 222714950 0.88
fineweb_q06/datafusion:vortex-file-compressed 🚀 68161245 78625280 0.87
fineweb_q07/datafusion:vortex-file-compressed 🚀 69742041 84010817 0.83
fineweb_q08/datafusion:vortex-file-compressed 🚀 22375380 29466510 0.76
datafusion / vortex-compact (0.919x ➖, 3↑ 1↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 4394062 5282727 0.83
fineweb_q01/datafusion:vortex-compact 166088915 180108340 0.92
fineweb_q02/datafusion:vortex-compact 🚀 163573589 184094488 0.89
fineweb_q03/datafusion:vortex-compact 1442056424 1538713832 0.94
fineweb_q04/datafusion:vortex-compact 1551818241 1635001297 0.95
fineweb_q05/datafusion:vortex-compact 1221654261 1341216241 0.91
fineweb_q06/datafusion:vortex-compact 🚀 692073811 830827241 0.83
fineweb_q07/datafusion:vortex-compact 725329555 793956651 0.91
fineweb_q08/datafusion:vortex-compact 🚨 23482280 21017389 1.12
datafusion / parquet (0.929x ➖, 2↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6026210 6223082 0.97
fineweb_q01/datafusion:parquet 273380972 296056242 0.92
fineweb_q02/datafusion:parquet 🚀 271006593 303287101 0.89
fineweb_q03/datafusion:parquet 279007880 288813362 0.97
fineweb_q04/datafusion:parquet 286549495 315654713 0.91
fineweb_q05/datafusion:parquet 281087541 295760413 0.95
fineweb_q06/datafusion:parquet 🚀 275488622 321021695 0.86
fineweb_q07/datafusion:parquet 271399933 290302506 0.93
fineweb_q08/datafusion:parquet 265680036 275626083 0.96
duckdb / vortex-file-compressed (0.825x ✅, 8↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3318360 4835289 0.69
fineweb_q01/duckdb:vortex-file-compressed 🚀 28291445 34091760 0.83
fineweb_q02/duckdb:vortex-file-compressed 🚀 29987944 34925613 0.86
fineweb_q03/duckdb:vortex-file-compressed 153042858 156386893 0.98
fineweb_q04/duckdb:vortex-file-compressed 🚀 206310136 233176633 0.88
fineweb_q05/duckdb:vortex-file-compressed 🚀 176092679 203452220 0.87
fineweb_q06/duckdb:vortex-file-compressed 🚀 64560453 79369562 0.81
fineweb_q07/duckdb:vortex-file-compressed 🚀 66378921 82769207 0.80
fineweb_q08/duckdb:vortex-file-compressed 🚀 25159714 33987041 0.74
duckdb / vortex-compact (0.884x ✅, 4↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 3816405 4804176 0.79
fineweb_q01/duckdb:vortex-compact 🚀 106492822 118967150 0.90
fineweb_q02/duckdb:vortex-compact 🚀 114364911 131975129 0.87
fineweb_q03/duckdb:vortex-compact 849892266 926944988 0.92
fineweb_q04/duckdb:vortex-compact 902500230 980543668 0.92
fineweb_q05/duckdb:vortex-compact 814674405 881544379 0.92
fineweb_q06/duckdb:vortex-compact 466725612 506399646 0.92
fineweb_q07/duckdb:vortex-compact 475919690 513820037 0.93
fineweb_q08/duckdb:vortex-compact 🚀 21143942 26235637 0.81
duckdb / parquet (0.937x ➖, 1↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36331706 37265864 0.97
fineweb_q01/duckdb:parquet 91654026 94729625 0.97
fineweb_q02/duckdb:parquet 95447377 100936927 0.95
fineweb_q03/duckdb:parquet 305583193 319132385 0.96
fineweb_q04/duckdb:parquet 438954885 457373706 0.96
fineweb_q05/duckdb:parquet 407335366 445697117 0.91
fineweb_q06/duckdb:parquet 197224379 214494288 0.92
fineweb_q07/duckdb:parquet 🚀 208118257 233820667 0.89
fineweb_q08/duckdb:parquet 57132120 63105537 0.91
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -16.8% -2.8% -14.4% +44.8% ➖ noise
0 datafusion:vortex-file-compressed +13.5% -2.8% +16.8% +82.1% ➖ noise
0 duckdb:vortex-compact -20.6% -2.8% -18.2% +51.2% ➖ noise
0 duckdb:vortex-file-compressed -31.4% -2.8% -29.4% +55.6% ➖ noise
1 datafusion:vortex-compact -7.8% -5.5% -2.4% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -7.4% -5.5% -2.0% +15.0% ➖ noise
1 duckdb:vortex-compact -10.5% -5.5% -5.3% +21.5% ➖ noise
1 duckdb:vortex-file-compressed -17.0% -5.5% -12.2% +35.8% ➖ noise
2 datafusion:vortex-compact -11.1% -8.1% -3.3% +13.0% ➖ noise
2 datafusion:vortex-file-compressed -21.5% -8.1% -14.6% +20.6% ➖ noise
2 duckdb:vortex-compact -13.3% -8.1% -5.7% +12.0% ➖ noise
2 duckdb:vortex-file-compressed -14.1% -8.1% -6.6% +20.4% ➖ noise
3 datafusion:vortex-compact -6.3% -3.8% -2.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -14.9% -3.8% -11.6% +26.2% ➖ noise
3 duckdb:vortex-compact -8.3% -3.8% -4.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.1% -3.8% +1.7% +25.1% ➖ noise
4 datafusion:vortex-compact -5.1% -6.7% +1.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -11.4% -6.7% -5.0% +15.0% ➖ noise
4 duckdb:vortex-compact -8.0% -6.7% -1.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -11.5% -6.7% -5.2% +10.0% ➖ noise
5 datafusion:vortex-compact -8.9% -6.8% -2.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -12.3% -6.8% -5.9% +12.2% ➖ noise
5 duckdb:vortex-compact -7.6% -6.8% -0.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -13.4% -6.8% -7.1% +10.0% ➖ noise
6 datafusion:vortex-compact -16.7% -11.2% -6.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -13.3% -11.2% -2.4% +15.8% ➖ noise
6 duckdb:vortex-compact -7.8% -11.2% +3.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -18.7% -11.2% -8.4% +11.8% ➖ noise
7 datafusion:vortex-compact -8.6% -8.8% +0.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -17.0% -8.8% -9.0% +13.8% ➖ noise
7 duckdb:vortex-compact -7.4% -8.8% +1.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -19.8% -8.8% -12.1% +10.0% ✅ faster
8 datafusion:vortex-compact +11.7% -6.6% +19.6% +19.5% 🚨 regression
8 datafusion:vortex-file-compressed -24.1% -6.6% -18.7% +46.5% ➖ noise
8 duckdb:vortex-compact -19.4% -6.6% -13.7% +19.4% ➖ noise
8 duckdb:vortex-file-compressed -26.0% -6.6% -20.8% +28.1% ➖ noise

@0ax1 0ax1 force-pushed the ad/clean-up-inline branch from d3bb4ef to 5be4b29 Compare March 17, 2026 19:25
@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.4%
Vortex (geomean): 0.996x ➖
Parquet (geomean): 0.951x ➖
Shifts: Parquet (control) -4.9% · Median polish +0.4%


datafusion / vortex-file-compressed (0.939x ➖, 23↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 28070190 33096389 0.85
tpcds_q02/datafusion:vortex-file-compressed 78718935 84837335 0.93
tpcds_q03/datafusion:vortex-file-compressed 🚀 28074487 33088626 0.85
tpcds_q04/datafusion:vortex-file-compressed 🚀 390258256 449968054 0.87
tpcds_q05/datafusion:vortex-file-compressed 🚀 72091123 82764341 0.87
tpcds_q06/datafusion:vortex-file-compressed 🚀 76640928 87024294 0.88
tpcds_q07/datafusion:vortex-file-compressed 76443429 81056102 0.94
tpcds_q08/datafusion:vortex-file-compressed 41696406 45862390 0.91
tpcds_q09/datafusion:vortex-file-compressed 🚀 48378320 55556879 0.87
tpcds_q10/datafusion:vortex-file-compressed 🚀 49913704 56143807 0.89
tpcds_q11/datafusion:vortex-file-compressed 🚀 240056771 268551854 0.89
tpcds_q12/datafusion:vortex-file-compressed 35383085 37261247 0.95
tpcds_q13/datafusion:vortex-file-compressed 79861190 76362537 1.05
tpcds_q14/datafusion:vortex-file-compressed 221943664 242752098 0.91
tpcds_q15/datafusion:vortex-file-compressed 🚀 51495124 62330175 0.83
tpcds_q16/datafusion:vortex-file-compressed 🚀 30086659 39609940 0.76
tpcds_q17/datafusion:vortex-file-compressed 🚀 113841419 137717860 0.83
tpcds_q18/datafusion:vortex-file-compressed 🚀 103000616 120574536 0.85
tpcds_q19/datafusion:vortex-file-compressed 🚀 49344282 62523667 0.79
tpcds_q20/datafusion:vortex-file-compressed 🚀 40828833 53024653 0.77
tpcds_q21/datafusion:vortex-file-compressed 🚀 179120212 210641393 0.85
tpcds_q22/datafusion:vortex-file-compressed 🚀 72474739 89076482 0.81
tpcds_q23/datafusion:vortex-file-compressed 189085388 204877349 0.92
tpcds_q24/datafusion:vortex-file-compressed 182044487 188149998 0.97
tpcds_q25/datafusion:vortex-file-compressed 114565627 125241285 0.91
tpcds_q26/datafusion:vortex-file-compressed 64326998 69356865 0.93
tpcds_q27/datafusion:vortex-file-compressed 🚀 170572901 190147557 0.90
tpcds_q28/datafusion:vortex-file-compressed 50645507 55821345 0.91
tpcds_q29/datafusion:vortex-file-compressed 113507390 118807731 0.96
tpcds_q30/datafusion:vortex-file-compressed 33445290 34360350 0.97
tpcds_q31/datafusion:vortex-file-compressed 186990195 194914259 0.96
tpcds_q32/datafusion:vortex-file-compressed 24938222 26785611 0.93
tpcds_q33/datafusion:vortex-file-compressed 37833535 41835613 0.90
tpcds_q34/datafusion:vortex-file-compressed 38611161 42724539 0.90
tpcds_q35/datafusion:vortex-file-compressed 62081177 66748702 0.93
tpcds_q36/datafusion:vortex-file-compressed 107299948 115229731 0.93
tpcds_q37/datafusion:vortex-file-compressed 39771605 41835652 0.95
tpcds_q38/datafusion:vortex-file-compressed 88893494 95223503 0.93
tpcds_q39/datafusion:vortex-file-compressed 212399716 209164984 1.02
tpcds_q40/datafusion:vortex-file-compressed 🚀 53882023 66883136 0.81
tpcds_q41/datafusion:vortex-file-compressed 15116231 16486948 0.92
tpcds_q42/datafusion:vortex-file-compressed 32475828 32430179 1.00
tpcds_q43/datafusion:vortex-file-compressed 49010090 53768791 0.91
tpcds_q44/datafusion:vortex-file-compressed 41918821 46491895 0.90
tpcds_q45/datafusion:vortex-file-compressed 🚀 50081335 56294615 0.89
tpcds_q46/datafusion:vortex-file-compressed 66433094 73677434 0.90
tpcds_q47/datafusion:vortex-file-compressed 281386218 307696414 0.91
tpcds_q48/datafusion:vortex-file-compressed 70003706 70042128 1.00
tpcds_q49/datafusion:vortex-file-compressed 74201735 76274589 0.97
tpcds_q50/datafusion:vortex-file-compressed 77600349 82390729 0.94
tpcds_q51/datafusion:vortex-file-compressed 🚀 96871244 108857878 0.89
tpcds_q52/datafusion:vortex-file-compressed 🚀 31517581 35490325 0.89
tpcds_q53/datafusion:vortex-file-compressed 30181556 30890998 0.98
tpcds_q54/datafusion:vortex-file-compressed 49882566 55222412 0.90
tpcds_q55/datafusion:vortex-file-compressed 🚀 30968760 34611573 0.89
tpcds_q56/datafusion:vortex-file-compressed 48712034 50026083 0.97
tpcds_q57/datafusion:vortex-file-compressed 182076166 195748542 0.93
tpcds_q58/datafusion:vortex-file-compressed 110845921 120330706 0.92
tpcds_q59/datafusion:vortex-file-compressed 🚀 96539219 110459809 0.87
tpcds_q60/datafusion:vortex-file-compressed 49092863 52309689 0.94
tpcds_q61/datafusion:vortex-file-compressed 59559218 64148318 0.93
tpcds_q62/datafusion:vortex-file-compressed 46225680 48621533 0.95
tpcds_q63/datafusion:vortex-file-compressed 29591085 31352548 0.94
tpcds_q64/datafusion:vortex-file-compressed 726878047 777134710 0.94
tpcds_q65/datafusion:vortex-file-compressed 51061936 51893811 0.98
tpcds_q66/datafusion:vortex-file-compressed 108814160 106456252 1.02
tpcds_q67/datafusion:vortex-file-compressed 143143014 142458123 1.00
tpcds_q68/datafusion:vortex-file-compressed 67500832 67010395 1.01
tpcds_q69/datafusion:vortex-file-compressed 46922358 46219148 1.02
tpcds_q70/datafusion:vortex-file-compressed 134525666 131287346 1.02
tpcds_q71/datafusion:vortex-file-compressed 31813844 31278883 1.02
tpcds_q72/datafusion:vortex-file-compressed 3434339107 3344670659 1.03
tpcds_q73/datafusion:vortex-file-compressed 39950551 41381762 0.97
tpcds_q74/datafusion:vortex-file-compressed 161364534 168532910 0.96
tpcds_q75/datafusion:vortex-file-compressed 134202403 135962407 0.99
tpcds_q76/datafusion:vortex-file-compressed 60868361 59480286 1.02
tpcds_q77/datafusion:vortex-file-compressed 53426934 52996409 1.01
tpcds_q78/datafusion:vortex-file-compressed 176399811 175478261 1.01
tpcds_q79/datafusion:vortex-file-compressed 43871621 42027913 1.04
tpcds_q80/datafusion:vortex-file-compressed 116316995 117534784 0.99
tpcds_q81/datafusion:vortex-file-compressed 36073680 34550949 1.04
tpcds_q82/datafusion:vortex-file-compressed 39921419 39486906 1.01
tpcds_q83/datafusion:vortex-file-compressed 64785223 65686813 0.99
tpcds_q84/datafusion:vortex-file-compressed 14630973 15269581 0.96
tpcds_q85/datafusion:vortex-file-compressed 132120639 133744847 0.99
tpcds_q86/datafusion:vortex-file-compressed 29545853 31112522 0.95
tpcds_q87/datafusion:vortex-file-compressed 89382518 89809291 1.00
tpcds_q88/datafusion:vortex-file-compressed 82148192 80271730 1.02
tpcds_q89/datafusion:vortex-file-compressed 54525945 56362399 0.97
tpcds_q90/datafusion:vortex-file-compressed 16211775 16152058 1.00
tpcds_q91/datafusion:vortex-file-compressed 26896445 26408950 1.02
tpcds_q92/datafusion:vortex-file-compressed 18927075 19082987 0.99
tpcds_q93/datafusion:vortex-file-compressed 35547515 37085700 0.96
tpcds_q94/datafusion:vortex-file-compressed 26612645 26168505 1.02
tpcds_q95/datafusion:vortex-file-compressed 87181063 87044039 1.00
tpcds_q96/datafusion:vortex-file-compressed 14666479 15414995 0.95
tpcds_q97/datafusion:vortex-file-compressed 31875493 32116407 0.99
tpcds_q98/datafusion:vortex-file-compressed 49564512 50053107 0.99
tpcds_q99/datafusion:vortex-file-compressed 60857764 59395993 1.02
datafusion / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 34308265 33811443 1.01
tpcds_q02/datafusion:vortex-compact 83302517 82604589 1.01
tpcds_q03/datafusion:vortex-compact 33416253 33380264 1.00
tpcds_q04/datafusion:vortex-compact 436115720 440382433 0.99
tpcds_q05/datafusion:vortex-compact 85277382 82504646 1.03
tpcds_q06/datafusion:vortex-compact 82793193 82562061 1.00
tpcds_q07/datafusion:vortex-compact 93037411 92498850 1.01
tpcds_q08/datafusion:vortex-compact 50936232 51131044 1.00
tpcds_q09/datafusion:vortex-compact 99655795 93433275 1.07
tpcds_q10/datafusion:vortex-compact 70246820 67727475 1.04
tpcds_q11/datafusion:vortex-compact 261493109 258317889 1.01
tpcds_q12/datafusion:vortex-compact 38722983 38802104 1.00
tpcds_q13/datafusion:vortex-compact 148089152 140170630 1.06
tpcds_q14/datafusion:vortex-compact 271502035 265543797 1.02
tpcds_q15/datafusion:vortex-compact 52028513 54506771 0.95
tpcds_q16/datafusion:vortex-compact 40986374 42667610 0.96
tpcds_q17/datafusion:vortex-compact 126286160 125661868 1.00
tpcds_q18/datafusion:vortex-compact 115060090 118161975 0.97
tpcds_q19/datafusion:vortex-compact 62428901 62013306 1.01
tpcds_q20/datafusion:vortex-compact 43911266 44465542 0.99
tpcds_q21/datafusion:vortex-compact 183781170 177284255 1.04
tpcds_q22/datafusion:vortex-compact 78114391 79228550 0.99
tpcds_q23/datafusion:vortex-compact 235128724 227428591 1.03
tpcds_q24/datafusion:vortex-compact 207974462 206725064 1.01
tpcds_q25/datafusion:vortex-compact 127736329 132032216 0.97
tpcds_q26/datafusion:vortex-compact 73735540 69352362 1.06
tpcds_q27/datafusion:vortex-compact 205733030 206924302 0.99
tpcds_q28/datafusion:vortex-compact 104114213 99496099 1.05
tpcds_q29/datafusion:vortex-compact 131414083 125693832 1.05
tpcds_q30/datafusion:vortex-compact 35343440 35774171 0.99
tpcds_q31/datafusion:vortex-compact 212193539 211427064 1.00
tpcds_q32/datafusion:vortex-compact 29548601 28212412 1.05
tpcds_q33/datafusion:vortex-compact 51961077 51062944 1.02
tpcds_q34/datafusion:vortex-compact 59597685 58438617 1.02
tpcds_q35/datafusion:vortex-compact 76648428 73730427 1.04
tpcds_q36/datafusion:vortex-compact 130754389 126679116 1.03
tpcds_q37/datafusion:vortex-compact 50988784 51116224 1.00
tpcds_q38/datafusion:vortex-compact 103529411 101119045 1.02
tpcds_q39/datafusion:vortex-compact 201943677 210781770 0.96
tpcds_q40/datafusion:vortex-compact 62377157 63720153 0.98
tpcds_q41/datafusion:vortex-compact 15833652 15651138 1.01
tpcds_q42/datafusion:vortex-compact 37056479 37144037 1.00
tpcds_q43/datafusion:vortex-compact 55716279 53784314 1.04
tpcds_q44/datafusion:vortex-compact 74769008 73091863 1.02
tpcds_q45/datafusion:vortex-compact 53200265 53127814 1.00
tpcds_q46/datafusion:vortex-compact 91389452 91551931 1.00
tpcds_q47/datafusion:vortex-compact 303846506 302437198 1.00
tpcds_q48/datafusion:vortex-compact 112847839 114116155 0.99
tpcds_q49/datafusion:vortex-compact 98537046 98364841 1.00
tpcds_q50/datafusion:vortex-compact 92747020 93151938 1.00
tpcds_q51/datafusion:vortex-compact 100195601 98686633 1.02
tpcds_q52/datafusion:vortex-compact 35839258 35246756 1.02
tpcds_q53/datafusion:vortex-compact 39178772 38484939 1.02
tpcds_q54/datafusion:vortex-compact 63105084 64264650 0.98
tpcds_q55/datafusion:vortex-compact 34735294 36896362 0.94
tpcds_q56/datafusion:vortex-compact 59550095 59524824 1.00
tpcds_q57/datafusion:vortex-compact 193025041 192936619 1.00
tpcds_q58/datafusion:vortex-compact 119189114 118730229 1.00
tpcds_q59/datafusion:vortex-compact 111508736 108155692 1.03
tpcds_q60/datafusion:vortex-compact 60877899 59301128 1.03
tpcds_q61/datafusion:vortex-compact 84815048 81810650 1.04
tpcds_q62/datafusion:vortex-compact 46553274 45514306 1.02
tpcds_q63/datafusion:vortex-compact 39615295 40417775 0.98
tpcds_q64/datafusion:vortex-compact 788879465 793081953 0.99
tpcds_q65/datafusion:vortex-compact 75325317 73341364 1.03
tpcds_q66/datafusion:vortex-compact 111065025 111578971 1.00
tpcds_q67/datafusion:vortex-compact 158271926 154701327 1.02
tpcds_q68/datafusion:vortex-compact 88607254 92084728 0.96
tpcds_q69/datafusion:vortex-compact 64197661 63455562 1.01
tpcds_q70/datafusion:vortex-compact 138870652 139620912 0.99
tpcds_q71/datafusion:vortex-compact 45378509 45322236 1.00
tpcds_q72/datafusion:vortex-compact 3389825067 3366722728 1.01
tpcds_q73/datafusion:vortex-compact 56902289 56906743 1.00
tpcds_q74/datafusion:vortex-compact 185887925 190148510 0.98
tpcds_q75/datafusion:vortex-compact 183996090 177504861 1.04
tpcds_q76/datafusion:vortex-compact 76943943 76055367 1.01
tpcds_q77/datafusion:vortex-compact 68731553 68220194 1.01
tpcds_q78/datafusion:vortex-compact 204021691 204341314 1.00
tpcds_q79/datafusion:vortex-compact 66241892 65299348 1.01
tpcds_q80/datafusion:vortex-compact 138421008 135330430 1.02
tpcds_q81/datafusion:vortex-compact 41523138 43064357 0.96
tpcds_q82/datafusion:vortex-compact 54134126 53017470 1.02
tpcds_q83/datafusion:vortex-compact 66109666 66269079 1.00
tpcds_q84/datafusion:vortex-compact 18295664 18853762 0.97
tpcds_q85/datafusion:vortex-compact 157989525 157166226 1.01
tpcds_q86/datafusion:vortex-compact 31857739 31913001 1.00
tpcds_q87/datafusion:vortex-compact 102150513 103053065 0.99
tpcds_q88/datafusion:vortex-compact 137453360 134202803 1.02
tpcds_q89/datafusion:vortex-compact 64885649 67271038 0.96
tpcds_q90/datafusion:vortex-compact 22247405 22053645 1.01
tpcds_q91/datafusion:vortex-compact 42654553 41855594 1.02
tpcds_q92/datafusion:vortex-compact 21254235 21670777 0.98
tpcds_q93/datafusion:vortex-compact 52547178 53797745 0.98
tpcds_q94/datafusion:vortex-compact 32139978 32711048 0.98
tpcds_q95/datafusion:vortex-compact 98142125 98467066 1.00
tpcds_q96/datafusion:vortex-compact 25749304 24467652 1.05
tpcds_q97/datafusion:vortex-compact 43083824 44544991 0.97
tpcds_q98/datafusion:vortex-compact 55889007 55459220 1.01
tpcds_q99/datafusion:vortex-compact 62712088 63618888 0.99
datafusion / parquet (0.903x ➖, 40↑ 1↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 37870297 37648125 1.01
tpcds_q02/datafusion:parquet 54098355 52955879 1.02
tpcds_q03/datafusion:parquet 🚀 16077777 18087114 0.89
tpcds_q04/datafusion:parquet 374575692 398809084 0.94
tpcds_q05/datafusion:parquet 🚀 91995244 110735929 0.83
tpcds_q06/datafusion:parquet 🚀 95771077 106723244 0.90
tpcds_q07/datafusion:parquet 🚀 138522800 169663818 0.82
tpcds_q08/datafusion:parquet 🚀 38570768 47589962 0.81
tpcds_q09/datafusion:parquet 🚀 54861794 68962811 0.80
tpcds_q10/datafusion:parquet 🚀 103281576 130553808 0.79
tpcds_q11/datafusion:parquet 🚀 220883370 304555189 0.73
tpcds_q12/datafusion:parquet 🚀 29511958 40201391 0.73
tpcds_q13/datafusion:parquet 🚀 138773911 170976806 0.81
tpcds_q14/datafusion:parquet 🚀 216704465 277530748 0.78
tpcds_q15/datafusion:parquet 🚀 56267895 66929192 0.84
tpcds_q16/datafusion:parquet 🚀 33694716 40201162 0.84
tpcds_q17/datafusion:parquet 🚀 171250406 196235803 0.87
tpcds_q18/datafusion:parquet 🚀 175862687 212570899 0.83
tpcds_q19/datafusion:parquet 🚀 35217838 43278039 0.81
tpcds_q20/datafusion:parquet 🚀 25274551 32436387 0.78
tpcds_q21/datafusion:parquet 🚀 28047577 34880277 0.80
tpcds_q22/datafusion:parquet 🚀 155873186 190879964 0.82
tpcds_q23/datafusion:parquet 🚀 189255089 245438759 0.77
tpcds_q24/datafusion:parquet 🚀 209863137 261977630 0.80
tpcds_q25/datafusion:parquet 🚀 178104635 209102051 0.85
tpcds_q26/datafusion:parquet 120598733 125651587 0.96
tpcds_q27/datafusion:parquet 258272071 279317543 0.92
tpcds_q28/datafusion:parquet 51990063 56993223 0.91
tpcds_q29/datafusion:parquet 179678697 194924739 0.92
tpcds_q30/datafusion:parquet 🚀 44322634 49569532 0.89
tpcds_q31/datafusion:parquet 106287007 116468051 0.91
tpcds_q32/datafusion:parquet 30878687 31562004 0.98
tpcds_q33/datafusion:parquet 37537368 40021163 0.94
tpcds_q34/datafusion:parquet 🚀 34331652 38794775 0.88
tpcds_q35/datafusion:parquet 🚀 96103545 109273391 0.88
tpcds_q36/datafusion:parquet 83388595 91238058 0.91
tpcds_q37/datafusion:parquet 26027802 27874147 0.93
tpcds_q38/datafusion:parquet 🚀 63284162 70412387 0.90
tpcds_q39/datafusion:parquet 🚀 101982791 116516089 0.88
tpcds_q40/datafusion:parquet 🚀 35217180 40125552 0.88
tpcds_q41/datafusion:parquet 🚀 12864903 14688670 0.88
tpcds_q42/datafusion:parquet 16215698 16779311 0.97
tpcds_q43/datafusion:parquet 27801637 28634727 0.97
tpcds_q44/datafusion:parquet 41489934 45894690 0.90
tpcds_q45/datafusion:parquet 68630032 72143346 0.95
tpcds_q46/datafusion:parquet 51792851 56547395 0.92
tpcds_q47/datafusion:parquet 🚀 182218786 205178502 0.89
tpcds_q48/datafusion:parquet 133779839 143176224 0.93
tpcds_q49/datafusion:parquet 75598007 81852832 0.92
tpcds_q50/datafusion:parquet 112616708 116369888 0.97
tpcds_q51/datafusion:parquet 96593689 105987638 0.91
tpcds_q52/datafusion:parquet 🚀 15642107 17726927 0.88
tpcds_q53/datafusion:parquet 32370735 31105993 1.04
tpcds_q54/datafusion:parquet 48891679 52955876 0.92
tpcds_q55/datafusion:parquet 16422682 18002259 0.91
tpcds_q56/datafusion:parquet 36526742 38850975 0.94
tpcds_q57/datafusion:parquet 134555025 147347676 0.91
tpcds_q58/datafusion:parquet 74687840 82894373 0.90
tpcds_q59/datafusion:parquet 70866993 73577982 0.96
tpcds_q60/datafusion:parquet 37943298 40356215 0.94
tpcds_q61/datafusion:parquet 67716964 73123311 0.93
tpcds_q62/datafusion:parquet 46261331 42283481 1.09
tpcds_q63/datafusion:parquet 32648734 34108323 0.96
tpcds_q64/datafusion:parquet 998334067 1061306751 0.94
tpcds_q65/datafusion:parquet 50088062 54638421 0.92
tpcds_q66/datafusion:parquet 90214931 99263683 0.91
tpcds_q67/datafusion:parquet 🚀 178837196 200910063 0.89
tpcds_q68/datafusion:parquet 🚀 50626017 57003199 0.89
tpcds_q69/datafusion:parquet 95592812 104714228 0.91
tpcds_q70/datafusion:parquet 108107903 119569093 0.90
tpcds_q71/datafusion:parquet 29326073 31508532 0.93
tpcds_q72/datafusion:parquet 882240105 972638875 0.91
tpcds_q73/datafusion:parquet 37765107 38178544 0.99
tpcds_q74/datafusion:parquet 🚀 132706923 148358942 0.89
tpcds_q75/datafusion:parquet 136642801 143545993 0.95
tpcds_q76/datafusion:parquet 95295275 93983729 1.01
tpcds_q77/datafusion:parquet 59927647 64657760 0.93
tpcds_q78/datafusion:parquet 🚀 185745971 208079508 0.89
tpcds_q79/datafusion:parquet 41637582 45840162 0.91
tpcds_q80/datafusion:parquet 🚀 115372155 129148671 0.89
tpcds_q81/datafusion:parquet 44317710 48487666 0.91
tpcds_q82/datafusion:parquet 29156978 32066739 0.91
tpcds_q83/datafusion:parquet 55826023 60934672 0.92
tpcds_q84/datafusion:parquet 49381985 50435637 0.98
tpcds_q85/datafusion:parquet 245939629 253836708 0.97
tpcds_q86/datafusion:parquet 21460525 21357663 1.00
tpcds_q87/datafusion:parquet 69926183 73115016 0.96
tpcds_q88/datafusion:parquet 🚀 79105966 89558898 0.88
tpcds_q89/datafusion:parquet 39468988 43215628 0.91
tpcds_q90/datafusion:parquet 🚀 19443163 22293168 0.87
tpcds_q91/datafusion:parquet 81231450 87203568 0.93
tpcds_q92/datafusion:parquet 25843832 26723394 0.97
tpcds_q93/datafusion:parquet 🚀 40711959 50658746 0.80
tpcds_q94/datafusion:parquet 🚀 28437726 33820425 0.84
tpcds_q95/datafusion:parquet 135129798 141304796 0.96
tpcds_q96/datafusion:parquet 15652475 14478802 1.08
tpcds_q97/datafusion:parquet 38523811 41470607 0.93
tpcds_q98/datafusion:parquet 38790798 42874997 0.90
tpcds_q99/datafusion:parquet 🚨 55718148 50483881 1.10
duckdb / vortex-file-compressed (1.019x ➖, 0↑ 1↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 28064881 26338728 1.07
tpcds_q02/duckdb:vortex-file-compressed 87950352 80909882 1.09
tpcds_q03/duckdb:vortex-file-compressed 21941908 22742492 0.96
tpcds_q04/duckdb:vortex-file-compressed 110054811 104416663 1.05
tpcds_q05/duckdb:vortex-file-compressed 96907287 103126142 0.94
tpcds_q06/duckdb:vortex-file-compressed 35540168 35551239 1.00
tpcds_q07/duckdb:vortex-file-compressed 23656974 24728604 0.96
tpcds_q08/duckdb:vortex-file-compressed 24337356 23640288 1.03
tpcds_q09/duckdb:vortex-file-compressed 40952727 39981010 1.02
tpcds_q10/duckdb:vortex-file-compressed 36303167 36725336 0.99
tpcds_q11/duckdb:vortex-file-compressed 61741534 59993994 1.03
tpcds_q12/duckdb:vortex-file-compressed 15120614 15163754 1.00
tpcds_q13/duckdb:vortex-file-compressed 32215053 32854638 0.98
tpcds_q14/duckdb:vortex-file-compressed 197204241 190270419 1.04
tpcds_q15/duckdb:vortex-file-compressed 41016724 41247487 0.99
tpcds_q16/duckdb:vortex-file-compressed 30182524 29479488 1.02
tpcds_q17/duckdb:vortex-file-compressed 38023652 37407151 1.02
tpcds_q18/duckdb:vortex-file-compressed 45339444 46676756 0.97
tpcds_q19/duckdb:vortex-file-compressed 33327141 31962459 1.04
tpcds_q20/duckdb:vortex-file-compressed 17175374 16070988 1.07
tpcds_q21/duckdb:vortex-file-compressed 19687426 20683213 0.95
tpcds_q22/duckdb:vortex-file-compressed 112819572 108295869 1.04
tpcds_q23/duckdb:vortex-file-compressed 131424908 125045620 1.05
tpcds_q24/duckdb:vortex-file-compressed 55983068 54313667 1.03
tpcds_q25/duckdb:vortex-file-compressed 38554466 37263623 1.03
tpcds_q26/duckdb:vortex-file-compressed 39933748 42571912 0.94
tpcds_q27/duckdb:vortex-file-compressed 88883517 84793783 1.05
tpcds_q28/duckdb:vortex-file-compressed 39033150 36760905 1.06
tpcds_q29/duckdb:vortex-file-compressed 37754385 37739171 1.00
tpcds_q30/duckdb:vortex-file-compressed 29741168 28804063 1.03
tpcds_q31/duckdb:vortex-file-compressed 26392391 25125991 1.05
tpcds_q32/duckdb:vortex-file-compressed 16636024 16247984 1.02
tpcds_q33/duckdb:vortex-file-compressed 71803301 65939928 1.09
tpcds_q34/duckdb:vortex-file-compressed 19232050 20316203 0.95
tpcds_q35/duckdb:vortex-file-compressed 65220249 62235391 1.05
tpcds_q36/duckdb:vortex-file-compressed 27821011 29173913 0.95
tpcds_q37/duckdb:vortex-file-compressed 23342910 22249040 1.05
tpcds_q38/duckdb:vortex-file-compressed 39607951 37412916 1.06
tpcds_q39/duckdb:vortex-file-compressed 48139478 45368259 1.06
tpcds_q40/duckdb:vortex-file-compressed 24822466 22684501 1.09
tpcds_q41/duckdb:vortex-file-compressed 13852994 13440287 1.03
tpcds_q42/duckdb:vortex-file-compressed 12150268 11809256 1.03
tpcds_q43/duckdb:vortex-file-compressed 20426913 21115537 0.97
tpcds_q44/duckdb:vortex-file-compressed 24495699 25024876 0.98
tpcds_q45/duckdb:vortex-file-compressed 27231463 27265227 1.00
tpcds_q46/duckdb:vortex-file-compressed 47633424 47070902 1.01
tpcds_q47/duckdb:vortex-file-compressed 52284809 49553456 1.06
tpcds_q48/duckdb:vortex-file-compressed 30911759 30256252 1.02
tpcds_q49/duckdb:vortex-file-compressed 32103313 30650621 1.05
tpcds_q50/duckdb:vortex-file-compressed 35119628 34120567 1.03
tpcds_q51/duckdb:vortex-file-compressed 100790014 104888840 0.96
tpcds_q52/duckdb:vortex-file-compressed 11554001 12005298 0.96
tpcds_q53/duckdb:vortex-file-compressed 18578687 17455274 1.06
tpcds_q54/duckdb:vortex-file-compressed 49644936 48413919 1.03
tpcds_q55/duckdb:vortex-file-compressed 12355357 12937178 0.96
tpcds_q56/duckdb:vortex-file-compressed 66837196 61732736 1.08
tpcds_q57/duckdb:vortex-file-compressed 46190238 44714899 1.03
tpcds_q58/duckdb:vortex-file-compressed 32229547 34879073 0.92
tpcds_q59/duckdb:vortex-file-compressed 57059581 56465583 1.01
tpcds_q60/duckdb:vortex-file-compressed 65919562 68479608 0.96
tpcds_q61/duckdb:vortex-file-compressed 40048940 37993002 1.05
tpcds_q62/duckdb:vortex-file-compressed 17933106 18816700 0.95
tpcds_q63/duckdb:vortex-file-compressed 17501458 17414290 1.01
tpcds_q64/duckdb:vortex-file-compressed 78926183 78740727 1.00
tpcds_q65/duckdb:vortex-file-compressed 23989984 23402846 1.03
tpcds_q66/duckdb:vortex-file-compressed 57355925 53700822 1.07
tpcds_q67/duckdb:vortex-file-compressed 148826510 147586681 1.01
tpcds_q68/duckdb:vortex-file-compressed 41270193 40070023 1.03
tpcds_q69/duckdb:vortex-file-compressed 38475525 37731834 1.02
tpcds_q70/duckdb:vortex-file-compressed 24579173 24371054 1.01
tpcds_q71/duckdb:vortex-file-compressed 21690581 20650757 1.05
tpcds_q72/duckdb:vortex-file-compressed 178599704 176627809 1.01
tpcds_q73/duckdb:vortex-file-compressed 20111298 19948371 1.01
tpcds_q74/duckdb:vortex-file-compressed 51715893 50602945 1.02
tpcds_q75/duckdb:vortex-file-compressed 59580118 61624184 0.97
tpcds_q76/duckdb:vortex-file-compressed 59101080 60699294 0.97
tpcds_q77/duckdb:vortex-file-compressed 63564163 66052513 0.96
tpcds_q78/duckdb:vortex-file-compressed 82727543 80209329 1.03
tpcds_q79/duckdb:vortex-file-compressed 35369268 34538590 1.02
tpcds_q80/duckdb:vortex-file-compressed 96825449 90523783 1.07
tpcds_q81/duckdb:vortex-file-compressed 34674571 33236289 1.04
tpcds_q82/duckdb:vortex-file-compressed 23725439 22876861 1.04
tpcds_q83/duckdb:vortex-file-compressed 28646426 27746904 1.03
tpcds_q84/duckdb:vortex-file-compressed 18339146 17427726 1.05
tpcds_q85/duckdb:vortex-file-compressed 46920594 44205996 1.06
tpcds_q86/duckdb:vortex-file-compressed 16732725 16730613 1.00
tpcds_q87/duckdb:vortex-file-compressed 42419850 38932409 1.09
tpcds_q88/duckdb:vortex-file-compressed 41401970 40955300 1.01
tpcds_q89/duckdb:vortex-file-compressed 18204201 18836616 0.97
tpcds_q90/duckdb:vortex-file-compressed 16023310 14754342 1.09
tpcds_q91/duckdb:vortex-file-compressed 27952561 26954461 1.04
tpcds_q92/duckdb:vortex-file-compressed 14956367 14099814 1.06
tpcds_q93/duckdb:vortex-file-compressed 31667141 30980328 1.02
tpcds_q94/duckdb:vortex-file-compressed 🚨 23218960 21054730 1.10
tpcds_q95/duckdb:vortex-file-compressed 157936163 158136989 1.00
tpcds_q96/duckdb:vortex-file-compressed 18215490 17695013 1.03
tpcds_q97/duckdb:vortex-file-compressed 40761235 39135994 1.04
tpcds_q98/duckdb:vortex-file-compressed 18319211 18992769 0.96
tpcds_q99/duckdb:vortex-file-compressed 33644052 32176415 1.05
duckdb / vortex-compact (1.022x ➖, 1↑ 4↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 34736024 34564818 1.00
tpcds_q02/duckdb:vortex-compact 129152912 125100684 1.03
tpcds_q03/duckdb:vortex-compact 51030888 50344453 1.01
tpcds_q04/duckdb:vortex-compact 129068741 128556562 1.00
tpcds_q05/duckdb:vortex-compact 175626126 165374465 1.06
tpcds_q06/duckdb:vortex-compact 41507187 41901542 0.99
tpcds_q07/duckdb:vortex-compact 39628377 38518994 1.03
tpcds_q08/duckdb:vortex-compact 29112805 28968273 1.00
tpcds_q09/duckdb:vortex-compact 113065799 110393370 1.02
tpcds_q10/duckdb:vortex-compact 48541692 48206043 1.01
tpcds_q11/duckdb:vortex-compact 78795106 78363842 1.01
tpcds_q12/duckdb:vortex-compact 19994319 18945494 1.06
tpcds_q13/duckdb:vortex-compact 54429965 53572293 1.02
tpcds_q14/duckdb:vortex-compact 289042414 285173914 1.01
tpcds_q15/duckdb:vortex-compact 45315566 45424534 1.00
tpcds_q16/duckdb:vortex-compact 37427792 36343684 1.03
tpcds_q17/duckdb:vortex-compact 54267724 52946203 1.02
tpcds_q18/duckdb:vortex-compact 66343125 66508523 1.00
tpcds_q19/duckdb:vortex-compact 41156910 41129546 1.00
tpcds_q20/duckdb:vortex-compact 21366581 20976575 1.02
tpcds_q21/duckdb:vortex-compact 28032011 27445438 1.02
tpcds_q22/duckdb:vortex-compact 118947035 115615714 1.03
tpcds_q23/duckdb:vortex-compact 175175474 169680182 1.03
tpcds_q24/duckdb:vortex-compact 77878428 77816444 1.00
tpcds_q25/duckdb:vortex-compact 52810938 51868312 1.02
tpcds_q26/duckdb:vortex-compact 51799225 50980293 1.02
tpcds_q27/duckdb:vortex-compact 144094296 140031581 1.03
tpcds_q28/duckdb:vortex-compact 108998930 106557590 1.02
tpcds_q29/duckdb:vortex-compact 53534522 51010811 1.05
tpcds_q30/duckdb:vortex-compact 35782003 37189477 0.96
tpcds_q31/duckdb:vortex-compact 32623307 31056550 1.05
tpcds_q32/duckdb:vortex-compact 23658123 22849285 1.04
tpcds_q33/duckdb:vortex-compact 143059198 139860449 1.02
tpcds_q34/duckdb:vortex-compact 29744710 29929800 0.99
tpcds_q35/duckdb:vortex-compact 72183319 70910963 1.02
tpcds_q36/duckdb:vortex-compact 35547445 35167427 1.01
tpcds_q37/duckdb:vortex-compact 31680506 31961352 0.99
tpcds_q38/duckdb:vortex-compact 41289547 37923604 1.09
tpcds_q39/duckdb:vortex-compact 54587935 53735487 1.02
tpcds_q40/duckdb:vortex-compact 30807936 31685986 0.97
tpcds_q41/duckdb:vortex-compact 16171528 17263614 0.94
tpcds_q42/duckdb:vortex-compact 15123932 14805178 1.02
tpcds_q43/duckdb:vortex-compact 24780003 24192158 1.02
tpcds_q44/duckdb:vortex-compact 35889874 35160133 1.02
tpcds_q45/duckdb:vortex-compact 🚨 35087981 30823210 1.14
tpcds_q46/duckdb:vortex-compact 63177119 61123524 1.03
tpcds_q47/duckdb:vortex-compact 56166955 55112993 1.02
tpcds_q48/duckdb:vortex-compact 45467833 46754735 0.97
tpcds_q49/duckdb:vortex-compact 51587324 48077275 1.07
tpcds_q50/duckdb:vortex-compact 54658467 57000593 0.96
tpcds_q51/duckdb:vortex-compact 🚀 105780253 124788410 0.85
tpcds_q52/duckdb:vortex-compact 14812145 15960568 0.93
tpcds_q53/duckdb:vortex-compact 22488228 22413867 1.00
tpcds_q54/duckdb:vortex-compact 88612025 85357926 1.04
tpcds_q55/duckdb:vortex-compact 🚨 16054937 14562454 1.10
tpcds_q56/duckdb:vortex-compact 143326981 137245370 1.04
tpcds_q57/duckdb:vortex-compact 48383221 47610296 1.02
tpcds_q58/duckdb:vortex-compact 43184439 45588471 0.95
tpcds_q59/duckdb:vortex-compact 67788207 64616194 1.05
tpcds_q60/duckdb:vortex-compact 143106681 147036668 0.97
tpcds_q61/duckdb:vortex-compact 55122810 53293882 1.03
tpcds_q62/duckdb:vortex-compact 22368956 22249917 1.01
tpcds_q63/duckdb:vortex-compact 22538449 22210582 1.01
tpcds_q64/duckdb:vortex-compact 107173038 106695029 1.00
tpcds_q65/duckdb:vortex-compact 28703976 27812359 1.03
tpcds_q66/duckdb:vortex-compact 101879403 95386298 1.07
tpcds_q67/duckdb:vortex-compact 154359247 153226347 1.01
tpcds_q68/duckdb:vortex-compact 57334577 57251153 1.00
tpcds_q69/duckdb:vortex-compact 51313327 48716120 1.05
tpcds_q70/duckdb:vortex-compact 29308097 29801614 0.98
tpcds_q71/duckdb:vortex-compact 25983584 25157307 1.03
tpcds_q72/duckdb:vortex-compact 199021007 200227085 0.99
tpcds_q73/duckdb:vortex-compact 29410343 29326685 1.00
tpcds_q74/duckdb:vortex-compact 61619225 58761545 1.05
tpcds_q75/duckdb:vortex-compact 74130817 69562844 1.07
tpcds_q76/duckdb:vortex-compact 137479225 128583499 1.07
tpcds_q77/duckdb:vortex-compact 143653954 138864038 1.03
tpcds_q78/duckdb:vortex-compact 89507522 88055498 1.02
tpcds_q79/duckdb:vortex-compact 63081823 61596568 1.02
tpcds_q80/duckdb:vortex-compact 173510511 167256468 1.04
tpcds_q81/duckdb:vortex-compact 41692860 39753189 1.05
tpcds_q82/duckdb:vortex-compact 31346311 32231968 0.97
tpcds_q83/duckdb:vortex-compact 45901982 45796694 1.00
tpcds_q84/duckdb:vortex-compact 21152403 21398735 0.99
tpcds_q85/duckdb:vortex-compact 61461151 60868131 1.01
tpcds_q86/duckdb:vortex-compact 19361992 18971063 1.02
tpcds_q87/duckdb:vortex-compact 43698987 44794978 0.98
tpcds_q88/duckdb:vortex-compact 46460275 43837671 1.06
tpcds_q89/duckdb:vortex-compact 24264902 23958892 1.01
tpcds_q90/duckdb:vortex-compact 17267457 15852930 1.09
tpcds_q91/duckdb:vortex-compact 47043438 43647488 1.08
tpcds_q92/duckdb:vortex-compact 22595928 20762702 1.09
tpcds_q93/duckdb:vortex-compact 38248106 37591027 1.02
tpcds_q94/duckdb:vortex-compact 28125054 26470853 1.06
tpcds_q95/duckdb:vortex-compact 🚨 164641343 149600423 1.10
tpcds_q96/duckdb:vortex-compact 🚨 22884715 18208099 1.26
tpcds_q97/duckdb:vortex-compact 41667460 38930084 1.07
tpcds_q98/duckdb:vortex-compact 23726490 21946844 1.08
tpcds_q99/duckdb:vortex-compact 39765038 42274195 0.94
duckdb / parquet (1.002x ➖, 0↑ 1↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 45931320 45818606 1.00
tpcds_q02/duckdb:parquet 59691543 59815399 1.00
tpcds_q03/duckdb:parquet 11999554 11731607 1.02
tpcds_q04/duckdb:parquet 129990805 127888665 1.02
tpcds_q05/duckdb:parquet 70824611 71019791 1.00
tpcds_q06/duckdb:parquet 29212127 28370098 1.03
tpcds_q07/duckdb:parquet 23212414 23172340 1.00
tpcds_q08/duckdb:parquet 28782043 28278661 1.02
tpcds_q09/duckdb:parquet 39625337 39679813 1.00
tpcds_q10/duckdb:parquet 34031059 36657921 0.93
tpcds_q11/duckdb:parquet 86594114 87579750 0.99
tpcds_q12/duckdb:parquet 14648197 14242197 1.03
tpcds_q13/duckdb:parquet 33761323 34016293 0.99
tpcds_q14/duckdb:parquet 166688423 167048347 1.00
tpcds_q15/duckdb:parquet 30275478 29910094 1.01
tpcds_q16/duckdb:parquet 21791686 21895190 1.00
tpcds_q17/duckdb:parquet 38073714 38390531 0.99
tpcds_q18/duckdb:parquet 48090763 46022934 1.04
tpcds_q19/duckdb:parquet 30055292 29469867 1.02
tpcds_q20/duckdb:parquet 15718290 15284922 1.03
tpcds_q21/duckdb:parquet 10758136 11476309 0.94
tpcds_q22/duckdb:parquet 66565361 67323831 0.99
tpcds_q23/duckdb:parquet 110706553 111192304 1.00
tpcds_q24/duckdb:parquet 44891251 45640734 0.98
tpcds_q25/duckdb:parquet 33519907 32880982 1.02
tpcds_q26/duckdb:parquet 38042630 37942467 1.00
tpcds_q27/duckdb:parquet 88802498 88756338 1.00
tpcds_q28/duckdb:parquet 37278532 36909281 1.01
tpcds_q29/duckdb:parquet 35427731 35169683 1.01
tpcds_q30/duckdb:parquet 37700178 40327588 0.93
tpcds_q31/duckdb:parquet 23133161 23431114 0.99
tpcds_q32/duckdb:parquet 11054418 11671105 0.95
tpcds_q33/duckdb:parquet 69900746 72131648 0.97
tpcds_q34/duckdb:parquet 20388640 20692740 0.99
tpcds_q35/duckdb:parquet 59130026 57470130 1.03
tpcds_q36/duckdb:parquet 20546725 20898267 0.98
tpcds_q37/duckdb:parquet 13643377 13338001 1.02
tpcds_q38/duckdb:parquet 34000059 32927312 1.03
tpcds_q39/duckdb:parquet 32159453 32139050 1.00
tpcds_q40/duckdb:parquet 17493823 18338372 0.95
tpcds_q41/duckdb:parquet 7757988 7599339 1.02
tpcds_q42/duckdb:parquet 10361605 9995214 1.04
tpcds_q43/duckdb:parquet 15493337 15497744 1.00
tpcds_q44/duckdb:parquet 22385458 21744316 1.03
tpcds_q45/duckdb:parquet 26494115 26960411 0.98
tpcds_q46/duckdb:parquet 46947404 44697604 1.05
tpcds_q47/duckdb:parquet 46001999 45718998 1.01
tpcds_q48/duckdb:parquet 30203238 30674159 0.98
tpcds_q49/duckdb:parquet 25138556 25533532 0.98
tpcds_q50/duckdb:parquet 24427858 24421203 1.00
tpcds_q51/duckdb:parquet 96678769 92638928 1.04
tpcds_q52/duckdb:parquet 11107767 11164813 0.99
tpcds_q53/duckdb:parquet 16071526 15783625 1.02
tpcds_q54/duckdb:parquet 41157947 41481052 0.99
tpcds_q55/duckdb:parquet 10466123 10448349 1.00
tpcds_q56/duckdb:parquet 66946619 67641272 0.99
tpcds_q57/duckdb:parquet 35468509 34903280 1.02
tpcds_q58/duckdb:parquet 21249254 20832230 1.02
tpcds_q59/duckdb:parquet 36881987 36633741 1.01
tpcds_q60/duckdb:parquet 71046664 73091643 0.97
tpcds_q61/duckdb:parquet 29808614 30594465 0.97
tpcds_q62/duckdb:parquet 11646337 11455726 1.02
tpcds_q63/duckdb:parquet 14990818 15192864 0.99
tpcds_q64/duckdb:parquet 73692241 74298130 0.99
tpcds_q65/duckdb:parquet 20309761 20506852 0.99
tpcds_q66/duckdb:parquet 55409673 56101063 0.99
tpcds_q67/duckdb:parquet 135230777 134638057 1.00
tpcds_q68/duckdb:parquet 38128900 37602084 1.01
tpcds_q69/duckdb:parquet 38251623 35603134 1.07
tpcds_q70/duckdb:parquet 19887213 19832371 1.00
tpcds_q71/duckdb:parquet 18574386 17237919 1.08
tpcds_q72/duckdb:parquet 165723675 165427120 1.00
tpcds_q73/duckdb:parquet 18171360 17785552 1.02
tpcds_q74/duckdb:parquet 49171031 49288122 1.00
tpcds_q75/duckdb:parquet 53119427 53144608 1.00
tpcds_q76/duckdb:parquet 70975712 71615562 0.99
tpcds_q77/duckdb:parquet 62728985 62911228 1.00
tpcds_q78/duckdb:parquet 72196487 73615431 0.98
tpcds_q79/duckdb:parquet 27339764 27561000 0.99
tpcds_q80/duckdb:parquet 81476100 82596746 0.99
tpcds_q81/duckdb:parquet 46955897 47903916 0.98
tpcds_q82/duckdb:parquet 15144302 15212061 1.00
tpcds_q83/duckdb:parquet 15861827 15804877 1.00
tpcds_q84/duckdb:parquet 19223170 19947318 0.96
tpcds_q85/duckdb:parquet 39775692 39470398 1.01
tpcds_q86/duckdb:parquet 🚨 13174626 11962580 1.10
tpcds_q87/duckdb:parquet 37655888 35278191 1.07
tpcds_q88/duckdb:parquet 29022062 28824026 1.01
tpcds_q89/duckdb:parquet 18655938 17200786 1.08
tpcds_q90/duckdb:parquet 8100652 7981652 1.01
tpcds_q91/duckdb:parquet 23108433 23144162 1.00
tpcds_q92/duckdb:parquet 11569410 11352619 1.02
tpcds_q93/duckdb:parquet 30308119 29860999 1.01
tpcds_q94/duckdb:parquet 15929174 15901805 1.00
tpcds_q95/duckdb:parquet 121162120 130655599 0.93
tpcds_q96/duckdb:parquet 8958824 9092186 0.99
tpcds_q97/duckdb:parquet 34587303 35948363 0.96
tpcds_q98/duckdb:parquet 18107186 17981503 1.01
tpcds_q99/duckdb:parquet 19403614 19760197 0.98
duckdb / duckdb (1.032x ➖, 0↑ 10↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20025578 20152902 0.99
tpcds_q02/duckdb:duckdb 🚨 18383586 16602656 1.11
tpcds_q03/duckdb:duckdb 🚨 9167848 8314015 1.10
tpcds_q04/duckdb:duckdb 163178397 162935882 1.00
tpcds_q05/duckdb:duckdb 18303339 17843975 1.03
tpcds_q06/duckdb:duckdb 🚨 24432864 22051525 1.11
tpcds_q07/duckdb:duckdb 37855614 37982178 1.00
tpcds_q08/duckdb:duckdb 121595418 119164702 1.02
tpcds_q09/duckdb:duckdb 19874022 19762884 1.01
tpcds_q10/duckdb:duckdb 24159850 23033563 1.05
tpcds_q11/duckdb:duckdb 140720373 137403898 1.02
tpcds_q12/duckdb:duckdb 11545166 11297037 1.02
tpcds_q13/duckdb:duckdb 23845936 22995314 1.04
tpcds_q14/duckdb:duckdb 95294600 91304870 1.04
tpcds_q15/duckdb:duckdb 24634052 23290610 1.06
tpcds_q16/duckdb:duckdb 17360802 18021585 0.96
tpcds_q17/duckdb:duckdb 22119454 21803408 1.01
tpcds_q18/duckdb:duckdb 45035494 43207560 1.04
tpcds_q19/duckdb:duckdb 16657477 17405904 0.96
tpcds_q20/duckdb:duckdb 11649518 11771516 0.99
tpcds_q21/duckdb:duckdb 6786863 6547290 1.04
tpcds_q22/duckdb:duckdb 61491808 61086845 1.01
tpcds_q23/duckdb:duckdb 81671492 78963190 1.03
tpcds_q24/duckdb:duckdb 24249788 23688258 1.02
tpcds_q25/duckdb:duckdb 16669207 16284976 1.02
tpcds_q26/duckdb:duckdb 🚨 27382671 22831121 1.20
tpcds_q27/duckdb:duckdb 41646503 40397844 1.03
tpcds_q28/duckdb:duckdb 21204193 21016382 1.01
tpcds_q29/duckdb:duckdb 20397914 19756513 1.03
tpcds_q30/duckdb:duckdb 29173757 28652421 1.02
tpcds_q31/duckdb:duckdb 20929507 19667641 1.06
tpcds_q32/duckdb:duckdb 🚨 7737913 6645714 1.16
tpcds_q33/duckdb:duckdb 13234398 12466041 1.06
tpcds_q34/duckdb:duckdb 15756078 14470967 1.09
tpcds_q35/duckdb:duckdb 33331062 32162515 1.04
tpcds_q36/duckdb:duckdb 69941622 66538882 1.05
tpcds_q37/duckdb:duckdb 7564818 7444282 1.02
tpcds_q38/duckdb:duckdb 32289245 31517583 1.02
tpcds_q39/duckdb:duckdb 25908697 25890877 1.00
tpcds_q40/duckdb:duckdb 14106550 13623922 1.04
tpcds_q41/duckdb:duckdb 8126304 7975302 1.02
tpcds_q42/duckdb:duckdb 6626748 6475317 1.02
tpcds_q43/duckdb:duckdb 11478414 10881351 1.05
tpcds_q44/duckdb:duckdb 13576341 13294801 1.02
tpcds_q45/duckdb:duckdb 17126903 16796899 1.02
tpcds_q46/duckdb:duckdb 36159198 36140193 1.00
tpcds_q47/duckdb:duckdb 42315475 40536699 1.04
tpcds_q48/duckdb:duckdb 21997816 21395213 1.03
tpcds_q49/duckdb:duckdb 16673214 17405046 0.96
tpcds_q50/duckdb:duckdb 14252298 13931761 1.02
tpcds_q51/duckdb:duckdb 90699010 89790522 1.01
tpcds_q52/duckdb:duckdb 7316423 6991258 1.05
tpcds_q53/duckdb:duckdb 11809160 11460243 1.03
tpcds_q54/duckdb:duckdb 17031706 16593890 1.03
tpcds_q55/duckdb:duckdb 7151637 6709538 1.07
tpcds_q56/duckdb:duckdb 13580266 13832107 0.98
tpcds_q57/duckdb:duckdb 32605073 30509802 1.07
tpcds_q58/duckdb:duckdb 12841882 11773115 1.09
tpcds_q59/duckdb:duckdb 34373338 33971419 1.01
tpcds_q60/duckdb:duckdb 14584508 14254932 1.02
tpcds_q61/duckdb:duckdb 14490964 13765402 1.05
tpcds_q62/duckdb:duckdb 9083768 8954263 1.01
tpcds_q63/duckdb:duckdb 11421898 10998284 1.04
tpcds_q64/duckdb:duckdb 52972636 53703452 0.99
tpcds_q65/duckdb:duckdb 33665968 33259484 1.01
tpcds_q66/duckdb:duckdb 25472176 24077582 1.06
tpcds_q67/duckdb:duckdb 130660587 129854316 1.01
tpcds_q68/duckdb:duckdb 24418283 24333035 1.00
tpcds_q69/duckdb:duckdb 23240407 22668587 1.03
tpcds_q70/duckdb:duckdb 14077247 13776846 1.02
tpcds_q71/duckdb:duckdb 🚨 13327083 11728071 1.14
tpcds_q72/duckdb:duckdb 41134491 41605403 0.99
tpcds_q73/duckdb:duckdb 11066143 10824597 1.02
tpcds_q74/duckdb:duckdb 98031834 96353510 1.02
tpcds_q75/duckdb:duckdb 42972546 41552099 1.03
tpcds_q76/duckdb:duckdb 11792088 11465933 1.03
tpcds_q77/duckdb:duckdb 12061307 12461358 0.97
tpcds_q78/duckdb:duckdb 64093850 61358762 1.04
tpcds_q79/duckdb:duckdb 18108641 17991427 1.01
tpcds_q80/duckdb:duckdb 29341343 30818220 0.95
tpcds_q81/duckdb:duckdb 36377284 36764430 0.99
tpcds_q82/duckdb:duckdb 8268283 7844397 1.05
tpcds_q83/duckdb:duckdb 9375389 8723251 1.07
tpcds_q84/duckdb:duckdb 🚨 14257417 12906996 1.10
tpcds_q85/duckdb:duckdb 23798035 22908504 1.04
tpcds_q86/duckdb:duckdb 10503824 10886929 0.96
tpcds_q87/duckdb:duckdb 32782806 34269357 0.96
tpcds_q88/duckdb:duckdb 24164641 24002685 1.01
tpcds_q89/duckdb:duckdb 13262057 12901961 1.03
tpcds_q90/duckdb:duckdb 🚨 5848783 5304584 1.10
tpcds_q91/duckdb:duckdb 12888664 12197692 1.06
tpcds_q92/duckdb:duckdb 🚨 9303054 8322782 1.12
tpcds_q93/duckdb:duckdb 22444699 22169600 1.01
tpcds_q94/duckdb:duckdb 🚨 13780996 12352379 1.12
tpcds_q95/duckdb:duckdb 130365233 125350572 1.04
tpcds_q96/duckdb:duckdb 4675975 4299658 1.09
tpcds_q97/duckdb:duckdb 29801521 29852948 1.00
tpcds_q98/duckdb:duckdb 13895520 13941682 1.00
tpcds_q99/duckdb:duckdb 16209113 15627987 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.5% +0.4% +1.0% +11.5% ➖ noise
1 datafusion:vortex-file-compressed -15.2% +0.4% -15.5% +13.8% ✅ faster
1 duckdb:duckdb -0.6% +0.4% -1.0% +16.3% ➖ noise
1 duckdb:vortex-compact +0.5% +0.4% +0.1% +11.7% ➖ noise
1 duckdb:vortex-file-compressed +6.6% +0.4% +6.1% +11.5% ➖ noise
2 datafusion:vortex-compact +0.8% +1.0% -0.1% +12.1% ➖ noise
2 datafusion:vortex-file-compressed -7.2% +1.0% -8.1% +12.4% ➖ noise
2 duckdb:duckdb +10.7% +1.0% +9.7% +11.5% ➖ noise
2 duckdb:vortex-compact +3.2% +1.0% +2.2% +11.5% ➖ noise
2 duckdb:vortex-file-compressed +8.7% +1.0% +7.7% +12.0% ➖ noise
3 datafusion:vortex-compact +0.1% -4.6% +5.0% +14.9% ➖ noise
3 datafusion:vortex-file-compressed -15.2% -4.6% -11.0% +15.3% ➖ noise
3 duckdb:duckdb +10.3% -4.6% +15.6% +33.1% ➖ noise
3 duckdb:vortex-compact +1.4% -4.6% +6.3% +14.3% ➖ noise
3 duckdb:vortex-file-compressed -3.5% -4.6% +1.2% +19.0% ➖ noise
4 datafusion:vortex-compact -1.0% -2.3% +1.4% +11.5% ➖ noise
4 datafusion:vortex-file-compressed -13.3% -2.3% -11.2% +11.5% ✅ faster
4 duckdb:duckdb +0.1% -2.3% +2.5% +11.5% ➖ noise
4 duckdb:vortex-compact +0.4% -2.3% +2.8% +12.2% ➖ noise
4 duckdb:vortex-file-compressed +5.4% -2.3% +7.9% +13.4% ➖ noise
5 datafusion:vortex-compact +3.4% -9.0% +13.6% +11.5% 🚨 regression
5 datafusion:vortex-file-compressed -12.9% -9.0% -4.3% +11.5% ➖ noise
5 duckdb:duckdb +2.6% -9.0% +12.7% +12.0% 🚨 regression
5 duckdb:vortex-compact +6.2% -9.0% +16.7% +11.5% 🚨 regression
5 duckdb:vortex-file-compressed -6.0% -9.0% +3.2% +11.5% ➖ noise
6 datafusion:vortex-compact +0.3% -3.9% +4.3% +11.5% ➖ noise
6 datafusion:vortex-file-compressed -11.9% -3.9% -8.4% +11.5% ➖ noise
6 duckdb:duckdb +10.8% -3.9% +15.3% +11.5% 🚨 regression
6 duckdb:vortex-compact -0.9% -3.9% +3.1% +11.5% ➖ noise
6 duckdb:vortex-file-compressed -0.0% -3.9% +4.0% +11.5% ➖ noise
7 datafusion:vortex-compact +0.6% -9.6% +11.2% +11.5% ➖ noise
7 datafusion:vortex-file-compressed -5.7% -9.6% +4.3% +16.7% ➖ noise
7 duckdb:duckdb -0.3% -9.6% +10.2% +16.2% ➖ noise
7 duckdb:vortex-compact +2.9% -9.6% +13.8% +11.5% 🚨 regression
7 duckdb:vortex-file-compressed -4.3% -9.6% +5.8% +11.5% ➖ noise
8 datafusion:vortex-compact -0.4% -9.2% +9.7% +11.5% ➖ noise
8 datafusion:vortex-file-compressed -9.1% -9.2% +0.1% +12.9% ➖ noise
8 duckdb:duckdb +2.0% -9.2% +12.3% +11.5% 🚨 regression
8 duckdb:vortex-compact +0.5% -9.2% +10.7% +11.5% ➖ noise
8 duckdb:vortex-file-compressed +2.9% -9.2% +13.3% +11.5% 🚨 regression
9 datafusion:vortex-compact +6.7% -10.9% +19.7% +11.5% 🚨 regression
9 datafusion:vortex-file-compressed -12.9% -10.9% -2.3% +17.6% ➖ noise
9 duckdb:duckdb +0.6% -10.9% +12.8% +11.5% 🚨 regression
9 duckdb:vortex-compact +2.4% -10.9% +14.9% +11.5% 🚨 regression
9 duckdb:vortex-file-compressed +2.4% -10.9% +14.9% +11.5% 🚨 regression
10 datafusion:vortex-compact +3.7% -14.3% +21.0% +11.5% 🚨 regression
10 datafusion:vortex-file-compressed -11.1% -14.3% +3.7% +11.8% ➖ noise
10 duckdb:duckdb +4.9% -14.3% +22.4% +11.5% 🚨 regression
10 duckdb:vortex-compact +0.7% -14.3% +17.5% +11.5% 🚨 regression
10 duckdb:vortex-file-compressed -1.1% -14.3% +15.3% +11.5% 🚨 regression
11 datafusion:vortex-compact +1.2% -15.3% +19.5% +11.5% 🚨 regression
11 datafusion:vortex-file-compressed -10.6% -15.3% +5.6% +11.5% ➖ noise
11 duckdb:duckdb +2.4% -15.3% +20.9% +11.5% 🚨 regression
11 duckdb:vortex-compact +0.6% -15.3% +18.7% +11.5% 🚨 regression
11 duckdb:vortex-file-compressed +2.9% -15.3% +21.5% +11.5% 🚨 regression
12 datafusion:vortex-compact -0.2% -13.1% +14.9% +11.5% 🚨 regression
12 datafusion:vortex-file-compressed -5.0% -13.1% +9.3% +15.5% ➖ noise
12 duckdb:duckdb +2.2% -13.1% +17.6% +12.3% 🚨 regression
12 duckdb:vortex-compact +5.5% -13.1% +21.5% +16.2% 🚨 regression
12 duckdb:vortex-file-compressed -0.3% -13.1% +14.8% +12.9% 🚨 regression
13 datafusion:vortex-compact +5.6% -10.2% +17.7% +11.5% 🚨 regression
13 datafusion:vortex-file-compressed +4.6% -10.2% +16.5% +11.5% 🚨 regression
13 duckdb:duckdb +3.7% -10.2% +15.5% +11.5% 🚨 regression
13 duckdb:vortex-compact +1.6% -10.2% +13.2% +11.5% 🚨 regression
13 duckdb:vortex-file-compressed -1.9% -10.2% +9.2% +11.5% ➖ noise
14 datafusion:vortex-compact +2.2% -11.7% +15.8% +11.5% 🚨 regression
14 datafusion:vortex-file-compressed -8.6% -11.7% +3.6% +11.5% ➖ noise
14 duckdb:duckdb +4.4% -11.7% +18.2% +11.5% 🚨 regression
14 duckdb:vortex-compact +1.4% -11.7% +14.8% +14.8% ➖ noise
14 duckdb:vortex-file-compressed +3.6% -11.7% +17.4% +11.5% 🚨 regression
15 datafusion:vortex-compact -4.5% -7.8% +3.5% +11.5% ➖ noise
15 datafusion:vortex-file-compressed -17.4% -7.8% -10.4% +17.8% ➖ noise
15 duckdb:duckdb +5.8% -7.8% +14.7% +15.0% ➖ noise
15 duckdb:vortex-compact -0.2% -7.8% +8.1% +11.5% ➖ noise
15 duckdb:vortex-file-compressed -0.6% -7.8% +7.8% +13.7% ➖ noise
16 datafusion:vortex-compact -3.9% -8.7% +5.2% +13.8% ➖ noise
16 datafusion:vortex-file-compressed -24.0% -8.7% -16.8% +13.9% ✅ faster
16 duckdb:duckdb -3.7% -8.7% +5.5% +16.4% ➖ noise
16 duckdb:vortex-compact +3.0% -8.7% +12.8% +19.2% ➖ noise
16 duckdb:vortex-file-compressed +2.4% -8.7% +12.1% +12.3% ➖ noise
17 datafusion:vortex-compact +0.5% -7.0% +8.0% +11.5% ➖ noise
17 datafusion:vortex-file-compressed -17.3% -7.0% -11.1% +11.5% ✅ faster
17 duckdb:duckdb +1.4% -7.0% +9.0% +11.5% ➖ noise
17 duckdb:vortex-compact +2.5% -7.0% +10.2% +12.3% ➖ noise
17 duckdb:vortex-file-compressed +1.6% -7.0% +9.3% +11.5% ➖ noise
18 datafusion:vortex-compact -2.6% -7.0% +4.7% +11.5% ➖ noise
18 datafusion:vortex-file-compressed -14.6% -7.0% -8.1% +15.0% ➖ noise
18 duckdb:duckdb +4.2% -7.0% +12.1% +11.5% 🚨 regression
18 duckdb:vortex-compact -0.2% -7.0% +7.3% +11.5% ➖ noise
18 duckdb:vortex-file-compressed -2.9% -7.0% +4.5% +11.5% ➖ noise
19 datafusion:vortex-compact +0.7% -8.9% +10.5% +11.5% ➖ noise
19 datafusion:vortex-file-compressed -21.1% -8.9% -13.4% +14.6% ✅ faster
19 duckdb:duckdb -4.3% -8.9% +5.0% +14.9% ➖ noise
19 duckdb:vortex-compact +0.1% -8.9% +9.8% +11.5% ➖ noise
19 duckdb:vortex-file-compressed +4.3% -8.9% +14.5% +11.5% 🚨 regression
20 datafusion:vortex-compact -1.2% -10.5% +10.3% +11.5% ➖ noise
20 datafusion:vortex-file-compressed -23.0% -10.5% -14.0% +11.5% ✅ faster
20 duckdb:duckdb -1.0% -10.5% +10.6% +13.3% ➖ noise
20 duckdb:vortex-compact +1.9% -10.5% +13.8% +11.5% 🚨 regression
20 duckdb:vortex-file-compressed +6.9% -10.5% +19.4% +11.5% 🚨 regression
21 datafusion:vortex-compact +3.7% -13.2% +19.4% +14.4% 🚨 regression
21 datafusion:vortex-file-compressed -15.0% -13.2% -2.1% +12.7% ➖ noise
21 duckdb:duckdb +3.7% -13.2% +19.4% +20.6% ➖ noise
21 duckdb:vortex-compact +2.1% -13.2% +17.6% +13.0% 🚨 regression
21 duckdb:vortex-file-compressed -4.8% -13.2% +9.6% +18.9% ➖ noise
22 datafusion:vortex-compact -1.4% -10.1% +9.7% +11.5% ➖ noise
22 datafusion:vortex-file-compressed -18.6% -10.1% -9.5% +13.1% ➖ noise
22 duckdb:duckdb +0.7% -10.1% +12.0% +11.5% 🚨 regression
22 duckdb:vortex-compact +2.9% -10.1% +14.5% +11.9% 🚨 regression
22 duckdb:vortex-file-compressed +4.2% -10.1% +15.9% +11.5% 🚨 regression
23 datafusion:vortex-compact +3.4% -12.4% +18.0% +11.5% 🚨 regression
23 datafusion:vortex-file-compressed -7.7% -12.4% +5.3% +11.5% ➖ noise
23 duckdb:duckdb +3.4% -12.4% +18.0% +13.1% 🚨 regression
23 duckdb:vortex-compact +3.2% -12.4% +17.8% +12.5% 🚨 regression
23 duckdb:vortex-file-compressed +5.1% -12.4% +20.0% +11.5% 🚨 regression
24 datafusion:vortex-compact +0.6% -11.2% +13.3% +11.5% 🚨 regression
24 datafusion:vortex-file-compressed -3.2% -11.2% +9.0% +11.5% ➖ noise
24 duckdb:duckdb +2.4% -11.2% +15.3% +11.5% 🚨 regression
24 duckdb:vortex-compact +0.1% -11.2% +12.7% +11.5% 🚨 regression
24 duckdb:vortex-file-compressed +3.1% -11.2% +16.1% +11.5% 🚨 regression
25 datafusion:vortex-compact -3.3% -6.8% +3.8% +11.5% ➖ noise
25 datafusion:vortex-file-compressed -8.5% -6.8% -1.8% +11.5% ➖ noise
25 duckdb:duckdb +2.4% -6.8% +9.8% +11.5% ➖ noise
25 duckdb:vortex-compact +1.8% -6.8% +9.3% +11.5% ➖ noise
25 duckdb:vortex-file-compressed +3.5% -6.8% +11.0% +11.5% ➖ noise
26 datafusion:vortex-compact +6.3% -1.9% +8.4% +11.5% ➖ noise
26 datafusion:vortex-file-compressed -7.3% -1.9% -5.5% +11.5% ➖ noise
26 duckdb:duckdb +19.9% -1.9% +22.3% +20.4% 🚨 regression
26 duckdb:vortex-compact +1.6% -1.9% +3.6% +11.9% ➖ noise
26 duckdb:vortex-file-compressed -6.2% -1.9% -4.4% +15.3% ➖ noise
27 datafusion:vortex-compact -0.6% -3.8% +3.4% +11.5% ➖ noise
27 datafusion:vortex-file-compressed -10.3% -3.8% -6.7% +11.5% ➖ noise
27 duckdb:duckdb +3.1% -3.8% +7.2% +18.4% ➖ noise
27 duckdb:vortex-compact +2.9% -3.8% +7.0% +11.5% ➖ noise
27 duckdb:vortex-file-compressed +4.8% -3.8% +9.0% +11.5% ➖ noise
28 datafusion:vortex-compact +4.6% -4.0% +9.0% +11.5% ➖ noise
28 datafusion:vortex-file-compressed -9.3% -4.0% -5.5% +11.5% ➖ noise
28 duckdb:duckdb +0.9% -4.0% +5.1% +11.5% ➖ noise
28 duckdb:vortex-compact +2.3% -4.0% +6.6% +11.5% ➖ noise
28 duckdb:vortex-file-compressed +6.2% -4.0% +10.6% +11.5% ➖ noise
29 datafusion:vortex-compact +4.6% -3.6% +8.5% +11.5% ➖ noise
29 datafusion:vortex-file-compressed -4.5% -3.6% -0.9% +11.5% ➖ noise
29 duckdb:duckdb +3.2% -3.6% +7.1% +11.5% ➖ noise
29 duckdb:vortex-compact +4.9% -3.6% +8.9% +11.5% ➖ noise
29 duckdb:vortex-file-compressed +0.0% -3.6% +3.8% +11.5% ➖ noise
30 datafusion:vortex-compact -1.2% -8.6% +8.1% +11.5% ➖ noise
30 datafusion:vortex-file-compressed -2.7% -8.6% +6.5% +16.3% ➖ noise
30 duckdb:duckdb +1.8% -8.6% +11.4% +11.5% ➖ noise
30 duckdb:vortex-compact -3.8% -8.6% +5.2% +11.5% ➖ noise
30 duckdb:vortex-file-compressed +3.3% -8.6% +12.9% +13.0% ➖ noise
31 datafusion:vortex-compact +0.4% -5.1% +5.7% +11.5% ➖ noise
31 datafusion:vortex-file-compressed -4.1% -5.1% +1.1% +11.5% ➖ noise
31 duckdb:duckdb +6.4% -5.1% +12.1% +11.5% 🚨 regression
31 duckdb:vortex-compact +5.0% -5.1% +10.7% +11.5% ➖ noise
31 duckdb:vortex-file-compressed +5.0% -5.1% +10.7% +12.2% ➖ noise
32 datafusion:vortex-compact +4.7% -3.7% +8.8% +11.5% ➖ noise
32 datafusion:vortex-file-compressed -6.9% -3.7% -3.3% +11.5% ➖ noise
32 duckdb:duckdb +16.4% -3.7% +21.0% +16.6% 🚨 regression
32 duckdb:vortex-compact +3.5% -3.7% +7.6% +11.5% ➖ noise
32 duckdb:vortex-file-compressed +2.4% -3.7% +6.4% +11.5% ➖ noise
33 datafusion:vortex-compact +1.8% -4.7% +6.7% +11.5% ➖ noise
33 datafusion:vortex-file-compressed -9.6% -4.7% -5.1% +11.5% ➖ noise
33 duckdb:duckdb +6.2% -4.7% +11.4% +11.5% ➖ noise
33 duckdb:vortex-compact +2.3% -4.7% +7.3% +11.5% ➖ noise
33 duckdb:vortex-file-compressed +8.9% -4.7% +14.2% +11.5% 🚨 regression
34 datafusion:vortex-compact +2.0% -6.6% +9.2% +11.5% ➖ noise
34 datafusion:vortex-file-compressed -9.6% -6.6% -3.2% +11.5% ➖ noise
34 duckdb:duckdb +8.9% -6.6% +16.6% +11.5% 🚨 regression
34 duckdb:vortex-compact -0.6% -6.6% +6.4% +11.5% ➖ noise
34 duckdb:vortex-file-compressed -5.3% -6.6% +1.4% +11.5% ➖ noise
35 datafusion:vortex-compact +4.0% -4.9% +9.3% +11.5% ➖ noise
35 datafusion:vortex-file-compressed -7.0% -4.9% -2.2% +11.5% ➖ noise
35 duckdb:duckdb +3.6% -4.9% +8.9% +12.5% ➖ noise
35 duckdb:vortex-compact +1.8% -4.9% +7.0% +11.5% ➖ noise
35 duckdb:vortex-file-compressed +4.8% -4.9% +10.2% +11.5% ➖ noise
36 datafusion:vortex-compact +3.2% -5.2% +8.9% +11.5% ➖ noise
36 datafusion:vortex-file-compressed -6.9% -5.2% -1.8% +11.5% ➖ noise
36 duckdb:duckdb +5.1% -5.2% +10.9% +11.5% ➖ noise
36 duckdb:vortex-compact +1.1% -5.2% +6.6% +11.5% ➖ noise
36 duckdb:vortex-file-compressed -4.6% -5.2% +0.6% +12.1% ➖ noise
37 datafusion:vortex-compact -0.2% -2.3% +2.1% +11.5% ➖ noise
37 datafusion:vortex-file-compressed -4.9% -2.3% -2.7% +12.6% ➖ noise
37 duckdb:duckdb +1.6% -2.3% +4.0% +12.3% ➖ noise
37 duckdb:vortex-compact -0.9% -2.3% +1.4% +11.5% ➖ noise
37 duckdb:vortex-file-compressed +4.9% -2.3% +7.4% +12.7% ➖ noise
38 datafusion:vortex-compact +2.4% -3.7% +6.3% +11.5% ➖ noise
38 datafusion:vortex-file-compressed -6.6% -3.7% -3.1% +11.5% ➖ noise
38 duckdb:duckdb +2.4% -3.7% +6.3% +14.5% ➖ noise
38 duckdb:vortex-compact +8.9% -3.7% +13.0% +11.8% 🚨 regression
38 duckdb:vortex-file-compressed +5.9% -3.7% +9.9% +13.1% ➖ noise
39 datafusion:vortex-compact -4.2% -6.4% +2.4% +15.2% ➖ noise
39 datafusion:vortex-file-compressed +1.5% -6.4% +8.5% +20.3% ➖ noise
39 duckdb:duckdb +0.1% -6.4% +6.9% +13.4% ➖ noise
39 duckdb:vortex-compact +1.6% -6.4% +8.5% +17.1% ➖ noise
39 duckdb:vortex-file-compressed +6.1% -6.4% +13.4% +15.1% ➖ noise
40 datafusion:vortex-compact -2.1% -8.5% +7.0% +12.6% ➖ noise
40 datafusion:vortex-file-compressed -19.4% -8.5% -12.0% +15.0% ➖ noise
40 duckdb:duckdb +3.5% -8.5% +13.2% +20.8% ➖ noise
40 duckdb:vortex-compact -2.8% -8.5% +6.3% +18.5% ➖ noise
40 duckdb:vortex-file-compressed +9.4% -8.5% +19.6% +17.1% 🚨 regression
41 datafusion:vortex-compact +1.2% -5.4% +7.0% +14.8% ➖ noise
41 datafusion:vortex-file-compressed -8.3% -5.4% -3.0% +14.0% ➖ noise
41 duckdb:duckdb +1.9% -5.4% +7.8% +14.4% ➖ noise
41 duckdb:vortex-compact -6.3% -5.4% -0.9% +11.5% ➖ noise
41 duckdb:vortex-file-compressed +3.1% -5.4% +9.0% +11.5% ➖ noise
42 datafusion:vortex-compact -0.2% +0.1% -0.3% +11.5% ➖ noise
42 datafusion:vortex-file-compressed +0.1% +0.1% +0.0% +12.6% ➖ noise
42 duckdb:duckdb +2.3% +0.1% +2.2% +17.4% ➖ noise
42 duckdb:vortex-compact +2.2% +0.1% +2.1% +13.9% ➖ noise
42 duckdb:vortex-file-compressed +2.9% +0.1% +2.8% +17.6% ➖ noise
43 datafusion:vortex-compact +3.6% -1.5% +5.1% +11.5% ➖ noise
43 datafusion:vortex-file-compressed -8.9% -1.5% -7.5% +11.5% ➖ noise
43 duckdb:duckdb +5.5% -1.5% +7.1% +11.5% ➖ noise
43 duckdb:vortex-compact +2.4% -1.5% +4.0% +17.1% ➖ noise
43 duckdb:vortex-file-compressed -3.3% -1.5% -1.8% +11.5% ➖ noise
44 datafusion:vortex-compact +2.3% -3.5% +6.0% +11.5% ➖ noise
44 datafusion:vortex-file-compressed -9.8% -3.5% -6.5% +11.5% ➖ noise
44 duckdb:duckdb +2.1% -3.5% +5.9% +14.6% ➖ noise
44 duckdb:vortex-compact +2.1% -3.5% +5.8% +11.5% ➖ noise
44 duckdb:vortex-file-compressed -2.1% -3.5% +1.5% +11.5% ➖ noise
45 datafusion:vortex-compact +0.1% -3.3% +3.6% +11.5% ➖ noise
45 datafusion:vortex-file-compressed -11.0% -3.3% -8.0% +11.5% ➖ noise
45 duckdb:duckdb +2.0% -3.3% +5.5% +11.5% ➖ noise
45 duckdb:vortex-compact +13.8% -3.3% +17.7% +12.6% 🚨 regression
45 duckdb:vortex-file-compressed -0.1% -3.3% +3.3% +11.5% ➖ noise
46 datafusion:vortex-compact -0.2% -1.9% +1.8% +11.5% ➖ noise
46 datafusion:vortex-file-compressed -9.8% -1.9% -8.1% +11.5% ➖ noise
46 duckdb:duckdb +0.1% -1.9% +2.0% +15.4% ➖ noise
46 duckdb:vortex-compact +3.4% -1.9% +5.4% +11.5% ➖ noise
46 duckdb:vortex-file-compressed +1.2% -1.9% +3.2% +11.5% ➖ noise
47 datafusion:vortex-compact +0.5% -5.5% +6.3% +11.5% ➖ noise
47 datafusion:vortex-file-compressed -8.6% -5.5% -3.3% +11.5% ➖ noise
47 duckdb:duckdb +4.4% -5.5% +10.4% +11.5% ➖ noise
47 duckdb:vortex-compact +1.9% -5.5% +7.8% +11.5% ➖ noise
47 duckdb:vortex-file-compressed +5.5% -5.5% +11.6% +11.5% 🚨 regression
48 datafusion:vortex-compact -1.1% -4.1% +3.1% +11.5% ➖ noise
48 datafusion:vortex-file-compressed -0.1% -4.1% +4.2% +11.5% ➖ noise
48 duckdb:duckdb +2.8% -4.1% +7.2% +14.5% ➖ noise
48 duckdb:vortex-compact -2.8% -4.1% +1.4% +13.8% ➖ noise
48 duckdb:vortex-file-compressed +2.2% -4.1% +6.5% +11.5% ➖ noise
49 datafusion:vortex-compact +0.2% -4.6% +5.1% +11.5% ➖ noise
49 datafusion:vortex-file-compressed -2.7% -4.6% +2.0% +11.5% ➖ noise
49 duckdb:duckdb -4.2% -4.6% +0.5% +14.3% ➖ noise
49 duckdb:vortex-compact +7.3% -4.6% +12.5% +11.5% 🚨 regression
49 duckdb:vortex-file-compressed +4.7% -4.6% +9.8% +16.1% ➖ noise
50 datafusion:vortex-compact -0.4% -1.6% +1.2% +11.5% ➖ noise
50 datafusion:vortex-file-compressed -5.8% -1.6% -4.3% +11.5% ➖ noise
50 duckdb:duckdb +2.3% -1.6% +4.0% +12.4% ➖ noise
50 duckdb:vortex-compact -4.1% -1.6% -2.5% +11.5% ➖ noise
50 duckdb:vortex-file-compressed +2.9% -1.6% +4.6% +11.5% ➖ noise
51 datafusion:vortex-compact +1.5% -2.5% +4.1% +11.5% ➖ noise
51 datafusion:vortex-file-compressed -11.0% -2.5% -8.8% +11.5% ➖ noise
51 duckdb:duckdb +1.0% -2.5% +3.6% +11.5% ➖ noise
51 duckdb:vortex-compact -15.2% -2.5% -13.1% +25.5% ➖ noise
51 duckdb:vortex-file-compressed -3.9% -2.5% -1.5% +18.2% ➖ noise
52 datafusion:vortex-compact +1.7% -6.3% +8.5% +13.6% ➖ noise
52 datafusion:vortex-file-compressed -11.2% -6.3% -5.2% +13.6% ➖ noise
52 duckdb:duckdb +4.7% -6.3% +11.7% +15.2% ➖ noise
52 duckdb:vortex-compact -7.2% -6.3% -1.0% +22.4% ➖ noise
52 duckdb:vortex-file-compressed -3.8% -6.3% +2.7% +21.1% ➖ noise
53 datafusion:vortex-compact +1.8% +2.9% -1.1% +11.5% ➖ noise
53 datafusion:vortex-file-compressed -2.3% +2.9% -5.1% +13.8% ➖ noise
53 duckdb:duckdb +3.0% +2.9% +0.1% +12.3% ➖ noise
53 duckdb:vortex-compact +0.3% +2.9% -2.5% +11.5% ➖ noise
53 duckdb:vortex-file-compressed +6.4% +2.9% +3.4% +13.5% ➖ noise
54 datafusion:vortex-compact -1.8% -4.3% +2.6% +11.5% ➖ noise
54 datafusion:vortex-file-compressed -9.7% -4.3% -5.6% +11.5% ➖ noise
54 duckdb:duckdb +2.6% -4.3% +7.2% +11.5% ➖ noise
54 duckdb:vortex-compact +3.8% -4.3% +8.5% +11.5% ➖ noise
54 duckdb:vortex-file-compressed +2.5% -4.3% +7.1% +16.0% ➖ noise
55 datafusion:vortex-compact -5.9% -4.4% -1.5% +12.1% ➖ noise
55 datafusion:vortex-file-compressed -10.5% -4.4% -6.4% +13.4% ➖ noise
55 duckdb:duckdb +6.6% -4.4% +11.5% +24.2% ➖ noise
55 duckdb:vortex-compact +10.2% -4.4% +15.3% +12.8% 🚨 regression
55 duckdb:vortex-file-compressed -4.5% -4.4% -0.1% +17.3% ➖ noise
56 datafusion:vortex-compact +0.0% -3.5% +3.7% +11.5% ➖ noise
56 datafusion:vortex-file-compressed -2.6% -3.5% +0.9% +11.5% ➖ noise
56 duckdb:duckdb -1.8% -3.5% +1.8% +11.5% ➖ noise
56 duckdb:vortex-compact +4.4% -3.5% +8.3% +11.5% ➖ noise
56 duckdb:vortex-file-compressed +8.3% -3.5% +12.2% +11.5% 🚨 regression
57 datafusion:vortex-compact +0.0% -3.7% +3.9% +11.5% ➖ noise
57 datafusion:vortex-file-compressed -7.0% -3.7% -3.4% +11.5% ➖ noise
57 duckdb:duckdb +6.9% -3.7% +10.9% +17.2% ➖ noise
57 duckdb:vortex-compact +1.6% -3.7% +5.5% +11.5% ➖ noise
57 duckdb:vortex-file-compressed +3.3% -3.7% +7.2% +17.5% ➖ noise
58 datafusion:vortex-compact +0.4% -4.1% +4.7% +11.5% ➖ noise
58 datafusion:vortex-file-compressed -7.9% -4.1% -3.9% +11.5% ➖ noise
58 duckdb:duckdb +9.1% -4.1% +13.8% +18.6% ➖ noise
58 duckdb:vortex-compact -5.3% -4.1% -1.2% +11.5% ➖ noise
58 duckdb:vortex-file-compressed -7.6% -4.1% -3.6% +14.9% ➖ noise
59 datafusion:vortex-compact +3.1% -1.5% +4.7% +11.5% ➖ noise
59 datafusion:vortex-file-compressed -12.6% -1.5% -11.2% +11.5% ✅ faster
59 duckdb:duckdb +1.2% -1.5% +2.8% +11.5% ➖ noise
59 duckdb:vortex-compact +4.9% -1.5% +6.5% +11.5% ➖ noise
59 duckdb:vortex-file-compressed +1.1% -1.5% +2.6% +11.5% ➖ noise
60 datafusion:vortex-compact +2.7% -4.4% +7.4% +11.5% ➖ noise
60 datafusion:vortex-file-compressed -6.1% -4.4% -1.8% +11.5% ➖ noise
60 duckdb:duckdb +2.3% -4.4% +7.0% +13.5% ➖ noise
60 duckdb:vortex-compact -2.7% -4.4% +1.8% +11.5% ➖ noise
60 duckdb:vortex-file-compressed -3.7% -4.4% +0.7% +11.5% ➖ noise
61 datafusion:vortex-compact +3.7% -5.0% +9.1% +11.5% ➖ noise
61 datafusion:vortex-file-compressed -7.2% -5.0% -2.3% +14.4% ➖ noise
61 duckdb:duckdb +5.3% -5.0% +10.8% +11.5% ➖ noise
61 duckdb:vortex-compact +3.4% -5.0% +8.9% +11.5% ➖ noise
61 duckdb:vortex-file-compressed +5.4% -5.0% +11.0% +17.0% ➖ noise
62 datafusion:vortex-compact +2.3% +5.5% -3.0% +12.2% ➖ noise
62 datafusion:vortex-file-compressed -4.9% +5.5% -9.9% +11.5% ➖ noise
62 duckdb:duckdb +1.4% +5.5% -3.8% +17.2% ➖ noise
62 duckdb:vortex-compact +0.5% +5.5% -4.7% +16.6% ➖ noise
62 duckdb:vortex-file-compressed -4.7% +5.5% -9.6% +17.8% ➖ noise
63 datafusion:vortex-compact -2.0% -2.8% +0.9% +11.5% ➖ noise
63 datafusion:vortex-file-compressed -5.6% -2.8% -2.9% +11.5% ➖ noise
63 duckdb:duckdb +3.9% -2.8% +6.9% +11.5% ➖ noise
63 duckdb:vortex-compact +1.5% -2.8% +4.4% +16.7% ➖ noise
63 duckdb:vortex-file-compressed +0.5% -2.8% +3.4% +12.3% ➖ noise
64 datafusion:vortex-compact -0.5% -3.4% +3.0% +11.5% ➖ noise
64 datafusion:vortex-file-compressed -6.5% -3.4% -3.2% +11.5% ➖ noise
64 duckdb:duckdb -1.4% -3.4% +2.1% +11.5% ➖ noise
64 duckdb:vortex-compact +0.4% -3.4% +4.0% +11.5% ➖ noise
64 duckdb:vortex-file-compressed +0.2% -3.4% +3.8% +11.5% ➖ noise
65 datafusion:vortex-compact +2.7% -4.7% +7.8% +11.5% ➖ noise
65 datafusion:vortex-file-compressed -1.6% -4.7% +3.3% +12.6% ➖ noise
65 duckdb:duckdb +1.2% -4.7% +6.2% +14.8% ➖ noise
65 duckdb:vortex-compact +3.2% -4.7% +8.3% +11.5% ➖ noise
65 duckdb:vortex-file-compressed +2.5% -4.7% +7.6% +12.2% ➖ noise
66 datafusion:vortex-compact -0.5% -5.3% +5.1% +13.0% ➖ noise
66 datafusion:vortex-file-compressed +2.2% -5.3% +7.9% +15.4% ➖ noise
66 duckdb:duckdb +5.8% -5.3% +11.7% +15.0% ➖ noise
66 duckdb:vortex-compact +6.8% -5.3% +12.7% +14.2% ➖ noise
66 duckdb:vortex-file-compressed +6.8% -5.3% +12.7% +13.2% ➖ noise
67 datafusion:vortex-compact +2.3% -5.4% +8.2% +11.5% ➖ noise
67 datafusion:vortex-file-compressed +0.5% -5.4% +6.3% +11.5% ➖ noise
67 duckdb:duckdb +0.6% -5.4% +6.4% +11.5% ➖ noise
67 duckdb:vortex-compact +0.7% -5.4% +6.5% +11.5% ➖ noise
67 duckdb:vortex-file-compressed +0.8% -5.4% +6.6% +11.5% ➖ noise
68 datafusion:vortex-compact -3.8% -5.1% +1.4% +11.5% ➖ noise
68 datafusion:vortex-file-compressed +0.7% -5.1% +6.1% +11.5% ➖ noise
68 duckdb:duckdb +0.4% -5.1% +5.7% +11.5% ➖ noise
68 duckdb:vortex-compact +0.1% -5.1% +5.5% +11.5% ➖ noise
68 duckdb:vortex-file-compressed +3.0% -5.1% +8.5% +11.5% ➖ noise
69 datafusion:vortex-compact +1.2% -1.0% +2.2% +11.5% ➖ noise
69 datafusion:vortex-file-compressed +1.5% -1.0% +2.5% +11.5% ➖ noise
69 duckdb:duckdb +2.5% -1.0% +3.5% +11.7% ➖ noise
69 duckdb:vortex-compact +5.3% -1.0% +6.4% +11.5% ➖ noise
69 duckdb:vortex-file-compressed +2.0% -1.0% +3.0% +11.5% ➖ noise
70 datafusion:vortex-compact -0.5% -4.8% +4.5% +11.5% ➖ noise
70 datafusion:vortex-file-compressed +2.5% -4.8% +7.6% +11.5% ➖ noise
70 duckdb:duckdb +2.2% -4.8% +7.3% +12.6% ➖ noise
70 duckdb:vortex-compact -1.7% -4.8% +3.3% +11.5% ➖ noise
70 duckdb:vortex-file-compressed +0.9% -4.8% +5.9% +11.5% ➖ noise
71 datafusion:vortex-compact +0.1% +0.1% -0.0% +11.5% ➖ noise
71 datafusion:vortex-file-compressed +1.7% +0.1% +1.6% +11.5% ➖ noise
71 duckdb:duckdb +13.6% +0.1% +13.5% +14.8% ➖ noise
71 duckdb:vortex-compact +3.3% +0.1% +3.1% +12.3% ➖ noise
71 duckdb:vortex-file-compressed +5.0% +0.1% +4.9% +12.9% ➖ noise
72 datafusion:vortex-compact +0.7% -4.7% +5.6% +11.5% ➖ noise
72 datafusion:vortex-file-compressed +2.7% -4.7% +7.7% +11.5% ➖ noise
72 duckdb:duckdb -1.1% -4.7% +3.7% +14.8% ➖ noise
72 duckdb:vortex-compact -0.6% -4.7% +4.3% +11.5% ➖ noise
72 duckdb:vortex-file-compressed +1.1% -4.7% +6.1% +11.5% ➖ noise
73 datafusion:vortex-compact -0.0% +0.5% -0.5% +14.9% ➖ noise
73 datafusion:vortex-file-compressed -3.5% +0.5% -4.0% +21.1% ➖ noise
73 duckdb:duckdb +2.2% +0.5% +1.7% +12.0% ➖ noise
73 duckdb:vortex-compact +0.3% +0.5% -0.2% +11.5% ➖ noise
73 duckdb:vortex-file-compressed +0.8% +0.5% +0.3% +11.5% ➖ noise
74 datafusion:vortex-compact -2.2% -5.5% +3.5% +11.5% ➖ noise
74 datafusion:vortex-file-compressed -4.3% -5.5% +1.4% +11.5% ➖ noise
74 duckdb:duckdb +1.7% -5.5% +7.7% +11.5% ➖ noise
74 duckdb:vortex-compact +4.9% -5.5% +11.0% +11.5% ➖ noise
74 duckdb:vortex-file-compressed +2.2% -5.5% +8.2% +11.5% ➖ noise
75 datafusion:vortex-compact +3.7% -2.5% +6.3% +11.5% ➖ noise
75 datafusion:vortex-file-compressed -1.3% -2.5% +1.2% +11.5% ➖ noise
75 duckdb:duckdb +3.4% -2.5% +6.0% +11.5% ➖ noise
75 duckdb:vortex-compact +6.6% -2.5% +9.3% +11.5% ➖ noise
75 duckdb:vortex-file-compressed -3.3% -2.5% -0.9% +11.5% ➖ noise
76 datafusion:vortex-compact +1.2% +0.2% +0.9% +11.5% ➖ noise
76 datafusion:vortex-file-compressed +2.3% +0.2% +2.1% +11.5% ➖ noise
76 duckdb:duckdb +2.8% +0.2% +2.6% +20.1% ➖ noise
76 duckdb:vortex-compact +6.9% +0.2% +6.7% +11.5% ➖ noise
76 duckdb:vortex-file-compressed -2.6% +0.2% -2.9% +26.3% ➖ noise
77 datafusion:vortex-compact +0.7% -3.9% +4.8% +11.5% ➖ noise
77 datafusion:vortex-file-compressed +0.8% -3.9% +4.9% +11.5% ➖ noise
77 duckdb:duckdb -3.2% -3.9% +0.7% +16.7% ➖ noise
77 duckdb:vortex-compact +3.4% -3.9% +7.6% +11.5% ➖ noise
77 duckdb:vortex-file-compressed -3.8% -3.9% +0.1% +11.5% ➖ noise
78 datafusion:vortex-compact -0.2% -6.4% +6.7% +11.5% ➖ noise
78 datafusion:vortex-file-compressed +0.5% -6.4% +7.4% +11.5% ➖ noise
78 duckdb:duckdb +4.5% -6.4% +11.6% +12.0% ➖ noise
78 duckdb:vortex-compact +1.6% -6.4% +8.6% +11.5% ➖ noise
78 duckdb:vortex-file-compressed +3.1% -6.4% +10.2% +11.5% ➖ noise
79 datafusion:vortex-compact +1.4% -5.1% +6.9% +11.5% ➖ noise
79 datafusion:vortex-file-compressed +4.4% -5.1% +10.0% +11.5% ➖ noise
79 duckdb:duckdb +0.7% -5.1% +6.0% +14.0% ➖ noise
79 duckdb:vortex-compact +2.4% -5.1% +7.9% +11.5% ➖ noise
79 duckdb:vortex-file-compressed +2.4% -5.1% +7.9% +12.6% ➖ noise
80 datafusion:vortex-compact +2.3% -6.1% +9.0% +11.5% ➖ noise
80 datafusion:vortex-file-compressed -1.0% -6.1% +5.4% +11.5% ➖ noise
80 duckdb:duckdb -4.8% -6.1% +1.4% +18.1% ➖ noise
80 duckdb:vortex-compact +3.7% -6.1% +10.5% +11.5% ➖ noise
80 duckdb:vortex-file-compressed +7.0% -6.1% +13.9% +11.5% 🚨 regression
81 datafusion:vortex-compact -3.6% -5.3% +1.9% +13.2% ➖ noise
81 datafusion:vortex-file-compressed +4.4% -5.3% +10.3% +12.6% ➖ noise
81 duckdb:duckdb -1.1% -5.3% +4.5% +11.5% ➖ noise
81 duckdb:vortex-compact +4.9% -5.3% +10.8% +11.5% ➖ noise
81 duckdb:vortex-file-compressed +4.3% -5.3% +10.2% +11.5% ➖ noise
82 datafusion:vortex-compact +2.1% -4.9% +7.3% +11.5% ➖ noise
82 datafusion:vortex-file-compressed +1.1% -4.9% +6.3% +11.5% ➖ noise
82 duckdb:duckdb +5.4% -4.9% +10.8% +19.8% ➖ noise
82 duckdb:vortex-compact -2.7% -4.9% +2.2% +11.5% ➖ noise
82 duckdb:vortex-file-compressed +3.7% -4.9% +9.0% +12.4% ➖ noise
83 datafusion:vortex-compact -0.2% -4.1% +4.0% +11.5% ➖ noise
83 datafusion:vortex-file-compressed -1.4% -4.1% +2.9% +11.5% ➖ noise
83 duckdb:duckdb +7.5% -4.1% +12.1% +12.4% ➖ noise
83 duckdb:vortex-compact +0.2% -4.1% +4.5% +11.5% ➖ noise
83 duckdb:vortex-file-compressed +3.2% -4.1% +7.7% +12.9% ➖ noise
84 datafusion:vortex-compact -3.0% -2.9% -0.1% +11.5% ➖ noise
84 datafusion:vortex-file-compressed -4.2% -2.9% -1.4% +13.0% ➖ noise
84 duckdb:duckdb +10.5% -2.9% +13.7% +11.7% 🚨 regression
84 duckdb:vortex-compact -1.2% -2.9% +1.8% +11.5% ➖ noise
84 duckdb:vortex-file-compressed +5.2% -2.9% +8.3% +11.5% ➖ noise
85 datafusion:vortex-compact +0.5% -1.2% +1.7% +11.5% ➖ noise
85 datafusion:vortex-file-compressed -1.2% -1.2% -0.0% +11.5% ➖ noise
85 duckdb:duckdb +3.9% -1.2% +5.1% +11.5% ➖ noise
85 duckdb:vortex-compact +1.0% -1.2% +2.2% +11.5% ➖ noise
85 duckdb:vortex-file-compressed +6.1% -1.2% +7.4% +11.5% ➖ noise
86 datafusion:vortex-compact -0.2% +5.2% -5.1% +13.6% ➖ noise
86 datafusion:vortex-file-compressed -5.0% +5.2% -9.7% +14.4% ➖ noise
86 duckdb:duckdb -3.5% +5.2% -8.3% +13.5% ➖ noise
86 duckdb:vortex-compact +2.1% +5.2% -3.0% +17.4% ➖ noise
86 duckdb:vortex-file-compressed +0.0% +5.2% -4.9% +14.5% ➖ noise
87 datafusion:vortex-compact -0.9% +1.0% -1.9% +11.5% ➖ noise
87 datafusion:vortex-file-compressed -0.5% +1.0% -1.5% +11.5% ➖ noise
87 duckdb:duckdb -4.3% +1.0% -5.3% +14.7% ➖ noise
87 duckdb:vortex-compact -2.4% +1.0% -3.4% +11.7% ➖ noise
87 duckdb:vortex-file-compressed +9.0% +1.0% +7.8% +14.8% ➖ noise
88 datafusion:vortex-compact +2.4% -5.7% +8.6% +11.5% ➖ noise
88 datafusion:vortex-file-compressed +2.3% -5.7% +8.5% +11.5% ➖ noise
88 duckdb:duckdb +0.7% -5.7% +6.8% +11.5% ➖ noise
88 duckdb:vortex-compact +6.0% -5.7% +12.4% +11.5% 🚨 regression
88 duckdb:vortex-file-compressed +1.1% -5.7% +7.2% +11.6% ➖ noise
89 datafusion:vortex-compact -3.5% -0.5% -3.1% +11.5% ➖ noise
89 datafusion:vortex-file-compressed -3.3% -0.5% -2.8% +11.5% ➖ noise
89 duckdb:duckdb +2.8% -0.5% +3.3% +11.5% ➖ noise
89 duckdb:vortex-compact +1.3% -0.5% +1.8% +11.5% ➖ noise
89 duckdb:vortex-file-compressed -3.4% -0.5% -2.9% +12.2% ➖ noise
90 datafusion:vortex-compact +0.9% -5.9% +7.2% +11.5% ➖ noise
90 datafusion:vortex-file-compressed +0.4% -5.9% +6.7% +11.5% ➖ noise
90 duckdb:duckdb +10.3% -5.9% +17.2% +12.1% 🚨 regression
90 duckdb:vortex-compact +8.9% -5.9% +15.8% +11.5% 🚨 regression
90 duckdb:vortex-file-compressed +8.6% -5.9% +15.4% +11.7% 🚨 regression
91 datafusion:vortex-compact +1.9% -3.6% +5.7% +11.5% ➖ noise
91 datafusion:vortex-file-compressed +1.8% -3.6% +5.6% +11.5% ➖ noise
91 duckdb:duckdb +5.7% -3.6% +9.6% +13.4% ➖ noise
91 duckdb:vortex-compact +7.8% -3.6% +11.8% +11.5% 🚨 regression
91 duckdb:vortex-file-compressed +3.7% -3.6% +7.5% +13.1% ➖ noise
92 datafusion:vortex-compact -1.9% -0.7% -1.2% +11.7% ➖ noise
92 datafusion:vortex-file-compressed -0.8% -0.7% -0.1% +11.5% ➖ noise
92 duckdb:duckdb +11.8% -0.7% +12.6% +13.3% ➖ noise
92 duckdb:vortex-compact +8.8% -0.7% +9.6% +17.4% ➖ noise
92 duckdb:vortex-file-compressed +6.1% -0.7% +6.8% +13.0% ➖ noise
93 datafusion:vortex-compact -2.3% -9.7% +8.1% +18.2% ➖ noise
93 datafusion:vortex-file-compressed -4.1% -9.7% +6.1% +14.6% ➖ noise
93 duckdb:duckdb +1.2% -9.7% +12.1% +17.0% ➖ noise
93 duckdb:vortex-compact +1.7% -9.7% +12.7% +15.4% ➖ noise
93 duckdb:vortex-file-compressed +2.2% -9.7% +13.2% +19.2% ➖ noise
94 datafusion:vortex-compact -1.7% -8.2% +7.1% +11.9% ➖ noise
94 datafusion:vortex-file-compressed +1.7% -8.2% +10.8% +11.5% ➖ noise
94 duckdb:duckdb +11.6% -8.2% +21.6% +12.9% 🚨 regression
94 duckdb:vortex-compact +6.2% -8.2% +15.8% +14.7% 🚨 regression
94 duckdb:vortex-file-compressed +10.3% -8.2% +20.2% +11.5% 🚨 regression
95 datafusion:vortex-compact -0.3% -5.8% +5.8% +11.5% ➖ noise
95 datafusion:vortex-file-compressed +0.2% -5.8% +6.4% +11.5% ➖ noise
95 duckdb:duckdb +4.0% -5.8% +10.4% +16.5% ➖ noise
95 duckdb:vortex-compact +10.1% -5.8% +16.9% +15.0% 🚨 regression
95 duckdb:vortex-file-compressed -0.1% -5.8% +6.1% +15.7% ➖ noise
96 datafusion:vortex-compact +5.2% +3.2% +2.0% +11.7% ➖ noise
96 datafusion:vortex-file-compressed -4.9% +3.2% -7.8% +11.8% ➖ noise
96 duckdb:duckdb +8.8% +3.2% +5.4% +13.2% ➖ noise
96 duckdb:vortex-compact +25.7% +3.2% +21.8% +21.5% 🚨 regression
96 duckdb:vortex-file-compressed +2.9% +3.2% -0.3% +20.1% ➖ noise
97 datafusion:vortex-compact -3.3% -5.5% +2.3% +11.5% ➖ noise
97 datafusion:vortex-file-compressed -0.8% -5.5% +5.0% +11.5% ➖ noise
97 duckdb:duckdb -0.2% -5.5% +5.6% +11.5% ➖ noise
97 duckdb:vortex-compact +7.0% -5.5% +13.2% +13.5% ➖ noise
97 duckdb:vortex-file-compressed +4.2% -5.5% +10.2% +11.5% ➖ noise
98 datafusion:vortex-compact +0.8% -4.6% +5.6% +11.5% ➖ noise
98 datafusion:vortex-file-compressed -1.0% -4.6% +3.7% +11.9% ➖ noise
98 duckdb:duckdb -0.3% -4.6% +4.4% +11.5% ➖ noise
98 duckdb:vortex-compact +8.1% -4.6% +13.3% +12.3% 🚨 regression
98 duckdb:vortex-file-compressed -3.5% -4.6% +1.1% +13.0% ➖ noise
99 datafusion:vortex-compact -1.4% +4.1% -5.3% +16.0% ➖ noise
99 datafusion:vortex-file-compressed +2.5% +4.1% -1.6% +14.6% ➖ noise
99 duckdb:duckdb +3.7% +4.1% -0.4% +12.4% ➖ noise
99 duckdb:vortex-compact -5.9% +4.1% -9.6% +19.9% ➖ noise
99 duckdb:vortex-file-compressed +4.6% +4.1% +0.4% +24.7% ➖ noise

@0ax1
Copy link
Contributor Author

0ax1 commented Mar 17, 2026

Seems like there are some things that needed to be inlined in here? related to bitpacking and between eval

Yeah, I'll double check any regressions for sure.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.5%
Vortex (geomean): 0.952x ➖
Parquet (geomean): 0.934x ➖
Shifts: Parquet (control) -6.6% · Median polish -4.5%


datafusion / vortex-file-compressed (0.976x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 426689164 453594052 0.94
tpch_q02/datafusion:vortex-file-compressed 157630066 161344017 0.98
tpch_q03/datafusion:vortex-file-compressed 245821201 259803205 0.95
tpch_q04/datafusion:vortex-file-compressed 105802313 108171536 0.98
tpch_q05/datafusion:vortex-file-compressed 462925665 476595732 0.97
tpch_q06/datafusion:vortex-file-compressed 40308761 41326066 0.98
tpch_q07/datafusion:vortex-file-compressed 641213599 659161287 0.97
tpch_q08/datafusion:vortex-file-compressed 469542656 478801861 0.98
tpch_q09/datafusion:vortex-file-compressed 795729066 819917095 0.97
tpch_q10/datafusion:vortex-file-compressed 294475327 295776490 1.00
tpch_q11/datafusion:vortex-file-compressed 114905931 115953450 0.99
tpch_q12/datafusion:vortex-file-compressed 126672822 127264631 1.00
tpch_q13/datafusion:vortex-file-compressed 225332467 225263696 1.00
tpch_q14/datafusion:vortex-file-compressed 72257845 76128921 0.95
tpch_q15/datafusion:vortex-file-compressed 109528727 108231898 1.01
tpch_q16/datafusion:vortex-file-compressed 92270494 95343388 0.97
tpch_q17/datafusion:vortex-file-compressed 737893832 735926055 1.00
tpch_q18/datafusion:vortex-file-compressed 968698790 983756532 0.98
tpch_q19/datafusion:vortex-file-compressed 129204894 128330741 1.01
tpch_q20/datafusion:vortex-file-compressed 198421384 201509976 0.98
tpch_q21/datafusion:vortex-file-compressed 755318153 801389322 0.94
tpch_q22/datafusion:vortex-file-compressed 60242541 63892145 0.94
datafusion / vortex-compact (0.939x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 481989315 480214719 1.00
tpch_q02/datafusion:vortex-compact 161067846 176548088 0.91
tpch_q03/datafusion:vortex-compact 260638282 285950227 0.91
tpch_q04/datafusion:vortex-compact 128179479 134390426 0.95
tpch_q05/datafusion:vortex-compact 464456085 508134583 0.91
tpch_q06/datafusion:vortex-compact 63856559 66634664 0.96
tpch_q07/datafusion:vortex-compact 668620096 726983683 0.92
tpch_q08/datafusion:vortex-compact 476698843 511181807 0.93
tpch_q09/datafusion:vortex-compact 809730313 884098474 0.92
tpch_q10/datafusion:vortex-compact 320146122 341991817 0.94
tpch_q11/datafusion:vortex-compact 121397420 127968764 0.95
tpch_q12/datafusion:vortex-compact 183840496 191626634 0.96
tpch_q13/datafusion:vortex-compact 273563460 290004356 0.94
tpch_q14/datafusion:vortex-compact 87511052 93882146 0.93
tpch_q15/datafusion:vortex-compact 165809431 176022871 0.94
tpch_q16/datafusion:vortex-compact 99313690 107898616 0.92
tpch_q17/datafusion:vortex-compact 734797377 807645328 0.91
tpch_q18/datafusion:vortex-compact 974858362 1050911654 0.93
tpch_q19/datafusion:vortex-compact 229401052 235408531 0.97
tpch_q20/datafusion:vortex-compact 227777584 238224618 0.96
tpch_q21/datafusion:vortex-compact 795843801 841699920 0.95
tpch_q22/datafusion:vortex-compact 71091752 74343633 0.96
datafusion / parquet (0.925x ➖, 8↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 450947249 553048607 0.82
tpch_q02/datafusion:parquet 267333554 281117835 0.95
tpch_q03/datafusion:parquet 🚀 386508684 444781628 0.87
tpch_q04/datafusion:parquet 🚀 149408070 169771349 0.88
tpch_q05/datafusion:parquet 🚀 578959569 651394028 0.89
tpch_q06/datafusion:parquet 🚀 123621628 144476541 0.86
tpch_q07/datafusion:parquet 🚀 791308462 917457637 0.86
tpch_q08/datafusion:parquet 🚀 646868525 725273378 0.89
tpch_q09/datafusion:parquet 🚀 951009381 1097756195 0.87
tpch_q10/datafusion:parquet 604950986 665587268 0.91
tpch_q11/datafusion:parquet 192114279 211490538 0.91
tpch_q12/datafusion:parquet 250670290 273009782 0.92
tpch_q13/datafusion:parquet 339792136 342139533 0.99
tpch_q14/datafusion:parquet 195097092 198556104 0.98
tpch_q15/datafusion:parquet 261098927 263353405 0.99
tpch_q16/datafusion:parquet 176907020 180375655 0.98
tpch_q17/datafusion:parquet 837112897 848487636 0.99
tpch_q18/datafusion:parquet 1013250182 1071724465 0.95
tpch_q19/datafusion:parquet 350066313 345509888 1.01
tpch_q20/datafusion:parquet 367751847 387233996 0.95
tpch_q21/datafusion:parquet 891335208 938310748 0.95
tpch_q22/datafusion:parquet 220574144 224579318 0.98
datafusion / arrow (0.941x ➖, 6↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 705976715 723965678 0.98
tpch_q02/datafusion:arrow 194378888 200736521 0.97
tpch_q03/datafusion:arrow 534953110 543054106 0.99
tpch_q04/datafusion:arrow 388266712 393612258 0.99
tpch_q05/datafusion:arrow 1034068830 1054712726 0.98
tpch_q06/datafusion:arrow 311529141 318125955 0.98
tpch_q07/datafusion:arrow 1353486259 1362436344 0.99
tpch_q08/datafusion:arrow 1261249705 1300772474 0.97
tpch_q09/datafusion:arrow 1521919486 1554138005 0.98
tpch_q10/datafusion:arrow 667846981 681465451 0.98
tpch_q11/datafusion:arrow 176472728 179424704 0.98
tpch_q12/datafusion:arrow 732285173 730668347 1.00
tpch_q13/datafusion:arrow 530771181 509883270 1.04
tpch_q14/datafusion:arrow 350115368 359468604 0.97
tpch_q15/datafusion:arrow 747973180 760546663 0.98
tpch_q16/datafusion:arrow 117873620 120747018 0.98
tpch_q17/datafusion:arrow 🚀 1543702227 1757634906 0.88
tpch_q18/datafusion:arrow 🚀 2058183370 2496787158 0.82
tpch_q19/datafusion:arrow 🚀 565865207 676376100 0.84
tpch_q20/datafusion:arrow 🚀 554722979 660222829 0.84
tpch_q21/datafusion:arrow 🚀 3836974177 4800605295 0.80
tpch_q22/datafusion:arrow 🚀 175362413 212053928 0.83
duckdb / vortex-file-compressed (0.914x ➖, 5↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 178211825 186921858 0.95
tpch_q02/duckdb:vortex-file-compressed 52403321 57603818 0.91
tpch_q03/duckdb:vortex-file-compressed 130722877 144955738 0.90
tpch_q04/duckdb:vortex-file-compressed 🚀 148044616 167175204 0.89
tpch_q05/duckdb:vortex-file-compressed 🚀 129997161 150402568 0.86
tpch_q06/duckdb:vortex-file-compressed 🚀 49310440 54977953 0.90
tpch_q07/duckdb:vortex-file-compressed 146639000 153343931 0.96
tpch_q08/duckdb:vortex-file-compressed 177045653 188982217 0.94
tpch_q09/duckdb:vortex-file-compressed 338116172 360673242 0.94
tpch_q10/duckdb:vortex-file-compressed 156476766 173567200 0.90
tpch_q11/duckdb:vortex-file-compressed 36536938 40137528 0.91
tpch_q12/duckdb:vortex-file-compressed 92908071 102630701 0.91
tpch_q13/duckdb:vortex-file-compressed 249185045 271356438 0.92
tpch_q14/duckdb:vortex-file-compressed 69999064 76717427 0.91
tpch_q15/duckdb:vortex-file-compressed 99196540 109717619 0.90
tpch_q16/duckdb:vortex-file-compressed 80491332 85720481 0.94
tpch_q17/duckdb:vortex-file-compressed 103548672 112437081 0.92
tpch_q18/duckdb:vortex-file-compressed 🚀 283160357 317278504 0.89
tpch_q19/duckdb:vortex-file-compressed 91662775 98877883 0.93
tpch_q20/duckdb:vortex-file-compressed 166974684 183049257 0.91
tpch_q21/duckdb:vortex-file-compressed 🚀 562428775 629279175 0.89
tpch_q22/duckdb:vortex-file-compressed 77388772 83410571 0.93
duckdb / vortex-compact (0.979x ➖, 1↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 230261393 237413327 0.97
tpch_q02/duckdb:vortex-compact 59148897 65173437 0.91
tpch_q03/duckdb:vortex-compact 🚀 141029516 157351699 0.90
tpch_q04/duckdb:vortex-compact 177881003 189391916 0.94
tpch_q05/duckdb:vortex-compact 150119833 159521984 0.94
tpch_q06/duckdb:vortex-compact 85402701 89628897 0.95
tpch_q07/duckdb:vortex-compact 206925916 207323885 1.00
tpch_q08/duckdb:vortex-compact 191763603 194075983 0.99
tpch_q09/duckdb:vortex-compact 368971163 367398501 1.00
tpch_q10/duckdb:vortex-compact 187094119 185717203 1.01
tpch_q11/duckdb:vortex-compact 42378523 42215008 1.00
tpch_q12/duckdb:vortex-compact 207315892 209239812 0.99
tpch_q13/duckdb:vortex-compact 295866591 300217330 0.99
tpch_q14/duckdb:vortex-compact 103780080 104189160 1.00
tpch_q15/duckdb:vortex-compact 119710154 121251147 0.99
tpch_q16/duckdb:vortex-compact 84256450 85767441 0.98
tpch_q17/duckdb:vortex-compact 120658824 119265261 1.01
tpch_q18/duckdb:vortex-compact 294809825 299774963 0.98
tpch_q19/duckdb:vortex-compact 115722692 116240409 1.00
tpch_q20/duckdb:vortex-compact 208804405 208117313 1.00
tpch_q21/duckdb:vortex-compact 637086358 633410600 1.01
tpch_q22/duckdb:vortex-compact 91407550 91662479 1.00
duckdb / parquet (0.944x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 258743192 269962723 0.96
tpch_q02/duckdb:parquet 103945844 109455541 0.95
tpch_q03/duckdb:parquet 217207883 222515543 0.98
tpch_q04/duckdb:parquet 135674019 146802063 0.92
tpch_q05/duckdb:parquet 219078853 234864262 0.93
tpch_q06/duckdb:parquet 65940249 70763937 0.93
tpch_q07/duckdb:parquet 181116002 196211143 0.92
tpch_q08/duckdb:parquet 257277912 277573690 0.93
tpch_q09/duckdb:parquet 460421966 503449622 0.91
tpch_q10/duckdb:parquet 603686508 648278332 0.93
tpch_q11/duckdb:parquet 45980969 46469960 0.99
tpch_q12/duckdb:parquet 124202575 130304095 0.95
tpch_q13/duckdb:parquet 432093432 475169687 0.91
tpch_q14/duckdb:parquet 172520836 183129729 0.94
tpch_q15/duckdb:parquet 98427927 101794398 0.97
tpch_q16/duckdb:parquet 161943227 174604173 0.93
tpch_q17/duckdb:parquet 175818258 183672783 0.96
tpch_q18/duckdb:parquet 352361926 376972331 0.93
tpch_q19/duckdb:parquet 280421239 292079540 0.96
tpch_q20/duckdb:parquet 233992371 233827151 1.00
tpch_q21/duckdb:parquet 573996126 627394409 0.91
tpch_q22/duckdb:parquet 288910508 306941580 0.94
duckdb / duckdb (0.998x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117291509 115440689 1.02
tpch_q02/duckdb:duckdb 45987729 47395206 0.97
tpch_q03/duckdb:duckdb 96079941 97660642 0.98
tpch_q04/duckdb:duckdb 128984790 128537520 1.00
tpch_q05/duckdb:duckdb 107914400 109445742 0.99
tpch_q06/duckdb:duckdb 39452693 38725484 1.02
tpch_q07/duckdb:duckdb 86177191 86081152 1.00
tpch_q08/duckdb:duckdb 110745530 109932330 1.01
tpch_q09/duckdb:duckdb 277007948 274808226 1.01
tpch_q10/duckdb:duckdb 198753699 203704202 0.98
tpch_q11/duckdb:duckdb 15051352 15935606 0.94
tpch_q12/duckdb:duckdb 82538396 83004294 0.99
tpch_q13/duckdb:duckdb 247746413 253483971 0.98
tpch_q14/duckdb:duckdb 69766693 70423346 0.99
tpch_q15/duckdb:duckdb 79865349 76144383 1.05
tpch_q16/duckdb:duckdb 73615727 73242472 1.01
tpch_q17/duckdb:duckdb 84828157 84070307 1.01
tpch_q18/duckdb:duckdb 214694524 212931346 1.01
tpch_q19/duckdb:duckdb 115121025 113260215 1.02
tpch_q20/duckdb:duckdb 111728735 110875352 1.01
tpch_q21/duckdb:duckdb 307144370 304877730 1.01
tpch_q22/duckdb:duckdb 68824133 69635848 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -2.5% -11.6% +10.3% +11.8% ➖ noise
1 datafusion:vortex-compact +0.4% -11.6% +13.5% +13.0% 🚨 regression
1 datafusion:vortex-file-compressed -5.9% -11.6% +6.4% +13.0% ➖ noise
1 duckdb:duckdb +1.6% -11.6% +14.9% +11.8% 🚨 regression
1 duckdb:vortex-compact -3.0% -11.6% +9.7% +11.8% ➖ noise
1 duckdb:vortex-file-compressed -4.7% -11.6% +7.8% +12.5% ➖ noise
2 datafusion:arrow -3.2% -5.0% +1.9% +10.0% ➖ noise
2 datafusion:vortex-compact -8.8% -5.0% -4.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.3% -5.0% +2.8% +10.0% ➖ noise
2 duckdb:duckdb -3.0% -5.0% +2.1% +11.3% ➖ noise
2 duckdb:vortex-compact -9.2% -5.0% -4.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -9.0% -5.0% -4.3% +10.0% ➖ noise
3 datafusion:arrow -1.5% -7.9% +7.0% +10.0% ➖ noise
3 datafusion:vortex-compact -8.9% -7.9% -1.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -5.4% -7.9% +2.7% +10.0% ➖ noise
3 duckdb:duckdb -1.6% -7.9% +6.8% +10.0% ➖ noise
3 duckdb:vortex-compact -10.4% -7.9% -2.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -9.8% -7.9% -2.1% +10.0% ➖ noise
4 datafusion:arrow -1.4% -9.8% +9.4% +10.0% ➖ noise
4 datafusion:vortex-compact -4.6% -9.8% +5.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.2% -9.8% +8.5% +10.0% ➖ noise
4 duckdb:duckdb +0.3% -9.8% +11.3% +10.0% 🚨 regression
4 duckdb:vortex-compact -6.1% -9.8% +4.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -11.4% -9.8% -1.8% +10.0% ➖ noise
5 datafusion:arrow -2.0% -8.9% +7.7% +10.0% ➖ noise
5 datafusion:vortex-compact -8.6% -8.9% +0.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.9% -8.9% +6.7% +10.0% ➖ noise
5 duckdb:duckdb -1.4% -8.9% +8.3% +10.0% ➖ noise
5 duckdb:vortex-compact -5.9% -8.9% +3.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -13.6% -8.9% -5.1% +10.0% ➖ noise
6 datafusion:arrow -2.1% -10.7% +9.7% +10.0% ➖ noise
6 datafusion:vortex-compact -4.2% -10.7% +7.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.5% -10.7% +9.2% +10.0% ➖ noise
6 duckdb:duckdb +1.9% -10.7% +14.1% +15.5% ➖ noise
6 duckdb:vortex-compact -4.7% -10.7% +6.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -10.3% -10.7% +0.4% +13.6% ➖ noise
7 datafusion:arrow -0.7% -10.8% +11.3% +10.0% 🚨 regression
7 datafusion:vortex-compact -8.0% -10.8% +3.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -2.7% -10.8% +9.0% +10.0% ➖ noise
7 duckdb:duckdb +0.1% -10.8% +12.2% +10.0% 🚨 regression
7 duckdb:vortex-compact -0.2% -10.8% +11.9% +10.0% 🚨 regression
7 duckdb:vortex-file-compressed -4.4% -10.8% +7.2% +10.0% ➖ noise
8 datafusion:arrow -3.0% -9.1% +6.6% +10.0% ➖ noise
8 datafusion:vortex-compact -6.7% -9.1% +2.6% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.9% -9.1% +7.9% +10.0% ➖ noise
8 duckdb:duckdb +0.7% -9.1% +10.8% +10.0% 🚨 regression
8 duckdb:vortex-compact -1.2% -9.1% +8.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -6.3% -9.1% +3.0% +10.0% ➖ noise
9 datafusion:arrow -2.1% -11.0% +10.0% +10.0% 🚨 regression
9 datafusion:vortex-compact -8.4% -11.0% +2.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -3.0% -11.0% +9.0% +10.0% ➖ noise
9 duckdb:duckdb +0.8% -11.0% +13.2% +10.0% 🚨 regression
9 duckdb:vortex-compact +0.4% -11.0% +12.8% +10.0% 🚨 regression
9 duckdb:vortex-file-compressed -6.3% -11.0% +5.3% +10.0% ➖ noise
10 datafusion:arrow -2.0% -8.0% +6.5% +10.0% ➖ noise
10 datafusion:vortex-compact -6.4% -8.0% +1.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.4% -8.0% +8.2% +10.0% ➖ noise
10 duckdb:duckdb -2.4% -8.0% +6.1% +10.0% ➖ noise
10 duckdb:vortex-compact +0.7% -8.0% +9.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -9.8% -8.0% -2.0% +10.0% ➖ noise
11 datafusion:arrow -1.6% -5.2% +3.7% +10.0% ➖ noise
11 datafusion:vortex-compact -5.1% -5.2% +0.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.9% -5.2% +4.5% +10.0% ➖ noise
11 duckdb:duckdb -5.5% -5.2% -0.4% +19.1% ➖ noise
11 duckdb:vortex-compact +0.4% -5.2% +5.9% +10.6% ➖ noise
11 duckdb:vortex-file-compressed -9.0% -5.2% -4.0% +12.9% ➖ noise
12 datafusion:arrow +0.2% -6.4% +7.1% +39.6% ➖ noise
12 datafusion:vortex-compact -4.1% -6.4% +2.6% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.5% -6.4% +6.4% +10.0% ➖ noise
12 duckdb:duckdb -0.6% -6.4% +6.3% +10.0% ➖ noise
12 duckdb:vortex-compact -0.9% -6.4% +5.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -9.5% -6.4% -3.2% +10.0% ➖ noise
13 datafusion:arrow +4.1% -5.0% +9.5% +11.9% ➖ noise
13 datafusion:vortex-compact -5.7% -5.0% -0.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.0% -5.0% +5.3% +10.0% ➖ noise
13 duckdb:duckdb -2.3% -5.0% +2.8% +10.0% ➖ noise
13 duckdb:vortex-compact -1.4% -5.0% +3.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -8.2% -5.0% -3.4% +10.0% ➖ noise
14 datafusion:arrow -2.6% -3.8% +1.2% +10.0% ➖ noise
14 datafusion:vortex-compact -6.8% -3.8% -3.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -5.1% -3.8% -1.3% +10.0% ➖ noise
14 duckdb:duckdb -0.9% -3.8% +3.0% +10.0% ➖ noise
14 duckdb:vortex-compact -0.4% -3.8% +3.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -8.8% -3.8% -5.2% +10.0% ➖ noise
15 datafusion:arrow -1.7% -2.1% +0.4% +10.0% ➖ noise
15 datafusion:vortex-compact -5.8% -2.1% -3.8% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.2% -2.1% +3.4% +10.0% ➖ noise
15 duckdb:duckdb +4.9% -2.1% +7.1% +10.0% ➖ noise
15 duckdb:vortex-compact -1.3% -2.1% +0.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -9.6% -2.1% -7.7% +10.0% ➖ noise
16 datafusion:arrow -2.4% -4.6% +2.4% +10.0% ➖ noise
16 datafusion:vortex-compact -8.0% -4.6% -3.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -3.2% -4.6% +1.5% +10.0% ➖ noise
16 duckdb:duckdb +0.5% -4.6% +5.4% +10.0% ➖ noise
16 duckdb:vortex-compact -1.8% -4.6% +3.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -6.1% -4.6% -1.5% +10.0% ➖ noise
17 datafusion:arrow -12.2% -2.8% -9.6% +10.0% ✅ faster
17 datafusion:vortex-compact -9.0% -2.8% -6.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.3% -2.8% +3.2% +10.0% ➖ noise
17 duckdb:duckdb +0.9% -2.8% +3.8% +10.0% ➖ noise
17 duckdb:vortex-compact +1.2% -2.8% +4.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -7.9% -2.8% -5.2% +10.0% ➖ noise
18 datafusion:arrow -17.6% -6.0% -12.3% +10.0% ✅ faster
18 datafusion:vortex-compact -7.2% -6.0% -1.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -1.5% -6.0% +4.7% +20.2% ➖ noise
18 duckdb:duckdb +0.8% -6.0% +7.3% +10.0% ➖ noise
18 duckdb:vortex-compact -1.7% -6.0% +4.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -10.8% -6.0% -5.1% +10.0% ➖ noise
19 datafusion:arrow -16.3% -1.4% -15.2% +10.0% ✅ faster
19 datafusion:vortex-compact -2.6% -1.4% -1.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +0.7% -1.4% +2.1% +10.5% ➖ noise
19 duckdb:duckdb +1.6% -1.4% +3.1% +10.0% ➖ noise
19 duckdb:vortex-compact -0.4% -1.4% +0.9% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -7.3% -1.4% -6.0% +10.0% ➖ noise
20 datafusion:arrow -16.0% -2.5% -13.8% +10.0% ✅ faster
20 datafusion:vortex-compact -4.4% -2.5% -1.9% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.5% -2.5% +1.0% +10.0% ➖ noise
20 duckdb:duckdb +0.8% -2.5% +3.4% +10.0% ➖ noise
20 duckdb:vortex-compact +0.3% -2.5% +2.9% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -8.8% -2.5% -6.4% +10.0% ➖ noise
21 datafusion:arrow -20.1% -6.8% -14.3% +10.0% ✅ faster
21 datafusion:vortex-compact -5.4% -6.8% +1.4% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -5.7% -6.8% +1.1% +10.0% ➖ noise
21 duckdb:duckdb +0.7% -6.8% +8.1% +10.0% ➖ noise
21 duckdb:vortex-compact +0.6% -6.8% +7.9% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -10.6% -6.8% -4.1% +10.0% ➖ noise
22 datafusion:arrow -17.3% -3.9% -14.0% +10.0% ✅ faster
22 datafusion:vortex-compact -4.4% -3.9% -0.5% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -5.7% -3.9% -1.9% +10.0% ➖ noise
22 duckdb:duckdb -1.2% -3.9% +2.8% +13.4% ➖ noise
22 duckdb:vortex-compact -0.3% -3.9% +3.7% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -7.2% -3.9% -3.5% +10.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.1%
Vortex (geomean): 1.030x ➖
Parquet (geomean): 1.052x ➖
Shifts: Parquet (control) +5.2% · Median polish +6.9%


datafusion / vortex-file-compressed (0.908x ➖, 5↑ 1↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 201062541 387767824 0.52
tpch_q02/datafusion:vortex-file-compressed 🚀 437844503 682488227 0.64
tpch_q03/datafusion:vortex-file-compressed 🚀 317839443 587633013 0.54
tpch_q04/datafusion:vortex-file-compressed 223541069 286734955 0.78
tpch_q05/datafusion:vortex-file-compressed 461420228 555383171 0.83
tpch_q06/datafusion:vortex-file-compressed 395402894 425247715 0.93
tpch_q07/datafusion:vortex-file-compressed 🚀 450111739 690361761 0.65
tpch_q08/datafusion:vortex-file-compressed 729697805 666664363 1.09
tpch_q09/datafusion:vortex-file-compressed 🚨 659430419 505420893 1.30
tpch_q10/datafusion:vortex-file-compressed 686677313 587200969 1.17
tpch_q11/datafusion:vortex-file-compressed 408163359 432100192 0.94
tpch_q12/datafusion:vortex-file-compressed 584433931 472693357 1.24
tpch_q13/datafusion:vortex-file-compressed 282997104 235703213 1.20
tpch_q14/datafusion:vortex-file-compressed 264603041 265101945 1.00
tpch_q15/datafusion:vortex-file-compressed 375060572 378238717 0.99
tpch_q16/datafusion:vortex-file-compressed 187241884 223386168 0.84
tpch_q17/datafusion:vortex-file-compressed 337780467 338015673 1.00
tpch_q18/datafusion:vortex-file-compressed 370256796 341520247 1.08
tpch_q19/datafusion:vortex-file-compressed 528143757 434432253 1.22
tpch_q20/datafusion:vortex-file-compressed 546128233 501813007 1.09
tpch_q21/datafusion:vortex-file-compressed 574679796 628216834 0.91
tpch_q22/datafusion:vortex-file-compressed 🚀 181184641 271982298 0.67
datafusion / vortex-compact (1.208x ➖, 0↑ 7↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 216445277 247275982 0.88
tpch_q02/datafusion:vortex-compact 🚨 755238992 517618092 1.46
tpch_q03/datafusion:vortex-compact 366193016 300369202 1.22
tpch_q04/datafusion:vortex-compact 🚨 284712431 217546639 1.31
tpch_q05/datafusion:vortex-compact 🚨 577169195 442698342 1.30
tpch_q06/datafusion:vortex-compact 468245921 391745783 1.20
tpch_q07/datafusion:vortex-compact 537968250 574758780 0.94
tpch_q08/datafusion:vortex-compact 688425570 552670128 1.25
tpch_q09/datafusion:vortex-compact 571975409 457849638 1.25
tpch_q10/datafusion:vortex-compact 584872442 534354570 1.09
tpch_q11/datafusion:vortex-compact 333217902 380605917 0.88
tpch_q12/datafusion:vortex-compact 613405530 475597801 1.29
tpch_q13/datafusion:vortex-compact 🚨 339005282 217935261 1.56
tpch_q14/datafusion:vortex-compact 339094259 284156700 1.19
tpch_q15/datafusion:vortex-compact 🚨 771058756 503584119 1.53
tpch_q16/datafusion:vortex-compact 🚨 308952550 226832334 1.36
tpch_q17/datafusion:vortex-compact 422969863 326259363 1.30
tpch_q18/datafusion:vortex-compact 413442125 339374232 1.22
tpch_q19/datafusion:vortex-compact 450832423 396377994 1.14
tpch_q20/datafusion:vortex-compact 509067191 474541518 1.07
tpch_q21/datafusion:vortex-compact 586393601 512810630 1.14
tpch_q22/datafusion:vortex-compact 🚨 162817721 125159779 1.30
datafusion / parquet (1.041x ➖, 0↑ 1↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 241142593 226369543 1.07
tpch_q02/datafusion:parquet 420224329 438311304 0.96
tpch_q03/datafusion:parquet 361506264 395162875 0.91
tpch_q04/datafusion:parquet 198025324 175400901 1.13
tpch_q05/datafusion:parquet 569383721 537506679 1.06
tpch_q06/datafusion:parquet 144272023 152120602 0.95
tpch_q07/datafusion:parquet 593602712 542170820 1.09
tpch_q08/datafusion:parquet 608733548 616441529 0.99
tpch_q09/datafusion:parquet 530218035 551870548 0.96
tpch_q10/datafusion:parquet 595568054 572036859 1.04
tpch_q11/datafusion:parquet 341153416 421474449 0.81
tpch_q12/datafusion:parquet 275167081 260966520 1.05
tpch_q13/datafusion:parquet 432992127 439055245 0.99
tpch_q14/datafusion:parquet 231354033 216508106 1.07
tpch_q15/datafusion:parquet 362674779 301635343 1.20
tpch_q16/datafusion:parquet 179194823 182570459 0.98
tpch_q17/datafusion:parquet 430976217 394989864 1.09
tpch_q18/datafusion:parquet 529415634 505381330 1.05
tpch_q19/datafusion:parquet 🚨 477730290 365512446 1.31
tpch_q20/datafusion:parquet 443375648 398555159 1.11
tpch_q21/datafusion:parquet 665353093 574284564 1.16
tpch_q22/datafusion:parquet 166135909 161317575 1.03
duckdb / vortex-file-compressed (1.049x ➖, 0↑ 2↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 287369754 235386246 1.22
tpch_q02/duckdb:vortex-file-compressed 1146387859 1063184792 1.08
tpch_q03/duckdb:vortex-file-compressed 🚨 730013953 552115108 1.32
tpch_q04/duckdb:vortex-file-compressed 439885483 377863623 1.16
tpch_q05/duckdb:vortex-file-compressed 966006046 977665479 0.99
tpch_q06/duckdb:vortex-file-compressed 474506655 514825226 0.92
tpch_q07/duckdb:vortex-file-compressed 999169564 806940798 1.24
tpch_q08/duckdb:vortex-file-compressed 1062947321 979267578 1.09
tpch_q09/duckdb:vortex-file-compressed 1060430274 918246496 1.15
tpch_q10/duckdb:vortex-file-compressed 852852503 715351374 1.19
tpch_q11/duckdb:vortex-file-compressed 532364311 550686468 0.97
tpch_q12/duckdb:vortex-file-compressed 518023504 664939183 0.78
tpch_q13/duckdb:vortex-file-compressed 509386118 484195866 1.05
tpch_q14/duckdb:vortex-file-compressed 502063455 545864086 0.92
tpch_q15/duckdb:vortex-file-compressed 317211299 290386452 1.09
tpch_q16/duckdb:vortex-file-compressed 330532055 350280817 0.94
tpch_q17/duckdb:vortex-file-compressed 665505847 662752789 1.00
tpch_q18/duckdb:vortex-file-compressed 577784388 688804843 0.84
tpch_q19/duckdb:vortex-file-compressed 429733569 464143932 0.93
tpch_q20/duckdb:vortex-file-compressed 878701777 821073829 1.07
tpch_q21/duckdb:vortex-file-compressed 🚨 1344390446 1000395176 1.34
tpch_q22/duckdb:vortex-file-compressed 358566352 361038165 0.99
duckdb / vortex-compact (0.980x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 294044195 383237160 0.77
tpch_q02/duckdb:vortex-compact 902310166 961818080 0.94
tpch_q03/duckdb:vortex-compact 501600421 545026098 0.92
tpch_q04/duckdb:vortex-compact 353023302 348888294 1.01
tpch_q05/duckdb:vortex-compact 847379230 786305734 1.08
tpch_q06/duckdb:vortex-compact 364483301 385307908 0.95
tpch_q07/duckdb:vortex-compact 693411667 703780581 0.99
tpch_q08/duckdb:vortex-compact 830052738 880171731 0.94
tpch_q09/duckdb:vortex-compact 912048146 910947761 1.00
tpch_q10/duckdb:vortex-compact 655689179 648303325 1.01
tpch_q11/duckdb:vortex-compact 482436167 562651271 0.86
tpch_q12/duckdb:vortex-compact 448495322 435092343 1.03
tpch_q13/duckdb:vortex-compact 439713009 456825820 0.96
tpch_q14/duckdb:vortex-compact 488811693 478427968 1.02
tpch_q15/duckdb:vortex-compact 275925233 306375005 0.90
tpch_q16/duckdb:vortex-compact 338141709 303669536 1.11
tpch_q17/duckdb:vortex-compact 621294403 620437295 1.00
tpch_q18/duckdb:vortex-compact 520584286 501263419 1.04
tpch_q19/duckdb:vortex-compact 437118869 441084767 0.99
tpch_q20/duckdb:vortex-compact 757934820 751548473 1.01
tpch_q21/duckdb:vortex-compact 1234386768 1058468348 1.17
tpch_q22/duckdb:vortex-compact 334572431 357011549 0.94
duckdb / parquet (1.064x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 560848319 474783465 1.18
tpch_q02/duckdb:parquet 1358726055 1261444235 1.08
tpch_q03/duckdb:parquet 1094747300 1104245430 0.99
tpch_q04/duckdb:parquet 658866980 652651079 1.01
tpch_q05/duckdb:parquet 1555755297 1516291749 1.03
tpch_q06/duckdb:parquet 459044037 408193033 1.12
tpch_q07/duckdb:parquet 1518396998 1258982265 1.21
tpch_q08/duckdb:parquet 1811165918 1659192594 1.09
tpch_q09/duckdb:parquet 1403607169 1586947844 0.88
tpch_q10/duckdb:parquet 1338385974 1394245772 0.96
tpch_q11/duckdb:parquet 873450032 833478160 1.05
tpch_q12/duckdb:parquet 773419694 632208314 1.22
tpch_q13/duckdb:parquet 943562037 901760825 1.05
tpch_q14/duckdb:parquet 672824463 697331727 0.96
tpch_q15/duckdb:parquet 584891340 489380727 1.20
tpch_q16/duckdb:parquet 578965068 585373053 0.99
tpch_q17/duckdb:parquet 863602715 831744441 1.04
tpch_q18/duckdb:parquet 874278482 756543518 1.16
tpch_q19/duckdb:parquet 914986720 749561297 1.22
tpch_q20/duckdb:parquet 1070908105 1046011409 1.02
tpch_q21/duckdb:parquet 1103582394 1098481725 1.00
tpch_q22/duckdb:parquet 547748785 527972048 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -12.5% +12.2% -22.0% +160.8% ➖ noise
1 datafusion:vortex-file-compressed -48.1% +12.2% -53.8% +137.5% ➖ noise
1 duckdb:vortex-compact -23.3% +12.2% -31.6% +100.8% ➖ noise
1 duckdb:vortex-file-compressed +22.1% +12.2% +8.8% +49.6% ➖ noise
2 datafusion:vortex-compact +45.9% +1.6% +43.6% +32.8% 🚨 regression
2 datafusion:vortex-file-compressed -35.8% +1.6% -36.9% +39.1% ✅ faster
2 duckdb:vortex-compact -6.2% +1.6% -7.7% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +7.8% +1.6% +6.1% +30.8% ➖ noise
3 datafusion:vortex-compact +21.9% -4.8% +28.0% +74.7% ➖ noise
3 datafusion:vortex-file-compressed -45.9% -4.8% -43.2% +104.0% ➖ noise
3 duckdb:vortex-compact -8.0% -4.8% -3.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +32.2% -4.8% +38.8% +38.7% 🚨 regression
4 datafusion:vortex-compact +30.9% +6.8% +22.6% +71.5% ➖ noise
4 datafusion:vortex-file-compressed -22.0% +6.8% -27.0% +50.6% ➖ noise
4 duckdb:vortex-compact +1.2% +6.8% -5.2% +44.8% ➖ noise
4 duckdb:vortex-file-compressed +16.4% +6.8% +9.0% +37.9% ➖ noise
5 datafusion:vortex-compact +30.4% +4.3% +25.1% +44.2% ➖ noise
5 datafusion:vortex-file-compressed -16.9% +4.3% -20.3% +42.5% ➖ noise
5 duckdb:vortex-compact +7.8% +4.3% +3.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -1.2% +4.3% -5.2% +30.0% ➖ noise
6 datafusion:vortex-compact +19.5% +3.3% +15.7% +53.6% ➖ noise
6 datafusion:vortex-file-compressed -7.0% +3.3% -10.0% +48.4% ➖ noise
6 duckdb:vortex-compact -5.4% +3.3% -8.4% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -7.8% +3.3% -10.8% +52.0% ➖ noise
7 datafusion:vortex-compact -6.4% +14.9% -18.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -34.8% +14.9% -43.3% +44.6% ✅ faster
7 duckdb:vortex-compact -1.5% +14.9% -14.3% +42.9% ➖ noise
7 duckdb:vortex-file-compressed +23.8% +14.9% +7.8% +30.0% ➖ noise
8 datafusion:vortex-compact +24.6% +3.8% +20.0% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +9.5% +3.8% +5.4% +30.0% ➖ noise
8 duckdb:vortex-compact -5.7% +3.8% -9.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +8.5% +3.8% +4.5% +33.0% ➖ noise
9 datafusion:vortex-compact +24.9% -7.8% +35.5% +30.7% 🚨 regression
9 datafusion:vortex-file-compressed +30.5% -7.8% +41.5% +30.0% 🚨 regression
9 duckdb:vortex-compact +0.1% -7.8% +8.6% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +15.5% -7.8% +25.3% +36.2% ➖ noise
10 datafusion:vortex-compact +9.5% -0.0% +9.5% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +16.9% -0.0% +17.0% +32.5% ➖ noise
10 duckdb:vortex-compact +1.1% -0.0% +1.2% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +19.2% -0.0% +19.3% +30.0% ➖ noise
11 datafusion:vortex-compact -12.5% -7.9% -4.9% +34.0% ➖ noise
11 datafusion:vortex-file-compressed -5.5% -7.9% +2.6% +30.0% ➖ noise
11 duckdb:vortex-compact -14.3% -7.9% -6.9% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -3.3% -7.9% +5.0% +30.0% ➖ noise
12 datafusion:vortex-compact +29.0% +13.6% +13.6% +36.7% ➖ noise
12 datafusion:vortex-file-compressed +23.6% +13.6% +8.9% +41.9% ➖ noise
12 duckdb:vortex-compact +3.1% +13.6% -9.2% +53.2% ➖ noise
12 duckdb:vortex-file-compressed -22.1% +13.6% -31.4% +55.2% ➖ noise
13 datafusion:vortex-compact +55.6% +1.6% +53.1% +54.2% ➖ noise
13 datafusion:vortex-file-compressed +20.1% +1.6% +18.2% +39.2% ➖ noise
13 duckdb:vortex-compact -3.7% +1.6% -5.2% +33.5% ➖ noise
13 duckdb:vortex-file-compressed +5.2% +1.6% +3.6% +36.1% ➖ noise
14 datafusion:vortex-compact +19.3% +1.5% +17.5% +35.1% ➖ noise
14 datafusion:vortex-file-compressed -0.2% +1.5% -1.7% +30.0% ➖ noise
14 duckdb:vortex-compact +2.2% +1.5% +0.6% +34.8% ➖ noise
14 duckdb:vortex-file-compressed -8.0% +1.5% -9.4% +30.0% ➖ noise
15 datafusion:vortex-compact +53.1% +19.9% +27.7% +35.0% ➖ noise
15 datafusion:vortex-file-compressed -0.8% +19.9% -17.3% +30.0% ➖ noise
15 duckdb:vortex-compact -9.9% +19.9% -24.9% +30.0% ✅ faster
15 duckdb:vortex-file-compressed +9.2% +19.9% -8.9% +30.0% ➖ noise
16 datafusion:vortex-compact +36.2% -1.5% +38.2% +30.0% 🚨 regression
16 datafusion:vortex-file-compressed -16.2% -1.5% -14.9% +32.6% ➖ noise
16 duckdb:vortex-compact +11.4% -1.5% +13.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -5.6% -1.5% -4.2% +30.0% ➖ noise
17 datafusion:vortex-compact +29.6% +6.4% +21.8% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -0.1% +6.4% -6.1% +33.7% ➖ noise
17 duckdb:vortex-compact +0.1% +6.4% -5.9% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +0.4% +6.4% -5.7% +30.0% ➖ noise
18 datafusion:vortex-compact +21.8% +10.0% +10.7% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +8.4% +10.0% -1.5% +31.8% ➖ noise
18 duckdb:vortex-compact +3.9% +10.0% -5.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -16.1% +10.0% -23.8% +30.0% ✅ faster
19 datafusion:vortex-compact +13.7% +26.3% -10.0% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +21.6% +26.3% -3.8% +36.6% ➖ noise
19 duckdb:vortex-compact -0.9% +26.3% -21.5% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -7.4% +26.3% -26.7% +32.1% ✅ faster
20 datafusion:vortex-compact +7.3% +6.7% +0.5% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +8.8% +6.7% +2.0% +36.0% ➖ noise
20 duckdb:vortex-compact +0.8% +6.7% -5.5% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +7.0% +6.7% +0.3% +36.6% ➖ noise
21 datafusion:vortex-compact +14.3% +7.9% +6.0% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -8.5% +7.9% -15.2% +30.0% ➖ noise
21 duckdb:vortex-compact +16.6% +7.9% +8.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +34.4% +7.9% +24.6% +30.1% ➖ noise
22 datafusion:vortex-compact +30.1% +3.4% +25.9% +30.7% ➖ noise
22 datafusion:vortex-file-compressed -33.4% +3.4% -35.6% +43.9% ✅ faster
22 duckdb:vortex-compact -6.3% +3.4% -9.3% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -0.7% +3.4% -3.9% +30.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.3%
Vortex (geomean): 1.000x ➖
Parquet (geomean): 1.023x ➖
Shifts: Parquet (control) +2.3% · Median polish -0.5%


datafusion / vortex-file-compressed (1.054x ➖, 0↑ 1↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 32032459 31476381 1.02
fineweb_q01/datafusion:vortex-file-compressed 622983459 619948733 1.00
fineweb_q02/datafusion:vortex-file-compressed 512304157 505647709 1.01
fineweb_q03/datafusion:vortex-file-compressed 1473834408 1375935960 1.07
fineweb_q04/datafusion:vortex-file-compressed 1401331812 1410001570 0.99
fineweb_q05/datafusion:vortex-file-compressed 1363166696 1392233400 0.98
fineweb_q06/datafusion:vortex-file-compressed 1579583358 1580803391 1.00
fineweb_q07/datafusion:vortex-file-compressed 1434793500 1386136197 1.04
fineweb_q08/datafusion:vortex-file-compressed 🚨 798401464 555818505 1.44
datafusion / vortex-compact (1.023x ➖, 0↑ 1↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 31575910 33727049 0.94
fineweb_q01/datafusion:vortex-compact 542270930 606410591 0.89
fineweb_q02/datafusion:vortex-compact 638424595 683092061 0.93
fineweb_q03/datafusion:vortex-compact 1913986824 1846333687 1.04
fineweb_q04/datafusion:vortex-compact 2278663089 2250158054 1.01
fineweb_q05/datafusion:vortex-compact 1739598078 1743563611 1.00
fineweb_q06/datafusion:vortex-compact 🚨 1955804613 1409055049 1.39
fineweb_q07/datafusion:vortex-compact 1329326238 1352516461 0.98
fineweb_q08/datafusion:vortex-compact 433322336 394881046 1.10
datafusion / parquet (1.050x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1370270427 1081300218 1.27
fineweb_q01/datafusion:parquet 1998630495 2005492447 1.00
fineweb_q02/datafusion:parquet 2032245564 1845992459 1.10
fineweb_q03/datafusion:parquet 1942398528 1904107315 1.02
fineweb_q04/datafusion:parquet 2002660075 2110339677 0.95
fineweb_q05/datafusion:parquet 1883110771 1816476647 1.04
fineweb_q06/datafusion:parquet 1853499229 1948346580 0.95
fineweb_q07/datafusion:parquet 1965366294 1867277259 1.05
fineweb_q08/datafusion:parquet 2119783308 1911449403 1.11
duckdb / vortex-file-compressed (0.939x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 100592992 121096005 0.83
fineweb_q01/duckdb:vortex-file-compressed 535554283 580585440 0.92
fineweb_q02/duckdb:vortex-file-compressed 441068392 436151938 1.01
fineweb_q03/duckdb:vortex-file-compressed 1572103409 1524659686 1.03
fineweb_q04/duckdb:vortex-file-compressed 1589096143 1631399237 0.97
fineweb_q05/duckdb:vortex-file-compressed 1548761576 1563671233 0.99
fineweb_q06/duckdb:vortex-file-compressed 1668727143 1780124937 0.94
fineweb_q07/duckdb:vortex-file-compressed 1508425286 1708248559 0.88
fineweb_q08/duckdb:vortex-file-compressed 625436495 700360876 0.89
duckdb / vortex-compact (0.987x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 85214906 107622039 0.79
fineweb_q01/duckdb:vortex-compact 584535096 512685966 1.14
fineweb_q02/duckdb:vortex-compact 643145188 625649076 1.03
fineweb_q03/duckdb:vortex-compact 1663277713 1679511539 0.99
fineweb_q04/duckdb:vortex-compact 1752710784 1792165012 0.98
fineweb_q05/duckdb:vortex-compact 1513195790 1646968899 0.92
fineweb_q06/duckdb:vortex-compact 1491084396 1551403690 0.96
fineweb_q07/duckdb:vortex-compact 1363364729 1427561351 0.96
fineweb_q08/duckdb:vortex-compact 567579998 484931421 1.17
duckdb / parquet (0.997x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1117463802 1122539348 1.00
fineweb_q01/duckdb:parquet 1617699755 1659470458 0.97
fineweb_q02/duckdb:parquet 1634607627 1632733938 1.00
fineweb_q03/duckdb:parquet 4160849488 4161701287 1.00
fineweb_q04/duckdb:parquet 2013592071 1906504077 1.06
fineweb_q05/duckdb:parquet 2770117679 2854323237 0.97
fineweb_q06/duckdb:parquet 3302537855 3419312003 0.97
fineweb_q07/duckdb:parquet 4314961196 4013858147 1.08
fineweb_q08/duckdb:parquet 1045994312 1110949752 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -6.4% +12.3% -16.6% +203.8% ➖ noise
0 datafusion:vortex-file-compressed +1.8% +12.3% -9.4% +316.2% ➖ noise
0 duckdb:vortex-compact -20.8% +12.3% -29.5% +48.9% ➖ noise
0 duckdb:vortex-file-compressed -16.9% +12.3% -26.0% +52.2% ➖ noise
1 datafusion:vortex-compact -10.6% -1.4% -9.3% +57.7% ➖ noise
1 datafusion:vortex-file-compressed +0.5% -1.4% +2.0% +54.0% ➖ noise
1 duckdb:vortex-compact +14.0% -1.4% +15.7% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -7.8% -1.4% -6.4% +30.0% ➖ noise
2 datafusion:vortex-compact -6.5% +5.0% -11.0% +31.9% ➖ noise
2 datafusion:vortex-file-compressed +1.3% +5.0% -3.5% +31.8% ➖ noise
2 duckdb:vortex-compact +2.8% +5.0% -2.1% +32.8% ➖ noise
2 duckdb:vortex-file-compressed +1.1% +5.0% -3.7% +30.0% ➖ noise
3 datafusion:vortex-compact +3.7% +1.0% +2.6% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +7.1% +1.0% +6.1% +30.0% ➖ noise
3 duckdb:vortex-compact -1.0% +1.0% -1.9% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +3.1% +1.0% +2.1% +30.0% ➖ noise
4 datafusion:vortex-compact +1.3% +0.1% +1.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.6% +0.1% -0.7% +30.0% ➖ noise
4 duckdb:vortex-compact -2.2% +0.1% -2.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -2.6% +0.1% -2.7% +30.0% ➖ noise
5 datafusion:vortex-compact -0.2% +0.3% -0.5% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -2.1% +0.3% -2.4% +30.0% ➖ noise
5 duckdb:vortex-compact -8.1% +0.3% -8.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -1.0% +0.3% -1.3% +30.0% ➖ noise
6 datafusion:vortex-compact +38.8% -4.1% +44.8% +30.0% 🚨 regression
6 datafusion:vortex-file-compressed -0.1% -4.1% +4.2% +30.0% ➖ noise
6 duckdb:vortex-compact -3.9% -4.1% +0.3% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -6.3% -4.1% -2.2% +30.0% ➖ noise
7 datafusion:vortex-compact -1.7% +6.4% -7.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +3.5% +6.4% -2.7% +30.0% ➖ noise
7 duckdb:vortex-compact -4.5% +6.4% -10.2% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -11.7% +6.4% -17.0% +30.0% ➖ noise
8 datafusion:vortex-compact +9.7% +2.2% +7.4% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +43.6% +2.2% +40.6% +30.0% 🚨 regression
8 duckdb:vortex-compact +17.0% +2.2% +14.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -10.7% +2.2% -12.6% +30.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: Random Access

Vortex (geomean): 0.931x ➖
Parquet (geomean): 1.059x ➖


unknown / unknown (1.001x ➖, 6↑ 15↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 3122702 3378656 0.92
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1546696 1632860 0.95
random-access/feature-vectors/correlated/parquet-tokio-local-disk 14033768371 14323988952 0.98
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 14044407114 13651581772 1.03
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚨 8654661 7592617 1.14
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6933012 6385543 1.09
random-access/feature-vectors/uniform/lance-tokio-local-disk 1854181 1933554 0.96
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2951572 2963473 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk 13665698692 13637455038 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 14139036858 13718370581 1.03
random-access/feature-vectors/uniform/vortex-tokio-local-disk 14362312 15880164 0.90
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 14420043 15925479 0.91
random-access/lance-tokio-local-disk 748017 746478 1.00
random-access/lance-tokio-local-disk-footer 1341498 1367163 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk 🚨 309939 274424 1.13
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚨 910106 767554 1.19
random-access/nested-lists/correlated/parquet-tokio-local-disk 174742494 172863505 1.01
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 174300489 171180122 1.02
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚨 802903 705253 1.14
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 804449 704505 1.14
random-access/nested-lists/uniform/lance-tokio-local-disk 1312471 1252247 1.05
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 🚨 1912137 1675208 1.14
random-access/nested-lists/uniform/parquet-tokio-local-disk 176777562 169070903 1.05
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 179106945 163398529 1.10
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚨 2687854 2322475 1.16
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2635308 2564851 1.03
random-access/nested-structs/correlated/lance-tokio-local-disk 465714 433614 1.07
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 698061 642154 1.09
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 31763381 24830523 1.28
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 30595177 24808684 1.23
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚨 1060350 831989 1.27
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 1088715 924901 1.18
random-access/nested-structs/uniform/lance-tokio-local-disk 2911375 2762796 1.05
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3098430 3004684 1.03
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 31999924 25525874 1.25
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 31746416 24963411 1.27
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚨 2119450 1807471 1.17
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚨 1944208 1765157 1.10
random-access/parquet-tokio-local-disk 185961382 187944122 0.99
random-access/parquet-tokio-local-disk-footer 182213039 188124761 0.97
random-access/taxi/correlated/lance-tokio-local-disk 958400 973100 0.98
random-access/taxi/correlated/lance-tokio-local-disk-footer 1633307 1716074 0.95
random-access/taxi/correlated/parquet-tokio-local-disk 273861614 280052085 0.98
random-access/taxi/correlated/parquet-tokio-local-disk-footer 275933188 281320742 0.98
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1701032 2822371 0.60
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1717713 2736761 0.63
random-access/taxi/uniform/lance-tokio-local-disk 8522705 9077905 0.94
random-access/taxi/uniform/lance-tokio-local-disk-footer 9142077 9863676 0.93
random-access/taxi/uniform/parquet-tokio-local-disk 295496689 297544665 0.99
random-access/taxi/uniform/parquet-tokio-local-disk-footer 295841133 298320570 0.99
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4278508 5574434 0.77
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4345661 5381129 0.81
random-access/vortex-tokio-local-disk 🚀 1191014 1890386 0.63
random-access/vortex-tokio-local-disk-footer 🚀 1189950 1941007 0.61

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 0.999x ➖
Parquet (geomean): 1.008x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.8%


duckdb / vortex-file-compressed (1.017x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11205276 10910796 1.03
statpopgen_q01/duckdb:vortex-file-compressed 27012572 26798142 1.01
statpopgen_q02/duckdb:vortex-file-compressed 1306035294 1278342881 1.02
statpopgen_q03/duckdb:vortex-file-compressed 3101644344 3065489020 1.01
statpopgen_q04/duckdb:vortex-file-compressed 3176837164 3041259601 1.04
statpopgen_q05/duckdb:vortex-file-compressed 1394550567 1352248783 1.03
statpopgen_q06/duckdb:vortex-file-compressed 2049001609 2037776991 1.01
statpopgen_q07/duckdb:vortex-file-compressed 200611093 197927591 1.01
statpopgen_q08/duckdb:vortex-file-compressed 212501499 210758902 1.01
statpopgen_q09/duckdb:vortex-file-compressed 2887562223 2830606870 1.02
statpopgen_q10/duckdb:vortex-file-compressed 4596654833 4604392630 1.00
duckdb / vortex-compact (0.980x ➖, 1↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10973493 10603759 1.03
statpopgen_q01/duckdb:vortex-compact 🚀 124414884 168583645 0.74
statpopgen_q02/duckdb:vortex-compact 1828594468 1799826247 1.02
statpopgen_q03/duckdb:vortex-compact 3527154851 3482279792 1.01
statpopgen_q04/duckdb:vortex-compact 3561093273 3472636074 1.03
statpopgen_q05/duckdb:vortex-compact 1852881485 1848151081 1.00
statpopgen_q06/duckdb:vortex-compact 2684774704 2662627997 1.01
statpopgen_q07/duckdb:vortex-compact 947826495 961884690 0.99
statpopgen_q08/duckdb:vortex-compact 993985237 1009281077 0.98
statpopgen_q09/duckdb:vortex-compact 3360922403 3351140168 1.00
statpopgen_q10/duckdb:vortex-compact 5402053000 5329687510 1.01
duckdb / parquet (1.008x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 320290313 312622369 1.02
statpopgen_q01/duckdb:parquet 405945192 392125399 1.04
statpopgen_q02/duckdb:parquet 996799970 994823626 1.00
statpopgen_q03/duckdb:parquet 1510514695 1503526594 1.00
statpopgen_q04/duckdb:parquet 1512020068 1511597194 1.00
statpopgen_q05/duckdb:parquet 1005164226 1003399349 1.00
statpopgen_q06/duckdb:parquet 1482997722 1478612771 1.00
statpopgen_q07/duckdb:parquet 1902863058 1867398904 1.02
statpopgen_q08/duckdb:parquet 1901444288 1880768588 1.01
statpopgen_q09/duckdb:parquet 1377422527 1388537596 0.99
statpopgen_q10/duckdb:parquet 2662363170 2670087198 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +3.5% +2.5% +1.0% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +2.7% +2.5% +0.2% +10.0% ➖ noise
1 duckdb:vortex-compact -26.2% +3.5% -28.7% +20.8% ✅ faster
1 duckdb:vortex-file-compressed +0.8% +3.5% -2.6% +271.7% ➖ noise
2 duckdb:vortex-compact +1.6% +0.2% +1.4% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +2.2% +0.2% +2.0% +10.0% ➖ noise
3 duckdb:vortex-compact +1.3% +0.5% +0.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.2% +0.5% +0.7% +10.0% ➖ noise
4 duckdb:vortex-compact +2.5% +0.0% +2.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +4.5% +0.0% +4.4% +10.0% ➖ noise
5 duckdb:vortex-compact +0.3% +0.2% +0.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.1% +0.2% +2.9% +10.0% ➖ noise
6 duckdb:vortex-compact +0.8% +0.3% +0.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.6% +0.3% +0.3% +10.0% ➖ noise
7 duckdb:vortex-compact -1.5% +1.9% -3.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.4% +1.9% -0.5% +10.0% ➖ noise
8 duckdb:vortex-compact -1.5% +1.1% -2.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.8% +1.1% -0.3% +10.0% ➖ noise
9 duckdb:vortex-compact +0.3% -0.8% +1.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.0% -0.8% +2.8% +10.0% ➖ noise
10 duckdb:vortex-compact +1.4% -0.3% +1.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.2% -0.3% +0.1% +10.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.1%
Vortex (geomean): 0.969x ➖
Parquet (geomean): 1.032x ➖
Shifts: Parquet (control) +3.2% · Median polish -4.3%


datafusion / vortex-file-compressed (0.933x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 752172480 800005942 0.94
tpch_q02/datafusion:vortex-file-compressed 866906401 924689460 0.94
tpch_q03/datafusion:vortex-file-compressed 873576317 1192806316 0.73
tpch_q04/datafusion:vortex-file-compressed 631723240 848574692 0.74
tpch_q05/datafusion:vortex-file-compressed 1233919056 1552025201 0.80
tpch_q06/datafusion:vortex-file-compressed 670974786 627853972 1.07
tpch_q07/datafusion:vortex-file-compressed 1354856186 1441984709 0.94
tpch_q08/datafusion:vortex-file-compressed 1278485346 1425073594 0.90
tpch_q09/datafusion:vortex-file-compressed 1541363981 1703835944 0.90
tpch_q10/datafusion:vortex-file-compressed 1043922122 1051417446 0.99
tpch_q11/datafusion:vortex-file-compressed 509988273 530918723 0.96
tpch_q12/datafusion:vortex-file-compressed 908430196 1011623248 0.90
tpch_q13/datafusion:vortex-file-compressed 443834240 524323543 0.85
tpch_q14/datafusion:vortex-file-compressed 599980112 587245581 1.02
tpch_q15/datafusion:vortex-file-compressed 1435693536 1218420958 1.18
tpch_q16/datafusion:vortex-file-compressed 324182341 316791734 1.02
tpch_q17/datafusion:vortex-file-compressed 1274306161 1363986164 0.93
tpch_q18/datafusion:vortex-file-compressed 1391712555 1414187652 0.98
tpch_q19/datafusion:vortex-file-compressed 857393413 740104306 1.16
tpch_q20/datafusion:vortex-file-compressed 1035760669 961329508 1.08
tpch_q21/datafusion:vortex-file-compressed 1719241380 1809285505 0.95
tpch_q22/datafusion:vortex-file-compressed 439469133 612233904 0.72
datafusion / vortex-compact (0.995x ➖, 0↑ 2↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 802112531 793582513 1.01
tpch_q02/datafusion:vortex-compact 943189679 824272108 1.14
tpch_q03/datafusion:vortex-compact 1038545607 1146510454 0.91
tpch_q04/datafusion:vortex-compact 624442855 643508592 0.97
tpch_q05/datafusion:vortex-compact 1066950780 1358627236 0.79
tpch_q06/datafusion:vortex-compact 618186117 663936077 0.93
tpch_q07/datafusion:vortex-compact 1157840090 1558386483 0.74
tpch_q08/datafusion:vortex-compact 1250943202 1316005806 0.95
tpch_q09/datafusion:vortex-compact 1479756276 1537305929 0.96
tpch_q10/datafusion:vortex-compact 1207954800 1015117439 1.19
tpch_q11/datafusion:vortex-compact 🚨 622142738 428427608 1.45
tpch_q12/datafusion:vortex-compact 850436752 892053491 0.95
tpch_q13/datafusion:vortex-compact 401152035 484674746 0.83
tpch_q14/datafusion:vortex-compact 632340747 695429811 0.91
tpch_q15/datafusion:vortex-compact 1119422588 1289472774 0.87
tpch_q16/datafusion:vortex-compact 400868052 371939278 1.08
tpch_q17/datafusion:vortex-compact 1413897481 1645010458 0.86
tpch_q18/datafusion:vortex-compact 1412401120 1603805232 0.88
tpch_q19/datafusion:vortex-compact 836541875 697177570 1.20
tpch_q20/datafusion:vortex-compact 1147424878 930797853 1.23
tpch_q21/datafusion:vortex-compact 1551677152 1498481977 1.04
tpch_q22/datafusion:vortex-compact 🚨 482099258 364664111 1.32
datafusion / parquet (1.078x ➖, 0↑ 3↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 896952505 941550706 0.95
tpch_q02/datafusion:parquet 🚨 1065979443 754948940 1.41
tpch_q03/datafusion:parquet 1313398278 1029551268 1.28
tpch_q04/datafusion:parquet 645252318 498178470 1.30
tpch_q05/datafusion:parquet 1563805231 1648721660 0.95
tpch_q06/datafusion:parquet 575145642 666654824 0.86
tpch_q07/datafusion:parquet 1593072731 1958246204 0.81
tpch_q08/datafusion:parquet 2155937810 2869452551 0.75
tpch_q09/datafusion:parquet 2448447446 2361873914 1.04
tpch_q10/datafusion:parquet 2204400217 2821842583 0.78
tpch_q11/datafusion:parquet 🚨 964714105 698879727 1.38
tpch_q12/datafusion:parquet 795038673 728124532 1.09
tpch_q13/datafusion:parquet 837250024 758264961 1.10
tpch_q14/datafusion:parquet 868188505 874788981 0.99
tpch_q15/datafusion:parquet 1352287662 1367607723 0.99
tpch_q16/datafusion:parquet 583601395 454668834 1.28
tpch_q17/datafusion:parquet 1696891096 1457126515 1.16
tpch_q18/datafusion:parquet 1913173259 1837030312 1.04
tpch_q19/datafusion:parquet 1186641680 1012345295 1.17
tpch_q20/datafusion:parquet 🚨 1670842621 1195183325 1.40
tpch_q21/datafusion:parquet 2221639847 1810484252 1.23
tpch_q22/datafusion:parquet 794624566 706638452 1.12
duckdb / vortex-file-compressed (0.985x ➖, 1↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 634012807 660335706 0.96
tpch_q02/duckdb:vortex-file-compressed 1346411479 1172102388 1.15
tpch_q03/duckdb:vortex-file-compressed 938616593 1036034288 0.91
tpch_q04/duckdb:vortex-file-compressed 805973797 635246002 1.27
tpch_q05/duckdb:vortex-file-compressed 1248211524 1289882999 0.97
tpch_q06/duckdb:vortex-file-compressed 912550584 925672643 0.99
tpch_q07/duckdb:vortex-file-compressed 1438327894 1401092752 1.03
tpch_q08/duckdb:vortex-file-compressed 1693988152 1665000451 1.02
tpch_q09/duckdb:vortex-file-compressed 1711856498 1586700893 1.08
tpch_q10/duckdb:vortex-file-compressed 1079791002 1167506027 0.92
tpch_q11/duckdb:vortex-file-compressed 711984440 729777007 0.98
tpch_q12/duckdb:vortex-file-compressed 879770079 743284907 1.18
tpch_q13/duckdb:vortex-file-compressed 1285367528 1012428784 1.27
tpch_q14/duckdb:vortex-file-compressed 946784854 940341095 1.01
tpch_q15/duckdb:vortex-file-compressed 627235266 606589954 1.03
tpch_q16/duckdb:vortex-file-compressed 500990105 490114622 1.02
tpch_q17/duckdb:vortex-file-compressed 931421522 1218020991 0.76
tpch_q18/duckdb:vortex-file-compressed 1024153483 1136871285 0.90
tpch_q19/duckdb:vortex-file-compressed 768156708 917391304 0.84
tpch_q20/duckdb:vortex-file-compressed 1231803812 1348942487 0.91
tpch_q21/duckdb:vortex-file-compressed 2264986363 2157842557 1.05
tpch_q22/duckdb:vortex-file-compressed 🚀 525887147 802834458 0.66
duckdb / vortex-compact (0.963x ➖, 0↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 640657761 675220488 0.95
tpch_q02/duckdb:vortex-compact 1060625356 1073866114 0.99
tpch_q03/duckdb:vortex-compact 1008564943 1014885361 0.99
tpch_q04/duckdb:vortex-compact 573308238 627182903 0.91
tpch_q05/duckdb:vortex-compact 1106193531 1116165721 0.99
tpch_q06/duckdb:vortex-compact 760827703 829287149 0.92
tpch_q07/duckdb:vortex-compact 1094316636 1205742500 0.91
tpch_q08/duckdb:vortex-compact 1355855435 1730829380 0.78
tpch_q09/duckdb:vortex-compact 1380697158 1428193538 0.97
tpch_q10/duckdb:vortex-compact 1182457794 1213620121 0.97
tpch_q11/duckdb:vortex-compact 822077807 704475187 1.17
tpch_q12/duckdb:vortex-compact 620879042 688680475 0.90
tpch_q13/duckdb:vortex-compact 866614577 929040071 0.93
tpch_q14/duckdb:vortex-compact 897249538 1004775531 0.89
tpch_q15/duckdb:vortex-compact 601219963 626524544 0.96
tpch_q16/duckdb:vortex-compact 462411192 448574794 1.03
tpch_q17/duckdb:vortex-compact 961773562 1028446113 0.94
tpch_q18/duckdb:vortex-compact 772805585 759326891 1.02
tpch_q19/duckdb:vortex-compact 830307895 880823016 0.94
tpch_q20/duckdb:vortex-compact 1407574832 1180508455 1.19
tpch_q21/duckdb:vortex-compact 1842463137 1850080459 1.00
tpch_q22/duckdb:vortex-compact 652641699 715650746 0.91
duckdb / parquet (0.989x ➖, 0↑ 1↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 866225292 916980825 0.94
tpch_q02/duckdb:parquet 1486786359 1417067378 1.05
tpch_q03/duckdb:parquet 🚨 2316947234 1748055109 1.33
tpch_q04/duckdb:parquet 1266194322 1063662882 1.19
tpch_q05/duckdb:parquet 2529904275 2271562022 1.11
tpch_q06/duckdb:parquet 772659617 792149060 0.98
tpch_q07/duckdb:parquet 1587477655 1823727223 0.87
tpch_q08/duckdb:parquet 2232946690 2438966177 0.92
tpch_q09/duckdb:parquet 2608158889 2592776376 1.01
tpch_q10/duckdb:parquet 3595145069 3563005178 1.01
tpch_q11/duckdb:parquet 1092192737 1034759310 1.06
tpch_q12/duckdb:parquet 1069331801 1137088718 0.94
tpch_q13/duckdb:parquet 1183207596 1353003836 0.87
tpch_q14/duckdb:parquet 1304071686 1233506767 1.06
tpch_q15/duckdb:parquet 901536599 967563778 0.93
tpch_q16/duckdb:parquet 815438742 816255880 1.00
tpch_q17/duckdb:parquet 1270586849 1329244284 0.96
tpch_q18/duckdb:parquet 1399740357 1441736187 0.97
tpch_q19/duckdb:parquet 1569962989 1688771002 0.93
tpch_q20/duckdb:parquet 1808250477 1837166121 0.98
tpch_q21/duckdb:parquet 1904426636 2026183511 0.94
tpch_q22/duckdb:parquet 1025215392 1235521042 0.83
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.1% -5.1% +6.5% +60.0% ➖ noise
1 datafusion:vortex-file-compressed -6.0% -5.1% -0.9% +65.2% ➖ noise
1 duckdb:vortex-compact -5.1% -5.1% +0.0% +36.9% ➖ noise
1 duckdb:vortex-file-compressed -4.0% -5.1% +1.2% +36.9% ➖ noise
2 datafusion:vortex-compact +14.4% +21.7% -6.0% +55.4% ➖ noise
2 datafusion:vortex-file-compressed -6.2% +21.7% -23.0% +59.0% ➖ noise
2 duckdb:vortex-compact -1.2% +21.7% -18.9% +44.1% ➖ noise
2 duckdb:vortex-file-compressed +14.9% +21.7% -5.6% +36.9% ➖ noise
3 datafusion:vortex-compact -9.4% +30.0% -30.3% +71.1% ➖ noise
3 datafusion:vortex-file-compressed -26.8% +30.0% -43.7% +73.7% ✅ faster
3 duckdb:vortex-compact -0.6% +30.0% -23.6% +50.9% ➖ noise
3 duckdb:vortex-file-compressed -9.4% +30.0% -30.3% +71.8% ➖ noise
4 datafusion:vortex-compact -3.0% +24.2% -21.9% +60.2% ➖ noise
4 datafusion:vortex-file-compressed -25.6% +24.2% -40.0% +60.8% ✅ faster
4 duckdb:vortex-compact -8.6% +24.2% -26.4% +39.6% ➖ noise
4 duckdb:vortex-file-compressed +26.9% +24.2% +2.2% +36.9% ➖ noise
5 datafusion:vortex-compact -21.5% +2.8% -23.6% +36.9% ➖ noise
5 datafusion:vortex-file-compressed -20.5% +2.8% -22.6% +36.9% ➖ noise
5 duckdb:vortex-compact -0.9% +2.8% -3.6% +36.9% ➖ noise
5 duckdb:vortex-file-compressed -3.2% +2.8% -5.8% +36.9% ➖ noise
6 datafusion:vortex-compact -6.9% -8.3% +1.5% +36.9% ➖ noise
6 datafusion:vortex-file-compressed +6.9% -8.3% +16.5% +36.9% ➖ noise
6 duckdb:vortex-compact -8.3% -8.3% +0.0% +36.9% ➖ noise
6 duckdb:vortex-file-compressed -1.4% -8.3% +7.5% +36.9% ➖ noise
7 datafusion:vortex-compact -25.7% -15.8% -11.7% +36.9% ➖ noise
7 datafusion:vortex-file-compressed -6.0% -15.8% +11.7% +36.9% ➖ noise
7 duckdb:vortex-compact -9.2% -15.8% +7.9% +36.9% ➖ noise
7 duckdb:vortex-file-compressed +2.7% -15.8% +22.0% +36.9% ➖ noise
8 datafusion:vortex-compact -4.9% -17.1% +14.6% +48.4% ➖ noise
8 datafusion:vortex-file-compressed -10.3% -17.1% +8.2% +36.9% ➖ noise
8 duckdb:vortex-compact -21.7% -17.1% -5.5% +36.9% ➖ noise
8 duckdb:vortex-file-compressed +1.7% -17.1% +22.7% +36.9% ➖ noise
9 datafusion:vortex-compact -3.7% +2.1% -5.7% +36.9% ➖ noise
9 datafusion:vortex-file-compressed -9.5% +2.1% -11.4% +36.9% ➖ noise
9 duckdb:vortex-compact -3.3% +2.1% -5.3% +36.9% ➖ noise
9 duckdb:vortex-file-compressed +7.9% +2.1% +5.7% +36.9% ➖ noise
10 datafusion:vortex-compact +19.0% -11.2% +34.0% +36.9% ➖ noise
10 datafusion:vortex-file-compressed -0.7% -11.2% +11.8% +36.9% ➖ noise
10 duckdb:vortex-compact -2.6% -11.2% +9.7% +42.2% ➖ noise
10 duckdb:vortex-file-compressed -7.5% -11.2% +4.2% +38.6% ➖ noise
11 datafusion:vortex-compact +45.2% +20.7% +20.3% +43.8% ➖ noise
11 datafusion:vortex-file-compressed -3.9% +20.7% -20.4% +41.8% ➖ noise
11 duckdb:vortex-compact +16.7% +20.7% -3.3% +36.9% ➖ noise
11 duckdb:vortex-file-compressed -2.4% +20.7% -19.2% +36.9% ➖ noise
12 datafusion:vortex-compact -4.7% +1.3% -5.9% +36.9% ➖ noise
12 datafusion:vortex-file-compressed -10.2% +1.3% -11.4% +36.9% ➖ noise
12 duckdb:vortex-compact -9.8% +1.3% -11.0% +37.9% ➖ noise
12 duckdb:vortex-file-compressed +18.4% +1.3% +16.8% +36.9% ➖ noise
13 datafusion:vortex-compact -17.2% -1.7% -15.8% +36.9% ➖ noise
13 datafusion:vortex-file-compressed -15.4% -1.7% -13.9% +44.4% ➖ noise
13 duckdb:vortex-compact -6.7% -1.7% -5.1% +70.6% ➖ noise
13 duckdb:vortex-file-compressed +27.0% -1.7% +29.2% +67.5% ➖ noise
14 datafusion:vortex-compact -9.1% +2.4% -11.2% +36.9% ➖ noise
14 datafusion:vortex-file-compressed +2.2% +2.4% -0.3% +36.9% ➖ noise
14 duckdb:vortex-compact -10.7% +2.4% -12.8% +36.9% ➖ noise
14 duckdb:vortex-file-compressed +0.7% +2.4% -1.7% +36.9% ➖ noise
15 datafusion:vortex-compact -13.2% -4.0% -9.6% +36.9% ➖ noise
15 datafusion:vortex-file-compressed +17.8% -4.0% +22.8% +36.9% ➖ noise
15 duckdb:vortex-compact -4.0% -4.0% -0.0% +36.9% ➖ noise
15 duckdb:vortex-file-compressed +3.4% -4.0% +7.7% +36.9% ➖ noise
16 datafusion:vortex-compact +7.8% +13.2% -4.8% +45.0% ➖ noise
16 datafusion:vortex-file-compressed +2.3% +13.2% -9.6% +36.9% ➖ noise
16 duckdb:vortex-compact +3.1% +13.2% -9.0% +48.5% ➖ noise
16 duckdb:vortex-file-compressed +2.2% +13.2% -9.7% +40.0% ➖ noise
17 datafusion:vortex-compact -14.0% +5.5% -18.5% +36.9% ➖ noise
17 datafusion:vortex-file-compressed -6.6% +5.5% -11.5% +36.9% ➖ noise
17 duckdb:vortex-compact -6.5% +5.5% -11.4% +36.9% ➖ noise
17 duckdb:vortex-file-compressed -23.5% +5.5% -27.5% +36.9% ✅ faster
18 datafusion:vortex-compact -11.9% +0.6% -12.4% +36.9% ➖ noise
18 datafusion:vortex-file-compressed -1.6% +0.6% -2.1% +36.9% ➖ noise
18 duckdb:vortex-compact +1.8% +0.6% +1.2% +36.9% ➖ noise
18 duckdb:vortex-file-compressed -9.9% +0.6% -10.4% +36.9% ➖ noise
19 datafusion:vortex-compact +20.0% +4.4% +14.9% +36.9% ➖ noise
19 datafusion:vortex-file-compressed +15.8% +4.4% +11.0% +37.4% ➖ noise
19 duckdb:vortex-compact -5.7% +4.4% -9.7% +36.9% ➖ noise
19 duckdb:vortex-file-compressed -16.3% +4.4% -19.8% +36.9% ➖ noise
20 datafusion:vortex-compact +23.3% +17.3% +5.1% +36.9% ➖ noise
20 datafusion:vortex-file-compressed +7.7% +17.3% -8.1% +36.9% ➖ noise
20 duckdb:vortex-compact +19.2% +17.3% +1.6% +36.9% ➖ noise
20 duckdb:vortex-file-compressed -8.7% +17.3% -22.2% +36.9% ➖ noise
21 datafusion:vortex-compact +3.5% +7.4% -3.6% +36.9% ➖ noise
21 datafusion:vortex-file-compressed -5.0% +7.4% -11.5% +36.9% ➖ noise
21 duckdb:vortex-compact -0.4% +7.4% -7.3% +36.9% ➖ noise
21 duckdb:vortex-file-compressed +5.0% +7.4% -2.3% +36.9% ➖ noise
22 datafusion:vortex-compact +32.2% -3.4% +36.9% +36.9% ➖ noise
22 datafusion:vortex-file-compressed -28.2% -3.4% -25.7% +63.5% ➖ noise
22 duckdb:vortex-compact -8.8% -3.4% -5.6% +36.9% ➖ noise
22 duckdb:vortex-file-compressed -34.5% -3.4% -32.2% +46.5% ✅ faster

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.1%
Vortex (geomean): 0.917x ➖
Parquet (geomean): 0.937x ➖
Shifts: Parquet (control) -6.3% · Median polish -3.9%


datafusion / vortex-file-compressed (0.883x ✅, 21↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚀 1619909 2381854 0.68
clickbench_q01/datafusion:vortex-file-compressed 13605085 14699654 0.93
clickbench_q02/datafusion:vortex-file-compressed 33725688 32870890 1.03
clickbench_q03/datafusion:vortex-file-compressed 🚀 36201533 55110376 0.66
clickbench_q04/datafusion:vortex-file-compressed 🚀 315429070 419053207 0.75
clickbench_q05/datafusion:vortex-file-compressed 🚀 316706553 396212000 0.80
clickbench_q06/datafusion:vortex-file-compressed 🚀 1703406 2361697 0.72
clickbench_q07/datafusion:vortex-file-compressed 🚀 17678719 20384636 0.87
clickbench_q08/datafusion:vortex-file-compressed 🚀 388023868 517210703 0.75
clickbench_q09/datafusion:vortex-file-compressed 🚀 575410381 682741766 0.84
clickbench_q10/datafusion:vortex-file-compressed 72371086 77441990 0.93
clickbench_q11/datafusion:vortex-file-compressed 81103381 86530620 0.94
clickbench_q12/datafusion:vortex-file-compressed 🚀 277905315 318810674 0.87
clickbench_q13/datafusion:vortex-file-compressed 🚀 418203510 469431270 0.89
clickbench_q14/datafusion:vortex-file-compressed 🚀 250264327 284241675 0.88
clickbench_q15/datafusion:vortex-file-compressed 372048414 404139763 0.92
clickbench_q16/datafusion:vortex-file-compressed 🚀 719876734 834653466 0.86
clickbench_q17/datafusion:vortex-file-compressed 707892757 771332214 0.92
clickbench_q18/datafusion:vortex-file-compressed 1489409725 1552186174 0.96
clickbench_q19/datafusion:vortex-file-compressed 22967758 24177927 0.95
clickbench_q20/datafusion:vortex-file-compressed 🚀 358700708 430566960 0.83
clickbench_q21/datafusion:vortex-file-compressed 🚀 417673833 497486605 0.84
clickbench_q22/datafusion:vortex-file-compressed 🚀 579237547 707108387 0.82
clickbench_q23/datafusion:vortex-file-compressed 🚀 718200310 830405258 0.86
clickbench_q24/datafusion:vortex-file-compressed 🚀 49267019 59155175 0.83
clickbench_q25/datafusion:vortex-file-compressed 🚀 77817721 96917952 0.80
clickbench_q26/datafusion:vortex-file-compressed 🚀 46236035 62817341 0.74
clickbench_q27/datafusion:vortex-file-compressed 819974874 850247946 0.96
clickbench_q28/datafusion:vortex-file-compressed 6888855344 6941171831 0.99
clickbench_q29/datafusion:vortex-file-compressed 239351347 239757325 1.00
clickbench_q30/datafusion:vortex-file-compressed 256566295 273802263 0.94
clickbench_q31/datafusion:vortex-file-compressed 293038639 317519450 0.92
clickbench_q32/datafusion:vortex-file-compressed 1407237409 1411628502 1.00
clickbench_q33/datafusion:vortex-file-compressed 1436207918 1459974953 0.98
clickbench_q34/datafusion:vortex-file-compressed 1420043864 1493512175 0.95
clickbench_q35/datafusion:vortex-file-compressed 526658902 545007186 0.97
clickbench_q36/datafusion:vortex-file-compressed 🚀 80410918 90785986 0.89
clickbench_q37/datafusion:vortex-file-compressed 38586636 42324635 0.91
clickbench_q38/datafusion:vortex-file-compressed 24050912 25107889 0.96
clickbench_q39/datafusion:vortex-file-compressed 147033771 145988274 1.01
clickbench_q40/datafusion:vortex-file-compressed 20502970 21041027 0.97
clickbench_q41/datafusion:vortex-file-compressed 18892961 20172245 0.94
clickbench_q42/datafusion:vortex-file-compressed 🚀 21603091 24082593 0.90
datafusion / parquet (0.898x ✅, 17↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚀 1717787 1932374 0.89
clickbench_q01/datafusion:parquet 🚀 21136898 23646180 0.89
clickbench_q02/datafusion:parquet 49460244 49493648 1.00
clickbench_q03/datafusion:parquet 🚀 41282930 47489139 0.87
clickbench_q04/datafusion:parquet 345732190 369480836 0.94
clickbench_q05/datafusion:parquet 386069219 381252454 1.01
clickbench_q06/datafusion:parquet 🚀 1615296 2940557 0.55
clickbench_q07/datafusion:parquet 🚀 25931502 29554395 0.88
clickbench_q08/datafusion:parquet 412152552 452729679 0.91
clickbench_q09/datafusion:parquet 638107944 704326584 0.91
clickbench_q10/datafusion:parquet 119133137 124930801 0.95
clickbench_q11/datafusion:parquet 143720623 143217233 1.00
clickbench_q12/datafusion:parquet 367033190 381062511 0.96
clickbench_q13/datafusion:parquet 511876628 528598133 0.97
clickbench_q14/datafusion:parquet 366242425 381465784 0.96
clickbench_q15/datafusion:parquet 🚀 393759656 495958342 0.79
clickbench_q16/datafusion:parquet 745458118 775407516 0.96
clickbench_q17/datafusion:parquet 🚀 725105514 889205355 0.82
clickbench_q18/datafusion:parquet 🚀 1527853545 1756413433 0.87
clickbench_q19/datafusion:parquet 33406400 33380197 1.00
clickbench_q20/datafusion:parquet 🚀 608174990 745289713 0.82
clickbench_q21/datafusion:parquet 🚀 674098521 877497667 0.77
clickbench_q22/datafusion:parquet 984455523 1073047408 0.92
clickbench_q23/datafusion:parquet 3725398362 4090836035 0.91
clickbench_q24/datafusion:parquet 94916818 99571624 0.95
clickbench_q25/datafusion:parquet 🚀 152921884 171662434 0.89
clickbench_q26/datafusion:parquet 🚀 99765085 115629837 0.86
clickbench_q27/datafusion:parquet 🚀 1058176043 1252139679 0.85
clickbench_q28/datafusion:parquet 6549238115 6824636080 0.96
clickbench_q29/datafusion:parquet 236172025 235222138 1.00
clickbench_q30/datafusion:parquet 371150776 396338775 0.94
clickbench_q31/datafusion:parquet 400574713 431598709 0.93
clickbench_q32/datafusion:parquet 1420477618 1404042238 1.01
clickbench_q33/datafusion:parquet 🚀 1581917130 1826904288 0.87
clickbench_q34/datafusion:parquet 🚀 1538556884 1878510664 0.82
clickbench_q35/datafusion:parquet 🚀 550394911 616092871 0.89
clickbench_q36/datafusion:parquet 144897946 152135257 0.95
clickbench_q37/datafusion:parquet 58849392 61031617 0.96
clickbench_q38/datafusion:parquet 93615612 97203262 0.96
clickbench_q39/datafusion:parquet 278437524 302012410 0.92
clickbench_q40/datafusion:parquet 🚀 34584056 52602844 0.66
clickbench_q41/datafusion:parquet 30766369 33471201 0.92
clickbench_q42/datafusion:parquet 31635709 32914374 0.96
duckdb / vortex-file-compressed (0.953x ➖, 6↑ 1↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 6036145 6982068 0.86
clickbench_q01/duckdb:vortex-file-compressed 13254794 13934033 0.95
clickbench_q02/duckdb:vortex-file-compressed 24071516 24264444 0.99
clickbench_q03/duckdb:vortex-file-compressed 30482261 31186729 0.98
clickbench_q04/duckdb:vortex-file-compressed 171296106 172081242 1.00
clickbench_q05/duckdb:vortex-file-compressed 199860615 198795446 1.01
clickbench_q06/duckdb:vortex-file-compressed 18666400 19169113 0.97
clickbench_q07/duckdb:vortex-file-compressed 16453288 15238099 1.08
clickbench_q08/duckdb:vortex-file-compressed 261904602 260858401 1.00
clickbench_q09/duckdb:vortex-file-compressed 372540569 380807926 0.98
clickbench_q10/duckdb:vortex-file-compressed 74952558 79086198 0.95
clickbench_q11/duckdb:vortex-file-compressed 81132748 89655945 0.90
clickbench_q12/duckdb:vortex-file-compressed 218638995 218975230 1.00
clickbench_q13/duckdb:vortex-file-compressed 431404907 435772632 0.99
clickbench_q14/duckdb:vortex-file-compressed 242566420 244122717 0.99
clickbench_q15/duckdb:vortex-file-compressed 211633457 213599254 0.99
clickbench_q16/duckdb:vortex-file-compressed 722586308 766542474 0.94
clickbench_q17/duckdb:vortex-file-compressed 🚀 543179708 664330285 0.82
clickbench_q18/duckdb:vortex-file-compressed 1197296283 1285868206 0.93
clickbench_q19/duckdb:vortex-file-compressed 21146290 20457391 1.03
clickbench_q20/duckdb:vortex-file-compressed 399176700 428781887 0.93
clickbench_q21/duckdb:vortex-file-compressed 426115263 446191891 0.96
clickbench_q22/duckdb:vortex-file-compressed 636653673 633301635 1.01
clickbench_q23/duckdb:vortex-file-compressed 🚀 718987636 1281639157 0.56
clickbench_q24/duckdb:vortex-file-compressed 🚨 48400470 43174893 1.12
clickbench_q25/duckdb:vortex-file-compressed 77540040 82853539 0.94
clickbench_q26/duckdb:vortex-file-compressed 🚀 41769401 51588782 0.81
clickbench_q27/duckdb:vortex-file-compressed 540457425 569044826 0.95
clickbench_q28/duckdb:vortex-file-compressed 3011824532 3043747040 0.99
clickbench_q29/duckdb:vortex-file-compressed 27905478 28426764 0.98
clickbench_q30/duckdb:vortex-file-compressed 195290596 198309156 0.98
clickbench_q31/duckdb:vortex-file-compressed 275791227 281854024 0.98
clickbench_q32/duckdb:vortex-file-compressed 🚀 1292592709 1469471739 0.88
clickbench_q33/duckdb:vortex-file-compressed 1513187661 1635216273 0.93
clickbench_q34/duckdb:vortex-file-compressed 1619228170 1723769414 0.94
clickbench_q35/duckdb:vortex-file-compressed 360854018 377302400 0.96
clickbench_q36/duckdb:vortex-file-compressed 30340700 30106245 1.01
clickbench_q37/duckdb:vortex-file-compressed 20722375 22901942 0.90
clickbench_q38/duckdb:vortex-file-compressed 22380266 21896197 1.02
clickbench_q39/duckdb:vortex-file-compressed 46661785 44389557 1.05
clickbench_q40/duckdb:vortex-file-compressed 20840174 21450812 0.97
clickbench_q41/duckdb:vortex-file-compressed 🚀 20074889 22997389 0.87
clickbench_q42/duckdb:vortex-file-compressed 23404035 22135940 1.06
duckdb / parquet (0.976x ➖, 2↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚀 214417102 245713517 0.87
clickbench_q01/duckdb:parquet 50360556 51761932 0.97
clickbench_q02/duckdb:parquet 65609053 69146322 0.95
clickbench_q03/duckdb:parquet 62908210 66032916 0.95
clickbench_q04/duckdb:parquet 204002347 212528001 0.96
clickbench_q05/duckdb:parquet 283065765 280942833 1.01
clickbench_q06/duckdb:parquet 60395976 61248944 0.99
clickbench_q07/duckdb:parquet 53769770 52491153 1.02
clickbench_q08/duckdb:parquet 269223167 270746119 0.99
clickbench_q09/duckdb:parquet 398408493 402799429 0.99
clickbench_q10/duckdb:parquet 94876261 97562385 0.97
clickbench_q11/duckdb:parquet 110826019 110542345 1.00
clickbench_q12/duckdb:parquet 298285661 302157552 0.99
clickbench_q13/duckdb:parquet 514517509 545340920 0.94
clickbench_q14/duckdb:parquet 332981908 347721671 0.96
clickbench_q15/duckdb:parquet 243449878 244205641 1.00
clickbench_q16/duckdb:parquet 614195982 626692160 0.98
clickbench_q17/duckdb:parquet 518626521 525361422 0.99
clickbench_q18/duckdb:parquet 1046062660 1064185417 0.98
clickbench_q19/duckdb:parquet 49914396 50253989 0.99
clickbench_q20/duckdb:parquet 436018831 437552073 1.00
clickbench_q21/duckdb:parquet 557323928 569699518 0.98
clickbench_q22/duckdb:parquet 926550452 951890392 0.97
clickbench_q23/duckdb:parquet 323972123 315272259 1.03
clickbench_q24/duckdb:parquet 78392868 80310421 0.98
clickbench_q25/duckdb:parquet 139582898 141473049 0.99
clickbench_q26/duckdb:parquet 53727126 57458054 0.94
clickbench_q27/duckdb:parquet 649564661 646782930 1.00
clickbench_q28/duckdb:parquet 4839079900 4888489554 0.99
clickbench_q29/duckdb:parquet 60862597 62995711 0.97
clickbench_q30/duckdb:parquet 304368770 307008447 0.99
clickbench_q31/duckdb:parquet 353062300 357503419 0.99
clickbench_q32/duckdb:parquet 1174020454 1204234690 0.97
clickbench_q33/duckdb:parquet 1250633996 1253313320 1.00
clickbench_q34/duckdb:parquet 1276352405 1313033050 0.97
clickbench_q35/duckdb:parquet 352060081 362534194 0.97
clickbench_q36/duckdb:parquet 63660604 65966316 0.97
clickbench_q37/duckdb:parquet 54163209 54149317 1.00
clickbench_q38/duckdb:parquet 🚀 56399460 63361742 0.89
clickbench_q39/duckdb:parquet 99160930 99938336 0.99
clickbench_q40/duckdb:parquet 55112237 56048049 0.98
clickbench_q41/duckdb:parquet 58996347 61559436 0.96
clickbench_q42/duckdb:parquet 52539120 53972776 0.97
duckdb / duckdb (0.980x ➖, 2↑ 0↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18999605 17380710 1.09
clickbench_q01/duckdb:duckdb 34550725 32998852 1.05
clickbench_q02/duckdb:duckdb 46715051 44797692 1.04
clickbench_q03/duckdb:duckdb 48297448 46876947 1.03
clickbench_q04/duckdb:duckdb 222480707 233967409 0.95
clickbench_q05/duckdb:duckdb 325097284 335360494 0.97
clickbench_q06/duckdb:duckdb 36062364 34938902 1.03
clickbench_q07/duckdb:duckdb 36241936 35377842 1.02
clickbench_q08/duckdb:duckdb 316664637 325443991 0.97
clickbench_q09/duckdb:duckdb 486585061 523003469 0.93
clickbench_q10/duckdb:duckdb 99017039 96693694 1.02
clickbench_q11/duckdb:duckdb 108083290 105362871 1.03
clickbench_q12/duckdb:duckdb 302075779 320414517 0.94
clickbench_q13/duckdb:duckdb 562495722 604363091 0.93
clickbench_q14/duckdb:duckdb 352673067 377361389 0.93
clickbench_q15/duckdb:duckdb 256726051 277385197 0.93
clickbench_q16/duckdb:duckdb 676854380 717647960 0.94
clickbench_q17/duckdb:duckdb 582233764 614552489 0.95
clickbench_q18/duckdb:duckdb 1244366478 1320269293 0.94
clickbench_q19/duckdb:duckdb 35596440 34007809 1.05
clickbench_q20/duckdb:duckdb 🚀 931672519 1127395712 0.83
clickbench_q21/duckdb:duckdb 1083584956 1127069187 0.96
clickbench_q22/duckdb:duckdb 1116581534 1169354148 0.95
clickbench_q23/duckdb:duckdb 253839890 250756500 1.01
clickbench_q24/duckdb:duckdb 61513545 61652574 1.00
clickbench_q25/duckdb:duckdb 125304264 124186955 1.01
clickbench_q26/duckdb:duckdb 56881747 55518331 1.02
clickbench_q27/duckdb:duckdb 1060107765 1177392309 0.90
clickbench_q28/duckdb:duckdb 4625374020 4675743357 0.99
clickbench_q29/duckdb:duckdb 49564586 48565301 1.02
clickbench_q30/duckdb:duckdb 285924878 302754371 0.94
clickbench_q31/duckdb:duckdb 412834141 442324676 0.93
clickbench_q32/duckdb:duckdb 1462931753 1600682393 0.91
clickbench_q33/duckdb:duckdb 1946031725 2045834618 0.95
clickbench_q34/duckdb:duckdb 2113003787 2149081389 0.98
clickbench_q35/duckdb:duckdb 264684092 264812499 1.00
clickbench_q36/duckdb:duckdb 🚀 36995994 41119358 0.90
clickbench_q37/duckdb:duckdb 32189174 31110535 1.03
clickbench_q38/duckdb:duckdb 31002339 30790767 1.01
clickbench_q39/duckdb:duckdb 63774658 64415650 0.99
clickbench_q40/duckdb:duckdb 32424892 31294917 1.04
clickbench_q41/duckdb:duckdb 31457843 30397068 1.03
clickbench_q42/duckdb:duckdb 32226590 31513786 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -32.0% -11.9% -22.8% +691.6% ➖ noise
0 duckdb:duckdb +9.3% -11.9% +24.1% +302.3% ➖ noise
0 duckdb:vortex-file-compressed -13.5% -11.9% -1.8% +350.0% ➖ noise
1 datafusion:vortex-file-compressed -7.4% -6.7% -0.8% +34.6% ➖ noise
1 duckdb:duckdb +4.7% -6.7% +12.3% +59.5% ➖ noise
1 duckdb:vortex-file-compressed -4.9% -6.7% +2.0% +20.9% ➖ noise
2 datafusion:vortex-file-compressed +2.6% -2.6% +5.4% +35.5% ➖ noise
2 duckdb:duckdb +4.3% -2.6% +7.1% +25.1% ➖ noise
2 duckdb:vortex-file-compressed -0.8% -2.6% +1.9% +16.0% ➖ noise
3 datafusion:vortex-file-compressed -34.3% -9.0% -27.8% +146.7% ➖ noise
3 duckdb:duckdb +3.0% -9.0% +13.2% +59.1% ➖ noise
3 duckdb:vortex-file-compressed -2.3% -9.0% +7.4% +32.5% ➖ noise
4 datafusion:vortex-file-compressed -24.7% -5.2% -20.6% +22.7% ✅ faster
4 duckdb:duckdb -4.9% -5.2% +0.3% +16.0% ➖ noise
4 duckdb:vortex-file-compressed -0.5% -5.2% +5.0% +16.0% ➖ noise
5 datafusion:vortex-file-compressed -20.1% +1.0% -20.9% +26.4% ➖ noise
5 duckdb:duckdb -3.1% +1.0% -4.0% +16.0% ➖ noise
5 duckdb:vortex-file-compressed +0.5% +1.0% -0.5% +16.0% ➖ noise
6 datafusion:vortex-file-compressed -27.9% -26.4% -2.0% +38.3% ➖ noise
6 duckdb:duckdb +3.2% -26.4% +40.2% +27.5% 🚨 regression
6 duckdb:vortex-file-compressed -2.6% -26.4% +32.3% +16.5% 🚨 regression
7 datafusion:vortex-file-compressed -13.3% -5.2% -8.5% +18.1% ➖ noise
7 duckdb:duckdb +2.4% -5.2% +8.1% +16.0% ➖ noise
7 duckdb:vortex-file-compressed +8.0% -5.2% +13.9% +16.0% ➖ noise
8 datafusion:vortex-file-compressed -25.0% -4.9% -21.1% +25.5% ✅ faster
8 duckdb:duckdb -2.7% -4.9% +2.3% +16.0% ➖ noise
8 duckdb:vortex-file-compressed +0.4% -4.9% +5.5% +16.0% ➖ noise
9 datafusion:vortex-file-compressed -15.7% -5.3% -11.0% +19.3% ➖ noise
9 duckdb:duckdb -7.0% -5.3% -1.7% +16.0% ➖ noise
9 duckdb:vortex-file-compressed -2.2% -5.3% +3.3% +16.0% ➖ noise
10 datafusion:vortex-file-compressed -6.5% -3.7% -3.0% +16.0% ➖ noise
10 duckdb:duckdb +2.4% -3.7% +6.3% +16.0% ➖ noise
10 duckdb:vortex-file-compressed -5.2% -3.7% -1.6% +16.0% ➖ noise
11 datafusion:vortex-file-compressed -6.3% +0.3% -6.6% +16.0% ➖ noise
11 duckdb:duckdb +2.6% +0.3% +2.3% +16.0% ➖ noise
11 duckdb:vortex-file-compressed -9.5% +0.3% -9.8% +16.0% ➖ noise
12 datafusion:vortex-file-compressed -12.8% -2.5% -10.6% +16.0% ➖ noise
12 duckdb:duckdb -5.7% -2.5% -3.3% +16.0% ➖ noise
12 duckdb:vortex-file-compressed -0.2% -2.5% +2.4% +16.0% ➖ noise
13 datafusion:vortex-file-compressed -10.9% -4.4% -6.8% +16.0% ➖ noise
13 duckdb:duckdb -6.9% -4.4% -2.6% +16.0% ➖ noise
13 duckdb:vortex-file-compressed -1.0% -4.4% +3.6% +16.0% ➖ noise
14 datafusion:vortex-file-compressed -12.0% -4.1% -8.2% +16.0% ➖ noise
14 duckdb:duckdb -6.5% -4.1% -2.5% +16.0% ➖ noise
14 duckdb:vortex-file-compressed -0.6% -4.1% +3.6% +16.0% ➖ noise
15 datafusion:vortex-file-compressed -7.9% -11.0% +3.5% +16.0% ➖ noise
15 duckdb:duckdb -7.4% -11.0% +4.0% +16.0% ➖ noise
15 duckdb:vortex-file-compressed -0.9% -11.0% +11.4% +16.0% ➖ noise
16 datafusion:vortex-file-compressed -13.8% -2.9% -11.1% +16.0% ➖ noise
16 duckdb:duckdb -5.7% -2.9% -2.8% +16.0% ➖ noise
16 duckdb:vortex-file-compressed -5.7% -2.9% -2.9% +16.0% ➖ noise
17 datafusion:vortex-file-compressed -8.2% -10.3% +2.3% +16.0% ➖ noise
17 duckdb:duckdb -5.3% -10.3% +5.6% +16.0% ➖ noise
17 duckdb:vortex-file-compressed -18.2% -10.3% -8.9% +16.0% ➖ noise
18 datafusion:vortex-file-compressed -4.0% -7.5% +3.8% +16.0% ➖ noise
18 duckdb:duckdb -5.7% -7.5% +1.9% +16.0% ➖ noise
18 duckdb:vortex-file-compressed -6.9% -7.5% +0.7% +16.0% ➖ noise
19 datafusion:vortex-file-compressed -5.0% -0.3% -4.7% +28.0% ➖ noise
19 duckdb:duckdb +4.7% -0.3% +5.0% +16.0% ➖ noise
19 duckdb:vortex-file-compressed +3.4% -0.3% +3.7% +41.5% ➖ noise
20 datafusion:vortex-file-compressed -16.7% -9.8% -7.6% +174.9% ➖ noise
20 duckdb:duckdb -17.4% -9.8% -8.4% +25.5% ➖ noise
20 duckdb:vortex-file-compressed -6.9% -9.8% +3.2% +16.0% ➖ noise
21 datafusion:vortex-file-compressed -16.0% -13.3% -3.2% +16.0% ➖ noise
21 duckdb:duckdb -3.9% -13.3% +10.9% +16.0% ➖ noise
21 duckdb:vortex-file-compressed -4.5% -13.3% +10.2% +16.0% ➖ noise
22 datafusion:vortex-file-compressed -18.1% -5.5% -13.3% +16.0% ➖ noise
22 duckdb:duckdb -4.5% -5.5% +1.0% +16.0% ➖ noise
22 duckdb:vortex-file-compressed +0.5% -5.5% +6.4% +16.0% ➖ noise
23 datafusion:vortex-file-compressed -13.5% -3.3% -10.6% +38.6% ➖ noise
23 duckdb:duckdb +1.2% -3.3% +4.6% +16.0% ➖ noise
23 duckdb:vortex-file-compressed -43.9% -3.3% -42.0% +24.9% ✅ faster
24 datafusion:vortex-file-compressed -16.7% -3.5% -13.7% +18.5% ➖ noise
24 duckdb:duckdb -0.2% -3.5% +3.4% +16.0% ➖ noise
24 duckdb:vortex-file-compressed +12.1% -3.5% +16.2% +26.0% ➖ noise
25 datafusion:vortex-file-compressed -19.7% -6.2% -14.4% +16.0% ✅ faster
25 duckdb:duckdb +0.9% -6.2% +7.6% +16.0% ➖ noise
25 duckdb:vortex-file-compressed -6.4% -6.2% -0.2% +17.0% ➖ noise
26 datafusion:vortex-file-compressed -26.4% -10.2% -18.1% +16.0% ✅ faster
26 duckdb:duckdb +2.5% -10.2% +14.1% +16.0% ➖ noise
26 duckdb:vortex-file-compressed -19.0% -10.2% -9.9% +21.2% ➖ noise
27 datafusion:vortex-file-compressed -3.6% -7.9% +4.7% +16.0% ➖ noise
27 duckdb:duckdb -10.0% -7.9% -2.3% +16.0% ➖ noise
27 duckdb:vortex-file-compressed -5.0% -7.9% +3.1% +16.0% ➖ noise
28 datafusion:vortex-file-compressed -0.8% -2.5% +1.8% +16.0% ➖ noise
28 duckdb:duckdb -1.1% -2.5% +1.5% +16.0% ➖ noise
28 duckdb:vortex-file-compressed -1.0% -2.5% +1.5% +16.0% ➖ noise
29 datafusion:vortex-file-compressed -0.2% -1.5% +1.4% +16.0% ➖ noise
29 duckdb:duckdb +2.1% -1.5% +3.6% +16.0% ➖ noise
29 duckdb:vortex-file-compressed -1.8% -1.5% -0.3% +16.0% ➖ noise
30 datafusion:vortex-file-compressed -6.3% -3.6% -2.7% +16.0% ➖ noise
30 duckdb:duckdb -5.6% -3.6% -2.0% +16.0% ➖ noise
30 duckdb:vortex-file-compressed -1.5% -3.6% +2.2% +16.0% ➖ noise
31 datafusion:vortex-file-compressed -7.7% -4.3% -3.6% +16.0% ➖ noise
31 duckdb:duckdb -6.7% -4.3% -2.5% +16.0% ➖ noise
31 duckdb:vortex-file-compressed -2.2% -4.3% +2.2% +16.0% ➖ noise
32 datafusion:vortex-file-compressed -0.3% -0.7% +0.4% +20.1% ➖ noise
32 duckdb:duckdb -8.6% -0.7% -8.0% +16.0% ➖ noise
32 duckdb:vortex-file-compressed -12.0% -0.7% -11.4% +16.0% ➖ noise
33 datafusion:vortex-file-compressed -1.6% -7.0% +5.8% +16.0% ➖ noise
33 duckdb:duckdb -4.9% -7.0% +2.3% +16.0% ➖ noise
33 duckdb:vortex-file-compressed -7.5% -7.0% -0.4% +16.0% ➖ noise
34 datafusion:vortex-file-compressed -4.9% -10.8% +6.6% +16.0% ➖ noise
34 duckdb:duckdb -1.7% -10.8% +10.2% +16.0% ➖ noise
34 duckdb:vortex-file-compressed -6.1% -10.8% +5.3% +16.0% ➖ noise
35 datafusion:vortex-file-compressed -3.4% -6.9% +3.7% +16.0% ➖ noise
35 duckdb:duckdb -0.0% -6.9% +7.3% +16.0% ➖ noise
35 duckdb:vortex-file-compressed -4.4% -6.9% +2.7% +16.0% ➖ noise
36 datafusion:vortex-file-compressed -11.4% -4.1% -7.6% +16.0% ➖ noise
36 duckdb:duckdb -10.0% -4.1% -6.2% +18.6% ➖ noise
36 duckdb:vortex-file-compressed +0.8% -4.1% +5.1% +20.0% ➖ noise
37 datafusion:vortex-file-compressed -8.8% -1.8% -7.2% +16.0% ➖ noise
37 duckdb:duckdb +3.5% -1.8% +5.4% +16.0% ➖ noise
37 duckdb:vortex-file-compressed -9.5% -1.8% -7.9% +16.0% ➖ noise
38 datafusion:vortex-file-compressed -4.2% -7.4% +3.5% +16.0% ➖ noise
38 duckdb:duckdb +0.7% -7.4% +8.7% +16.0% ➖ noise
38 duckdb:vortex-file-compressed +2.2% -7.4% +10.4% +16.0% ➖ noise
39 datafusion:vortex-file-compressed +0.7% -4.4% +5.3% +16.0% ➖ noise
39 duckdb:duckdb -1.0% -4.4% +3.5% +19.6% ➖ noise
39 duckdb:vortex-file-compressed +5.1% -4.4% +9.9% +16.0% ➖ noise
40 datafusion:vortex-file-compressed -2.6% -19.6% +21.2% +16.0% 🚨 regression
40 duckdb:duckdb +3.6% -19.6% +28.9% +16.0% 🚨 regression
40 duckdb:vortex-file-compressed -2.8% -19.6% +20.8% +16.0% 🚨 regression
41 datafusion:vortex-file-compressed -6.3% -6.1% -0.2% +16.0% ➖ noise
41 duckdb:duckdb +3.5% -6.1% +10.3% +16.0% ➖ noise
41 duckdb:vortex-file-compressed -12.7% -6.1% -7.0% +16.0% ➖ noise
42 datafusion:vortex-file-compressed -10.3% -3.3% -7.3% +16.0% ➖ noise
42 duckdb:duckdb +2.3% -3.3% +5.7% +16.0% ➖ noise
42 duckdb:vortex-file-compressed +5.7% -3.3% +9.3% +16.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 17, 2026

Benchmarks: Compression

Vortex (geomean): 1.012x ➖
Parquet (geomean): 1.021x ➖


unknown / unknown (1.028x ➖, 0↑ 13↓)
name PR 7e978b8 (ns) base c63a800 (ns) ratio (PR/base)
compress time/Arade 1195664638 1115954026 1.07
compress time/Bimbo 7340281410 7120800750 1.03
compress time/CMSprovider 3054720642 2925027120 1.04
compress time/Euro2016 🚨 442182733 391261006 1.13
compress time/Food 411243313 404887218 1.02
compress time/HashTags 953128400 914092312 1.04
compress time/TPC-H l_comment canonical 2891480824 2761510823 1.05
compress time/TPC-H l_comment chunked 2800792626 2840686539 0.99
compress time/taxi 763396921 738255222 1.03
compress time/wide table cols=100 chunks=1 rows=1000 16985366 15466617 1.10
compress time/wide table cols=100 chunks=50 rows=1000 18272986 16753772 1.09
compress time/wide table cols=1000 chunks=1 rows=1000 164957954 155848920 1.06
compress time/wide table cols=1000 chunks=50 rows=1000 166993298 161885826 1.03
compress time/wide table cols=10000 chunks=1 rows=1000 1602778567 1593930018 1.01
compress time/wide table cols=10000 chunks=50 rows=1000 1606308680 1559621785 1.03
decompress time/Arade 🚨 34930543 30250901 1.15
decompress time/Bimbo 🚨 108384712 97256584 1.11
decompress time/CMSprovider 91640261 86149565 1.06
decompress time/Euro2016 23579771 22221573 1.06
decompress time/Food 🚨 9547339 8192366 1.17
decompress time/HashTags 83091629 81263269 1.02
decompress time/TPC-H l_comment canonical 🚨 46969226 42054044 1.12
decompress time/TPC-H l_comment chunked 44989890 43176776 1.04
decompress time/taxi 🚨 21620999 19359108 1.12
decompress time/wide table cols=100 chunks=1 rows=1000 2906003 2787761 1.04
decompress time/wide table cols=100 chunks=50 rows=1000 2844243 2677340 1.06
decompress time/wide table cols=1000 chunks=1 rows=1000 25207602 23364053 1.08
decompress time/wide table cols=1000 chunks=50 rows=1000 24725005 24190088 1.02
decompress time/wide table cols=10000 chunks=1 rows=1000 271185735 254890387 1.06
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 269802763 240963983 1.12
parquet size/Arade 305282152 305282152 1.00
parquet size/Bimbo 388935055 388935055 1.00
parquet size/CMSprovider 384634824 384634824 1.00
parquet size/Euro2016 123042700 123042700 1.00
parquet size/Food 36177631 36177631 1.00
parquet size/HashTags 133854962 133854962 1.00
parquet size/TPC-H l_comment canonical 158411391 158411391 1.00
parquet size/TPC-H l_comment chunked 158411391 158411391 1.00
parquet size/taxi 55879185 55879185 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932204 932204 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932204 932204 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93220004 93220004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93220004 93220004 1.00
parquet_rs-zstd compress time/Arade 2562395890 2549236554 1.01
parquet_rs-zstd compress time/Bimbo 16068891078 16142605539 1.00
parquet_rs-zstd compress time/CMSprovider 8392549578 7820258578 1.07
parquet_rs-zstd compress time/Euro2016 1516122390 1455054486 1.04
parquet_rs-zstd compress time/Food 943614707 940563279 1.00
parquet_rs-zstd compress time/HashTags 2778754996 2530085727 1.10
parquet_rs-zstd compress time/TPC-H l_comment canonical 3294243704 3209961108 1.03
parquet_rs-zstd compress time/TPC-H l_comment chunked 3317386360 3205694710 1.03
parquet_rs-zstd compress time/taxi 1415464077 1408606041 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 7662673 6517374 1.18
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 7647250 7506161 1.02
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 🚨 90252627 82044929 1.10
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 90655653 86307324 1.05
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 921878349 902576499 1.02
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 902845631 908451237 0.99
parquet_rs-zstd decompress time/Arade 674499837 660693387 1.02
parquet_rs-zstd decompress time/Bimbo 2320621873 2276131322 1.02
parquet_rs-zstd decompress time/CMSprovider 2211068757 2110319574 1.05
parquet_rs-zstd decompress time/Euro2016 430458288 421254859 1.02
parquet_rs-zstd decompress time/Food 248972782 242944210 1.02
parquet_rs-zstd decompress time/HashTags 🚨 753894946 667494059 1.13
parquet_rs-zstd decompress time/TPC-H l_comment canonical 737280133 725828743 1.02
parquet_rs-zstd decompress time/TPC-H l_comment chunked 741116483 715651523 1.04
parquet_rs-zstd decompress time/taxi 293258804 289995268 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2701164 2551777 1.06
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2690853 2566494 1.05
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31049768 28748063 1.08
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 31119454 30525843 1.02
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 350479770 345853730 1.01
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 352569293 344139443 1.02
vortex-file-compressed size/Arade 143320332 143320332 1.00
vortex-file-compressed size/Bimbo 526057964 526057964 1.00
vortex-file-compressed size/CMSprovider 448338524 448338524 1.00
vortex-file-compressed size/Euro2016 167858276 167858276 1.00
vortex-file-compressed size/Food 44162400 44162400 1.00
vortex-file-compressed size/HashTags 198700964 198700964 1.00
vortex-file-compressed size/TPC-H l_comment canonical 180398648 180398648 1.00
vortex-file-compressed size/TPC-H l_comment chunked 180398648 180398648 1.00
vortex-file-compressed size/taxi 51449348 51449348 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317584 88317584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317584 88317584 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.07
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.04
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.97
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.08
vortex:parquet-zstd ratio compress time/Food 0 0 1.01
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.95
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.95
vortex:parquet-zstd ratio compress time/taxi 0 0 1.03
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 0.93
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 1.07
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.96
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio decompress time/Arade 🚨 0 0 1.13
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.09
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.04
vortex:parquet-zstd ratio decompress time/Food 🚨 0 0 1.14
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.91
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.10
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio decompress time/taxi 🚨 0 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.09
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@0ax1 0ax1 force-pushed the ad/clean-up-inline branch 3 times, most recently from 6b439f7 to 1ffe423 Compare March 17, 2026 20:10
@0ax1 0ax1 added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 17, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 17, 2026
@0ax1 0ax1 force-pushed the ad/clean-up-inline branch 2 times, most recently from 7647ccd to 6f17616 Compare March 18, 2026 13:30
Remove #[inline] from private, pub(crate), and inner functions where
the compiler already has full visibility, and from large (>20 line)
functions where code bloat outweighs benefit.

Add #[inline] to BitBuffer operator trait impls (BitOr, BitAnd, Not,
BitXor) — non-generic impls on a concrete type that are otherwise
opaque cross-crate with LTO disabled.

Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
@0ax1 0ax1 force-pushed the ad/clean-up-inline branch from 6f17616 to 7e978b8 Compare March 18, 2026 13:32
@0ax1 0ax1 added the action/benchmark Trigger full benchmarks to run on this PR label Mar 18, 2026
@0ax1 0ax1 marked this pull request as ready for review March 18, 2026 13:54
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 18, 2026
@0ax1
Copy link
Contributor Author

0ax1 commented Mar 18, 2026

@connortsui20 I think the current regressions are flaky benchmarks. If you look at the benchmark dashboards you can see how they oscillate back and forth 10% over time.

@0ax1 0ax1 changed the title chore: only use #[inline] for non-generic & public fns chore: clean up #[inline] annotations Mar 18, 2026
@0ax1 0ax1 enabled auto-merge (squash) March 18, 2026 13:58
@0ax1 0ax1 changed the title chore: clean up #[inline] annotations chore: clean up #[inline] annotations Mar 18, 2026
Copy link
Contributor

@connortsui20 connortsui20 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice

@0ax1 0ax1 merged commit 904079c into develop Mar 18, 2026
69 of 70 checks passed
@0ax1 0ax1 deleted the ad/clean-up-inline branch March 18, 2026 14:00
dimitarvdimitrov pushed a commit that referenced this pull request Mar 20, 2026
Remove #[inline] from private, pub(crate), and inner functions where the compiler already has full visibility, and from large (>20 line) functions where code bloat outweighs benefit.

Add #[inline] to BitBuffer operator trait impls (BitOr, BitAnd, Not, BitXor) — non-generic impls on a concrete type that are otherwise opaque cross-crate with LTO disabled.

Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants