Skip to content

Remove type coercion#8032

Merged
gatesn merged 1 commit into
developfrom
ngates/remove-coercion
May 20, 2026
Merged

Remove type coercion#8032
gatesn merged 1 commit into
developfrom
ngates/remove-coercion

Conversation

@gatesn
Copy link
Copy Markdown
Contributor

@gatesn gatesn commented May 20, 2026

This belongs in a type analysis phase inside an engine, rather than inside the Vortex physical function implementations.

It is currently unused.

Signed-off-by: Nicholas Gates <nick@nickgates.com>
@gatesn gatesn enabled auto-merge (squash) May 20, 2026 13:05
@gatesn gatesn added the changelog/chore A trivial change label May 20, 2026
@robert3005 robert3005 added the action/benchmark Trigger full benchmarks to run on this PR label May 20, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 20, 2026
@robert3005
Copy link
Copy Markdown
Contributor

Just running benchmarks to make sure nothing is broken, we can merge after that

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 002a8e9 2 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done 002a8e9 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 1.034x ➖
Parquet (geomean): 1.043x ➖
Shifts: Parquet (control) +4.3% · Median polish +3.6%


datafusion / vortex-file-compressed (1.043x ➖, 0↑ 1↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5708206 5484067 1.04
fineweb_q01/datafusion:vortex-file-compressed 22057137 20405584 1.08
fineweb_q02/datafusion:vortex-file-compressed 🚨 23756861 20953599 1.13
fineweb_q03/datafusion:vortex-file-compressed 84811605 81878783 1.04
fineweb_q04/datafusion:vortex-file-compressed 231214025 227916006 1.01
fineweb_q05/datafusion:vortex-file-compressed 217656979 217401321 1.00
fineweb_q06/datafusion:vortex-file-compressed 53811016 50704544 1.06
fineweb_q07/datafusion:vortex-file-compressed 60407180 56801553 1.06
fineweb_q08/datafusion:vortex-file-compressed 21890372 22643134 0.97
datafusion / vortex-compact (1.040x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5872814 5562236 1.06
fineweb_q01/datafusion:vortex-compact 97692801 97113688 1.01
fineweb_q02/datafusion:vortex-compact 111350243 108109235 1.03
fineweb_q03/datafusion:vortex-compact 883109320 850911019 1.04
fineweb_q04/datafusion:vortex-compact 963966053 910281210 1.06
fineweb_q05/datafusion:vortex-compact 843915085 822348659 1.03
fineweb_q06/datafusion:vortex-compact 481380682 466178312 1.03
fineweb_q07/datafusion:vortex-compact 490193887 472573857 1.04
fineweb_q08/datafusion:vortex-compact 19167684 17743430 1.08
datafusion / parquet (1.018x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6997060 7196734 0.97
fineweb_q01/datafusion:parquet 310409330 316335016 0.98
fineweb_q02/datafusion:parquet 305084631 310861884 0.98
fineweb_q03/datafusion:parquet 317364285 297613960 1.07
fineweb_q04/datafusion:parquet 322856646 304715725 1.06
fineweb_q05/datafusion:parquet 316229811 312319347 1.01
fineweb_q06/datafusion:parquet 303178781 294757472 1.03
fineweb_q07/datafusion:parquet 298815127 289157003 1.03
fineweb_q08/datafusion:parquet 295414397 286471158 1.03
duckdb / vortex-file-compressed (1.026x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3522369 3373833 1.04
fineweb_q01/duckdb:vortex-file-compressed 22417961 22075025 1.02
fineweb_q02/duckdb:vortex-file-compressed 24084060 23823124 1.01
fineweb_q03/duckdb:vortex-file-compressed 131993367 126646387 1.04
fineweb_q04/duckdb:vortex-file-compressed 221962171 215163879 1.03
fineweb_q05/duckdb:vortex-file-compressed 213183326 208631640 1.02
fineweb_q06/duckdb:vortex-file-compressed 53775985 54796598 0.98
fineweb_q07/duckdb:vortex-file-compressed 55332987 53206631 1.04
fineweb_q08/duckdb:vortex-file-compressed 22972244 21933292 1.05
duckdb / vortex-compact (1.025x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4111328 3784584 1.09
fineweb_q01/duckdb:vortex-compact 97846615 108070930 0.91
fineweb_q02/duckdb:vortex-compact 113521824 113621537 1.00
fineweb_q03/duckdb:vortex-compact 879102460 856545679 1.03
fineweb_q04/duckdb:vortex-compact 931238914 889735780 1.05
fineweb_q05/duckdb:vortex-compact 840442554 805156765 1.04
fineweb_q06/duckdb:vortex-compact 472201249 457053645 1.03
fineweb_q07/duckdb:vortex-compact 495563496 473774983 1.05
fineweb_q08/duckdb:vortex-compact 19803734 18840908 1.05
duckdb / parquet (1.068x ➖, 0↑ 2↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 31895135 27275511 1.17
fineweb_q01/duckdb:parquet 87001752 83979198 1.04
fineweb_q02/duckdb:parquet 90000756 82246278 1.09
fineweb_q03/duckdb:parquet 321463144 306119212 1.05
fineweb_q04/duckdb:parquet 451335720 440284390 1.03
fineweb_q05/duckdb:parquet 421202719 408351920 1.03
fineweb_q06/duckdb:parquet 206542602 196121993 1.05
fineweb_q07/duckdb:parquet 216017441 208059226 1.04
fineweb_q08/duckdb:parquet 🚨 35614124 31590916 1.13
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +5.6% +6.6% -1.0% +60.8% ➖ noise
0 datafusion:vortex-file-compressed +4.1% +6.6% -2.4% +47.8% ➖ noise
0 duckdb:vortex-compact +8.6% +6.6% +1.9% +47.7% ➖ noise
0 duckdb:vortex-file-compressed +4.4% +6.6% -2.1% +86.9% ➖ noise
1 datafusion:vortex-compact +0.6% +0.8% -0.2% +13.2% ➖ noise
1 datafusion:vortex-file-compressed +8.1% +0.8% +7.2% +18.2% ➖ noise
1 duckdb:vortex-compact -9.5% +0.8% -10.2% +17.4% ➖ noise
1 duckdb:vortex-file-compressed +1.6% +0.8% +0.7% +68.2% ➖ noise
2 datafusion:vortex-compact +3.0% +3.6% -0.6% +16.7% ➖ noise
2 datafusion:vortex-file-compressed +13.4% +3.6% +9.4% +12.0% ➖ noise
2 duckdb:vortex-compact -0.1% +3.6% -3.6% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.1% +3.6% -2.4% +10.0% ➖ noise
3 datafusion:vortex-compact +3.8% +5.8% -1.9% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +3.6% +5.8% -2.1% +28.5% ➖ noise
3 duckdb:vortex-compact +2.6% +5.8% -3.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +4.2% +5.8% -1.5% +30.2% ➖ noise
4 datafusion:vortex-compact +5.9% +4.2% +1.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.4% +4.2% -2.7% +10.0% ➖ noise
4 duckdb:vortex-compact +4.7% +4.2% +0.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.2% +4.2% -1.0% +10.0% ➖ noise
5 datafusion:vortex-compact +2.6% +2.2% +0.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.1% +2.2% -2.0% +10.0% ➖ noise
5 duckdb:vortex-compact +4.4% +2.2% +2.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.2% +2.2% -0.0% +10.0% ➖ noise
6 datafusion:vortex-compact +3.3% +4.1% -0.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +6.1% +4.1% +2.0% +10.0% ➖ noise
6 duckdb:vortex-compact +3.3% +4.1% -0.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.9% +4.1% -5.7% +15.3% ➖ noise
7 datafusion:vortex-compact +3.7% +3.6% +0.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +6.3% +3.6% +2.7% +14.8% ➖ noise
7 duckdb:vortex-compact +4.6% +3.6% +1.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.0% +3.6% +0.4% +10.5% ➖ noise
8 datafusion:vortex-compact +8.0% +7.8% +0.2% +14.1% ➖ noise
8 datafusion:vortex-file-compressed -3.3% +7.8% -10.3% +16.1% ➖ noise
8 duckdb:vortex-compact +5.1% +7.8% -2.5% +25.6% ➖ noise
8 duckdb:vortex-file-compressed +4.7% +7.8% -2.9% +25.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 20, 2026

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 1 improved benchmark
❌ 1 regressed benchmark
✅ 1235 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime cuda/bitpacked_u8/unpack/3bw[100M] 350.3 µs 300.3 µs +16.68%
Simulation chunked_varbinview_opt_canonical_into[(1000, 10)] 187.6 µs 225.1 µs -16.65%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ngates/remove-coercion (002a8e9) with develop (a88e6b1)

Open in CodSpeed

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.5%
Vortex (geomean): 1.091x ➖
Parquet (geomean): 1.043x ➖
Shifts: Parquet (control) +4.3% · Median polish +7.1%


datafusion / vortex-file-compressed (1.085x ➖, 0↑ 6↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51960779 49822264 1.04
tpch_q02/datafusion:vortex-file-compressed 24480923 22477239 1.09
tpch_q03/datafusion:vortex-file-compressed 🚨 31051611 27519463 1.13
tpch_q04/datafusion:vortex-file-compressed 21879328 20387250 1.07
tpch_q05/datafusion:vortex-file-compressed 51357604 47556870 1.08
tpch_q06/datafusion:vortex-file-compressed 🚨 11565543 10352344 1.12
tpch_q07/datafusion:vortex-file-compressed 58403803 54687114 1.07
tpch_q08/datafusion:vortex-file-compressed 🚨 43207465 38662609 1.12
tpch_q09/datafusion:vortex-file-compressed 54983638 52022664 1.06
tpch_q10/datafusion:vortex-file-compressed 43156550 39914950 1.08
tpch_q11/datafusion:vortex-file-compressed 🚨 17142523 15448405 1.11
tpch_q12/datafusion:vortex-file-compressed 25920285 23847564 1.09
tpch_q13/datafusion:vortex-file-compressed 26052969 25121928 1.04
tpch_q14/datafusion:vortex-file-compressed 16853571 15605820 1.08
tpch_q15/datafusion:vortex-file-compressed 26034626 24728675 1.05
tpch_q16/datafusion:vortex-file-compressed 20654319 19438524 1.06
tpch_q17/datafusion:vortex-file-compressed 🚨 74574327 67597296 1.10
tpch_q18/datafusion:vortex-file-compressed 86960194 79769295 1.09
tpch_q19/datafusion:vortex-file-compressed 🚨 22972539 19850149 1.16
tpch_q20/datafusion:vortex-file-compressed 31729301 29704611 1.07
tpch_q21/datafusion:vortex-file-compressed 77438372 70847902 1.09
tpch_q22/datafusion:vortex-file-compressed 13273224 12197282 1.09
datafusion / vortex-compact (1.077x ➖, 0↑ 3↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 61228283 58113891 1.05
tpch_q02/datafusion:vortex-compact 27527677 25357221 1.09
tpch_q03/datafusion:vortex-compact 31676962 28878964 1.10
tpch_q04/datafusion:vortex-compact 🚨 24592571 22282123 1.10
tpch_q05/datafusion:vortex-compact 🚨 54641817 49660500 1.10
tpch_q06/datafusion:vortex-compact 13702493 12528092 1.09
tpch_q07/datafusion:vortex-compact 🚨 64751884 58275676 1.11
tpch_q08/datafusion:vortex-compact 47084180 43247053 1.09
tpch_q09/datafusion:vortex-compact 59907368 55586916 1.08
tpch_q10/datafusion:vortex-compact 49311247 45049007 1.09
tpch_q11/datafusion:vortex-compact 18099347 16715365 1.08
tpch_q12/datafusion:vortex-compact 32596386 30285619 1.08
tpch_q13/datafusion:vortex-compact 32731532 31001711 1.06
tpch_q14/datafusion:vortex-compact 19911177 19096072 1.04
tpch_q15/datafusion:vortex-compact 31889773 31117819 1.02
tpch_q16/datafusion:vortex-compact 25890972 23651540 1.09
tpch_q17/datafusion:vortex-compact 74804890 70345605 1.06
tpch_q18/datafusion:vortex-compact 89975441 83834576 1.07
tpch_q19/datafusion:vortex-compact 32401988 30229593 1.07
tpch_q20/datafusion:vortex-compact 36645998 34385298 1.07
tpch_q21/datafusion:vortex-compact 81183912 75418278 1.08
tpch_q22/datafusion:vortex-compact 13516102 12566870 1.08
datafusion / parquet (1.053x ➖, 0↑ 3↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 131566536 127547433 1.03
tpch_q02/datafusion:parquet 62413158 62293069 1.00
tpch_q03/datafusion:parquet 75445934 72190028 1.05
tpch_q04/datafusion:parquet 45414707 43987512 1.03
tpch_q05/datafusion:parquet 94884462 95447339 0.99
tpch_q06/datafusion:parquet 33079433 33156857 1.00
tpch_q07/datafusion:parquet 110446695 105689547 1.05
tpch_q08/datafusion:parquet 98104736 99775568 0.98
tpch_q09/datafusion:parquet 132790570 124083753 1.07
tpch_q10/datafusion:parquet 116132292 108880094 1.07
tpch_q11/datafusion:parquet 43082740 40521181 1.06
tpch_q12/datafusion:parquet 79024968 78716124 1.00
tpch_q13/datafusion:parquet 208241313 192312735 1.08
tpch_q14/datafusion:parquet 47418150 45563713 1.04
tpch_q15/datafusion:parquet 61729948 57869293 1.07
tpch_q16/datafusion:parquet 🚨 43006589 39062802 1.10
tpch_q17/datafusion:parquet 🚨 156330788 134551280 1.16
tpch_q18/datafusion:parquet 174809637 159528844 1.10
tpch_q19/datafusion:parquet 🚨 71107741 61972688 1.15
tpch_q20/datafusion:parquet 68786801 66901007 1.03
tpch_q21/datafusion:parquet 142620448 132660494 1.08
tpch_q22/datafusion:parquet 31756573 30205245 1.05
datafusion / arrow (1.027x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 64039513 58222210 1.10
tpch_q02/datafusion:arrow 19172910 19693121 0.97
tpch_q03/datafusion:arrow 30889943 30709147 1.01
tpch_q04/datafusion:arrow 26912021 29177296 0.92
tpch_q05/datafusion:arrow 77367029 77707040 1.00
tpch_q06/datafusion:arrow 20821288 20677446 1.01
tpch_q07/datafusion:arrow 104579729 103477893 1.01
tpch_q08/datafusion:arrow 46873887 43962207 1.07
tpch_q09/datafusion:arrow 71372290 71162475 1.00
tpch_q10/datafusion:arrow 49764066 50883369 0.98
tpch_q11/datafusion:arrow 9946022 9454011 1.05
tpch_q12/datafusion:arrow 56497184 53078233 1.06
tpch_q13/datafusion:arrow 49296959 47220471 1.04
tpch_q14/datafusion:arrow 23490823 22851959 1.03
tpch_q15/datafusion:arrow 47745867 45677619 1.05
tpch_q16/datafusion:arrow 20479080 19522251 1.05
tpch_q17/datafusion:arrow 76135231 75099520 1.01
tpch_q18/datafusion:arrow 147491793 143420697 1.03
tpch_q19/datafusion:arrow 39226230 37431060 1.05
tpch_q20/datafusion:arrow 38937046 35804902 1.09
tpch_q21/datafusion:arrow 165880830 154321974 1.07
tpch_q22/datafusion:arrow 18777026 18327072 1.02
duckdb / vortex-file-compressed (1.087x ➖, 0↑ 8↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32452060 30969545 1.05
tpch_q02/duckdb:vortex-file-compressed 24937919 23703125 1.05
tpch_q03/duckdb:vortex-file-compressed 30797384 29364878 1.05
tpch_q04/duckdb:vortex-file-compressed 27972403 27152589 1.03
tpch_q05/duckdb:vortex-file-compressed 38867530 36274834 1.07
tpch_q06/duckdb:vortex-file-compressed 🚨 9514934 7992818 1.19
tpch_q07/duckdb:vortex-file-compressed 35986917 33546302 1.07
tpch_q08/duckdb:vortex-file-compressed 35836597 35253646 1.02
tpch_q09/duckdb:vortex-file-compressed 61983704 59142155 1.05
tpch_q10/duckdb:vortex-file-compressed 42980550 41875153 1.03
tpch_q11/duckdb:vortex-file-compressed 🚨 15389664 13404135 1.15
tpch_q12/duckdb:vortex-file-compressed 23140531 21218271 1.09
tpch_q13/duckdb:vortex-file-compressed 38623437 35410307 1.09
tpch_q14/duckdb:vortex-file-compressed 🚨 22967117 20171054 1.14
tpch_q15/duckdb:vortex-file-compressed 🚨 18665343 16464832 1.13
tpch_q16/duckdb:vortex-file-compressed 🚨 29050248 26332448 1.10
tpch_q17/duckdb:vortex-file-compressed 25489207 24216138 1.05
tpch_q18/duckdb:vortex-file-compressed 52962422 49640470 1.07
tpch_q19/duckdb:vortex-file-compressed 🚨 33357595 28891252 1.15
tpch_q20/duckdb:vortex-file-compressed 34959930 32183418 1.09
tpch_q21/duckdb:vortex-file-compressed 🚨 106883017 93733551 1.14
tpch_q22/duckdb:vortex-file-compressed 🚨 17008243 14984119 1.14
duckdb / vortex-compact (1.113x ❌, 0↑ 11↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39953930 38730131 1.03
tpch_q02/duckdb:vortex-compact 35264252 32151829 1.10
tpch_q03/duckdb:vortex-compact 🚨 35027100 31166033 1.12
tpch_q04/duckdb:vortex-compact 32416253 30838586 1.05
tpch_q05/duckdb:vortex-compact 43069119 40033552 1.08
tpch_q06/duckdb:vortex-compact 🚨 12065382 9700385 1.24
tpch_q07/duckdb:vortex-compact 41416479 39081146 1.06
tpch_q08/duckdb:vortex-compact 42661461 39107516 1.09
tpch_q09/duckdb:vortex-compact 🚨 73099053 64714536 1.13
tpch_q10/duckdb:vortex-compact 50872048 46643854 1.09
tpch_q11/duckdb:vortex-compact 🚨 20225406 16633687 1.22
tpch_q12/duckdb:vortex-compact 🚨 31518297 27714131 1.14
tpch_q13/duckdb:vortex-compact 🚨 47988452 42808851 1.12
tpch_q14/duckdb:vortex-compact 🚨 28333521 25200015 1.12
tpch_q15/duckdb:vortex-compact 🚨 22105922 19543207 1.13
tpch_q16/duckdb:vortex-compact 32805671 30378243 1.08
tpch_q17/duckdb:vortex-compact 30785000 28058066 1.10
tpch_q18/duckdb:vortex-compact 54408634 49925084 1.09
tpch_q19/duckdb:vortex-compact 🚨 37792852 32973781 1.15
tpch_q20/duckdb:vortex-compact 41330279 38780891 1.07
tpch_q21/duckdb:vortex-compact 🚨 112215992 97476041 1.15
tpch_q22/duckdb:vortex-compact 🚨 18586707 16042696 1.16
duckdb / parquet (1.034x ➖, 1↑ 3↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 79548798 77860516 1.02
tpch_q02/duckdb:parquet 40618642 38373045 1.06
tpch_q03/duckdb:parquet 71790604 78640769 0.91
tpch_q04/duckdb:parquet 49109588 47026783 1.04
tpch_q05/duckdb:parquet 69163881 64563778 1.07
tpch_q06/duckdb:parquet 20749149 19888195 1.04
tpch_q07/duckdb:parquet 73616117 67120464 1.10
tpch_q08/duckdb:parquet 82744499 90549541 0.91
tpch_q09/duckdb:parquet 🚨 156439829 142153171 1.10
tpch_q10/duckdb:parquet 130133095 124453706 1.05
tpch_q11/duckdb:parquet 22593110 20879048 1.08
tpch_q12/duckdb:parquet 47781654 45014539 1.06
tpch_q13/duckdb:parquet 🚨 282351231 245477841 1.15
tpch_q14/duckdb:parquet 50185895 48739538 1.03
tpch_q15/duckdb:parquet 🚀 24997968 31341290 0.80
tpch_q16/duckdb:parquet 59668447 55341882 1.08
tpch_q17/duckdb:parquet 55206669 54807159 1.01
tpch_q18/duckdb:parquet 113604655 114146073 1.00
tpch_q19/duckdb:parquet 🚨 74813217 67846251 1.10
tpch_q20/duckdb:parquet 65660775 62532005 1.05
tpch_q21/duckdb:parquet 181096549 165404015 1.09
tpch_q22/duckdb:parquet 54252918 51738666 1.05
duckdb / duckdb (1.088x ➖, 0↑ 10↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16922862 15886490 1.07
tpch_q02/duckdb:duckdb 14331843 13162787 1.09
tpch_q03/duckdb:duckdb 20249935 19367103 1.05
tpch_q04/duckdb:duckdb 20284910 18540093 1.09
tpch_q05/duckdb:duckdb 21111065 20649718 1.02
tpch_q06/duckdb:duckdb 🚨 5900865 5362160 1.10
tpch_q07/duckdb:duckdb 🚨 25644483 22568673 1.14
tpch_q08/duckdb:duckdb 22992973 21413001 1.07
tpch_q09/duckdb:duckdb 🚨 62998920 54518494 1.16
tpch_q10/duckdb:duckdb 🚨 47821356 42785343 1.12
tpch_q11/duckdb:duckdb 🚨 6747190 5741184 1.18
tpch_q12/duckdb:duckdb 🚨 15982154 13921992 1.15
tpch_q13/duckdb:duckdb 41104420 38421148 1.07
tpch_q14/duckdb:duckdb 18366759 17314346 1.06
tpch_q15/duckdb:duckdb 12445480 12757068 0.98
tpch_q16/duckdb:duckdb 🚨 25190072 22479343 1.12
tpch_q17/duckdb:duckdb 🚨 15374296 13598558 1.13
tpch_q18/duckdb:duckdb 39750555 38270610 1.04
tpch_q19/duckdb:duckdb 🚨 30264747 27254472 1.11
tpch_q20/duckdb:duckdb 23402335 22321474 1.05
tpch_q21/duckdb:duckdb 🚨 62735698 56002640 1.12
tpch_q22/duckdb:duckdb 25803005 24160305 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +10.0% +2.7% +7.1% +20.1% ➖ noise
1 datafusion:vortex-compact +5.4% +2.7% +2.6% +17.3% ➖ noise
1 datafusion:vortex-file-compressed +4.3% +2.7% +1.6% +16.7% ➖ noise
1 duckdb:duckdb +6.5% +2.7% +3.8% +15.8% ➖ noise
1 duckdb:vortex-compact +3.2% +2.7% +0.5% +15.7% ➖ noise
1 duckdb:vortex-file-compressed +4.8% +2.7% +2.1% +19.8% ➖ noise
2 datafusion:arrow -2.6% +3.0% -5.5% +13.1% ➖ noise
2 datafusion:vortex-compact +8.6% +3.0% +5.4% +13.1% ➖ noise
2 datafusion:vortex-file-compressed +8.9% +3.0% +5.8% +13.1% ➖ noise
2 duckdb:duckdb +8.9% +3.0% +5.7% +13.1% ➖ noise
2 duckdb:vortex-compact +9.7% +3.0% +6.5% +13.1% ➖ noise
2 duckdb:vortex-file-compressed +5.2% +3.0% +2.2% +13.1% ➖ noise
3 datafusion:arrow +0.6% -2.3% +3.0% +13.1% ➖ noise
3 datafusion:vortex-compact +9.7% -2.3% +12.3% +13.1% ➖ noise
3 datafusion:vortex-file-compressed +12.8% -2.3% +15.5% +13.1% 🚨 regression
3 duckdb:duckdb +4.6% -2.3% +7.0% +13.1% ➖ noise
3 duckdb:vortex-compact +12.4% -2.3% +15.1% +13.1% 🚨 regression
3 duckdb:vortex-file-compressed +4.9% -2.3% +7.4% +14.0% ➖ noise
4 datafusion:arrow -7.8% +3.8% -11.2% +13.1% ➖ noise
4 datafusion:vortex-compact +10.4% +3.8% +6.3% +13.1% ➖ noise
4 datafusion:vortex-file-compressed +7.3% +3.8% +3.4% +13.1% ➖ noise
4 duckdb:duckdb +9.4% +3.8% +5.4% +13.1% ➖ noise
4 duckdb:vortex-compact +5.1% +3.8% +1.2% +13.1% ➖ noise
4 duckdb:vortex-file-compressed +3.0% +3.8% -0.8% +13.1% ➖ noise
5 datafusion:arrow -0.4% +3.2% -3.5% +13.1% ➖ noise
5 datafusion:vortex-compact +10.0% +3.2% +6.6% +13.1% ➖ noise
5 datafusion:vortex-file-compressed +8.0% +3.2% +4.6% +13.1% ➖ noise
5 duckdb:duckdb +2.2% +3.2% -0.9% +13.1% ➖ noise
5 duckdb:vortex-compact +7.6% +3.2% +4.3% +13.1% ➖ noise
5 duckdb:vortex-file-compressed +7.1% +3.2% +3.8% +13.1% ➖ noise
6 datafusion:arrow +0.7% +2.0% -1.3% +15.5% ➖ noise
6 datafusion:vortex-compact +9.4% +2.0% +7.2% +17.1% ➖ noise
6 datafusion:vortex-file-compressed +11.7% +2.0% +9.5% +18.6% ➖ noise
6 duckdb:duckdb +10.0% +2.0% +7.9% +17.4% ➖ noise
6 duckdb:vortex-compact +24.4% +2.0% +21.9% +19.7% 🚨 regression
6 duckdb:vortex-file-compressed +19.0% +2.0% +16.7% +18.2% ➖ noise
7 datafusion:arrow +1.1% +7.1% -5.6% +13.1% ➖ noise
7 datafusion:vortex-compact +11.1% +7.1% +3.8% +13.1% ➖ noise
7 datafusion:vortex-file-compressed +6.8% +7.1% -0.2% +13.1% ➖ noise
7 duckdb:duckdb +13.6% +7.1% +6.1% +13.1% ➖ noise
7 duckdb:vortex-compact +6.0% +7.1% -1.0% +13.1% ➖ noise
7 duckdb:vortex-file-compressed +7.3% +7.1% +0.2% +13.1% ➖ noise
8 datafusion:arrow +6.6% -5.2% +12.5% +13.1% ➖ noise
8 datafusion:vortex-compact +8.9% -5.2% +14.9% +13.1% 🚨 regression
8 datafusion:vortex-file-compressed +11.8% -5.2% +17.9% +13.1% 🚨 regression
8 duckdb:duckdb +7.4% -5.2% +13.3% +13.1% 🚨 regression
8 duckdb:vortex-compact +9.1% -5.2% +15.1% +13.1% 🚨 regression
8 duckdb:vortex-file-compressed +1.7% -5.2% +7.2% +13.1% ➖ noise
9 datafusion:arrow +0.3% +8.5% -7.6% +13.1% ➖ noise
9 datafusion:vortex-compact +7.8% +8.5% -0.7% +13.1% ➖ noise
9 datafusion:vortex-file-compressed +5.7% +8.5% -2.6% +13.1% ➖ noise
9 duckdb:duckdb +15.6% +8.5% +6.5% +13.1% ➖ noise
9 duckdb:vortex-compact +13.0% +8.5% +4.1% +13.1% ➖ noise
9 duckdb:vortex-file-compressed +4.8% +8.5% -3.4% +13.1% ➖ noise
10 datafusion:arrow -2.2% +5.6% -7.4% +13.1% ➖ noise
10 datafusion:vortex-compact +9.5% +5.6% +3.6% +13.1% ➖ noise
10 datafusion:vortex-file-compressed +8.1% +5.6% +2.4% +13.1% ➖ noise
10 duckdb:duckdb +11.8% +5.6% +5.8% +13.2% ➖ noise
10 duckdb:vortex-compact +9.1% +5.6% +3.3% +13.1% ➖ noise
10 duckdb:vortex-file-compressed +2.6% +5.6% -2.8% +13.1% ➖ noise
11 datafusion:arrow +5.2% +7.3% -1.9% +13.1% ➖ noise
11 datafusion:vortex-compact +8.3% +7.3% +0.9% +13.1% ➖ noise
11 datafusion:vortex-file-compressed +11.0% +7.3% +3.5% +13.1% ➖ noise
11 duckdb:duckdb +17.5% +7.3% +9.6% +13.7% ➖ noise
11 duckdb:vortex-compact +21.6% +7.3% +13.4% +13.1% 🚨 regression
11 duckdb:vortex-file-compressed +14.8% +7.3% +7.0% +13.9% ➖ noise
12 datafusion:arrow +6.4% +3.2% +3.1% +18.1% ➖ noise
12 datafusion:vortex-compact +7.6% +3.2% +4.3% +13.1% ➖ noise
12 datafusion:vortex-file-compressed +8.7% +3.2% +5.3% +13.1% ➖ noise
12 duckdb:duckdb +14.8% +3.2% +11.2% +13.1% ➖ noise
12 duckdb:vortex-compact +13.7% +3.2% +10.2% +13.1% ➖ noise
12 duckdb:vortex-file-compressed +9.1% +3.2% +5.6% +13.1% ➖ noise
13 datafusion:arrow +4.4% +11.6% -6.5% +13.1% ➖ noise
13 datafusion:vortex-compact +5.6% +11.6% -5.4% +13.1% ➖ noise
13 datafusion:vortex-file-compressed +3.7% +11.6% -7.1% +13.1% ➖ noise
13 duckdb:duckdb +7.0% +11.6% -4.1% +13.1% ➖ noise
13 duckdb:vortex-compact +12.1% +11.6% +0.4% +13.1% ➖ noise
13 duckdb:vortex-file-compressed +9.1% +11.6% -2.3% +13.1% ➖ noise
14 datafusion:arrow +2.8% +3.5% -0.7% +13.1% ➖ noise
14 datafusion:vortex-compact +4.3% +3.5% +0.7% +13.1% ➖ noise
14 datafusion:vortex-file-compressed +8.0% +3.5% +4.3% +13.1% ➖ noise
14 duckdb:duckdb +6.1% +3.5% +2.5% +16.3% ➖ noise
14 duckdb:vortex-compact +12.4% +3.5% +8.6% +13.1% ➖ noise
14 duckdb:vortex-file-compressed +13.9% +3.5% +10.0% +13.1% ➖ noise
15 datafusion:arrow +4.5% -7.8% +13.3% +13.1% 🚨 regression
15 datafusion:vortex-compact +2.5% -7.8% +11.1% +13.1% ➖ noise
15 datafusion:vortex-file-compressed +5.3% -7.8% +14.1% +13.1% 🚨 regression
15 duckdb:duckdb -2.4% -7.8% +5.8% +16.7% ➖ noise
15 duckdb:vortex-compact +13.1% -7.8% +22.6% +13.1% 🚨 regression
15 duckdb:vortex-file-compressed +13.4% -7.8% +22.9% +13.1% 🚨 regression
16 datafusion:arrow +4.9% +9.0% -3.7% +13.1% ➖ noise
16 datafusion:vortex-compact +9.5% +9.0% +0.5% +13.1% ➖ noise
16 datafusion:vortex-file-compressed +6.3% +9.0% -2.5% +13.1% ➖ noise
16 duckdb:duckdb +12.1% +9.0% +2.9% +13.1% ➖ noise
16 duckdb:vortex-compact +8.0% +9.0% -0.9% +13.1% ➖ noise
16 duckdb:vortex-file-compressed +10.3% +9.0% +1.3% +13.1% ➖ noise
17 datafusion:arrow +1.4% +8.2% -6.3% +13.1% ➖ noise
17 datafusion:vortex-compact +6.3% +8.2% -1.7% +13.1% ➖ noise
17 datafusion:vortex-file-compressed +10.3% +8.2% +2.0% +13.1% ➖ noise
17 duckdb:duckdb +13.1% +8.2% +4.5% +13.1% ➖ noise
17 duckdb:vortex-compact +9.7% +8.2% +1.4% +13.1% ➖ noise
17 duckdb:vortex-file-compressed +5.3% +8.2% -2.7% +13.1% ➖ noise
18 datafusion:arrow +2.8% +4.4% -1.5% +13.1% ➖ noise
18 datafusion:vortex-compact +7.3% +4.4% +2.8% +13.1% ➖ noise
18 datafusion:vortex-file-compressed +9.0% +4.4% +4.4% +13.1% ➖ noise
18 duckdb:duckdb +3.9% +4.4% -0.5% +13.1% ➖ noise
18 duckdb:vortex-compact +9.0% +4.4% +4.4% +13.1% ➖ noise
18 duckdb:vortex-file-compressed +6.7% +4.4% +2.2% +13.1% ➖ noise
19 datafusion:arrow +4.8% +12.5% -6.8% +15.6% ➖ noise
19 datafusion:vortex-compact +7.2% +12.5% -4.7% +13.1% ➖ noise
19 datafusion:vortex-file-compressed +15.7% +12.5% +2.9% +13.1% ➖ noise
19 duckdb:duckdb +11.0% +12.5% -1.3% +13.3% ➖ noise
19 duckdb:vortex-compact +14.6% +12.5% +1.9% +13.1% ➖ noise
19 duckdb:vortex-file-compressed +15.5% +12.5% +2.6% +13.1% ➖ noise
20 datafusion:arrow +8.7% +3.9% +4.7% +14.2% ➖ noise
20 datafusion:vortex-compact +6.6% +3.9% +2.6% +13.1% ➖ noise
20 datafusion:vortex-file-compressed +6.8% +3.9% +2.8% +13.1% ➖ noise
20 duckdb:duckdb +4.8% +3.9% +0.9% +13.1% ➖ noise
20 duckdb:vortex-compact +6.6% +3.9% +2.6% +13.1% ➖ noise
20 duckdb:vortex-file-compressed +8.6% +3.9% +4.5% +13.1% ➖ noise
21 datafusion:arrow +7.5% +8.5% -0.9% +13.1% ➖ noise
21 datafusion:vortex-compact +7.6% +8.5% -0.8% +13.1% ➖ noise
21 datafusion:vortex-file-compressed +9.3% +8.5% +0.7% +13.1% ➖ noise
21 duckdb:duckdb +12.0% +8.5% +3.3% +13.1% ➖ noise
21 duckdb:vortex-compact +15.1% +8.5% +6.1% +13.1% ➖ noise
21 duckdb:vortex-file-compressed +14.0% +8.5% +5.1% +13.1% ➖ noise
22 datafusion:arrow +2.5% +5.0% -2.4% +13.1% ➖ noise
22 datafusion:vortex-compact +7.6% +5.0% +2.4% +13.1% ➖ noise
22 datafusion:vortex-file-compressed +8.8% +5.0% +3.6% +13.1% ➖ noise
22 duckdb:duckdb +6.8% +5.0% +1.7% +13.1% ➖ noise
22 duckdb:vortex-compact +15.9% +5.0% +10.3% +13.1% ➖ noise
22 duckdb:vortex-file-compressed +13.5% +5.0% +8.1% +15.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.7%
Vortex (geomean): 0.974x ➖
Parquet (geomean): 1.011x ➖
Shifts: Parquet (control) +1.1% · Median polish +0.2%


datafusion / vortex-file-compressed (1.088x ➖, 0↑ 1↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 52855295 54908126 0.96
fineweb_q01/datafusion:vortex-file-compressed 🚨 891340828 511649945 1.74
fineweb_q02/datafusion:vortex-file-compressed 466516703 469629682 0.99
fineweb_q03/datafusion:vortex-file-compressed 1403226847 1347448352 1.04
fineweb_q04/datafusion:vortex-file-compressed 1512467646 1419397893 1.07
fineweb_q05/datafusion:vortex-file-compressed 1374190407 1366719863 1.01
fineweb_q06/datafusion:vortex-file-compressed 1674628553 1451935348 1.15
fineweb_q07/datafusion:vortex-file-compressed 1374204628 1425324256 0.96
fineweb_q08/datafusion:vortex-file-compressed 605450132 584385932 1.04
datafusion / vortex-compact (0.865x ➖, 2↑ 1↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 29193205 39506664 0.74
fineweb_q01/datafusion:vortex-compact 592351963 620648848 0.95
fineweb_q02/datafusion:vortex-compact 🚨 700672848 522624966 1.34
fineweb_q03/datafusion:vortex-compact 1442966693 1508200421 0.96
fineweb_q04/datafusion:vortex-compact 1530762138 2117564933 0.72
fineweb_q05/datafusion:vortex-compact 🚀 1382943790 1990570168 0.69
fineweb_q06/datafusion:vortex-compact 🚀 1278975666 2241613437 0.57
fineweb_q07/datafusion:vortex-compact 1452850174 1151980475 1.26
fineweb_q08/datafusion:vortex-compact 388889414 467831898 0.83
datafusion / parquet (0.990x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1536034401 1559015517 0.99
fineweb_q01/datafusion:parquet 2170589552 2084022969 1.04
fineweb_q02/datafusion:parquet 2249285465 2090231208 1.08
fineweb_q03/datafusion:parquet 2023540875 2022288015 1.00
fineweb_q04/datafusion:parquet 1976732398 1903473974 1.04
fineweb_q05/datafusion:parquet 1952122069 2083622438 0.94
fineweb_q06/datafusion:parquet 1940697287 2062407573 0.94
fineweb_q07/datafusion:parquet 2105438766 2064864824 1.02
fineweb_q08/datafusion:parquet 1931948832 2178650719 0.89
duckdb / vortex-file-compressed (0.935x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 82442804 86712420 0.95
fineweb_q01/duckdb:vortex-file-compressed 650227548 721351653 0.90
fineweb_q02/duckdb:vortex-file-compressed 530099984 691230389 0.77
fineweb_q03/duckdb:vortex-file-compressed 1667329890 1597312716 1.04
fineweb_q04/duckdb:vortex-file-compressed 1802238859 1747609710 1.03
fineweb_q05/duckdb:vortex-file-compressed 1644415597 1731985032 0.95
fineweb_q06/duckdb:vortex-file-compressed 1758597150 1896295553 0.93
fineweb_q07/duckdb:vortex-file-compressed 1542376808 1724511578 0.89
fineweb_q08/duckdb:vortex-file-compressed 652040811 663832000 0.98
duckdb / vortex-compact (1.021x ➖, 0↑ 1↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 86088591 84893346 1.01
fineweb_q01/duckdb:vortex-compact 677541374 583704326 1.16
fineweb_q02/duckdb:vortex-compact 🚨 834610848 585322507 1.43
fineweb_q03/duckdb:vortex-compact 1742140147 1988234686 0.88
fineweb_q04/duckdb:vortex-compact 1799156433 2175147969 0.83
fineweb_q05/duckdb:vortex-compact 1629394239 1894825955 0.86
fineweb_q06/duckdb:vortex-compact 1487781546 1675056895 0.89
fineweb_q07/duckdb:vortex-compact 1572674875 1543971732 1.02
fineweb_q08/duckdb:vortex-compact 585441768 460960357 1.27
duckdb / parquet (1.032x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1376364850 1191802558 1.15
fineweb_q01/duckdb:parquet 1448358299 1482182568 0.98
fineweb_q02/duckdb:parquet 1477047305 1353048609 1.09
fineweb_q03/duckdb:parquet 3888734081 3856351795 1.01
fineweb_q04/duckdb:parquet 1997645568 2029278002 0.98
fineweb_q05/duckdb:parquet 2366667871 2295255877 1.03
fineweb_q06/duckdb:parquet 4656590640 4576455058 1.02
fineweb_q07/duckdb:parquet 2841742026 2777885545 1.02
fineweb_q08/duckdb:parquet 1211893820 1202256295 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -26.1% +6.7% -30.7% +222.8% ➖ noise
0 datafusion:vortex-file-compressed -3.7% +6.7% -9.8% +264.2% ➖ noise
0 duckdb:vortex-compact +1.4% +6.7% -4.9% +47.4% ➖ noise
0 duckdb:vortex-file-compressed -4.9% +6.7% -10.9% +40.6% ➖ noise
1 datafusion:vortex-compact -4.6% +0.9% -5.4% +60.2% ➖ noise
1 datafusion:vortex-file-compressed +74.2% +0.9% +72.7% +74.1% ➖ noise
1 duckdb:vortex-compact +16.1% +0.9% +15.1% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -9.9% +0.9% -10.7% +30.0% ➖ noise
2 datafusion:vortex-compact +34.1% +8.4% +23.7% +39.2% ➖ noise
2 datafusion:vortex-file-compressed -0.7% +8.4% -8.3% +49.1% ➖ noise
2 duckdb:vortex-compact +42.6% +8.4% +31.6% +72.8% ➖ noise
2 duckdb:vortex-file-compressed -23.3% +8.4% -29.2% +66.3% ➖ noise
3 datafusion:vortex-compact -4.3% +0.5% -4.8% +36.6% ➖ noise
3 datafusion:vortex-file-compressed +4.1% +0.5% +3.7% +30.0% ➖ noise
3 duckdb:vortex-compact -12.4% +0.5% -12.8% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +4.4% +0.5% +3.9% +30.0% ➖ noise
4 datafusion:vortex-compact -27.7% +1.1% -28.5% +39.6% ✅ faster
4 datafusion:vortex-file-compressed +6.6% +1.1% +5.4% +30.0% ➖ noise
4 duckdb:vortex-compact -17.3% +1.1% -18.2% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +3.1% +1.1% +2.0% +30.0% ➖ noise
5 datafusion:vortex-compact -30.5% -1.7% -29.3% +35.9% ✅ faster
5 datafusion:vortex-file-compressed +0.5% -1.7% +2.3% +30.0% ➖ noise
5 duckdb:vortex-compact -14.0% -1.7% -12.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -5.1% -1.7% -3.4% +30.0% ➖ noise
6 datafusion:vortex-compact -42.9% -2.1% -41.7% +53.5% ✅ faster
6 datafusion:vortex-file-compressed +15.3% -2.1% +17.9% +30.0% ➖ noise
6 duckdb:vortex-compact -11.2% -2.1% -9.2% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -7.3% -2.1% -5.2% +30.0% ➖ noise
7 datafusion:vortex-compact +26.1% +2.1% +23.5% +38.4% ➖ noise
7 datafusion:vortex-file-compressed -3.6% +2.1% -5.6% +30.0% ➖ noise
7 duckdb:vortex-compact +1.9% +2.1% -0.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -10.6% +2.1% -12.4% +30.0% ➖ noise
8 datafusion:vortex-compact -16.9% -5.5% -12.1% +30.7% ➖ noise
8 datafusion:vortex-file-compressed +3.6% -5.5% +9.6% +30.0% ➖ noise
8 duckdb:vortex-compact +27.0% -5.5% +34.3% +30.0% 🚨 regression
8 duckdb:vortex-file-compressed -1.8% -5.5% +3.9% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Vortex (geomean): 1.009x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish +1.0%


duckdb / vortex-file-compressed (1.009x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11754583 11261306 1.04
statpopgen_q01/duckdb:vortex-file-compressed 25856216 26562321 0.97
statpopgen_q02/duckdb:vortex-file-compressed 564385272 540219689 1.04
statpopgen_q03/duckdb:vortex-file-compressed 1049378628 1054332091 1.00
statpopgen_q04/duckdb:vortex-file-compressed 1057411586 1066137681 0.99
statpopgen_q05/duckdb:vortex-file-compressed 466822722 495851571 0.94
statpopgen_q06/duckdb:vortex-file-compressed 1560381678 1565746565 1.00
statpopgen_q07/duckdb:vortex-file-compressed 221704958 211323386 1.05
statpopgen_q08/duckdb:vortex-file-compressed 246600788 243888387 1.01
statpopgen_q09/duckdb:vortex-file-compressed 854302733 814337118 1.05
statpopgen_q10/duckdb:vortex-file-compressed 2859354879 2821207305 1.01
duckdb / vortex-compact (1.008x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11258570 11588711 0.97
statpopgen_q01/duckdb:vortex-compact 228734053 213995528 1.07
statpopgen_q02/duckdb:vortex-compact 550789325 554158815 0.99
statpopgen_q03/duckdb:vortex-compact 1163036044 1154284891 1.01
statpopgen_q04/duckdb:vortex-compact 1166537897 1146121064 1.02
statpopgen_q05/duckdb:vortex-compact 569074342 587498016 0.97
statpopgen_q06/duckdb:vortex-compact 1485717650 1504469504 0.99
statpopgen_q07/duckdb:vortex-compact 915264483 890922009 1.03
statpopgen_q08/duckdb:vortex-compact 950176941 926272484 1.03
statpopgen_q09/duckdb:vortex-compact 918463584 908292288 1.01
statpopgen_q10/duckdb:vortex-compact 2904362652 2874722074 1.01
duckdb / parquet (1.013x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 332798385 328271391 1.01
statpopgen_q01/duckdb:parquet 418643273 403238669 1.04
statpopgen_q02/duckdb:parquet 990135874 997864024 0.99
statpopgen_q03/duckdb:parquet 1531821236 1511251388 1.01
statpopgen_q04/duckdb:parquet 1523666734 1525235471 1.00
statpopgen_q05/duckdb:parquet 1021030894 1015042637 1.01
statpopgen_q06/duckdb:parquet 1509230598 1511149914 1.00
statpopgen_q07/duckdb:parquet 1311838212 1281576250 1.02
statpopgen_q08/duckdb:parquet 1305996771 1279075183 1.02
statpopgen_q09/duckdb:parquet 1425915311 1393474177 1.02
statpopgen_q10/duckdb:parquet 2711334471 2684585460 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -2.8% +1.4% -4.2% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +4.4% +1.4% +3.0% +10.0% ➖ noise
1 duckdb:vortex-compact +6.9% +3.8% +3.0% +11.8% ➖ noise
1 duckdb:vortex-file-compressed -2.7% +3.8% -6.2% +222.2% ➖ noise
2 duckdb:vortex-compact -0.6% -0.8% +0.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +4.5% -0.8% +5.3% +10.0% ➖ noise
3 duckdb:vortex-compact +0.8% +1.4% -0.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.5% +1.4% -1.8% +10.0% ➖ noise
4 duckdb:vortex-compact +1.8% -0.1% +1.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.8% -0.1% -0.7% +10.0% ➖ noise
5 duckdb:vortex-compact -3.1% +0.6% -3.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -5.9% +0.6% -6.4% +10.0% ➖ noise
6 duckdb:vortex-compact -1.2% -0.1% -1.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.3% -0.1% -0.2% +10.0% ➖ noise
7 duckdb:vortex-compact +2.7% +2.4% +0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.9% +2.4% +2.5% +10.0% ➖ noise
8 duckdb:vortex-compact +2.6% +2.1% +0.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.1% +2.1% -1.0% +10.0% ➖ noise
9 duckdb:vortex-compact +1.1% +2.3% -1.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +4.9% +2.3% +2.5% +10.0% ➖ noise
10 duckdb:vortex-compact +1.0% +1.0% +0.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.4% +1.0% +0.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.991x ➖
Parquet (geomean): 1.051x ➖


unknown / unknown (1.054x ➖, 3↑ 4↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 1739718 404535 4.30
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1083349 1036397 1.05
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8716973912 8149619983 1.07
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8682499339 8195729595 1.06
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 8425553 13947139 0.60
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7981184 8300109 0.96
random-access/feature-vectors/uniform/lance-tokio-local-disk 1247415 1156808 1.08
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1960216 1802551 1.09
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8679570704 8168247918 1.06
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8768203682 8125757961 1.08
random-access/feature-vectors/uniform/vortex-tokio-local-disk 14415880 13242035 1.09
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 14054520 13071618 1.08
random-access/lance-tokio-local-disk 658805 648660 1.02
random-access/lance-tokio-local-disk-footer 1348226 1355229 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk 236655 241632 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 607099 622686 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk 135254351 126075459 1.07
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 135747940 124787663 1.09
random-access/nested-lists/correlated/vortex-tokio-local-disk 732792 685002 1.07
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 735744 649536 1.13
random-access/nested-lists/uniform/lance-tokio-local-disk 1050579 1032998 1.02
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1439286 1354255 1.06
random-access/nested-lists/uniform/parquet-tokio-local-disk 135199199 125219367 1.08
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 135290345 125976550 1.07
random-access/nested-lists/uniform/vortex-tokio-local-disk 2361022 2547282 0.93
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2339310 2235103 1.05
random-access/nested-structs/correlated/lance-tokio-local-disk 384700 364607 1.06
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 568881 576403 0.99
random-access/nested-structs/correlated/parquet-tokio-local-disk 23744810 23627197 1.00
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 24088176 23141752 1.04
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚨 877364 741618 1.18
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 834797 949703 0.88
random-access/nested-structs/uniform/lance-tokio-local-disk 2671483 2440465 1.09
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 🚨 2915600 2602328 1.12
random-access/nested-structs/uniform/parquet-tokio-local-disk 23710763 23172705 1.02
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 23546497 23226856 1.01
random-access/nested-structs/uniform/vortex-tokio-local-disk 1826969 1987336 0.92
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1798792 1648486 1.09
random-access/parquet-tokio-local-disk 177571703 168013149 1.06
random-access/parquet-tokio-local-disk-footer 177892761 167810449 1.06
random-access/taxi/correlated/lance-tokio-local-disk 969913 943279 1.03
random-access/taxi/correlated/lance-tokio-local-disk-footer 1998073 1824428 1.10
random-access/taxi/correlated/parquet-tokio-local-disk 264988495 274357354 0.97
random-access/taxi/correlated/parquet-tokio-local-disk-footer 265524834 253921393 1.05
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1994818 2246145 0.89
random-access/taxi/correlated/vortex-tokio-local-disk-footer 2007533 2222796 0.90
random-access/taxi/uniform/lance-tokio-local-disk 9677167 9460505 1.02
random-access/taxi/uniform/lance-tokio-local-disk-footer 10375248 10044301 1.03
random-access/taxi/uniform/parquet-tokio-local-disk 284488116 268104726 1.06
random-access/taxi/uniform/parquet-tokio-local-disk-footer 285841601 268735660 1.06
random-access/taxi/uniform/vortex-tokio-local-disk 4948029 4634442 1.07
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4935876 4516301 1.09
random-access/vortex-tokio-local-disk 1301981 1247967 1.04
random-access/vortex-tokio-local-disk-footer 1330432 1276028 1.04

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 1.043x ➖
Parquet (geomean): 1.042x ➖
Shifts: Parquet (control) +4.2% · Median polish +4.6%


datafusion / vortex-file-compressed (1.075x ➖, 1↑ 19↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1672874 1621540 1.03
clickbench_q01/datafusion:vortex-file-compressed 19503138 18876361 1.03
clickbench_q02/datafusion:vortex-file-compressed 39946343 37846876 1.06
clickbench_q03/datafusion:vortex-file-compressed 46131080 42126702 1.10
clickbench_q04/datafusion:vortex-file-compressed 311803246 287853453 1.08
clickbench_q05/datafusion:vortex-file-compressed 🚨 340554695 304509334 1.12
clickbench_q06/datafusion:vortex-file-compressed 1676889 1659373 1.01
clickbench_q07/datafusion:vortex-file-compressed 🚨 24959148 22296931 1.12
clickbench_q08/datafusion:vortex-file-compressed 🚨 392157650 346346486 1.13
clickbench_q09/datafusion:vortex-file-compressed 🚨 605837882 549334620 1.10
clickbench_q10/datafusion:vortex-file-compressed 🚨 78702986 71087241 1.11
clickbench_q11/datafusion:vortex-file-compressed 92419349 87509204 1.06
clickbench_q12/datafusion:vortex-file-compressed 289802040 264890389 1.09
clickbench_q13/datafusion:vortex-file-compressed 🚨 460447205 409837780 1.12
clickbench_q14/datafusion:vortex-file-compressed 🚨 279759763 252953553 1.11
clickbench_q15/datafusion:vortex-file-compressed 🚨 360293791 323391279 1.11
clickbench_q16/datafusion:vortex-file-compressed 🚨 725531958 642865445 1.13
clickbench_q17/datafusion:vortex-file-compressed 🚨 723254617 630570654 1.15
clickbench_q18/datafusion:vortex-file-compressed 🚨 1418736250 1276654823 1.11
clickbench_q19/datafusion:vortex-file-compressed 🚨 39756485 35975371 1.11
clickbench_q20/datafusion:vortex-file-compressed 358825593 348164237 1.03
clickbench_q21/datafusion:vortex-file-compressed 🚨 411534956 371584711 1.11
clickbench_q22/datafusion:vortex-file-compressed 489358145 448979168 1.09
clickbench_q23/datafusion:vortex-file-compressed 🚨 692740392 622862206 1.11
clickbench_q24/datafusion:vortex-file-compressed 48324062 46698712 1.03
clickbench_q25/datafusion:vortex-file-compressed 78305506 72455023 1.08
clickbench_q26/datafusion:vortex-file-compressed 46627184 45194367 1.03
clickbench_q27/datafusion:vortex-file-compressed 779545840 726375720 1.07
clickbench_q28/datafusion:vortex-file-compressed 6895897903 6658937354 1.04
clickbench_q29/datafusion:vortex-file-compressed 240104668 253075421 0.95
clickbench_q30/datafusion:vortex-file-compressed 🚀 243670382 281361692 0.87
clickbench_q31/datafusion:vortex-file-compressed 282511080 299158825 0.94
clickbench_q32/datafusion:vortex-file-compressed 🚨 1210211212 1079651243 1.12
clickbench_q33/datafusion:vortex-file-compressed 🚨 1416542506 1282572619 1.10
clickbench_q34/datafusion:vortex-file-compressed 1428888484 1308211897 1.09
clickbench_q35/datafusion:vortex-file-compressed 🚨 487813577 439315727 1.11
clickbench_q36/datafusion:vortex-file-compressed 🚨 76658982 67331736 1.14
clickbench_q37/datafusion:vortex-file-compressed 37342890 34328500 1.09
clickbench_q38/datafusion:vortex-file-compressed 19362450 18400370 1.05
clickbench_q39/datafusion:vortex-file-compressed 140270397 130406008 1.08
clickbench_q40/datafusion:vortex-file-compressed 16461239 15460009 1.06
clickbench_q41/datafusion:vortex-file-compressed 🚨 15904359 14141831 1.12
clickbench_q42/datafusion:vortex-file-compressed 18009745 16621085 1.08
datafusion / parquet (1.055x ➖, 1↑ 8↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1550723 1550618 1.00
clickbench_q01/datafusion:parquet 19440986 19043714 1.02
clickbench_q02/datafusion:parquet 47998705 47317439 1.01
clickbench_q03/datafusion:parquet 39277073 38494403 1.02
clickbench_q04/datafusion:parquet 317879560 300430796 1.06
clickbench_q05/datafusion:parquet 🚨 381333328 334876624 1.14
clickbench_q06/datafusion:parquet 1584643 1616314 0.98
clickbench_q07/datafusion:parquet 23110611 22007435 1.05
clickbench_q08/datafusion:parquet 🚨 400247525 360579452 1.11
clickbench_q09/datafusion:parquet 666051036 619620719 1.07
clickbench_q10/datafusion:parquet 112594581 103811601 1.08
clickbench_q11/datafusion:parquet 🚨 143035362 129154504 1.11
clickbench_q12/datafusion:parquet 🚨 381015639 335934973 1.13
clickbench_q13/datafusion:parquet 535705941 492525996 1.09
clickbench_q14/datafusion:parquet 369431914 339393620 1.09
clickbench_q15/datafusion:parquet 363262232 334423604 1.09
clickbench_q16/datafusion:parquet 🚨 727948301 648148606 1.12
clickbench_q17/datafusion:parquet 698969067 641659020 1.09
clickbench_q18/datafusion:parquet 🚨 1462016842 1312221023 1.11
clickbench_q19/datafusion:parquet 30391408 28898131 1.05
clickbench_q20/datafusion:parquet 642475923 609000386 1.05
clickbench_q21/datafusion:parquet 713638251 750636545 0.95
clickbench_q22/datafusion:parquet 1058317492 1109574299 0.95
clickbench_q23/datafusion:parquet 3969677140 3678953386 1.08
clickbench_q24/datafusion:parquet 85636289 85328070 1.00
clickbench_q25/datafusion:parquet 141111023 134154302 1.05
clickbench_q26/datafusion:parquet 89423722 83516467 1.07
clickbench_q27/datafusion:parquet 1118974162 1048869360 1.07
clickbench_q28/datafusion:parquet 6859695859 6618563757 1.04
clickbench_q29/datafusion:parquet 242568476 235018096 1.03
clickbench_q30/datafusion:parquet 346058341 322102309 1.07
clickbench_q31/datafusion:parquet 394753832 365926181 1.08
clickbench_q32/datafusion:parquet 🚨 1345412615 1175558565 1.14
clickbench_q33/datafusion:parquet 1623403639 1483834587 1.09
clickbench_q34/datafusion:parquet 🚀 1630921006 1878209801 0.87
clickbench_q35/datafusion:parquet 499011889 548395106 0.91
clickbench_q36/datafusion:parquet 149691517 137546511 1.09
clickbench_q37/datafusion:parquet 60390474 55574367 1.09
clickbench_q38/datafusion:parquet 🚨 90683943 82034476 1.11
clickbench_q39/datafusion:parquet 269120439 252068694 1.07
clickbench_q40/datafusion:parquet 31655934 29917251 1.06
clickbench_q41/datafusion:parquet 28838680 26276856 1.10
clickbench_q42/datafusion:parquet 30104194 29587387 1.02
duckdb / vortex-file-compressed (1.013x ➖, 2↑ 2↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6053368 6075975 1.00
clickbench_q01/duckdb:vortex-file-compressed 12469190 11932254 1.04
clickbench_q02/duckdb:vortex-file-compressed 28533274 26347962 1.08
clickbench_q03/duckdb:vortex-file-compressed 31578197 30412706 1.04
clickbench_q04/duckdb:vortex-file-compressed 193856460 183070027 1.06
clickbench_q05/duckdb:vortex-file-compressed 189590077 177665178 1.07
clickbench_q06/duckdb:vortex-file-compressed 21470755 20839489 1.03
clickbench_q07/duckdb:vortex-file-compressed 14999090 15929640 0.94
clickbench_q08/duckdb:vortex-file-compressed 276131202 261273816 1.06
clickbench_q09/duckdb:vortex-file-compressed 357210004 336633943 1.06
clickbench_q10/duckdb:vortex-file-compressed 71594120 67305155 1.06
clickbench_q11/duckdb:vortex-file-compressed 84011666 77010376 1.09
clickbench_q12/duckdb:vortex-file-compressed 210930142 198216078 1.06
clickbench_q13/duckdb:vortex-file-compressed 429529662 407199964 1.05
clickbench_q14/duckdb:vortex-file-compressed 253061761 232198686 1.09
clickbench_q15/duckdb:vortex-file-compressed 258197262 241802785 1.07
clickbench_q16/duckdb:vortex-file-compressed 628529876 591162290 1.06
clickbench_q17/duckdb:vortex-file-compressed 512721732 474612807 1.08
clickbench_q18/duckdb:vortex-file-compressed 🚨 1089407991 979959864 1.11
clickbench_q19/duckdb:vortex-file-compressed 22897641 20866174 1.10
clickbench_q20/duckdb:vortex-file-compressed 341881025 347589443 0.98
clickbench_q21/duckdb:vortex-file-compressed 395343337 437843053 0.90
clickbench_q22/duckdb:vortex-file-compressed 🚀 543027314 757790365 0.72
clickbench_q23/duckdb:vortex-file-compressed 164693890 178146777 0.92
clickbench_q24/duckdb:vortex-file-compressed 🚨 37297432 33627162 1.11
clickbench_q25/duckdb:vortex-file-compressed 73900040 67687937 1.09
clickbench_q26/duckdb:vortex-file-compressed 🚀 35254683 42191359 0.84
clickbench_q27/duckdb:vortex-file-compressed 499983961 474568063 1.05
clickbench_q28/duckdb:vortex-file-compressed 3164797527 2998854308 1.06
clickbench_q29/duckdb:vortex-file-compressed 30171917 29939301 1.01
clickbench_q30/duckdb:vortex-file-compressed 205088804 211283437 0.97
clickbench_q31/duckdb:vortex-file-compressed 303649869 324818012 0.93
clickbench_q32/duckdb:vortex-file-compressed 1229432709 1189750969 1.03
clickbench_q33/duckdb:vortex-file-compressed 1269430768 1169759657 1.09
clickbench_q34/duckdb:vortex-file-compressed 1384912148 1499702607 0.92
clickbench_q35/duckdb:vortex-file-compressed 399540106 392999702 1.02
clickbench_q36/duckdb:vortex-file-compressed 25210885 24309480 1.04
clickbench_q37/duckdb:vortex-file-compressed 17439336 19151206 0.91
clickbench_q38/duckdb:vortex-file-compressed 19608516 20618910 0.95
clickbench_q39/duckdb:vortex-file-compressed 41878664 38952978 1.08
clickbench_q40/duckdb:vortex-file-compressed 16916285 18087932 0.94
clickbench_q41/duckdb:vortex-file-compressed 16990487 18425163 0.92
clickbench_q42/duckdb:vortex-file-compressed 20389938 19153314 1.06
duckdb / parquet (1.029x ➖, 0↑ 2↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 28128686 25995308 1.08
clickbench_q01/duckdb:parquet 28099475 27187082 1.03
clickbench_q02/duckdb:parquet 48777788 49167833 0.99
clickbench_q03/duckdb:parquet 39318752 38680690 1.02
clickbench_q04/duckdb:parquet 214342072 201321755 1.06
clickbench_q05/duckdb:parquet 279171375 265098389 1.05
clickbench_q06/duckdb:parquet 47289259 46140018 1.02
clickbench_q07/duckdb:parquet 29288215 29381624 1.00
clickbench_q08/duckdb:parquet 289138960 270648482 1.07
clickbench_q09/duckdb:parquet 420598484 408843672 1.03
clickbench_q10/duckdb:parquet 85720735 91195466 0.94
clickbench_q11/duckdb:parquet 104202394 112447615 0.93
clickbench_q12/duckdb:parquet 302829994 330443769 0.92
clickbench_q13/duckdb:parquet 515041938 563746746 0.91
clickbench_q14/duckdb:parquet 342212283 359057482 0.95
clickbench_q15/duckdb:parquet 279943593 259964978 1.08
clickbench_q16/duckdb:parquet 683918124 647400243 1.06
clickbench_q17/duckdb:parquet 575332139 548132077 1.05
clickbench_q18/duckdb:parquet 1154427178 1088776252 1.06
clickbench_q19/duckdb:parquet 28118040 26463884 1.06
clickbench_q20/duckdb:parquet 452303455 428315213 1.06
clickbench_q21/duckdb:parquet 573686642 551794696 1.04
clickbench_q22/duckdb:parquet 970875323 965556569 1.01
clickbench_q23/duckdb:parquet 317173469 326239781 0.97
clickbench_q24/duckdb:parquet 72226939 71181421 1.01
clickbench_q25/duckdb:parquet 163773340 158360312 1.03
clickbench_q26/duckdb:parquet 50833036 49770597 1.02
clickbench_q27/duckdb:parquet 685161743 645277988 1.06
clickbench_q28/duckdb:parquet 5083285230 4879444775 1.04
clickbench_q29/duckdb:parquet 41928454 40112213 1.05
clickbench_q30/duckdb:parquet 316007846 300638728 1.05
clickbench_q31/duckdb:parquet 388538733 363374503 1.07
clickbench_q32/duckdb:parquet 1245314972 1143955012 1.09
clickbench_q33/duckdb:parquet 1354493280 1256923489 1.08
clickbench_q34/duckdb:parquet 1404598770 1438857661 0.98
clickbench_q35/duckdb:parquet 379574967 365808679 1.04
clickbench_q36/duckdb:parquet 🚨 54281391 46411420 1.17
clickbench_q37/duckdb:parquet 32412150 33189226 0.98
clickbench_q38/duckdb:parquet 33478338 33029735 1.01
clickbench_q39/duckdb:parquet 90225360 83837709 1.08
clickbench_q40/duckdb:parquet 20010013 19462671 1.03
clickbench_q41/duckdb:parquet 20383805 20106570 1.01
clickbench_q42/duckdb:parquet 🚨 23214110 20456122 1.13
duckdb / duckdb (1.028x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17946367 18032768 1.00
clickbench_q01/duckdb:duckdb 33958121 32854778 1.03
clickbench_q02/duckdb:duckdb 46739047 44512789 1.05
clickbench_q03/duckdb:duckdb 47963550 47016424 1.02
clickbench_q04/duckdb:duckdb 198325725 190176078 1.04
clickbench_q05/duckdb:duckdb 284929061 267506670 1.07
clickbench_q06/duckdb:duckdb 35987234 35103846 1.03
clickbench_q07/duckdb:duckdb 35767076 35055039 1.02
clickbench_q08/duckdb:duckdb 265040583 252357613 1.05
clickbench_q09/duckdb:duckdb 387972279 371310394 1.04
clickbench_q10/duckdb:duckdb 102240484 99950834 1.02
clickbench_q11/duckdb:duckdb 111423130 107917013 1.03
clickbench_q12/duckdb:duckdb 258194436 240885070 1.07
clickbench_q13/duckdb:duckdb 536984927 491717167 1.09
clickbench_q14/duckdb:duckdb 299174456 279168587 1.07
clickbench_q15/duckdb:duckdb 236027782 220852193 1.07
clickbench_q16/duckdb:duckdb 688937540 667597267 1.03
clickbench_q17/duckdb:duckdb 589238386 576610828 1.02
clickbench_q18/duckdb:duckdb 1317577991 1266811656 1.04
clickbench_q19/duckdb:duckdb 35364961 36287001 0.97
clickbench_q20/duckdb:duckdb 999166971 1106017499 0.90
clickbench_q21/duckdb:duckdb 1156360605 1072467417 1.08
clickbench_q22/duckdb:duckdb 1135256689 1082952391 1.05
clickbench_q23/duckdb:duckdb 272772868 255385165 1.07
clickbench_q24/duckdb:duckdb 62850701 61096046 1.03
clickbench_q25/duckdb:duckdb 146786779 143461750 1.02
clickbench_q26/duckdb:duckdb 59769953 60476471 0.99
clickbench_q27/duckdb:duckdb 1165275663 1088547160 1.07
clickbench_q28/duckdb:duckdb 5007117933 4696818710 1.07
clickbench_q29/duckdb:duckdb 48530093 48104850 1.01
clickbench_q30/duckdb:duckdb 277004230 266947530 1.04
clickbench_q31/duckdb:duckdb 476437455 441081588 1.08
clickbench_q32/duckdb:duckdb 1553707016 1623001891 0.96
clickbench_q33/duckdb:duckdb 2047752103 2068468782 0.99
clickbench_q34/duckdb:duckdb 2144038282 2245423916 0.95
clickbench_q35/duckdb:duckdb 303354419 281304160 1.08
clickbench_q36/duckdb:duckdb 42797608 42732742 1.00
clickbench_q37/duckdb:duckdb 31936064 31438474 1.02
clickbench_q38/duckdb:duckdb 31409195 30320585 1.04
clickbench_q39/duckdb:duckdb 69681479 72456747 0.96
clickbench_q40/duckdb:duckdb 31995834 30795478 1.04
clickbench_q41/duckdb:duckdb 30995084 30043888 1.03
clickbench_q42/duckdb:duckdb 31676698 31257925 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +3.2% +4.0% -0.8% +790.0% ➖ noise
0 duckdb:duckdb -0.5% +4.0% -4.3% +290.7% ➖ noise
0 duckdb:vortex-file-compressed -0.4% +4.0% -4.2% +514.0% ➖ noise
1 datafusion:vortex-file-compressed +3.3% +2.7% +0.6% +23.2% ➖ noise
1 duckdb:duckdb +3.4% +2.7% +0.6% +61.5% ➖ noise
1 duckdb:vortex-file-compressed +4.5% +2.7% +1.7% +22.9% ➖ noise
2 datafusion:vortex-file-compressed +5.5% +0.3% +5.2% +13.2% ➖ noise
2 duckdb:duckdb +5.0% +0.3% +4.7% +20.9% ➖ noise
2 duckdb:vortex-file-compressed +8.3% +0.3% +8.0% +11.1% ➖ noise
3 datafusion:vortex-file-compressed +9.5% +1.8% +7.5% +134.4% ➖ noise
3 duckdb:duckdb +2.0% +1.8% +0.2% +41.5% ➖ noise
3 duckdb:vortex-file-compressed +3.8% +1.8% +2.0% +30.2% ➖ noise
4 datafusion:vortex-file-compressed +8.3% +6.1% +2.1% +10.6% ➖ noise
4 duckdb:duckdb +4.3% +6.1% -1.7% +10.6% ➖ noise
4 duckdb:vortex-file-compressed +5.9% +6.1% -0.2% +10.6% ➖ noise
5 datafusion:vortex-file-compressed +11.8% +9.5% +2.1% +10.6% ➖ noise
5 duckdb:duckdb +6.5% +9.5% -2.7% +10.6% ➖ noise
5 duckdb:vortex-file-compressed +6.7% +9.5% -2.6% +10.6% ➖ noise
6 datafusion:vortex-file-compressed +1.1% +0.2% +0.8% +37.0% ➖ noise
6 duckdb:duckdb +2.5% +0.2% +2.3% +27.6% ➖ noise
6 duckdb:vortex-file-compressed +3.0% +0.2% +2.8% +17.6% ➖ noise
7 datafusion:vortex-file-compressed +11.9% +2.3% +9.4% +12.3% ➖ noise
7 duckdb:duckdb +2.0% +2.3% -0.3% +10.6% ➖ noise
7 duckdb:vortex-file-compressed -5.8% +2.3% -8.0% +10.6% ➖ noise
8 datafusion:vortex-file-compressed +13.2% +8.9% +4.0% +10.6% ➖ noise
8 duckdb:duckdb +5.0% +8.9% -3.6% +10.6% ➖ noise
8 duckdb:vortex-file-compressed +5.7% +8.9% -2.9% +10.6% ➖ noise
9 datafusion:vortex-file-compressed +10.3% +5.2% +4.9% +10.6% ➖ noise
9 duckdb:duckdb +4.5% +5.2% -0.6% +10.6% ➖ noise
9 duckdb:vortex-file-compressed +6.1% +5.2% +0.9% +10.6% ➖ noise
10 datafusion:vortex-file-compressed +10.7% +1.0% +9.6% +10.6% ➖ noise
10 duckdb:duckdb +2.3% +1.0% +1.3% +10.6% ➖ noise
10 duckdb:vortex-file-compressed +6.4% +1.0% +5.4% +10.6% ➖ noise
11 datafusion:vortex-file-compressed +5.6% +1.3% +4.3% +10.6% ➖ noise
11 duckdb:duckdb +3.2% +1.3% +1.9% +10.6% ➖ noise
11 duckdb:vortex-file-compressed +9.1% +1.3% +7.7% +10.6% ➖ noise
12 datafusion:vortex-file-compressed +9.4% +2.0% +7.3% +10.6% ➖ noise
12 duckdb:duckdb +7.2% +2.0% +5.1% +10.6% ➖ noise
12 duckdb:vortex-file-compressed +6.4% +2.0% +4.4% +10.6% ➖ noise
13 datafusion:vortex-file-compressed +12.3% -0.3% +12.7% +10.6% 🚨 regression
13 duckdb:duckdb +9.2% -0.3% +9.6% +10.6% ➖ noise
13 duckdb:vortex-file-compressed +5.5% -0.3% +5.8% +10.6% ➖ noise
14 datafusion:vortex-file-compressed +10.6% +1.9% +8.6% +10.6% ➖ noise
14 duckdb:duckdb +7.2% +1.9% +5.2% +10.6% ➖ noise
14 duckdb:vortex-file-compressed +9.0% +1.9% +7.0% +10.6% ➖ noise
15 datafusion:vortex-file-compressed +11.4% +8.2% +3.0% +10.6% ➖ noise
15 duckdb:duckdb +6.9% +8.2% -1.2% +10.6% ➖ noise
15 duckdb:vortex-file-compressed +6.8% +8.2% -1.3% +10.6% ➖ noise
16 datafusion:vortex-file-compressed +12.9% +8.9% +3.6% +10.6% ➖ noise
16 duckdb:duckdb +3.2% +8.9% -5.3% +10.6% ➖ noise
16 duckdb:vortex-file-compressed +6.3% +8.9% -2.4% +10.6% ➖ noise
17 datafusion:vortex-file-compressed +14.7% +6.9% +7.3% +10.6% ➖ noise
17 duckdb:duckdb +2.2% +6.9% -4.4% +10.6% ➖ noise
17 duckdb:vortex-file-compressed +8.0% +6.9% +1.0% +10.6% ➖ noise
18 datafusion:vortex-file-compressed +11.1% +8.7% +2.2% +10.6% ➖ noise
18 duckdb:duckdb +4.0% +8.7% -4.3% +10.6% ➖ noise
18 duckdb:vortex-file-compressed +11.2% +8.7% +2.3% +10.6% ➖ noise
19 datafusion:vortex-file-compressed +10.5% +5.7% +4.5% +38.3% ➖ noise
19 duckdb:duckdb -2.5% +5.7% -7.8% +19.9% ➖ noise
19 duckdb:vortex-file-compressed +9.7% +5.7% +3.8% +19.8% ➖ noise
20 datafusion:vortex-file-compressed +3.1% +5.5% -2.4% +200.2% ➖ noise
20 duckdb:duckdb -9.7% +5.5% -14.4% +20.0% ➖ noise
20 duckdb:vortex-file-compressed -1.6% +5.5% -6.8% +61.2% ➖ noise
21 datafusion:vortex-file-compressed +10.8% -0.6% +11.4% +10.6% 🚨 regression
21 duckdb:duckdb +7.8% -0.6% +8.5% +10.7% ➖ noise
21 duckdb:vortex-file-compressed -9.7% -0.6% -9.2% +10.6% ➖ noise
22 datafusion:vortex-file-compressed +9.0% -2.1% +11.3% +13.6% ➖ noise
22 duckdb:duckdb +4.8% -2.1% +7.0% +10.6% ➖ noise
22 duckdb:vortex-file-compressed -28.3% -2.1% -26.8% +16.5% ✅ faster
23 datafusion:vortex-file-compressed +11.2% +2.4% +8.6% +49.8% ➖ noise
23 duckdb:duckdb +6.8% +2.4% +4.3% +10.6% ➖ noise
23 duckdb:vortex-file-compressed -7.6% +2.4% -9.7% +22.3% ➖ noise
24 datafusion:vortex-file-compressed +3.5% +0.9% +2.5% +12.0% ➖ noise
24 duckdb:duckdb +2.9% +0.9% +1.9% +10.6% ➖ noise
24 duckdb:vortex-file-compressed +10.9% +0.9% +9.9% +21.6% ➖ noise
25 datafusion:vortex-file-compressed +8.1% +4.3% +3.6% +10.6% ➖ noise
25 duckdb:duckdb +2.3% +4.3% -1.9% +10.6% ➖ noise
25 duckdb:vortex-file-compressed +9.2% +4.3% +4.7% +11.3% ➖ noise
26 datafusion:vortex-file-compressed +3.2% +4.6% -1.3% +10.6% ➖ noise
26 duckdb:duckdb -1.2% +4.6% -5.5% +14.1% ➖ noise
26 duckdb:vortex-file-compressed -16.4% +4.6% -20.1% +28.4% ➖ noise
27 datafusion:vortex-file-compressed +7.3% +6.4% +0.8% +10.6% ➖ noise
27 duckdb:duckdb +7.0% +6.4% +0.6% +12.7% ➖ noise
27 duckdb:vortex-file-compressed +5.4% +6.4% -1.0% +10.6% ➖ noise
28 datafusion:vortex-file-compressed +3.6% +3.9% -0.3% +10.6% ➖ noise
28 duckdb:duckdb +6.6% +3.9% +2.6% +10.6% ➖ noise
28 duckdb:vortex-file-compressed +5.5% +3.9% +1.6% +10.6% ➖ noise
29 datafusion:vortex-file-compressed -5.1% +3.9% -8.7% +10.6% ➖ noise
29 duckdb:duckdb +0.9% +3.9% -2.9% +12.8% ➖ noise
29 duckdb:vortex-file-compressed +0.8% +3.9% -3.0% +18.6% ➖ noise
30 datafusion:vortex-file-compressed -13.4% +6.3% -18.5% +10.6% ✅ faster
30 duckdb:duckdb +3.8% +6.3% -2.4% +10.6% ➖ noise
30 duckdb:vortex-file-compressed -2.9% +6.3% -8.7% +10.6% ➖ noise
31 datafusion:vortex-file-compressed -5.6% +7.4% -12.1% +15.3% ➖ noise
31 duckdb:duckdb +8.0% +7.4% +0.6% +10.7% ➖ noise
31 duckdb:vortex-file-compressed -6.5% +7.4% -13.0% +10.6% ✅ faster
32 datafusion:vortex-file-compressed +12.1% +11.6% +0.4% +10.6% ➖ noise
32 duckdb:duckdb -4.3% +11.6% -14.2% +10.6% ✅ faster
32 duckdb:vortex-file-compressed +3.3% +11.6% -7.4% +10.6% ➖ noise
33 datafusion:vortex-file-compressed +10.4% +8.6% +1.7% +10.6% ➖ noise
33 duckdb:duckdb -1.0% +8.6% -8.8% +10.6% ➖ noise
33 duckdb:vortex-file-compressed +8.5% +8.6% -0.1% +13.0% ➖ noise
34 datafusion:vortex-file-compressed +9.2% -7.9% +18.6% +10.6% 🚨 regression
34 duckdb:duckdb -4.5% -7.9% +3.7% +10.6% ➖ noise
34 duckdb:vortex-file-compressed -7.7% -7.9% +0.3% +11.3% ➖ noise
35 datafusion:vortex-file-compressed +11.0% -2.8% +14.3% +10.6% 🚨 regression
35 duckdb:duckdb +7.8% -2.8% +11.0% +10.6% 🚨 regression
35 duckdb:vortex-file-compressed +1.7% -2.8% +4.6% +10.6% ➖ noise
36 datafusion:vortex-file-compressed +13.9% +12.8% +0.9% +12.7% ➖ noise
36 duckdb:duckdb +0.2% +12.8% -11.2% +13.5% ➖ noise
36 duckdb:vortex-file-compressed +3.7% +12.8% -8.1% +15.3% ➖ noise
37 datafusion:vortex-file-compressed +8.8% +3.0% +5.6% +10.6% ➖ noise
37 duckdb:duckdb +1.6% +3.0% -1.4% +10.6% ➖ noise
37 duckdb:vortex-file-compressed -8.9% +3.0% -11.6% +10.6% ✅ faster
38 datafusion:vortex-file-compressed +5.2% +5.9% -0.6% +10.6% ➖ noise
38 duckdb:duckdb +3.6% +5.9% -2.1% +10.6% ➖ noise
38 duckdb:vortex-file-compressed -4.9% +5.9% -10.2% +10.6% ✅ faster
39 datafusion:vortex-file-compressed +7.6% +7.2% +0.3% +10.6% ➖ noise
39 duckdb:duckdb -3.8% +7.2% -10.3% +18.7% ➖ noise
39 duckdb:vortex-file-compressed +7.5% +7.2% +0.3% +12.5% ➖ noise
40 datafusion:vortex-file-compressed +6.5% +4.3% +2.1% +12.6% ➖ noise
40 duckdb:duckdb +3.9% +4.3% -0.4% +10.9% ➖ noise
40 duckdb:vortex-file-compressed -6.5% +4.3% -10.3% +14.4% ➖ noise
41 datafusion:vortex-file-compressed +12.5% +5.5% +6.6% +13.3% ➖ noise
41 duckdb:duckdb +3.2% +5.5% -2.2% +14.5% ➖ noise
41 duckdb:vortex-file-compressed -7.8% +5.5% -12.6% +15.1% ➖ noise
42 datafusion:vortex-file-compressed +8.4% +7.5% +0.8% +15.3% ➖ noise
42 duckdb:duckdb +1.3% +7.5% -5.7% +12.8% ➖ noise
42 duckdb:vortex-file-compressed +6.5% +7.5% -0.9% +14.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.7%
Vortex (geomean): 1.088x ➖
Parquet (geomean): 1.011x ➖
Shifts: Parquet (control) +1.1% · Median polish +2.9%


datafusion / vortex-file-compressed (1.197x ➖, 0↑ 5↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 292443909 254424880 1.15
tpch_q02/datafusion:vortex-file-compressed 🚨 792904635 443627636 1.79
tpch_q03/datafusion:vortex-file-compressed 🚨 623128695 437177173 1.43
tpch_q04/datafusion:vortex-file-compressed 324225787 324692325 1.00
tpch_q05/datafusion:vortex-file-compressed 571880944 516604543 1.11
tpch_q06/datafusion:vortex-file-compressed 394964294 344688307 1.15
tpch_q07/datafusion:vortex-file-compressed 643766652 536401924 1.20
tpch_q08/datafusion:vortex-file-compressed 831149007 760677844 1.09
tpch_q09/datafusion:vortex-file-compressed 522888936 493542085 1.06
tpch_q10/datafusion:vortex-file-compressed 595677822 597865663 1.00
tpch_q11/datafusion:vortex-file-compressed 400453132 389184549 1.03
tpch_q12/datafusion:vortex-file-compressed 513685938 503982084 1.02
tpch_q13/datafusion:vortex-file-compressed 156397824 145462955 1.08
tpch_q14/datafusion:vortex-file-compressed 🚨 350967855 223860880 1.57
tpch_q15/datafusion:vortex-file-compressed 🚨 628216437 441980544 1.42
tpch_q16/datafusion:vortex-file-compressed 245262584 206214043 1.19
tpch_q17/datafusion:vortex-file-compressed 545239083 453966261 1.20
tpch_q18/datafusion:vortex-file-compressed 393441108 371243313 1.06
tpch_q19/datafusion:vortex-file-compressed 586702833 491230977 1.19
tpch_q20/datafusion:vortex-file-compressed 458048237 392148655 1.17
tpch_q21/datafusion:vortex-file-compressed 707513126 620918679 1.14
tpch_q22/datafusion:vortex-file-compressed 🚨 275944934 162831791 1.69
datafusion / vortex-compact (1.104x ➖, 0↑ 4↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 349687806 249177299 1.40
tpch_q02/datafusion:vortex-compact 🚨 558255138 423867642 1.32
tpch_q03/datafusion:vortex-compact 399636727 416130677 0.96
tpch_q04/datafusion:vortex-compact 243428684 248798714 0.98
tpch_q05/datafusion:vortex-compact 🚨 522733430 393046111 1.33
tpch_q06/datafusion:vortex-compact 396237559 317100632 1.25
tpch_q07/datafusion:vortex-compact 497489241 426880077 1.17
tpch_q08/datafusion:vortex-compact 637316254 556072606 1.15
tpch_q09/datafusion:vortex-compact 433125565 498206078 0.87
tpch_q10/datafusion:vortex-compact 457852677 480690325 0.95
tpch_q11/datafusion:vortex-compact 257703442 289635627 0.89
tpch_q12/datafusion:vortex-compact 480104171 409383668 1.17
tpch_q13/datafusion:vortex-compact 161249220 152692862 1.06
tpch_q14/datafusion:vortex-compact 272534316 264476651 1.03
tpch_q15/datafusion:vortex-compact 553382206 482244967 1.15
tpch_q16/datafusion:vortex-compact 228987277 207314623 1.10
tpch_q17/datafusion:vortex-compact 412408902 433485903 0.95
tpch_q18/datafusion:vortex-compact 356773699 388571549 0.92
tpch_q19/datafusion:vortex-compact 514354180 487915052 1.05
tpch_q20/datafusion:vortex-compact 493831871 521724637 0.95
tpch_q21/datafusion:vortex-compact 729863788 566709381 1.29
tpch_q22/datafusion:vortex-compact 🚨 196453148 114735467 1.71
datafusion / parquet (1.014x ➖, 0↑ 2↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 246754905 237187944 1.04
tpch_q02/datafusion:parquet 428495441 420116617 1.02
tpch_q03/datafusion:parquet 365450011 320826894 1.14
tpch_q04/datafusion:parquet 171540144 170713059 1.00
tpch_q05/datafusion:parquet 466157517 473240849 0.99
tpch_q06/datafusion:parquet 152230635 185641509 0.82
tpch_q07/datafusion:parquet 483735346 496920550 0.97
tpch_q08/datafusion:parquet 606362331 597854387 1.01
tpch_q09/datafusion:parquet 512818548 513475138 1.00
tpch_q10/datafusion:parquet 521794645 520861393 1.00
tpch_q11/datafusion:parquet 314766613 331876064 0.95
tpch_q12/datafusion:parquet 228746052 232681776 0.98
tpch_q13/datafusion:parquet 448106378 433043741 1.03
tpch_q14/datafusion:parquet 216317528 174188572 1.24
tpch_q15/datafusion:parquet 311086336 310107165 1.00
tpch_q16/datafusion:parquet 174606824 190229346 0.92
tpch_q17/datafusion:parquet 392312705 542086521 0.72
tpch_q18/datafusion:parquet 460420812 507531880 0.91
tpch_q19/datafusion:parquet 332014186 416678302 0.80
tpch_q20/datafusion:parquet 400557674 324075677 1.24
tpch_q21/datafusion:parquet 🚨 774780904 534377636 1.45
tpch_q22/datafusion:parquet 🚨 157569372 116862031 1.35
duckdb / vortex-file-compressed (1.030x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 329489523 279743689 1.18
tpch_q02/duckdb:vortex-file-compressed 996627107 993439539 1.00
tpch_q03/duckdb:vortex-file-compressed 656509561 694006148 0.95
tpch_q04/duckdb:vortex-file-compressed 420166950 446911519 0.94
tpch_q05/duckdb:vortex-file-compressed 887536097 933953851 0.95
tpch_q06/duckdb:vortex-file-compressed 360408485 362586784 0.99
tpch_q07/duckdb:vortex-file-compressed 1073116805 1035770368 1.04
tpch_q08/duckdb:vortex-file-compressed 1031306427 1077768196 0.96
tpch_q09/duckdb:vortex-file-compressed 914777772 1008776472 0.91
tpch_q10/duckdb:vortex-file-compressed 870962553 839865663 1.04
tpch_q11/duckdb:vortex-file-compressed 567159018 523288657 1.08
tpch_q12/duckdb:vortex-file-compressed 803578003 620442204 1.30
tpch_q13/duckdb:vortex-file-compressed 494101197 498771946 0.99
tpch_q14/duckdb:vortex-file-compressed 443925091 398439716 1.11
tpch_q15/duckdb:vortex-file-compressed 325454017 291295467 1.12
tpch_q16/duckdb:vortex-file-compressed 385349923 358074446 1.08
tpch_q17/duckdb:vortex-file-compressed 773689219 817473120 0.95
tpch_q18/duckdb:vortex-file-compressed 654316326 636441701 1.03
tpch_q19/duckdb:vortex-file-compressed 551951379 530106302 1.04
tpch_q20/duckdb:vortex-file-compressed 771221347 842602443 0.92
tpch_q21/duckdb:vortex-file-compressed 1221738947 1075506644 1.14
tpch_q22/duckdb:vortex-file-compressed 333426746 312704903 1.07
duckdb / vortex-compact (1.029x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 335851285 331152087 1.01
tpch_q02/duckdb:vortex-compact 937297222 903434228 1.04
tpch_q03/duckdb:vortex-compact 650355073 663909147 0.98
tpch_q04/duckdb:vortex-compact 406308828 381005110 1.07
tpch_q05/duckdb:vortex-compact 876127902 857421712 1.02
tpch_q06/duckdb:vortex-compact 304949384 348397168 0.88
tpch_q07/duckdb:vortex-compact 981717257 934886899 1.05
tpch_q08/duckdb:vortex-compact 982637467 979356390 1.00
tpch_q09/duckdb:vortex-compact 978525150 1003966509 0.97
tpch_q10/duckdb:vortex-compact 825287334 737276581 1.12
tpch_q11/duckdb:vortex-compact 527364060 485212766 1.09
tpch_q12/duckdb:vortex-compact 682842231 603111943 1.13
tpch_q13/duckdb:vortex-compact 443874169 452066953 0.98
tpch_q14/duckdb:vortex-compact 402897317 487216044 0.83
tpch_q15/duckdb:vortex-compact 328885063 336844554 0.98
tpch_q16/duckdb:vortex-compact 343478871 343581518 1.00
tpch_q17/duckdb:vortex-compact 738823801 691841989 1.07
tpch_q18/duckdb:vortex-compact 549408359 471621973 1.16
tpch_q19/duckdb:vortex-compact 544967040 484179269 1.13
tpch_q20/duckdb:vortex-compact 819511623 731390188 1.12
tpch_q21/duckdb:vortex-compact 1123347166 976572473 1.15
tpch_q22/duckdb:vortex-compact 293523073 308512415 0.95
duckdb / parquet (1.008x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 497989461 517945595 0.96
tpch_q02/duckdb:parquet 1195254666 1326042849 0.90
tpch_q03/duckdb:parquet 1185522754 1069584775 1.11
tpch_q04/duckdb:parquet 687432443 675219434 1.02
tpch_q05/duckdb:parquet 1330336400 1368688980 0.97
tpch_q06/duckdb:parquet 476697121 459801569 1.04
tpch_q07/duckdb:parquet 1303936642 1315478734 0.99
tpch_q08/duckdb:parquet 1614969896 1763102260 0.92
tpch_q09/duckdb:parquet 1591594461 1360984613 1.17
tpch_q10/duckdb:parquet 1418884229 1386304910 1.02
tpch_q11/duckdb:parquet 830298604 795931649 1.04
tpch_q12/duckdb:parquet 732591688 710542302 1.03
tpch_q13/duckdb:parquet 937753906 994653435 0.94
tpch_q14/duckdb:parquet 851642930 743702994 1.15
tpch_q15/duckdb:parquet 626746345 617559053 1.01
tpch_q16/duckdb:parquet 656178492 751062875 0.87
tpch_q17/duckdb:parquet 764173487 867201137 0.88
tpch_q18/duckdb:parquet 961049736 895762148 1.07
tpch_q19/duckdb:parquet 851377421 909144942 0.94
tpch_q20/duckdb:parquet 1277035838 1089361812 1.17
tpch_q21/duckdb:parquet 1178324100 1177190611 1.00
tpch_q22/duckdb:parquet 644375385 620409999 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +40.3% +0.0% +40.3% +70.1% ➖ noise
1 datafusion:vortex-file-compressed +14.9% +0.0% +14.9% +58.9% ➖ noise
1 duckdb:vortex-compact +1.4% +0.0% +1.4% +45.7% ➖ noise
1 duckdb:vortex-file-compressed +17.8% +0.0% +17.8% +48.3% ➖ noise
2 datafusion:vortex-compact +31.7% -4.1% +37.4% +31.8% 🚨 regression
2 datafusion:vortex-file-compressed +78.7% -4.1% +86.4% +31.8% 🚨 regression
2 duckdb:vortex-compact +3.7% -4.1% +8.2% +31.8% ➖ noise
2 duckdb:vortex-file-compressed +0.3% -4.1% +4.6% +31.8% ➖ noise
3 datafusion:vortex-compact -4.0% +12.4% -14.5% +40.8% ➖ noise
3 datafusion:vortex-file-compressed +42.5% +12.4% +26.9% +57.0% ➖ noise
3 duckdb:vortex-compact -2.0% +12.4% -12.8% +34.8% ➖ noise
3 duckdb:vortex-file-compressed -5.4% +12.4% -15.8% +31.8% ➖ noise
4 datafusion:vortex-compact -2.2% +1.1% -3.3% +38.1% ➖ noise
4 datafusion:vortex-file-compressed -0.1% +1.1% -1.3% +36.2% ➖ noise
4 duckdb:vortex-compact +6.6% +1.1% +5.4% +35.0% ➖ noise
4 duckdb:vortex-file-compressed -6.0% +1.1% -7.0% +33.2% ➖ noise
5 datafusion:vortex-compact +33.0% -2.2% +35.9% +31.8% 🚨 regression
5 datafusion:vortex-file-compressed +10.7% -2.2% +13.1% +31.8% ➖ noise
5 duckdb:vortex-compact +2.2% -2.2% +4.4% +31.8% ➖ noise
5 duckdb:vortex-file-compressed -5.0% -2.2% -2.9% +31.8% ➖ noise
6 datafusion:vortex-compact +25.0% -7.8% +35.5% +44.8% ➖ noise
6 datafusion:vortex-file-compressed +14.6% -7.8% +24.3% +31.8% ➖ noise
6 duckdb:vortex-compact -12.5% -7.8% -5.1% +31.8% ➖ noise
6 duckdb:vortex-file-compressed -0.6% -7.8% +7.8% +31.8% ➖ noise
7 datafusion:vortex-compact +16.5% -1.8% +18.6% +31.8% ➖ noise
7 datafusion:vortex-file-compressed +20.0% -1.8% +22.2% +31.8% ➖ noise
7 duckdb:vortex-compact +5.0% -1.8% +6.9% +31.8% ➖ noise
7 duckdb:vortex-file-compressed +3.6% -1.8% +5.5% +31.8% ➖ noise
8 datafusion:vortex-compact +14.6% -3.6% +18.9% +31.8% ➖ noise
8 datafusion:vortex-file-compressed +9.3% -3.6% +13.4% +33.1% ➖ noise
8 duckdb:vortex-compact +0.3% -3.6% +4.1% +31.8% ➖ noise
8 duckdb:vortex-file-compressed -4.3% -3.6% -0.7% +31.8% ➖ noise
9 datafusion:vortex-compact -13.1% +8.1% -19.6% +31.8% ➖ noise
9 datafusion:vortex-file-compressed +5.9% +8.1% -2.0% +31.8% ➖ noise
9 duckdb:vortex-compact -2.5% +8.1% -9.8% +31.8% ➖ noise
9 duckdb:vortex-file-compressed -9.3% +8.1% -16.1% +31.8% ➖ noise
10 datafusion:vortex-compact -4.8% +1.3% -5.9% +31.8% ➖ noise
10 datafusion:vortex-file-compressed -0.4% +1.3% -1.6% +31.8% ➖ noise
10 duckdb:vortex-compact +11.9% +1.3% +10.5% +31.8% ➖ noise
10 duckdb:vortex-file-compressed +3.7% +1.3% +2.4% +31.8% ➖ noise
11 datafusion:vortex-compact -11.0% -0.5% -10.5% +31.8% ➖ noise
11 datafusion:vortex-file-compressed +2.9% -0.5% +3.4% +31.8% ➖ noise
11 duckdb:vortex-compact +8.7% -0.5% +9.3% +31.8% ➖ noise
11 duckdb:vortex-file-compressed +8.4% -0.5% +9.0% +31.8% ➖ noise
12 datafusion:vortex-compact +17.3% +0.7% +16.5% +31.8% ➖ noise
12 datafusion:vortex-file-compressed +1.9% +0.7% +1.2% +31.8% ➖ noise
12 duckdb:vortex-compact +13.2% +0.7% +12.5% +31.8% ➖ noise
12 duckdb:vortex-file-compressed +29.5% +0.7% +28.6% +31.8% ➖ noise
13 datafusion:vortex-compact +5.6% -1.2% +6.9% +64.8% ➖ noise
13 datafusion:vortex-file-compressed +7.5% -1.2% +8.9% +39.5% ➖ noise
13 duckdb:vortex-compact -1.8% -1.2% -0.6% +31.8% ➖ noise
13 duckdb:vortex-file-compressed -0.9% -1.2% +0.3% +31.8% ➖ noise
14 datafusion:vortex-compact +3.0% +19.3% -13.6% +31.8% ➖ noise
14 datafusion:vortex-file-compressed +56.8% +19.3% +31.5% +31.8% ➖ noise
14 duckdb:vortex-compact -17.3% +19.3% -30.7% +31.8% ✅ faster
14 duckdb:vortex-file-compressed +11.4% +19.3% -6.6% +31.8% ➖ noise
15 datafusion:vortex-compact +14.8% +0.9% +13.7% +31.8% ➖ noise
15 datafusion:vortex-file-compressed +42.1% +0.9% +40.9% +31.8% 🚨 regression
15 duckdb:vortex-compact -2.4% +0.9% -3.2% +33.1% ➖ noise
15 duckdb:vortex-file-compressed +11.7% +0.9% +10.7% +31.8% ➖ noise
16 datafusion:vortex-compact +10.5% -10.5% +23.3% +31.8% ➖ noise
16 datafusion:vortex-file-compressed +18.9% -10.5% +32.8% +44.6% ➖ noise
16 duckdb:vortex-compact -0.0% -10.5% +11.6% +31.8% ➖ noise
16 duckdb:vortex-file-compressed +7.6% -10.5% +20.2% +31.8% ➖ noise
17 datafusion:vortex-compact -4.9% -20.1% +19.1% +31.8% ➖ noise
17 datafusion:vortex-file-compressed +20.1% -20.1% +50.4% +31.8% 🚨 regression
17 duckdb:vortex-compact +6.8% -20.1% +33.7% +31.8% 🚨 regression
17 duckdb:vortex-file-compressed -5.4% -20.1% +18.5% +31.8% ➖ noise
18 datafusion:vortex-compact -8.2% -1.3% -6.9% +33.7% ➖ noise
18 datafusion:vortex-file-compressed +6.0% -1.3% +7.4% +31.8% ➖ noise
18 duckdb:vortex-compact +16.5% -1.3% +18.1% +31.8% ➖ noise
18 duckdb:vortex-file-compressed +2.8% -1.3% +4.2% +31.8% ➖ noise
19 datafusion:vortex-compact +5.4% -13.6% +22.0% +31.8% ➖ noise
19 datafusion:vortex-file-compressed +19.4% -13.6% +38.3% +31.8% 🚨 regression
19 duckdb:vortex-compact +12.6% -13.6% +30.3% +31.8% ➖ noise
19 duckdb:vortex-file-compressed +4.1% -13.6% +20.5% +31.8% ➖ noise
20 datafusion:vortex-compact -5.3% +20.4% -21.4% +31.8% ➖ noise
20 datafusion:vortex-file-compressed +16.8% +20.4% -3.0% +31.8% ➖ noise
20 duckdb:vortex-compact +12.0% +20.4% -6.9% +31.8% ➖ noise
20 duckdb:vortex-file-compressed -8.5% +20.4% -24.0% +31.8% ➖ noise
21 datafusion:vortex-compact +28.8% +20.5% +6.9% +31.8% ➖ noise
21 datafusion:vortex-file-compressed +13.9% +20.5% -5.4% +31.8% ➖ noise
21 duckdb:vortex-compact +15.0% +20.5% -4.5% +31.8% ➖ noise
21 duckdb:vortex-file-compressed +13.6% +20.5% -5.7% +31.8% ➖ noise
22 datafusion:vortex-compact +71.2% +18.3% +44.7% +31.8% 🚨 regression
22 datafusion:vortex-file-compressed +69.5% +18.3% +43.2% +47.7% ➖ noise
22 duckdb:vortex-compact -4.9% +18.3% -19.6% +31.8% ➖ noise
22 duckdb:vortex-file-compressed +6.6% +18.3% -9.9% +37.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.015x ➖
Parquet (geomean): 1.024x ➖


unknown / unknown (1.033x ➖, 2↑ 19↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
compress time/Arade 1210204227 1168888229 1.04
compress time/Bimbo 7120688135 6966954532 1.02
compress time/CMSprovider 2953295576 2884667937 1.02
compress time/Euro2016 454989507 426013165 1.07
compress time/Food 413568773 379409592 1.09
compress time/HashTags 832540385 802641724 1.04
compress time/TPC-H l_comment canonical 1349450185 1316648729 1.02
compress time/TPC-H l_comment chunked 1366489612 1301290084 1.05
compress time/taxi 748462874 725970797 1.03
compress time/wide table cols=100 chunks=1 rows=1000 12013252 11752842 1.02
compress time/wide table cols=100 chunks=50 rows=1000 12539373 11413206 1.10
compress time/wide table cols=1000 chunks=1 rows=1000 135244009 127394996 1.06
compress time/wide table cols=1000 chunks=50 rows=1000 134583607 126500709 1.06
compress time/wide table cols=10000 chunks=1 rows=1000 1476168898 1448642289 1.02
compress time/wide table cols=10000 chunks=50 rows=1000 1511703338 1416023236 1.07
decompress time/Arade 27761682 26604167 1.04
decompress time/Bimbo 86355296 81588497 1.06
decompress time/CMSprovider 🚨 85906060 72125156 1.19
decompress time/Euro2016 🚨 20767444 18631041 1.11
decompress time/Food 8713691 8240526 1.06
decompress time/HashTags 75646464 71668981 1.06
decompress time/TPC-H l_comment canonical 🚨 44182303 39690487 1.11
decompress time/TPC-H l_comment chunked 🚨 46747899 40572687 1.15
decompress time/taxi 15199207 14370419 1.06
decompress time/wide table cols=100 chunks=1 rows=1000 🚨 2730213 2401281 1.14
decompress time/wide table cols=100 chunks=50 rows=1000 2827859 2646531 1.07
decompress time/wide table cols=1000 chunks=1 rows=1000 24647466 22811852 1.08
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 25833521 22227670 1.16
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 290888382 250190847 1.16
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 276155333 250110784 1.10
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2673549747 2610030817 1.02
parquet_rs-zstd compress time/Bimbo 13117376413 12654463655 1.04
parquet_rs-zstd compress time/CMSprovider 7253800614 6913356477 1.05
parquet_rs-zstd compress time/Euro2016 1347376184 1305912433 1.03
parquet_rs-zstd compress time/Food 818374790 810409231 1.01
parquet_rs-zstd compress time/HashTags 2414328822 2249672029 1.07
parquet_rs-zstd compress time/TPC-H l_comment canonical 3355918433 3232809361 1.04
parquet_rs-zstd compress time/TPC-H l_comment chunked 3336028157 3160899065 1.06
parquet_rs-zstd compress time/taxi 1256403801 1182225254 1.06
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 7234884 6168738 1.17
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 7493432 5987507 1.25
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 78381717 74243942 1.06
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 80684239 74995727 1.08
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 830704509 789124861 1.05
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 786181589 771437393 1.02
parquet_rs-zstd decompress time/Arade 630425579 616717255 1.02
parquet_rs-zstd decompress time/Bimbo 1705302973 1699719592 1.00
parquet_rs-zstd decompress time/CMSprovider 1764158324 1708623690 1.03
parquet_rs-zstd decompress time/Euro2016 386745460 399419762 0.97
parquet_rs-zstd decompress time/Food 203699666 214278289 0.95
parquet_rs-zstd decompress time/HashTags 🚨 718970210 619730747 1.16
parquet_rs-zstd decompress time/TPC-H l_comment canonical 610601499 590312032 1.03
parquet_rs-zstd decompress time/TPC-H l_comment chunked 611022957 597674911 1.02
parquet_rs-zstd decompress time/taxi 248076161 245645897 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 3005823 2894445 1.04
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚨 3174933 2802642 1.13
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 34226922 31804481 1.08
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 35512945 34873011 1.02
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 355993545 368040862 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 346938747 378944182 0.92
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163395292 163393980 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.01
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.98
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.04
vortex:parquet-zstd ratio compress time/Food 0 0 1.08
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.97
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.99
vortex:parquet-zstd ratio compress time/taxi 0 0 0.97
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 1 0.87
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚀 1 1 0.88
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.05
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.02
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.05
vortex:parquet-zstd ratio decompress time/CMSprovider 🚨 0 0 1.15
vortex:parquet-zstd ratio decompress time/Euro2016 🚨 0 0 1.15
vortex:parquet-zstd ratio decompress time/Food 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.91
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.08
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 🚨 0 0 1.13
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.09
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.94
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 0 0 1.14
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.20
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 0 0 1.21
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.7%
Vortex (geomean): 1.029x ➖
Parquet (geomean): 1.115x ➖
Shifts: Parquet (control) +11.5% · Median polish +5.3%


datafusion / vortex-file-compressed (1.130x ➖, 0↑ 3↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 741485539 686357264 1.08
tpch_q02/datafusion:vortex-file-compressed 867884640 749934939 1.16
tpch_q03/datafusion:vortex-file-compressed 1045981750 895523613 1.17
tpch_q04/datafusion:vortex-file-compressed 700410698 569105917 1.23
tpch_q05/datafusion:vortex-file-compressed 1122387291 897299233 1.25
tpch_q06/datafusion:vortex-file-compressed 589662192 614141276 0.96
tpch_q07/datafusion:vortex-file-compressed 990736617 1014353852 0.98
tpch_q08/datafusion:vortex-file-compressed 1188871556 1208050776 0.98
tpch_q09/datafusion:vortex-file-compressed 1356972571 1472393555 0.92
tpch_q10/datafusion:vortex-file-compressed 1024200763 970635072 1.06
tpch_q11/datafusion:vortex-file-compressed 522165469 535464227 0.98
tpch_q12/datafusion:vortex-file-compressed 981788928 771521969 1.27
tpch_q13/datafusion:vortex-file-compressed 490458835 436891000 1.12
tpch_q14/datafusion:vortex-file-compressed 🚨 688233422 483213225 1.42
tpch_q15/datafusion:vortex-file-compressed 1179993760 937055307 1.26
tpch_q16/datafusion:vortex-file-compressed 🚨 591021652 345660740 1.71
tpch_q17/datafusion:vortex-file-compressed 1165757236 1245644552 0.94
tpch_q18/datafusion:vortex-file-compressed 1204591869 1387351119 0.87
tpch_q19/datafusion:vortex-file-compressed 813635900 884882797 0.92
tpch_q20/datafusion:vortex-file-compressed 1097996664 881123413 1.25
tpch_q21/datafusion:vortex-file-compressed 1775047695 1647514068 1.08
tpch_q22/datafusion:vortex-file-compressed 🚨 595759622 349067324 1.71
datafusion / vortex-compact (1.086x ➖, 1↑ 3↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 798590004 676955540 1.18
tpch_q02/datafusion:vortex-compact 861930509 673379975 1.28
tpch_q03/datafusion:vortex-compact 818429753 730934332 1.12
tpch_q04/datafusion:vortex-compact 579276183 496050341 1.17
tpch_q05/datafusion:vortex-compact 1053769946 855053181 1.23
tpch_q06/datafusion:vortex-compact 549440599 565409939 0.97
tpch_q07/datafusion:vortex-compact 951792399 1082837569 0.88
tpch_q08/datafusion:vortex-compact 🚨 1503891035 1101902825 1.36
tpch_q09/datafusion:vortex-compact 1412012912 1373400700 1.03
tpch_q10/datafusion:vortex-compact 1135474673 1081331007 1.05
tpch_q11/datafusion:vortex-compact 411661485 395141034 1.04
tpch_q12/datafusion:vortex-compact 🚀 807415255 1291779111 0.63
tpch_q13/datafusion:vortex-compact 417965429 453500609 0.92
tpch_q14/datafusion:vortex-compact 526968755 517260157 1.02
tpch_q15/datafusion:vortex-compact 981189636 883741896 1.11
tpch_q16/datafusion:vortex-compact 🚨 654950696 330520077 1.98
tpch_q17/datafusion:vortex-compact 1175224595 1155571238 1.02
tpch_q18/datafusion:vortex-compact 1087826994 1128254908 0.96
tpch_q19/datafusion:vortex-compact 772714431 752943589 1.03
tpch_q20/datafusion:vortex-compact 803759523 828611531 0.97
tpch_q21/datafusion:vortex-compact 1426274000 1383323048 1.03
tpch_q22/datafusion:vortex-compact 🚨 526209037 352542087 1.49
datafusion / parquet (1.215x ➖, 0↑ 4↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 889059815 832368305 1.07
tpch_q02/datafusion:parquet 🚨 1284478604 723561380 1.78
tpch_q03/datafusion:parquet 988632196 917758380 1.08
tpch_q04/datafusion:parquet 653446755 527371187 1.24
tpch_q05/datafusion:parquet 1224848497 1121962237 1.09
tpch_q06/datafusion:parquet 521950238 482608518 1.08
tpch_q07/datafusion:parquet 1379525404 1221937893 1.13
tpch_q08/datafusion:parquet 1559954538 1549818856 1.01
tpch_q09/datafusion:parquet 2052057007 1839989746 1.12
tpch_q10/datafusion:parquet 2201067243 1908022958 1.15
tpch_q11/datafusion:parquet 🚨 634358169 445787705 1.42
tpch_q12/datafusion:parquet 🚨 1174610313 680594588 1.73
tpch_q13/datafusion:parquet 740626671 679642757 1.09
tpch_q14/datafusion:parquet 797702533 804748469 0.99
tpch_q15/datafusion:parquet 1357671738 1253644365 1.08
tpch_q16/datafusion:parquet 394428090 353840637 1.11
tpch_q17/datafusion:parquet 1550289342 1330084072 1.17
tpch_q18/datafusion:parquet 1799278365 1645800495 1.09
tpch_q19/datafusion:parquet 1075043464 917889763 1.17
tpch_q20/datafusion:parquet 1215485080 1095283953 1.11
tpch_q21/datafusion:parquet 1962446659 1662005303 1.18
tpch_q22/datafusion:parquet 🚨 1930231089 721804098 2.67
duckdb / vortex-file-compressed (0.962x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 637239299 650874425 0.98
tpch_q02/duckdb:vortex-file-compressed 1259152157 1181500158 1.07
tpch_q03/duckdb:vortex-file-compressed 917598536 1052981609 0.87
tpch_q04/duckdb:vortex-file-compressed 783310188 850348966 0.92
tpch_q05/duckdb:vortex-file-compressed 1319738320 1285748103 1.03
tpch_q06/duckdb:vortex-file-compressed 577364295 618305070 0.93
tpch_q07/duckdb:vortex-file-compressed 1298641223 1338769654 0.97
tpch_q08/duckdb:vortex-file-compressed 1455394674 1541762239 0.94
tpch_q09/duckdb:vortex-file-compressed 1769375679 1761080092 1.00
tpch_q10/duckdb:vortex-file-compressed 1174205422 1180012352 1.00
tpch_q11/duckdb:vortex-file-compressed 703107296 713966221 0.98
tpch_q12/duckdb:vortex-file-compressed 1173568489 1196296740 0.98
tpch_q13/duckdb:vortex-file-compressed 991213805 995940697 1.00
tpch_q14/duckdb:vortex-file-compressed 664310409 787769187 0.84
tpch_q15/duckdb:vortex-file-compressed 535591468 571105624 0.94
tpch_q16/duckdb:vortex-file-compressed 470189271 475589143 0.99
tpch_q17/duckdb:vortex-file-compressed 976124307 1021918310 0.96
tpch_q18/duckdb:vortex-file-compressed 913618592 1053458926 0.87
tpch_q19/duckdb:vortex-file-compressed 791069512 843410693 0.94
tpch_q20/duckdb:vortex-file-compressed 1233220867 1231680341 1.00
tpch_q21/duckdb:vortex-file-compressed 2018499332 2110009216 0.96
tpch_q22/duckdb:vortex-file-compressed 440383782 422590965 1.04
duckdb / vortex-compact (0.951x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 605661663 604802019 1.00
tpch_q02/duckdb:vortex-compact 1153547290 1154567842 1.00
tpch_q03/duckdb:vortex-compact 832431475 918402128 0.91
tpch_q04/duckdb:vortex-compact 639469821 645799194 0.99
tpch_q05/duckdb:vortex-compact 1223466098 1214090599 1.01
tpch_q06/duckdb:vortex-compact 484070958 545381832 0.89
tpch_q07/duckdb:vortex-compact 1175659662 1199244141 0.98
tpch_q08/duckdb:vortex-compact 1425611865 1617575552 0.88
tpch_q09/duckdb:vortex-compact 1438362449 1796970051 0.80
tpch_q10/duckdb:vortex-compact 1090479047 1146979741 0.95
tpch_q11/duckdb:vortex-compact 681255185 773361589 0.88
tpch_q12/duckdb:vortex-compact 1030738723 1064225146 0.97
tpch_q13/duckdb:vortex-compact 882349121 914463718 0.96
tpch_q14/duckdb:vortex-compact 683676470 682935010 1.00
tpch_q15/duckdb:vortex-compact 525872194 561304278 0.94
tpch_q16/duckdb:vortex-compact 426087582 458224551 0.93
tpch_q17/duckdb:vortex-compact 929132579 943022348 0.99
tpch_q18/duckdb:vortex-compact 755806781 794143652 0.95
tpch_q19/duckdb:vortex-compact 758477526 851402064 0.89
tpch_q20/duckdb:vortex-compact 1303302152 1198456315 1.09
tpch_q21/duckdb:vortex-compact 1570126227 1821491417 0.86
tpch_q22/duckdb:vortex-compact 466138082 419981833 1.11
duckdb / parquet (1.023x ➖, 0↑ 1↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 1058981271 787507668 1.34
tpch_q02/duckdb:parquet 1332462559 1358307576 0.98
tpch_q03/duckdb:parquet 1712452516 1765511267 0.97
tpch_q04/duckdb:parquet 1105688391 993096831 1.11
tpch_q05/duckdb:parquet 1984991877 1951545044 1.02
tpch_q06/duckdb:parquet 812590811 750409017 1.08
tpch_q07/duckdb:parquet 1795625169 1742946158 1.03
tpch_q08/duckdb:parquet 2415628558 2283780019 1.06
tpch_q09/duckdb:parquet 2551281059 2674718893 0.95
tpch_q10/duckdb:parquet 3424298174 3083921714 1.11
tpch_q11/duckdb:parquet 936126884 1030538404 0.91
tpch_q12/duckdb:parquet 1098147130 1278638876 0.86
tpch_q13/duckdb:parquet 1345066083 1305766682 1.03
tpch_q14/duckdb:parquet 1364163338 1266556132 1.08
tpch_q15/duckdb:parquet 1115107466 926807296 1.20
tpch_q16/duckdb:parquet 1043692280 966740455 1.08
tpch_q17/duckdb:parquet 1402828878 1471382923 0.95
tpch_q18/duckdb:parquet 1396911359 1661870612 0.84
tpch_q19/duckdb:parquet 1535692735 1536432885 1.00
tpch_q20/duckdb:parquet 2142197844 2067454810 1.04
tpch_q21/duckdb:parquet 1810973103 1873999765 0.97
tpch_q22/duckdb:parquet 1107217191 1090054977 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +18.0% +19.8% -1.6% +40.4% ➖ noise
1 datafusion:vortex-file-compressed +8.0% +19.8% -9.9% +50.5% ➖ noise
1 duckdb:vortex-compact +0.1% +19.8% -16.4% +33.3% ➖ noise
1 duckdb:vortex-file-compressed -2.1% +19.8% -18.3% +33.3% ➖ noise
2 datafusion:vortex-compact +28.0% +32.0% -3.0% +36.4% ➖ noise
2 datafusion:vortex-file-compressed +15.7% +32.0% -12.3% +38.3% ➖ noise
2 duckdb:vortex-compact -0.1% +32.0% -24.3% +33.3% ➖ noise
2 duckdb:vortex-file-compressed +6.6% +32.0% -19.2% +33.3% ➖ noise
3 datafusion:vortex-compact +12.0% +2.2% +9.5% +40.4% ➖ noise
3 datafusion:vortex-file-compressed +16.8% +2.2% +14.3% +43.8% ➖ noise
3 duckdb:vortex-compact -9.4% +2.2% -11.3% +36.8% ➖ noise
3 duckdb:vortex-file-compressed -12.9% +2.2% -14.7% +38.9% ➖ noise
4 datafusion:vortex-compact +16.8% +17.5% -0.6% +35.0% ➖ noise
4 datafusion:vortex-file-compressed +23.1% +17.5% +4.8% +33.3% ➖ noise
4 duckdb:vortex-compact -1.0% +17.5% -15.7% +33.3% ➖ noise
4 duckdb:vortex-file-compressed -7.9% +17.5% -21.6% +33.3% ➖ noise
5 datafusion:vortex-compact +23.2% +5.4% +17.0% +33.3% ➖ noise
5 datafusion:vortex-file-compressed +25.1% +5.4% +18.7% +33.3% ➖ noise
5 duckdb:vortex-compact +0.8% +5.4% -4.4% +33.3% ➖ noise
5 duckdb:vortex-file-compressed +2.6% +5.4% -2.6% +33.3% ➖ noise
6 datafusion:vortex-compact -2.8% +8.2% -10.2% +33.3% ➖ noise
6 datafusion:vortex-file-compressed -4.0% +8.2% -11.3% +33.3% ➖ noise
6 duckdb:vortex-compact -11.2% +8.2% -18.0% +33.3% ➖ noise
6 duckdb:vortex-file-compressed -6.6% +8.2% -13.7% +33.3% ➖ noise
7 datafusion:vortex-compact -12.1% +7.8% -18.5% +33.3% ➖ noise
7 datafusion:vortex-file-compressed -2.3% +7.8% -9.4% +33.3% ➖ noise
7 duckdb:vortex-compact -2.0% +7.8% -9.1% +33.3% ➖ noise
7 duckdb:vortex-file-compressed -3.0% +7.8% -10.1% +33.3% ➖ noise
8 datafusion:vortex-compact +36.5% +3.2% +32.3% +33.3% ➖ noise
8 datafusion:vortex-file-compressed -1.6% +3.2% -4.6% +33.3% ➖ noise
8 duckdb:vortex-compact -11.9% +3.2% -14.6% +33.3% ➖ noise
8 duckdb:vortex-file-compressed -5.6% +3.2% -8.5% +33.3% ➖ noise
9 datafusion:vortex-compact +2.8% +3.1% -0.3% +33.3% ➖ noise
9 datafusion:vortex-file-compressed -7.8% +3.1% -10.6% +33.3% ➖ noise
9 duckdb:vortex-compact -20.0% +3.1% -22.4% +33.3% ➖ noise
9 duckdb:vortex-file-compressed +0.5% +3.1% -2.6% +33.3% ➖ noise
10 datafusion:vortex-compact +5.0% +13.2% -7.2% +33.6% ➖ noise
10 datafusion:vortex-file-compressed +5.5% +13.2% -6.8% +33.3% ➖ noise
10 duckdb:vortex-compact -4.9% +13.2% -16.0% +33.3% ➖ noise
10 duckdb:vortex-file-compressed -0.5% +13.2% -12.1% +33.3% ➖ noise
11 datafusion:vortex-compact +4.2% +13.7% -8.4% +35.3% ➖ noise
11 datafusion:vortex-file-compressed -2.5% +13.7% -14.2% +33.3% ➖ noise
11 duckdb:vortex-compact -11.9% +13.7% -22.5% +33.3% ➖ noise
11 duckdb:vortex-file-compressed -1.5% +13.7% -13.4% +33.3% ➖ noise
12 datafusion:vortex-compact -37.5% +21.7% -48.7% +33.3% ✅ faster
12 datafusion:vortex-file-compressed +27.3% +21.7% +4.5% +33.3% ➖ noise
12 duckdb:vortex-compact -3.1% +21.7% -20.4% +33.3% ➖ noise
12 duckdb:vortex-file-compressed -1.9% +21.7% -19.4% +33.3% ➖ noise
13 datafusion:vortex-compact -7.8% +5.9% -13.0% +52.4% ➖ noise
13 datafusion:vortex-file-compressed +12.3% +5.9% +6.0% +33.3% ➖ noise
13 duckdb:vortex-compact -3.5% +5.9% -8.9% +34.5% ➖ noise
13 duckdb:vortex-file-compressed -0.5% +5.9% -6.1% +39.2% ➖ noise
14 datafusion:vortex-compact +1.9% +3.3% -1.4% +33.3% ➖ noise
14 datafusion:vortex-file-compressed +42.4% +3.3% +37.8% +33.3% 🚨 regression
14 duckdb:vortex-compact +0.1% +3.3% -3.1% +33.3% ➖ noise
14 duckdb:vortex-file-compressed -15.7% +3.3% -18.4% +33.3% ➖ noise
15 datafusion:vortex-compact +11.0% +14.1% -2.7% +33.3% ➖ noise
15 datafusion:vortex-file-compressed +25.9% +14.1% +10.3% +33.3% ➖ noise
15 duckdb:vortex-compact -6.3% +14.1% -17.9% +33.3% ➖ noise
15 duckdb:vortex-file-compressed -6.2% +14.1% -17.8% +33.3% ➖ noise
16 datafusion:vortex-compact +98.2% +9.7% +80.6% +44.4% 🚨 regression
16 datafusion:vortex-file-compressed +71.0% +9.7% +55.9% +35.9% 🚨 regression
16 duckdb:vortex-compact -7.0% +9.7% -15.2% +33.3% ➖ noise
16 duckdb:vortex-file-compressed -1.1% +9.7% -9.9% +33.3% ➖ noise
17 datafusion:vortex-compact +1.7% +5.4% -3.5% +33.3% ➖ noise
17 datafusion:vortex-file-compressed -6.4% +5.4% -11.2% +33.3% ➖ noise
17 duckdb:vortex-compact -1.5% +5.4% -6.5% +33.3% ➖ noise
17 duckdb:vortex-file-compressed -4.5% +5.4% -9.4% +33.3% ➖ noise
18 datafusion:vortex-compact -3.6% -4.1% +0.6% +33.3% ➖ noise
18 datafusion:vortex-file-compressed -13.2% -4.1% -9.4% +33.3% ➖ noise
18 duckdb:vortex-compact -4.8% -4.1% -0.7% +33.3% ➖ noise
18 duckdb:vortex-file-compressed -13.3% -4.1% -9.5% +33.3% ➖ noise
19 datafusion:vortex-compact +2.6% +8.2% -5.1% +33.3% ➖ noise
19 datafusion:vortex-file-compressed -8.1% +8.2% -15.0% +33.3% ➖ noise
19 duckdb:vortex-compact -10.9% +8.2% -17.7% +33.3% ➖ noise
19 duckdb:vortex-file-compressed -6.2% +8.2% -13.3% +33.3% ➖ noise
20 datafusion:vortex-compact -3.0% +7.2% -9.5% +33.3% ➖ noise
20 datafusion:vortex-file-compressed +24.6% +7.2% +16.2% +33.3% ➖ noise
20 duckdb:vortex-compact +8.7% +7.2% +1.4% +33.3% ➖ noise
20 duckdb:vortex-file-compressed +0.1% +7.2% -6.6% +33.3% ➖ noise
21 datafusion:vortex-compact +3.1% +6.8% -3.5% +33.3% ➖ noise
21 datafusion:vortex-file-compressed +7.7% +6.8% +0.9% +33.3% ➖ noise
21 duckdb:vortex-compact -13.8% +6.8% -19.3% +33.3% ➖ noise
21 duckdb:vortex-file-compressed -4.3% +6.8% -10.4% +33.3% ➖ noise
22 datafusion:vortex-compact +49.3% +64.8% -9.4% +33.3% ➖ noise
22 datafusion:vortex-file-compressed +70.7% +64.8% +3.6% +36.2% ➖ noise
22 duckdb:vortex-compact +11.0% +64.8% -32.7% +33.3% ✅ faster
22 duckdb:vortex-file-compressed +4.2% +64.8% -36.8% +34.4% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.055x ➖


datafusion / vortex-file-compressed (1.055x ➖, 0↑ 1↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 128847912 126484696 1.02
polarsignals_q01/datafusion:vortex-file-compressed 291921081 301065834 0.97
polarsignals_q02/datafusion:vortex-file-compressed 25407830 23634868 1.08
polarsignals_q03/datafusion:vortex-file-compressed 310352384 285005774 1.09
polarsignals_q04/datafusion:vortex-file-compressed 12630374 11836121 1.07
polarsignals_q05/datafusion:vortex-file-compressed 16022972 15619124 1.03
polarsignals_q06/datafusion:vortex-file-compressed 18560006 17869772 1.04
polarsignals_q07/datafusion:vortex-file-compressed 🚨 14586887 12919654 1.13
polarsignals_q08/datafusion:vortex-file-compressed 429021817 406627852 1.06
polarsignals_q09/datafusion:vortex-file-compressed 11690354 10698446 1.09

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.2%
Vortex (geomean): 0.961x ➖
Parquet (geomean): 0.984x ➖
Shifts: Parquet (control) -1.6% · Median polish -2.4%


datafusion / vortex-file-compressed (0.968x ➖, 4↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 24851672 25040645 0.99
tpcds_q02/datafusion:vortex-file-compressed 46493428 47087938 0.99
tpcds_q03/datafusion:vortex-file-compressed 14848109 15917429 0.93
tpcds_q04/datafusion:vortex-file-compressed 248166639 257716319 0.96
tpcds_q05/datafusion:vortex-file-compressed 42852798 45338911 0.95
tpcds_q06/datafusion:vortex-file-compressed 58403285 58687988 1.00
tpcds_q07/datafusion:vortex-file-compressed 41189625 43485675 0.95
tpcds_q08/datafusion:vortex-file-compressed 28125685 29266979 0.96
tpcds_q09/datafusion:vortex-file-compressed 38588081 40194236 0.96
tpcds_q10/datafusion:vortex-file-compressed 37745541 39752694 0.95
tpcds_q11/datafusion:vortex-file-compressed 124745765 131963663 0.95
tpcds_q12/datafusion:vortex-file-compressed 19225056 18711973 1.03
tpcds_q13/datafusion:vortex-file-compressed 39380269 40396248 0.97
tpcds_q14/datafusion:vortex-file-compressed 169543858 170907181 0.99
tpcds_q15/datafusion:vortex-file-compressed 27654597 28611317 0.97
tpcds_q16/datafusion:vortex-file-compressed 28041651 28342477 0.99
tpcds_q17/datafusion:vortex-file-compressed 62561718 63005948 0.99
tpcds_q18/datafusion:vortex-file-compressed 67633903 69701242 0.97
tpcds_q19/datafusion:vortex-file-compressed 21369543 22955735 0.93
tpcds_q20/datafusion:vortex-file-compressed 21570433 21535735 1.00
tpcds_q21/datafusion:vortex-file-compressed 34766473 36484959 0.95
tpcds_q22/datafusion:vortex-file-compressed 🚀 114394653 131663152 0.87
tpcds_q23/datafusion:vortex-file-compressed 147187625 157989019 0.93
tpcds_q24/datafusion:vortex-file-compressed 82795727 83164372 1.00
tpcds_q25/datafusion:vortex-file-compressed 66335563 68792118 0.96
tpcds_q26/datafusion:vortex-file-compressed 33557087 33613854 1.00
tpcds_q27/datafusion:vortex-file-compressed 106335184 107646780 0.99
tpcds_q28/datafusion:vortex-file-compressed 33774245 34625890 0.98
tpcds_q29/datafusion:vortex-file-compressed 60529633 61486378 0.98
tpcds_q30/datafusion:vortex-file-compressed 22290249 23540044 0.95
tpcds_q31/datafusion:vortex-file-compressed 72035792 75152149 0.96
tpcds_q32/datafusion:vortex-file-compressed 19646016 21055244 0.93
tpcds_q33/datafusion:vortex-file-compressed 29179397 29982007 0.97
tpcds_q34/datafusion:vortex-file-compressed 24170128 24406800 0.99
tpcds_q35/datafusion:vortex-file-compressed 44092111 46106888 0.96
tpcds_q36/datafusion:vortex-file-compressed 58062144 57415880 1.01
tpcds_q37/datafusion:vortex-file-compressed 22816525 25271137 0.90
tpcds_q38/datafusion:vortex-file-compressed 41314786 44956569 0.92
tpcds_q39/datafusion:vortex-file-compressed 103521538 105977825 0.98
tpcds_q40/datafusion:vortex-file-compressed 32360475 32802088 0.99
tpcds_q41/datafusion:vortex-file-compressed 14990274 15252826 0.98
tpcds_q42/datafusion:vortex-file-compressed 13874637 14359788 0.97
tpcds_q43/datafusion:vortex-file-compressed 18833077 19040468 0.99
tpcds_q44/datafusion:vortex-file-compressed 31354237 32269652 0.97
tpcds_q45/datafusion:vortex-file-compressed 26511061 27041067 0.98
tpcds_q46/datafusion:vortex-file-compressed 🚀 33724224 37883886 0.89
tpcds_q47/datafusion:vortex-file-compressed 129098772 133080404 0.97
tpcds_q48/datafusion:vortex-file-compressed 35299596 36455957 0.97
tpcds_q49/datafusion:vortex-file-compressed 56728795 58742949 0.97
tpcds_q50/datafusion:vortex-file-compressed 39856132 39899747 1.00
tpcds_q51/datafusion:vortex-file-compressed 86622895 86462865 1.00
tpcds_q52/datafusion:vortex-file-compressed 13989890 14527605 0.96
tpcds_q53/datafusion:vortex-file-compressed 20876343 21279746 0.98
tpcds_q54/datafusion:vortex-file-compressed 35045174 36559480 0.96
tpcds_q55/datafusion:vortex-file-compressed 14207110 14082106 1.01
tpcds_q56/datafusion:vortex-file-compressed 29626058 30934931 0.96
tpcds_q57/datafusion:vortex-file-compressed 112448361 106812239 1.05
tpcds_q58/datafusion:vortex-file-compressed 52197227 54375238 0.96
tpcds_q59/datafusion:vortex-file-compressed 55256372 57076095 0.97
tpcds_q60/datafusion:vortex-file-compressed 29888628 30207865 0.99
tpcds_q61/datafusion:vortex-file-compressed 40121619 40390118 0.99
tpcds_q62/datafusion:vortex-file-compressed 🚀 21569566 26866954 0.80
tpcds_q63/datafusion:vortex-file-compressed 20706750 21654624 0.96
tpcds_q64/datafusion:vortex-file-compressed 405055270 420848778 0.96
tpcds_q65/datafusion:vortex-file-compressed 39600880 40163028 0.99
tpcds_q66/datafusion:vortex-file-compressed 69144430 72445812 0.95
tpcds_q67/datafusion:vortex-file-compressed 141095229 150994674 0.93
tpcds_q68/datafusion:vortex-file-compressed 31621895 32367724 0.98
tpcds_q69/datafusion:vortex-file-compressed 35115285 35400504 0.99
tpcds_q70/datafusion:vortex-file-compressed 82680841 90540510 0.91
tpcds_q71/datafusion:vortex-file-compressed 23030008 24214020 0.95
tpcds_q72/datafusion:vortex-file-compressed 🚀 2122925225 2369943292 0.90
tpcds_q73/datafusion:vortex-file-compressed 22705226 22383048 1.01
tpcds_q74/datafusion:vortex-file-compressed 77635797 80608945 0.96
tpcds_q75/datafusion:vortex-file-compressed 105118412 107656297 0.98
tpcds_q76/datafusion:vortex-file-compressed 23863238 25572472 0.93
tpcds_q77/datafusion:vortex-file-compressed 39557942 40282038 0.98
tpcds_q78/datafusion:vortex-file-compressed 122727649 127937315 0.96
tpcds_q79/datafusion:vortex-file-compressed 28568229 29094136 0.98
tpcds_q80/datafusion:vortex-file-compressed 91343434 97572125 0.94
tpcds_q81/datafusion:vortex-file-compressed 23482041 23413586 1.00
tpcds_q82/datafusion:vortex-file-compressed 24206689 25143325 0.96
tpcds_q83/datafusion:vortex-file-compressed 32964190 33527326 0.98
tpcds_q84/datafusion:vortex-file-compressed 12731672 13174724 0.97
tpcds_q85/datafusion:vortex-file-compressed 90073196 92674801 0.97
tpcds_q86/datafusion:vortex-file-compressed 15196511 16181577 0.94
tpcds_q87/datafusion:vortex-file-compressed 42213010 42697673 0.99
tpcds_q88/datafusion:vortex-file-compressed 56690544 56832112 1.00
tpcds_q89/datafusion:vortex-file-compressed 24189633 24439840 0.99
tpcds_q90/datafusion:vortex-file-compressed 14172477 14501367 0.98
tpcds_q91/datafusion:vortex-file-compressed 17543159 19174255 0.91
tpcds_q92/datafusion:vortex-file-compressed 17673078 17866396 0.99
tpcds_q93/datafusion:vortex-file-compressed 33171355 33738969 0.98
tpcds_q94/datafusion:vortex-file-compressed 22729433 23276793 0.98
tpcds_q95/datafusion:vortex-file-compressed 59654163 61582849 0.97
tpcds_q96/datafusion:vortex-file-compressed 13863697 13531192 1.02
tpcds_q97/datafusion:vortex-file-compressed 32043141 32600573 0.98
tpcds_q98/datafusion:vortex-file-compressed 24383978 23890648 1.02
tpcds_q99/datafusion:vortex-file-compressed 31269271 31856412 0.98
datafusion / vortex-compact (0.951x ➖, 25↑ 1↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 26620088 25521322 1.04
tpcds_q02/datafusion:vortex-compact 52676402 53877690 0.98
tpcds_q03/datafusion:vortex-compact 19908685 19885676 1.00
tpcds_q04/datafusion:vortex-compact 298501901 289612640 1.03
tpcds_q05/datafusion:vortex-compact 45893062 46661707 0.98
tpcds_q06/datafusion:vortex-compact 62094333 63933739 0.97
tpcds_q07/datafusion:vortex-compact 51890149 54370504 0.95
tpcds_q08/datafusion:vortex-compact 35475835 35602577 1.00
tpcds_q09/datafusion:vortex-compact 52008646 52176971 1.00
tpcds_q10/datafusion:vortex-compact 48395724 48869423 0.99
tpcds_q11/datafusion:vortex-compact 150569153 153764414 0.98
tpcds_q12/datafusion:vortex-compact 22194574 24488332 0.91
tpcds_q13/datafusion:vortex-compact 121769545 128599090 0.95
tpcds_q14/datafusion:vortex-compact 195778404 201076340 0.97
tpcds_q15/datafusion:vortex-compact 29905436 30059038 0.99
tpcds_q16/datafusion:vortex-compact 31769534 32152218 0.99
tpcds_q17/datafusion:vortex-compact 75568176 75921986 1.00
tpcds_q18/datafusion:vortex-compact 77068031 77838329 0.99
tpcds_q19/datafusion:vortex-compact 29195614 30904300 0.94
tpcds_q20/datafusion:vortex-compact 26068877 26450102 0.99
tpcds_q21/datafusion:vortex-compact 39058492 40216788 0.97
tpcds_q22/datafusion:vortex-compact 🚀 122162385 145572312 0.84
tpcds_q23/datafusion:vortex-compact 171551704 162090317 1.06
tpcds_q24/datafusion:vortex-compact 97187386 96838005 1.00
tpcds_q25/datafusion:vortex-compact 77573501 79512156 0.98
tpcds_q26/datafusion:vortex-compact 43977458 43644146 1.01
tpcds_q27/datafusion:vortex-compact 131226398 122861735 1.07
tpcds_q28/datafusion:vortex-compact 97596104 100275564 0.97
tpcds_q29/datafusion:vortex-compact 73187734 73208122 1.00
tpcds_q30/datafusion:vortex-compact 26395479 26360280 1.00
tpcds_q31/datafusion:vortex-compact 96520476 99066861 0.97
tpcds_q32/datafusion:vortex-compact 25645306 25030076 1.02
tpcds_q33/datafusion:vortex-compact 36623875 37733434 0.97
tpcds_q34/datafusion:vortex-compact 33020506 32917067 1.00
tpcds_q35/datafusion:vortex-compact 50508918 51967652 0.97
tpcds_q36/datafusion:vortex-compact 72232919 78495528 0.92
tpcds_q37/datafusion:vortex-compact 32846223 33996046 0.97
tpcds_q38/datafusion:vortex-compact 50001993 51469192 0.97
tpcds_q39/datafusion:vortex-compact 109669708 111805060 0.98
tpcds_q40/datafusion:vortex-compact 36433073 36676281 0.99
tpcds_q41/datafusion:vortex-compact 16761171 18068472 0.93
tpcds_q42/datafusion:vortex-compact 18555620 18251026 1.02
tpcds_q43/datafusion:vortex-compact 24669047 25337630 0.97
tpcds_q44/datafusion:vortex-compact 46472095 49242696 0.94
tpcds_q45/datafusion:vortex-compact 🚀 31643655 39515057 0.80
tpcds_q46/datafusion:vortex-compact 🚀 43923765 50053676 0.88
tpcds_q47/datafusion:vortex-compact 🚀 148420103 172599789 0.86
tpcds_q48/datafusion:vortex-compact 82242845 91139373 0.90
tpcds_q49/datafusion:vortex-compact 🚀 69052033 79800726 0.87
tpcds_q50/datafusion:vortex-compact 🚀 48372786 54703039 0.88
tpcds_q51/datafusion:vortex-compact 🚀 95833932 110254389 0.87
tpcds_q52/datafusion:vortex-compact 🚀 18398110 21082150 0.87
tpcds_q53/datafusion:vortex-compact 🚀 28058514 31774574 0.88
tpcds_q54/datafusion:vortex-compact 🚀 41649542 47229109 0.88
tpcds_q55/datafusion:vortex-compact 🚀 17952861 20816147 0.86
tpcds_q56/datafusion:vortex-compact 🚀 36058332 43021820 0.84
tpcds_q57/datafusion:vortex-compact 🚀 113517104 129365875 0.88
tpcds_q58/datafusion:vortex-compact 🚀 61566527 71948739 0.86
tpcds_q59/datafusion:vortex-compact 68871962 76168729 0.90
tpcds_q60/datafusion:vortex-compact 🚀 36204690 41529046 0.87
tpcds_q61/datafusion:vortex-compact 🚀 54663115 63744944 0.86
tpcds_q62/datafusion:vortex-compact 🚀 27828089 34415328 0.81
tpcds_q63/datafusion:vortex-compact 🚀 27538735 31539694 0.87
tpcds_q64/datafusion:vortex-compact 🚀 451493636 533157309 0.85
tpcds_q65/datafusion:vortex-compact 🚀 52605284 60743347 0.87
tpcds_q66/datafusion:vortex-compact 75473029 82535480 0.91
tpcds_q67/datafusion:vortex-compact 🚀 149969387 182210953 0.82
tpcds_q68/datafusion:vortex-compact 🚀 43954598 50248006 0.87
tpcds_q69/datafusion:vortex-compact 🚀 45232642 50809998 0.89
tpcds_q70/datafusion:vortex-compact 94730884 99783541 0.95
tpcds_q71/datafusion:vortex-compact 30216335 30546129 0.99
tpcds_q72/datafusion:vortex-compact 🚀 2112093322 2658569550 0.79
tpcds_q73/datafusion:vortex-compact 30037427 30063163 1.00
tpcds_q74/datafusion:vortex-compact 90651387 95502196 0.95
tpcds_q75/datafusion:vortex-compact 125895627 128547722 0.98
tpcds_q76/datafusion:vortex-compact 33154505 31935011 1.04
tpcds_q77/datafusion:vortex-compact 52344313 49294011 1.06
tpcds_q78/datafusion:vortex-compact 140014816 138680123 1.01
tpcds_q79/datafusion:vortex-compact 37531359 41076206 0.91
tpcds_q80/datafusion:vortex-compact 103213070 101323876 1.02
tpcds_q81/datafusion:vortex-compact 🚨 32145607 27196244 1.18
tpcds_q82/datafusion:vortex-compact 34217805 34689437 0.99
tpcds_q83/datafusion:vortex-compact 32487163 34247572 0.95
tpcds_q84/datafusion:vortex-compact 13804904 13894885 0.99
tpcds_q85/datafusion:vortex-compact 158420240 151312409 1.05
tpcds_q86/datafusion:vortex-compact 18011648 18128683 0.99
tpcds_q87/datafusion:vortex-compact 48319984 49985701 0.97
tpcds_q88/datafusion:vortex-compact 79305372 77337844 1.03
tpcds_q89/datafusion:vortex-compact 30729791 32166174 0.96
tpcds_q90/datafusion:vortex-compact 15231013 15435397 0.99
tpcds_q91/datafusion:vortex-compact 32893025 33738310 0.97
tpcds_q92/datafusion:vortex-compact 23615881 24444439 0.97
tpcds_q93/datafusion:vortex-compact 38119998 38603863 0.99
tpcds_q94/datafusion:vortex-compact 27672339 26699725 1.04
tpcds_q95/datafusion:vortex-compact 66349966 69059629 0.96
tpcds_q96/datafusion:vortex-compact 17317542 17254359 1.00
tpcds_q97/datafusion:vortex-compact 34790192 34826294 1.00
tpcds_q98/datafusion:vortex-compact 29362563 29697320 0.99
tpcds_q99/datafusion:vortex-compact 🚀 29940313 34775357 0.86
datafusion / parquet (0.972x ➖, 8↑ 2↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 29200102 30338104 0.96
tpcds_q02/datafusion:parquet 42367833 43689379 0.97
tpcds_q03/datafusion:parquet 13557377 12930083 1.05
tpcds_q04/datafusion:parquet 254233861 280555024 0.91
tpcds_q05/datafusion:parquet 39559119 41904396 0.94
tpcds_q06/datafusion:parquet 58336804 59946694 0.97
tpcds_q07/datafusion:parquet 78770096 76211229 1.03
tpcds_q08/datafusion:parquet 26660225 26297610 1.01
tpcds_q09/datafusion:parquet 45479010 43427194 1.05
tpcds_q10/datafusion:parquet 68944929 69798549 0.99
tpcds_q11/datafusion:parquet 139496351 146225010 0.95
tpcds_q12/datafusion:parquet 16444603 17441691 0.94
tpcds_q13/datafusion:parquet 74847540 75227984 0.99
tpcds_q14/datafusion:parquet 161096890 164873293 0.98
tpcds_q15/datafusion:parquet 21023957 22325827 0.94
tpcds_q16/datafusion:parquet 22941879 25056893 0.92
tpcds_q17/datafusion:parquet 61329031 64015677 0.96
tpcds_q18/datafusion:parquet 112403998 113200036 0.99
tpcds_q19/datafusion:parquet 22015250 23375188 0.94
tpcds_q20/datafusion:parquet 15817340 17008210 0.93
tpcds_q21/datafusion:parquet 18703712 18453718 1.01
tpcds_q22/datafusion:parquet 🚨 173469635 139012878 1.25
tpcds_q23/datafusion:parquet 144394012 142122453 1.02
tpcds_q24/datafusion:parquet 87512779 89715504 0.98
tpcds_q25/datafusion:parquet 65036071 64507663 1.01
tpcds_q26/datafusion:parquet 64194825 63750812 1.01
tpcds_q27/datafusion:parquet 143850988 143250171 1.00
tpcds_q28/datafusion:parquet 45563708 44069217 1.03
tpcds_q29/datafusion:parquet 62875545 68041736 0.92
tpcds_q30/datafusion:parquet 33203298 34686181 0.96
tpcds_q31/datafusion:parquet 63479823 65551176 0.97
tpcds_q32/datafusion:parquet 17775049 18544995 0.96
tpcds_q33/datafusion:parquet 26047674 27005706 0.96
tpcds_q34/datafusion:parquet 20385371 21799386 0.94
tpcds_q35/datafusion:parquet 66079970 69595299 0.95
tpcds_q36/datafusion:parquet 56247297 56195861 1.00
tpcds_q37/datafusion:parquet 17940614 18409178 0.97
tpcds_q38/datafusion:parquet 38658606 38404129 1.01
tpcds_q39/datafusion:parquet 72272105 72965941 0.99
tpcds_q40/datafusion:parquet 22889277 23973252 0.95
tpcds_q41/datafusion:parquet 12952393 13198231 0.98
tpcds_q42/datafusion:parquet 11230935 11080690 1.01
tpcds_q43/datafusion:parquet 16648119 17047069 0.98
tpcds_q44/datafusion:parquet 32746616 32902922 1.00
tpcds_q45/datafusion:parquet 27471181 28388343 0.97
tpcds_q46/datafusion:parquet 31647947 32222396 0.98
tpcds_q47/datafusion:parquet 124494717 124027231 1.00
tpcds_q48/datafusion:parquet 67946955 70381523 0.97
tpcds_q49/datafusion:parquet 54124162 56914978 0.95
tpcds_q50/datafusion:parquet 42977789 42828463 1.00
tpcds_q51/datafusion:parquet 83644322 83837892 1.00
tpcds_q52/datafusion:parquet 11650527 11891282 0.98
tpcds_q53/datafusion:parquet 17672353 17226369 1.03
tpcds_q54/datafusion:parquet 33053372 35062384 0.94
tpcds_q55/datafusion:parquet 11104184 11614134 0.96
tpcds_q56/datafusion:parquet 27090532 27263365 0.99
tpcds_q57/datafusion:parquet 97505734 95632242 1.02
tpcds_q58/datafusion:parquet 49313010 50348233 0.98
tpcds_q59/datafusion:parquet 56237895 55957664 1.01
tpcds_q60/datafusion:parquet 26888763 27889176 0.96
tpcds_q61/datafusion:parquet 41712513 45243360 0.92
tpcds_q62/datafusion:parquet 20077900 20927033 0.96
tpcds_q63/datafusion:parquet 17918210 18935183 0.95
tpcds_q64/datafusion:parquet 🚀 500218082 571212504 0.88
tpcds_q65/datafusion:parquet 37461927 41621386 0.90
tpcds_q66/datafusion:parquet 68960534 72917460 0.95
tpcds_q67/datafusion:parquet 🚀 140468495 168879236 0.83
tpcds_q68/datafusion:parquet 🚀 31979720 35950981 0.89
tpcds_q69/datafusion:parquet 🚀 63963179 72311339 0.88
tpcds_q70/datafusion:parquet 🚀 86601569 98875065 0.88
tpcds_q71/datafusion:parquet 🚀 22006802 25150137 0.88
tpcds_q72/datafusion:parquet 🚀 605791400 725334069 0.84
tpcds_q73/datafusion:parquet 20874215 21238340 0.98
tpcds_q74/datafusion:parquet 81504605 81542836 1.00
tpcds_q75/datafusion:parquet 96079985 99953237 0.96
tpcds_q76/datafusion:parquet 29707504 29578713 1.00
tpcds_q77/datafusion:parquet 38607944 38322969 1.01
tpcds_q78/datafusion:parquet 110614523 112537613 0.98
tpcds_q79/datafusion:parquet 26605081 25694974 1.04
tpcds_q80/datafusion:parquet 78613718 77759025 1.01
tpcds_q81/datafusion:parquet 30530690 32264018 0.95
tpcds_q82/datafusion:parquet 18870075 19378566 0.97
tpcds_q83/datafusion:parquet 35165762 36329573 0.97
tpcds_q84/datafusion:parquet 37665248 38305177 0.98
tpcds_q85/datafusion:parquet 145369096 147202041 0.99
tpcds_q86/datafusion:parquet 🚨 15344136 13781271 1.11
tpcds_q87/datafusion:parquet 39044146 39645861 0.98
tpcds_q88/datafusion:parquet 58339595 58697366 0.99
tpcds_q89/datafusion:parquet 20471306 20905174 0.98
tpcds_q90/datafusion:parquet 13758518 13599285 1.01
tpcds_q91/datafusion:parquet 56616108 56524682 1.00
tpcds_q92/datafusion:parquet 17842534 17673734 1.01
tpcds_q93/datafusion:parquet 31438870 32931064 0.95
tpcds_q94/datafusion:parquet 19791539 19839841 1.00
tpcds_q95/datafusion:parquet 57991299 59316814 0.98
tpcds_q96/datafusion:parquet 11195227 12004704 0.93
tpcds_q97/datafusion:parquet 29069276 28980746 1.00
tpcds_q98/datafusion:parquet 20401868 20797754 0.98
tpcds_q99/datafusion:parquet 🚀 24990721 28996865 0.86
duckdb / vortex-file-compressed (0.955x ➖, 18↑ 1↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21645724 21980196 0.98
tpcds_q02/duckdb:vortex-file-compressed 33440641 33397949 1.00
tpcds_q03/duckdb:vortex-file-compressed 26527789 26385063 1.01
tpcds_q04/duckdb:vortex-file-compressed 90272590 90784184 0.99
tpcds_q05/duckdb:vortex-file-compressed 32302319 32237147 1.00
tpcds_q06/duckdb:vortex-file-compressed 30129084 31315473 0.96
tpcds_q07/duckdb:vortex-file-compressed 19819272 19454174 1.02
tpcds_q08/duckdb:vortex-file-compressed 23968855 25964211 0.92
tpcds_q09/duckdb:vortex-file-compressed 14766112 15744772 0.94
tpcds_q10/duckdb:vortex-file-compressed 35579716 35338601 1.01
tpcds_q11/duckdb:vortex-file-compressed 59979114 60558770 0.99
tpcds_q12/duckdb:vortex-file-compressed 13125607 13786029 0.95
tpcds_q13/duckdb:vortex-file-compressed 31281250 32889700 0.95
tpcds_q14/duckdb:vortex-file-compressed 95575230 94934867 1.01
tpcds_q15/duckdb:vortex-file-compressed 25959574 26148060 0.99
tpcds_q16/duckdb:vortex-file-compressed 25274200 24906692 1.01
tpcds_q17/duckdb:vortex-file-compressed 43668450 44701796 0.98
tpcds_q18/duckdb:vortex-file-compressed 36236143 36288462 1.00
tpcds_q19/duckdb:vortex-file-compressed 30312138 30754839 0.99
tpcds_q20/duckdb:vortex-file-compressed 14315775 14660204 0.98
tpcds_q21/duckdb:vortex-file-compressed 15033748 15608622 0.96
tpcds_q22/duckdb:vortex-file-compressed 71647507 73606503 0.97
tpcds_q23/duckdb:vortex-file-compressed 106651871 97632506 1.09
tpcds_q24/duckdb:vortex-file-compressed 46886779 46762467 1.00
tpcds_q25/duckdb:vortex-file-compressed 47336223 50443732 0.94
tpcds_q26/duckdb:vortex-file-compressed 17325904 17278388 1.00
tpcds_q27/duckdb:vortex-file-compressed 20653823 20116986 1.03
tpcds_q28/duckdb:vortex-file-compressed 11741077 12091414 0.97
tpcds_q29/duckdb:vortex-file-compressed 39138779 41049248 0.95
tpcds_q30/duckdb:vortex-file-compressed 23757222 23503425 1.01
tpcds_q31/duckdb:vortex-file-compressed 25789681 25903813 1.00
tpcds_q32/duckdb:vortex-file-compressed 13196680 13313900 0.99
tpcds_q33/duckdb:vortex-file-compressed 22208969 22581138 0.98
tpcds_q34/duckdb:vortex-file-compressed 23107621 23731122 0.97
tpcds_q35/duckdb:vortex-file-compressed 64169510 63380831 1.01
tpcds_q36/duckdb:vortex-file-compressed 23175148 22822993 1.02
tpcds_q37/duckdb:vortex-file-compressed 18202359 19113994 0.95
tpcds_q38/duckdb:vortex-file-compressed 34431176 34459258 1.00
tpcds_q39/duckdb:vortex-file-compressed 33806817 32833075 1.03
tpcds_q40/duckdb:vortex-file-compressed 18493181 18209516 1.02
tpcds_q41/duckdb:vortex-file-compressed 9480101 9698143 0.98
tpcds_q42/duckdb:vortex-file-compressed 12258647 12249429 1.00
tpcds_q43/duckdb:vortex-file-compressed 20767255 20302981 1.02
tpcds_q44/duckdb:vortex-file-compressed 20614240 21101377 0.98
tpcds_q45/duckdb:vortex-file-compressed 28092119 27448442 1.02
tpcds_q46/duckdb:vortex-file-compressed 31352782 30633699 1.02
tpcds_q47/duckdb:vortex-file-compressed 46350154 45565275 1.02
tpcds_q48/duckdb:vortex-file-compressed 27965397 27909576 1.00
tpcds_q49/duckdb:vortex-file-compressed 30144320 32356018 0.93
tpcds_q50/duckdb:vortex-file-compressed 28976915 29724314 0.97
tpcds_q51/duckdb:vortex-file-compressed 🚀 95209624 122312813 0.78
tpcds_q52/duckdb:vortex-file-compressed 12818576 12561942 1.02
tpcds_q53/duckdb:vortex-file-compressed 22140488 21548211 1.03
tpcds_q54/duckdb:vortex-file-compressed 🚀 26411196 30646880 0.86
tpcds_q55/duckdb:vortex-file-compressed 11125746 11980542 0.93
tpcds_q56/duckdb:vortex-file-compressed 🚀 21851374 25272289 0.86
tpcds_q57/duckdb:vortex-file-compressed 38515584 42002088 0.92
tpcds_q58/duckdb:vortex-file-compressed 29059832 31228976 0.93
tpcds_q59/duckdb:vortex-file-compressed 65566776 68678003 0.95
tpcds_q60/duckdb:vortex-file-compressed 🚀 22906980 27785504 0.82
tpcds_q61/duckdb:vortex-file-compressed 🚀 30382761 34638644 0.88
tpcds_q62/duckdb:vortex-file-compressed 🚀 15174760 17500562 0.87
tpcds_q63/duckdb:vortex-file-compressed 🚀 19666136 25118961 0.78
tpcds_q64/duckdb:vortex-file-compressed 🚀 99750069 115787068 0.86
tpcds_q65/duckdb:vortex-file-compressed 🚀 20336530 26787863 0.76
tpcds_q66/duckdb:vortex-file-compressed 🚀 26985159 30669921 0.88
tpcds_q67/duckdb:vortex-file-compressed 🚀 133914678 159872546 0.84
tpcds_q68/duckdb:vortex-file-compressed 🚀 29958825 35363714 0.85
tpcds_q69/duckdb:vortex-file-compressed 🚀 37057025 44628606 0.83
tpcds_q70/duckdb:vortex-file-compressed 37348687 39379064 0.95
tpcds_q71/duckdb:vortex-file-compressed 🚀 18288031 21970878 0.83
tpcds_q72/duckdb:vortex-file-compressed 167786035 178124515 0.94
tpcds_q73/duckdb:vortex-file-compressed 🚀 22655351 26656426 0.85
tpcds_q74/duckdb:vortex-file-compressed 39139324 42425888 0.92
tpcds_q75/duckdb:vortex-file-compressed 47466630 48939226 0.97
tpcds_q76/duckdb:vortex-file-compressed 🚀 16639045 19709339 0.84
tpcds_q77/duckdb:vortex-file-compressed 🚀 20969901 23787269 0.88
tpcds_q78/duckdb:vortex-file-compressed 76828283 75393136 1.02
tpcds_q79/duckdb:vortex-file-compressed 24554769 23951642 1.03
tpcds_q80/duckdb:vortex-file-compressed 🚀 42242204 50828950 0.83
tpcds_q81/duckdb:vortex-file-compressed 27192385 28483502 0.95
tpcds_q82/duckdb:vortex-file-compressed 47011260 51913975 0.91
tpcds_q83/duckdb:vortex-file-compressed 25001058 25917589 0.96
tpcds_q84/duckdb:vortex-file-compressed 18828340 19803686 0.95
tpcds_q85/duckdb:vortex-file-compressed 43416532 45191807 0.96
tpcds_q86/duckdb:vortex-file-compressed 🚨 16849637 15240972 1.11
tpcds_q87/duckdb:vortex-file-compressed 37040788 40477277 0.92
tpcds_q88/duckdb:vortex-file-compressed 50953756 51018509 1.00
tpcds_q89/duckdb:vortex-file-compressed 19456930 19936991 0.98
tpcds_q90/duckdb:vortex-file-compressed 9879252 9771262 1.01
tpcds_q91/duckdb:vortex-file-compressed 24804252 22627455 1.10
tpcds_q92/duckdb:vortex-file-compressed 16987506 18510852 0.92
tpcds_q93/duckdb:vortex-file-compressed 28254668 30067845 0.94
tpcds_q94/duckdb:vortex-file-compressed 19691770 20219332 0.97
tpcds_q95/duckdb:vortex-file-compressed 154523175 162068820 0.95
tpcds_q96/duckdb:vortex-file-compressed 12275100 13396156 0.92
tpcds_q97/duckdb:vortex-file-compressed 37705808 35056522 1.08
tpcds_q98/duckdb:vortex-file-compressed 17983148 17861301 1.01
tpcds_q99/duckdb:vortex-file-compressed 25135693 26966433 0.93
duckdb / vortex-compact (0.968x ➖, 11↑ 3↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 24463760 23462120 1.04
tpcds_q02/duckdb:vortex-compact 41065459 39676213 1.04
tpcds_q03/duckdb:vortex-compact 48927718 51032013 0.96
tpcds_q04/duckdb:vortex-compact 94492484 104713491 0.90
tpcds_q05/duckdb:vortex-compact 41303397 42790757 0.97
tpcds_q06/duckdb:vortex-compact 36009463 38831832 0.93
tpcds_q07/duckdb:vortex-compact 32996904 33454254 0.99
tpcds_q08/duckdb:vortex-compact 41197407 39461312 1.04
tpcds_q09/duckdb:vortex-compact 19697971 21004577 0.94
tpcds_q10/duckdb:vortex-compact 48261971 50641974 0.95
tpcds_q11/duckdb:vortex-compact 68458803 73489686 0.93
tpcds_q12/duckdb:vortex-compact 18644903 20506173 0.91
tpcds_q13/duckdb:vortex-compact 53211380 53525740 0.99
tpcds_q14/duckdb:vortex-compact 114852270 119235931 0.96
tpcds_q15/duckdb:vortex-compact 28250793 30126617 0.94
tpcds_q16/duckdb:vortex-compact 26026925 26766247 0.97
tpcds_q17/duckdb:vortex-compact 54741923 54455593 1.01
tpcds_q18/duckdb:vortex-compact 47405014 47150739 1.01
tpcds_q19/duckdb:vortex-compact 41377533 43031424 0.96
tpcds_q20/duckdb:vortex-compact 17449333 18314375 0.95
tpcds_q21/duckdb:vortex-compact 17391126 17679239 0.98
tpcds_q22/duckdb:vortex-compact 72957099 72763164 1.00
tpcds_q23/duckdb:vortex-compact 🚀 113906385 130563094 0.87
tpcds_q24/duckdb:vortex-compact 56168178 57432522 0.98
tpcds_q25/duckdb:vortex-compact 77931442 82227975 0.95
tpcds_q26/duckdb:vortex-compact 31073739 30861125 1.01
tpcds_q27/duckdb:vortex-compact 34687348 34377744 1.01
tpcds_q28/duckdb:vortex-compact 🚀 25360120 34813458 0.73
tpcds_q29/duckdb:vortex-compact 51479542 52550829 0.98
tpcds_q30/duckdb:vortex-compact 29925449 27752425 1.08
tpcds_q31/duckdb:vortex-compact 33055314 33372825 0.99
tpcds_q32/duckdb:vortex-compact 19853835 21003587 0.95
tpcds_q33/duckdb:vortex-compact 32238892 32300992 1.00
tpcds_q34/duckdb:vortex-compact 29522847 30203794 0.98
tpcds_q35/duckdb:vortex-compact 71534788 72073188 0.99
tpcds_q36/duckdb:vortex-compact 35238721 35417355 0.99
tpcds_q37/duckdb:vortex-compact 21938087 24283027 0.90
tpcds_q38/duckdb:vortex-compact 39629418 37273152 1.06
tpcds_q39/duckdb:vortex-compact 35790848 36502956 0.98
tpcds_q40/duckdb:vortex-compact 24375240 23392499 1.04
tpcds_q41/duckdb:vortex-compact 11621580 11141538 1.04
tpcds_q42/duckdb:vortex-compact 18937094 18321887 1.03
tpcds_q43/duckdb:vortex-compact 31232492 29767124 1.05
tpcds_q44/duckdb:vortex-compact 27894176 29398282 0.95
tpcds_q45/duckdb:vortex-compact 34877932 35163352 0.99
tpcds_q46/duckdb:vortex-compact 46040110 45610963 1.01
tpcds_q47/duckdb:vortex-compact 55873615 61820803 0.90
tpcds_q48/duckdb:vortex-compact 45088310 46013482 0.98
tpcds_q49/duckdb:vortex-compact 45158672 45308751 1.00
tpcds_q50/duckdb:vortex-compact 36524542 36955117 0.99
tpcds_q51/duckdb:vortex-compact 🚨 116564600 105126360 1.11
tpcds_q52/duckdb:vortex-compact 18239679 18148827 1.01
tpcds_q53/duckdb:vortex-compact 31023732 33252404 0.93
tpcds_q54/duckdb:vortex-compact 35822000 35839958 1.00
tpcds_q55/duckdb:vortex-compact 18982195 18867290 1.01
tpcds_q56/duckdb:vortex-compact 30876732 31822311 0.97
tpcds_q57/duckdb:vortex-compact 40538402 42066960 0.96
tpcds_q58/duckdb:vortex-compact 36415699 36234077 1.01
tpcds_q59/duckdb:vortex-compact 86456934 87337526 0.99
tpcds_q60/duckdb:vortex-compact 32331976 33491008 0.97
tpcds_q61/duckdb:vortex-compact 52701066 52790480 1.00
tpcds_q62/duckdb:vortex-compact 🚀 18099328 20945844 0.86
tpcds_q63/duckdb:vortex-compact 29553689 31933150 0.93
tpcds_q64/duckdb:vortex-compact 126217004 133457729 0.95
tpcds_q65/duckdb:vortex-compact 29207074 30113500 0.97
tpcds_q66/duckdb:vortex-compact 35192925 34516337 1.02
tpcds_q67/duckdb:vortex-compact 147588474 145329212 1.02
tpcds_q68/duckdb:vortex-compact 46440482 48082630 0.97
tpcds_q69/duckdb:vortex-compact 52411900 52778204 0.99
tpcds_q70/duckdb:vortex-compact 57553704 59188005 0.97
tpcds_q71/duckdb:vortex-compact 27564600 26633869 1.03
tpcds_q72/duckdb:vortex-compact 187794933 183778276 1.02
tpcds_q73/duckdb:vortex-compact 26835601 28123594 0.95
tpcds_q74/duckdb:vortex-compact 45000685 47447541 0.95
tpcds_q75/duckdb:vortex-compact 57749651 57764809 1.00
tpcds_q76/duckdb:vortex-compact 27294962 26932210 1.01
tpcds_q77/duckdb:vortex-compact 37513741 37028410 1.01
tpcds_q78/duckdb:vortex-compact 85445809 84373151 1.01
tpcds_q79/duckdb:vortex-compact 39058088 42554421 0.92
tpcds_q80/duckdb:vortex-compact 70974338 70645162 1.00
tpcds_q81/duckdb:vortex-compact 31332921 32608336 0.96
tpcds_q82/duckdb:vortex-compact 50790481 54475899 0.93
tpcds_q83/duckdb:vortex-compact 🚨 39479700 34881035 1.13
tpcds_q84/duckdb:vortex-compact 🚀 26127880 29216872 0.89
tpcds_q85/duckdb:vortex-compact 56023770 60145243 0.93
tpcds_q86/duckdb:vortex-compact 🚀 19987888 22927407 0.87
tpcds_q87/duckdb:vortex-compact 45266107 44285516 1.02
tpcds_q88/duckdb:vortex-compact 🚀 73868856 85749676 0.86
tpcds_q89/duckdb:vortex-compact 29839482 32555965 0.92
tpcds_q90/duckdb:vortex-compact 🚀 10850299 12084330 0.90
tpcds_q91/duckdb:vortex-compact 43792238 48156591 0.91
tpcds_q92/duckdb:vortex-compact 🚨 48878746 42610785 1.15
tpcds_q93/duckdb:vortex-compact 🚀 31112507 36668293 0.85
tpcds_q94/duckdb:vortex-compact 🚀 25885601 30401289 0.85
tpcds_q95/duckdb:vortex-compact 163083973 163700371 1.00
tpcds_q96/duckdb:vortex-compact 16097467 17368275 0.93
tpcds_q97/duckdb:vortex-compact 🚀 42150816 47512785 0.89
tpcds_q98/duckdb:vortex-compact 25698819 28414658 0.90
tpcds_q99/duckdb:vortex-compact 🚀 28174741 33288822 0.85
duckdb / parquet (0.996x ➖, 3↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28356849 28057560 1.01
tpcds_q02/duckdb:parquet 23611443 23949963 0.99
tpcds_q03/duckdb:parquet 11528920 11716269 0.98
tpcds_q04/duckdb:parquet 168607620 167299527 1.01
tpcds_q05/duckdb:parquet 🚀 27735876 31443168 0.88
tpcds_q06/duckdb:parquet 27111769 27041855 1.00
tpcds_q07/duckdb:parquet 20932459 20661369 1.01
tpcds_q08/duckdb:parquet 26427202 26310128 1.00
tpcds_q09/duckdb:parquet 39664492 39263341 1.01
tpcds_q10/duckdb:parquet 32905462 32217160 1.02
tpcds_q11/duckdb:parquet 87140256 83204371 1.05
tpcds_q12/duckdb:parquet 14284775 14831618 0.96
tpcds_q13/duckdb:parquet 32607180 32884432 0.99
tpcds_q14/duckdb:parquet 100563958 100895687 1.00
tpcds_q15/duckdb:parquet 28727459 30336287 0.95
tpcds_q16/duckdb:parquet 20635154 21108236 0.98
tpcds_q17/duckdb:parquet 37093669 35888039 1.03
tpcds_q18/duckdb:parquet 46176135 44810373 1.03
tpcds_q19/duckdb:parquet 28322165 30678830 0.92
tpcds_q20/duckdb:parquet 14773930 15629723 0.95
tpcds_q21/duckdb:parquet 🚀 10079034 11273260 0.89
tpcds_q22/duckdb:parquet 65933671 70025364 0.94
tpcds_q23/duckdb:parquet 81755864 80375047 1.02
tpcds_q24/duckdb:parquet 43953938 43391119 1.01
tpcds_q25/duckdb:parquet 32080938 32935345 0.97
tpcds_q26/duckdb:parquet 34920734 34168716 1.02
tpcds_q27/duckdb:parquet 48358005 49014328 0.99
tpcds_q28/duckdb:parquet 37196193 37626065 0.99
tpcds_q29/duckdb:parquet 36824693 34653034 1.06
tpcds_q30/duckdb:parquet 34081344 33506711 1.02
tpcds_q31/duckdb:parquet 23553674 23971463 0.98
tpcds_q32/duckdb:parquet 🚀 10959539 12640222 0.87
tpcds_q33/duckdb:parquet 21135513 20093556 1.05
tpcds_q34/duckdb:parquet 20894815 20892969 1.00
tpcds_q35/duckdb:parquet 55157485 57356841 0.96
tpcds_q36/duckdb:parquet 19637142 20984185 0.94
tpcds_q37/duckdb:parquet 12724505 12898785 0.99
tpcds_q38/duckdb:parquet 33817796 32226540 1.05
tpcds_q39/duckdb:parquet 29262570 30157679 0.97
tpcds_q40/duckdb:parquet 16609460 17540477 0.95
tpcds_q41/duckdb:parquet 7252731 7435085 0.98
tpcds_q42/duckdb:parquet 10000083 10004972 1.00
tpcds_q43/duckdb:parquet 15092202 14960566 1.01
tpcds_q44/duckdb:parquet 23715465 22520330 1.05
tpcds_q45/duckdb:parquet 25314248 26642143 0.95
tpcds_q46/duckdb:parquet 45637900 43390172 1.05
tpcds_q47/duckdb:parquet 42885574 44793890 0.96
tpcds_q48/duckdb:parquet 29109444 28970190 1.00
tpcds_q49/duckdb:parquet 25563603 24094524 1.06
tpcds_q50/duckdb:parquet 25063464 25328556 0.99
tpcds_q51/duckdb:parquet 96504960 92871585 1.04
tpcds_q52/duckdb:parquet 10418810 10630695 0.98
tpcds_q53/duckdb:parquet 14864807 15896385 0.94
tpcds_q54/duckdb:parquet 26054322 25424146 1.02
tpcds_q55/duckdb:parquet 9521152 9539326 1.00
tpcds_q56/duckdb:parquet 20502168 20983306 0.98
tpcds_q57/duckdb:parquet 34252210 33903482 1.01
tpcds_q58/duckdb:parquet 24322718 22137641 1.10
tpcds_q59/duckdb:parquet 34471580 35343392 0.98
tpcds_q60/duckdb:parquet 21139880 21747792 0.97
tpcds_q61/duckdb:parquet 30403487 30544354 1.00
tpcds_q62/duckdb:parquet 11177301 11715931 0.95
tpcds_q63/duckdb:parquet 13637717 13671849 1.00
tpcds_q64/duckdb:parquet 75958724 77680741 0.98
tpcds_q65/duckdb:parquet 20070969 20884889 0.96
tpcds_q66/duckdb:parquet 29501817 29186041 1.01
tpcds_q67/duckdb:parquet 138104039 132191785 1.04
tpcds_q68/duckdb:parquet 36413500 36423879 1.00
tpcds_q69/duckdb:parquet 34970045 35603216 0.98
tpcds_q70/duckdb:parquet 19794083 19211833 1.03
tpcds_q71/duckdb:parquet 19371002 19209629 1.01
tpcds_q72/duckdb:parquet 164217366 164822390 1.00
tpcds_q73/duckdb:parquet 17305315 17713107 0.98
tpcds_q74/duckdb:parquet 125152741 128632188 0.97
tpcds_q75/duckdb:parquet 51704125 52532680 0.98
tpcds_q76/duckdb:parquet 20290142 20210397 1.00
tpcds_q77/duckdb:parquet 21857796 21093675 1.04
tpcds_q78/duckdb:parquet 75430370 74235563 1.02
tpcds_q79/duckdb:parquet 27447852 27048551 1.01
tpcds_q80/duckdb:parquet 42417466 42024660 1.01
tpcds_q81/duckdb:parquet 31701078 32329355 0.98
tpcds_q82/duckdb:parquet 13642462 13586439 1.00
tpcds_q83/duckdb:parquet 16102920 16431501 0.98
tpcds_q84/duckdb:parquet 18172766 18700922 0.97
tpcds_q85/duckdb:parquet 39017615 38046451 1.03
tpcds_q86/duckdb:parquet 12627418 12701853 0.99
tpcds_q87/duckdb:parquet 36905942 36195227 1.02
tpcds_q88/duckdb:parquet 48478203 48052896 1.01
tpcds_q89/duckdb:parquet 17203970 15829384 1.09
tpcds_q90/duckdb:parquet 7485598 7217199 1.04
tpcds_q91/duckdb:parquet 22411282 22460766 1.00
tpcds_q92/duckdb:parquet 11250049 11109499 1.01
tpcds_q93/duckdb:parquet 29918887 29061799 1.03
tpcds_q94/duckdb:parquet 16010291 16241478 0.99
tpcds_q95/duckdb:parquet 142877237 142167000 1.00
tpcds_q96/duckdb:parquet 8817964 8432974 1.05
tpcds_q97/duckdb:parquet 34082901 35022172 0.97
tpcds_q98/duckdb:parquet 17378609 17060261 1.02
tpcds_q99/duckdb:parquet 18791649 19129084 0.98
duckdb / duckdb (0.969x ➖, 6↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚀 21107496 23585216 0.89
tpcds_q02/duckdb:duckdb 18541353 19295165 0.96
tpcds_q03/duckdb:duckdb 🚀 8357205 9877626 0.85
tpcds_q04/duckdb:duckdb 170676668 179011175 0.95
tpcds_q05/duckdb:duckdb 19422388 20935322 0.93
tpcds_q06/duckdb:duckdb 22936006 23832965 0.96
tpcds_q07/duckdb:duckdb 37330000 41197118 0.91
tpcds_q08/duckdb:duckdb 120019657 121106651 0.99
tpcds_q09/duckdb:duckdb 19753040 20393860 0.97
tpcds_q10/duckdb:duckdb 23386312 24845684 0.94
tpcds_q11/duckdb:duckdb 91912403 85795807 1.07
tpcds_q12/duckdb:duckdb 11032696 11836074 0.93
tpcds_q13/duckdb:duckdb 24364509 24357472 1.00
tpcds_q14/duckdb:duckdb 91870613 93325851 0.98
tpcds_q15/duckdb:duckdb 27405237 25498703 1.07
tpcds_q16/duckdb:duckdb 18149660 18441631 0.98
tpcds_q17/duckdb:duckdb 20880624 22416161 0.93
tpcds_q18/duckdb:duckdb 43618120 44900236 0.97
tpcds_q19/duckdb:duckdb 16086862 16830192 0.96
tpcds_q20/duckdb:duckdb 11734442 12360826 0.95
tpcds_q21/duckdb:duckdb 6758384 6861750 0.98
tpcds_q22/duckdb:duckdb 62153663 61330521 1.01
tpcds_q23/duckdb:duckdb 76033530 75297285 1.01
tpcds_q24/duckdb:duckdb 24105909 24862611 0.97
tpcds_q25/duckdb:duckdb 18342368 17853594 1.03
tpcds_q26/duckdb:duckdb 🚀 23263483 25883829 0.90
tpcds_q27/duckdb:duckdb 38601133 36210135 1.07
tpcds_q28/duckdb:duckdb 21870046 23064558 0.95
tpcds_q29/duckdb:duckdb 20321229 21069608 0.96
tpcds_q30/duckdb:duckdb 28366174 29055819 0.98
tpcds_q31/duckdb:duckdb 46197328 48809829 0.95
tpcds_q32/duckdb:duckdb 7363227 7121876 1.03
tpcds_q33/duckdb:duckdb 12802552 12745055 1.00
tpcds_q34/duckdb:duckdb 14712107 15175786 0.97
tpcds_q35/duckdb:duckdb 33215077 33393497 0.99
tpcds_q36/duckdb:duckdb 70616815 70023952 1.01
tpcds_q37/duckdb:duckdb 7777931 8173671 0.95
tpcds_q38/duckdb:duckdb 29122693 30971431 0.94
tpcds_q39/duckdb:duckdb 26241979 25236096 1.04
tpcds_q40/duckdb:duckdb 12649710 13204954 0.96
tpcds_q41/duckdb:duckdb 8340652 8449317 0.99
tpcds_q42/duckdb:duckdb 6198705 6821582 0.91
tpcds_q43/duckdb:duckdb 10823838 11293447 0.96
tpcds_q44/duckdb:duckdb 13908391 14060749 0.99
tpcds_q45/duckdb:duckdb 17777980 18166341 0.98
tpcds_q46/duckdb:duckdb 36198882 37154561 0.97
tpcds_q47/duckdb:duckdb 40692044 41712475 0.98
tpcds_q48/duckdb:duckdb 21500014 22139831 0.97
tpcds_q49/duckdb:duckdb 16709805 16697569 1.00
tpcds_q50/duckdb:duckdb 14430805 14459029 1.00
tpcds_q51/duckdb:duckdb 89029322 89983185 0.99
tpcds_q52/duckdb:duckdb 7027806 7369769 0.95
tpcds_q53/duckdb:duckdb 13004354 13342557 0.97
tpcds_q54/duckdb:duckdb 15959783 16666863 0.96
tpcds_q55/duckdb:duckdb 7000379 7319341 0.96
tpcds_q56/duckdb:duckdb 13434275 13521897 0.99
tpcds_q57/duckdb:duckdb 31953793 34063992 0.94
tpcds_q58/duckdb:duckdb 12995643 12813434 1.01
tpcds_q59/duckdb:duckdb 35215431 36008033 0.98
tpcds_q60/duckdb:duckdb 14344389 15159385 0.95
tpcds_q61/duckdb:duckdb 14405935 14477601 1.00
tpcds_q62/duckdb:duckdb 9504372 9868258 0.96
tpcds_q63/duckdb:duckdb 11859052 12219425 0.97
tpcds_q64/duckdb:duckdb 52782404 53290522 0.99
tpcds_q65/duckdb:duckdb 33494066 35323342 0.95
tpcds_q66/duckdb:duckdb 24671062 26172700 0.94
tpcds_q67/duckdb:duckdb 126440696 132610000 0.95
tpcds_q68/duckdb:duckdb 25303089 25377133 1.00
tpcds_q69/duckdb:duckdb 25058810 25858099 0.97
tpcds_q70/duckdb:duckdb 14628857 15091448 0.97
tpcds_q71/duckdb:duckdb 13307372 12992774 1.02
tpcds_q72/duckdb:duckdb 41195192 42970923 0.96
tpcds_q73/duckdb:duckdb 10733332 11045289 0.97
tpcds_q74/duckdb:duckdb 143894269 145385983 0.99
tpcds_q75/duckdb:duckdb 43536096 43933382 0.99
tpcds_q76/duckdb:duckdb 11818467 12088881 0.98
tpcds_q77/duckdb:duckdb 12273172 11863152 1.03
tpcds_q78/duckdb:duckdb 65529876 63353659 1.03
tpcds_q79/duckdb:duckdb 18847540 19168276 0.98
tpcds_q80/duckdb:duckdb 27714216 29286469 0.95
tpcds_q81/duckdb:duckdb 36110743 39325126 0.92
tpcds_q82/duckdb:duckdb 8269396 8926919 0.93
tpcds_q83/duckdb:duckdb 9508714 9881073 0.96
tpcds_q84/duckdb:duckdb 14139741 13968209 1.01
tpcds_q85/duckdb:duckdb 23571342 25004454 0.94
tpcds_q86/duckdb:duckdb 10099339 11103792 0.91
tpcds_q87/duckdb:duckdb 🚀 32004839 36674652 0.87
tpcds_q88/duckdb:duckdb 25555273 26190907 0.98
tpcds_q89/duckdb:duckdb 14290663 15100149 0.95
tpcds_q90/duckdb:duckdb 5591067 5751074 0.97
tpcds_q91/duckdb:duckdb 13068736 13252336 0.99
tpcds_q92/duckdb:duckdb 8588698 8743922 0.98
tpcds_q93/duckdb:duckdb 🚀 21006558 23662700 0.89
tpcds_q94/duckdb:duckdb 🚀 12255442 14041604 0.87
tpcds_q95/duckdb:duckdb 127905163 129078884 0.99
tpcds_q96/duckdb:duckdb 4595417 4802535 0.96
tpcds_q97/duckdb:duckdb 29271071 31082028 0.94
tpcds_q98/duckdb:duckdb 14034177 13429391 1.05
tpcds_q99/duckdb:duckdb 16278090 16582330 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +4.3% -1.4% +5.8% +23.8% ➖ noise
1 datafusion:vortex-file-compressed -0.8% -1.4% +0.6% +17.2% ➖ noise
1 duckdb:duckdb -10.5% -1.4% -9.3% +23.7% ➖ noise
1 duckdb:vortex-compact +4.3% -1.4% +5.7% +20.0% ➖ noise
1 duckdb:vortex-file-compressed -1.5% -1.4% -0.2% +28.3% ➖ noise
2 datafusion:vortex-compact -2.2% -2.2% -0.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.3% -2.2% +1.0% +10.0% ➖ noise
2 duckdb:duckdb -3.9% -2.2% -1.7% +10.8% ➖ noise
2 duckdb:vortex-compact +3.5% -2.2% +5.9% +10.5% ➖ noise
2 duckdb:vortex-file-compressed +0.1% -2.2% +2.4% +19.0% ➖ noise
3 datafusion:vortex-compact +0.1% +1.6% -1.4% +18.7% ➖ noise
3 datafusion:vortex-file-compressed -6.7% +1.6% -8.2% +10.2% ➖ noise
3 duckdb:duckdb -15.4% +1.6% -16.7% +12.6% ✅ faster
3 duckdb:vortex-compact -4.1% +1.6% -5.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.5% +1.6% -1.0% +19.8% ➖ noise
4 datafusion:vortex-compact +3.1% -4.4% +7.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -3.7% -4.4% +0.8% +10.0% ➖ noise
4 duckdb:duckdb -4.7% -4.4% -0.2% +10.0% ➖ noise
4 duckdb:vortex-compact -9.8% -4.4% -5.6% +13.0% ➖ noise
4 duckdb:vortex-file-compressed -0.6% -4.4% +4.1% +12.0% ➖ noise
5 datafusion:vortex-compact -1.6% -8.7% +7.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -5.5% -8.7% +3.6% +13.6% ➖ noise
5 duckdb:duckdb -7.2% -8.7% +1.7% +10.0% ➖ noise
5 duckdb:vortex-compact -3.5% -8.7% +5.8% +13.4% ➖ noise
5 duckdb:vortex-file-compressed +0.2% -8.7% +9.8% +10.0% ➖ noise
6 datafusion:vortex-compact -2.9% -1.2% -1.7% +13.4% ➖ noise
6 datafusion:vortex-file-compressed -0.5% -1.2% +0.7% +10.3% ➖ noise
6 duckdb:duckdb -3.8% -1.2% -2.6% +14.0% ➖ noise
6 duckdb:vortex-compact -7.3% -1.2% -6.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.8% -1.2% -2.6% +10.0% ➖ noise
7 datafusion:vortex-compact -4.6% +2.3% -6.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -5.3% +2.3% -7.4% +10.0% ➖ noise
7 duckdb:duckdb -9.4% +2.3% -11.4% +19.6% ➖ noise
7 duckdb:vortex-compact -1.4% +2.3% -3.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.9% +2.3% -0.4% +13.3% ➖ noise
8 datafusion:vortex-compact -0.4% +0.9% -1.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -3.9% +0.9% -4.8% +10.0% ➖ noise
8 duckdb:duckdb -0.9% +0.9% -1.8% +10.0% ➖ noise
8 duckdb:vortex-compact +4.4% +0.9% +3.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -7.7% +0.9% -8.5% +16.9% ➖ noise
9 datafusion:vortex-compact -0.3% +2.9% -3.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -4.0% +2.9% -6.7% +10.0% ➖ noise
9 duckdb:duckdb -3.1% +2.9% -5.8% +10.0% ➖ noise
9 duckdb:vortex-compact -6.2% +2.9% -8.8% +15.5% ➖ noise
9 duckdb:vortex-file-compressed -6.2% +2.9% -8.8% +14.3% ➖ noise
10 datafusion:vortex-compact -1.0% +0.4% -1.4% +11.0% ➖ noise
10 datafusion:vortex-file-compressed -5.0% +0.4% -5.5% +10.0% ➖ noise
10 duckdb:duckdb -5.9% +0.4% -6.3% +10.0% ➖ noise
10 duckdb:vortex-compact -4.7% +0.4% -5.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.7% +0.4% +0.2% +12.5% ➖ noise
11 datafusion:vortex-compact -2.1% -0.0% -2.0% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -5.5% -0.0% -5.4% +10.0% ➖ noise
11 duckdb:duckdb +7.1% -0.0% +7.2% +10.0% ➖ noise
11 duckdb:vortex-compact -6.8% -0.0% -6.8% +11.9% ➖ noise
11 duckdb:vortex-file-compressed -1.0% -0.0% -0.9% +10.0% ➖ noise
12 datafusion:vortex-compact -9.4% -4.7% -4.9% +19.2% ➖ noise
12 datafusion:vortex-file-compressed +2.7% -4.7% +7.8% +13.7% ➖ noise
12 duckdb:duckdb -6.8% -4.7% -2.2% +17.9% ➖ noise
12 duckdb:vortex-compact -9.1% -4.7% -4.6% +21.1% ➖ noise
12 duckdb:vortex-file-compressed -4.8% -4.7% -0.1% +24.0% ➖ noise
13 datafusion:vortex-compact -5.3% -0.7% -4.7% +22.2% ➖ noise
13 datafusion:vortex-file-compressed -2.5% -0.7% -1.9% +10.0% ➖ noise
13 duckdb:duckdb +0.0% -0.7% +0.7% +10.0% ➖ noise
13 duckdb:vortex-compact -0.6% -0.7% +0.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -4.9% -0.7% -4.2% +11.6% ➖ noise
14 datafusion:vortex-compact -2.6% -1.3% -1.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.8% -1.3% +0.5% +10.0% ➖ noise
14 duckdb:duckdb -1.6% -1.3% -0.2% +10.0% ➖ noise
14 duckdb:vortex-compact -3.7% -1.3% -2.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.7% -1.3% +2.0% +11.9% ➖ noise
15 datafusion:vortex-compact -0.5% -5.6% +5.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -3.3% -5.6% +2.4% +18.6% ➖ noise
15 duckdb:duckdb +7.5% -5.6% +13.8% +13.3% 🚨 regression
15 duckdb:vortex-compact -6.2% -5.6% -0.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.7% -5.6% +5.1% +10.0% ➖ noise
16 datafusion:vortex-compact -1.2% -5.4% +4.4% +16.5% ➖ noise
16 datafusion:vortex-file-compressed -1.1% -5.4% +4.6% +10.0% ➖ noise
16 duckdb:duckdb -1.6% -5.4% +4.0% +10.9% ➖ noise
16 duckdb:vortex-compact -2.8% -5.4% +2.8% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.5% -5.4% +7.3% +10.8% ➖ noise
17 datafusion:vortex-compact -0.5% -0.5% +0.0% +10.3% ➖ noise
17 datafusion:vortex-file-compressed -0.7% -0.5% -0.2% +10.0% ➖ noise
17 duckdb:duckdb -6.9% -0.5% -6.4% +10.0% ➖ noise
17 duckdb:vortex-compact +0.5% -0.5% +1.0% +14.9% ➖ noise
17 duckdb:vortex-file-compressed -2.3% -0.5% -1.8% +10.0% ➖ noise
18 datafusion:vortex-compact -1.0% +1.2% -2.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -3.0% +1.2% -4.1% +10.0% ➖ noise
18 duckdb:duckdb -2.9% +1.2% -4.0% +10.0% ➖ noise
18 duckdb:vortex-compact +0.5% +1.2% -0.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.1% +1.2% -1.3% +10.6% ➖ noise
19 datafusion:vortex-compact -5.5% -6.8% +1.3% +10.6% ➖ noise
19 datafusion:vortex-file-compressed -6.9% -6.8% -0.2% +13.3% ➖ noise
19 duckdb:duckdb -4.4% -6.8% +2.5% +11.8% ➖ noise
19 duckdb:vortex-compact -3.8% -6.8% +3.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -1.4% -6.8% +5.7% +18.7% ➖ noise
20 datafusion:vortex-compact -1.4% -6.2% +5.1% +17.6% ➖ noise
20 datafusion:vortex-file-compressed +0.2% -6.2% +6.8% +19.4% ➖ noise
20 duckdb:duckdb -5.1% -6.2% +1.3% +21.6% ➖ noise
20 duckdb:vortex-compact -4.7% -6.2% +1.6% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -2.3% -6.2% +4.2% +10.0% ➖ noise
21 datafusion:vortex-compact -2.9% -4.8% +2.0% +13.6% ➖ noise
21 datafusion:vortex-file-compressed -4.7% -4.8% +0.1% +11.5% ➖ noise
21 duckdb:duckdb -1.5% -4.8% +3.5% +21.0% ➖ noise
21 duckdb:vortex-compact -1.6% -4.8% +3.3% +28.3% ➖ noise
21 duckdb:vortex-file-compressed -3.7% -4.8% +1.2% +15.1% ➖ noise
22 datafusion:vortex-compact -16.1% +8.4% -22.6% +29.9% ➖ noise
22 datafusion:vortex-file-compressed -13.1% +8.4% -19.8% +31.2% ➖ noise
22 duckdb:duckdb +1.3% +8.4% -6.5% +11.8% ➖ noise
22 duckdb:vortex-compact +0.3% +8.4% -7.5% +13.1% ➖ noise
22 duckdb:vortex-file-compressed -2.7% +8.4% -10.2% +11.8% ➖ noise
23 datafusion:vortex-compact +5.8% +1.7% +4.1% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -6.8% +1.7% -8.4% +10.0% ➖ noise
23 duckdb:duckdb +1.0% +1.7% -0.7% +13.8% ➖ noise
23 duckdb:vortex-compact -12.8% +1.7% -14.2% +20.7% ➖ noise
23 duckdb:vortex-file-compressed +9.2% +1.7% +7.5% +16.0% ➖ noise
24 datafusion:vortex-compact +0.4% -0.6% +1.0% +12.7% ➖ noise
24 datafusion:vortex-file-compressed -0.4% -0.6% +0.2% +10.0% ➖ noise
24 duckdb:duckdb -3.0% -0.6% -2.5% +10.0% ➖ noise
24 duckdb:vortex-compact -2.2% -0.6% -1.6% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +0.3% -0.6% +0.9% +10.0% ➖ noise
25 datafusion:vortex-compact -2.4% -0.9% -1.5% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -3.6% -0.9% -2.7% +10.0% ➖ noise
25 duckdb:duckdb +2.7% -0.9% +3.7% +14.6% ➖ noise
25 duckdb:vortex-compact -5.2% -0.9% -4.4% +11.8% ➖ noise
25 duckdb:vortex-file-compressed -6.2% -0.9% -5.3% +14.9% ➖ noise
26 datafusion:vortex-compact +0.8% +1.4% -0.7% +16.0% ➖ noise
26 datafusion:vortex-file-compressed -0.2% +1.4% -1.6% +10.0% ➖ noise
26 duckdb:duckdb -10.1% +1.4% -11.4% +15.0% ➖ noise
26 duckdb:vortex-compact +0.7% +1.4% -0.7% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +0.3% +1.4% -1.2% +10.0% ➖ noise
27 datafusion:vortex-compact +6.8% -0.5% +7.3% +12.6% ➖ noise
27 datafusion:vortex-file-compressed -1.2% -0.5% -0.8% +11.3% ➖ noise
27 duckdb:duckdb +6.6% -0.5% +7.1% +20.4% ➖ noise
27 duckdb:vortex-compact +0.9% -0.5% +1.4% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +2.7% -0.5% +3.1% +10.0% ➖ noise
28 datafusion:vortex-compact -2.7% +1.1% -3.7% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -2.5% +1.1% -3.5% +10.0% ➖ noise
28 duckdb:duckdb -5.2% +1.1% -6.2% +10.0% ➖ noise
28 duckdb:vortex-compact -27.2% +1.1% -27.9% +26.0% ✅ faster
28 duckdb:vortex-file-compressed -2.9% +1.1% -4.0% +10.0% ➖ noise
29 datafusion:vortex-compact -0.0% -0.9% +0.9% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -1.6% -0.9% -0.7% +10.0% ➖ noise
29 duckdb:duckdb -3.6% -0.9% -2.7% +10.0% ➖ noise
29 duckdb:vortex-compact -2.0% -0.9% -1.1% +11.7% ➖ noise
29 duckdb:vortex-file-compressed -4.7% -0.9% -3.8% +19.1% ➖ noise
30 datafusion:vortex-compact +0.1% -1.3% +1.5% +10.2% ➖ noise
30 datafusion:vortex-file-compressed -5.3% -1.3% -4.0% +10.0% ➖ noise
30 duckdb:duckdb -2.4% -1.3% -1.1% +11.9% ➖ noise
30 duckdb:vortex-compact +7.8% -1.3% +9.3% +12.0% ➖ noise
30 duckdb:vortex-file-compressed +1.1% -1.3% +2.4% +11.0% ➖ noise
31 datafusion:vortex-compact -2.6% -2.5% -0.1% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -4.1% -2.5% -1.7% +10.5% ➖ noise
31 duckdb:duckdb -5.4% -2.5% -3.0% +10.0% ➖ noise
31 duckdb:vortex-compact -1.0% -2.5% +1.5% +10.9% ➖ noise
31 duckdb:vortex-file-compressed -0.4% -2.5% +2.1% +10.2% ➖ noise
32 datafusion:vortex-compact +2.5% -8.8% +12.4% +11.1% 🚨 regression
32 datafusion:vortex-file-compressed -6.7% -8.8% +2.4% +10.0% ➖ noise
32 duckdb:duckdb +3.4% -8.8% +13.4% +12.1% 🚨 regression
32 duckdb:vortex-compact -5.5% -8.8% +3.7% +16.0% ➖ noise
32 duckdb:vortex-file-compressed -0.9% -8.8% +8.7% +10.0% ➖ noise
33 datafusion:vortex-compact -2.9% +0.7% -3.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -2.7% +0.7% -3.4% +11.2% ➖ noise
33 duckdb:duckdb +0.5% +0.7% -0.3% +10.0% ➖ noise
33 duckdb:vortex-compact -0.2% +0.7% -0.9% +12.1% ➖ noise
33 duckdb:vortex-file-compressed -1.6% +0.7% -2.4% +10.0% ➖ noise
34 datafusion:vortex-compact +0.3% -3.3% +3.7% +12.3% ➖ noise
34 datafusion:vortex-file-compressed -1.0% -3.3% +2.4% +12.4% ➖ noise
34 duckdb:duckdb -3.1% -3.3% +0.2% +14.2% ➖ noise
34 duckdb:vortex-compact -2.3% -3.3% +1.1% +12.4% ➖ noise
34 duckdb:vortex-file-compressed -2.6% -3.3% +0.7% +13.3% ➖ noise
35 datafusion:vortex-compact -2.8% -4.4% +1.7% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -4.4% -4.4% +0.1% +10.0% ➖ noise
35 duckdb:duckdb -0.5% -4.4% +4.1% +12.9% ➖ noise
35 duckdb:vortex-compact -0.7% -4.4% +3.9% +12.0% ➖ noise
35 duckdb:vortex-file-compressed +1.2% -4.4% +6.0% +14.4% ➖ noise
36 datafusion:vortex-compact -8.0% -3.2% -4.9% +12.9% ➖ noise
36 datafusion:vortex-file-compressed +1.1% -3.2% +4.5% +14.6% ➖ noise
36 duckdb:duckdb +0.8% -3.2% +4.2% +10.0% ➖ noise
36 duckdb:vortex-compact -0.5% -3.2% +2.8% +12.3% ➖ noise
36 duckdb:vortex-file-compressed +1.5% -3.2% +4.9% +10.0% ➖ noise
37 datafusion:vortex-compact -3.4% -2.0% -1.5% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -9.7% -2.0% -7.9% +12.5% ➖ noise
37 duckdb:duckdb -4.8% -2.0% -2.9% +15.0% ➖ noise
37 duckdb:vortex-compact -9.7% -2.0% -7.9% +12.5% ➖ noise
37 duckdb:vortex-file-compressed -4.8% -2.0% -2.9% +13.0% ➖ noise
38 datafusion:vortex-compact -2.9% +2.8% -5.5% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -8.1% +2.8% -10.6% +10.0% ✅ faster
38 duckdb:duckdb -6.0% +2.8% -8.5% +15.1% ➖ noise
38 duckdb:vortex-compact +6.3% +2.8% +3.4% +11.1% ➖ noise
38 duckdb:vortex-file-compressed -0.1% +2.8% -2.8% +10.0% ➖ noise
39 datafusion:vortex-compact -1.9% -2.0% +0.1% +13.4% ➖ noise
39 datafusion:vortex-file-compressed -2.3% -2.0% -0.4% +10.7% ➖ noise
39 duckdb:duckdb +4.0% -2.0% +6.1% +20.7% ➖ noise
39 duckdb:vortex-compact -2.0% -2.0% +0.0% +17.3% ➖ noise
39 duckdb:vortex-file-compressed +3.0% -2.0% +5.0% +14.9% ➖ noise
40 datafusion:vortex-compact -0.7% -4.9% +4.5% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -1.3% -4.9% +3.8% +16.2% ➖ noise
40 duckdb:duckdb -4.2% -4.9% +0.7% +17.2% ➖ noise
40 duckdb:vortex-compact +4.2% -4.9% +9.6% +12.2% ➖ noise
40 duckdb:vortex-file-compressed +1.6% -4.9% +6.8% +11.0% ➖ noise
41 datafusion:vortex-compact -7.2% -2.2% -5.2% +12.8% ➖ noise
41 datafusion:vortex-file-compressed -1.7% -2.2% +0.4% +15.2% ➖ noise
41 duckdb:duckdb -1.3% -2.2% +0.9% +10.0% ➖ noise
41 duckdb:vortex-compact +4.3% -2.2% +6.6% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -2.2% -2.2% -0.1% +10.8% ➖ noise
42 datafusion:vortex-compact +1.7% +0.7% +1.0% +12.8% ➖ noise
42 datafusion:vortex-file-compressed -3.4% +0.7% -4.0% +13.1% ➖ noise
42 duckdb:duckdb -9.1% +0.7% -9.7% +19.1% ➖ noise
42 duckdb:vortex-compact +3.4% +0.7% +2.7% +13.0% ➖ noise
42 duckdb:vortex-file-compressed +0.1% +0.7% -0.6% +16.0% ➖ noise
43 datafusion:vortex-compact -2.6% -0.7% -1.9% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -1.1% -0.7% -0.3% +10.0% ➖ noise
43 duckdb:duckdb -4.2% -0.7% -3.4% +13.8% ➖ noise
43 duckdb:vortex-compact +4.9% -0.7% +5.7% +25.4% ➖ noise
43 duckdb:vortex-file-compressed +2.3% -0.7% +3.1% +20.1% ➖ noise
44 datafusion:vortex-compact -5.6% +2.4% -7.8% +11.3% ➖ noise
44 datafusion:vortex-file-compressed -2.8% +2.4% -5.1% +10.1% ➖ noise
44 duckdb:duckdb -1.1% +2.4% -3.4% +10.0% ➖ noise
44 duckdb:vortex-compact -5.1% +2.4% -7.3% +11.9% ➖ noise
44 duckdb:vortex-file-compressed -2.3% +2.4% -4.6% +10.0% ➖ noise
45 datafusion:vortex-compact -19.9% -4.1% -16.5% +16.9% ✅ faster
45 datafusion:vortex-file-compressed -2.0% -4.1% +2.2% +10.0% ➖ noise
45 duckdb:duckdb -2.1% -4.1% +2.1% +10.0% ➖ noise
45 duckdb:vortex-compact -0.8% -4.1% +3.4% +12.3% ➖ noise
45 duckdb:vortex-file-compressed +2.3% -4.1% +6.7% +10.0% ➖ noise
46 datafusion:vortex-compact -12.2% +1.6% -13.7% +12.1% ✅ faster
46 datafusion:vortex-file-compressed -11.0% +1.6% -12.4% +10.0% ✅ faster
46 duckdb:duckdb -2.6% +1.6% -4.1% +10.0% ➖ noise
46 duckdb:vortex-compact +0.9% +1.6% -0.7% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +2.3% +1.6% +0.7% +17.1% ➖ noise
47 datafusion:vortex-compact -14.0% -2.0% -12.3% +10.0% ✅ faster
47 datafusion:vortex-file-compressed -3.0% -2.0% -1.0% +10.0% ➖ noise
47 duckdb:duckdb -2.4% -2.0% -0.5% +10.0% ➖ noise
47 duckdb:vortex-compact -9.6% -2.0% -7.8% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +1.7% -2.0% +3.8% +10.0% ➖ noise
48 datafusion:vortex-compact -9.8% -1.5% -8.4% +17.7% ➖ noise
48 datafusion:vortex-file-compressed -3.2% -1.5% -1.7% +10.0% ➖ noise
48 duckdb:duckdb -2.9% -1.5% -1.4% +10.0% ➖ noise
48 duckdb:vortex-compact -2.0% -1.5% -0.5% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +0.2% -1.5% +1.7% +10.0% ➖ noise
49 datafusion:vortex-compact -13.5% +0.4% -13.9% +11.1% ✅ faster
49 datafusion:vortex-file-compressed -3.4% +0.4% -3.9% +10.0% ➖ noise
49 duckdb:duckdb +0.1% +0.4% -0.4% +14.5% ➖ noise
49 duckdb:vortex-compact -0.3% +0.4% -0.8% +10.0% ➖ noise
49 duckdb:vortex-file-compressed -6.8% +0.4% -7.2% +22.8% ➖ noise
50 datafusion:vortex-compact -11.6% -0.4% -11.3% +10.0% ✅ faster
50 datafusion:vortex-file-compressed -0.1% -0.4% +0.2% +10.0% ➖ noise
50 duckdb:duckdb -0.2% -0.4% +0.2% +11.6% ➖ noise
50 duckdb:vortex-compact -1.2% -0.4% -0.8% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -2.5% -0.4% -2.2% +10.0% ➖ noise
51 datafusion:vortex-compact -13.1% +1.8% -14.6% +10.0% ✅ faster
51 datafusion:vortex-file-compressed +0.2% +1.8% -1.6% +10.0% ➖ noise
51 duckdb:duckdb -1.1% +1.8% -2.8% +17.1% ➖ noise
51 duckdb:vortex-compact +10.9% +1.8% +8.9% +14.3% ➖ noise
51 duckdb:vortex-file-compressed -22.2% +1.8% -23.6% +16.8% ✅ faster
52 datafusion:vortex-compact -12.7% -2.0% -10.9% +17.1% ➖ noise
52 datafusion:vortex-file-compressed -3.7% -2.0% -1.7% +16.9% ➖ noise
52 duckdb:duckdb -4.6% -2.0% -2.7% +18.4% ➖ noise
52 duckdb:vortex-compact +0.5% -2.0% +2.6% +11.7% ➖ noise
52 duckdb:vortex-file-compressed +2.0% -2.0% +4.1% +26.4% ➖ noise
53 datafusion:vortex-compact -11.7% -2.1% -9.8% +10.4% ✅ faster
53 datafusion:vortex-file-compressed -1.9% -2.1% +0.2% +12.1% ➖ noise
53 duckdb:duckdb -2.5% -2.1% -0.5% +11.9% ➖ noise
53 duckdb:vortex-compact -6.7% -2.1% -4.7% +12.4% ➖ noise
53 duckdb:vortex-file-compressed +2.7% -2.1% +4.9% +10.2% ➖ noise
54 datafusion:vortex-compact -11.8% -1.7% -10.3% +10.0% ✅ faster
54 datafusion:vortex-file-compressed -4.1% -1.7% -2.5% +10.0% ➖ noise
54 duckdb:duckdb -4.2% -1.7% -2.6% +10.9% ➖ noise
54 duckdb:vortex-compact -0.1% -1.7% +1.7% +18.5% ➖ noise
54 duckdb:vortex-file-compressed -13.8% -1.7% -12.3% +10.0% ✅ faster
55 datafusion:vortex-compact -13.8% -2.3% -11.7% +10.0% ✅ faster
55 datafusion:vortex-file-compressed +0.9% -2.3% +3.3% +20.5% ➖ noise
55 duckdb:duckdb -4.4% -2.3% -2.1% +15.7% ➖ noise
55 duckdb:vortex-compact +0.6% -2.3% +3.0% +10.0% ➖ noise
55 duckdb:vortex-file-compressed -7.1% -2.3% -4.9% +11.0% ➖ noise
56 datafusion:vortex-compact -16.2% -1.5% -14.9% +10.0% ✅ faster
56 datafusion:vortex-file-compressed -4.2% -1.5% -2.8% +10.0% ➖ noise
56 duckdb:duckdb -0.6% -1.5% +0.8% +11.7% ➖ noise
56 duckdb:vortex-compact -3.0% -1.5% -1.5% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -13.5% -1.5% -12.2% +20.7% ➖ noise
57 datafusion:vortex-compact -12.3% +1.5% -13.5% +10.5% ✅ faster
57 datafusion:vortex-file-compressed +5.3% +1.5% +3.7% +11.0% ➖ noise
57 duckdb:duckdb -6.2% +1.5% -7.6% +23.8% ➖ noise
57 duckdb:vortex-compact -3.6% +1.5% -5.1% +10.7% ➖ noise
57 duckdb:vortex-file-compressed -8.3% +1.5% -9.6% +15.1% ➖ noise
58 datafusion:vortex-compact -14.4% +3.7% -17.5% +12.5% ✅ faster
58 datafusion:vortex-file-compressed -4.0% +3.7% -7.5% +11.5% ➖ noise
58 duckdb:duckdb +1.4% +3.7% -2.2% +15.8% ➖ noise
58 duckdb:vortex-compact +0.5% +3.7% -3.1% +18.0% ➖ noise
58 duckdb:vortex-file-compressed -6.9% +3.7% -10.3% +10.3% ✅ faster
59 datafusion:vortex-compact -9.6% -1.0% -8.7% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -3.2% -1.0% -2.2% +10.0% ➖ noise
59 duckdb:duckdb -2.2% -1.0% -1.2% +10.0% ➖ noise
59 duckdb:vortex-compact -1.0% -1.0% -0.0% +16.6% ➖ noise
59 duckdb:vortex-file-compressed -4.5% -1.0% -3.6% +26.9% ➖ noise
60 datafusion:vortex-compact -12.8% -3.2% -9.9% +10.0% ✅ faster
60 datafusion:vortex-file-compressed -1.1% -3.2% +2.2% +10.0% ➖ noise
60 duckdb:duckdb -5.4% -3.2% -2.3% +11.6% ➖ noise
60 duckdb:vortex-compact -3.5% -3.2% -0.3% +10.7% ➖ noise
60 duckdb:vortex-file-compressed -17.6% -3.2% -14.8% +10.1% ✅ faster
61 datafusion:vortex-compact -14.2% -4.2% -10.5% +12.7% ➖ noise
61 datafusion:vortex-file-compressed -0.7% -4.2% +3.7% +10.0% ➖ noise
61 duckdb:duckdb -0.5% -4.2% +3.9% +10.0% ➖ noise
61 duckdb:vortex-compact -0.2% -4.2% +4.2% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -12.3% -4.2% -8.4% +17.1% ➖ noise
62 datafusion:vortex-compact -19.1% -4.3% -15.5% +26.6% ➖ noise
62 datafusion:vortex-file-compressed -19.7% -4.3% -16.1% +26.2% ➖ noise
62 duckdb:duckdb -3.7% -4.3% +0.7% +26.7% ➖ noise
62 duckdb:vortex-compact -13.6% -4.3% -9.7% +23.4% ➖ noise
62 duckdb:vortex-file-compressed -13.3% -4.3% -9.4% +19.8% ➖ noise
63 datafusion:vortex-compact -12.7% -2.8% -10.1% +10.0% ✅ faster
63 datafusion:vortex-file-compressed -4.4% -2.8% -1.6% +10.0% ➖ noise
63 duckdb:duckdb -2.9% -2.8% -0.1% +10.0% ➖ noise
63 duckdb:vortex-compact -7.5% -2.8% -4.7% +12.5% ➖ noise
63 duckdb:vortex-file-compressed -21.7% -2.8% -19.4% +25.0% ➖ noise
64 datafusion:vortex-compact -15.3% -7.5% -8.5% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -3.8% -7.5% +4.0% +10.0% ➖ noise
64 duckdb:duckdb -1.0% -7.5% +7.0% +10.0% ➖ noise
64 duckdb:vortex-compact -5.4% -7.5% +2.2% +11.7% ➖ noise
64 duckdb:vortex-file-compressed -13.9% -7.5% -6.9% +10.4% ➖ noise
65 datafusion:vortex-compact -13.4% -7.0% -6.9% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -1.4% -7.0% +6.0% +16.8% ➖ noise
65 duckdb:duckdb -5.2% -7.0% +2.0% +10.9% ➖ noise
65 duckdb:vortex-compact -3.0% -7.0% +4.3% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -24.1% -7.0% -18.4% +18.0% ✅ faster
66 datafusion:vortex-compact -8.6% -2.2% -6.5% +13.2% ➖ noise
66 datafusion:vortex-file-compressed -4.6% -2.2% -2.4% +10.0% ➖ noise
66 duckdb:duckdb -5.7% -2.2% -3.6% +10.0% ➖ noise
66 duckdb:vortex-compact +2.0% -2.2% +4.3% +15.5% ➖ noise
66 duckdb:vortex-file-compressed -12.0% -2.2% -10.0% +12.1% ➖ noise
67 datafusion:vortex-compact -17.7% -6.8% -11.7% +10.0% ✅ faster
67 datafusion:vortex-file-compressed -6.6% -6.8% +0.2% +13.9% ➖ noise
67 duckdb:duckdb -4.7% -6.8% +2.3% +10.0% ➖ noise
67 duckdb:vortex-compact +1.6% -6.8% +8.9% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -16.2% -6.8% -10.1% +10.0% ✅ faster
68 datafusion:vortex-compact -12.5% -5.7% -7.2% +20.8% ➖ noise
68 datafusion:vortex-file-compressed -2.3% -5.7% +3.6% +10.6% ➖ noise
68 duckdb:duckdb -0.3% -5.7% +5.7% +12.1% ➖ noise
68 duckdb:vortex-compact -3.4% -5.7% +2.4% +15.9% ➖ noise
68 duckdb:vortex-file-compressed -15.3% -5.7% -10.2% +24.1% ➖ noise
69 datafusion:vortex-compact -11.0% -6.8% -4.5% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -0.8% -6.8% +6.4% +22.0% ➖ noise
69 duckdb:duckdb -3.1% -6.8% +4.0% +10.0% ➖ noise
69 duckdb:vortex-compact -0.7% -6.8% +6.5% +11.5% ➖ noise
69 duckdb:vortex-file-compressed -17.0% -6.8% -10.9% +10.5% ✅ faster
70 datafusion:vortex-compact -5.1% -5.0% -0.1% +11.3% ➖ noise
70 datafusion:vortex-file-compressed -8.7% -5.0% -3.9% +12.8% ➖ noise
70 duckdb:duckdb -3.1% -5.0% +2.0% +17.3% ➖ noise
70 duckdb:vortex-compact -2.8% -5.0% +2.4% +10.3% ➖ noise
70 duckdb:vortex-file-compressed -5.2% -5.0% -0.2% +10.0% ➖ noise
71 datafusion:vortex-compact -1.1% -6.1% +5.3% +10.1% ➖ noise
71 datafusion:vortex-file-compressed -4.9% -6.1% +1.3% +11.1% ➖ noise
71 duckdb:duckdb +2.4% -6.1% +9.0% +16.2% ➖ noise
71 duckdb:vortex-compact +3.5% -6.1% +10.2% +10.4% ➖ noise
71 duckdb:vortex-file-compressed -16.8% -6.1% -11.4% +10.0% ✅ faster
72 datafusion:vortex-compact -20.6% -8.8% -12.9% +12.4% ✅ faster
72 datafusion:vortex-file-compressed -10.4% -8.8% -1.8% +12.0% ➖ noise
72 duckdb:duckdb -4.1% -8.8% +5.1% +10.0% ➖ noise
72 duckdb:vortex-compact +2.2% -8.8% +12.0% +10.0% 🚨 regression
72 duckdb:vortex-file-compressed -5.8% -8.8% +3.3% +10.0% ➖ noise
73 datafusion:vortex-compact -0.1% -2.0% +2.0% +14.1% ➖ noise
73 datafusion:vortex-file-compressed +1.4% -2.0% +3.5% +14.5% ➖ noise
73 duckdb:duckdb -2.8% -2.0% -0.8% +16.6% ➖ noise
73 duckdb:vortex-compact -4.6% -2.0% -2.6% +21.5% ➖ noise
73 duckdb:vortex-file-compressed -15.0% -2.0% -13.3% +24.9% ➖ noise
74 datafusion:vortex-compact -5.1% -1.4% -3.7% +12.2% ➖ noise
74 datafusion:vortex-file-compressed -3.7% -1.4% -2.3% +13.2% ➖ noise
74 duckdb:duckdb -1.0% -1.4% +0.4% +10.0% ➖ noise
74 duckdb:vortex-compact -5.2% -1.4% -3.8% +10.0% ➖ noise
74 duckdb:vortex-file-compressed -7.7% -1.4% -6.5% +10.0% ➖ noise
75 datafusion:vortex-compact -2.1% -2.7% +0.7% +10.2% ➖ noise
75 datafusion:vortex-file-compressed -2.4% -2.7% +0.4% +10.0% ➖ noise
75 duckdb:duckdb -0.9% -2.7% +1.9% +11.7% ➖ noise
75 duckdb:vortex-compact -0.0% -2.7% +2.8% +10.0% ➖ noise
75 duckdb:vortex-file-compressed -3.0% -2.7% -0.3% +10.0% ➖ noise
76 datafusion:vortex-compact +3.8% +0.4% +3.4% +14.4% ➖ noise
76 datafusion:vortex-file-compressed -6.7% +0.4% -7.1% +32.2% ➖ noise
76 duckdb:duckdb -2.2% +0.4% -2.6% +19.5% ➖ noise
76 duckdb:vortex-compact +1.3% +0.4% +0.9% +21.3% ➖ noise
76 duckdb:vortex-file-compressed -15.6% +0.4% -15.9% +13.9% ✅ faster
77 datafusion:vortex-compact +6.2% +2.2% +3.9% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -1.8% +2.2% -3.9% +13.8% ➖ noise
77 duckdb:duckdb +3.5% +2.2% +1.3% +17.1% ➖ noise
77 duckdb:vortex-compact +1.3% +2.2% -0.8% +15.5% ➖ noise
77 duckdb:vortex-file-compressed -11.8% +2.2% -13.7% +10.0% ✅ faster
78 datafusion:vortex-compact +1.0% -0.1% +1.0% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -4.1% -0.1% -4.0% +10.0% ➖ noise
78 duckdb:duckdb +3.4% -0.1% +3.5% +12.6% ➖ noise
78 duckdb:vortex-compact +1.3% -0.1% +1.3% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +1.9% -0.1% +2.0% +10.0% ➖ noise
79 datafusion:vortex-compact -8.6% +2.5% -10.9% +16.4% ➖ noise
79 datafusion:vortex-file-compressed -1.8% +2.5% -4.2% +21.8% ➖ noise
79 duckdb:duckdb -1.7% +2.5% -4.1% +11.3% ➖ noise
79 duckdb:vortex-compact -8.2% +2.5% -10.5% +13.7% ➖ noise
79 duckdb:vortex-file-compressed +2.5% +2.5% +0.0% +12.2% ➖ noise
80 datafusion:vortex-compact +1.9% +1.0% +0.8% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -6.4% +1.0% -7.3% +10.0% ➖ noise
80 duckdb:duckdb -5.4% +1.0% -6.3% +10.4% ➖ noise
80 duckdb:vortex-compact +0.5% +1.0% -0.5% +13.2% ➖ noise
80 duckdb:vortex-file-compressed -16.9% +1.0% -17.7% +14.8% ✅ faster
81 datafusion:vortex-compact +18.2% -3.7% +22.7% +15.7% 🚨 regression
81 datafusion:vortex-file-compressed +0.3% -3.7% +4.1% +10.0% ➖ noise
81 duckdb:duckdb -8.2% -3.7% -4.7% +10.0% ➖ noise
81 duckdb:vortex-compact -3.9% -3.7% -0.2% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -4.5% -3.7% -0.9% +10.0% ➖ noise
82 datafusion:vortex-compact -1.4% -1.1% -0.2% +12.2% ➖ noise
82 datafusion:vortex-file-compressed -3.7% -1.1% -2.6% +10.0% ➖ noise
82 duckdb:duckdb -7.4% -1.1% -6.3% +14.3% ➖ noise
82 duckdb:vortex-compact -6.8% -1.1% -5.7% +10.0% ➖ noise
82 duckdb:vortex-file-compressed -9.4% -1.1% -8.4% +13.5% ➖ noise
83 datafusion:vortex-compact -5.1% -2.6% -2.6% +13.2% ➖ noise
83 datafusion:vortex-file-compressed -1.7% -2.6% +0.9% +10.0% ➖ noise
83 duckdb:duckdb -3.8% -2.6% -1.2% +10.0% ➖ noise
83 duckdb:vortex-compact +13.2% -2.6% +16.2% +21.4% ➖ noise
83 duckdb:vortex-file-compressed -3.5% -2.6% -1.0% +10.0% ➖ noise
84 datafusion:vortex-compact -0.6% -2.2% +1.6% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -3.4% -2.2% -1.1% +29.0% ➖ noise
84 duckdb:duckdb +1.2% -2.2% +3.6% +10.5% ➖ noise
84 duckdb:vortex-compact -10.6% -2.2% -8.5% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -4.9% -2.2% -2.7% +10.0% ➖ noise
85 datafusion:vortex-compact +4.7% +0.6% +4.0% +16.8% ➖ noise
85 datafusion:vortex-file-compressed -2.8% +0.6% -3.4% +10.0% ➖ noise
85 duckdb:duckdb -5.7% +0.6% -6.3% +10.0% ➖ noise
85 duckdb:vortex-compact -6.9% +0.6% -7.4% +12.2% ➖ noise
85 duckdb:vortex-file-compressed -3.9% +0.6% -4.5% +10.1% ➖ noise
86 datafusion:vortex-compact -0.6% +5.2% -5.6% +21.9% ➖ noise
86 datafusion:vortex-file-compressed -6.1% +5.2% -10.7% +11.6% ✅ faster
86 duckdb:duckdb -9.0% +5.2% -13.5% +13.2% ✅ faster
86 duckdb:vortex-compact -12.8% +5.2% -17.1% +15.2% ✅ faster
86 duckdb:vortex-file-compressed +10.6% +5.2% +5.1% +13.6% ➖ noise
87 datafusion:vortex-compact -3.3% +0.2% -3.5% +10.3% ➖ noise
87 datafusion:vortex-file-compressed -1.1% +0.2% -1.3% +10.0% ➖ noise
87 duckdb:duckdb -12.7% +0.2% -12.9% +15.8% ➖ noise
87 duckdb:vortex-compact +2.2% +0.2% +2.0% +15.5% ➖ noise
87 duckdb:vortex-file-compressed -8.5% +0.2% -8.7% +12.9% ➖ noise
88 datafusion:vortex-compact +2.5% +0.1% +2.4% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -0.2% +0.1% -0.4% +10.0% ➖ noise
88 duckdb:duckdb -2.4% +0.1% -2.6% +10.0% ➖ noise
88 duckdb:vortex-compact -13.9% +0.1% -14.0% +10.0% ✅ faster
88 duckdb:vortex-file-compressed -0.1% +0.1% -0.3% +10.0% ➖ noise
89 datafusion:vortex-compact -4.5% +3.2% -7.4% +15.9% ➖ noise
89 datafusion:vortex-file-compressed -1.0% +3.2% -4.1% +11.7% ➖ noise
89 duckdb:duckdb -5.4% +3.2% -8.3% +11.3% ➖ noise
89 duckdb:vortex-compact -8.3% +3.2% -11.2% +10.0% ✅ faster
89 duckdb:vortex-file-compressed -2.4% +3.2% -5.4% +10.0% ➖ noise
90 datafusion:vortex-compact -1.3% +2.4% -3.7% +16.5% ➖ noise
90 datafusion:vortex-file-compressed -2.3% +2.4% -4.6% +16.0% ➖ noise
90 duckdb:duckdb -2.8% +2.4% -5.1% +10.5% ➖ noise
90 duckdb:vortex-compact -10.2% +2.4% -12.3% +10.0% ✅ faster
90 duckdb:vortex-file-compressed +1.1% +2.4% -1.3% +17.6% ➖ noise
91 datafusion:vortex-compact -2.5% -0.0% -2.5% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -8.5% -0.0% -8.5% +10.0% ➖ noise
91 duckdb:duckdb -1.4% -0.0% -1.4% +14.1% ➖ noise
91 duckdb:vortex-compact -9.1% -0.0% -9.0% +11.5% ➖ noise
91 duckdb:vortex-file-compressed +9.6% -0.0% +9.7% +10.0% ➖ noise
92 datafusion:vortex-compact -3.4% +1.1% -4.5% +13.9% ➖ noise
92 datafusion:vortex-file-compressed -1.1% +1.1% -2.2% +10.5% ➖ noise
92 duckdb:duckdb -1.8% +1.1% -2.9% +14.0% ➖ noise
92 duckdb:vortex-compact +14.7% +1.1% +13.5% +23.0% ➖ noise
92 duckdb:vortex-file-compressed -8.2% +1.1% -9.2% +19.4% ➖ noise
93 datafusion:vortex-compact -1.3% -0.9% -0.4% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -1.7% -0.9% -0.8% +10.0% ➖ noise
93 duckdb:duckdb -11.2% -0.9% -10.5% +16.5% ➖ noise
93 duckdb:vortex-compact -15.2% -0.9% -14.4% +10.0% ✅ faster
93 duckdb:vortex-file-compressed -6.0% -0.9% -5.2% +10.0% ➖ noise
94 datafusion:vortex-compact +3.6% -0.8% +4.5% +11.6% ➖ noise
94 datafusion:vortex-file-compressed -2.4% -0.8% -1.5% +10.0% ➖ noise
94 duckdb:duckdb -12.7% -0.8% -12.0% +10.0% ✅ faster
94 duckdb:vortex-compact -14.9% -0.8% -14.1% +13.3% ✅ faster
94 duckdb:vortex-file-compressed -2.6% -0.8% -1.8% +10.0% ➖ noise
95 datafusion:vortex-compact -3.9% -0.9% -3.1% +10.0% ➖ noise
95 datafusion:vortex-file-compressed -3.1% -0.9% -2.3% +10.0% ➖ noise
95 duckdb:duckdb -0.9% -0.9% -0.0% +17.1% ➖ noise
95 duckdb:vortex-compact -0.4% -0.9% +0.5% +19.2% ➖ noise
95 duckdb:vortex-file-compressed -4.7% -0.9% -3.8% +13.7% ➖ noise
96 datafusion:vortex-compact +0.4% -1.3% +1.6% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +2.5% -1.3% +3.8% +10.9% ➖ noise
96 duckdb:duckdb -4.3% -1.3% -3.1% +13.9% ➖ noise
96 duckdb:vortex-compact -7.3% -1.3% -6.1% +13.2% ➖ noise
96 duckdb:vortex-file-compressed -8.4% -1.3% -7.2% +12.5% ➖ noise
97 datafusion:vortex-compact -0.1% -1.2% +1.1% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -1.7% -1.2% -0.5% +10.0% ➖ noise
97 duckdb:duckdb -5.8% -1.2% -4.7% +22.7% ➖ noise
97 duckdb:vortex-compact -11.3% -1.2% -10.2% +16.2% ➖ noise
97 duckdb:vortex-file-compressed +7.6% -1.2% +8.9% +13.1% ➖ noise
98 datafusion:vortex-compact -1.1% -0.0% -1.1% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +2.1% -0.0% +2.1% +10.0% ➖ noise
98 duckdb:duckdb +4.5% -0.0% +4.5% +14.9% ➖ noise
98 duckdb:vortex-compact -9.6% -0.0% -9.5% +10.0% ✅ faster
98 duckdb:vortex-file-compressed +0.7% -0.0% +0.7% +10.0% ➖ noise
99 datafusion:vortex-compact -13.9% -8.0% -6.4% +22.3% ➖ noise
99 datafusion:vortex-file-compressed -1.8% -8.0% +6.7% +24.7% ➖ noise
99 duckdb:duckdb -1.8% -8.0% +6.7% +24.8% ➖ noise
99 duckdb:vortex-compact -15.4% -8.0% -8.0% +15.4% ➖ noise
99 duckdb:vortex-file-compressed -6.8% -8.0% +1.3% +22.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Vortex (geomean): 1.002x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.2%


datafusion / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 392236079 382555440 1.03
tpch_q02/datafusion:vortex-file-compressed 104283210 105262000 0.99
tpch_q03/datafusion:vortex-file-compressed 214482811 212064814 1.01
tpch_q04/datafusion:vortex-file-compressed 111213371 111715295 1.00
tpch_q05/datafusion:vortex-file-compressed 366663075 362784249 1.01
tpch_q06/datafusion:vortex-file-compressed 35868618 35016749 1.02
tpch_q07/datafusion:vortex-file-compressed 499352211 497170724 1.00
tpch_q08/datafusion:vortex-file-compressed 350668982 346826675 1.01
tpch_q09/datafusion:vortex-file-compressed 620057323 621177086 1.00
tpch_q10/datafusion:vortex-file-compressed 222765671 223826666 1.00
tpch_q11/datafusion:vortex-file-compressed 80447006 80413589 1.00
tpch_q12/datafusion:vortex-file-compressed 114123588 114830743 0.99
tpch_q13/datafusion:vortex-file-compressed 210830411 211384390 1.00
tpch_q14/datafusion:vortex-file-compressed 51280946 51684755 0.99
tpch_q15/datafusion:vortex-file-compressed 96302779 95951627 1.00
tpch_q16/datafusion:vortex-file-compressed 75392771 74794406 1.01
tpch_q17/datafusion:vortex-file-compressed 626559563 621719132 1.01
tpch_q18/datafusion:vortex-file-compressed 828994048 822868686 1.01
tpch_q19/datafusion:vortex-file-compressed 66787667 68866507 0.97
tpch_q20/datafusion:vortex-file-compressed 159639507 157895214 1.01
tpch_q21/datafusion:vortex-file-compressed 645290961 645198754 1.00
tpch_q22/datafusion:vortex-file-compressed 65536722 63490280 1.03
datafusion / vortex-compact (0.997x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 439287583 436543504 1.01
tpch_q02/datafusion:vortex-compact 106885667 109060439 0.98
tpch_q03/datafusion:vortex-compact 212380487 215817129 0.98
tpch_q04/datafusion:vortex-compact 116999570 116870344 1.00
tpch_q05/datafusion:vortex-compact 365711982 369509512 0.99
tpch_q06/datafusion:vortex-compact 58127998 58387378 1.00
tpch_q07/datafusion:vortex-compact 512196481 507920985 1.01
tpch_q08/datafusion:vortex-compact 352645409 358901423 0.98
tpch_q09/datafusion:vortex-compact 623908599 627538274 0.99
tpch_q10/datafusion:vortex-compact 240255502 239944682 1.00
tpch_q11/datafusion:vortex-compact 80630128 81822266 0.99
tpch_q12/datafusion:vortex-compact 157376993 156625892 1.00
tpch_q13/datafusion:vortex-compact 262130660 260733931 1.01
tpch_q14/datafusion:vortex-compact 69624558 69312717 1.00
tpch_q15/datafusion:vortex-compact 150742603 151571786 0.99
tpch_q16/datafusion:vortex-compact 77768620 78770934 0.99
tpch_q17/datafusion:vortex-compact 627528705 627130843 1.00
tpch_q18/datafusion:vortex-compact 830652050 825066842 1.01
tpch_q19/datafusion:vortex-compact 123962921 122472083 1.01
tpch_q20/datafusion:vortex-compact 183805683 183877838 1.00
tpch_q21/datafusion:vortex-compact 652229557 651117937 1.00
tpch_q22/datafusion:vortex-compact 70178489 70593248 0.99
datafusion / parquet (1.003x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 453460334 440392848 1.03
tpch_q02/datafusion:parquet 167541342 169514413 0.99
tpch_q03/datafusion:parquet 279850010 279784027 1.00
tpch_q04/datafusion:parquet 127063816 126868542 1.00
tpch_q05/datafusion:parquet 426186217 427015238 1.00
tpch_q06/datafusion:parquet 124575108 130949525 0.95
tpch_q07/datafusion:parquet 596681721 599121126 1.00
tpch_q08/datafusion:parquet 449606103 451328748 1.00
tpch_q09/datafusion:parquet 726375088 725841756 1.00
tpch_q10/datafusion:parquet 487988318 485806441 1.00
tpch_q11/datafusion:parquet 114574498 113356584 1.01
tpch_q12/datafusion:parquet 194997332 195278082 1.00
tpch_q13/datafusion:parquet 328873774 325077495 1.01
tpch_q14/datafusion:parquet 160352166 152334718 1.05
tpch_q15/datafusion:parquet 249290541 241709879 1.03
tpch_q16/datafusion:parquet 118858473 120626916 0.99
tpch_q17/datafusion:parquet 674470292 673894165 1.00
tpch_q18/datafusion:parquet 879946081 867675813 1.01
tpch_q19/datafusion:parquet 253111722 251712883 1.01
tpch_q20/datafusion:parquet 286153286 284630041 1.01
tpch_q21/datafusion:parquet 686495037 683943014 1.00
tpch_q22/datafusion:parquet 212602002 214536557 0.99
datafusion / arrow (0.989x ➖, 1↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 596208796 592086849 1.01
tpch_q02/datafusion:arrow 165219526 167058550 0.99
tpch_q03/datafusion:arrow 460192541 464625379 0.99
tpch_q04/datafusion:arrow 333593803 336330997 0.99
tpch_q05/datafusion:arrow 914566853 931037614 0.98
tpch_q06/datafusion:arrow 279516823 283932745 0.98
tpch_q07/datafusion:arrow 1142207739 1148335091 0.99
tpch_q08/datafusion:arrow 1122277257 1125598054 1.00
tpch_q09/datafusion:arrow 1334934896 1330973079 1.00
tpch_q10/datafusion:arrow 572553133 583887467 0.98
tpch_q11/datafusion:arrow 137422341 138714406 0.99
tpch_q12/datafusion:arrow 🚀 679198269 781411867 0.87
tpch_q13/datafusion:arrow 505188530 498355839 1.01
tpch_q14/datafusion:arrow 315049316 313211323 1.01
tpch_q15/datafusion:arrow 682401928 699101866 0.98
tpch_q16/datafusion:arrow 105107350 105798632 0.99
tpch_q17/datafusion:arrow 1311465755 1321893366 0.99
tpch_q18/datafusion:arrow 1846078971 1864660101 0.99
tpch_q19/datafusion:arrow 481386027 480876543 1.00
tpch_q20/datafusion:arrow 480790226 481371756 1.00
tpch_q21/datafusion:arrow 2990432239 2980059612 1.00
tpch_q22/datafusion:arrow 131248425 130955508 1.00
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170873936 171638636 1.00
tpch_q02/duckdb:vortex-file-compressed 51130242 51516627 0.99
tpch_q03/duckdb:vortex-file-compressed 125910951 129663713 0.97
tpch_q04/duckdb:vortex-file-compressed 157333297 158066800 1.00
tpch_q05/duckdb:vortex-file-compressed 144430471 144145102 1.00
tpch_q06/duckdb:vortex-file-compressed 36531286 34848994 1.05
tpch_q07/duckdb:vortex-file-compressed 137797950 135237199 1.02
tpch_q08/duckdb:vortex-file-compressed 165770157 165686379 1.00
tpch_q09/duckdb:vortex-file-compressed 387661821 383218943 1.01
tpch_q10/duckdb:vortex-file-compressed 182979242 182506339 1.00
tpch_q11/duckdb:vortex-file-compressed 32042570 31243837 1.03
tpch_q12/duckdb:vortex-file-compressed 97918511 98141568 1.00
tpch_q13/duckdb:vortex-file-compressed 225795643 225817443 1.00
tpch_q14/duckdb:vortex-file-compressed 55060909 55585354 0.99
tpch_q15/duckdb:vortex-file-compressed 89701727 89615318 1.00
tpch_q16/duckdb:vortex-file-compressed 73434664 72451518 1.01
tpch_q17/duckdb:vortex-file-compressed 94237001 94849871 0.99
tpch_q18/duckdb:vortex-file-compressed 279412375 280283022 1.00
tpch_q19/duckdb:vortex-file-compressed 81397110 81308929 1.00
tpch_q20/duckdb:vortex-file-compressed 147125855 147961045 0.99
tpch_q21/duckdb:vortex-file-compressed 488385028 489892896 1.00
tpch_q22/duckdb:vortex-file-compressed 63613046 62462266 1.02
duckdb / vortex-compact (1.002x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 228762720 227513874 1.01
tpch_q02/duckdb:vortex-compact 55849525 55602911 1.00
tpch_q03/duckdb:vortex-compact 138098672 138762296 1.00
tpch_q04/duckdb:vortex-compact 168241388 165906368 1.01
tpch_q05/duckdb:vortex-compact 169817243 169159281 1.00
tpch_q06/duckdb:vortex-compact 56763243 56574310 1.00
tpch_q07/duckdb:vortex-compact 172904388 173495287 1.00
tpch_q08/duckdb:vortex-compact 183026030 182904710 1.00
tpch_q09/duckdb:vortex-compact 422847307 416546901 1.02
tpch_q10/duckdb:vortex-compact 212951819 211828298 1.01
tpch_q11/duckdb:vortex-compact 38364048 37569180 1.02
tpch_q12/duckdb:vortex-compact 161105498 160232895 1.01
tpch_q13/duckdb:vortex-compact 273111225 272016489 1.00
tpch_q14/duckdb:vortex-compact 71321870 74289969 0.96
tpch_q15/duckdb:vortex-compact 112803763 113682391 0.99
tpch_q16/duckdb:vortex-compact 77557549 77082403 1.01
tpch_q17/duckdb:vortex-compact 107281379 106601107 1.01
tpch_q18/duckdb:vortex-compact 285560598 285177392 1.00
tpch_q19/duckdb:vortex-compact 98834274 99020496 1.00
tpch_q20/duckdb:vortex-compact 178532228 178976301 1.00
tpch_q21/duckdb:vortex-compact 512942603 515086437 1.00
tpch_q22/duckdb:vortex-compact 70211854 69641441 1.01
duckdb / parquet (0.997x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 257696773 257167640 1.00
tpch_q02/duckdb:parquet 102181676 100180897 1.02
tpch_q03/duckdb:parquet 203733688 206223189 0.99
tpch_q04/duckdb:parquet 130544023 131457648 0.99
tpch_q05/duckdb:parquet 211417679 216621494 0.98
tpch_q06/duckdb:parquet 67625965 68088275 0.99
tpch_q07/duckdb:parquet 179329448 181442603 0.99
tpch_q08/duckdb:parquet 255702044 254419857 1.01
tpch_q09/duckdb:parquet 480445565 501440528 0.96
tpch_q10/duckdb:parquet 610272312 605073508 1.01
tpch_q11/duckdb:parquet 55070473 56389120 0.98
tpch_q12/duckdb:parquet 123296692 123481406 1.00
tpch_q13/duckdb:parquet 451319259 441849248 1.02
tpch_q14/duckdb:parquet 175816191 172935329 1.02
tpch_q15/duckdb:parquet 95335197 96393343 0.99
tpch_q16/duckdb:parquet 156868108 157998937 0.99
tpch_q17/duckdb:parquet 175637764 171608082 1.02
tpch_q18/duckdb:parquet 351015378 356173357 0.99
tpch_q19/duckdb:parquet 281309640 279255136 1.01
tpch_q20/duckdb:parquet 227130214 226754726 1.00
tpch_q21/duckdb:parquet 559712462 555670692 1.01
tpch_q22/duckdb:parquet 287610329 291273840 0.99
duckdb / duckdb (0.996x ➖, 0↑ 0↓)
name PR 002a8e9 (ns) base a88e6b1 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116884600 116958077 1.00
tpch_q02/duckdb:duckdb 48395223 47711077 1.01
tpch_q03/duckdb:duckdb 97303553 97783792 1.00
tpch_q04/duckdb:duckdb 130034458 132155206 0.98
tpch_q05/duckdb:duckdb 109540937 109504088 1.00
tpch_q06/duckdb:duckdb 37647743 38578658 0.98
tpch_q07/duckdb:duckdb 86411927 88249036 0.98
tpch_q08/duckdb:duckdb 110537839 111058851 1.00
tpch_q09/duckdb:duckdb 279943093 281069028 1.00
tpch_q10/duckdb:duckdb 204049207 205098364 0.99
tpch_q11/duckdb:duckdb 15638198 15725561 0.99
tpch_q12/duckdb:duckdb 85523748 84767035 1.01
tpch_q13/duckdb:duckdb 222093627 221122567 1.00
tpch_q14/duckdb:duckdb 72286144 70689689 1.02
tpch_q15/duckdb:duckdb 77796324 77874091 1.00
tpch_q16/duckdb:duckdb 73236054 72614549 1.01
tpch_q17/duckdb:duckdb 84735879 85543916 0.99
tpch_q18/duckdb:duckdb 214822135 216353724 0.99
tpch_q19/duckdb:duckdb 117303523 117923850 0.99
tpch_q20/duckdb:duckdb 112553328 112428245 1.00
tpch_q21/duckdb:duckdb 296494220 295683144 1.00
tpch_q22/duckdb:duckdb 67573324 69752758 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.7% +1.6% -0.9% +10.0% ➖ noise
1 datafusion:vortex-compact +0.6% +1.6% -0.9% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +2.5% +1.6% +0.9% +10.0% ➖ noise
1 duckdb:duckdb -0.1% +1.6% -1.6% +10.0% ➖ noise
1 duckdb:vortex-compact +0.5% +1.6% -1.0% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.4% +1.6% -2.0% +10.0% ➖ noise
2 datafusion:arrow -1.1% +0.4% -1.5% +10.0% ➖ noise
2 datafusion:vortex-compact -2.0% +0.4% -2.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.9% +0.4% -1.3% +10.0% ➖ noise
2 duckdb:duckdb +1.4% +0.4% +1.0% +10.0% ➖ noise
2 duckdb:vortex-compact +0.4% +0.4% +0.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.8% +0.4% -1.1% +10.0% ➖ noise
3 datafusion:arrow -1.0% -0.6% -0.4% +10.0% ➖ noise
3 datafusion:vortex-compact -1.6% -0.6% -1.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +1.1% -0.6% +1.7% +10.0% ➖ noise
3 duckdb:duckdb -0.5% -0.6% +0.1% +10.0% ➖ noise
3 duckdb:vortex-compact -0.5% -0.6% +0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.9% -0.6% -2.3% +10.0% ➖ noise
4 datafusion:arrow -0.8% -0.3% -0.5% +10.0% ➖ noise
4 datafusion:vortex-compact +0.1% -0.3% +0.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.4% -0.3% -0.2% +10.0% ➖ noise
4 duckdb:duckdb -1.6% -0.3% -1.3% +10.0% ➖ noise
4 duckdb:vortex-compact +1.4% -0.3% +1.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.5% -0.3% -0.2% +10.0% ➖ noise
5 datafusion:arrow -1.8% -1.3% -0.5% +10.0% ➖ noise
5 datafusion:vortex-compact -1.0% -1.3% +0.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.1% -1.3% +2.4% +10.0% ➖ noise
5 duckdb:duckdb +0.0% -1.3% +1.4% +10.0% ➖ noise
5 duckdb:vortex-compact +0.4% -1.3% +1.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.2% -1.3% +1.5% +10.0% ➖ noise
6 datafusion:arrow -1.6% -2.8% +1.3% +10.0% ➖ noise
6 datafusion:vortex-compact -0.4% -2.8% +2.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +2.4% -2.8% +5.4% +10.0% ➖ noise
6 duckdb:duckdb -2.4% -2.8% +0.4% +10.0% ➖ noise
6 duckdb:vortex-compact +0.3% -2.8% +3.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +4.8% -2.8% +7.8% +10.9% ➖ noise
7 datafusion:arrow -0.5% -0.8% +0.3% +10.0% ➖ noise
7 datafusion:vortex-compact +0.8% -0.8% +1.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.4% -0.8% +1.2% +10.0% ➖ noise
7 duckdb:duckdb -2.1% -0.8% -1.3% +10.0% ➖ noise
7 duckdb:vortex-compact -0.3% -0.8% +0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.9% -0.8% +2.7% +10.0% ➖ noise
8 datafusion:arrow -0.3% +0.1% -0.4% +10.0% ➖ noise
8 datafusion:vortex-compact -1.7% +0.1% -1.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +1.1% +0.1% +1.0% +10.0% ➖ noise
8 duckdb:duckdb -0.5% +0.1% -0.5% +10.0% ➖ noise
8 duckdb:vortex-compact +0.1% +0.1% +0.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.1% +0.1% -0.0% +10.0% ➖ noise
9 datafusion:arrow +0.3% -2.1% +2.4% +10.0% ➖ noise
9 datafusion:vortex-compact -0.6% -2.1% +1.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.2% -2.1% +1.9% +10.0% ➖ noise
9 duckdb:duckdb -0.4% -2.1% +1.7% +10.0% ➖ noise
9 duckdb:vortex-compact +1.5% -2.1% +3.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.2% -2.1% +3.3% +10.0% ➖ noise
10 datafusion:arrow -1.9% +0.7% -2.6% +10.0% ➖ noise
10 datafusion:vortex-compact +0.1% +0.7% -0.5% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.5% +0.7% -1.1% +10.0% ➖ noise
10 duckdb:duckdb -0.5% +0.7% -1.2% +10.0% ➖ noise
10 duckdb:vortex-compact +0.5% +0.7% -0.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.3% +0.7% -0.4% +10.0% ➖ noise
11 datafusion:arrow -0.9% -0.6% -0.3% +10.5% ➖ noise
11 datafusion:vortex-compact -1.5% -0.6% -0.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.0% -0.6% +0.7% +10.0% ➖ noise
11 duckdb:duckdb -0.6% -0.6% +0.1% +11.7% ➖ noise
11 duckdb:vortex-compact +2.1% -0.6% +2.8% +12.2% ➖ noise
11 duckdb:vortex-file-compressed +2.6% -0.6% +3.2% +10.0% ➖ noise
12 datafusion:arrow -13.1% -0.1% -13.0% +34.9% ➖ noise
12 datafusion:vortex-compact +0.5% -0.1% +0.6% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.6% -0.1% -0.5% +10.0% ➖ noise
12 duckdb:duckdb +0.9% -0.1% +1.0% +10.0% ➖ noise
12 duckdb:vortex-compact +0.5% -0.1% +0.7% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.2% -0.1% -0.1% +10.0% ➖ noise
13 datafusion:arrow +1.4% +1.7% -0.3% +10.0% ➖ noise
13 datafusion:vortex-compact +0.5% +1.7% -1.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.3% +1.7% -1.9% +10.0% ➖ noise
13 duckdb:duckdb +0.4% +1.7% -1.2% +10.0% ➖ noise
13 duckdb:vortex-compact +0.4% +1.7% -1.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.0% +1.7% -1.6% +10.0% ➖ noise
14 datafusion:arrow +0.6% +3.4% -2.8% +10.0% ➖ noise
14 datafusion:vortex-compact +0.4% +3.4% -2.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.8% +3.4% -4.1% +10.0% ➖ noise
14 duckdb:duckdb +2.3% +3.4% -1.2% +10.0% ➖ noise
14 duckdb:vortex-compact -4.0% +3.4% -7.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.9% +3.4% -4.2% +10.0% ➖ noise
15 datafusion:arrow -2.4% +1.0% -3.4% +10.0% ➖ noise
15 datafusion:vortex-compact -0.5% +1.0% -1.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.4% +1.0% -0.6% +10.0% ➖ noise
15 duckdb:duckdb -0.1% +1.0% -1.1% +10.0% ➖ noise
15 duckdb:vortex-compact -0.8% +1.0% -1.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.1% +1.0% -0.9% +10.0% ➖ noise
16 datafusion:arrow -0.7% -1.1% +0.4% +10.0% ➖ noise
16 datafusion:vortex-compact -1.3% -1.1% -0.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.8% -1.1% +1.9% +10.0% ➖ noise
16 duckdb:duckdb +0.9% -1.1% +2.0% +10.0% ➖ noise
16 duckdb:vortex-compact +0.6% -1.1% +1.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.4% -1.1% +2.5% +10.0% ➖ noise
17 datafusion:arrow -0.8% +1.2% -2.0% +10.0% ➖ noise
17 datafusion:vortex-compact +0.1% +1.2% -1.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.8% +1.2% -0.4% +10.0% ➖ noise
17 duckdb:duckdb -0.9% +1.2% -2.1% +10.0% ➖ noise
17 duckdb:vortex-compact +0.6% +1.2% -0.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.6% +1.2% -1.8% +10.0% ➖ noise
18 datafusion:arrow -1.0% -0.0% -1.0% +10.0% ➖ noise
18 datafusion:vortex-compact +0.7% -0.0% +0.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.7% -0.0% +0.8% +10.0% ➖ noise
18 duckdb:duckdb -0.7% -0.0% -0.7% +10.0% ➖ noise
18 duckdb:vortex-compact +0.1% -0.0% +0.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.3% -0.0% -0.3% +10.0% ➖ noise
19 datafusion:arrow +0.1% +0.6% -0.5% +10.0% ➖ noise
19 datafusion:vortex-compact +1.2% +0.6% +0.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -3.0% +0.6% -3.6% +10.0% ➖ noise
19 duckdb:duckdb -0.5% +0.6% -1.2% +10.0% ➖ noise
19 duckdb:vortex-compact -0.2% +0.6% -0.8% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +0.1% +0.6% -0.5% +10.0% ➖ noise
20 datafusion:arrow -0.1% +0.4% -0.5% +10.0% ➖ noise
20 datafusion:vortex-compact -0.0% +0.4% -0.4% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +1.1% +0.4% +0.8% +10.0% ➖ noise
20 duckdb:duckdb +0.1% +0.4% -0.2% +10.0% ➖ noise
20 duckdb:vortex-compact -0.2% +0.4% -0.6% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.6% +0.4% -0.9% +10.0% ➖ noise
21 datafusion:arrow +0.3% +0.6% -0.2% +10.0% ➖ noise
21 datafusion:vortex-compact +0.2% +0.6% -0.4% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +0.0% +0.6% -0.5% +10.0% ➖ noise
21 duckdb:duckdb +0.3% +0.6% -0.3% +10.0% ➖ noise
21 duckdb:vortex-compact -0.4% +0.6% -1.0% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -0.3% +0.6% -0.9% +10.0% ➖ noise
22 datafusion:arrow +0.2% -1.1% +1.3% +10.0% ➖ noise
22 datafusion:vortex-compact -0.6% -1.1% +0.5% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +3.2% -1.1% +4.4% +10.0% ➖ noise
22 duckdb:duckdb -3.1% -1.1% -2.1% +10.0% ➖ noise
22 duckdb:vortex-compact +0.8% -1.1% +1.9% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +1.8% -1.1% +3.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@gatesn gatesn merged commit 2033ef5 into develop May 20, 2026
93 of 98 checks passed
@gatesn gatesn deleted the ngates/remove-coercion branch May 20, 2026 14:16
@gatesn gatesn restored the ngates/remove-coercion branch May 20, 2026 16:48
gatesn added a commit that referenced this pull request May 20, 2026
Reverts #8032

Actually I'm not so sure on this one! If we say that Vortex has a
logical type system, and we allow users to define extension types, then
we really ought to allow users to define the coercion rules of said
extension types.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants