Skip to content

multi-file stats for duckdb#7907

Closed
myrrc wants to merge 1 commit into
developfrom
duckdb/file-caches
Closed

multi-file stats for duckdb#7907
myrrc wants to merge 1 commit into
developfrom
duckdb/file-caches

Conversation

@myrrc
Copy link
Copy Markdown
Contributor

@myrrc myrrc commented May 13, 2026

TODO

@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR do not merge Pull requests that are not intended to merge action/benchmark-sql Trigger SQL benchmarks to run on this PR labels May 13, 2026
@github-actions github-actions Bot removed action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels May 13, 2026
@myrrc myrrc added changelog/feature A new feature action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels May 13, 2026
@github-actions github-actions Bot removed action/benchmark-sql Trigger SQL benchmarks to run on this PR action/benchmark Trigger full benchmarks to run on this PR labels May 13, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 13, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done a8dfde2 2 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done a8dfde2 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟡 In Progress a8dfde2 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.3%
Vortex (geomean): 1.004x ➖
Parquet (geomean): 1.028x ➖
Shifts: Parquet (control) +2.8% · Median polish +1.0%


datafusion / vortex-file-compressed (1.014x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5104806 4976736 1.03
fineweb_q01/datafusion:vortex-file-compressed 20760315 19801703 1.05
fineweb_q02/datafusion:vortex-file-compressed 20607485 21669291 0.95
fineweb_q03/datafusion:vortex-file-compressed 76596759 79665464 0.96
fineweb_q04/datafusion:vortex-file-compressed 223051097 221789170 1.01
fineweb_q05/datafusion:vortex-file-compressed 213623092 209162159 1.02
fineweb_q06/datafusion:vortex-file-compressed 50016696 49985275 1.00
fineweb_q07/datafusion:vortex-file-compressed 🚨 61419358 53528156 1.15
fineweb_q08/datafusion:vortex-file-compressed 21700878 22195979 0.98
datafusion / vortex-compact (1.011x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5709880 5431787 1.05
fineweb_q01/datafusion:vortex-compact 🚨 141438236 125565869 1.13
fineweb_q02/datafusion:vortex-compact 128561322 133684542 0.96
fineweb_q03/datafusion:vortex-compact 1043030426 1020160858 1.02
fineweb_q04/datafusion:vortex-compact 1121081988 1092931038 1.03
fineweb_q05/datafusion:vortex-compact 958680600 963488452 1.00
fineweb_q06/datafusion:vortex-compact 512097707 534694947 0.96
fineweb_q07/datafusion:vortex-compact 540762910 536021391 1.01
fineweb_q08/datafusion:vortex-compact 18153456 18964834 0.96
datafusion / parquet (1.031x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 7014290 5893088 1.19
fineweb_q01/datafusion:parquet 283774791 289196982 0.98
fineweb_q02/datafusion:parquet 285852906 286233058 1.00
fineweb_q03/datafusion:parquet 288894151 278357938 1.04
fineweb_q04/datafusion:parquet 301141068 291383599 1.03
fineweb_q05/datafusion:parquet 297146585 292064953 1.02
fineweb_q06/datafusion:parquet 286870028 289348133 0.99
fineweb_q07/datafusion:parquet 286634307 277684962 1.03
fineweb_q08/datafusion:parquet 278204049 276328684 1.01
duckdb / vortex-file-compressed (1.000x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3083577 3310131 0.93
fineweb_q01/duckdb:vortex-file-compressed 🚨 23385133 20923626 1.12
fineweb_q02/duckdb:vortex-file-compressed 22700898 24329240 0.93
fineweb_q03/duckdb:vortex-file-compressed 157744833 155737511 1.01
fineweb_q04/duckdb:vortex-file-compressed 217231936 218981887 0.99
fineweb_q05/duckdb:vortex-file-compressed 207491207 205533590 1.01
fineweb_q06/duckdb:vortex-file-compressed 51526373 50676249 1.02
fineweb_q07/duckdb:vortex-file-compressed 54004913 54295899 0.99
fineweb_q08/duckdb:vortex-file-compressed 22192634 22142012 1.00
duckdb / vortex-compact (0.991x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4006249 3940293 1.02
fineweb_q01/duckdb:vortex-compact 98146086 104834333 0.94
fineweb_q02/duckdb:vortex-compact 111430441 110356314 1.01
fineweb_q03/duckdb:vortex-compact 860656838 863502974 1.00
fineweb_q04/duckdb:vortex-compact 900458200 896955310 1.00
fineweb_q05/duckdb:vortex-compact 803772863 802744961 1.00
fineweb_q06/duckdb:vortex-compact 457642168 465527606 0.98
fineweb_q07/duckdb:vortex-compact 475693792 473545663 1.00
fineweb_q08/duckdb:vortex-compact 20735744 21292969 0.97
duckdb / parquet (1.025x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 30254464 26508454 1.14
fineweb_q01/duckdb:parquet 82735742 82460748 1.00
fineweb_q02/duckdb:parquet 82854708 82285831 1.01
fineweb_q03/duckdb:parquet 311179638 307545239 1.01
fineweb_q04/duckdb:parquet 440286062 438254458 1.00
fineweb_q05/duckdb:parquet 409184802 408543742 1.00
fineweb_q06/duckdb:parquet 199326096 196897901 1.01
fineweb_q07/duckdb:parquet 210539878 207631114 1.01
fineweb_q08/duckdb:parquet 29067929 28059817 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +5.1% +16.6% -9.8% +51.7% ➖ noise
0 datafusion:vortex-file-compressed +2.6% +16.6% -12.0% +53.8% ➖ noise
0 duckdb:vortex-compact +1.7% +16.6% -12.8% +93.6% ➖ noise
0 duckdb:vortex-file-compressed -6.8% +16.6% -20.1% +85.8% ➖ noise
1 datafusion:vortex-compact +12.6% -0.8% +13.5% +14.3% ➖ noise
1 datafusion:vortex-file-compressed +4.8% -0.8% +5.7% +22.4% ➖ noise
1 duckdb:vortex-compact -6.4% -0.8% -5.6% +16.7% ➖ noise
1 duckdb:vortex-file-compressed +11.8% -0.8% +12.6% +62.1% ➖ noise
2 datafusion:vortex-compact -3.8% +0.3% -4.1% +13.3% ➖ noise
2 datafusion:vortex-file-compressed -4.9% +0.3% -5.2% +13.3% ➖ noise
2 duckdb:vortex-compact +1.0% +0.3% +0.7% +13.3% ➖ noise
2 duckdb:vortex-file-compressed -6.7% +0.3% -7.0% +14.5% ➖ noise
3 datafusion:vortex-compact +2.2% +2.5% -0.2% +13.3% ➖ noise
3 datafusion:vortex-file-compressed -3.9% +2.5% -6.2% +13.3% ➖ noise
3 duckdb:vortex-compact -0.3% +2.5% -2.7% +13.3% ➖ noise
3 duckdb:vortex-file-compressed +1.3% +2.5% -1.2% +34.0% ➖ noise
4 datafusion:vortex-compact +2.6% +1.9% +0.7% +13.3% ➖ noise
4 datafusion:vortex-file-compressed +0.6% +1.9% -1.3% +13.3% ➖ noise
4 duckdb:vortex-compact +0.4% +1.9% -1.5% +13.3% ➖ noise
4 duckdb:vortex-file-compressed -0.8% +1.9% -2.6% +13.3% ➖ noise
5 datafusion:vortex-compact -0.5% +0.9% -1.4% +13.3% ➖ noise
5 datafusion:vortex-file-compressed +2.1% +0.9% +1.2% +13.3% ➖ noise
5 duckdb:vortex-compact +0.1% +0.9% -0.8% +13.3% ➖ noise
5 duckdb:vortex-file-compressed +1.0% +0.9% +0.0% +13.3% ➖ noise
6 datafusion:vortex-compact -4.2% +0.2% -4.4% +13.3% ➖ noise
6 datafusion:vortex-file-compressed +0.1% +0.2% -0.1% +13.3% ➖ noise
6 duckdb:vortex-compact -1.7% +0.2% -1.9% +13.3% ➖ noise
6 duckdb:vortex-file-compressed +1.7% +0.2% +1.5% +13.3% ➖ noise
7 datafusion:vortex-compact +0.9% +2.3% -1.4% +13.3% ➖ noise
7 datafusion:vortex-file-compressed +14.7% +2.3% +12.2% +13.3% ➖ noise
7 duckdb:vortex-compact +0.5% +2.3% -1.8% +13.3% ➖ noise
7 duckdb:vortex-file-compressed -0.5% +2.3% -2.8% +13.3% ➖ noise
8 datafusion:vortex-compact -4.3% +2.1% -6.3% +19.5% ➖ noise
8 datafusion:vortex-file-compressed -2.2% +2.1% -4.3% +13.7% ➖ noise
8 duckdb:vortex-compact -2.6% +2.1% -4.6% +22.6% ➖ noise
8 duckdb:vortex-file-compressed +0.2% +2.1% -1.9% +19.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Vortex (geomean): 0.988x ➖
Parquet (geomean): 0.970x ➖
Shifts: Parquet (control) -3.0% · Median polish -2.0%


datafusion / vortex-file-compressed (0.912x ➖, 8↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51777658 55285535 0.94
tpch_q02/datafusion:vortex-file-compressed 22784857 23614453 0.96
tpch_q03/datafusion:vortex-file-compressed 30019879 31608180 0.95
tpch_q04/datafusion:vortex-file-compressed 21696718 23532433 0.92
tpch_q05/datafusion:vortex-file-compressed 🚀 49390751 56196371 0.88
tpch_q06/datafusion:vortex-file-compressed 12558190 13690182 0.92
tpch_q07/datafusion:vortex-file-compressed 58007389 63755292 0.91
tpch_q08/datafusion:vortex-file-compressed 40440828 44625965 0.91
tpch_q09/datafusion:vortex-file-compressed 🚀 52906125 60406685 0.88
tpch_q10/datafusion:vortex-file-compressed 40995736 44356835 0.92
tpch_q11/datafusion:vortex-file-compressed 16615136 17894028 0.93
tpch_q12/datafusion:vortex-file-compressed 🚀 25442703 29528470 0.86
tpch_q13/datafusion:vortex-file-compressed 25063367 26701100 0.94
tpch_q14/datafusion:vortex-file-compressed 🚀 17097219 19584371 0.87
tpch_q15/datafusion:vortex-file-compressed 🚀 26666964 30048518 0.89
tpch_q16/datafusion:vortex-file-compressed 🚀 19865843 22814139 0.87
tpch_q17/datafusion:vortex-file-compressed 🚀 68316007 78486170 0.87
tpch_q18/datafusion:vortex-file-compressed 🚀 82398755 92501683 0.89
tpch_q19/datafusion:vortex-file-compressed 24203166 26438474 0.92
tpch_q20/datafusion:vortex-file-compressed 31341833 31781230 0.99
tpch_q21/datafusion:vortex-file-compressed 74536788 79958963 0.93
tpch_q22/datafusion:vortex-file-compressed 12553813 13264108 0.95
datafusion / vortex-compact (0.965x ➖, 1↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 56200337 61605625 0.91
tpch_q02/datafusion:vortex-compact 25972145 26968091 0.96
tpch_q03/datafusion:vortex-compact 31638655 32580627 0.97
tpch_q04/datafusion:vortex-compact 24431716 25133184 0.97
tpch_q05/datafusion:vortex-compact 52514984 56923848 0.92
tpch_q06/datafusion:vortex-compact 15101450 15805915 0.96
tpch_q07/datafusion:vortex-compact 62126277 64987331 0.96
tpch_q08/datafusion:vortex-compact 45175936 46573360 0.97
tpch_q09/datafusion:vortex-compact 57651338 59902442 0.96
tpch_q10/datafusion:vortex-compact 47571943 51665666 0.92
tpch_q11/datafusion:vortex-compact 17393331 17813964 0.98
tpch_q12/datafusion:vortex-compact 33334523 34523511 0.97
tpch_q13/datafusion:vortex-compact 32535689 33620492 0.97
tpch_q14/datafusion:vortex-compact 20977998 21113441 0.99
tpch_q15/datafusion:vortex-compact 33261578 33167956 1.00
tpch_q16/datafusion:vortex-compact 24690471 24977394 0.99
tpch_q17/datafusion:vortex-compact 73104507 72209522 1.01
tpch_q18/datafusion:vortex-compact 87177572 96078251 0.91
tpch_q19/datafusion:vortex-compact 🚀 30575100 34069415 0.90
tpch_q20/datafusion:vortex-compact 35241085 36217282 0.97
tpch_q21/datafusion:vortex-compact 82577280 79066789 1.04
tpch_q22/datafusion:vortex-compact 12789786 12614629 1.01
datafusion / parquet (0.949x ➖, 2↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 129498014 99654560 1.30
tpch_q02/datafusion:parquet 61559688 67426692 0.91
tpch_q03/datafusion:parquet 🚀 64709186 77159947 0.84
tpch_q04/datafusion:parquet 43497140 48269399 0.90
tpch_q05/datafusion:parquet 95037432 101517367 0.94
tpch_q06/datafusion:parquet 41504822 40871340 1.02
tpch_q07/datafusion:parquet 107845411 112856211 0.96
tpch_q08/datafusion:parquet 100054053 97314612 1.03
tpch_q09/datafusion:parquet 131975791 141836442 0.93
tpch_q10/datafusion:parquet 114625295 122269358 0.94
tpch_q11/datafusion:parquet 42760496 46982616 0.91
tpch_q12/datafusion:parquet 84790343 92256483 0.92
tpch_q13/datafusion:parquet 204562422 216035678 0.95
tpch_q14/datafusion:parquet 45243320 48899430 0.93
tpch_q15/datafusion:parquet 60102132 63043848 0.95
tpch_q16/datafusion:parquet 40719091 44861124 0.91
tpch_q17/datafusion:parquet 137063855 146705211 0.93
tpch_q18/datafusion:parquet 🚀 163936579 185500147 0.88
tpch_q19/datafusion:parquet 70665392 71389676 0.99
tpch_q20/datafusion:parquet 69703960 75324025 0.93
tpch_q21/datafusion:parquet 137272512 146730260 0.94
tpch_q22/datafusion:parquet 32282274 33119004 0.97
datafusion / arrow (0.862x ✅, 13↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 53822107 68114564 0.79
tpch_q02/datafusion:arrow 19477442 21415576 0.91
tpch_q03/datafusion:arrow 🚀 30207646 38226227 0.79
tpch_q04/datafusion:arrow 🚀 25873155 32767135 0.79
tpch_q05/datafusion:arrow 80605711 87258978 0.92
tpch_q06/datafusion:arrow 22278154 23640402 0.94
tpch_q07/datafusion:arrow 106141856 114659161 0.93
tpch_q08/datafusion:arrow 🚀 43705351 51932476 0.84
tpch_q09/datafusion:arrow 🚀 66510218 81395248 0.82
tpch_q10/datafusion:arrow 🚀 48245762 55293670 0.87
tpch_q11/datafusion:arrow 9333663 10179420 0.92
tpch_q12/datafusion:arrow 55047289 60564932 0.91
tpch_q13/datafusion:arrow 48288333 51339362 0.94
tpch_q14/datafusion:arrow 🚀 21846854 29059521 0.75
tpch_q15/datafusion:arrow 🚀 42876221 53899625 0.80
tpch_q16/datafusion:arrow 19342347 20907244 0.93
tpch_q17/datafusion:arrow 🚀 71250051 80224803 0.89
tpch_q18/datafusion:arrow 🚀 140738849 166244273 0.85
tpch_q19/datafusion:arrow 🚀 36637991 43938337 0.83
tpch_q20/datafusion:arrow 🚀 36422526 44586446 0.82
tpch_q21/datafusion:arrow 🚀 154693811 183862379 0.84
tpch_q22/datafusion:arrow 18662361 19843805 0.94
duckdb / vortex-file-compressed (1.046x ➖, 0↑ 2↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31776113 31458795 1.01
tpch_q02/duckdb:vortex-file-compressed 25020074 23494017 1.06
tpch_q03/duckdb:vortex-file-compressed 30966405 28822570 1.07
tpch_q04/duckdb:vortex-file-compressed 30249072 28106125 1.08
tpch_q05/duckdb:vortex-file-compressed 33566987 32651485 1.03
tpch_q06/duckdb:vortex-file-compressed 10201727 10177976 1.00
tpch_q07/duckdb:vortex-file-compressed 36296368 35292819 1.03
tpch_q08/duckdb:vortex-file-compressed 39338611 36824229 1.07
tpch_q09/duckdb:vortex-file-compressed 73977000 72792141 1.02
tpch_q10/duckdb:vortex-file-compressed 35256771 33540731 1.05
tpch_q11/duckdb:vortex-file-compressed 🚨 15870638 14101272 1.13
tpch_q12/duckdb:vortex-file-compressed 21782728 21954799 0.99
tpch_q13/duckdb:vortex-file-compressed 34871115 34487698 1.01
tpch_q14/duckdb:vortex-file-compressed 20580034 20665032 1.00
tpch_q15/duckdb:vortex-file-compressed 16863754 15979159 1.06
tpch_q16/duckdb:vortex-file-compressed 29286878 27917336 1.05
tpch_q17/duckdb:vortex-file-compressed 25781306 25110311 1.03
tpch_q18/duckdb:vortex-file-compressed 50725846 49619214 1.02
tpch_q19/duckdb:vortex-file-compressed 🚨 31925501 28320131 1.13
tpch_q20/duckdb:vortex-file-compressed 35819388 33065477 1.08
tpch_q21/duckdb:vortex-file-compressed 110255279 102296555 1.08
tpch_q22/duckdb:vortex-file-compressed 17933261 17147058 1.05
duckdb / vortex-compact (1.035x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38654745 37973946 1.02
tpch_q02/duckdb:vortex-compact 35752225 35479904 1.01
tpch_q03/duckdb:vortex-compact 33217093 31428808 1.06
tpch_q04/duckdb:vortex-compact 35324299 34197349 1.03
tpch_q05/duckdb:vortex-compact 39484605 37140391 1.06
tpch_q06/duckdb:vortex-compact 14335621 14795311 0.97
tpch_q07/duckdb:vortex-compact 43652704 41698611 1.05
tpch_q08/duckdb:vortex-compact 44690594 44073094 1.01
tpch_q09/duckdb:vortex-compact 85368654 82486044 1.03
tpch_q10/duckdb:vortex-compact 39777197 38266873 1.04
tpch_q11/duckdb:vortex-compact 19898019 19899488 1.00
tpch_q12/duckdb:vortex-compact 35454921 34852295 1.02
tpch_q13/duckdb:vortex-compact 44788481 44331843 1.01
tpch_q14/duckdb:vortex-compact 29784712 28542857 1.04
tpch_q15/duckdb:vortex-compact 19776917 18997582 1.04
tpch_q16/duckdb:vortex-compact 36520609 35226615 1.04
tpch_q17/duckdb:vortex-compact 31211879 29106221 1.07
tpch_q18/duckdb:vortex-compact 50711212 49812743 1.02
tpch_q19/duckdb:vortex-compact 37112561 33846041 1.10
tpch_q20/duckdb:vortex-compact 44025139 41873380 1.05
tpch_q21/duckdb:vortex-compact 114898930 108218272 1.06
tpch_q22/duckdb:vortex-compact 20057220 19358945 1.04
duckdb / parquet (0.991x ➖, 2↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 76011086 87681874 0.87
tpch_q02/duckdb:parquet 40123371 40691419 0.99
tpch_q03/duckdb:parquet 69628059 71553470 0.97
tpch_q04/duckdb:parquet 48143200 48040000 1.00
tpch_q05/duckdb:parquet 65132055 65718542 0.99
tpch_q06/duckdb:parquet 20934516 21008717 1.00
tpch_q07/duckdb:parquet 68811529 71622202 0.96
tpch_q08/duckdb:parquet 87020781 80324729 1.08
tpch_q09/duckdb:parquet 🚀 144870049 161006172 0.90
tpch_q10/duckdb:parquet 124907735 128059840 0.98
tpch_q11/duckdb:parquet 21118043 21414251 0.99
tpch_q12/duckdb:parquet 45513268 46061083 0.99
tpch_q13/duckdb:parquet 261932930 261094877 1.00
tpch_q14/duckdb:parquet 49676427 48473921 1.02
tpch_q15/duckdb:parquet 24558585 25665013 0.96
tpch_q16/duckdb:parquet 56821265 56110036 1.01
tpch_q17/duckdb:parquet 52790424 52784623 1.00
tpch_q18/duckdb:parquet 118787311 111420073 1.07
tpch_q19/duckdb:parquet 70933425 67911856 1.04
tpch_q20/duckdb:parquet 64330319 62700946 1.03
tpch_q21/duckdb:parquet 163509648 169548517 0.96
tpch_q22/duckdb:parquet 52727578 51660803 1.02
duckdb / duckdb (1.049x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16509148 16054339 1.03
tpch_q02/duckdb:duckdb 12667912 12086632 1.05
tpch_q03/duckdb:duckdb 20163924 19262891 1.05
tpch_q04/duckdb:duckdb 19889047 19151961 1.04
tpch_q05/duckdb:duckdb 20429990 19853173 1.03
tpch_q06/duckdb:duckdb 5511651 5302120 1.04
tpch_q07/duckdb:duckdb 23215725 22070639 1.05
tpch_q08/duckdb:duckdb 22036001 20445338 1.08
tpch_q09/duckdb:duckdb 57876331 53102654 1.09
tpch_q10/duckdb:duckdb 44089773 42936569 1.03
tpch_q11/duckdb:duckdb 6253960 5797100 1.08
tpch_q12/duckdb:duckdb 14158721 13601177 1.04
tpch_q13/duckdb:duckdb 38726098 37761670 1.03
tpch_q14/duckdb:duckdb 🚨 20281171 16728160 1.21
tpch_q15/duckdb:duckdb 12191595 11596971 1.05
tpch_q16/duckdb:duckdb 23488189 24291974 0.97
tpch_q17/duckdb:duckdb 14611736 13775966 1.06
tpch_q18/duckdb:duckdb 39068326 38471048 1.02
tpch_q19/duckdb:duckdb 27704591 26155691 1.06
tpch_q20/duckdb:duckdb 23340867 22636398 1.03
tpch_q21/duckdb:duckdb 59110211 55858738 1.06
tpch_q22/duckdb:duckdb 24629636 24230150 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -21.0% +6.1% -25.6% +19.4% ✅ faster
1 datafusion:vortex-compact -8.8% +6.1% -14.0% +19.1% ➖ noise
1 datafusion:vortex-file-compressed -6.3% +6.1% -11.8% +19.2% ➖ noise
1 duckdb:duckdb +2.8% +6.1% -3.1% +17.1% ➖ noise
1 duckdb:vortex-compact +1.8% +6.1% -4.1% +16.7% ➖ noise
1 duckdb:vortex-file-compressed +1.0% +6.1% -4.8% +19.5% ➖ noise
2 datafusion:arrow -9.1% -5.1% -4.1% +10.6% ➖ noise
2 datafusion:vortex-compact -3.7% -5.1% +1.5% +10.4% ➖ noise
2 datafusion:vortex-file-compressed -3.5% -5.1% +1.7% +10.4% ➖ noise
2 duckdb:duckdb +4.8% -5.1% +10.5% +10.4% 🚨 regression
2 duckdb:vortex-compact +0.8% -5.1% +6.2% +10.4% ➖ noise
2 duckdb:vortex-file-compressed +6.5% -5.1% +12.2% +10.4% 🚨 regression
3 datafusion:arrow -21.0% -9.7% -12.5% +10.4% ✅ faster
3 datafusion:vortex-compact -2.9% -9.7% +7.5% +10.4% ➖ noise
3 datafusion:vortex-file-compressed -5.0% -9.7% +5.1% +10.4% ➖ noise
3 duckdb:duckdb +4.7% -9.7% +15.9% +10.7% 🚨 regression
3 duckdb:vortex-compact +5.7% -9.7% +17.0% +11.7% 🚨 regression
3 duckdb:vortex-file-compressed +7.4% -9.7% +18.9% +16.4% 🚨 regression
4 datafusion:arrow -21.0% -5.0% -16.9% +10.4% ✅ faster
4 datafusion:vortex-compact -2.8% -5.0% +2.3% +10.4% ➖ noise
4 datafusion:vortex-file-compressed -7.8% -5.0% -3.0% +10.4% ➖ noise
4 duckdb:duckdb +3.8% -5.0% +9.3% +10.4% ➖ noise
4 duckdb:vortex-compact +3.3% -5.0% +8.7% +10.4% ➖ noise
4 duckdb:vortex-file-compressed +7.6% -5.0% +13.3% +10.4% 🚨 regression
5 datafusion:arrow -7.6% -3.7% -4.1% +10.4% ➖ noise
5 datafusion:vortex-compact -7.7% -3.7% -4.2% +10.4% ➖ noise
5 datafusion:vortex-file-compressed -12.1% -3.7% -8.8% +10.4% ➖ noise
5 duckdb:duckdb +2.9% -3.7% +6.8% +12.6% ➖ noise
5 duckdb:vortex-compact +6.3% -3.7% +10.4% +10.4% ➖ noise
5 duckdb:vortex-file-compressed +2.8% -3.7% +6.7% +12.4% ➖ noise
6 datafusion:arrow -5.8% +0.6% -6.3% +16.4% ➖ noise
6 datafusion:vortex-compact -4.5% +0.6% -5.0% +16.3% ➖ noise
6 datafusion:vortex-file-compressed -8.3% +0.6% -8.8% +16.6% ➖ noise
6 duckdb:duckdb +4.0% +0.6% +3.3% +16.8% ➖ noise
6 duckdb:vortex-compact -3.1% +0.6% -3.7% +17.9% ➖ noise
6 duckdb:vortex-file-compressed +0.2% +0.6% -0.4% +16.3% ➖ noise
7 datafusion:arrow -7.4% -4.2% -3.4% +11.3% ➖ noise
7 datafusion:vortex-compact -4.4% -4.2% -0.2% +10.4% ➖ noise
7 datafusion:vortex-file-compressed -9.0% -4.2% -5.0% +10.4% ➖ noise
7 duckdb:duckdb +5.2% -4.2% +9.8% +10.4% ➖ noise
7 duckdb:vortex-compact +4.7% -4.2% +9.3% +10.4% ➖ noise
7 duckdb:vortex-file-compressed +2.8% -4.2% +7.3% +10.4% ➖ noise
8 datafusion:arrow -15.8% +5.5% -20.3% +10.4% ✅ faster
8 datafusion:vortex-compact -3.0% +5.5% -8.1% +10.4% ➖ noise
8 datafusion:vortex-file-compressed -9.4% +5.5% -14.1% +10.4% ✅ faster
8 duckdb:duckdb +7.8% +5.5% +2.1% +10.4% ➖ noise
8 duckdb:vortex-compact +1.4% +5.5% -3.9% +10.7% ➖ noise
8 duckdb:vortex-file-compressed +6.8% +5.5% +1.2% +11.2% ➖ noise
9 datafusion:arrow -18.3% -8.5% -10.7% +10.7% ✅ faster
9 datafusion:vortex-compact -3.8% -8.5% +5.2% +10.4% ➖ noise
9 datafusion:vortex-file-compressed -12.4% -8.5% -4.3% +10.6% ➖ noise
9 duckdb:duckdb +9.0% -8.5% +19.1% +10.4% 🚨 regression
9 duckdb:vortex-compact +3.5% -8.5% +13.1% +10.4% 🚨 regression
9 duckdb:vortex-file-compressed +1.6% -8.5% +11.1% +10.4% 🚨 regression
10 datafusion:arrow -12.7% -4.4% -8.8% +10.4% ➖ noise
10 datafusion:vortex-compact -7.9% -4.4% -3.7% +10.4% ➖ noise
10 datafusion:vortex-file-compressed -7.6% -4.4% -3.3% +10.4% ➖ noise
10 duckdb:duckdb +2.7% -4.4% +7.4% +12.5% ➖ noise
10 duckdb:vortex-compact +3.9% -4.4% +8.7% +10.4% ➖ noise
10 duckdb:vortex-file-compressed +5.1% -4.4% +9.9% +10.4% ➖ noise
11 datafusion:arrow -8.3% -5.3% -3.2% +10.4% ➖ noise
11 datafusion:vortex-compact -2.4% -5.3% +3.1% +10.4% ➖ noise
11 datafusion:vortex-file-compressed -7.1% -5.3% -2.0% +10.4% ➖ noise
11 duckdb:duckdb +7.9% -5.3% +13.9% +10.4% 🚨 regression
11 duckdb:vortex-compact -0.0% -5.3% +5.5% +11.3% ➖ noise
11 duckdb:vortex-file-compressed +12.5% -5.3% +18.8% +10.4% 🚨 regression
12 datafusion:arrow -9.1% -4.7% -4.6% +18.7% ➖ noise
12 datafusion:vortex-compact -3.4% -4.7% +1.3% +13.2% ➖ noise
12 datafusion:vortex-file-compressed -13.8% -4.7% -9.6% +11.9% ➖ noise
12 duckdb:duckdb +4.1% -4.7% +9.2% +12.1% ➖ noise
12 duckdb:vortex-compact +1.7% -4.7% +6.8% +12.9% ➖ noise
12 duckdb:vortex-file-compressed -0.8% -4.7% +4.1% +12.3% ➖ noise
13 datafusion:arrow -5.9% -2.5% -3.5% +10.7% ➖ noise
13 datafusion:vortex-compact -3.2% -2.5% -0.7% +10.4% ➖ noise
13 datafusion:vortex-file-compressed -6.1% -2.5% -3.7% +10.4% ➖ noise
13 duckdb:duckdb +2.6% -2.5% +5.2% +10.4% ➖ noise
13 duckdb:vortex-compact +1.0% -2.5% +3.7% +10.4% ➖ noise
13 duckdb:vortex-file-compressed +1.1% -2.5% +3.7% +10.4% ➖ noise
14 datafusion:arrow -24.8% -2.6% -22.8% +10.4% ✅ faster
14 datafusion:vortex-compact -0.6% -2.6% +2.0% +10.4% ➖ noise
14 datafusion:vortex-file-compressed -12.7% -2.6% -10.3% +12.8% ➖ noise
14 duckdb:duckdb +21.2% -2.6% +24.5% +19.2% 🚨 regression
14 duckdb:vortex-compact +4.4% -2.6% +7.2% +10.7% ➖ noise
14 duckdb:vortex-file-compressed -0.4% -2.6% +2.3% +13.7% ➖ noise
15 datafusion:arrow -20.5% -4.5% -16.7% +12.6% ✅ faster
15 datafusion:vortex-compact +0.3% -4.5% +5.0% +11.0% ➖ noise
15 datafusion:vortex-file-compressed -11.3% -4.5% -7.1% +11.7% ➖ noise
15 duckdb:duckdb +5.1% -4.5% +10.1% +14.3% ➖ noise
15 duckdb:vortex-compact +4.1% -4.5% +9.0% +12.2% ➖ noise
15 duckdb:vortex-file-compressed +5.5% -4.5% +10.5% +11.2% ➖ noise
16 datafusion:arrow -7.5% -4.1% -3.5% +10.4% ➖ noise
16 datafusion:vortex-compact -1.1% -4.1% +3.1% +10.4% ➖ noise
16 datafusion:vortex-file-compressed -12.9% -4.1% -9.2% +10.4% ➖ noise
16 duckdb:duckdb -3.3% -4.1% +0.9% +10.4% ➖ noise
16 duckdb:vortex-compact +3.7% -4.1% +8.1% +10.4% ➖ noise
16 duckdb:vortex-file-compressed +4.9% -4.1% +9.4% +10.4% ➖ noise
17 datafusion:arrow -11.2% -3.3% -8.1% +10.7% ➖ noise
17 datafusion:vortex-compact +1.2% -3.3% +4.7% +10.4% ➖ noise
17 datafusion:vortex-file-compressed -13.0% -3.3% -10.0% +11.6% ➖ noise
17 duckdb:duckdb +6.1% -3.3% +9.7% +15.5% ➖ noise
17 duckdb:vortex-compact +7.2% -3.3% +10.9% +11.3% ➖ noise
17 duckdb:vortex-file-compressed +2.7% -3.3% +6.2% +12.6% ➖ noise
18 datafusion:arrow -15.3% -2.9% -12.8% +10.4% ✅ faster
18 datafusion:vortex-compact -9.3% -2.9% -6.5% +10.4% ➖ noise
18 datafusion:vortex-file-compressed -10.9% -2.9% -8.2% +10.4% ➖ noise
18 duckdb:duckdb +1.6% -2.9% +4.6% +10.4% ➖ noise
18 duckdb:vortex-compact +1.8% -2.9% +4.9% +10.4% ➖ noise
18 duckdb:vortex-file-compressed +2.2% -2.9% +5.3% +10.4% ➖ noise
19 datafusion:arrow -16.6% +1.7% -18.0% +18.6% ✅ faster
19 datafusion:vortex-compact -10.3% +1.7% -11.7% +12.1% ✅ faster
19 datafusion:vortex-file-compressed -8.5% +1.7% -10.0% +12.7% ➖ noise
19 duckdb:duckdb +5.9% +1.7% +4.2% +14.0% ➖ noise
19 duckdb:vortex-compact +9.7% +1.7% +7.8% +11.5% ➖ noise
19 duckdb:vortex-file-compressed +12.7% +1.7% +10.9% +11.7% ➖ noise
20 datafusion:arrow -18.3% -2.6% -16.2% +10.4% ✅ faster
20 datafusion:vortex-compact -2.7% -2.6% -0.1% +10.4% ➖ noise
20 datafusion:vortex-file-compressed -1.4% -2.6% +1.2% +10.4% ➖ noise
20 duckdb:duckdb +3.1% -2.6% +5.8% +10.6% ➖ noise
20 duckdb:vortex-compact +5.1% -2.6% +7.9% +10.4% ➖ noise
20 duckdb:vortex-file-compressed +8.3% -2.6% +11.2% +10.5% 🚨 regression
21 datafusion:arrow -15.9% -5.0% -11.4% +10.4% ✅ faster
21 datafusion:vortex-compact +4.4% -5.0% +10.0% +10.4% ➖ noise
21 datafusion:vortex-file-compressed -6.8% -5.0% -1.9% +10.4% ➖ noise
21 duckdb:duckdb +5.8% -5.0% +11.4% +10.4% 🚨 regression
21 duckdb:vortex-compact +6.2% -5.0% +11.8% +10.4% 🚨 regression
21 duckdb:vortex-file-compressed +7.8% -5.0% +13.5% +10.4% 🚨 regression
22 datafusion:arrow -6.0% -0.3% -5.7% +10.4% ➖ noise
22 datafusion:vortex-compact +1.4% -0.3% +1.6% +10.4% ➖ noise
22 datafusion:vortex-file-compressed -5.4% -0.3% -5.1% +10.4% ➖ noise
22 duckdb:duckdb +1.6% -0.3% +1.9% +10.4% ➖ noise
22 duckdb:vortex-compact +3.6% -0.3% +3.9% +10.4% ➖ noise
22 duckdb:vortex-file-compressed +4.6% -0.3% +4.9% +10.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

File Size Changes (195 files changed, -98.4% overall, 0↑ 195↓)
File Scale Format Base HEAD Change %
lineitem_18.vortex 100 vortex-file-compressed 147.55 MB 0 B 147.55 MB -100.0%
lineitem_77.vortex 100 vortex-file-compressed 148.24 MB 0 B 148.24 MB -100.0%
part_15.vortex 100 vortex-file-compressed 28.48 MB 0 B 28.48 MB -100.0%
lineitem_72.vortex 100 vortex-file-compressed 147.99 MB 0 B 147.99 MB -100.0%
lineitem_66.vortex 100 vortex-file-compressed 148.09 MB 0 B 148.09 MB -100.0%
orders_17.vortex 100 vortex-file-compressed 180.01 MB 0 B 180.01 MB -100.0%
orders_18.vortex 100 vortex-file-compressed 180.45 MB 0 B 180.45 MB -100.0%
lineitem_47.vortex 100 vortex-file-compressed 148.26 MB 0 B 148.26 MB -100.0%
part_3.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
lineitem_70.vortex 100 vortex-file-compressed 147.89 MB 0 B 147.89 MB -100.0%
lineitem_48.vortex 100 vortex-file-compressed 148.23 MB 0 B 148.23 MB -100.0%
lineitem_12.vortex 100 vortex-file-compressed 148.19 MB 0 B 148.19 MB -100.0%
orders_11.vortex 100 vortex-file-compressed 180.08 MB 0 B 180.08 MB -100.0%
lineitem_20.vortex 100 vortex-file-compressed 148.78 MB 0 B 148.78 MB -100.0%
orders_15.vortex 100 vortex-file-compressed 180.19 MB 0 B 180.19 MB -100.0%
lineitem_52.vortex 100 vortex-file-compressed 146.97 MB 0 B 146.97 MB -100.0%
customer_3.vortex 100 vortex-file-compressed 261.80 MB 0 B 261.80 MB -100.0%
lineitem_55.vortex 100 vortex-file-compressed 148.16 MB 0 B 148.16 MB -100.0%
lineitem_49.vortex 100 vortex-file-compressed 148.47 MB 0 B 148.47 MB -100.0%
lineitem_2.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
lineitem_9.vortex 100 vortex-file-compressed 148.87 MB 0 B 148.87 MB -100.0%
orders_5.vortex 100 vortex-file-compressed 180.03 MB 0 B 180.03 MB -100.0%
part_7.vortex 100 vortex-file-compressed 28.41 MB 0 B 28.41 MB -100.0%
customer_0.vortex 100 vortex-file-compressed 261.80 MB 0 B 261.80 MB -100.0%
part_14.vortex 100 vortex-file-compressed 28.46 MB 0 B 28.46 MB -100.0%
lineitem_88.vortex 100 vortex-file-compressed 148.71 MB 0 B 148.71 MB -100.0%
lineitem_4.vortex 100 vortex-file-compressed 147.27 MB 0 B 147.27 MB -100.0%
lineitem_26.vortex 100 vortex-file-compressed 148.11 MB 0 B 148.11 MB -100.0%
lineitem_54.vortex 100 vortex-file-compressed 149.12 MB 0 B 149.12 MB -100.0%
partsupp_2.vortex 100 vortex-file-compressed 191.39 MB 0 B 191.39 MB -100.0%
lineitem_101.vortex 100 vortex-file-compressed 148.35 MB 0 B 148.35 MB -100.0%
lineitem_89.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
part_16.vortex 100 vortex-file-compressed 28.42 MB 0 B 28.42 MB -100.0%
partsupp_8.vortex 100 vortex-file-compressed 191.49 MB 0 B 191.49 MB -100.0%
partsupp_0.vortex 100 vortex-file-compressed 191.37 MB 0 B 191.37 MB -100.0%
lineitem_45.vortex 100 vortex-file-compressed 146.88 MB 0 B 146.88 MB -100.0%
orders_10.vortex 100 vortex-file-compressed 180.14 MB 0 B 180.14 MB -100.0%
lineitem_112.vortex 100 vortex-file-compressed 147.42 MB 0 B 147.42 MB -100.0%
lineitem_58.vortex 100 vortex-file-compressed 148.72 MB 0 B 148.72 MB -100.0%
orders_3.vortex 100 vortex-file-compressed 180.12 MB 0 B 180.12 MB -100.0%
part_8.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
partsupp_14.vortex 100 vortex-file-compressed 191.62 MB 0 B 191.62 MB -100.0%
part_2.vortex 100 vortex-file-compressed 28.46 MB 0 B 28.46 MB -100.0%
lineitem_85.vortex 100 vortex-file-compressed 147.92 MB 0 B 147.92 MB -100.0%
orders_1.vortex 100 vortex-file-compressed 179.92 MB 0 B 179.92 MB -100.0%
lineitem_15.vortex 100 vortex-file-compressed 147.63 MB 0 B 147.63 MB -100.0%
part_11.vortex 100 vortex-file-compressed 28.45 MB 0 B 28.45 MB -100.0%
lineitem_78.vortex 100 vortex-file-compressed 147.35 MB 0 B 147.35 MB -100.0%
part_1.vortex 100 vortex-file-compressed 28.49 MB 0 B 28.49 MB -100.0%
lineitem_19.vortex 100 vortex-file-compressed 148.77 MB 0 B 148.77 MB -100.0%
lineitem_5.vortex 100 vortex-file-compressed 148.16 MB 0 B 148.16 MB -100.0%
partsupp_3.vortex 100 vortex-file-compressed 191.37 MB 0 B 191.37 MB -100.0%
lineitem_56.vortex 100 vortex-file-compressed 147.73 MB 0 B 147.73 MB -100.0%
lineitem_17.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
lineitem_106.vortex 100 vortex-file-compressed 148.07 MB 0 B 148.07 MB -100.0%
lineitem_37.vortex 100 vortex-file-compressed 147.47 MB 0 B 147.47 MB -100.0%
lineitem_68.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
lineitem_79.vortex 100 vortex-file-compressed 148.43 MB 0 B 148.43 MB -100.0%
lineitem_38.vortex 100 vortex-file-compressed 149.09 MB 0 B 149.09 MB -100.0%
lineitem_105.vortex 100 vortex-file-compressed 147.47 MB 0 B 147.47 MB -100.0%
lineitem_95.vortex 100 vortex-file-compressed 147.49 MB 0 B 147.49 MB -100.0%
orders_4.vortex 100 vortex-file-compressed 180.39 MB 0 B 180.39 MB -100.0%
part_9.vortex 100 vortex-file-compressed 28.41 MB 0 B 28.41 MB -100.0%
orders_24.vortex 100 vortex-file-compressed 179.56 MB 0 B 179.56 MB -100.0%
part_13.vortex 100 vortex-file-compressed 28.44 MB 0 B 28.44 MB -100.0%
lineitem_69.vortex 100 vortex-file-compressed 148.10 MB 0 B 148.10 MB -100.0%
lineitem_39.vortex 100 vortex-file-compressed 147.38 MB 0 B 147.38 MB -100.0%
lineitem_97.vortex 100 vortex-file-compressed 148.10 MB 0 B 148.10 MB -100.0%
lineitem_118.vortex 100 vortex-file-compressed 147.83 MB 0 B 147.83 MB -100.0%
orders_19.vortex 100 vortex-file-compressed 180.04 MB 0 B 180.04 MB -100.0%
lineitem_36.vortex 100 vortex-file-compressed 147.64 MB 0 B 147.64 MB -100.0%
orders_9.vortex 100 vortex-file-compressed 180.11 MB 0 B 180.11 MB -100.0%
lineitem_7.vortex 100 vortex-file-compressed 147.86 MB 0 B 147.86 MB -100.0%
lineitem_29.vortex 100 vortex-file-compressed 148.75 MB 0 B 148.75 MB -100.0%
lineitem_3.vortex 100 vortex-file-compressed 148.16 MB 0 B 148.16 MB -100.0%
lineitem_81.vortex 100 vortex-file-compressed 147.75 MB 0 B 147.75 MB -100.0%
partsupp_7.vortex 100 vortex-file-compressed 191.61 MB 0 B 191.61 MB -100.0%
lineitem_110.vortex 100 vortex-file-compressed 148.41 MB 0 B 148.41 MB -100.0%
lineitem_28.vortex 100 vortex-file-compressed 148.66 MB 0 B 148.66 MB -100.0%
part_10.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
orders_20.vortex 100 vortex-file-compressed 179.85 MB 0 B 179.85 MB -100.0%
lineitem_1.vortex 100 vortex-file-compressed 148.56 MB 0 B 148.56 MB -100.0%
partsupp_18.vortex 100 vortex-file-compressed 191.38 MB 0 B 191.38 MB -100.0%
lineitem_57.vortex 100 vortex-file-compressed 148.37 MB 0 B 148.37 MB -100.0%
duckdb.db 100 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
part_18.vortex 100 vortex-file-compressed 28.51 MB 0 B 28.51 MB -100.0%
partsupp_15.vortex 100 vortex-file-compressed 191.52 MB 0 B 191.52 MB -100.0%
orders_14.vortex 100 vortex-file-compressed 180.18 MB 0 B 180.18 MB -100.0%
partsupp_12.vortex 100 vortex-file-compressed 191.50 MB 0 B 191.50 MB -100.0%
orders_2.vortex 100 vortex-file-compressed 180.35 MB 0 B 180.35 MB -100.0%
part_0.vortex 100 vortex-file-compressed 28.45 MB 0 B 28.45 MB -100.0%
lineitem_25.vortex 100 vortex-file-compressed 148.52 MB 0 B 148.52 MB -100.0%
lineitem_13.vortex 100 vortex-file-compressed 148.26 MB 0 B 148.26 MB -100.0%
lineitem_96.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
lineitem_24.vortex 100 vortex-file-compressed 147.50 MB 0 B 147.50 MB -100.0%
part_5.vortex 100 vortex-file-compressed 28.38 MB 0 B 28.38 MB -100.0%
lineitem_73.vortex 100 vortex-file-compressed 148.32 MB 0 B 148.32 MB -100.0%
lineitem_65.vortex 100 vortex-file-compressed 147.57 MB 0 B 147.57 MB -100.0%
lineitem_34.vortex 100 vortex-file-compressed 148.93 MB 0 B 148.93 MB -100.0%
partsupp_13.vortex 100 vortex-file-compressed 191.35 MB 0 B 191.35 MB -100.0%
region_0.vortex 100 vortex-file-compressed 6.13 KB 0 B 6.13 KB -100.0%
lineitem_27.vortex 100 vortex-file-compressed 148.45 MB 0 B 148.45 MB -100.0%
lineitem_82.vortex 100 vortex-file-compressed 148.37 MB 0 B 148.37 MB -100.0%
orders_26.vortex 100 vortex-file-compressed 179.99 MB 0 B 179.99 MB -100.0%
lineitem_60.vortex 100 vortex-file-compressed 148.62 MB 0 B 148.62 MB -100.0%
lineitem_40.vortex 100 vortex-file-compressed 147.97 MB 0 B 147.97 MB -100.0%
partsupp_1.vortex 100 vortex-file-compressed 191.69 MB 0 B 191.69 MB -100.0%
lineitem_50.vortex 100 vortex-file-compressed 148.88 MB 0 B 148.88 MB -100.0%
lineitem_46.vortex 100 vortex-file-compressed 147.77 MB 0 B 147.77 MB -100.0%
part_12.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
lineitem_59.vortex 100 vortex-file-compressed 148.42 MB 0 B 148.42 MB -100.0%
lineitem_14.vortex 100 vortex-file-compressed 147.79 MB 0 B 147.79 MB -100.0%
lineitem_108.vortex 100 vortex-file-compressed 147.29 MB 0 B 147.29 MB -100.0%
lineitem_63.vortex 100 vortex-file-compressed 148.65 MB 0 B 148.65 MB -100.0%
lineitem_76.vortex 100 vortex-file-compressed 147.35 MB 0 B 147.35 MB -100.0%
partsupp_16.vortex 100 vortex-file-compressed 191.25 MB 0 B 191.25 MB -100.0%
orders_0.vortex 100 vortex-file-compressed 180.00 MB 0 B 180.00 MB -100.0%
orders_6.vortex 100 vortex-file-compressed 179.80 MB 0 B 179.80 MB -100.0%
lineitem_111.vortex 100 vortex-file-compressed 147.77 MB 0 B 147.77 MB -100.0%
lineitem_120.vortex 100 vortex-file-compressed 147.10 MB 0 B 147.10 MB -100.0%
lineitem_53.vortex 100 vortex-file-compressed 148.23 MB 0 B 148.23 MB -100.0%
lineitem_67.vortex 100 vortex-file-compressed 148.84 MB 0 B 148.84 MB -100.0%
orders_13.vortex 100 vortex-file-compressed 179.83 MB 0 B 179.83 MB -100.0%
lineitem_90.vortex 100 vortex-file-compressed 147.82 MB 0 B 147.82 MB -100.0%
lineitem_114.vortex 100 vortex-file-compressed 147.46 MB 0 B 147.46 MB -100.0%
partsupp_9.vortex 100 vortex-file-compressed 191.50 MB 0 B 191.50 MB -100.0%
lineitem_8.vortex 100 vortex-file-compressed 148.56 MB 0 B 148.56 MB -100.0%
lineitem_61.vortex 100 vortex-file-compressed 147.73 MB 0 B 147.73 MB -100.0%
lineitem_16.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
lineitem_71.vortex 100 vortex-file-compressed 147.94 MB 0 B 147.94 MB -100.0%
lineitem_33.vortex 100 vortex-file-compressed 147.74 MB 0 B 147.74 MB -100.0%
lineitem_87.vortex 100 vortex-file-compressed 147.46 MB 0 B 147.46 MB -100.0%
lineitem_23.vortex 100 vortex-file-compressed 148.19 MB 0 B 148.19 MB -100.0%
lineitem_104.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
lineitem_94.vortex 100 vortex-file-compressed 148.40 MB 0 B 148.40 MB -100.0%
part_6.vortex 100 vortex-file-compressed 28.44 MB 0 B 28.44 MB -100.0%
orders_23.vortex 100 vortex-file-compressed 179.94 MB 0 B 179.94 MB -100.0%
lineitem_11.vortex 100 vortex-file-compressed 148.62 MB 0 B 148.62 MB -100.0%
lineitem_103.vortex 100 vortex-file-compressed 148.37 MB 0 B 148.37 MB -100.0%
lineitem_115.vortex 100 vortex-file-compressed 147.64 MB 0 B 147.64 MB -100.0%
lineitem_102.vortex 100 vortex-file-compressed 148.14 MB 0 B 148.14 MB -100.0%
lineitem_22.vortex 100 vortex-file-compressed 147.32 MB 0 B 147.32 MB -100.0%
part_17.vortex 100 vortex-file-compressed 28.41 MB 0 B 28.41 MB -100.0%
lineitem_116.vortex 100 vortex-file-compressed 148.20 MB 0 B 148.20 MB -100.0%
lineitem_119.vortex 100 vortex-file-compressed 148.33 MB 0 B 148.33 MB -100.0%
partsupp_17.vortex 100 vortex-file-compressed 191.49 MB 0 B 191.49 MB -100.0%
lineitem_80.vortex 100 vortex-file-compressed 147.55 MB 0 B 147.55 MB -100.0%
lineitem_91.vortex 100 vortex-file-compressed 148.27 MB 0 B 148.27 MB -100.0%
lineitem_83.vortex 100 vortex-file-compressed 148.68 MB 0 B 148.68 MB -100.0%
orders_21.vortex 100 vortex-file-compressed 179.89 MB 0 B 179.89 MB -100.0%
nation_0.vortex 100 vortex-file-compressed 10.97 KB 0 B 10.97 KB -100.0%
lineitem_42.vortex 100 vortex-file-compressed 148.38 MB 0 B 148.38 MB -100.0%
lineitem_30.vortex 100 vortex-file-compressed 147.46 MB 0 B 147.46 MB -100.0%
partsupp_11.vortex 100 vortex-file-compressed 191.43 MB 0 B 191.43 MB -100.0%
lineitem_32.vortex 100 vortex-file-compressed 148.90 MB 0 B 148.90 MB -100.0%
orders_22.vortex 100 vortex-file-compressed 180.04 MB 0 B 180.04 MB -100.0%
lineitem_51.vortex 100 vortex-file-compressed 148.42 MB 0 B 148.42 MB -100.0%
orders_16.vortex 100 vortex-file-compressed 179.88 MB 0 B 179.88 MB -100.0%
part_4.vortex 100 vortex-file-compressed 28.42 MB 0 B 28.42 MB -100.0%
lineitem_100.vortex 100 vortex-file-compressed 148.11 MB 0 B 148.11 MB -100.0%
lineitem_64.vortex 100 vortex-file-compressed 147.72 MB 0 B 147.72 MB -100.0%
lineitem_86.vortex 100 vortex-file-compressed 147.62 MB 0 B 147.62 MB -100.0%
partsupp_5.vortex 100 vortex-file-compressed 191.41 MB 0 B 191.41 MB -100.0%
lineitem_31.vortex 100 vortex-file-compressed 148.50 MB 0 B 148.50 MB -100.0%
lineitem_113.vortex 100 vortex-file-compressed 147.56 MB 0 B 147.56 MB -100.0%
lineitem_35.vortex 100 vortex-file-compressed 148.35 MB 0 B 148.35 MB -100.0%
supplier_0.vortex 100 vortex-file-compressed 66.71 MB 0 B 66.71 MB -100.0%
lineitem_10.vortex 100 vortex-file-compressed 148.35 MB 0 B 148.35 MB -100.0%
lineitem_21.vortex 100 vortex-file-compressed 148.33 MB 0 B 148.33 MB -100.0%
lineitem_74.vortex 100 vortex-file-compressed 147.55 MB 0 B 147.55 MB -100.0%
orders_27.vortex 100 vortex-file-compressed 179.78 MB 0 B 179.78 MB -100.0%
lineitem_6.vortex 100 vortex-file-compressed 147.90 MB 0 B 147.90 MB -100.0%
lineitem_0.vortex 100 vortex-file-compressed 148.68 MB 0 B 148.68 MB -100.0%
orders_25.vortex 100 vortex-file-compressed 179.82 MB 0 B 179.82 MB -100.0%
lineitem_84.vortex 100 vortex-file-compressed 147.94 MB 0 B 147.94 MB -100.0%
lineitem_98.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
orders_8.vortex 100 vortex-file-compressed 180.21 MB 0 B 180.21 MB -100.0%
partsupp_10.vortex 100 vortex-file-compressed 191.59 MB 0 B 191.59 MB -100.0%
customer_1.vortex 100 vortex-file-compressed 261.77 MB 0 B 261.77 MB -100.0%
customer_2.vortex 100 vortex-file-compressed 261.69 MB 0 B 261.69 MB -100.0%
partsupp_4.vortex 100 vortex-file-compressed 191.40 MB 0 B 191.40 MB -100.0%
lineitem_93.vortex 100 vortex-file-compressed 147.77 MB 0 B 147.77 MB -100.0%
orders_12.vortex 100 vortex-file-compressed 180.32 MB 0 B 180.32 MB -100.0%
partsupp_6.vortex 100 vortex-file-compressed 191.38 MB 0 B 191.38 MB -100.0%
lineitem_117.vortex 100 vortex-file-compressed 148.24 MB 0 B 148.24 MB -100.0%
lineitem_109.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
orders_7.vortex 100 vortex-file-compressed 180.12 MB 0 B 180.12 MB -100.0%
lineitem_43.vortex 100 vortex-file-compressed 147.84 MB 0 B 147.84 MB -100.0%
lineitem_62.vortex 100 vortex-file-compressed 146.94 MB 0 B 146.94 MB -100.0%
lineitem_75.vortex 100 vortex-file-compressed 147.88 MB 0 B 147.88 MB -100.0%
lineitem_41.vortex 100 vortex-file-compressed 146.66 MB 0 B 146.66 MB -100.0%
lineitem_107.vortex 100 vortex-file-compressed 148.04 MB 0 B 148.04 MB -100.0%
lineitem_44.vortex 100 vortex-file-compressed 147.91 MB 0 B 147.91 MB -100.0%
lineitem_99.vortex 100 vortex-file-compressed 147.26 MB 0 B 147.26 MB -100.0%
lineitem_92.vortex 100 vortex-file-compressed 148.08 MB 0 B 148.08 MB -100.0%

Totals:

  • vortex-compact: 194.82 MB → 194.82 MB (0.0%)
  • vortex-file-compressed: 27.85 GB → 266.60 MB (-99.1%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.0%
Vortex (geomean): 0.992x ➖
Parquet (geomean): 0.977x ➖
Shifts: Parquet (control) -2.3% · Median polish +0.6%


datafusion / vortex-file-compressed (0.929x ➖, 16↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 26640337 30447491 0.87
tpcds_q02/datafusion:vortex-file-compressed 48638358 51419980 0.95
tpcds_q03/datafusion:vortex-file-compressed 🚀 15311589 17194047 0.89
tpcds_q04/datafusion:vortex-file-compressed 269418041 287008085 0.94
tpcds_q05/datafusion:vortex-file-compressed 44323719 47961032 0.92
tpcds_q06/datafusion:vortex-file-compressed 60169170 60550858 0.99
tpcds_q07/datafusion:vortex-file-compressed 🚀 42403552 48419777 0.88
tpcds_q08/datafusion:vortex-file-compressed 30816866 31301834 0.98
tpcds_q09/datafusion:vortex-file-compressed 45531610 47112456 0.97
tpcds_q10/datafusion:vortex-file-compressed 41211875 43854152 0.94
tpcds_q11/datafusion:vortex-file-compressed 133624956 142170845 0.94
tpcds_q12/datafusion:vortex-file-compressed 20273029 22248535 0.91
tpcds_q13/datafusion:vortex-file-compressed 45457318 47950057 0.95
tpcds_q14/datafusion:vortex-file-compressed 175696657 189509680 0.93
tpcds_q15/datafusion:vortex-file-compressed 29035254 30428542 0.95
tpcds_q16/datafusion:vortex-file-compressed 29420056 32361307 0.91
tpcds_q17/datafusion:vortex-file-compressed 62931080 69800409 0.90
tpcds_q18/datafusion:vortex-file-compressed 70665872 77031542 0.92
tpcds_q19/datafusion:vortex-file-compressed 21895686 23804091 0.92
tpcds_q20/datafusion:vortex-file-compressed 21513548 23891996 0.90
tpcds_q21/datafusion:vortex-file-compressed 35572097 39207590 0.91
tpcds_q22/datafusion:vortex-file-compressed 117869373 129795758 0.91
tpcds_q23/datafusion:vortex-file-compressed 157427212 170775997 0.92
tpcds_q24/datafusion:vortex-file-compressed 85772850 93387043 0.92
tpcds_q25/datafusion:vortex-file-compressed 67207920 73152881 0.92
tpcds_q26/datafusion:vortex-file-compressed 34585620 36685610 0.94
tpcds_q27/datafusion:vortex-file-compressed 114682263 114579545 1.00
tpcds_q28/datafusion:vortex-file-compressed 42029506 45368394 0.93
tpcds_q29/datafusion:vortex-file-compressed 64913531 68816061 0.94
tpcds_q30/datafusion:vortex-file-compressed 24102002 25878360 0.93
tpcds_q31/datafusion:vortex-file-compressed 77523623 81562254 0.95
tpcds_q32/datafusion:vortex-file-compressed 22575171 23376339 0.97
tpcds_q33/datafusion:vortex-file-compressed 🚀 29755727 33156975 0.90
tpcds_q34/datafusion:vortex-file-compressed 24836044 27129710 0.92
tpcds_q35/datafusion:vortex-file-compressed 47123481 50397629 0.94
tpcds_q36/datafusion:vortex-file-compressed 58877092 63493375 0.93
tpcds_q37/datafusion:vortex-file-compressed 26171794 28898864 0.91
tpcds_q38/datafusion:vortex-file-compressed 46479503 49072320 0.95
tpcds_q39/datafusion:vortex-file-compressed 107088279 118469260 0.90
tpcds_q40/datafusion:vortex-file-compressed 33488777 36392000 0.92
tpcds_q41/datafusion:vortex-file-compressed 16790964 17895334 0.94
tpcds_q42/datafusion:vortex-file-compressed 14530896 15855980 0.92
tpcds_q43/datafusion:vortex-file-compressed 19673711 20377390 0.97
tpcds_q44/datafusion:vortex-file-compressed 32817687 34900673 0.94
tpcds_q45/datafusion:vortex-file-compressed 28452247 30933350 0.92
tpcds_q46/datafusion:vortex-file-compressed 34760299 37936735 0.92
tpcds_q47/datafusion:vortex-file-compressed 134636535 144327860 0.93
tpcds_q48/datafusion:vortex-file-compressed 40485985 41904773 0.97
tpcds_q49/datafusion:vortex-file-compressed 58460302 62323641 0.94
tpcds_q50/datafusion:vortex-file-compressed 40059430 43892007 0.91
tpcds_q51/datafusion:vortex-file-compressed 92488766 97421237 0.95
tpcds_q52/datafusion:vortex-file-compressed 15248409 15818056 0.96
tpcds_q53/datafusion:vortex-file-compressed 21664911 23970958 0.90
tpcds_q54/datafusion:vortex-file-compressed 36729285 38668995 0.95
tpcds_q55/datafusion:vortex-file-compressed 🚀 14187193 16149138 0.88
tpcds_q56/datafusion:vortex-file-compressed 30421005 32179201 0.95
tpcds_q57/datafusion:vortex-file-compressed 108011833 116086423 0.93
tpcds_q58/datafusion:vortex-file-compressed 54708697 56185144 0.97
tpcds_q59/datafusion:vortex-file-compressed 58621170 62760452 0.93
tpcds_q60/datafusion:vortex-file-compressed 🚀 29291707 32655974 0.90
tpcds_q61/datafusion:vortex-file-compressed 42853657 43072750 0.99
tpcds_q62/datafusion:vortex-file-compressed 🚀 22739622 25283377 0.90
tpcds_q63/datafusion:vortex-file-compressed 22175090 23599286 0.94
tpcds_q64/datafusion:vortex-file-compressed 428464921 463081106 0.93
tpcds_q65/datafusion:vortex-file-compressed 41381291 43705491 0.95
tpcds_q66/datafusion:vortex-file-compressed 73762711 77298083 0.95
tpcds_q67/datafusion:vortex-file-compressed 149783694 159814854 0.94
tpcds_q68/datafusion:vortex-file-compressed 33242043 36646448 0.91
tpcds_q69/datafusion:vortex-file-compressed 38447329 41136498 0.93
tpcds_q70/datafusion:vortex-file-compressed 93560583 96853280 0.97
tpcds_q71/datafusion:vortex-file-compressed 23631426 25497266 0.93
tpcds_q72/datafusion:vortex-file-compressed 🚀 2180939635 2431800994 0.90
tpcds_q73/datafusion:vortex-file-compressed 24264380 25820757 0.94
tpcds_q74/datafusion:vortex-file-compressed 81509000 89693803 0.91
tpcds_q75/datafusion:vortex-file-compressed 109318360 116524140 0.94
tpcds_q76/datafusion:vortex-file-compressed 24611283 25893116 0.95
tpcds_q77/datafusion:vortex-file-compressed 🚀 39756940 44901747 0.89
tpcds_q78/datafusion:vortex-file-compressed 128086455 138817852 0.92
tpcds_q79/datafusion:vortex-file-compressed 🚀 29646217 33675846 0.88
tpcds_q80/datafusion:vortex-file-compressed 97350285 104223023 0.93
tpcds_q81/datafusion:vortex-file-compressed 🚀 23504873 26370325 0.89
tpcds_q82/datafusion:vortex-file-compressed 27927082 29557331 0.94
tpcds_q83/datafusion:vortex-file-compressed 🚀 35597128 40026803 0.89
tpcds_q84/datafusion:vortex-file-compressed 13592672 14560692 0.93
tpcds_q85/datafusion:vortex-file-compressed 100455313 107170773 0.94
tpcds_q86/datafusion:vortex-file-compressed 18522810 19775775 0.94
tpcds_q87/datafusion:vortex-file-compressed 🚀 45229288 52023737 0.87
tpcds_q88/datafusion:vortex-file-compressed 57840403 59739172 0.97
tpcds_q89/datafusion:vortex-file-compressed 25370971 26574451 0.95
tpcds_q90/datafusion:vortex-file-compressed 16281089 16775483 0.97
tpcds_q91/datafusion:vortex-file-compressed 19242652 21343045 0.90
tpcds_q92/datafusion:vortex-file-compressed 20227769 20989243 0.96
tpcds_q93/datafusion:vortex-file-compressed 🚀 34286994 38832175 0.88
tpcds_q94/datafusion:vortex-file-compressed 🚀 23816641 26890334 0.89
tpcds_q95/datafusion:vortex-file-compressed 64521671 68183093 0.95
tpcds_q96/datafusion:vortex-file-compressed 13502597 14851402 0.91
tpcds_q97/datafusion:vortex-file-compressed 35745134 35620989 1.00
tpcds_q98/datafusion:vortex-file-compressed 🚀 24679133 28353061 0.87
tpcds_q99/datafusion:vortex-file-compressed 33674938 35336592 0.95
datafusion / vortex-compact (0.967x ➖, 7↑ 3↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 26470430 28728275 0.92
tpcds_q02/datafusion:vortex-compact 55238109 57339907 0.96
tpcds_q03/datafusion:vortex-compact 20042817 21933198 0.91
tpcds_q04/datafusion:vortex-compact 322868577 343961595 0.94
tpcds_q05/datafusion:vortex-compact 48664103 52077625 0.93
tpcds_q06/datafusion:vortex-compact 62081859 64987547 0.96
tpcds_q07/datafusion:vortex-compact 53434959 57450415 0.93
tpcds_q08/datafusion:vortex-compact 36457979 39495296 0.92
tpcds_q09/datafusion:vortex-compact 62437729 65958182 0.95
tpcds_q10/datafusion:vortex-compact 51960186 55706897 0.93
tpcds_q11/datafusion:vortex-compact 161562603 171789919 0.94
tpcds_q12/datafusion:vortex-compact 27612148 29100554 0.95
tpcds_q13/datafusion:vortex-compact 93197442 97414060 0.96
tpcds_q14/datafusion:vortex-compact 200535758 214468967 0.94
tpcds_q15/datafusion:vortex-compact 🚀 30675883 34974405 0.88
tpcds_q16/datafusion:vortex-compact 33505738 36381854 0.92
tpcds_q17/datafusion:vortex-compact 76772409 80704634 0.95
tpcds_q18/datafusion:vortex-compact 78794895 85643297 0.92
tpcds_q19/datafusion:vortex-compact 🚀 29332129 32995405 0.89
tpcds_q20/datafusion:vortex-compact 28903049 28618793 1.01
tpcds_q21/datafusion:vortex-compact 40711805 43649220 0.93
tpcds_q22/datafusion:vortex-compact 🚀 121478635 141570121 0.86
tpcds_q23/datafusion:vortex-compact 169539991 187012713 0.91
tpcds_q24/datafusion:vortex-compact 98943520 106480596 0.93
tpcds_q25/datafusion:vortex-compact 81033162 89291244 0.91
tpcds_q26/datafusion:vortex-compact 45785093 47709846 0.96
tpcds_q27/datafusion:vortex-compact 🚀 125904221 143480278 0.88
tpcds_q28/datafusion:vortex-compact 79366680 81320439 0.98
tpcds_q29/datafusion:vortex-compact 76263463 82721457 0.92
tpcds_q30/datafusion:vortex-compact 29693601 31335558 0.95
tpcds_q31/datafusion:vortex-compact 101859044 104920314 0.97
tpcds_q32/datafusion:vortex-compact 27349611 27681009 0.99
tpcds_q33/datafusion:vortex-compact 37990584 39810413 0.95
tpcds_q34/datafusion:vortex-compact 33069551 33938124 0.97
tpcds_q35/datafusion:vortex-compact 53843505 56677862 0.95
tpcds_q36/datafusion:vortex-compact 75438485 82462235 0.91
tpcds_q37/datafusion:vortex-compact 41202139 42297075 0.97
tpcds_q38/datafusion:vortex-compact 55623162 57481249 0.97
tpcds_q39/datafusion:vortex-compact 116092562 124463065 0.93
tpcds_q40/datafusion:vortex-compact 38420646 39103997 0.98
tpcds_q41/datafusion:vortex-compact 18811883 19901780 0.95
tpcds_q42/datafusion:vortex-compact 18856477 19692240 0.96
tpcds_q43/datafusion:vortex-compact 25426117 25823825 0.98
tpcds_q44/datafusion:vortex-compact 48676685 50922455 0.96
tpcds_q45/datafusion:vortex-compact 32800034 34323815 0.96
tpcds_q46/datafusion:vortex-compact 45427151 48032373 0.95
tpcds_q47/datafusion:vortex-compact 153332380 161508405 0.95
tpcds_q48/datafusion:vortex-compact 🚀 75031950 83527241 0.90
tpcds_q49/datafusion:vortex-compact 70634846 75555792 0.93
tpcds_q50/datafusion:vortex-compact 48045872 51995468 0.92
tpcds_q51/datafusion:vortex-compact 98795353 100809462 0.98
tpcds_q52/datafusion:vortex-compact 19315031 19344002 1.00
tpcds_q53/datafusion:vortex-compact 29599118 31016464 0.95
tpcds_q54/datafusion:vortex-compact 43622033 44787120 0.97
tpcds_q55/datafusion:vortex-compact 18739756 19462197 0.96
tpcds_q56/datafusion:vortex-compact 36253367 37232537 0.97
tpcds_q57/datafusion:vortex-compact 120141329 127674830 0.94
tpcds_q58/datafusion:vortex-compact 62660625 66794348 0.94
tpcds_q59/datafusion:vortex-compact 71175877 72585427 0.98
tpcds_q60/datafusion:vortex-compact 36286611 38439091 0.94
tpcds_q61/datafusion:vortex-compact 56648528 57473264 0.99
tpcds_q62/datafusion:vortex-compact 🚀 25949265 31343494 0.83
tpcds_q63/datafusion:vortex-compact 28639334 29727448 0.96
tpcds_q64/datafusion:vortex-compact 467971089 495394790 0.94
tpcds_q65/datafusion:vortex-compact 55645141 57298537 0.97
tpcds_q66/datafusion:vortex-compact 78225774 84008653 0.93
tpcds_q67/datafusion:vortex-compact 150952891 163922369 0.92
tpcds_q68/datafusion:vortex-compact 46418245 49280000 0.94
tpcds_q69/datafusion:vortex-compact 50915066 52816933 0.96
tpcds_q70/datafusion:vortex-compact 99400512 106285993 0.94
tpcds_q71/datafusion:vortex-compact 🚀 29719324 33862821 0.88
tpcds_q72/datafusion:vortex-compact 2188433419 2177245992 1.01
tpcds_q73/datafusion:vortex-compact 30489881 30562183 1.00
tpcds_q74/datafusion:vortex-compact 98834626 99252616 1.00
tpcds_q75/datafusion:vortex-compact 131628838 126257464 1.04
tpcds_q76/datafusion:vortex-compact 32034157 31510734 1.02
tpcds_q77/datafusion:vortex-compact 53424176 50209415 1.06
tpcds_q78/datafusion:vortex-compact 143492245 137693935 1.04
tpcds_q79/datafusion:vortex-compact 38977548 37773073 1.03
tpcds_q80/datafusion:vortex-compact 104775772 103722452 1.01
tpcds_q81/datafusion:vortex-compact 🚨 31772300 27566073 1.15
tpcds_q82/datafusion:vortex-compact 42790302 41681925 1.03
tpcds_q83/datafusion:vortex-compact 34773692 33087948 1.05
tpcds_q84/datafusion:vortex-compact 15340852 14961695 1.03
tpcds_q85/datafusion:vortex-compact 🚨 137552159 119135208 1.15
tpcds_q86/datafusion:vortex-compact 19287785 18132199 1.06
tpcds_q87/datafusion:vortex-compact 54242814 51981836 1.04
tpcds_q88/datafusion:vortex-compact 77191155 74995109 1.03
tpcds_q89/datafusion:vortex-compact 31628345 30886257 1.02
tpcds_q90/datafusion:vortex-compact 16644353 16208573 1.03
tpcds_q91/datafusion:vortex-compact 34876403 32647351 1.07
tpcds_q92/datafusion:vortex-compact 25395748 26444182 0.96
tpcds_q93/datafusion:vortex-compact 38530054 38916992 0.99
tpcds_q94/datafusion:vortex-compact 🚨 29659004 26439009 1.12
tpcds_q95/datafusion:vortex-compact 66716226 65700827 1.02
tpcds_q96/datafusion:vortex-compact 17885402 17421980 1.03
tpcds_q97/datafusion:vortex-compact 37982571 36917876 1.03
tpcds_q98/datafusion:vortex-compact 30900359 30103822 1.03
tpcds_q99/datafusion:vortex-compact 36157286 36154024 1.00
datafusion / parquet (0.945x ➖, 8↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚀 30822188 34657585 0.89
tpcds_q02/datafusion:parquet 41850190 44127404 0.95
tpcds_q03/datafusion:parquet 12982107 13387429 0.97
tpcds_q04/datafusion:parquet 259706488 285369077 0.91
tpcds_q05/datafusion:parquet 44033326 42248271 1.04
tpcds_q06/datafusion:parquet 61447931 58784567 1.05
tpcds_q07/datafusion:parquet 80958989 82219441 0.98
tpcds_q08/datafusion:parquet 28170577 27774657 1.01
tpcds_q09/datafusion:parquet 46374245 45693445 1.01
tpcds_q10/datafusion:parquet 72441999 72418767 1.00
tpcds_q11/datafusion:parquet 🚀 148092846 165332584 0.90
tpcds_q12/datafusion:parquet 🚀 16918862 19450571 0.87
tpcds_q13/datafusion:parquet 76597467 81541195 0.94
tpcds_q14/datafusion:parquet 160338965 174342094 0.92
tpcds_q15/datafusion:parquet 22331046 24796174 0.90
tpcds_q16/datafusion:parquet 24886191 26155740 0.95
tpcds_q17/datafusion:parquet 63424642 68409523 0.93
tpcds_q18/datafusion:parquet 119109255 122911340 0.97
tpcds_q19/datafusion:parquet 22729469 24215467 0.94
tpcds_q20/datafusion:parquet 16992344 18011705 0.94
tpcds_q21/datafusion:parquet 19642609 20167762 0.97
tpcds_q22/datafusion:parquet 158722658 173672686 0.91
tpcds_q23/datafusion:parquet 153892237 162805450 0.95
tpcds_q24/datafusion:parquet 92487260 95992554 0.96
tpcds_q25/datafusion:parquet 65011351 68965085 0.94
tpcds_q26/datafusion:parquet 65888252 70395550 0.94
tpcds_q27/datafusion:parquet 149707131 163804586 0.91
tpcds_q28/datafusion:parquet 45714516 48252942 0.95
tpcds_q29/datafusion:parquet 67211537 71855262 0.94
tpcds_q30/datafusion:parquet 35210483 37234351 0.95
tpcds_q31/datafusion:parquet 66796140 70021570 0.95
tpcds_q32/datafusion:parquet 19231206 20188383 0.95
tpcds_q33/datafusion:parquet 26472768 29293785 0.90
tpcds_q34/datafusion:parquet 21434429 23129308 0.93
tpcds_q35/datafusion:parquet 70807507 77214133 0.92
tpcds_q36/datafusion:parquet 58430139 63423894 0.92
tpcds_q37/datafusion:parquet 19237476 20636715 0.93
tpcds_q38/datafusion:parquet 43723489 44786442 0.98
tpcds_q39/datafusion:parquet 🚀 76181888 88520496 0.86
tpcds_q40/datafusion:parquet 25613128 27139775 0.94
tpcds_q41/datafusion:parquet 13771128 15163835 0.91
tpcds_q42/datafusion:parquet 11905786 12194124 0.98
tpcds_q43/datafusion:parquet 18044359 18445905 0.98
tpcds_q44/datafusion:parquet 33624922 34743018 0.97
tpcds_q45/datafusion:parquet 29474098 30801518 0.96
tpcds_q46/datafusion:parquet 33393613 34629789 0.96
tpcds_q47/datafusion:parquet 128722152 135558270 0.95
tpcds_q48/datafusion:parquet 71001720 74734258 0.95
tpcds_q49/datafusion:parquet 56349042 59873144 0.94
tpcds_q50/datafusion:parquet 44446731 47130262 0.94
tpcds_q51/datafusion:parquet 87865858 89660443 0.98
tpcds_q52/datafusion:parquet 11879685 12919179 0.92
tpcds_q53/datafusion:parquet 18094807 19406541 0.93
tpcds_q54/datafusion:parquet 35174414 37412040 0.94
tpcds_q55/datafusion:parquet 11557365 12785006 0.90
tpcds_q56/datafusion:parquet 🚀 26716113 30748401 0.87
tpcds_q57/datafusion:parquet 99794864 107475840 0.93
tpcds_q58/datafusion:parquet 🚀 48987364 55126541 0.89
tpcds_q59/datafusion:parquet 58503843 64460431 0.91
tpcds_q60/datafusion:parquet 28182461 29750589 0.95
tpcds_q61/datafusion:parquet 44135310 46046170 0.96
tpcds_q62/datafusion:parquet 🚨 26755236 22757389 1.18
tpcds_q63/datafusion:parquet 18683137 18688618 1.00
tpcds_q64/datafusion:parquet 526293800 569033001 0.92
tpcds_q65/datafusion:parquet 38527573 41988207 0.92
tpcds_q66/datafusion:parquet 67868087 71490411 0.95
tpcds_q67/datafusion:parquet 143425757 155670041 0.92
tpcds_q68/datafusion:parquet 32613645 33696336 0.97
tpcds_q69/datafusion:parquet 69442387 70770056 0.98
tpcds_q70/datafusion:parquet 89923487 93992257 0.96
tpcds_q71/datafusion:parquet 21908832 23896001 0.92
tpcds_q72/datafusion:parquet 639500935 663616576 0.96
tpcds_q73/datafusion:parquet 20919486 21384143 0.98
tpcds_q74/datafusion:parquet 88280123 93791491 0.94
tpcds_q75/datafusion:parquet 102078736 105116676 0.97
tpcds_q76/datafusion:parquet 31938576 33011561 0.97
tpcds_q77/datafusion:parquet 38774048 41964988 0.92
tpcds_q78/datafusion:parquet 115917039 125349901 0.92
tpcds_q79/datafusion:parquet 26394193 28642845 0.92
tpcds_q80/datafusion:parquet 80683963 84785522 0.95
tpcds_q81/datafusion:parquet 31980359 34414232 0.93
tpcds_q82/datafusion:parquet 19981747 21066674 0.95
tpcds_q83/datafusion:parquet 37022767 40488229 0.91
tpcds_q84/datafusion:parquet 40564268 41410418 0.98
tpcds_q85/datafusion:parquet 153950548 161888556 0.95
tpcds_q86/datafusion:parquet 17191606 17033831 1.01
tpcds_q87/datafusion:parquet 42295922 44522470 0.95
tpcds_q88/datafusion:parquet 58870358 63318429 0.93
tpcds_q89/datafusion:parquet 🚀 21518221 24556294 0.88
tpcds_q90/datafusion:parquet 15001595 16165384 0.93
tpcds_q91/datafusion:parquet 59806894 63494567 0.94
tpcds_q92/datafusion:parquet 18318862 19892150 0.92
tpcds_q93/datafusion:parquet 33947537 35881351 0.95
tpcds_q94/datafusion:parquet 🚀 20203850 22833548 0.88
tpcds_q95/datafusion:parquet 62921868 65281025 0.96
tpcds_q96/datafusion:parquet 13339704 14217851 0.94
tpcds_q97/datafusion:parquet 31483906 33600264 0.94
tpcds_q98/datafusion:parquet 22429449 23492859 0.95
tpcds_q99/datafusion:parquet 26995488 28651281 0.94
duckdb / vortex-file-compressed (1.047x ➖, 0↑ 9↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 22454039 21568777 1.04
tpcds_q02/duckdb:vortex-file-compressed 35195169 33543608 1.05
tpcds_q03/duckdb:vortex-file-compressed 32549803 30191857 1.08
tpcds_q04/duckdb:vortex-file-compressed 109721318 104321502 1.05
tpcds_q05/duckdb:vortex-file-compressed 38110979 37159633 1.03
tpcds_q06/duckdb:vortex-file-compressed 32938176 32192409 1.02
tpcds_q07/duckdb:vortex-file-compressed 🚨 23526969 19180867 1.23
tpcds_q08/duckdb:vortex-file-compressed 30352422 28971975 1.05
tpcds_q09/duckdb:vortex-file-compressed 38081576 37488894 1.02
tpcds_q10/duckdb:vortex-file-compressed 41787184 39577782 1.06
tpcds_q11/duckdb:vortex-file-compressed 63089831 60005284 1.05
tpcds_q12/duckdb:vortex-file-compressed 14704754 13740843 1.07
tpcds_q13/duckdb:vortex-file-compressed 34699740 32554531 1.07
tpcds_q14/duckdb:vortex-file-compressed 108824205 103222096 1.05
tpcds_q15/duckdb:vortex-file-compressed 26546615 26704667 0.99
tpcds_q16/duckdb:vortex-file-compressed 27317378 26113992 1.05
tpcds_q17/duckdb:vortex-file-compressed 🚨 46472070 41701488 1.11
tpcds_q18/duckdb:vortex-file-compressed 48409801 45826702 1.06
tpcds_q19/duckdb:vortex-file-compressed 33214583 31491735 1.05
tpcds_q20/duckdb:vortex-file-compressed 15786878 15441142 1.02
tpcds_q21/duckdb:vortex-file-compressed 🚨 18847154 16614294 1.13
tpcds_q22/duckdb:vortex-file-compressed 78823487 73400427 1.07
tpcds_q23/duckdb:vortex-file-compressed 110510896 110365569 1.00
tpcds_q24/duckdb:vortex-file-compressed 50936403 48207830 1.06
tpcds_q25/duckdb:vortex-file-compressed 50670400 49931554 1.01
tpcds_q26/duckdb:vortex-file-compressed 42847485 40217571 1.07
tpcds_q27/duckdb:vortex-file-compressed 49495628 48826098 1.01
tpcds_q28/duckdb:vortex-file-compressed 35724311 34459760 1.04
tpcds_q29/duckdb:vortex-file-compressed 44167786 41730223 1.06
tpcds_q30/duckdb:vortex-file-compressed 23336471 22537040 1.04
tpcds_q31/duckdb:vortex-file-compressed 35409352 33834462 1.05
tpcds_q32/duckdb:vortex-file-compressed 🚨 15422246 14001519 1.10
tpcds_q33/duckdb:vortex-file-compressed 25140444 23308624 1.08
tpcds_q34/duckdb:vortex-file-compressed 24612577 23090996 1.07
tpcds_q35/duckdb:vortex-file-compressed 66190650 64316392 1.03
tpcds_q36/duckdb:vortex-file-compressed 25052189 24650584 1.02
tpcds_q37/duckdb:vortex-file-compressed 16326759 15200717 1.07
tpcds_q38/duckdb:vortex-file-compressed 🚨 40810396 35828437 1.14
tpcds_q39/duckdb:vortex-file-compressed 35256719 34998500 1.01
tpcds_q40/duckdb:vortex-file-compressed 20136743 19030676 1.06
tpcds_q41/duckdb:vortex-file-compressed 13844518 13119204 1.06
tpcds_q42/duckdb:vortex-file-compressed 🚨 13077031 11735884 1.11
tpcds_q43/duckdb:vortex-file-compressed 22912273 23281512 0.98
tpcds_q44/duckdb:vortex-file-compressed 🚨 21926980 19775065 1.11
tpcds_q45/duckdb:vortex-file-compressed 28926080 28876838 1.00
tpcds_q46/duckdb:vortex-file-compressed 51914057 51077222 1.02
tpcds_q47/duckdb:vortex-file-compressed 49462022 46964763 1.05
tpcds_q48/duckdb:vortex-file-compressed 31893663 29024794 1.10
tpcds_q49/duckdb:vortex-file-compressed 33380218 33623318 0.99
tpcds_q50/duckdb:vortex-file-compressed 34821866 33496219 1.04
tpcds_q51/duckdb:vortex-file-compressed 101064477 97954046 1.03
tpcds_q52/duckdb:vortex-file-compressed 12669551 12236213 1.04
tpcds_q53/duckdb:vortex-file-compressed 23739031 22190459 1.07
tpcds_q54/duckdb:vortex-file-compressed 28767113 27651540 1.04
tpcds_q55/duckdb:vortex-file-compressed 13383402 12700718 1.05
tpcds_q56/duckdb:vortex-file-compressed 24698320 23972719 1.03
tpcds_q57/duckdb:vortex-file-compressed 40674875 38680500 1.05
tpcds_q58/duckdb:vortex-file-compressed 32209412 30102402 1.07
tpcds_q59/duckdb:vortex-file-compressed 66956013 69802912 0.96
tpcds_q60/duckdb:vortex-file-compressed 25701543 24749392 1.04
tpcds_q61/duckdb:vortex-file-compressed 🚨 35889047 31308436 1.15
tpcds_q62/duckdb:vortex-file-compressed 18146651 17357932 1.05
tpcds_q63/duckdb:vortex-file-compressed 22300507 21221968 1.05
tpcds_q64/duckdb:vortex-file-compressed 85848261 83388491 1.03
tpcds_q65/duckdb:vortex-file-compressed 22773521 21438586 1.06
tpcds_q66/duckdb:vortex-file-compressed 30527155 29136939 1.05
tpcds_q67/duckdb:vortex-file-compressed 144491707 141308248 1.02
tpcds_q68/duckdb:vortex-file-compressed 43118471 41135731 1.05
tpcds_q69/duckdb:vortex-file-compressed 43838730 40687437 1.08
tpcds_q70/duckdb:vortex-file-compressed 26591737 24805732 1.07
tpcds_q71/duckdb:vortex-file-compressed 21651053 19910697 1.09
tpcds_q72/duckdb:vortex-file-compressed 175291129 172801127 1.01
tpcds_q73/duckdb:vortex-file-compressed 22637141 23159481 0.98
tpcds_q74/duckdb:vortex-file-compressed 77343716 72712268 1.06
tpcds_q75/duckdb:vortex-file-compressed 59918028 57031786 1.05
tpcds_q76/duckdb:vortex-file-compressed 19365891 17814050 1.09
tpcds_q77/duckdb:vortex-file-compressed 25837181 25545586 1.01
tpcds_q78/duckdb:vortex-file-compressed 75007347 74323602 1.01
tpcds_q79/duckdb:vortex-file-compressed 35539262 33240161 1.07
tpcds_q80/duckdb:vortex-file-compressed 48153994 47576653 1.01
tpcds_q81/duckdb:vortex-file-compressed 28872122 27660069 1.04
tpcds_q82/duckdb:vortex-file-compressed 17180768 16032410 1.07
tpcds_q83/duckdb:vortex-file-compressed 24587437 23628939 1.04
tpcds_q84/duckdb:vortex-file-compressed 20615262 19707918 1.05
tpcds_q85/duckdb:vortex-file-compressed 46107569 44764681 1.03
tpcds_q86/duckdb:vortex-file-compressed 16616051 17083397 0.97
tpcds_q87/duckdb:vortex-file-compressed 41570994 40328726 1.03
tpcds_q88/duckdb:vortex-file-compressed 34135085 33407687 1.02
tpcds_q89/duckdb:vortex-file-compressed 23380069 22329205 1.05
tpcds_q90/duckdb:vortex-file-compressed 12854900 12441657 1.03
tpcds_q91/duckdb:vortex-file-compressed 30876250 30098469 1.03
tpcds_q92/duckdb:vortex-file-compressed 22102894 20975495 1.05
tpcds_q93/duckdb:vortex-file-compressed 🚨 28706630 26066280 1.10
tpcds_q94/duckdb:vortex-file-compressed 23577696 22352994 1.05
tpcds_q95/duckdb:vortex-file-compressed 153414587 151057039 1.02
tpcds_q96/duckdb:vortex-file-compressed 13693864 13275890 1.03
tpcds_q97/duckdb:vortex-file-compressed 37265915 37999648 0.98
tpcds_q98/duckdb:vortex-file-compressed 18119114 17722569 1.02
tpcds_q99/duckdb:vortex-file-compressed 29510238 27964880 1.06
duckdb / vortex-compact (1.027x ➖, 1↑ 5↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 23868623 23234552 1.03
tpcds_q02/duckdb:vortex-compact 45990549 43779619 1.05
tpcds_q03/duckdb:vortex-compact 59032824 56083763 1.05
tpcds_q04/duckdb:vortex-compact 126573661 116508868 1.09
tpcds_q05/duckdb:vortex-compact 53220148 51315111 1.04
tpcds_q06/duckdb:vortex-compact 41824889 40483865 1.03
tpcds_q07/duckdb:vortex-compact 35271890 33544367 1.05
tpcds_q08/duckdb:vortex-compact 47282434 43625707 1.08
tpcds_q09/duckdb:vortex-compact 59041195 57617732 1.02
tpcds_q10/duckdb:vortex-compact 61512870 59184254 1.04
tpcds_q11/duckdb:vortex-compact 71826622 73007990 0.98
tpcds_q12/duckdb:vortex-compact 23309469 23182707 1.01
tpcds_q13/duckdb:vortex-compact 57123341 57250886 1.00
tpcds_q14/duckdb:vortex-compact 136733248 131996308 1.04
tpcds_q15/duckdb:vortex-compact 33478270 30959635 1.08
tpcds_q16/duckdb:vortex-compact 31568994 30406151 1.04
tpcds_q17/duckdb:vortex-compact 57106083 54111500 1.06
tpcds_q18/duckdb:vortex-compact 59250028 56107792 1.06
tpcds_q19/duckdb:vortex-compact 51771109 50416146 1.03
tpcds_q20/duckdb:vortex-compact 20346542 20110738 1.01
tpcds_q21/duckdb:vortex-compact 18967904 19877938 0.95
tpcds_q22/duckdb:vortex-compact 76688066 74537445 1.03
tpcds_q23/duckdb:vortex-compact 🚀 119189781 141055434 0.84
tpcds_q24/duckdb:vortex-compact 61985106 62963292 0.98
tpcds_q25/duckdb:vortex-compact 84000344 80105050 1.05
tpcds_q26/duckdb:vortex-compact 52982363 53357602 0.99
tpcds_q27/duckdb:vortex-compact 70031019 69029809 1.01
tpcds_q28/duckdb:vortex-compact 86186028 85245797 1.01
tpcds_q29/duckdb:vortex-compact 54350265 53723669 1.01
tpcds_q30/duckdb:vortex-compact 🚨 31218699 27983483 1.12
tpcds_q31/duckdb:vortex-compact 46581254 45999727 1.01
tpcds_q32/duckdb:vortex-compact 23630130 22357703 1.06
tpcds_q33/duckdb:vortex-compact 36186128 33987414 1.06
tpcds_q34/duckdb:vortex-compact 39367460 38356950 1.03
tpcds_q35/duckdb:vortex-compact 83818985 80644593 1.04
tpcds_q36/duckdb:vortex-compact 41630256 41278246 1.01
tpcds_q37/duckdb:vortex-compact 24174204 24046779 1.01
tpcds_q38/duckdb:vortex-compact 47955128 47650102 1.01
tpcds_q39/duckdb:vortex-compact 36498046 36889769 0.99
tpcds_q40/duckdb:vortex-compact 26662777 25798620 1.03
tpcds_q41/duckdb:vortex-compact 16498817 15779492 1.05
tpcds_q42/duckdb:vortex-compact 23180413 22041866 1.05
tpcds_q43/duckdb:vortex-compact 35525776 34921479 1.02
tpcds_q44/duckdb:vortex-compact 🚨 31087880 28212313 1.10
tpcds_q45/duckdb:vortex-compact 39209472 37246724 1.05
tpcds_q46/duckdb:vortex-compact 72931666 68819690 1.06
tpcds_q47/duckdb:vortex-compact 62259835 61564577 1.01
tpcds_q48/duckdb:vortex-compact 50751123 51556811 0.98
tpcds_q49/duckdb:vortex-compact 57949831 54295024 1.07
tpcds_q50/duckdb:vortex-compact 47663630 45854012 1.04
tpcds_q51/duckdb:vortex-compact 109440435 110223450 0.99
tpcds_q52/duckdb:vortex-compact 22415317 20968022 1.07
tpcds_q53/duckdb:vortex-compact 38578597 38046939 1.01
tpcds_q54/duckdb:vortex-compact 39994877 41665135 0.96
tpcds_q55/duckdb:vortex-compact 23186801 22702918 1.02
tpcds_q56/duckdb:vortex-compact 🚨 37873218 33453816 1.13
tpcds_q57/duckdb:vortex-compact 44126056 44381319 0.99
tpcds_q58/duckdb:vortex-compact 38801479 41744405 0.93
tpcds_q59/duckdb:vortex-compact 87339266 89254749 0.98
tpcds_q60/duckdb:vortex-compact 38968496 37126165 1.05
tpcds_q61/duckdb:vortex-compact 64665423 60966576 1.06
tpcds_q62/duckdb:vortex-compact 27258682 26542450 1.03
tpcds_q63/duckdb:vortex-compact 37001652 36603074 1.01
tpcds_q64/duckdb:vortex-compact 118487087 115569736 1.03
tpcds_q65/duckdb:vortex-compact 33461622 33331648 1.00
tpcds_q66/duckdb:vortex-compact 38959016 38201714 1.02
tpcds_q67/duckdb:vortex-compact 158251867 151893146 1.04
tpcds_q68/duckdb:vortex-compact 63371189 63012908 1.01
tpcds_q69/duckdb:vortex-compact 61906110 62006219 1.00
tpcds_q70/duckdb:vortex-compact 36522099 35948366 1.02
tpcds_q71/duckdb:vortex-compact 34287022 34169262 1.00
tpcds_q72/duckdb:vortex-compact 195919801 194564246 1.01
tpcds_q73/duckdb:vortex-compact 37663994 38698657 0.97
tpcds_q74/duckdb:vortex-compact 82968047 86650742 0.96
tpcds_q75/duckdb:vortex-compact 74286034 72086491 1.03
tpcds_q76/duckdb:vortex-compact 35517359 33433773 1.06
tpcds_q77/duckdb:vortex-compact 44136455 41118809 1.07
tpcds_q78/duckdb:vortex-compact 88889331 88107902 1.01
tpcds_q79/duckdb:vortex-compact 52802655 52759068 1.00
tpcds_q80/duckdb:vortex-compact 78757573 79490035 0.99
tpcds_q81/duckdb:vortex-compact 34312039 34030830 1.01
tpcds_q82/duckdb:vortex-compact 🚨 27257619 24679000 1.10
tpcds_q83/duckdb:vortex-compact 🚨 34519097 31075845 1.11
tpcds_q84/duckdb:vortex-compact 27442157 26945814 1.02
tpcds_q85/duckdb:vortex-compact 61169161 56467181 1.08
tpcds_q86/duckdb:vortex-compact 23873657 22324644 1.07
tpcds_q87/duckdb:vortex-compact 52522854 50637609 1.04
tpcds_q88/duckdb:vortex-compact 40910746 39518352 1.04
tpcds_q89/duckdb:vortex-compact 37415700 36657096 1.02
tpcds_q90/duckdb:vortex-compact 16295396 15216327 1.07
tpcds_q91/duckdb:vortex-compact 51928056 50136589 1.04
tpcds_q92/duckdb:vortex-compact 46856352 44865708 1.04
tpcds_q93/duckdb:vortex-compact 33206839 31322436 1.06
tpcds_q94/duckdb:vortex-compact 34218959 33041460 1.04
tpcds_q95/duckdb:vortex-compact 164993386 161971037 1.02
tpcds_q96/duckdb:vortex-compact 18077264 17709106 1.02
tpcds_q97/duckdb:vortex-compact 44999711 41715119 1.08
tpcds_q98/duckdb:vortex-compact 28851229 28132794 1.03
tpcds_q99/duckdb:vortex-compact 32106344 31943024 1.01
duckdb / parquet (1.010x ➖, 0↑ 2↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29015021 29378897 0.99
tpcds_q02/duckdb:parquet 22743850 23400076 0.97
tpcds_q03/duckdb:parquet 11512167 11853358 0.97
tpcds_q04/duckdb:parquet 169876547 168599257 1.01
tpcds_q05/duckdb:parquet 30421705 30393092 1.00
tpcds_q06/duckdb:parquet 27211353 27443866 0.99
tpcds_q07/duckdb:parquet 21160238 20822847 1.02
tpcds_q08/duckdb:parquet 26974093 27457834 0.98
tpcds_q09/duckdb:parquet 39151462 39374415 0.99
tpcds_q10/duckdb:parquet 32408764 32855148 0.99
tpcds_q11/duckdb:parquet 90042097 85621023 1.05
tpcds_q12/duckdb:parquet 14335480 14090738 1.02
tpcds_q13/duckdb:parquet 33653249 32283891 1.04
tpcds_q14/duckdb:parquet 101253938 97743885 1.04
tpcds_q15/duckdb:parquet 31006389 30590621 1.01
tpcds_q16/duckdb:parquet 21050924 22101666 0.95
tpcds_q17/duckdb:parquet 35951420 37445723 0.96
tpcds_q18/duckdb:parquet 45285785 46216794 0.98
tpcds_q19/duckdb:parquet 30167745 28969505 1.04
tpcds_q20/duckdb:parquet 15798882 16274498 0.97
tpcds_q21/duckdb:parquet 10091147 10378916 0.97
tpcds_q22/duckdb:parquet 70915517 68446448 1.04
tpcds_q23/duckdb:parquet 80628866 81484934 0.99
tpcds_q24/duckdb:parquet 45253481 42396590 1.07
tpcds_q25/duckdb:parquet 33016739 32690198 1.01
tpcds_q26/duckdb:parquet 37092310 36185493 1.03
tpcds_q27/duckdb:parquet 48819135 47652714 1.02
tpcds_q28/duckdb:parquet 37963358 37793577 1.00
tpcds_q29/duckdb:parquet 36672852 36398042 1.01
tpcds_q30/duckdb:parquet 35518913 33139743 1.07
tpcds_q31/duckdb:parquet 23410837 23211079 1.01
tpcds_q32/duckdb:parquet 12070756 11411224 1.06
tpcds_q33/duckdb:parquet 20944548 21021878 1.00
tpcds_q34/duckdb:parquet 20729585 20418925 1.02
tpcds_q35/duckdb:parquet 57271906 58797939 0.97
tpcds_q36/duckdb:parquet 20047643 19482176 1.03
tpcds_q37/duckdb:parquet 12138598 12824618 0.95
tpcds_q38/duckdb:parquet 33969160 33256219 1.02
tpcds_q39/duckdb:parquet 28534347 29575023 0.96
tpcds_q40/duckdb:parquet 18341409 17195068 1.07
tpcds_q41/duckdb:parquet 7570113 7501547 1.01
tpcds_q42/duckdb:parquet 9523325 9560258 1.00
tpcds_q43/duckdb:parquet 15172088 15193712 1.00
tpcds_q44/duckdb:parquet 21718421 21603689 1.01
tpcds_q45/duckdb:parquet 25908030 27072697 0.96
tpcds_q46/duckdb:parquet 45676004 45509063 1.00
tpcds_q47/duckdb:parquet 43887080 42447032 1.03
tpcds_q48/duckdb:parquet 31087750 30716944 1.01
tpcds_q49/duckdb:parquet 24373203 24069049 1.01
tpcds_q50/duckdb:parquet 24380862 23790737 1.02
tpcds_q51/duckdb:parquet 95274587 93432457 1.02
tpcds_q52/duckdb:parquet 10602401 10948491 0.97
tpcds_q53/duckdb:parquet 15083807 14847145 1.02
tpcds_q54/duckdb:parquet 24908290 24723098 1.01
tpcds_q55/duckdb:parquet 10247757 10045388 1.02
tpcds_q56/duckdb:parquet 20928289 20411964 1.03
tpcds_q57/duckdb:parquet 34341684 34922901 0.98
tpcds_q58/duckdb:parquet 23538898 22052226 1.07
tpcds_q59/duckdb:parquet 35835224 35123453 1.02
tpcds_q60/duckdb:parquet 21700951 21113090 1.03
tpcds_q61/duckdb:parquet 32446657 30828311 1.05
tpcds_q62/duckdb:parquet 11952289 11540560 1.04
tpcds_q63/duckdb:parquet 14241118 13839701 1.03
tpcds_q64/duckdb:parquet 73857430 72691861 1.02
tpcds_q65/duckdb:parquet 19949753 19583739 1.02
tpcds_q66/duckdb:parquet 28237927 29127828 0.97
tpcds_q67/duckdb:parquet 136681052 135320748 1.01
tpcds_q68/duckdb:parquet 36576652 36657749 1.00
tpcds_q69/duckdb:parquet 36057304 35711203 1.01
tpcds_q70/duckdb:parquet 19280875 19076002 1.01
tpcds_q71/duckdb:parquet 19936578 19990546 1.00
tpcds_q72/duckdb:parquet 165189985 165478568 1.00
tpcds_q73/duckdb:parquet 17794385 17435231 1.02
tpcds_q74/duckdb:parquet 130277231 128120216 1.02
tpcds_q75/duckdb:parquet 53865773 53405527 1.01
tpcds_q76/duckdb:parquet 19587490 19989621 0.98
tpcds_q77/duckdb:parquet 22592442 21836150 1.03
tpcds_q78/duckdb:parquet 74554533 75023334 0.99
tpcds_q79/duckdb:parquet 28061724 26895201 1.04
tpcds_q80/duckdb:parquet 39875117 40018438 1.00
tpcds_q81/duckdb:parquet 30592454 29875477 1.02
tpcds_q82/duckdb:parquet 13652145 14665873 0.93
tpcds_q83/duckdb:parquet 16383721 16247622 1.01
tpcds_q84/duckdb:parquet 19666118 18926530 1.04
tpcds_q85/duckdb:parquet 39799556 37468564 1.06
tpcds_q86/duckdb:parquet 12171455 12978209 0.94
tpcds_q87/duckdb:parquet 36273917 37583692 0.97
tpcds_q88/duckdb:parquet 48995424 48420376 1.01
tpcds_q89/duckdb:parquet 16179598 17196962 0.94
tpcds_q90/duckdb:parquet 7614598 7386145 1.03
tpcds_q91/duckdb:parquet 23489995 22392323 1.05
tpcds_q92/duckdb:parquet 11427672 11726155 0.97
tpcds_q93/duckdb:parquet 30101390 29395515 1.02
tpcds_q94/duckdb:parquet 15916546 15601341 1.02
tpcds_q95/duckdb:parquet 🚨 133269696 116850070 1.14
tpcds_q96/duckdb:parquet 🚨 9458769 8552312 1.11
tpcds_q97/duckdb:parquet 34757349 35134209 0.99
tpcds_q98/duckdb:parquet 18183134 17419626 1.04
tpcds_q99/duckdb:parquet 19386046 19201934 1.01
duckdb / duckdb (1.014x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 21092704 20378112 1.04
tpcds_q02/duckdb:duckdb 18710541 18813328 0.99
tpcds_q03/duckdb:duckdb 8795687 8734129 1.01
tpcds_q04/duckdb:duckdb 178121521 176825979 1.01
tpcds_q05/duckdb:duckdb 19636411 20273503 0.97
tpcds_q06/duckdb:duckdb 23323766 24636846 0.95
tpcds_q07/duckdb:duckdb 40789867 38921343 1.05
tpcds_q08/duckdb:duckdb 120906894 120620220 1.00
tpcds_q09/duckdb:duckdb 20016307 19752413 1.01
tpcds_q10/duckdb:duckdb 25150232 23989287 1.05
tpcds_q11/duckdb:duckdb 91140788 91104717 1.00
tpcds_q12/duckdb:duckdb 11654991 11530103 1.01
tpcds_q13/duckdb:duckdb 23877779 23887108 1.00
tpcds_q14/duckdb:duckdb 92966205 92346296 1.01
tpcds_q15/duckdb:duckdb 25430295 24793678 1.03
tpcds_q16/duckdb:duckdb 18680041 18854883 0.99
tpcds_q17/duckdb:duckdb 22049852 21320742 1.03
tpcds_q18/duckdb:duckdb 44364568 41877361 1.06
tpcds_q19/duckdb:duckdb 16824816 16994662 0.99
tpcds_q20/duckdb:duckdb 12261665 11639704 1.05
tpcds_q21/duckdb:duckdb 6907154 7064103 0.98
tpcds_q22/duckdb:duckdb 62933304 60647403 1.04
tpcds_q23/duckdb:duckdb 76152283 77068344 0.99
tpcds_q24/duckdb:duckdb 24990095 24647506 1.01
tpcds_q25/duckdb:duckdb 18323657 17193735 1.07
tpcds_q26/duckdb:duckdb 27269999 26637204 1.02
tpcds_q27/duckdb:duckdb 40311797 39211310 1.03
tpcds_q28/duckdb:duckdb 21797475 21972921 0.99
tpcds_q29/duckdb:duckdb 22383758 20438296 1.10
tpcds_q30/duckdb:duckdb 29172323 29422627 0.99
tpcds_q31/duckdb:duckdb 50135301 46936527 1.07
tpcds_q32/duckdb:duckdb 7419273 7668069 0.97
tpcds_q33/duckdb:duckdb 13476487 12627369 1.07
tpcds_q34/duckdb:duckdb 15513973 15063089 1.03
tpcds_q35/duckdb:duckdb 32612454 33817267 0.96
tpcds_q36/duckdb:duckdb 70374506 68280135 1.03
tpcds_q37/duckdb:duckdb 8137463 7769114 1.05
tpcds_q38/duckdb:duckdb 31339411 31930154 0.98
tpcds_q39/duckdb:duckdb 26180889 25137798 1.04
tpcds_q40/duckdb:duckdb 13136704 14421581 0.91
tpcds_q41/duckdb:duckdb 8563306 8139488 1.05
tpcds_q42/duckdb:duckdb 6499260 6573357 0.99
tpcds_q43/duckdb:duckdb 11814007 11859471 1.00
tpcds_q44/duckdb:duckdb 14443518 13847700 1.04
tpcds_q45/duckdb:duckdb 17945788 18023855 1.00
tpcds_q46/duckdb:duckdb 36629373 37829104 0.97
tpcds_q47/duckdb:duckdb 40927049 40736743 1.00
tpcds_q48/duckdb:duckdb 23980416 23235044 1.03
tpcds_q49/duckdb:duckdb 18727561 17488573 1.07
tpcds_q50/duckdb:duckdb 14506678 14615448 0.99
tpcds_q51/duckdb:duckdb 91423133 92349997 0.99
tpcds_q52/duckdb:duckdb 7246962 7376823 0.98
tpcds_q53/duckdb:duckdb 13343513 14501818 0.92
tpcds_q54/duckdb:duckdb 17269313 17745123 0.97
tpcds_q55/duckdb:duckdb 7215611 7601920 0.95
tpcds_q56/duckdb:duckdb 14878775 14018020 1.06
tpcds_q57/duckdb:duckdb 31933824 32851532 0.97
tpcds_q58/duckdb:duckdb 13259699 12455964 1.06
tpcds_q59/duckdb:duckdb 35870526 35884243 1.00
tpcds_q60/duckdb:duckdb 15276261 14673771 1.04
tpcds_q61/duckdb:duckdb 14773564 15579916 0.95
tpcds_q62/duckdb:duckdb 9640861 9495637 1.02
tpcds_q63/duckdb:duckdb 12622966 12639305 1.00
tpcds_q64/duckdb:duckdb 55873316 56259306 0.99
tpcds_q65/duckdb:duckdb 33174104 33892360 0.98
tpcds_q66/duckdb:duckdb 26455902 25806596 1.03
tpcds_q67/duckdb:duckdb 131276151 128967984 1.02
tpcds_q68/duckdb:duckdb 26269985 25640520 1.02
tpcds_q69/duckdb:duckdb 25761054 24392122 1.06
tpcds_q70/duckdb:duckdb 14763277 14495675 1.02
tpcds_q71/duckdb:duckdb 13247551 12885136 1.03
tpcds_q72/duckdb:duckdb 43687408 44249236 0.99
tpcds_q73/duckdb:duckdb 11547138 11241131 1.03
tpcds_q74/duckdb:duckdb 145611531 145639739 1.00
tpcds_q75/duckdb:duckdb 43922083 42995165 1.02
tpcds_q76/duckdb:duckdb 12453423 12794206 0.97
tpcds_q77/duckdb:duckdb 12906964 12170634 1.06
tpcds_q78/duckdb:duckdb 64836448 62401248 1.04
tpcds_q79/duckdb:duckdb 19204717 18855481 1.02
tpcds_q80/duckdb:duckdb 26877245 27334594 0.98
tpcds_q81/duckdb:duckdb 38371897 38277747 1.00
tpcds_q82/duckdb:duckdb 8818623 8561033 1.03
tpcds_q83/duckdb:duckdb 10459381 9590608 1.09
tpcds_q84/duckdb:duckdb 14163236 14186083 1.00
tpcds_q85/duckdb:duckdb 24729145 23314968 1.06
tpcds_q86/duckdb:duckdb 10733748 10597266 1.01
tpcds_q87/duckdb:duckdb 35632404 33994885 1.05
tpcds_q88/duckdb:duckdb 26317180 26103858 1.01
tpcds_q89/duckdb:duckdb 14895572 14577657 1.02
tpcds_q90/duckdb:duckdb 5881625 5787130 1.02
tpcds_q91/duckdb:duckdb 13424466 13605778 0.99
tpcds_q92/duckdb:duckdb 9132321 8783592 1.04
tpcds_q93/duckdb:duckdb 21967425 21614697 1.02
tpcds_q94/duckdb:duckdb 13468154 13432521 1.00
tpcds_q95/duckdb:duckdb 🚨 129342049 105653554 1.22
tpcds_q96/duckdb:duckdb 4725277 4777307 0.99
tpcds_q97/duckdb:duckdb 29522884 30264508 0.98
tpcds_q98/duckdb:duckdb 14251992 13580301 1.05
tpcds_q99/duckdb:duckdb 17332565 16888530 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.9% -6.3% -1.7% +20.6% ➖ noise
1 datafusion:vortex-file-compressed -12.5% -6.3% -6.6% +21.0% ➖ noise
1 duckdb:duckdb +3.5% -6.3% +10.4% +22.2% ➖ noise
1 duckdb:vortex-compact +2.7% -6.3% +9.6% +22.4% ➖ noise
1 duckdb:vortex-file-compressed +4.1% -6.3% +11.1% +29.7% ➖ noise
2 datafusion:vortex-compact -3.7% -4.0% +0.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -5.4% -4.0% -1.5% +10.0% ➖ noise
2 duckdb:duckdb -0.5% -4.0% +3.6% +10.0% ➖ noise
2 duckdb:vortex-compact +5.1% -4.0% +9.4% +10.3% ➖ noise
2 duckdb:vortex-file-compressed +4.9% -4.0% +9.3% +24.1% ➖ noise
3 datafusion:vortex-compact -8.6% -3.0% -5.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -10.9% -3.0% -8.2% +10.0% ➖ noise
3 duckdb:duckdb +0.7% -3.0% +3.8% +18.4% ➖ noise
3 duckdb:vortex-compact +5.3% -3.0% +8.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +7.8% -3.0% +11.1% +10.0% 🚨 regression
4 datafusion:vortex-compact -6.1% -4.2% -2.0% +11.4% ➖ noise
4 datafusion:vortex-file-compressed -6.1% -4.2% -2.0% +10.0% ➖ noise
4 duckdb:duckdb +0.7% -4.2% +5.2% +10.0% ➖ noise
4 duckdb:vortex-compact +8.6% -4.2% +13.5% +12.0% 🚨 regression
4 duckdb:vortex-file-compressed +5.2% -4.2% +9.8% +13.1% ➖ noise
5 datafusion:vortex-compact -6.6% +2.1% -8.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -7.6% +2.1% -9.5% +10.0% ✅ faster
5 duckdb:duckdb -3.1% +2.1% -5.2% +13.6% ➖ noise
5 duckdb:vortex-compact +3.7% +2.1% +1.5% +11.3% ➖ noise
5 duckdb:vortex-file-compressed +2.6% +2.1% +0.4% +11.0% ➖ noise
6 datafusion:vortex-compact -4.5% +1.8% -6.2% +15.5% ➖ noise
6 datafusion:vortex-file-compressed -0.6% +1.8% -2.4% +10.3% ➖ noise
6 duckdb:duckdb -5.3% +1.8% -7.0% +14.8% ➖ noise
6 duckdb:vortex-compact +3.3% +1.8% +1.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.3% +1.8% +0.5% +10.0% ➖ noise
7 datafusion:vortex-compact -7.0% +0.0% -7.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -12.4% +0.0% -12.5% +10.0% ✅ faster
7 duckdb:duckdb +4.8% +0.0% +4.8% +21.1% ➖ noise
7 duckdb:vortex-compact +5.1% +0.0% +5.1% +10.1% ➖ noise
7 duckdb:vortex-file-compressed +22.7% +0.0% +22.6% +16.1% 🚨 regression
8 datafusion:vortex-compact -7.7% -0.2% -7.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.5% -0.2% -1.4% +12.2% ➖ noise
8 duckdb:duckdb +0.2% -0.2% +0.4% +10.0% ➖ noise
8 duckdb:vortex-compact +8.4% -0.2% +8.6% +11.9% ➖ noise
8 duckdb:vortex-file-compressed +4.8% -0.2% +5.0% +17.3% ➖ noise
9 datafusion:vortex-compact -5.3% +0.5% -5.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -3.4% +0.5% -3.8% +10.0% ➖ noise
9 duckdb:duckdb +1.3% +0.5% +0.9% +10.0% ➖ noise
9 duckdb:vortex-compact +2.5% +0.5% +2.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.6% +0.5% +1.1% +10.0% ➖ noise
10 datafusion:vortex-compact -6.7% -0.7% -6.1% +12.9% ➖ noise
10 datafusion:vortex-file-compressed -6.0% -0.7% -5.4% +12.8% ➖ noise
10 duckdb:duckdb +4.8% -0.7% +5.5% +10.2% ➖ noise
10 duckdb:vortex-compact +3.9% -0.7% +4.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +5.6% -0.7% +6.3% +10.0% ➖ noise
11 datafusion:vortex-compact -6.0% -2.9% -3.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -6.0% -2.9% -3.2% +10.3% ➖ noise
11 duckdb:duckdb +0.0% -2.9% +3.1% +10.4% ➖ noise
11 duckdb:vortex-compact -1.6% -2.9% +1.4% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +5.1% -2.9% +8.3% +11.8% ➖ noise
12 datafusion:vortex-compact -5.1% -5.9% +0.9% +20.1% ➖ noise
12 datafusion:vortex-file-compressed -8.9% -5.9% -3.1% +13.5% ➖ noise
12 duckdb:duckdb +1.1% -5.9% +7.5% +13.2% ➖ noise
12 duckdb:vortex-compact +0.5% -5.9% +6.9% +13.6% ➖ noise
12 duckdb:vortex-file-compressed +7.0% -5.9% +13.8% +11.3% 🚨 regression
13 datafusion:vortex-compact -4.3% -1.0% -3.3% +18.8% ➖ noise
13 datafusion:vortex-file-compressed -5.2% -1.0% -4.2% +10.9% ➖ noise
13 duckdb:duckdb -0.0% -1.0% +1.0% +10.2% ➖ noise
13 duckdb:vortex-compact -0.2% -1.0% +0.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +6.6% -1.0% +7.7% +14.2% ➖ noise
14 datafusion:vortex-compact -6.5% -2.4% -4.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -7.3% -2.4% -5.0% +10.0% ➖ noise
14 duckdb:duckdb +0.7% -2.4% +3.1% +10.0% ➖ noise
14 duckdb:vortex-compact +3.6% -2.4% +6.1% +13.9% ➖ noise
14 duckdb:vortex-file-compressed +5.4% -2.4% +8.0% +10.0% ➖ noise
15 datafusion:vortex-compact -12.3% -4.5% -8.2% +23.9% ➖ noise
15 datafusion:vortex-file-compressed -4.6% -4.5% -0.1% +10.0% ➖ noise
15 duckdb:duckdb +2.6% -4.5% +7.4% +12.9% ➖ noise
15 duckdb:vortex-compact +8.1% -4.5% +13.2% +12.2% 🚨 regression
15 duckdb:vortex-file-compressed -0.6% -4.5% +4.0% +10.0% ➖ noise
16 datafusion:vortex-compact -7.9% -4.8% -3.3% +20.2% ➖ noise
16 datafusion:vortex-file-compressed -9.1% -4.8% -4.5% +14.7% ➖ noise
16 duckdb:duckdb -0.9% -4.8% +4.1% +19.9% ➖ noise
16 duckdb:vortex-compact +3.8% -4.8% +9.1% +13.1% ➖ noise
16 duckdb:vortex-file-compressed +4.6% -4.8% +9.9% +11.5% ➖ noise
17 datafusion:vortex-compact -4.9% -5.7% +0.8% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -9.8% -5.7% -4.4% +10.6% ➖ noise
17 duckdb:duckdb +3.4% -5.7% +9.6% +10.5% ➖ noise
17 duckdb:vortex-compact +5.5% -5.7% +11.9% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed +11.4% -5.7% +18.1% +13.9% 🚨 regression
18 datafusion:vortex-compact -8.0% -2.6% -5.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -8.3% -2.6% -5.9% +11.4% ➖ noise
18 duckdb:duckdb +5.9% -2.6% +8.7% +10.0% ➖ noise
18 duckdb:vortex-compact +5.6% -2.6% +8.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +5.6% -2.6% +8.4% +10.0% ➖ noise
19 datafusion:vortex-compact -11.1% -1.1% -10.1% +10.0% ✅ faster
19 datafusion:vortex-file-compressed -8.0% -1.1% -7.0% +10.0% ➖ noise
19 duckdb:duckdb -1.0% -1.1% +0.1% +10.7% ➖ noise
19 duckdb:vortex-compact +2.7% -1.1% +3.9% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +5.5% -1.1% +6.7% +10.7% ➖ noise
20 datafusion:vortex-compact +1.0% -4.3% +5.5% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -10.0% -4.3% -5.9% +10.0% ➖ noise
20 duckdb:duckdb +5.3% -4.3% +10.1% +11.7% ➖ noise
20 duckdb:vortex-compact +1.2% -4.3% +5.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +2.2% -4.3% +6.8% +11.4% ➖ noise
21 datafusion:vortex-compact -6.7% -2.7% -4.2% +11.7% ➖ noise
21 datafusion:vortex-file-compressed -9.3% -2.7% -6.8% +10.2% ➖ noise
21 duckdb:duckdb -2.2% -2.7% +0.5% +19.2% ➖ noise
21 duckdb:vortex-compact -4.6% -2.7% -1.9% +14.7% ➖ noise
21 duckdb:vortex-file-compressed +13.4% -2.7% +16.6% +18.3% ➖ noise
22 datafusion:vortex-compact -14.2% -2.7% -11.8% +23.2% ➖ noise
22 datafusion:vortex-file-compressed -9.2% -2.7% -6.7% +25.6% ➖ noise
22 duckdb:duckdb +3.8% -2.7% +6.6% +10.2% ➖ noise
22 duckdb:vortex-compact +2.9% -2.7% +5.7% +11.9% ➖ noise
22 duckdb:vortex-file-compressed +7.4% -2.7% +10.4% +12.4% ➖ noise
23 datafusion:vortex-compact -9.3% -3.3% -6.3% +10.3% ➖ noise
23 datafusion:vortex-file-compressed -7.8% -3.3% -4.7% +10.0% ➖ noise
23 duckdb:duckdb -1.2% -3.3% +2.2% +11.4% ➖ noise
23 duckdb:vortex-compact -15.5% -3.3% -12.6% +20.2% ➖ noise
23 duckdb:vortex-file-compressed +0.1% -3.3% +3.5% +10.0% ➖ noise
24 datafusion:vortex-compact -7.1% +1.4% -8.4% +11.7% ➖ noise
24 datafusion:vortex-file-compressed -8.2% +1.4% -9.4% +10.2% ✅ faster
24 duckdb:duckdb +1.4% +1.4% -0.0% +10.3% ➖ noise
24 duckdb:vortex-compact -1.6% +1.4% -2.9% +18.0% ➖ noise
24 duckdb:vortex-file-compressed +5.7% +1.4% +4.2% +10.0% ➖ noise
25 datafusion:vortex-compact -9.2% -2.4% -7.0% +11.6% ➖ noise
25 datafusion:vortex-file-compressed -8.1% -2.4% -5.8% +13.6% ➖ noise
25 duckdb:duckdb +6.6% -2.4% +9.2% +10.8% ➖ noise
25 duckdb:vortex-compact +4.9% -2.4% +7.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +1.5% -2.4% +4.0% +10.0% ➖ noise
26 datafusion:vortex-compact -4.0% -2.0% -2.0% +16.0% ➖ noise
26 datafusion:vortex-file-compressed -5.7% -2.0% -3.8% +10.1% ➖ noise
26 duckdb:duckdb +2.4% -2.0% +4.5% +14.2% ➖ noise
26 duckdb:vortex-compact -0.7% -2.0% +1.4% +12.0% ➖ noise
26 duckdb:vortex-file-compressed +6.5% -2.0% +8.8% +15.9% ➖ noise
27 datafusion:vortex-compact -12.2% -3.2% -9.3% +10.6% ➖ noise
27 datafusion:vortex-file-compressed +0.1% -3.2% +3.4% +10.4% ➖ noise
27 duckdb:duckdb +2.8% -3.2% +6.2% +19.4% ➖ noise
27 duckdb:vortex-compact +1.5% -3.2% +4.8% +11.8% ➖ noise
27 duckdb:vortex-file-compressed +1.4% -3.2% +4.8% +11.1% ➖ noise
28 datafusion:vortex-compact -2.4% -2.4% +0.0% +10.1% ➖ noise
28 datafusion:vortex-file-compressed -7.4% -2.4% -5.0% +10.0% ➖ noise
28 duckdb:duckdb -0.8% -2.4% +1.7% +10.0% ➖ noise
28 duckdb:vortex-compact +1.1% -2.4% +3.6% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +3.7% -2.4% +6.3% +10.0% ➖ noise
29 datafusion:vortex-compact -7.8% -2.9% -5.0% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -5.7% -2.9% -2.8% +10.0% ➖ noise
29 duckdb:duckdb +9.5% -2.9% +12.8% +10.2% 🚨 regression
29 duckdb:vortex-compact +1.2% -2.9% +4.2% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +5.8% -2.9% +9.0% +10.0% ➖ noise
30 datafusion:vortex-compact -5.2% +0.7% -5.9% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -6.9% +0.7% -7.5% +10.0% ➖ noise
30 duckdb:duckdb -0.9% +0.7% -1.5% +10.0% ➖ noise
30 duckdb:vortex-compact +11.6% +0.7% +10.8% +14.2% ➖ noise
30 duckdb:vortex-file-compressed +3.5% +0.7% +2.9% +10.0% ➖ noise
31 datafusion:vortex-compact -2.9% -1.9% -1.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -5.0% -1.9% -3.1% +10.0% ➖ noise
31 duckdb:duckdb +6.8% -1.9% +8.9% +10.0% ➖ noise
31 duckdb:vortex-compact +1.3% -1.9% +3.2% +13.9% ➖ noise
31 duckdb:vortex-file-compressed +4.7% -1.9% +6.7% +14.3% ➖ noise
32 datafusion:vortex-compact -1.2% +0.4% -1.6% +22.6% ➖ noise
32 datafusion:vortex-file-compressed -3.4% +0.4% -3.8% +16.7% ➖ noise
32 duckdb:duckdb -3.2% +0.4% -3.6% +13.4% ➖ noise
32 duckdb:vortex-compact +5.7% +0.4% +5.3% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +10.1% +0.4% +9.7% +10.9% ➖ noise
33 datafusion:vortex-compact -4.6% -5.1% +0.6% +10.7% ➖ noise
33 datafusion:vortex-file-compressed -10.3% -5.1% -5.4% +11.0% ➖ noise
33 duckdb:duckdb +6.7% -5.1% +12.5% +12.1% 🚨 regression
33 duckdb:vortex-compact +6.5% -5.1% +12.2% +10.0% 🚨 regression
33 duckdb:vortex-file-compressed +7.9% -5.1% +13.7% +20.2% ➖ noise
34 datafusion:vortex-compact -2.6% -3.0% +0.5% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -8.5% -3.0% -5.6% +10.0% ➖ noise
34 duckdb:duckdb +3.0% -3.0% +6.2% +10.0% ➖ noise
34 duckdb:vortex-compact +2.6% -3.0% +5.8% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +6.6% -3.0% +9.9% +10.0% ➖ noise
35 datafusion:vortex-compact -5.0% -5.5% +0.5% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -6.5% -5.5% -1.1% +10.0% ➖ noise
35 duckdb:duckdb -3.6% -5.5% +2.0% +12.4% ➖ noise
35 duckdb:vortex-compact +3.9% -5.5% +10.0% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +2.9% -5.5% +8.9% +13.5% ➖ noise
36 datafusion:vortex-compact -8.5% -2.6% -6.0% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -7.3% -2.6% -4.8% +10.2% ➖ noise
36 duckdb:duckdb +3.1% -2.6% +5.9% +10.0% ➖ noise
36 duckdb:vortex-compact +0.9% -2.6% +3.6% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +1.6% -2.6% +4.4% +10.0% ➖ noise
37 datafusion:vortex-compact -2.6% -6.1% +3.7% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -9.4% -6.1% -3.6% +23.4% ➖ noise
37 duckdb:duckdb +4.7% -6.1% +11.5% +12.6% ➖ noise
37 duckdb:vortex-compact +0.5% -6.1% +7.0% +11.5% ➖ noise
37 duckdb:vortex-file-compressed +7.4% -6.1% +14.3% +22.3% ➖ noise
38 datafusion:vortex-compact -3.2% -0.1% -3.1% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -5.3% -0.1% -5.2% +10.0% ➖ noise
38 duckdb:duckdb -1.9% -0.1% -1.7% +13.8% ➖ noise
38 duckdb:vortex-compact +0.6% -0.1% +0.8% +12.1% ➖ noise
38 duckdb:vortex-file-compressed +13.9% -0.1% +14.1% +10.7% 🚨 regression
39 datafusion:vortex-compact -6.7% -8.9% +2.4% +14.4% ➖ noise
39 datafusion:vortex-file-compressed -9.6% -8.9% -0.8% +10.0% ➖ noise
39 duckdb:duckdb +4.1% -8.9% +14.3% +23.4% ➖ noise
39 duckdb:vortex-compact -1.1% -8.9% +8.6% +16.1% ➖ noise
39 duckdb:vortex-file-compressed +0.7% -8.9% +10.6% +10.0% 🚨 regression
40 datafusion:vortex-compact -1.7% +0.3% -2.1% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -8.0% +0.3% -8.3% +15.7% ➖ noise
40 duckdb:duckdb -8.9% +0.3% -9.2% +15.6% ➖ noise
40 duckdb:vortex-compact +3.3% +0.3% +3.0% +12.3% ➖ noise
40 duckdb:vortex-file-compressed +5.8% +0.3% +5.5% +11.2% ➖ noise
41 datafusion:vortex-compact -5.5% -4.3% -1.3% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -6.2% -4.3% -2.0% +10.0% ➖ noise
41 duckdb:duckdb +5.2% -4.3% +9.9% +10.0% ➖ noise
41 duckdb:vortex-compact +4.6% -4.3% +9.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +5.5% -4.3% +10.2% +10.0% 🚨 regression
42 datafusion:vortex-compact -4.2% -1.4% -2.9% +13.5% ➖ noise
42 datafusion:vortex-file-compressed -8.4% -1.4% -7.1% +13.4% ➖ noise
42 duckdb:duckdb -1.1% -1.4% +0.3% +16.3% ➖ noise
42 duckdb:vortex-compact +5.2% -1.4% +6.6% +14.4% ➖ noise
42 duckdb:vortex-file-compressed +11.4% -1.4% +13.0% +20.0% ➖ noise
43 datafusion:vortex-compact -1.5% -1.2% -0.4% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -3.5% -1.2% -2.3% +10.0% ➖ noise
43 duckdb:duckdb -0.4% -1.2% +0.8% +10.0% ➖ noise
43 duckdb:vortex-compact +1.7% -1.2% +2.9% +12.8% ➖ noise
43 duckdb:vortex-file-compressed -1.6% -1.2% -0.4% +15.4% ➖ noise
44 datafusion:vortex-compact -4.4% -1.4% -3.1% +10.1% ➖ noise
44 datafusion:vortex-file-compressed -6.0% -1.4% -4.7% +10.0% ➖ noise
44 duckdb:duckdb +4.3% -1.4% +5.7% +12.8% ➖ noise
44 duckdb:vortex-compact +10.2% -1.4% +11.7% +12.2% ➖ noise
44 duckdb:vortex-file-compressed +10.9% -1.4% +12.4% +10.0% 🚨 regression
45 datafusion:vortex-compact -4.4% -4.3% -0.1% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -8.0% -4.3% -3.9% +10.0% ➖ noise
45 duckdb:duckdb -0.4% -4.3% +4.0% +11.5% ➖ noise
45 duckdb:vortex-compact +5.3% -4.3% +10.0% +12.5% ➖ noise
45 duckdb:vortex-file-compressed +0.2% -4.3% +4.7% +10.5% ➖ noise
46 datafusion:vortex-compact -5.4% -1.6% -3.9% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -8.4% -1.6% -6.9% +16.5% ➖ noise
46 duckdb:duckdb -3.2% -1.6% -1.6% +10.0% ➖ noise
46 duckdb:vortex-compact +6.0% -1.6% +7.7% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +1.6% -1.6% +3.3% +10.0% ➖ noise
47 datafusion:vortex-compact -5.1% -0.9% -4.2% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -6.7% -0.9% -5.9% +10.0% ➖ noise
47 duckdb:duckdb +0.5% -0.9% +1.4% +10.0% ➖ noise
47 duckdb:vortex-compact +1.1% -0.9% +2.1% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +5.3% -0.9% +6.3% +10.0% ➖ noise
48 datafusion:vortex-compact -10.2% -1.9% -8.4% +18.4% ➖ noise
48 datafusion:vortex-file-compressed -3.4% -1.9% -1.5% +14.1% ➖ noise
48 duckdb:duckdb +3.2% -1.9% +5.3% +10.0% ➖ noise
48 duckdb:vortex-compact -1.6% -1.9% +0.4% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +9.9% -1.9% +12.1% +10.4% 🚨 regression
49 datafusion:vortex-compact -6.5% -2.4% -4.2% +10.6% ➖ noise
49 datafusion:vortex-file-compressed -6.2% -2.4% -3.9% +10.0% ➖ noise
49 duckdb:duckdb +7.1% -2.4% +9.7% +10.0% ➖ noise
49 duckdb:vortex-compact +6.7% -2.4% +9.3% +12.0% ➖ noise
49 duckdb:vortex-file-compressed -0.7% -2.4% +1.7% +26.1% ➖ noise
50 datafusion:vortex-compact -7.6% -1.7% -6.0% +12.9% ➖ noise
50 datafusion:vortex-file-compressed -8.7% -1.7% -7.2% +14.9% ➖ noise
50 duckdb:duckdb -0.7% -1.7% +1.0% +15.3% ➖ noise
50 duckdb:vortex-compact +3.9% -1.7% +5.7% +16.6% ➖ noise
50 duckdb:vortex-file-compressed +4.0% -1.7% +5.7% +16.8% ➖ noise
51 datafusion:vortex-compact -2.0% -0.0% -2.0% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -5.1% -0.0% -5.0% +11.9% ➖ noise
51 duckdb:duckdb -1.0% -0.0% -1.0% +10.0% ➖ noise
51 duckdb:vortex-compact -0.7% -0.0% -0.7% +18.5% ➖ noise
51 duckdb:vortex-file-compressed +3.2% -0.0% +3.2% +25.7% ➖ noise
52 datafusion:vortex-compact -0.1% -5.6% +5.8% +10.0% ➖ noise
52 datafusion:vortex-file-compressed -3.6% -5.6% +2.2% +10.6% ➖ noise
52 duckdb:duckdb -1.8% -5.6% +4.1% +14.8% ➖ noise
52 duckdb:vortex-compact +6.9% -5.6% +13.3% +10.7% 🚨 regression
52 duckdb:vortex-file-compressed +3.5% -5.6% +9.7% +10.0% ➖ noise
53 datafusion:vortex-compact -4.6% -2.7% -1.9% +22.0% ➖ noise
53 datafusion:vortex-file-compressed -9.6% -2.7% -7.1% +10.0% ➖ noise
53 duckdb:duckdb -8.0% -2.7% -5.5% +18.2% ➖ noise
53 duckdb:vortex-compact +1.4% -2.7% +4.2% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +7.0% -2.7% +9.9% +14.1% ➖ noise
54 datafusion:vortex-compact -2.6% -2.7% +0.1% +10.6% ➖ noise
54 datafusion:vortex-file-compressed -5.0% -2.7% -2.4% +10.0% ➖ noise
54 duckdb:duckdb -2.7% -2.7% -0.0% +15.6% ➖ noise
54 duckdb:vortex-compact -4.0% -2.7% -1.4% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +4.0% -2.7% +6.9% +10.0% ➖ noise
55 datafusion:vortex-compact -3.7% -4.0% +0.3% +10.0% ➖ noise
55 datafusion:vortex-file-compressed -12.1% -4.0% -8.5% +10.0% ➖ noise
55 duckdb:duckdb -5.1% -4.0% -1.2% +13.6% ➖ noise
55 duckdb:vortex-compact +2.1% -4.0% +6.4% +15.6% ➖ noise
55 duckdb:vortex-file-compressed +5.4% -4.0% +9.7% +10.0% ➖ noise
56 datafusion:vortex-compact -2.6% -5.6% +3.2% +13.4% ➖ noise
56 datafusion:vortex-file-compressed -5.5% -5.6% +0.2% +10.0% ➖ noise
56 duckdb:duckdb +6.1% -5.6% +12.5% +10.0% 🚨 regression
56 duckdb:vortex-compact +13.2% -5.6% +19.9% +10.0% 🚨 regression
56 duckdb:vortex-file-compressed +3.0% -5.6% +9.2% +10.0% ➖ noise
57 datafusion:vortex-compact -5.9% -4.4% -1.5% +11.5% ➖ noise
57 datafusion:vortex-file-compressed -7.0% -4.4% -2.6% +10.6% ➖ noise
57 duckdb:duckdb -2.8% -4.4% +1.7% +18.0% ➖ noise
57 duckdb:vortex-compact -0.6% -4.4% +4.0% +17.4% ➖ noise
57 duckdb:vortex-file-compressed +5.2% -4.4% +10.0% +10.0% 🚨 regression
58 datafusion:vortex-compact -6.2% -2.6% -3.7% +11.0% ➖ noise
58 datafusion:vortex-file-compressed -2.6% -2.6% -0.0% +10.0% ➖ noise
58 duckdb:duckdb +6.5% -2.6% +9.3% +14.8% ➖ noise
58 duckdb:vortex-compact -7.0% -2.6% -4.6% +15.5% ➖ noise
58 duckdb:vortex-file-compressed +7.0% -2.6% +9.9% +13.0% ➖ noise
59 datafusion:vortex-compact -1.9% -3.8% +1.9% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -6.6% -3.8% -2.9% +10.0% ➖ noise
59 duckdb:duckdb -0.0% -3.8% +3.9% +10.0% ➖ noise
59 duckdb:vortex-compact -2.1% -3.8% +1.7% +15.0% ➖ noise
59 duckdb:vortex-file-compressed -4.1% -3.8% -0.3% +10.0% ➖ noise
60 datafusion:vortex-compact -5.6% -1.3% -4.3% +14.2% ➖ noise
60 datafusion:vortex-file-compressed -10.3% -1.3% -9.1% +10.0% ✅ faster
60 duckdb:duckdb +4.1% -1.3% +5.5% +11.6% ➖ noise
60 duckdb:vortex-compact +5.0% -1.3% +6.4% +15.9% ➖ noise
60 duckdb:vortex-file-compressed +3.8% -1.3% +5.2% +10.0% ➖ noise
61 datafusion:vortex-compact -1.4% +0.4% -1.9% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -0.5% +0.4% -0.9% +10.0% ➖ noise
61 duckdb:duckdb -5.2% +0.4% -5.6% +10.0% ➖ noise
61 duckdb:vortex-compact +6.1% +0.4% +5.6% +13.6% ➖ noise
61 duckdb:vortex-file-compressed +14.6% +0.4% +14.1% +15.7% ➖ noise
62 datafusion:vortex-compact -17.2% +10.3% -25.0% +21.9% ✅ faster
62 datafusion:vortex-file-compressed -10.1% +10.3% -18.5% +14.2% ✅ faster
62 duckdb:duckdb +1.5% +10.3% -8.0% +12.0% ➖ noise
62 duckdb:vortex-compact +2.7% +10.3% -6.9% +11.4% ➖ noise
62 duckdb:vortex-file-compressed +4.5% +10.3% -5.3% +12.8% ➖ noise
63 datafusion:vortex-compact -3.7% +1.4% -5.0% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -6.0% +1.4% -7.4% +14.6% ➖ noise
63 duckdb:duckdb -0.1% +1.4% -1.5% +10.0% ➖ noise
63 duckdb:vortex-compact +1.1% +1.4% -0.3% +17.0% ➖ noise
63 duckdb:vortex-file-compressed +5.1% +1.4% +3.6% +10.0% ➖ noise
64 datafusion:vortex-compact -5.5% -3.1% -2.6% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -7.5% -3.1% -4.6% +10.0% ➖ noise
64 duckdb:duckdb -0.7% -3.1% +2.4% +10.0% ➖ noise
64 duckdb:vortex-compact +2.5% -3.1% +5.8% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +2.9% -3.1% +6.2% +10.0% ➖ noise
65 datafusion:vortex-compact -2.9% -3.3% +0.4% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -5.3% -3.3% -2.1% +10.0% ➖ noise
65 duckdb:duckdb -2.1% -3.3% +1.2% +15.6% ➖ noise
65 duckdb:vortex-compact +0.4% -3.3% +3.8% +14.3% ➖ noise
65 duckdb:vortex-file-compressed +6.2% -3.3% +9.9% +10.8% ➖ noise
66 datafusion:vortex-compact -6.9% -4.1% -2.9% +12.3% ➖ noise
66 datafusion:vortex-file-compressed -4.6% -4.1% -0.5% +10.6% ➖ noise
66 duckdb:duckdb +2.5% -4.1% +6.9% +10.6% ➖ noise
66 duckdb:vortex-compact +2.0% -4.1% +6.3% +12.6% ➖ noise
66 duckdb:vortex-file-compressed +4.8% -4.1% +9.2% +10.0% ➖ noise
67 datafusion:vortex-compact -7.9% -3.5% -4.5% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -6.3% -3.5% -2.8% +10.5% ➖ noise
67 duckdb:duckdb +1.8% -3.5% +5.5% +10.0% ➖ noise
67 duckdb:vortex-compact +4.2% -3.5% +8.0% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +2.3% -3.5% +6.0% +10.0% ➖ noise
68 datafusion:vortex-compact -5.8% -1.7% -4.2% +19.6% ➖ noise
68 datafusion:vortex-file-compressed -9.3% -1.7% -7.7% +10.0% ➖ noise
68 duckdb:duckdb +2.5% -1.7% +4.3% +10.7% ➖ noise
68 duckdb:vortex-compact +0.6% -1.7% +2.3% +10.8% ➖ noise
68 duckdb:vortex-file-compressed +4.8% -1.7% +6.7% +10.2% ➖ noise
69 datafusion:vortex-compact -3.6% -0.5% -3.2% +12.0% ➖ noise
69 datafusion:vortex-file-compressed -6.5% -0.5% -6.1% +10.0% ➖ noise
69 duckdb:duckdb +5.6% -0.5% +6.1% +10.5% ➖ noise
69 duckdb:vortex-compact -0.2% -0.5% +0.3% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +7.7% -0.5% +8.2% +10.0% ➖ noise
70 datafusion:vortex-compact -6.5% -1.7% -4.9% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -3.4% -1.7% -1.8% +10.9% ➖ noise
70 duckdb:duckdb +1.8% -1.7% +3.6% +13.9% ➖ noise
70 duckdb:vortex-compact +1.6% -1.7% +3.3% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +7.2% -1.7% +9.0% +10.0% ➖ noise
71 datafusion:vortex-compact -12.2% -4.4% -8.2% +19.1% ➖ noise
71 datafusion:vortex-file-compressed -7.3% -4.4% -3.1% +13.2% ➖ noise
71 duckdb:duckdb +2.8% -4.4% +7.5% +11.7% ➖ noise
71 duckdb:vortex-compact +0.3% -4.4% +4.9% +10.0% ➖ noise
71 duckdb:vortex-file-compressed +8.7% -4.4% +13.7% +10.0% 🚨 regression
72 datafusion:vortex-compact +0.5% -1.9% +2.5% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -10.3% -1.9% -8.6% +10.0% ➖ noise
72 duckdb:duckdb -1.3% -1.9% +0.7% +11.0% ➖ noise
72 duckdb:vortex-compact +0.7% -1.9% +2.7% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +1.4% -1.9% +3.4% +10.0% ➖ noise
73 datafusion:vortex-compact -0.2% -0.1% -0.2% +10.8% ➖ noise
73 datafusion:vortex-file-compressed -6.0% -0.1% -6.0% +10.0% ➖ noise
73 duckdb:duckdb +2.7% -0.1% +2.8% +11.0% ➖ noise
73 duckdb:vortex-compact -2.7% -0.1% -2.6% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -2.3% -0.1% -2.2% +10.0% ➖ noise
74 datafusion:vortex-compact -0.4% -2.2% +1.8% +12.3% ➖ noise
74 datafusion:vortex-file-compressed -9.1% -2.2% -7.1% +10.0% ➖ noise
74 duckdb:duckdb -0.0% -2.2% +2.2% +10.0% ➖ noise
74 duckdb:vortex-compact -4.3% -2.2% -2.1% +22.4% ➖ noise
74 duckdb:vortex-file-compressed +6.4% -2.2% +8.7% +26.7% ➖ noise
75 datafusion:vortex-compact +4.3% -1.0% +5.3% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -6.2% -1.0% -5.2% +10.0% ➖ noise
75 duckdb:duckdb +2.2% -1.0% +3.2% +10.2% ➖ noise
75 duckdb:vortex-compact +3.1% -1.0% +4.1% +13.7% ➖ noise
75 duckdb:vortex-file-compressed +5.1% -1.0% +6.2% +10.0% ➖ noise
76 datafusion:vortex-compact +1.7% -2.6% +4.4% +10.6% ➖ noise
76 datafusion:vortex-file-compressed -5.0% -2.6% -2.4% +27.9% ➖ noise
76 duckdb:duckdb -2.7% -2.6% -0.0% +20.0% ➖ noise
76 duckdb:vortex-compact +6.2% -2.6% +9.1% +10.0% ➖ noise
76 duckdb:vortex-file-compressed +8.7% -2.6% +11.7% +20.4% ➖ noise
77 datafusion:vortex-compact +6.4% -2.2% +8.8% +17.9% ➖ noise
77 datafusion:vortex-file-compressed -11.5% -2.2% -9.4% +10.0% ✅ faster
77 duckdb:duckdb +6.1% -2.2% +8.5% +16.2% ➖ noise
77 duckdb:vortex-compact +7.3% -2.2% +9.8% +17.6% ➖ noise
77 duckdb:vortex-file-compressed +1.1% -2.2% +3.4% +17.7% ➖ noise
78 datafusion:vortex-compact +4.2% -4.1% +8.7% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -7.7% -4.1% -3.7% +10.0% ➖ noise
78 duckdb:duckdb +3.9% -4.1% +8.4% +10.0% ➖ noise
78 duckdb:vortex-compact +0.9% -4.1% +5.2% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +0.9% -4.1% +5.3% +10.0% ➖ noise
79 datafusion:vortex-compact +3.2% -1.9% +5.2% +26.0% ➖ noise
79 datafusion:vortex-file-compressed -12.0% -1.9% -10.2% +20.2% ➖ noise
79 duckdb:duckdb +1.9% -1.9% +3.9% +10.8% ➖ noise
79 duckdb:vortex-compact +0.1% -1.9% +2.1% +10.0% ➖ noise
79 duckdb:vortex-file-compressed +6.9% -1.9% +9.0% +20.6% ➖ noise
80 datafusion:vortex-compact +1.0% -2.6% +3.7% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -6.6% -2.6% -4.1% +10.0% ➖ noise
80 duckdb:duckdb -1.7% -2.6% +1.0% +15.3% ➖ noise
80 duckdb:vortex-compact -0.9% -2.6% +1.7% +14.7% ➖ noise
80 duckdb:vortex-file-compressed +1.2% -2.6% +3.9% +13.0% ➖ noise
81 datafusion:vortex-compact +15.3% -2.5% +18.2% +10.2% 🚨 regression
81 datafusion:vortex-file-compressed -10.9% -2.5% -8.6% +10.0% ➖ noise
81 duckdb:duckdb +0.2% -2.5% +2.8% +10.0% ➖ noise
81 duckdb:vortex-compact +0.8% -2.5% +3.4% +11.8% ➖ noise
81 duckdb:vortex-file-compressed +4.4% -2.5% +7.0% +13.9% ➖ noise
82 datafusion:vortex-compact +2.7% -6.0% +9.3% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -5.5% -6.0% +0.6% +10.1% ➖ noise
82 duckdb:duckdb +3.0% -6.0% +9.6% +13.2% ➖ noise
82 duckdb:vortex-compact +10.4% -6.0% +17.5% +11.8% 🚨 regression
82 duckdb:vortex-file-compressed +7.2% -6.0% +14.0% +10.0% 🚨 regression
83 datafusion:vortex-compact +5.1% -4.0% +9.4% +21.1% ➖ noise
83 datafusion:vortex-file-compressed -11.1% -4.0% -7.4% +13.8% ➖ noise
83 duckdb:duckdb +9.1% -4.0% +13.6% +15.4% ➖ noise
83 duckdb:vortex-compact +11.1% -4.0% +15.7% +20.2% ➖ noise
83 duckdb:vortex-file-compressed +4.1% -4.0% +8.4% +15.0% ➖ noise
84 datafusion:vortex-compact +2.5% +0.9% +1.6% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -6.6% +0.9% -7.5% +10.0% ➖ noise
84 duckdb:duckdb -0.2% +0.9% -1.0% +10.0% ➖ noise
84 duckdb:vortex-compact +1.8% +0.9% +0.9% +11.1% ➖ noise
84 duckdb:vortex-file-compressed +4.6% +0.9% +3.7% +10.0% ➖ noise
85 datafusion:vortex-compact +15.5% +0.5% +14.9% +14.8% 🚨 regression
85 datafusion:vortex-file-compressed -6.3% +0.5% -6.7% +10.0% ➖ noise
85 duckdb:duckdb +6.1% +0.5% +5.5% +12.4% ➖ noise
85 duckdb:vortex-compact +8.3% +0.5% +7.8% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +3.0% +0.5% +2.5% +10.0% ➖ noise
86 datafusion:vortex-compact +6.4% -2.7% +9.3% +17.0% ➖ noise
86 datafusion:vortex-file-compressed -6.3% -2.7% -3.7% +12.6% ➖ noise
86 duckdb:duckdb +1.3% -2.7% +4.1% +21.9% ➖ noise
86 duckdb:vortex-compact +6.9% -2.7% +9.9% +13.7% ➖ noise
86 duckdb:vortex-file-compressed -2.7% -2.7% -0.0% +11.1% ➖ noise
87 datafusion:vortex-compact +4.3% -4.2% +9.0% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -13.1% -4.2% -9.2% +12.2% ➖ noise
87 duckdb:duckdb +4.8% -4.2% +9.5% +13.2% ➖ noise
87 duckdb:vortex-compact +3.7% -4.2% +8.3% +12.4% ➖ noise
87 duckdb:vortex-file-compressed +3.1% -4.2% +7.7% +13.8% ➖ noise
88 datafusion:vortex-compact +2.9% -3.0% +6.1% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -3.2% -3.0% -0.2% +10.0% ➖ noise
88 duckdb:duckdb +0.8% -3.0% +3.9% +10.0% ➖ noise
88 duckdb:vortex-compact +3.5% -3.0% +6.7% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +2.2% -3.0% +5.3% +10.0% ➖ noise
89 datafusion:vortex-compact +2.4% -9.2% +12.8% +10.0% 🚨 regression
89 datafusion:vortex-file-compressed -4.5% -9.2% +5.1% +10.0% ➖ noise
89 duckdb:duckdb +2.2% -9.2% +12.5% +10.4% 🚨 regression
89 duckdb:vortex-compact +2.1% -9.2% +12.4% +10.0% 🚨 regression
89 duckdb:vortex-file-compressed +4.7% -9.2% +15.3% +10.0% 🚨 regression
90 datafusion:vortex-compact +2.7% -2.2% +5.0% +13.2% ➖ noise
90 datafusion:vortex-file-compressed -2.9% -2.2% -0.8% +27.2% ➖ noise
90 duckdb:duckdb +1.6% -2.2% +3.9% +10.0% ➖ noise
90 duckdb:vortex-compact +7.1% -2.2% +9.5% +11.0% ➖ noise
90 duckdb:vortex-file-compressed +3.3% -2.2% +5.6% +10.0% ➖ noise
91 datafusion:vortex-compact +6.8% -0.6% +7.5% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -9.8% -0.6% -9.3% +10.0% ✅ faster
91 duckdb:duckdb -1.3% -0.6% -0.7% +11.9% ➖ noise
91 duckdb:vortex-compact +3.6% -0.6% +4.2% +12.1% ➖ noise
91 duckdb:vortex-file-compressed +2.6% -0.6% +3.2% +15.2% ➖ noise
92 datafusion:vortex-compact -4.0% -5.3% +1.4% +14.0% ➖ noise
92 datafusion:vortex-file-compressed -3.6% -5.3% +1.7% +12.0% ➖ noise
92 duckdb:duckdb +4.0% -5.3% +9.7% +14.0% ➖ noise
92 duckdb:vortex-compact +4.4% -5.3% +10.2% +13.9% ➖ noise
92 duckdb:vortex-file-compressed +5.4% -5.3% +11.2% +18.5% ➖ noise
93 datafusion:vortex-compact -1.0% -1.6% +0.6% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -11.7% -1.6% -10.3% +12.1% ➖ noise
93 duckdb:duckdb +1.6% -1.6% +3.3% +11.7% ➖ noise
93 duckdb:vortex-compact +6.0% -1.6% +7.7% +17.9% ➖ noise
93 duckdb:vortex-file-compressed +10.1% -1.6% +11.9% +15.8% ➖ noise
94 datafusion:vortex-compact +12.2% -5.0% +18.1% +16.9% 🚨 regression
94 datafusion:vortex-file-compressed -11.4% -5.0% -6.8% +10.0% ➖ noise
94 duckdb:duckdb +0.3% -5.0% +5.5% +16.1% ➖ noise
94 duckdb:vortex-compact +3.6% -5.0% +9.0% +13.1% ➖ noise
94 duckdb:vortex-file-compressed +5.5% -5.0% +11.0% +10.0% 🚨 regression
95 datafusion:vortex-compact +1.5% +4.8% -3.1% +11.5% ➖ noise
95 datafusion:vortex-file-compressed -5.4% +4.8% -9.7% +10.0% ✅ faster
95 duckdb:duckdb +22.4% +4.8% +16.8% +20.3% ➖ noise
95 duckdb:vortex-compact +1.9% +4.8% -2.8% +17.3% ➖ noise
95 duckdb:vortex-file-compressed +1.6% +4.8% -3.1% +16.2% ➖ noise
96 datafusion:vortex-compact +2.7% +1.9% +0.8% +10.0% ➖ noise
96 datafusion:vortex-file-compressed -9.1% +1.9% -10.7% +11.4% ✅ faster
96 duckdb:duckdb -1.1% +1.9% -2.9% +20.1% ➖ noise
96 duckdb:vortex-compact +2.1% +1.9% +0.2% +14.4% ➖ noise
96 duckdb:vortex-file-compressed +3.1% +1.9% +1.3% +13.3% ➖ noise
97 datafusion:vortex-compact +2.9% -3.7% +6.9% +14.6% ➖ noise
97 datafusion:vortex-file-compressed +0.3% -3.7% +4.2% +10.0% ➖ noise
97 duckdb:duckdb -2.5% -3.7% +1.3% +12.1% ➖ noise
97 duckdb:vortex-compact +7.9% -3.7% +12.0% +16.4% ➖ noise
97 duckdb:vortex-file-compressed -1.9% -3.7% +1.9% +14.2% ➖ noise
98 datafusion:vortex-compact +2.6% -0.2% +2.8% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -13.0% -0.2% -12.8% +12.1% ✅ faster
98 duckdb:duckdb +4.9% -0.2% +5.1% +12.6% ➖ noise
98 duckdb:vortex-compact +2.6% -0.2% +2.7% +10.0% ➖ noise
98 duckdb:vortex-file-compressed +2.2% -0.2% +2.4% +10.0% ➖ noise
99 datafusion:vortex-compact +0.0% -2.5% +2.5% +17.0% ➖ noise
99 datafusion:vortex-file-compressed -4.7% -2.5% -2.3% +25.9% ➖ noise
99 duckdb:duckdb +2.6% -2.5% +5.2% +34.6% ➖ noise
99 duckdb:vortex-compact +0.5% -2.5% +3.1% +23.8% ➖ noise
99 duckdb:vortex-file-compressed +5.5% -2.5% +8.2% +28.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.982x ➖
Shifts: Parquet (control) -1.8% · Median polish -3.8%


datafusion / vortex-file-compressed (1.037x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 31552620 31842830 0.99
fineweb_q01/datafusion:vortex-file-compressed 567975492 672720667 0.84
fineweb_q02/datafusion:vortex-file-compressed 528508759 465050081 1.14
fineweb_q03/datafusion:vortex-file-compressed 1339360696 1413716872 0.95
fineweb_q04/datafusion:vortex-file-compressed 1381599907 1371225784 1.01
fineweb_q05/datafusion:vortex-file-compressed 1374707409 1360593730 1.01
fineweb_q06/datafusion:vortex-file-compressed 1546390785 1504136691 1.03
fineweb_q07/datafusion:vortex-file-compressed 1399703963 1376997486 1.02
fineweb_q08/datafusion:vortex-file-compressed 🚨 722179127 500435916 1.44
datafusion / vortex-compact (1.005x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 33188220 38013951 0.87
fineweb_q01/datafusion:vortex-compact 547216462 640910514 0.85
fineweb_q02/datafusion:vortex-compact 582923750 775113580 0.75
fineweb_q03/datafusion:vortex-compact 1520344041 1525180584 1.00
fineweb_q04/datafusion:vortex-compact 1791434790 1733006097 1.03
fineweb_q05/datafusion:vortex-compact 1480752564 1463144178 1.01
fineweb_q06/datafusion:vortex-compact 🚨 1953981350 1323309331 1.48
fineweb_q07/datafusion:vortex-compact 1357631687 1138551325 1.19
fineweb_q08/datafusion:vortex-compact 366551530 361292791 1.01
datafusion / parquet (0.999x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1116892150 1175609887 0.95
fineweb_q01/datafusion:parquet 1879108122 1997858568 0.94
fineweb_q02/datafusion:parquet 1908354804 1921728627 0.99
fineweb_q03/datafusion:parquet 1918536022 1820095568 1.05
fineweb_q04/datafusion:parquet 1898197078 1806907635 1.05
fineweb_q05/datafusion:parquet 1827919031 2066350914 0.88
fineweb_q06/datafusion:parquet 2118507968 2006985790 1.06
fineweb_q07/datafusion:parquet 1949184590 1825918945 1.07
fineweb_q08/datafusion:parquet 1933773490 1904673326 1.02
duckdb / vortex-file-compressed (0.998x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 88756889 89907553 0.99
fineweb_q01/duckdb:vortex-file-compressed 653783739 560270546 1.17
fineweb_q02/duckdb:vortex-file-compressed 460574590 486470675 0.95
fineweb_q03/duckdb:vortex-file-compressed 1511018293 1634918684 0.92
fineweb_q04/duckdb:vortex-file-compressed 1582181994 1717664181 0.92
fineweb_q05/duckdb:vortex-file-compressed 1486696953 1753272854 0.85
fineweb_q06/duckdb:vortex-file-compressed 1596283812 1695769701 0.94
fineweb_q07/duckdb:vortex-file-compressed 1447697757 1628399989 0.89
fineweb_q08/duckdb:vortex-file-compressed 🚨 929105907 624990576 1.49
duckdb / vortex-compact (0.970x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 79579204 87526618 0.91
fineweb_q01/duckdb:vortex-compact 568013265 558196271 1.02
fineweb_q02/duckdb:vortex-compact 581418099 594663410 0.98
fineweb_q03/duckdb:vortex-compact 1666783924 1744426673 0.96
fineweb_q04/duckdb:vortex-compact 1746765296 1850413408 0.94
fineweb_q05/duckdb:vortex-compact 1624871221 1674263677 0.97
fineweb_q06/duckdb:vortex-compact 1521646165 1664123264 0.91
fineweb_q07/duckdb:vortex-compact 1410918790 1426309450 0.99
fineweb_q08/duckdb:vortex-compact 520017626 490365580 1.06
duckdb / parquet (0.964x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1146737532 1112568889 1.03
fineweb_q01/duckdb:parquet 1378461031 1430634713 0.96
fineweb_q02/duckdb:parquet 1365339604 1334952527 1.02
fineweb_q03/duckdb:parquet 3746219733 3778699144 0.99
fineweb_q04/duckdb:parquet 1919403838 2036525693 0.94
fineweb_q05/duckdb:parquet 2037897800 2309950541 0.88
fineweb_q06/duckdb:parquet 4287140437 4519675575 0.95
fineweb_q07/duckdb:parquet 2568855333 2709117715 0.95
fineweb_q08/duckdb:parquet 1079349239 1131277416 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -12.7% -1.0% -11.8% +198.8% ➖ noise
0 datafusion:vortex-file-compressed -0.9% -1.0% +0.1% +213.4% ➖ noise
0 duckdb:vortex-compact -9.1% -1.0% -8.1% +37.3% ➖ noise
0 duckdb:vortex-file-compressed -1.3% -1.0% -0.2% +31.6% ➖ noise
1 datafusion:vortex-compact -14.6% -4.8% -10.3% +87.5% ➖ noise
1 datafusion:vortex-file-compressed -15.6% -4.8% -11.3% +90.3% ➖ noise
1 duckdb:vortex-compact +1.8% -4.8% +6.9% +34.3% ➖ noise
1 duckdb:vortex-file-compressed +16.7% -4.8% +22.6% +30.0% ➖ noise
2 datafusion:vortex-compact -24.8% +0.8% -25.4% +36.3% ➖ noise
2 datafusion:vortex-file-compressed +13.6% +0.8% +12.8% +36.8% ➖ noise
2 duckdb:vortex-compact -2.2% +0.8% -3.0% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -5.3% +0.8% -6.1% +30.0% ➖ noise
3 datafusion:vortex-compact -0.3% +2.2% -2.5% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -5.3% +2.2% -7.3% +30.0% ➖ noise
3 duckdb:vortex-compact -4.5% +2.2% -6.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -7.6% +2.2% -9.6% +30.0% ➖ noise
4 datafusion:vortex-compact +3.4% -0.5% +3.9% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +0.8% -0.5% +1.3% +30.0% ➖ noise
4 duckdb:vortex-compact -5.6% -0.5% -5.1% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -7.9% -0.5% -7.4% +30.0% ➖ noise
5 datafusion:vortex-compact +1.2% -11.7% +14.6% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +1.0% -11.7% +14.4% +30.0% ➖ noise
5 duckdb:vortex-compact -3.0% -11.7% +9.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -15.2% -11.7% -4.0% +30.0% ➖ noise
6 datafusion:vortex-compact +47.7% +0.1% +47.6% +30.0% 🚨 regression
6 datafusion:vortex-file-compressed +2.8% +0.1% +2.7% +30.0% ➖ noise
6 duckdb:vortex-compact -8.6% +0.1% -8.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -5.9% +0.1% -5.9% +30.0% ➖ noise
7 datafusion:vortex-compact +19.2% +0.6% +18.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +1.6% +0.6% +1.0% +30.0% ➖ noise
7 duckdb:vortex-compact -1.1% +0.6% -1.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -11.1% +0.6% -11.6% +30.0% ➖ noise
8 datafusion:vortex-compact +1.5% -1.6% +3.1% +42.3% ➖ noise
8 datafusion:vortex-file-compressed +44.3% -1.6% +46.6% +33.3% 🚨 regression
8 duckdb:vortex-compact +6.0% -1.6% +7.7% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +48.7% -1.6% +51.0% +46.8% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.4%
Vortex (geomean): 0.998x ➖
Parquet (geomean): 0.975x ➖
Shifts: Parquet (control) -2.5% · Median polish -1.4%


duckdb / vortex-file-compressed (1.009x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12083801 12130086 1.00
statpopgen_q01/duckdb:vortex-file-compressed 🚨 26447031 19976376 1.32
statpopgen_q02/duckdb:vortex-file-compressed 1388744486 1415055612 0.98
statpopgen_q03/duckdb:vortex-file-compressed 3115230732 3238667593 0.96
statpopgen_q04/duckdb:vortex-file-compressed 3201186465 3236901696 0.99
statpopgen_q05/duckdb:vortex-file-compressed 1452164253 1485932098 0.98
statpopgen_q06/duckdb:vortex-file-compressed 2154205982 2177415541 0.99
statpopgen_q07/duckdb:vortex-file-compressed 209298819 210683668 0.99
statpopgen_q08/duckdb:vortex-file-compressed 232774205 239191369 0.97
statpopgen_q09/duckdb:vortex-file-compressed 2960031782 2981051173 0.99
statpopgen_q10/duckdb:vortex-file-compressed 4701643946 4847385381 0.97
duckdb / vortex-compact (0.987x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11528693 11622512 0.99
statpopgen_q01/duckdb:vortex-compact 164285102 167787698 0.98
statpopgen_q02/duckdb:vortex-compact 1845242393 1855764982 0.99
statpopgen_q03/duckdb:vortex-compact 3552892943 3614176044 0.98
statpopgen_q04/duckdb:vortex-compact 3582787087 3633003204 0.99
statpopgen_q05/duckdb:vortex-compact 1854199767 1859540649 1.00
statpopgen_q06/duckdb:vortex-compact 2725538158 2732673048 1.00
statpopgen_q07/duckdb:vortex-compact 887788172 900850940 0.99
statpopgen_q08/duckdb:vortex-compact 917416544 922389152 0.99
statpopgen_q09/duckdb:vortex-compact 3325739172 3417672353 0.97
statpopgen_q10/duckdb:vortex-compact 5420432240 5540580530 0.98
duckdb / parquet (0.975x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 320214110 335388708 0.95
statpopgen_q01/duckdb:parquet 410970633 418886882 0.98
statpopgen_q02/duckdb:parquet 1005170009 1035082333 0.97
statpopgen_q03/duckdb:parquet 1540793372 1539385017 1.00
statpopgen_q04/duckdb:parquet 1501217052 1561522794 0.96
statpopgen_q05/duckdb:parquet 1016896906 1031957108 0.99
statpopgen_q06/duckdb:parquet 1492905143 1541083873 0.97
statpopgen_q07/duckdb:parquet 1313485630 1359715199 0.97
statpopgen_q08/duckdb:parquet 1301863767 1351681429 0.96
statpopgen_q09/duckdb:parquet 1378359495 1390375935 0.99
statpopgen_q10/duckdb:parquet 2652452635 2689902818 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -0.8% -4.5% +3.9% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -0.4% -4.5% +4.3% +10.0% ➖ noise
1 duckdb:vortex-compact -2.1% -1.9% -0.2% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +32.4% -1.9% +34.9% +198.2% ➖ noise
2 duckdb:vortex-compact -0.6% -2.9% +2.4% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.9% -2.9% +1.1% +10.0% ➖ noise
3 duckdb:vortex-compact -1.7% +0.1% -1.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -3.8% +0.1% -3.9% +10.0% ➖ noise
4 duckdb:vortex-compact -1.4% -3.9% +2.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.1% -3.9% +2.9% +10.0% ➖ noise
5 duckdb:vortex-compact -0.3% -1.5% +1.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.3% -1.5% -0.8% +10.0% ➖ noise
6 duckdb:vortex-compact -0.3% -3.1% +3.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.1% -3.1% +2.1% +10.0% ➖ noise
7 duckdb:vortex-compact -1.5% -3.4% +2.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.7% -3.4% +2.8% +10.0% ➖ noise
8 duckdb:vortex-compact -0.5% -3.7% +3.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.7% -3.7% +1.0% +10.0% ➖ noise
9 duckdb:vortex-compact -2.7% -0.9% -1.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.7% -0.9% +0.2% +10.0% ➖ noise
10 duckdb:vortex-compact -2.2% -1.4% -0.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -3.0% -1.4% -1.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Vortex (geomean): 1.010x ➖
Parquet (geomean): 1.011x ➖
Shifts: Parquet (control) +1.1% · Median polish +1.3%


datafusion / vortex-file-compressed (1.020x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 403271093 381496424 1.06
tpch_q02/datafusion:vortex-file-compressed 108910433 105219597 1.04
tpch_q03/datafusion:vortex-file-compressed 219100557 212375089 1.03
tpch_q04/datafusion:vortex-file-compressed 116707336 113456587 1.03
tpch_q05/datafusion:vortex-file-compressed 379721112 367118438 1.03
tpch_q06/datafusion:vortex-file-compressed 43666718 42005036 1.04
tpch_q07/datafusion:vortex-file-compressed 510546456 491246589 1.04
tpch_q08/datafusion:vortex-file-compressed 360311402 349263580 1.03
tpch_q09/datafusion:vortex-file-compressed 626888428 613875376 1.02
tpch_q10/datafusion:vortex-file-compressed 229440345 224480680 1.02
tpch_q11/datafusion:vortex-file-compressed 81792551 80594101 1.01
tpch_q12/datafusion:vortex-file-compressed 121886697 120123404 1.01
tpch_q13/datafusion:vortex-file-compressed 211676516 210241826 1.01
tpch_q14/datafusion:vortex-file-compressed 56825191 56283791 1.01
tpch_q15/datafusion:vortex-file-compressed 105890880 105289020 1.01
tpch_q16/datafusion:vortex-file-compressed 74821605 74430075 1.01
tpch_q17/datafusion:vortex-file-compressed 626734717 615260823 1.02
tpch_q18/datafusion:vortex-file-compressed 833921572 819483781 1.02
tpch_q19/datafusion:vortex-file-compressed 92550115 93588244 0.99
tpch_q20/datafusion:vortex-file-compressed 165689262 163873187 1.01
tpch_q21/datafusion:vortex-file-compressed 645265584 639974162 1.01
tpch_q22/datafusion:vortex-file-compressed 63018277 63243975 1.00
datafusion / vortex-compact (1.009x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 438460550 441892087 0.99
tpch_q02/datafusion:vortex-compact 108632733 105769130 1.03
tpch_q03/datafusion:vortex-compact 218766348 214981579 1.02
tpch_q04/datafusion:vortex-compact 122364448 121283404 1.01
tpch_q05/datafusion:vortex-compact 370937224 367052630 1.01
tpch_q06/datafusion:vortex-compact 62938250 63110740 1.00
tpch_q07/datafusion:vortex-compact 520490047 508350514 1.02
tpch_q08/datafusion:vortex-compact 361579356 354377126 1.02
tpch_q09/datafusion:vortex-compact 633906793 619277431 1.02
tpch_q10/datafusion:vortex-compact 247013506 242636458 1.02
tpch_q11/datafusion:vortex-compact 82094310 82612107 0.99
tpch_q12/datafusion:vortex-compact 165281995 164245470 1.01
tpch_q13/datafusion:vortex-compact 260316357 256833735 1.01
tpch_q14/datafusion:vortex-compact 73138241 72678185 1.01
tpch_q15/datafusion:vortex-compact 159583469 158984762 1.00
tpch_q16/datafusion:vortex-compact 78245184 78386480 1.00
tpch_q17/datafusion:vortex-compact 634160069 622460400 1.02
tpch_q18/datafusion:vortex-compact 827925116 821913057 1.01
tpch_q19/datafusion:vortex-compact 132314422 133045965 0.99
tpch_q20/datafusion:vortex-compact 189402000 188674668 1.00
tpch_q21/datafusion:vortex-compact 659760660 648623575 1.02
tpch_q22/datafusion:vortex-compact 70064712 70844964 0.99
datafusion / parquet (1.015x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 453474271 433663210 1.05
tpch_q02/datafusion:parquet 169630014 165603912 1.02
tpch_q03/datafusion:parquet 278133388 270650282 1.03
tpch_q04/datafusion:parquet 124041202 124652016 1.00
tpch_q05/datafusion:parquet 423899124 420827180 1.01
tpch_q06/datafusion:parquet 122641686 122958588 1.00
tpch_q07/datafusion:parquet 597990433 587980571 1.02
tpch_q08/datafusion:parquet 453904269 446491851 1.02
tpch_q09/datafusion:parquet 729304854 724684318 1.01
tpch_q10/datafusion:parquet 495466498 477017488 1.04
tpch_q11/datafusion:parquet 117616488 113934294 1.03
tpch_q12/datafusion:parquet 193541113 187356453 1.03
tpch_q13/datafusion:parquet 327680297 327271695 1.00
tpch_q14/datafusion:parquet 149618289 150754449 0.99
tpch_q15/datafusion:parquet 243799715 241939961 1.01
tpch_q16/datafusion:parquet 120556976 124079459 0.97
tpch_q17/datafusion:parquet 675882731 659702548 1.02
tpch_q18/datafusion:parquet 894394360 872728807 1.02
tpch_q19/datafusion:parquet 253794599 251404078 1.01
tpch_q20/datafusion:parquet 290378310 281861836 1.03
tpch_q21/datafusion:parquet 698220865 669484106 1.04
tpch_q22/datafusion:parquet 211244386 213601544 0.99
datafusion / arrow (1.028x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 598381359 576569919 1.04
tpch_q02/datafusion:arrow 162015213 162461300 1.00
tpch_q03/datafusion:arrow 462392595 451199367 1.02
tpch_q04/datafusion:arrow 341747082 326882436 1.05
tpch_q05/datafusion:arrow 914205789 908326856 1.01
tpch_q06/datafusion:arrow 276111995 270580075 1.02
tpch_q07/datafusion:arrow 1149404214 1127914227 1.02
tpch_q08/datafusion:arrow 1131055009 1107766901 1.02
tpch_q09/datafusion:arrow 1341317720 1319238252 1.02
tpch_q10/datafusion:arrow 583177133 568773668 1.03
tpch_q11/datafusion:arrow 136395245 133777502 1.02
tpch_q12/datafusion:arrow 809938059 770865716 1.05
tpch_q13/datafusion:arrow 502501706 482667764 1.04
tpch_q14/datafusion:arrow 310648759 305421593 1.02
tpch_q15/datafusion:arrow 715854781 669770142 1.07
tpch_q16/datafusion:arrow 102962911 102079409 1.01
tpch_q17/datafusion:arrow 1329901794 1293153979 1.03
tpch_q18/datafusion:arrow 1873036375 1827886088 1.02
tpch_q19/datafusion:arrow 492017447 477859255 1.03
tpch_q20/datafusion:arrow 492539720 469385638 1.05
tpch_q21/datafusion:arrow 3020365548 2907045072 1.04
tpch_q22/datafusion:arrow 131407552 126858215 1.04
duckdb / vortex-file-compressed (1.008x ➖, 1↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 171175661 171123529 1.00
tpch_q02/duckdb:vortex-file-compressed 52298838 51561100 1.01
tpch_q03/duckdb:vortex-file-compressed 129861600 124527100 1.04
tpch_q04/duckdb:vortex-file-compressed 155144335 150267334 1.03
tpch_q05/duckdb:vortex-file-compressed 130130935 124282293 1.05
tpch_q06/duckdb:vortex-file-compressed 47319756 46166737 1.02
tpch_q07/duckdb:vortex-file-compressed 143833589 142637755 1.01
tpch_q08/duckdb:vortex-file-compressed 174405653 167502900 1.04
tpch_q09/duckdb:vortex-file-compressed 320215663 318779644 1.00
tpch_q10/duckdb:vortex-file-compressed 148134384 141740374 1.05
tpch_q11/duckdb:vortex-file-compressed 33322412 32405534 1.03
tpch_q12/duckdb:vortex-file-compressed 90142584 91742867 0.98
tpch_q13/duckdb:vortex-file-compressed 213328702 225672326 0.95
tpch_q14/duckdb:vortex-file-compressed 🚀 58609469 66228561 0.88
tpch_q15/duckdb:vortex-file-compressed 86408206 85328928 1.01
tpch_q16/duckdb:vortex-file-compressed 78346558 77249675 1.01
tpch_q17/duckdb:vortex-file-compressed 99228052 97475390 1.02
tpch_q18/duckdb:vortex-file-compressed 281115701 281942792 1.00
tpch_q19/duckdb:vortex-file-compressed 82689901 83208887 0.99
tpch_q20/duckdb:vortex-file-compressed 160117868 155614548 1.03
tpch_q21/duckdb:vortex-file-compressed 562702393 555216731 1.01
tpch_q22/duckdb:vortex-file-compressed 70628582 69980349 1.01
duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 224626406 226581566 0.99
tpch_q02/duckdb:vortex-compact 56173891 54779236 1.03
tpch_q03/duckdb:vortex-compact 138659383 136688425 1.01
tpch_q04/duckdb:vortex-compact 171327898 170002289 1.01
tpch_q05/duckdb:vortex-compact 144826938 141244630 1.03
tpch_q06/duckdb:vortex-compact 83441116 81592643 1.02
tpch_q07/duckdb:vortex-compact 194762607 196127830 0.99
tpch_q08/duckdb:vortex-compact 188343714 181191195 1.04
tpch_q09/duckdb:vortex-compact 346372280 347241800 1.00
tpch_q10/duckdb:vortex-compact 176658551 179432177 0.98
tpch_q11/duckdb:vortex-compact 40443884 41574033 0.97
tpch_q12/duckdb:vortex-compact 198057935 198823793 1.00
tpch_q13/duckdb:vortex-compact 263952183 273729459 0.96
tpch_q14/duckdb:vortex-compact 92580028 95816264 0.97
tpch_q15/duckdb:vortex-compact 111750886 111709927 1.00
tpch_q16/duckdb:vortex-compact 84678118 80470798 1.05
tpch_q17/duckdb:vortex-compact 113837106 109750861 1.04
tpch_q18/duckdb:vortex-compact 282026573 283404578 1.00
tpch_q19/duckdb:vortex-compact 105774602 107863661 0.98
tpch_q20/duckdb:vortex-compact 203940479 198753581 1.03
tpch_q21/duckdb:vortex-compact 631680458 609300352 1.04
tpch_q22/duckdb:vortex-compact 83792004 84348175 0.99
duckdb / parquet (1.006x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 254871899 259375368 0.98
tpch_q02/duckdb:parquet 94699631 92177251 1.03
tpch_q03/duckdb:parquet 205674281 203363782 1.01
tpch_q04/duckdb:parquet 131731192 132460589 0.99
tpch_q05/duckdb:parquet 215159211 210743267 1.02
tpch_q06/duckdb:parquet 66410241 67113720 0.99
tpch_q07/duckdb:parquet 180870289 177007715 1.02
tpch_q08/duckdb:parquet 251780892 251966241 1.00
tpch_q09/duckdb:parquet 500905786 475532003 1.05
tpch_q10/duckdb:parquet 614965700 604015486 1.02
tpch_q11/duckdb:parquet 55242906 57353050 0.96
tpch_q12/duckdb:parquet 125403146 123353979 1.02
tpch_q13/duckdb:parquet 449188870 444810298 1.01
tpch_q14/duckdb:parquet 172369275 174981022 0.99
tpch_q15/duckdb:parquet 95426982 97471243 0.98
tpch_q16/duckdb:parquet 163350255 162931922 1.00
tpch_q17/duckdb:parquet 177147465 174264864 1.02
tpch_q18/duckdb:parquet 354904877 349315871 1.02
tpch_q19/duckdb:parquet 279018662 284240117 0.98
tpch_q20/duckdb:parquet 229849961 225634060 1.02
tpch_q21/duckdb:parquet 566878660 554922011 1.02
tpch_q22/duckdb:parquet 293144243 288301559 1.02
duckdb / duckdb (1.010x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117699333 115790487 1.02
tpch_q02/duckdb:duckdb 47531387 44746706 1.06
tpch_q03/duckdb:duckdb 96659011 96336523 1.00
tpch_q04/duckdb:duckdb 131322809 131082008 1.00
tpch_q05/duckdb:duckdb 110326402 109707617 1.01
tpch_q06/duckdb:duckdb 38354581 37257314 1.03
tpch_q07/duckdb:duckdb 86985657 86261658 1.01
tpch_q08/duckdb:duckdb 110541519 110009200 1.00
tpch_q09/duckdb:duckdb 276929777 277544878 1.00
tpch_q10/duckdb:duckdb 201602177 204507639 0.99
tpch_q11/duckdb:duckdb 15197581 15231102 1.00
tpch_q12/duckdb:duckdb 84828967 85486757 0.99
tpch_q13/duckdb:duckdb 221740226 218216288 1.02
tpch_q14/duckdb:duckdb 70890756 70015430 1.01
tpch_q15/duckdb:duckdb 78235197 77138913 1.01
tpch_q16/duckdb:duckdb 74618722 74264404 1.00
tpch_q17/duckdb:duckdb 84795965 84947047 1.00
tpch_q18/duckdb:duckdb 214882594 211102349 1.02
tpch_q19/duckdb:duckdb 116686237 115075281 1.01
tpch_q20/duckdb:duckdb 112484200 111523409 1.01
tpch_q21/duckdb:duckdb 294282099 294991702 1.00
tpch_q22/duckdb:duckdb 67696169 65921519 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +3.8% +1.4% +2.4% +10.0% ➖ noise
1 datafusion:vortex-compact -0.8% +1.4% -2.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +5.7% +1.4% +4.3% +10.0% ➖ noise
1 duckdb:duckdb +1.6% +1.4% +0.3% +10.0% ➖ noise
1 duckdb:vortex-compact -0.9% +1.4% -2.2% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +0.0% +1.4% -1.3% +10.0% ➖ noise
2 datafusion:arrow -0.3% +2.6% -2.8% +10.0% ➖ noise
2 datafusion:vortex-compact +2.7% +2.6% +0.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +3.5% +2.6% +0.9% +10.0% ➖ noise
2 duckdb:duckdb +6.2% +2.6% +3.5% +10.0% ➖ noise
2 duckdb:vortex-compact +2.5% +2.6% -0.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.4% +2.6% -1.1% +10.0% ➖ noise
3 datafusion:arrow +2.5% +1.9% +0.5% +10.0% ➖ noise
3 datafusion:vortex-compact +1.8% +1.9% -0.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +3.2% +1.9% +1.2% +10.0% ➖ noise
3 duckdb:duckdb +0.3% +1.9% -1.6% +10.0% ➖ noise
3 duckdb:vortex-compact +1.4% +1.9% -0.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +4.3% +1.9% +2.3% +10.0% ➖ noise
4 datafusion:arrow +4.5% -0.5% +5.1% +10.0% ➖ noise
4 datafusion:vortex-compact +0.9% -0.5% +1.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.9% -0.5% +3.4% +10.0% ➖ noise
4 duckdb:duckdb +0.2% -0.5% +0.7% +10.0% ➖ noise
4 duckdb:vortex-compact +0.8% -0.5% +1.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.2% -0.5% +3.8% +10.0% ➖ noise
5 datafusion:arrow +0.6% +1.4% -0.8% +10.0% ➖ noise
5 datafusion:vortex-compact +1.1% +1.4% -0.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +3.4% +1.4% +2.0% +10.0% ➖ noise
5 duckdb:duckdb +0.6% +1.4% -0.8% +10.0% ➖ noise
5 duckdb:vortex-compact +2.5% +1.4% +1.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +4.7% +1.4% +3.2% +10.0% ➖ noise
6 datafusion:arrow +2.0% -0.7% +2.7% +10.0% ➖ noise
6 datafusion:vortex-compact -0.3% -0.7% +0.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +4.0% -0.7% +4.6% +10.0% ➖ noise
6 duckdb:duckdb +2.9% -0.7% +3.6% +10.3% ➖ noise
6 duckdb:vortex-compact +2.3% -0.7% +2.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.5% -0.7% +3.2% +10.0% ➖ noise
7 datafusion:arrow +1.9% +1.9% -0.0% +10.0% ➖ noise
7 datafusion:vortex-compact +2.4% +1.9% +0.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +3.9% +1.9% +1.9% +10.0% ➖ noise
7 duckdb:duckdb +0.8% +1.9% -1.1% +10.0% ➖ noise
7 duckdb:vortex-compact -0.7% +1.9% -2.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.8% +1.9% -1.1% +10.0% ➖ noise
8 datafusion:arrow +2.1% +0.8% +1.3% +10.0% ➖ noise
8 datafusion:vortex-compact +2.0% +0.8% +1.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +3.2% +0.8% +2.4% +10.0% ➖ noise
8 duckdb:duckdb +0.5% +0.8% -0.3% +10.0% ➖ noise
8 duckdb:vortex-compact +3.9% +0.8% +3.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +4.1% +0.8% +3.3% +10.0% ➖ noise
9 datafusion:arrow +1.7% +3.0% -1.2% +10.0% ➖ noise
9 datafusion:vortex-compact +2.4% +3.0% -0.6% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.1% +3.0% -0.8% +10.0% ➖ noise
9 duckdb:duckdb -0.2% +3.0% -3.1% +10.0% ➖ noise
9 duckdb:vortex-compact -0.3% +3.0% -3.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.5% +3.0% -2.4% +10.0% ➖ noise
10 datafusion:arrow +2.5% +2.8% -0.3% +10.0% ➖ noise
10 datafusion:vortex-compact +1.8% +2.8% -1.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +2.2% +2.8% -0.6% +10.0% ➖ noise
10 duckdb:duckdb -1.4% +2.8% -4.1% +10.0% ➖ noise
10 duckdb:vortex-compact -1.5% +2.8% -4.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +4.5% +2.8% +1.6% +10.0% ➖ noise
11 datafusion:arrow +2.0% -0.3% +2.2% +10.0% ➖ noise
11 datafusion:vortex-compact -0.6% -0.3% -0.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.5% -0.3% +1.8% +10.0% ➖ noise
11 duckdb:duckdb -0.2% -0.3% +0.1% +13.2% ➖ noise
11 duckdb:vortex-compact -2.7% -0.3% -2.4% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +2.8% -0.3% +3.1% +10.0% ➖ noise
12 datafusion:arrow +5.1% +2.5% +2.5% +31.9% ➖ noise
12 datafusion:vortex-compact +0.6% +2.5% -1.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.5% +2.5% -1.0% +10.0% ➖ noise
12 duckdb:duckdb -0.8% +2.5% -3.2% +10.0% ➖ noise
12 duckdb:vortex-compact -0.4% +2.5% -2.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -1.7% +2.5% -4.1% +10.0% ➖ noise
13 datafusion:arrow +4.1% +0.6% +3.5% +10.0% ➖ noise
13 datafusion:vortex-compact +1.4% +0.6% +0.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.7% +0.6% +0.1% +10.0% ➖ noise
13 duckdb:duckdb +1.6% +0.6% +1.1% +10.0% ➖ noise
13 duckdb:vortex-compact -3.6% +0.6% -4.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -5.5% +0.6% -6.0% +10.0% ➖ noise
14 datafusion:arrow +1.7% -1.1% +2.9% +10.0% ➖ noise
14 datafusion:vortex-compact +0.6% -1.1% +1.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.0% -1.1% +2.1% +10.0% ➖ noise
14 duckdb:duckdb +1.3% -1.1% +2.4% +10.0% ➖ noise
14 duckdb:vortex-compact -3.4% -1.1% -2.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -11.5% -1.1% -10.5% +10.0% ✅ faster
15 datafusion:arrow +6.9% -0.7% +7.6% +10.0% ➖ noise
15 datafusion:vortex-compact +0.4% -0.7% +1.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.6% -0.7% +1.3% +10.0% ➖ noise
15 duckdb:duckdb +1.4% -0.7% +2.1% +10.0% ➖ noise
15 duckdb:vortex-compact +0.0% -0.7% +0.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +1.3% -0.7% +2.0% +10.0% ➖ noise
16 datafusion:arrow +0.9% -1.3% +2.2% +10.0% ➖ noise
16 datafusion:vortex-compact -0.2% -1.3% +1.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.5% -1.3% +1.9% +10.0% ➖ noise
16 duckdb:duckdb +0.5% -1.3% +1.8% +10.0% ➖ noise
16 duckdb:vortex-compact +5.2% -1.3% +6.6% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.4% -1.3% +2.8% +10.0% ➖ noise
17 datafusion:arrow +2.8% +2.1% +0.8% +10.0% ➖ noise
17 datafusion:vortex-compact +1.9% +2.1% -0.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +1.9% +2.1% -0.2% +10.0% ➖ noise
17 duckdb:duckdb -0.2% +2.1% -2.2% +10.0% ➖ noise
17 duckdb:vortex-compact +3.7% +2.1% +1.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.8% +2.1% -0.2% +10.0% ➖ noise
18 datafusion:arrow +2.5% +2.0% +0.4% +10.0% ➖ noise
18 datafusion:vortex-compact +0.7% +2.0% -1.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.8% +2.0% -0.3% +10.0% ➖ noise
18 duckdb:duckdb +1.8% +2.0% -0.2% +10.0% ➖ noise
18 duckdb:vortex-compact -0.5% +2.0% -2.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.3% +2.0% -2.3% +10.0% ➖ noise
19 datafusion:arrow +3.0% -0.5% +3.4% +10.0% ➖ noise
19 datafusion:vortex-compact -0.5% -0.5% -0.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -1.1% -0.5% -0.7% +10.0% ➖ noise
19 duckdb:duckdb +1.4% -0.5% +1.9% +10.0% ➖ noise
19 duckdb:vortex-compact -1.9% -0.5% -1.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.6% -0.5% -0.2% +10.0% ➖ noise
20 datafusion:arrow +4.9% +2.4% +2.4% +10.0% ➖ noise
20 datafusion:vortex-compact +0.4% +2.4% -2.0% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +1.1% +2.4% -1.3% +10.0% ➖ noise
20 duckdb:duckdb +0.9% +2.4% -1.5% +10.0% ➖ noise
20 duckdb:vortex-compact +2.6% +2.4% +0.2% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +2.9% +2.4% +0.4% +10.0% ➖ noise
21 datafusion:arrow +3.9% +3.2% +0.7% +10.0% ➖ noise
21 datafusion:vortex-compact +1.7% +3.2% -1.5% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +0.8% +3.2% -2.3% +10.0% ➖ noise
21 duckdb:duckdb -0.2% +3.2% -3.4% +10.0% ➖ noise
21 duckdb:vortex-compact +3.7% +3.2% +0.4% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.3% +3.2% -1.8% +10.0% ➖ noise
22 datafusion:arrow +3.6% +0.3% +3.3% +10.0% ➖ noise
22 datafusion:vortex-compact -1.1% +0.3% -1.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.4% +0.3% -0.6% +10.0% ➖ noise
22 duckdb:duckdb +2.7% +0.3% +2.4% +10.0% ➖ noise
22 duckdb:vortex-compact -0.7% +0.3% -0.9% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +0.9% +0.3% +0.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Vortex (geomean): 0.977x ➖
Parquet (geomean): 0.954x ➖
Shifts: Parquet (control) -4.6% · Median polish -3.0%


datafusion / vortex-file-compressed (0.944x ➖, 4↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1658679 1725893 0.96
clickbench_q01/datafusion:vortex-file-compressed 20477824 20041827 1.02
clickbench_q02/datafusion:vortex-file-compressed 37422950 38234408 0.98
clickbench_q03/datafusion:vortex-file-compressed 42692287 46478815 0.92
clickbench_q04/datafusion:vortex-file-compressed 🚀 284199171 316126005 0.90
clickbench_q05/datafusion:vortex-file-compressed 295600139 323196105 0.91
clickbench_q06/datafusion:vortex-file-compressed 1628817 1663140 0.98
clickbench_q07/datafusion:vortex-file-compressed 22640863 24083280 0.94
clickbench_q08/datafusion:vortex-file-compressed 351533176 380562512 0.92
clickbench_q09/datafusion:vortex-file-compressed 🚀 539055275 606336738 0.89
clickbench_q10/datafusion:vortex-file-compressed 74416547 78554121 0.95
clickbench_q11/datafusion:vortex-file-compressed 86546672 89356490 0.97
clickbench_q12/datafusion:vortex-file-compressed 266573960 288882793 0.92
clickbench_q13/datafusion:vortex-file-compressed 407089648 443425656 0.92
clickbench_q14/datafusion:vortex-file-compressed 252872170 272613210 0.93
clickbench_q15/datafusion:vortex-file-compressed 326429364 347831955 0.94
clickbench_q16/datafusion:vortex-file-compressed 641225107 711282008 0.90
clickbench_q17/datafusion:vortex-file-compressed 639846713 693466929 0.92
clickbench_q18/datafusion:vortex-file-compressed 1288716515 1429806592 0.90
clickbench_q19/datafusion:vortex-file-compressed 🚨 38183714 29741654 1.28
clickbench_q20/datafusion:vortex-file-compressed 339404714 341947068 0.99
clickbench_q21/datafusion:vortex-file-compressed 366935754 382072660 0.96
clickbench_q22/datafusion:vortex-file-compressed 446282997 466138917 0.96
clickbench_q23/datafusion:vortex-file-compressed 🚀 648946534 744402551 0.87
clickbench_q24/datafusion:vortex-file-compressed 45019828 46665517 0.96
clickbench_q25/datafusion:vortex-file-compressed 70259557 72903307 0.96
clickbench_q26/datafusion:vortex-file-compressed 44324059 45276957 0.98
clickbench_q27/datafusion:vortex-file-compressed 705777809 729646404 0.97
clickbench_q28/datafusion:vortex-file-compressed 6639669562 6793211464 0.98
clickbench_q29/datafusion:vortex-file-compressed 229961787 241355762 0.95
clickbench_q30/datafusion:vortex-file-compressed 221502481 232551085 0.95
clickbench_q31/datafusion:vortex-file-compressed 253301102 273420987 0.93
clickbench_q32/datafusion:vortex-file-compressed 🚀 1121856215 1248890538 0.90
clickbench_q33/datafusion:vortex-file-compressed 1283688200 1425090445 0.90
clickbench_q34/datafusion:vortex-file-compressed 1289855535 1353194129 0.95
clickbench_q35/datafusion:vortex-file-compressed 451420321 477824640 0.94
clickbench_q36/datafusion:vortex-file-compressed 69610239 75638594 0.92
clickbench_q37/datafusion:vortex-file-compressed 33886896 36268029 0.93
clickbench_q38/datafusion:vortex-file-compressed 18182984 20050057 0.91
clickbench_q39/datafusion:vortex-file-compressed 130485431 139263217 0.94
clickbench_q40/datafusion:vortex-file-compressed 15818842 16884849 0.94
clickbench_q41/datafusion:vortex-file-compressed 14493306 15652010 0.93
clickbench_q42/datafusion:vortex-file-compressed 16532706 18312469 0.90
datafusion / parquet (0.931x ➖, 6↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚀 1557575 1750315 0.89
clickbench_q01/datafusion:parquet 18617463 19127925 0.97
clickbench_q02/datafusion:parquet 45960173 49250980 0.93
clickbench_q03/datafusion:parquet 37212447 39280739 0.95
clickbench_q04/datafusion:parquet 🚀 288695721 327544247 0.88
clickbench_q05/datafusion:parquet 360649931 391894013 0.92
clickbench_q06/datafusion:parquet 1585181 1691863 0.94
clickbench_q07/datafusion:parquet 22156442 23187187 0.96
clickbench_q08/datafusion:parquet 365599032 405832031 0.90
clickbench_q09/datafusion:parquet 607246222 660375980 0.92
clickbench_q10/datafusion:parquet 104027504 111843127 0.93
clickbench_q11/datafusion:parquet 127665424 133826839 0.95
clickbench_q12/datafusion:parquet 337030538 373499741 0.90
clickbench_q13/datafusion:parquet 487450843 520900412 0.94
clickbench_q14/datafusion:parquet 349872556 361747317 0.97
clickbench_q15/datafusion:parquet 331871536 368718106 0.90
clickbench_q16/datafusion:parquet 675051733 713272832 0.95
clickbench_q17/datafusion:parquet 655447708 685236035 0.96
clickbench_q18/datafusion:parquet 1311325355 1402326328 0.94
clickbench_q19/datafusion:parquet 29290768 31077119 0.94
clickbench_q20/datafusion:parquet 592242252 631128046 0.94
clickbench_q21/datafusion:parquet 654999770 698374340 0.94
clickbench_q22/datafusion:parquet 956328913 994703523 0.96
clickbench_q23/datafusion:parquet 3571971323 3834131844 0.93
clickbench_q24/datafusion:parquet 83496685 90349647 0.92
clickbench_q25/datafusion:parquet 129206010 139914637 0.92
clickbench_q26/datafusion:parquet 81531506 88796667 0.92
clickbench_q27/datafusion:parquet 1037546175 1101632027 0.94
clickbench_q28/datafusion:parquet 6513837013 6789349618 0.96
clickbench_q29/datafusion:parquet 243206641 240945191 1.01
clickbench_q30/datafusion:parquet 318479820 326534536 0.98
clickbench_q31/datafusion:parquet 352497376 371062352 0.95
clickbench_q32/datafusion:parquet 1170776832 1260948160 0.93
clickbench_q33/datafusion:parquet 1467202778 1542389331 0.95
clickbench_q34/datafusion:parquet 🚀 1450038119 1631073422 0.89
clickbench_q35/datafusion:parquet 458124885 478963781 0.96
clickbench_q36/datafusion:parquet 🚀 139306957 154856759 0.90
clickbench_q37/datafusion:parquet 55913496 61731661 0.91
clickbench_q38/datafusion:parquet 82863079 88947181 0.93
clickbench_q39/datafusion:parquet 🚀 255206591 285986863 0.89
clickbench_q40/datafusion:parquet 30296338 33388623 0.91
clickbench_q41/datafusion:parquet 🚀 26229077 30160122 0.87
clickbench_q42/datafusion:parquet 28637645 30483585 0.94
duckdb / vortex-file-compressed (1.010x ➖, 7↑ 13↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 11369440 6881452 1.65
clickbench_q01/duckdb:vortex-file-compressed 🚨 19179452 13653542 1.40
clickbench_q02/duckdb:vortex-file-compressed 🚨 30466867 26667658 1.14
clickbench_q03/duckdb:vortex-file-compressed 35139295 32625395 1.08
clickbench_q04/duckdb:vortex-file-compressed 179547701 190952773 0.94
clickbench_q05/duckdb:vortex-file-compressed 🚀 172802649 192040745 0.90
clickbench_q06/duckdb:vortex-file-compressed 🚨 25893990 20695128 1.25
clickbench_q07/duckdb:vortex-file-compressed 🚨 19214775 17067499 1.13
clickbench_q08/duckdb:vortex-file-compressed 253514137 265595116 0.95
clickbench_q09/duckdb:vortex-file-compressed 326495406 360188470 0.91
clickbench_q10/duckdb:vortex-file-compressed 69974895 71492818 0.98
clickbench_q11/duckdb:vortex-file-compressed 79671216 78836195 1.01
clickbench_q12/duckdb:vortex-file-compressed 190804432 204262853 0.93
clickbench_q13/duckdb:vortex-file-compressed 390496750 416789982 0.94
clickbench_q14/duckdb:vortex-file-compressed 229228292 242297413 0.95
clickbench_q15/duckdb:vortex-file-compressed 🚀 218639971 254362381 0.86
clickbench_q16/duckdb:vortex-file-compressed 🚀 559406757 635786441 0.88
clickbench_q17/duckdb:vortex-file-compressed 467174109 480331646 0.97
clickbench_q18/duckdb:vortex-file-compressed 990462956 1009332538 0.98
clickbench_q19/duckdb:vortex-file-compressed 🚨 26218888 22387592 1.17
clickbench_q20/duckdb:vortex-file-compressed 🚀 327004080 372174272 0.88
clickbench_q21/duckdb:vortex-file-compressed 355811878 389955017 0.91
clickbench_q22/duckdb:vortex-file-compressed 554894796 576993769 0.96
clickbench_q23/duckdb:vortex-file-compressed 🚀 214990365 340140916 0.63
clickbench_q24/duckdb:vortex-file-compressed 37263380 36788787 1.01
clickbench_q25/duckdb:vortex-file-compressed 83865659 76313280 1.10
clickbench_q26/duckdb:vortex-file-compressed 45881635 48269267 0.95
clickbench_q27/duckdb:vortex-file-compressed 465723033 478509809 0.97
clickbench_q28/duckdb:vortex-file-compressed 2973617535 3072812801 0.97
clickbench_q29/duckdb:vortex-file-compressed 🚨 34115962 29549226 1.15
clickbench_q30/duckdb:vortex-file-compressed 188666798 191545663 0.98
clickbench_q31/duckdb:vortex-file-compressed 282932166 307225416 0.92
clickbench_q32/duckdb:vortex-file-compressed 🚀 1159248465 1308080982 0.89
clickbench_q33/duckdb:vortex-file-compressed 1148804151 1246335875 0.92
clickbench_q34/duckdb:vortex-file-compressed 1222585871 1310028798 0.93
clickbench_q35/duckdb:vortex-file-compressed 🚀 292270809 390530832 0.75
clickbench_q36/duckdb:vortex-file-compressed 🚨 34486417 29740539 1.16
clickbench_q37/duckdb:vortex-file-compressed 🚨 27044680 23260766 1.16
clickbench_q38/duckdb:vortex-file-compressed 🚨 27865729 24607929 1.13
clickbench_q39/duckdb:vortex-file-compressed 45818471 45213936 1.01
clickbench_q40/duckdb:vortex-file-compressed 🚨 26814640 22284005 1.20
clickbench_q41/duckdb:vortex-file-compressed 🚨 27604577 22871904 1.21
clickbench_q42/duckdb:vortex-file-compressed 🚨 27343119 23710037 1.15
duckdb / parquet (0.976x ➖, 1↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 26943467 27109739 0.99
clickbench_q01/duckdb:parquet 27918815 27288756 1.02
clickbench_q02/duckdb:parquet 48380346 49253077 0.98
clickbench_q03/duckdb:parquet 38476217 39954551 0.96
clickbench_q04/duckdb:parquet 201839564 202935221 0.99
clickbench_q05/duckdb:parquet 273506872 265877410 1.03
clickbench_q06/duckdb:parquet 46644509 46333908 1.01
clickbench_q07/duckdb:parquet 29260989 29614668 0.99
clickbench_q08/duckdb:parquet 267114522 279575294 0.96
clickbench_q09/duckdb:parquet 394508693 415760264 0.95
clickbench_q10/duckdb:parquet 80277279 81299903 0.99
clickbench_q11/duckdb:parquet 98674759 99396864 0.99
clickbench_q12/duckdb:parquet 288646855 298401632 0.97
clickbench_q13/duckdb:parquet 470817724 485903254 0.97
clickbench_q14/duckdb:parquet 328169520 334278750 0.98
clickbench_q15/duckdb:parquet 263839624 268341577 0.98
clickbench_q16/duckdb:parquet 629925416 693611368 0.91
clickbench_q17/duckdb:parquet 535342058 551572598 0.97
clickbench_q18/duckdb:parquet 1060850040 1095023175 0.97
clickbench_q19/duckdb:parquet 24882844 25967417 0.96
clickbench_q20/duckdb:parquet 422339800 445554183 0.95
clickbench_q21/duckdb:parquet 548472463 566707033 0.97
clickbench_q22/duckdb:parquet 938271523 954260090 0.98
clickbench_q23/duckdb:parquet 308752949 317596527 0.97
clickbench_q24/duckdb:parquet 67842906 69898344 0.97
clickbench_q25/duckdb:parquet 155924748 159441046 0.98
clickbench_q26/duckdb:parquet 50147932 51998387 0.96
clickbench_q27/duckdb:parquet 646480046 652855259 0.99
clickbench_q28/duckdb:parquet 4846418221 4944614253 0.98
clickbench_q29/duckdb:parquet 40262997 41087598 0.98
clickbench_q30/duckdb:parquet 296630239 305329328 0.97
clickbench_q31/duckdb:parquet 359493536 370194261 0.97
clickbench_q32/duckdb:parquet 1188391669 1210792927 0.98
clickbench_q33/duckdb:parquet 1302182330 1266260874 1.03
clickbench_q34/duckdb:parquet 1396986381 1349543614 1.04
clickbench_q35/duckdb:parquet 361704358 374515094 0.97
clickbench_q36/duckdb:parquet 46841966 48517075 0.97
clickbench_q37/duckdb:parquet 31196724 33448542 0.93
clickbench_q38/duckdb:parquet 34843748 36710773 0.95
clickbench_q39/duckdb:parquet 🚀 73626715 87661967 0.84
clickbench_q40/duckdb:parquet 17724976 19234725 0.92
clickbench_q41/duckdb:parquet 19575264 18011517 1.09
clickbench_q42/duckdb:parquet 23018989 21705362 1.06
duckdb / duckdb (0.968x ➖, 2↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17688317 18957935 0.93
clickbench_q01/duckdb:duckdb 34133331 34828947 0.98
clickbench_q02/duckdb:duckdb 46271634 47375394 0.98
clickbench_q03/duckdb:duckdb 47727211 49814170 0.96
clickbench_q04/duckdb:duckdb 189419173 198272970 0.96
clickbench_q05/duckdb:duckdb 265944920 268948763 0.99
clickbench_q06/duckdb:duckdb 🚀 28549567 38334741 0.74
clickbench_q07/duckdb:duckdb 36858750 36196865 1.02
clickbench_q08/duckdb:duckdb 248599916 256166214 0.97
clickbench_q09/duckdb:duckdb 368720900 385529777 0.96
clickbench_q10/duckdb:duckdb 98066934 102219636 0.96
clickbench_q11/duckdb:duckdb 108839098 108937151 1.00
clickbench_q12/duckdb:duckdb 238378962 242037712 0.98
clickbench_q13/duckdb:duckdb 472089946 483991429 0.98
clickbench_q14/duckdb:duckdb 272983164 287636432 0.95
clickbench_q15/duckdb:duckdb 218819397 227146610 0.96
clickbench_q16/duckdb:duckdb 640778767 656300143 0.98
clickbench_q17/duckdb:duckdb 541154714 549923234 0.98
clickbench_q18/duckdb:duckdb 1214867507 1219063432 1.00
clickbench_q19/duckdb:duckdb 35841660 35967930 1.00
clickbench_q20/duckdb:duckdb 888179887 904302683 0.98
clickbench_q21/duckdb:duckdb 946256072 975144571 0.97
clickbench_q22/duckdb:duckdb 1121664614 1050149778 1.07
clickbench_q23/duckdb:duckdb 256637216 263073800 0.98
clickbench_q24/duckdb:duckdb 62500900 63529832 0.98
clickbench_q25/duckdb:duckdb 143175411 146945463 0.97
clickbench_q26/duckdb:duckdb 61199492 64807734 0.94
clickbench_q27/duckdb:duckdb 1018367171 1000454407 1.02
clickbench_q28/duckdb:duckdb 4606101174 4746313491 0.97
clickbench_q29/duckdb:duckdb 49474159 50518602 0.98
clickbench_q30/duckdb:duckdb 256678817 269547657 0.95
clickbench_q31/duckdb:duckdb 399359222 391782643 1.02
clickbench_q32/duckdb:duckdb 1459585778 1392104655 1.05
clickbench_q33/duckdb:duckdb 1919368774 1855398436 1.03
clickbench_q34/duckdb:duckdb 1989289312 2040700365 0.97
clickbench_q35/duckdb:duckdb 279125465 304364756 0.92
clickbench_q36/duckdb:duckdb 41040303 42743034 0.96
clickbench_q37/duckdb:duckdb 32128184 31882003 1.01
clickbench_q38/duckdb:duckdb 🚀 31156144 35001954 0.89
clickbench_q39/duckdb:duckdb 62977557 69537340 0.91
clickbench_q40/duckdb:duckdb 32079620 34398507 0.93
clickbench_q41/duckdb:duckdb 31447154 32327705 0.97
clickbench_q42/duckdb:duckdb 32432666 34315657 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -3.9% -6.0% +2.2% +770.4% ➖ noise
0 duckdb:duckdb -6.7% -6.0% -0.8% +286.1% ➖ noise
0 duckdb:vortex-file-compressed +65.2% -6.0% +75.7% +398.7% ➖ noise
1 datafusion:vortex-file-compressed +2.2% -0.2% +2.4% +27.9% ➖ noise
1 duckdb:duckdb -2.0% -0.2% -1.8% +58.6% ➖ noise
1 duckdb:vortex-file-compressed +40.5% -0.2% +40.8% +25.4% 🚨 regression
2 datafusion:vortex-file-compressed -2.1% -4.3% +2.2% +12.1% ➖ noise
2 duckdb:duckdb -2.3% -4.3% +2.0% +19.2% ➖ noise
2 duckdb:vortex-file-compressed +14.2% -4.3% +19.3% +12.2% 🚨 regression
3 datafusion:vortex-file-compressed -8.1% -4.5% -3.8% +135.9% ➖ noise
3 duckdb:duckdb -4.2% -4.5% +0.3% +39.5% ➖ noise
3 duckdb:vortex-file-compressed +7.7% -4.5% +12.8% +92.6% ➖ noise
4 datafusion:vortex-file-compressed -10.1% -6.4% -4.0% +10.0% ➖ noise
4 duckdb:duckdb -4.5% -6.4% +2.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -6.0% -6.4% +0.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -8.5% -2.7% -6.0% +10.0% ➖ noise
5 duckdb:duckdb -1.1% -2.7% +1.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -10.0% -2.7% -7.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.1% -2.9% +0.8% +42.0% ➖ noise
6 duckdb:duckdb -25.5% -2.9% -23.3% +31.8% ➖ noise
6 duckdb:vortex-file-compressed +25.1% -2.9% +28.8% +20.3% 🚨 regression
7 datafusion:vortex-file-compressed -6.0% -2.8% -3.2% +11.9% ➖ noise
7 duckdb:duckdb +1.8% -2.8% +4.8% +12.3% ➖ noise
7 duckdb:vortex-file-compressed +12.6% -2.8% +15.9% +10.0% 🚨 regression
8 datafusion:vortex-file-compressed -7.6% -7.2% -0.4% +10.0% ➖ noise
8 duckdb:duckdb -3.0% -7.2% +4.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -4.5% -7.2% +2.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -11.1% -6.6% -4.8% +10.0% ➖ noise
9 duckdb:duckdb -4.4% -6.6% +2.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -9.4% -6.6% -3.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -5.3% -4.2% -1.1% +10.0% ➖ noise
10 duckdb:duckdb -4.1% -4.2% +0.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.1% -4.2% +2.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.1% -2.7% -0.5% +10.0% ➖ noise
11 duckdb:duckdb -0.1% -2.7% +2.7% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +1.1% -2.7% +3.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -7.7% -6.6% -1.2% +10.0% ➖ noise
12 duckdb:duckdb -1.5% -6.6% +5.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -6.6% -6.6% -0.0% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -8.2% -4.8% -3.6% +10.0% ➖ noise
13 duckdb:duckdb -2.5% -4.8% +2.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -6.3% -4.8% -1.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -7.2% -2.6% -4.8% +10.0% ➖ noise
14 duckdb:duckdb -5.1% -2.6% -2.6% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -5.4% -2.6% -2.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -6.2% -5.9% -0.2% +10.0% ➖ noise
15 duckdb:duckdb -3.7% -5.9% +2.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -14.0% -5.9% -8.6% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -9.8% -7.3% -2.8% +10.0% ➖ noise
16 duckdb:duckdb -2.4% -7.3% +5.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -12.0% -7.3% -5.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -7.7% -3.6% -4.2% +10.0% ➖ noise
17 duckdb:duckdb -1.6% -3.6% +2.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -2.7% -3.6% +0.9% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -9.9% -4.8% -5.3% +10.0% ➖ noise
18 duckdb:duckdb -0.3% -4.8% +4.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.9% -4.8% +3.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +28.4% -5.0% +35.1% +33.8% 🚨 regression
19 duckdb:duckdb -0.4% -5.0% +4.9% +15.9% ➖ noise
19 duckdb:vortex-file-compressed +17.1% -5.0% +23.2% +17.7% 🚨 regression
20 datafusion:vortex-file-compressed -0.7% -5.7% +5.2% +207.5% ➖ noise
20 duckdb:duckdb -1.8% -5.7% +4.1% +25.2% ➖ noise
20 duckdb:vortex-file-compressed -12.1% -5.7% -6.8% +99.6% ➖ noise
21 datafusion:vortex-file-compressed -4.0% -4.7% +0.8% +10.0% ➖ noise
21 duckdb:duckdb -3.0% -4.7% +1.9% +10.5% ➖ noise
21 duckdb:vortex-file-compressed -8.8% -4.7% -4.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -4.3% -2.8% -1.5% +15.1% ➖ noise
22 duckdb:duckdb +6.8% -2.8% +9.9% +13.2% ➖ noise
22 duckdb:vortex-file-compressed -3.8% -2.8% -1.1% +19.4% ➖ noise
23 datafusion:vortex-file-compressed -12.8% -4.8% -8.4% +47.1% ➖ noise
23 duckdb:duckdb -2.4% -4.8% +2.5% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -36.8% -4.8% -33.6% +19.0% ✅ faster
24 datafusion:vortex-file-compressed -3.5% -5.3% +1.9% +12.3% ➖ noise
24 duckdb:duckdb -1.6% -5.3% +3.9% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +1.3% -5.3% +6.9% +15.5% ➖ noise
25 datafusion:vortex-file-compressed -3.6% -5.0% +1.4% +10.0% ➖ noise
25 duckdb:duckdb -2.6% -5.0% +2.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +9.9% -5.0% +15.6% +10.0% 🚨 regression
26 datafusion:vortex-file-compressed -2.1% -5.9% +4.0% +10.0% ➖ noise
26 duckdb:duckdb -5.6% -5.9% +0.4% +13.4% ➖ noise
26 duckdb:vortex-file-compressed -4.9% -5.9% +1.0% +16.7% ➖ noise
27 datafusion:vortex-file-compressed -3.3% -3.4% +0.2% +10.0% ➖ noise
27 duckdb:duckdb +1.8% -3.4% +5.4% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -2.7% -3.4% +0.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -2.3% -3.0% +0.8% +10.0% ➖ noise
28 duckdb:duckdb -3.0% -3.0% +0.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -3.2% -3.0% -0.2% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -4.7% -0.5% -4.2% +10.0% ➖ noise
29 duckdb:duckdb -2.1% -0.5% -1.5% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +15.5% -0.5% +16.1% +18.9% ➖ noise
30 datafusion:vortex-file-compressed -4.8% -2.7% -2.2% +10.0% ➖ noise
30 duckdb:duckdb -4.8% -2.7% -2.2% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -1.5% -2.7% +1.2% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -7.4% -4.0% -3.5% +10.0% ➖ noise
31 duckdb:duckdb +1.9% -4.0% +6.1% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -7.9% -4.0% -4.1% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -10.2% -4.5% -5.9% +11.1% ➖ noise
32 duckdb:duckdb +4.8% -4.5% +9.8% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -11.4% -4.5% -7.2% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -9.9% -1.1% -8.9% +10.0% ➖ noise
33 duckdb:duckdb +3.4% -1.1% +4.6% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -7.8% -1.1% -6.8% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -4.7% -4.1% -0.6% +10.0% ➖ noise
34 duckdb:duckdb -2.5% -4.1% +1.6% +13.9% ➖ noise
34 duckdb:vortex-file-compressed -6.7% -4.1% -2.7% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -5.5% -3.9% -1.7% +10.0% ➖ noise
35 duckdb:duckdb -8.3% -3.9% -4.6% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -25.2% -3.9% -22.1% +10.0% ✅ faster
36 datafusion:vortex-file-compressed -8.0% -6.8% -1.2% +11.3% ➖ noise
36 duckdb:duckdb -4.0% -6.8% +3.0% +17.0% ➖ noise
36 duckdb:vortex-file-compressed +16.0% -6.8% +24.4% +13.1% 🚨 regression
37 datafusion:vortex-file-compressed -6.6% -8.1% +1.7% +10.0% ➖ noise
37 duckdb:duckdb +0.8% -8.1% +9.6% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +16.3% -8.1% +26.5% +22.5% 🚨 regression
38 datafusion:vortex-file-compressed -9.3% -6.0% -3.6% +11.7% ➖ noise
38 duckdb:duckdb -11.0% -6.0% -5.3% +11.7% ➖ noise
38 duckdb:vortex-file-compressed +13.2% -6.0% +20.4% +10.1% 🚨 regression
39 datafusion:vortex-file-compressed -6.3% -13.4% +8.2% +10.0% ➖ noise
39 duckdb:duckdb -9.4% -13.4% +4.6% +21.1% ➖ noise
39 duckdb:vortex-file-compressed +1.3% -13.4% +17.1% +10.8% 🚨 regression
40 datafusion:vortex-file-compressed -6.3% -8.6% +2.5% +10.3% ➖ noise
40 duckdb:duckdb -6.7% -8.6% +2.0% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +20.3% -8.6% +31.6% +10.0% 🚨 regression
41 datafusion:vortex-file-compressed -7.4% -2.8% -4.8% +10.7% ➖ noise
41 duckdb:duckdb -2.7% -2.8% +0.1% +12.2% ➖ noise
41 duckdb:vortex-file-compressed +20.7% -2.8% +24.1% +13.9% 🚨 regression
42 datafusion:vortex-file-compressed -9.7% -0.2% -9.6% +10.0% ✅ faster
42 duckdb:duckdb -5.5% -0.2% -5.3% +10.8% ➖ noise
42 duckdb:vortex-file-compressed +15.3% -0.2% +15.5% +14.6% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.2%
Vortex (geomean): 0.957x ➖
Parquet (geomean): 0.969x ➖
Shifts: Parquet (control) -3.1% · Median polish -4.1%


datafusion / vortex-file-compressed (1.019x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 244878422 250576604 0.98
tpch_q02/datafusion:vortex-file-compressed 444813529 501841167 0.89
tpch_q03/datafusion:vortex-file-compressed 426729048 448248552 0.95
tpch_q04/datafusion:vortex-file-compressed 288993070 315928830 0.91
tpch_q05/datafusion:vortex-file-compressed 480308011 443792842 1.08
tpch_q06/datafusion:vortex-file-compressed 377383358 363640767 1.04
tpch_q07/datafusion:vortex-file-compressed 485487380 433614859 1.12
tpch_q08/datafusion:vortex-file-compressed 660694708 719235126 0.92
tpch_q09/datafusion:vortex-file-compressed 521511207 572641555 0.91
tpch_q10/datafusion:vortex-file-compressed 641978249 514423889 1.25
tpch_q11/datafusion:vortex-file-compressed 320379866 323534977 0.99
tpch_q12/datafusion:vortex-file-compressed 657656410 580404210 1.13
tpch_q13/datafusion:vortex-file-compressed 🚨 257570677 158150897 1.63
tpch_q14/datafusion:vortex-file-compressed 303399947 302966264 1.00
tpch_q15/datafusion:vortex-file-compressed 489430198 539229358 0.91
tpch_q16/datafusion:vortex-file-compressed 218981993 207210354 1.06
tpch_q17/datafusion:vortex-file-compressed 431378787 441922778 0.98
tpch_q18/datafusion:vortex-file-compressed 398947225 396790665 1.01
tpch_q19/datafusion:vortex-file-compressed 536427275 540566517 0.99
tpch_q20/datafusion:vortex-file-compressed 457461580 456228667 1.00
tpch_q21/datafusion:vortex-file-compressed 584148281 622903759 0.94
tpch_q22/datafusion:vortex-file-compressed 117583186 123013440 0.96
datafusion / vortex-compact (0.901x ➖, 2↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 292205114 260092390 1.12
tpch_q02/datafusion:vortex-compact 481904211 500130292 0.96
tpch_q03/datafusion:vortex-compact 443486806 394431903 1.12
tpch_q04/datafusion:vortex-compact 337932881 263961868 1.28
tpch_q05/datafusion:vortex-compact 389222318 451488174 0.86
tpch_q06/datafusion:vortex-compact 350384532 372900143 0.94
tpch_q07/datafusion:vortex-compact 404054297 475969224 0.85
tpch_q08/datafusion:vortex-compact 481560922 516229945 0.93
tpch_q09/datafusion:vortex-compact 369376015 390653634 0.95
tpch_q10/datafusion:vortex-compact 🚀 399863189 576359874 0.69
tpch_q11/datafusion:vortex-compact 🚀 258877854 465150369 0.56
tpch_q12/datafusion:vortex-compact 443235565 458583101 0.97
tpch_q13/datafusion:vortex-compact 120145549 141154277 0.85
tpch_q14/datafusion:vortex-compact 293539390 316789785 0.93
tpch_q15/datafusion:vortex-compact 517101639 606796084 0.85
tpch_q16/datafusion:vortex-compact 192919286 256684265 0.75
tpch_q17/datafusion:vortex-compact 411210064 429542102 0.96
tpch_q18/datafusion:vortex-compact 287363233 304300346 0.94
tpch_q19/datafusion:vortex-compact 472795553 488424743 0.97
tpch_q20/datafusion:vortex-compact 450348069 489647736 0.92
tpch_q21/datafusion:vortex-compact 552075494 642721175 0.86
tpch_q22/datafusion:vortex-compact 110208326 135189973 0.82
datafusion / parquet (0.984x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 236525955 245085659 0.97
tpch_q02/datafusion:parquet 395005150 431102583 0.92
tpch_q03/datafusion:parquet 325082536 341605599 0.95
tpch_q04/datafusion:parquet 168312085 173266592 0.97
tpch_q05/datafusion:parquet 458072614 510614265 0.90
tpch_q06/datafusion:parquet 161235205 175394224 0.92
tpch_q07/datafusion:parquet 480789824 546706619 0.88
tpch_q08/datafusion:parquet 583695479 580399382 1.01
tpch_q09/datafusion:parquet 498706553 476828675 1.05
tpch_q10/datafusion:parquet 629960309 510686757 1.23
tpch_q11/datafusion:parquet 391511174 350282779 1.12
tpch_q12/datafusion:parquet 270181307 235975949 1.14
tpch_q13/datafusion:parquet 484412986 472035245 1.03
tpch_q14/datafusion:parquet 197984752 219461320 0.90
tpch_q15/datafusion:parquet 368518340 340558314 1.08
tpch_q16/datafusion:parquet 188276337 169477512 1.11
tpch_q17/datafusion:parquet 468369500 426158642 1.10
tpch_q18/datafusion:parquet 547767297 453617880 1.21
tpch_q19/datafusion:parquet 382796577 407543633 0.94
tpch_q20/datafusion:parquet 312009761 420530156 0.74
tpch_q21/datafusion:parquet 486771280 556438733 0.87
tpch_q22/datafusion:parquet 107593816 136621838 0.79
duckdb / vortex-file-compressed (0.956x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 273090249 315744863 0.86
tpch_q02/duckdb:vortex-file-compressed 969242935 1036825356 0.93
tpch_q03/duckdb:vortex-file-compressed 718750306 749102606 0.96
tpch_q04/duckdb:vortex-file-compressed 445206884 423201113 1.05
tpch_q05/duckdb:vortex-file-compressed 942932673 1011469228 0.93
tpch_q06/duckdb:vortex-file-compressed 430225337 440476932 0.98
tpch_q07/duckdb:vortex-file-compressed 875133131 812726360 1.08
tpch_q08/duckdb:vortex-file-compressed 993578405 1114123909 0.89
tpch_q09/duckdb:vortex-file-compressed 890339497 955427386 0.93
tpch_q10/duckdb:vortex-file-compressed 816100042 890686770 0.92
tpch_q11/duckdb:vortex-file-compressed 529428230 565683690 0.94
tpch_q12/duckdb:vortex-file-compressed 533801725 527704542 1.01
tpch_q13/duckdb:vortex-file-compressed 498129446 502952095 0.99
tpch_q14/duckdb:vortex-file-compressed 469813373 576014042 0.82
tpch_q15/duckdb:vortex-file-compressed 378179075 317876045 1.19
tpch_q16/duckdb:vortex-file-compressed 401069207 412801415 0.97
tpch_q17/duckdb:vortex-file-compressed 736812039 842937685 0.87
tpch_q18/duckdb:vortex-file-compressed 617969774 640939532 0.96
tpch_q19/duckdb:vortex-file-compressed 545497909 488292589 1.12
tpch_q20/duckdb:vortex-file-compressed 926118327 953473758 0.97
tpch_q21/duckdb:vortex-file-compressed 1098444201 1129830200 0.97
tpch_q22/duckdb:vortex-file-compressed 362504065 463227848 0.78
duckdb / vortex-compact (0.955x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 286657299 285846884 1.00
tpch_q02/duckdb:vortex-compact 920037706 990481649 0.93
tpch_q03/duckdb:vortex-compact 649733008 634607273 1.02
tpch_q04/duckdb:vortex-compact 369577034 381740038 0.97
tpch_q05/duckdb:vortex-compact 907997200 931333989 0.97
tpch_q06/duckdb:vortex-compact 439279764 437724115 1.00
tpch_q07/duckdb:vortex-compact 836687294 906711604 0.92
tpch_q08/duckdb:vortex-compact 949577756 1006765408 0.94
tpch_q09/duckdb:vortex-compact 801489228 1006270788 0.80
tpch_q10/duckdb:vortex-compact 690876586 874350711 0.79
tpch_q11/duckdb:vortex-compact 513996811 515161189 1.00
tpch_q12/duckdb:vortex-compact 457393142 479771314 0.95
tpch_q13/duckdb:vortex-compact 457492283 426089019 1.07
tpch_q14/duckdb:vortex-compact 483148197 521473580 0.93
tpch_q15/duckdb:vortex-compact 299969767 334895573 0.90
tpch_q16/duckdb:vortex-compact 399040882 378494500 1.05
tpch_q17/duckdb:vortex-compact 592386459 636781036 0.93
tpch_q18/duckdb:vortex-compact 473038679 480649865 0.98
tpch_q19/duckdb:vortex-compact 467692941 457550025 1.02
tpch_q20/duckdb:vortex-compact 779465227 812397151 0.96
tpch_q21/duckdb:vortex-compact 1029864369 1083286653 0.95
tpch_q22/duckdb:vortex-compact 377118232 389271360 0.97
duckdb / parquet (0.955x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 463233598 587008673 0.79
tpch_q02/duckdb:parquet 1159081855 1134298680 1.02
tpch_q03/duckdb:parquet 1109436395 1166839215 0.95
tpch_q04/duckdb:parquet 721465626 782185136 0.92
tpch_q05/duckdb:parquet 1315973723 1386115265 0.95
tpch_q06/duckdb:parquet 425372241 451925149 0.94
tpch_q07/duckdb:parquet 1247717598 1220312511 1.02
tpch_q08/duckdb:parquet 1581917519 1729858686 0.91
tpch_q09/duckdb:parquet 1431069708 1525037354 0.94
tpch_q10/duckdb:parquet 1334380986 1348877741 0.99
tpch_q11/duckdb:parquet 752923222 831232954 0.91
tpch_q12/duckdb:parquet 745241039 808505598 0.92
tpch_q13/duckdb:parquet 944018790 964753080 0.98
tpch_q14/duckdb:parquet 825085076 785480435 1.05
tpch_q15/duckdb:parquet 543690217 606827601 0.90
tpch_q16/duckdb:parquet 666133982 642207312 1.04
tpch_q17/duckdb:parquet 741332140 933623678 0.79
tpch_q18/duckdb:parquet 937107170 973580748 0.96
tpch_q19/duckdb:parquet 862696037 838646206 1.03
tpch_q20/duckdb:parquet 1273619223 1125982658 1.13
tpch_q21/duckdb:parquet 1150351879 1137606210 1.01
tpch_q22/duckdb:parquet 589045616 643634951 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +12.3% -12.7% +28.7% +71.9% ➖ noise
1 datafusion:vortex-file-compressed -2.3% -12.7% +12.0% +70.5% ➖ noise
1 duckdb:vortex-compact +0.3% -12.7% +14.9% +52.9% ➖ noise
1 duckdb:vortex-file-compressed -13.5% -12.7% -0.9% +46.3% ➖ noise
2 datafusion:vortex-compact -3.6% -3.2% -0.4% +32.8% ➖ noise
2 datafusion:vortex-file-compressed -11.4% -3.2% -8.4% +30.0% ➖ noise
2 duckdb:vortex-compact -7.1% -3.2% -4.0% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -6.5% -3.2% -3.4% +30.0% ➖ noise
3 datafusion:vortex-compact +12.4% -4.9% +18.2% +44.1% ➖ noise
3 datafusion:vortex-file-compressed -4.8% -4.9% +0.1% +54.8% ➖ noise
3 duckdb:vortex-compact +2.4% -4.9% +7.6% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -4.1% -4.9% +0.9% +30.1% ➖ noise
4 datafusion:vortex-compact +28.0% -5.3% +35.2% +30.0% 🚨 regression
4 datafusion:vortex-file-compressed -8.5% -5.3% -3.4% +30.0% ➖ noise
4 duckdb:vortex-compact -3.2% -5.3% +2.3% +37.8% ➖ noise
4 duckdb:vortex-file-compressed +5.2% -5.3% +11.1% +30.0% ➖ noise
5 datafusion:vortex-compact -13.8% -7.7% -6.6% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +8.2% -7.7% +17.3% +30.0% ➖ noise
5 duckdb:vortex-compact -2.5% -7.7% +5.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -6.8% -7.7% +1.0% +30.0% ➖ noise
6 datafusion:vortex-compact -6.0% -7.0% +1.0% +40.1% ➖ noise
6 datafusion:vortex-file-compressed +3.8% -7.0% +11.6% +30.0% ➖ noise
6 duckdb:vortex-compact +0.4% -7.0% +7.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -2.3% -7.0% +5.0% +30.0% ➖ noise
7 datafusion:vortex-compact -15.1% -5.2% -10.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +12.0% -5.2% +18.1% +30.0% ➖ noise
7 duckdb:vortex-compact -7.7% -5.2% -2.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +7.7% -5.2% +13.6% +30.0% ➖ noise
8 datafusion:vortex-compact -6.7% -4.1% -2.7% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -8.1% -4.1% -4.2% +30.0% ➖ noise
8 duckdb:vortex-compact -5.7% -4.1% -1.6% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -10.8% -4.1% -7.0% +30.0% ➖ noise
9 datafusion:vortex-compact -5.4% -0.9% -4.6% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -8.9% -0.9% -8.1% +40.4% ➖ noise
9 duckdb:vortex-compact -20.4% -0.9% -19.6% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -6.8% -0.9% -5.9% +30.0% ➖ noise
10 datafusion:vortex-compact -30.6% +10.5% -37.2% +30.0% ✅ faster
10 datafusion:vortex-file-compressed +24.8% +10.5% +13.0% +39.2% ➖ noise
10 duckdb:vortex-compact -21.0% +10.5% -28.5% +30.0% ✅ faster
10 duckdb:vortex-file-compressed -8.4% +10.5% -17.1% +30.0% ➖ noise
11 datafusion:vortex-compact -44.3% +0.6% -44.7% +33.2% ✅ faster
11 datafusion:vortex-file-compressed -1.0% +0.6% -1.6% +37.6% ➖ noise
11 duckdb:vortex-compact -0.2% +0.6% -0.8% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -6.4% +0.6% -7.0% +30.0% ➖ noise
12 datafusion:vortex-compact -3.3% +2.7% -5.9% +105.7% ➖ noise
12 datafusion:vortex-file-compressed +13.3% +2.7% +10.3% +30.0% ➖ noise
12 duckdb:vortex-compact -4.7% +2.7% -7.2% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +1.2% +2.7% -1.5% +30.0% ➖ noise
13 datafusion:vortex-compact -14.9% +0.2% -15.1% +59.8% ➖ noise
13 datafusion:vortex-file-compressed +62.9% +0.2% +62.5% +46.7% 🚨 regression
13 duckdb:vortex-compact +7.4% +0.2% +7.1% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -1.0% +0.2% -1.2% +30.0% ➖ noise
14 datafusion:vortex-compact -7.3% -2.7% -4.8% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +0.1% -2.7% +2.9% +42.9% ➖ noise
14 duckdb:vortex-compact -7.3% -2.7% -4.8% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -18.4% -2.7% -16.2% +30.0% ➖ noise
15 datafusion:vortex-compact -14.8% -1.5% -13.5% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -9.2% -1.5% -7.8% +30.0% ➖ noise
15 duckdb:vortex-compact -10.4% -1.5% -9.0% +44.5% ➖ noise
15 duckdb:vortex-file-compressed +19.0% -1.5% +20.8% +32.2% ➖ noise
16 datafusion:vortex-compact -24.8% +7.3% -30.0% +33.6% ✅ faster
16 datafusion:vortex-file-compressed +5.7% +7.3% -1.6% +30.0% ➖ noise
16 duckdb:vortex-compact +5.4% +7.3% -1.8% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -2.8% +7.3% -9.5% +30.0% ➖ noise
17 datafusion:vortex-compact -4.3% -6.6% +2.5% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -2.4% -6.6% +4.5% +30.0% ➖ noise
17 duckdb:vortex-compact -7.0% -6.6% -0.4% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -12.6% -6.6% -6.4% +30.0% ➖ noise
18 datafusion:vortex-compact -5.6% +7.8% -12.4% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +0.5% +7.8% -6.7% +30.0% ➖ noise
18 duckdb:vortex-compact -1.6% +7.8% -8.7% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -3.6% +7.8% -10.6% +30.0% ➖ noise
19 datafusion:vortex-compact -3.2% -1.7% -1.5% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -0.8% -1.7% +1.0% +30.0% ➖ noise
19 duckdb:vortex-compact +2.2% -1.7% +4.0% +30.2% ➖ noise
19 duckdb:vortex-file-compressed +11.7% -1.7% +13.7% +30.0% ➖ noise
20 datafusion:vortex-compact -8.0% -8.4% +0.4% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +0.3% -8.4% +9.5% +30.0% ➖ noise
20 duckdb:vortex-compact -4.1% -8.4% +4.7% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -2.9% -8.4% +6.0% +30.0% ➖ noise
21 datafusion:vortex-compact -14.1% -5.9% -8.7% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -6.2% -5.9% -0.3% +30.0% ➖ noise
21 duckdb:vortex-compact -4.9% -5.9% +1.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -2.8% -5.9% +3.4% +30.0% ➖ noise
22 datafusion:vortex-compact -18.5% -15.1% -4.0% +31.3% ➖ noise
22 datafusion:vortex-file-compressed -4.4% -15.1% +12.6% +36.7% ➖ noise
22 duckdb:vortex-compact -3.1% -15.1% +14.1% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -21.7% -15.1% -7.8% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.4%
Vortex (geomean): 0.974x ➖
Parquet (geomean): 0.951x ➖
Shifts: Parquet (control) -4.9% · Median polish -2.9%


datafusion / vortex-file-compressed (0.957x ➖, 1↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 727668543 698467658 1.04
tpch_q02/datafusion:vortex-file-compressed 856897413 855131294 1.00
tpch_q03/datafusion:vortex-file-compressed 832831184 1080483214 0.77
tpch_q04/datafusion:vortex-file-compressed 631745301 699973584 0.90
tpch_q05/datafusion:vortex-file-compressed 970142472 1105623174 0.88
tpch_q06/datafusion:vortex-file-compressed 702081576 687167474 1.02
tpch_q07/datafusion:vortex-file-compressed 1071246673 1056799363 1.01
tpch_q08/datafusion:vortex-file-compressed 1148552942 1247973984 0.92
tpch_q09/datafusion:vortex-file-compressed 1318812689 1364410286 0.97
tpch_q10/datafusion:vortex-file-compressed 1040608516 1113392187 0.93
tpch_q11/datafusion:vortex-file-compressed 533934288 652087525 0.82
tpch_q12/datafusion:vortex-file-compressed 1056365735 1050502026 1.01
tpch_q13/datafusion:vortex-file-compressed 470024677 440658902 1.07
tpch_q14/datafusion:vortex-file-compressed 718022400 592882958 1.21
tpch_q15/datafusion:vortex-file-compressed 1318796287 1265892457 1.04
tpch_q16/datafusion:vortex-file-compressed 379498617 513471484 0.74
tpch_q17/datafusion:vortex-file-compressed 1209266111 1344537911 0.90
tpch_q18/datafusion:vortex-file-compressed 1390666267 1268630642 1.10
tpch_q19/datafusion:vortex-file-compressed 🚨 1272507146 810857825 1.57
tpch_q20/datafusion:vortex-file-compressed 1017867361 933066370 1.09
tpch_q21/datafusion:vortex-file-compressed 1572547597 1635052939 0.96
tpch_q22/datafusion:vortex-file-compressed 🚀 362827201 696929500 0.52
datafusion / vortex-compact (1.083x ➖, 1↑ 5↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 684244907 707889799 0.97
tpch_q02/datafusion:vortex-compact 🚀 667809713 996178225 0.67
tpch_q03/datafusion:vortex-compact 🚨 1014743927 720705303 1.41
tpch_q04/datafusion:vortex-compact 🚨 1055529175 609545888 1.73
tpch_q05/datafusion:vortex-compact 🚨 1470280737 966911029 1.52
tpch_q06/datafusion:vortex-compact 636239323 653157554 0.97
tpch_q07/datafusion:vortex-compact 925045770 929225564 1.00
tpch_q08/datafusion:vortex-compact 1151861234 1205472589 0.96
tpch_q09/datafusion:vortex-compact 1225319835 1247137723 0.98
tpch_q10/datafusion:vortex-compact 1098577245 1076967708 1.02
tpch_q11/datafusion:vortex-compact 395980881 434376751 0.91
tpch_q12/datafusion:vortex-compact 🚨 1189756658 818253961 1.45
tpch_q13/datafusion:vortex-compact 🚨 598728408 395253675 1.51
tpch_q14/datafusion:vortex-compact 760018232 598631157 1.27
tpch_q15/datafusion:vortex-compact 1256325085 1104747077 1.14
tpch_q16/datafusion:vortex-compact 391590863 373985389 1.05
tpch_q17/datafusion:vortex-compact 1194413317 1161460160 1.03
tpch_q18/datafusion:vortex-compact 1094353820 1082303058 1.01
tpch_q19/datafusion:vortex-compact 821021217 943962207 0.87
tpch_q20/datafusion:vortex-compact 928745023 1014315556 0.92
tpch_q21/datafusion:vortex-compact 1348611650 1515420999 0.89
tpch_q22/datafusion:vortex-compact 428671573 371112673 1.16
datafusion / parquet (0.960x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 880205965 858657384 1.03
tpch_q02/datafusion:parquet 🚨 1255113355 939482619 1.34
tpch_q03/datafusion:parquet 879796072 1198702792 0.73
tpch_q04/datafusion:parquet 416507272 558394419 0.75
tpch_q05/datafusion:parquet 1158694257 1264555903 0.92
tpch_q06/datafusion:parquet 524273085 518229063 1.01
tpch_q07/datafusion:parquet 1294059821 1454000509 0.89
tpch_q08/datafusion:parquet 1553868864 1519740909 1.02
tpch_q09/datafusion:parquet 1753831774 2113012884 0.83
tpch_q10/datafusion:parquet 2020416227 1907384990 1.06
tpch_q11/datafusion:parquet 507825470 478719386 1.06
tpch_q12/datafusion:parquet 633794612 827357731 0.77
tpch_q13/datafusion:parquet 704470736 716323150 0.98
tpch_q14/datafusion:parquet 1001077180 817375765 1.22
tpch_q15/datafusion:parquet 1694792095 1357907316 1.25
tpch_q16/datafusion:parquet 485488637 431997835 1.12
tpch_q17/datafusion:parquet 1293003386 1427979711 0.91
tpch_q18/datafusion:parquet 1413355930 1568873743 0.90
tpch_q19/datafusion:parquet 867997829 962031764 0.90
tpch_q20/datafusion:parquet 1079204700 1250237966 0.86
tpch_q21/datafusion:parquet 1812342729 1854977322 0.98
tpch_q22/datafusion:parquet 771081077 891256358 0.87
duckdb / vortex-file-compressed (0.936x ➖, 1↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 605570861 609631707 0.99
tpch_q02/duckdb:vortex-file-compressed 1216630114 1214034712 1.00
tpch_q03/duckdb:vortex-file-compressed 952135375 1016717443 0.94
tpch_q04/duckdb:vortex-file-compressed 700538217 692334182 1.01
tpch_q05/duckdb:vortex-file-compressed 1109540207 1117285581 0.99
tpch_q06/duckdb:vortex-file-compressed 775592735 749649026 1.03
tpch_q07/duckdb:vortex-file-compressed 1193058138 1217402191 0.98
tpch_q08/duckdb:vortex-file-compressed 1491866967 1518124527 0.98
tpch_q09/duckdb:vortex-file-compressed 1477254853 1515165817 0.97
tpch_q10/duckdb:vortex-file-compressed 1431471102 1420531522 1.01
tpch_q11/duckdb:vortex-file-compressed 698161749 706927787 0.99
tpch_q12/duckdb:vortex-file-compressed 753444132 751053437 1.00
tpch_q13/duckdb:vortex-file-compressed 🚀 739616156 1092282275 0.68
tpch_q14/duckdb:vortex-file-compressed 807153645 899272236 0.90
tpch_q15/duckdb:vortex-file-compressed 539443579 580186602 0.93
tpch_q16/duckdb:vortex-file-compressed 509480468 624487905 0.82
tpch_q17/duckdb:vortex-file-compressed 962908357 1159552768 0.83
tpch_q18/duckdb:vortex-file-compressed 1004842509 1072821227 0.94
tpch_q19/duckdb:vortex-file-compressed 692658583 735471516 0.94
tpch_q20/duckdb:vortex-file-compressed 1232458387 1286326259 0.96
tpch_q21/duckdb:vortex-file-compressed 1982199858 2120935360 0.93
tpch_q22/duckdb:vortex-file-compressed 595696841 709215953 0.84
duckdb / vortex-compact (0.928x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 592768397 605688780 0.98
tpch_q02/duckdb:vortex-compact 1132137217 1173498892 0.96
tpch_q03/duckdb:vortex-compact 875439029 963978252 0.91
tpch_q04/duckdb:vortex-compact 523261109 602218657 0.87
tpch_q05/duckdb:vortex-compact 1107818088 1134140518 0.98
tpch_q06/duckdb:vortex-compact 771725919 762369357 1.01
tpch_q07/duckdb:vortex-compact 1099941117 1123962516 0.98
tpch_q08/duckdb:vortex-compact 1449342950 1454840234 1.00
tpch_q09/duckdb:vortex-compact 1387650046 1352223839 1.03
tpch_q10/duckdb:vortex-compact 1238055736 1181219004 1.05
tpch_q11/duckdb:vortex-compact 664653604 781396547 0.85
tpch_q12/duckdb:vortex-compact 645740988 712812773 0.91
tpch_q13/duckdb:vortex-compact 668632016 910712773 0.73
tpch_q14/duckdb:vortex-compact 766423312 890010608 0.86
tpch_q15/duckdb:vortex-compact 535001761 605455845 0.88
tpch_q16/duckdb:vortex-compact 491589011 484952050 1.01
tpch_q17/duckdb:vortex-compact 906430265 921994325 0.98
tpch_q18/duckdb:vortex-compact 797581477 877955585 0.91
tpch_q19/duckdb:vortex-compact 705632490 884066410 0.80
tpch_q20/duckdb:vortex-compact 1187025588 1222625806 0.97
tpch_q21/duckdb:vortex-compact 1664423405 1754995801 0.95
tpch_q22/duckdb:vortex-compact 603157258 691430770 0.87
duckdb / parquet (0.941x ➖, 0↑ 0↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 798840654 934232055 0.86
tpch_q02/duckdb:parquet 1393160272 1491103723 0.93
tpch_q03/duckdb:parquet 1616033794 1911130190 0.85
tpch_q04/duckdb:parquet 891414984 1074414524 0.83
tpch_q05/duckdb:parquet 1773809423 2046085307 0.87
tpch_q06/duckdb:parquet 745627645 802313517 0.93
tpch_q07/duckdb:parquet 1737204531 1799911551 0.97
tpch_q08/duckdb:parquet 2241251897 2370521683 0.95
tpch_q09/duckdb:parquet 2555460445 2582134717 0.99
tpch_q10/duckdb:parquet 3097936187 3224874261 0.96
tpch_q11/duckdb:parquet 957806188 930647743 1.03
tpch_q12/duckdb:parquet 1201045005 1283515649 0.94
tpch_q13/duckdb:parquet 1245478364 1251182781 1.00
tpch_q14/duckdb:parquet 1325081816 1381078030 0.96
tpch_q15/duckdb:parquet 976457496 872184121 1.12
tpch_q16/duckdb:parquet 924634995 921031109 1.00
tpch_q17/duckdb:parquet 1329262528 1388805720 0.96
tpch_q18/duckdb:parquet 1357682736 1791412070 0.76
tpch_q19/duckdb:parquet 1479495215 1532775290 0.97
tpch_q20/duckdb:parquet 1799559343 1926129567 0.93
tpch_q21/duckdb:parquet 1721702158 1912989696 0.90
tpch_q22/duckdb:parquet 1114305089 1011384133 1.10
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -3.3% -6.4% +3.2% +38.7% ➖ noise
1 datafusion:vortex-file-compressed +4.2% -6.4% +11.3% +43.2% ➖ noise
1 duckdb:vortex-compact -2.1% -6.4% +4.5% +42.0% ➖ noise
1 duckdb:vortex-file-compressed -0.7% -6.4% +6.1% +31.3% ➖ noise
2 datafusion:vortex-compact -33.0% +11.7% -40.0% +42.3% ✅ faster
2 datafusion:vortex-file-compressed +0.2% +11.7% -10.3% +33.8% ➖ noise
2 duckdb:vortex-compact -3.5% +11.7% -13.6% +31.3% ➖ noise
2 duckdb:vortex-file-compressed +0.2% +11.7% -10.3% +31.3% ➖ noise
3 datafusion:vortex-compact +40.8% -21.2% +78.7% +42.8% 🚨 regression
3 datafusion:vortex-file-compressed -22.9% -21.2% -2.2% +48.2% ➖ noise
3 duckdb:vortex-compact -9.2% -21.2% +15.3% +31.4% ➖ noise
3 duckdb:vortex-file-compressed -6.4% -21.2% +18.9% +36.1% ➖ noise
4 datafusion:vortex-compact +73.2% -21.3% +120.1% +31.3% 🚨 regression
4 datafusion:vortex-file-compressed -9.7% -21.3% +14.7% +31.3% ➖ noise
4 duckdb:vortex-compact -13.1% -21.3% +10.5% +37.9% ➖ noise
4 duckdb:vortex-file-compressed +1.2% -21.3% +28.6% +31.3% ➖ noise
5 datafusion:vortex-compact +52.1% -10.9% +70.6% +31.3% 🚨 regression
5 datafusion:vortex-file-compressed -12.3% -10.9% -1.5% +31.3% ➖ noise
5 duckdb:vortex-compact -2.3% -10.9% +9.6% +31.3% ➖ noise
5 duckdb:vortex-file-compressed -0.7% -10.9% +11.4% +31.3% ➖ noise
6 datafusion:vortex-compact -2.6% -3.0% +0.5% +31.3% ➖ noise
6 datafusion:vortex-file-compressed +2.2% -3.0% +5.4% +31.3% ➖ noise
6 duckdb:vortex-compact +1.2% -3.0% +4.4% +31.3% ➖ noise
6 duckdb:vortex-file-compressed +3.5% -3.0% +6.7% +31.3% ➖ noise
7 datafusion:vortex-compact -0.4% -7.3% +7.4% +31.3% ➖ noise
7 datafusion:vortex-file-compressed +1.4% -7.3% +9.4% +31.3% ➖ noise
7 duckdb:vortex-compact -2.1% -7.3% +5.6% +31.3% ➖ noise
7 duckdb:vortex-file-compressed -2.0% -7.3% +5.7% +31.3% ➖ noise
8 datafusion:vortex-compact -4.4% -1.7% -2.8% +31.3% ➖ noise
8 datafusion:vortex-file-compressed -8.0% -1.7% -6.4% +31.3% ➖ noise
8 duckdb:vortex-compact -0.4% -1.7% +1.3% +31.3% ➖ noise
8 duckdb:vortex-file-compressed -1.7% -1.7% -0.1% +31.3% ➖ noise
9 datafusion:vortex-compact -1.7% -9.4% +8.4% +31.3% ➖ noise
9 datafusion:vortex-file-compressed -3.3% -9.4% +6.6% +31.3% ➖ noise
9 duckdb:vortex-compact +2.6% -9.4% +13.2% +31.3% ➖ noise
9 duckdb:vortex-file-compressed -2.5% -9.4% +7.6% +31.3% ➖ noise
10 datafusion:vortex-compact +2.0% +0.9% +1.1% +31.3% ➖ noise
10 datafusion:vortex-file-compressed -6.5% +0.9% -7.3% +31.3% ➖ noise
10 duckdb:vortex-compact +4.8% +0.9% +3.9% +31.3% ➖ noise
10 duckdb:vortex-file-compressed +0.8% +0.9% -0.1% +31.3% ➖ noise
11 datafusion:vortex-compact -8.8% +4.5% -12.8% +31.3% ➖ noise
11 datafusion:vortex-file-compressed -18.1% +4.5% -21.6% +33.4% ➖ noise
11 duckdb:vortex-compact -14.9% +4.5% -18.6% +31.3% ➖ noise
11 duckdb:vortex-file-compressed -1.2% +4.5% -5.5% +31.3% ➖ noise
12 datafusion:vortex-compact +45.4% -15.3% +71.7% +31.3% 🚨 regression
12 datafusion:vortex-file-compressed +0.6% -15.3% +18.8% +31.3% ➖ noise
12 duckdb:vortex-compact -9.4% -15.3% +7.0% +31.3% ➖ noise
12 duckdb:vortex-file-compressed +0.3% -15.3% +18.5% +31.3% ➖ noise
13 datafusion:vortex-compact +51.5% -1.1% +53.1% +31.3% 🚨 regression
13 datafusion:vortex-file-compressed +6.7% -1.1% +7.8% +31.3% ➖ noise
13 duckdb:vortex-compact -26.6% -1.1% -25.8% +32.4% ✅ faster
13 duckdb:vortex-file-compressed -32.3% -1.1% -31.6% +39.0% ✅ faster
14 datafusion:vortex-compact +27.0% +8.4% +17.1% +31.3% ➖ noise
14 datafusion:vortex-file-compressed +21.1% +8.4% +11.7% +31.3% ➖ noise
14 duckdb:vortex-compact -13.9% +8.4% -20.6% +31.3% ➖ noise
14 duckdb:vortex-file-compressed -10.2% +8.4% -17.2% +31.3% ➖ noise
15 datafusion:vortex-compact +13.7% +18.2% -3.8% +31.3% ➖ noise
15 datafusion:vortex-file-compressed +4.2% +18.2% -11.9% +31.3% ➖ noise
15 duckdb:vortex-compact -11.6% +18.2% -25.2% +31.3% ✅ faster
15 duckdb:vortex-file-compressed -7.0% +18.2% -21.3% +31.3% ➖ noise
16 datafusion:vortex-compact +4.7% +6.2% -1.4% +38.0% ➖ noise
16 datafusion:vortex-file-compressed -26.1% +6.2% -30.4% +31.9% ✅ faster
16 duckdb:vortex-compact +1.4% +6.2% -4.6% +31.3% ➖ noise
16 duckdb:vortex-file-compressed -18.4% +6.2% -23.2% +31.3% ➖ noise
17 datafusion:vortex-compact +2.8% -6.9% +10.5% +31.3% ➖ noise
17 datafusion:vortex-file-compressed -10.1% -6.9% -3.4% +31.3% ➖ noise
17 duckdb:vortex-compact -1.7% -6.9% +5.6% +31.3% ➖ noise
17 duckdb:vortex-file-compressed -17.0% -6.9% -10.8% +38.9% ➖ noise
18 datafusion:vortex-compact +1.1% -17.4% +22.4% +31.3% ➖ noise
18 datafusion:vortex-file-compressed +9.6% -17.4% +32.7% +31.3% 🚨 regression
18 duckdb:vortex-compact -9.2% -17.4% +9.9% +31.3% ➖ noise
18 duckdb:vortex-file-compressed -6.3% -17.4% +13.4% +31.3% ➖ noise
19 datafusion:vortex-compact -13.0% -6.7% -6.8% +36.1% ➖ noise
19 datafusion:vortex-file-compressed +56.9% -6.7% +68.2% +33.7% 🚨 regression
19 duckdb:vortex-compact -20.2% -6.7% -14.5% +31.3% ➖ noise
19 duckdb:vortex-file-compressed -5.8% -6.7% +0.9% +31.3% ➖ noise
20 datafusion:vortex-compact -8.4% -10.2% +2.0% +31.3% ➖ noise
20 datafusion:vortex-file-compressed +9.1% -10.2% +21.5% +31.3% ➖ noise
20 duckdb:vortex-compact -2.9% -10.2% +8.1% +31.3% ➖ noise
20 duckdb:vortex-file-compressed -4.2% -10.2% +6.7% +31.3% ➖ noise
21 datafusion:vortex-compact -11.0% -6.2% -5.1% +31.3% ➖ noise
21 datafusion:vortex-file-compressed -3.8% -6.2% +2.6% +31.3% ➖ noise
21 duckdb:vortex-compact -5.2% -6.2% +1.1% +31.3% ➖ noise
21 duckdb:vortex-file-compressed -6.5% -6.2% -0.3% +31.3% ➖ noise
22 datafusion:vortex-compact +15.5% -2.4% +18.3% +31.3% ➖ noise
22 datafusion:vortex-file-compressed -47.9% -2.4% -46.7% +31.3% ✅ faster
22 duckdb:vortex-compact -12.8% -2.4% -10.7% +31.3% ➖ noise
22 duckdb:vortex-file-compressed -16.0% -2.4% -14.0% +31.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.017x ➖


datafusion / vortex-file-compressed (1.017x ➖, 0↑ 1↓)
name PR a8dfde2 (ns) base e56c80d (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 119389586 127718167 0.93
polarsignals_q01/datafusion:vortex-file-compressed 258838324 284499421 0.91
polarsignals_q02/datafusion:vortex-file-compressed 24006816 24413822 0.98
polarsignals_q03/datafusion:vortex-file-compressed 290700142 269019857 1.08
polarsignals_q04/datafusion:vortex-file-compressed 🚨 12472396 11206921 1.11
polarsignals_q05/datafusion:vortex-file-compressed 15950585 14632804 1.09
polarsignals_q06/datafusion:vortex-file-compressed 19639916 18523920 1.06
polarsignals_q07/datafusion:vortex-file-compressed 14058629 13680432 1.03
polarsignals_q08/datafusion:vortex-file-compressed 412487086 396871149 1.04
polarsignals_q09/datafusion:vortex-file-compressed 10882439 11422351 0.95

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@myrrc
Copy link
Copy Markdown
Contributor Author

myrrc commented May 18, 2026

No meaningful speedup, closing

@myrrc myrrc closed this May 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature do not merge Pull requests that are not intended to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant