Skip to content

Fix reduction rule#7521

Merged
connortsui20 merged 1 commit intodevelopfrom
ct/extension-reduce
Apr 17, 2026
Merged

Fix reduction rule#7521
connortsui20 merged 1 commit intodevelopfrom
ct/extension-reduce

Conversation

@connortsui20
Copy link
Copy Markdown
Contributor

Summary

Changes a parent reduction rule on AnyArray to just a reduction rule.

Also my lsp reordered some things.

Testing

Existing tests pass (except 1 which I had to update).

@connortsui20 connortsui20 added the changelog/skip Do not list PR in the changelog label Apr 17, 2026
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 17, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 17, 2026
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20 connortsui20 enabled auto-merge (squash) April 17, 2026 18:32
@connortsui20 connortsui20 merged commit 9b11e57 into develop Apr 17, 2026
60 checks passed
@connortsui20 connortsui20 deleted the ct/extension-reduce branch April 17, 2026 18:33
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 17, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 632f898 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.988x ➖


datafusion / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 131466324 137208967 0.96
polarsignals_q01/datafusion:vortex-file-compressed 388608179 420910989 0.92
polarsignals_q02/datafusion:vortex-file-compressed 25617634 25224673 1.02
polarsignals_q03/datafusion:vortex-file-compressed 398813764 403683256 0.99
polarsignals_q04/datafusion:vortex-file-compressed 12466780 12623151 0.99
polarsignals_q05/datafusion:vortex-file-compressed 16813026 17968147 0.94
polarsignals_q06/datafusion:vortex-file-compressed 19783632 19474944 1.02
polarsignals_q07/datafusion:vortex-file-compressed 16221472 15507126 1.05
polarsignals_q08/datafusion:vortex-file-compressed 487300209 508883156 0.96
polarsignals_q09/datafusion:vortex-file-compressed 12782125 11994454 1.07

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Vortex (geomean): 0.993x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.4%


datafusion / vortex-file-compressed (1.020x ➖, 0↑ 1↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5383025 5193523 1.04
fineweb_q01/datafusion:vortex-file-compressed 28401692 26623758 1.07
fineweb_q02/datafusion:vortex-file-compressed 🚨 31851425 28151228 1.13
fineweb_q03/datafusion:vortex-file-compressed 87779988 89783390 0.98
fineweb_q04/datafusion:vortex-file-compressed 251578997 254962519 0.99
fineweb_q05/datafusion:vortex-file-compressed 230456761 243901228 0.94
fineweb_q06/datafusion:vortex-file-compressed 66434486 63012926 1.05
fineweb_q07/datafusion:vortex-file-compressed 65152456 67281150 0.97
fineweb_q08/datafusion:vortex-file-compressed 23096389 22520920 1.03
datafusion / vortex-compact (0.987x ➖, 1↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 4997238 5612524 0.89
fineweb_q01/datafusion:vortex-compact 162276506 164783755 0.98
fineweb_q02/datafusion:vortex-compact 165163051 164430205 1.00
fineweb_q03/datafusion:vortex-compact 1450730118 1447333241 1.00
fineweb_q04/datafusion:vortex-compact 1572461231 1554435451 1.01
fineweb_q05/datafusion:vortex-compact 1236384863 1233561020 1.00
fineweb_q06/datafusion:vortex-compact 691766028 694570911 1.00
fineweb_q07/datafusion:vortex-compact 731556797 731557981 1.00
fineweb_q08/datafusion:vortex-compact 24220830 24341715 1.00
datafusion / parquet (1.004x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7063516 6948613 1.02
fineweb_q01/datafusion:parquet 295335496 295243049 1.00
fineweb_q02/datafusion:parquet 290242209 295333076 0.98
fineweb_q03/datafusion:parquet 305594003 289277825 1.06
fineweb_q04/datafusion:parquet 305807095 303747784 1.01
fineweb_q05/datafusion:parquet 305510083 313002900 0.98
fineweb_q06/datafusion:parquet 293639695 296973614 0.99
fineweb_q07/datafusion:parquet 295600849 291204730 1.02
fineweb_q08/datafusion:parquet 288350013 289288021 1.00
duckdb / vortex-file-compressed (0.974x ➖, 1↑ 1↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3033968 3246315 0.93
fineweb_q01/duckdb:vortex-file-compressed 🚀 24633930 29494879 0.84
fineweb_q02/duckdb:vortex-file-compressed 🚨 27172094 24638795 1.10
fineweb_q03/duckdb:vortex-file-compressed 136697696 136964755 1.00
fineweb_q04/duckdb:vortex-file-compressed 225676449 229433703 0.98
fineweb_q05/duckdb:vortex-file-compressed 218482992 217871950 1.00
fineweb_q06/duckdb:vortex-file-compressed 66958209 64638159 1.04
fineweb_q07/duckdb:vortex-file-compressed 65158915 69751171 0.93
fineweb_q08/duckdb:vortex-file-compressed 25641651 26623461 0.96
duckdb / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4189110 3922033 1.07
fineweb_q01/duckdb:vortex-compact 105881432 108568180 0.98
fineweb_q02/duckdb:vortex-compact 114372729 117265914 0.98
fineweb_q03/duckdb:vortex-compact 851379598 862929771 0.99
fineweb_q04/duckdb:vortex-compact 908057369 907777746 1.00
fineweb_q05/duckdb:vortex-compact 807635163 818779140 0.99
fineweb_q06/duckdb:vortex-compact 455911136 462048633 0.99
fineweb_q07/duckdb:vortex-compact 478994890 478029264 1.00
fineweb_q08/duckdb:vortex-compact 23438707 24508078 0.96
duckdb / parquet (0.992x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 26624563 28674406 0.93
fineweb_q01/duckdb:parquet 82330550 82067246 1.00
fineweb_q02/duckdb:parquet 85111718 82983304 1.03
fineweb_q03/duckdb:parquet 308214282 308895899 1.00
fineweb_q04/duckdb:parquet 436454254 437853714 1.00
fineweb_q05/duckdb:parquet 407486349 408858701 1.00
fineweb_q06/duckdb:parquet 196783797 197338402 1.00
fineweb_q07/duckdb:parquet 207878613 207652244 1.00
fineweb_q08/duckdb:parquet 27990492 28507143 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -11.0% -2.8% -8.4% +41.9% ➖ noise
0 datafusion:vortex-file-compressed +3.6% -2.8% +6.7% +71.4% ➖ noise
0 duckdb:vortex-compact +6.8% -2.8% +9.9% +33.9% ➖ noise
0 duckdb:vortex-file-compressed -6.5% -2.8% -3.8% +50.0% ➖ noise
1 datafusion:vortex-compact -1.5% +0.2% -1.7% +13.2% ➖ noise
1 datafusion:vortex-file-compressed +6.7% +0.2% +6.5% +17.6% ➖ noise
1 duckdb:vortex-compact -2.5% +0.2% -2.6% +24.1% ➖ noise
1 duckdb:vortex-file-compressed -16.5% +0.2% -16.6% +48.7% ➖ noise
2 datafusion:vortex-compact +0.4% +0.4% +0.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +13.1% +0.4% +12.7% +12.0% 🚨 regression
2 duckdb:vortex-compact -2.5% +0.4% -2.9% +17.8% ➖ noise
2 duckdb:vortex-file-compressed +10.3% +0.4% +9.8% +10.0% ➖ noise
3 datafusion:vortex-compact +0.2% +2.7% -2.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -2.2% +2.7% -4.8% +25.9% ➖ noise
3 duckdb:vortex-compact -1.3% +2.7% -3.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.2% +2.7% -2.8% +21.1% ➖ noise
4 datafusion:vortex-compact +1.2% +0.2% +1.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.3% +0.2% -1.5% +10.0% ➖ noise
4 duckdb:vortex-compact +0.0% +0.2% -0.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.6% +0.2% -1.8% +10.0% ➖ noise
5 datafusion:vortex-compact +0.2% -1.4% +1.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -5.5% -1.4% -4.2% +10.0% ➖ noise
5 duckdb:vortex-compact -1.4% -1.4% +0.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.3% -1.4% +1.7% +10.0% ➖ noise
6 datafusion:vortex-compact -0.4% -0.7% +0.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +5.4% -0.7% +6.2% +16.0% ➖ noise
6 duckdb:vortex-compact -1.3% -0.7% -0.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +3.6% -0.7% +4.3% +24.6% ➖ noise
7 datafusion:vortex-compact -0.0% +0.8% -0.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -3.2% +0.8% -3.9% +10.5% ➖ noise
7 duckdb:vortex-compact +0.2% +0.8% -0.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -6.6% +0.8% -7.3% +10.0% ➖ noise
8 datafusion:vortex-compact -0.5% -1.1% +0.6% +27.0% ➖ noise
8 datafusion:vortex-file-compressed +2.6% -1.1% +3.7% +27.1% ➖ noise
8 duckdb:vortex-compact -4.4% -1.1% -3.3% +18.5% ➖ noise
8 duckdb:vortex-file-compressed -3.7% -1.1% -2.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +6.9%
Vortex (geomean): 1.069x ➖
Parquet (geomean): 0.971x ➖
Shifts: Parquet (control) -2.9% · Median polish -0.1%


datafusion / vortex-file-compressed (1.079x ➖, 0↑ 3↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50257722 52079282 0.97
tpch_q02/datafusion:vortex-file-compressed 32835368 34018230 0.97
tpch_q03/datafusion:vortex-file-compressed 27695437 28088505 0.99
tpch_q04/datafusion:vortex-file-compressed 20796918 19844042 1.05
tpch_q05/datafusion:vortex-file-compressed 58156168 55966260 1.04
tpch_q06/datafusion:vortex-file-compressed 🚨 11858968 10777360 1.10
tpch_q07/datafusion:vortex-file-compressed 69198395 66787859 1.04
tpch_q08/datafusion:vortex-file-compressed 46129215 47000058 0.98
tpch_q09/datafusion:vortex-file-compressed 57624432 56745030 1.02
tpch_q10/datafusion:vortex-file-compressed 46181290 46664939 0.99
tpch_q11/datafusion:vortex-file-compressed 17764913 18278263 0.97
tpch_q12/datafusion:vortex-file-compressed 🚨 83856799 24589993 3.41
tpch_q13/datafusion:vortex-file-compressed 29050455 28365221 1.02
tpch_q14/datafusion:vortex-file-compressed 17282298 16464211 1.05
tpch_q15/datafusion:vortex-file-compressed 🚨 28030941 25350550 1.11
tpch_q16/datafusion:vortex-file-compressed 25698125 25668310 1.00
tpch_q17/datafusion:vortex-file-compressed 66516094 63201768 1.05
tpch_q18/datafusion:vortex-file-compressed 78542760 80559562 0.97
tpch_q19/datafusion:vortex-file-compressed 24833693 24332221 1.02
tpch_q20/datafusion:vortex-file-compressed 34417148 33888769 1.02
tpch_q21/datafusion:vortex-file-compressed 78675827 75232364 1.05
tpch_q22/datafusion:vortex-file-compressed 18138833 16708778 1.09
datafusion / vortex-compact (1.056x ➖, 0↑ 1↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59256466 57462721 1.03
tpch_q02/datafusion:vortex-compact 36743492 36997048 0.99
tpch_q03/datafusion:vortex-compact 31616934 31498924 1.00
tpch_q04/datafusion:vortex-compact 24558150 22958788 1.07
tpch_q05/datafusion:vortex-compact 58337687 56032072 1.04
tpch_q06/datafusion:vortex-compact 15032718 13885978 1.08
tpch_q07/datafusion:vortex-compact 71768331 69852814 1.03
tpch_q08/datafusion:vortex-compact 50767322 49952900 1.02
tpch_q09/datafusion:vortex-compact 61206134 62659675 0.98
tpch_q10/datafusion:vortex-compact 53679664 53491053 1.00
tpch_q11/datafusion:vortex-compact 19671452 19483500 1.01
tpch_q12/datafusion:vortex-compact 🚨 74042514 33347262 2.22
tpch_q13/datafusion:vortex-compact 37952027 36422776 1.04
tpch_q14/datafusion:vortex-compact 22759647 21289394 1.07
tpch_q15/datafusion:vortex-compact 36055479 34810777 1.04
tpch_q16/datafusion:vortex-compact 30914140 30101998 1.03
tpch_q17/datafusion:vortex-compact 67760033 72575485 0.93
tpch_q18/datafusion:vortex-compact 84692855 85904567 0.99
tpch_q19/datafusion:vortex-compact 35863587 35474676 1.01
tpch_q20/datafusion:vortex-compact 39678516 39069799 1.02
tpch_q21/datafusion:vortex-compact 91681478 88255473 1.04
tpch_q22/datafusion:vortex-compact 17774755 17572159 1.01
datafusion / parquet (0.976x ➖, 2↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 134916356 137573173 0.98
tpch_q02/datafusion:parquet 69622046 69266737 1.01
tpch_q03/datafusion:parquet 72985329 74021990 0.99
tpch_q04/datafusion:parquet 48743610 50329410 0.97
tpch_q05/datafusion:parquet 102330279 103365577 0.99
tpch_q06/datafusion:parquet 🚀 38796019 44570469 0.87
tpch_q07/datafusion:parquet 112325724 113531537 0.99
tpch_q08/datafusion:parquet 95588248 101681422 0.94
tpch_q09/datafusion:parquet 131939020 130455596 1.01
tpch_q10/datafusion:parquet 121171500 121762686 1.00
tpch_q11/datafusion:parquet 48454218 48228551 1.00
tpch_q12/datafusion:parquet 🚀 81582762 94421232 0.86
tpch_q13/datafusion:parquet 207529008 203160642 1.02
tpch_q14/datafusion:parquet 48214175 51152255 0.94
tpch_q15/datafusion:parquet 64132138 64733281 0.99
tpch_q16/datafusion:parquet 49906085 51088476 0.98
tpch_q17/datafusion:parquet 124958538 130944513 0.95
tpch_q18/datafusion:parquet 168438603 174314334 0.97
tpch_q19/datafusion:parquet 82681163 77349310 1.07
tpch_q20/datafusion:parquet 74692589 76785343 0.97
tpch_q21/datafusion:parquet 151867616 148631867 1.02
tpch_q22/datafusion:parquet 34931218 35831705 0.97
datafusion / arrow (1.001x ➖, 0↑ 1↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 52379451 52951068 0.99
tpch_q02/datafusion:arrow 21635566 21786471 0.99
tpch_q03/datafusion:arrow 32259972 32905753 0.98
tpch_q04/datafusion:arrow 26516418 27154959 0.98
tpch_q05/datafusion:arrow 78165361 75178461 1.04
tpch_q06/datafusion:arrow 🚨 22575073 19511506 1.16
tpch_q07/datafusion:arrow 111041853 108932185 1.02
tpch_q08/datafusion:arrow 42557459 44012013 0.97
tpch_q09/datafusion:arrow 68232839 72638725 0.94
tpch_q10/datafusion:arrow 50540191 51159166 0.99
tpch_q11/datafusion:arrow 11279826 11245272 1.00
tpch_q12/datafusion:arrow 53735980 54492841 0.99
tpch_q13/datafusion:arrow 48446216 49129953 0.99
tpch_q14/datafusion:arrow 22316053 22545910 0.99
tpch_q15/datafusion:arrow 45398219 43324471 1.05
tpch_q16/datafusion:arrow 20751689 20650170 1.00
tpch_q17/datafusion:arrow 68095465 69741883 0.98
tpch_q18/datafusion:arrow 142888143 142093284 1.01
tpch_q19/datafusion:arrow 37410959 36954214 1.01
tpch_q20/datafusion:arrow 37002593 37566649 0.98
tpch_q21/datafusion:arrow 149432684 150807628 0.99
tpch_q22/datafusion:arrow 20223519 20064854 1.01
duckdb / vortex-file-compressed (1.088x ➖, 0↑ 2↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33098324 32974225 1.00
tpch_q02/duckdb:vortex-file-compressed 27445380 27695074 0.99
tpch_q03/duckdb:vortex-file-compressed 29378796 29135513 1.01
tpch_q04/duckdb:vortex-file-compressed 30869910 30230257 1.02
tpch_q05/duckdb:vortex-file-compressed 34499068 34384525 1.00
tpch_q06/duckdb:vortex-file-compressed 11794667 10941485 1.08
tpch_q07/duckdb:vortex-file-compressed 39504737 36715679 1.08
tpch_q08/duckdb:vortex-file-compressed 40691459 40473958 1.01
tpch_q09/duckdb:vortex-file-compressed 80167089 81640309 0.98
tpch_q10/duckdb:vortex-file-compressed 36219414 37036528 0.98
tpch_q11/duckdb:vortex-file-compressed 16455547 16579457 0.99
tpch_q12/duckdb:vortex-file-compressed 🚨 113373856 23544731 4.82
tpch_q13/duckdb:vortex-file-compressed 🚨 40315775 36614146 1.10
tpch_q14/duckdb:vortex-file-compressed 23265188 21377163 1.09
tpch_q15/duckdb:vortex-file-compressed 16553585 16364222 1.01
tpch_q16/duckdb:vortex-file-compressed 30385249 30054369 1.01
tpch_q17/duckdb:vortex-file-compressed 25657314 25614285 1.00
tpch_q18/duckdb:vortex-file-compressed 51495086 52362575 0.98
tpch_q19/duckdb:vortex-file-compressed 31736337 32038339 0.99
tpch_q20/duckdb:vortex-file-compressed 35160249 35412492 0.99
tpch_q21/duckdb:vortex-file-compressed 108354117 111629022 0.97
tpch_q22/duckdb:vortex-file-compressed 19318110 19037534 1.01
duckdb / vortex-compact (1.054x ➖, 0↑ 1↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40217239 41128336 0.98
tpch_q02/duckdb:vortex-compact 38094017 38842694 0.98
tpch_q03/duckdb:vortex-compact 32024864 33347484 0.96
tpch_q04/duckdb:vortex-compact 34247462 33456421 1.02
tpch_q05/duckdb:vortex-compact 37900758 37488877 1.01
tpch_q06/duckdb:vortex-compact 15180293 14623873 1.04
tpch_q07/duckdb:vortex-compact 43747040 43410276 1.01
tpch_q08/duckdb:vortex-compact 45905323 45603498 1.01
tpch_q09/duckdb:vortex-compact 90274031 90461391 1.00
tpch_q10/duckdb:vortex-compact 41695494 41765846 1.00
tpch_q11/duckdb:vortex-compact 20760883 20648287 1.01
tpch_q12/duckdb:vortex-compact 🚨 96727571 36234841 2.67
tpch_q13/duckdb:vortex-compact 47571524 46992172 1.01
tpch_q14/duckdb:vortex-compact 31272944 29819727 1.05
tpch_q15/duckdb:vortex-compact 19238514 19199279 1.00
tpch_q16/duckdb:vortex-compact 38214878 37989925 1.01
tpch_q17/duckdb:vortex-compact 30884719 31014911 1.00
tpch_q18/duckdb:vortex-compact 51993539 50709865 1.03
tpch_q19/duckdb:vortex-compact 36787376 37528730 0.98
tpch_q20/duckdb:vortex-compact 44297594 42625387 1.04
tpch_q21/duckdb:vortex-compact 114635953 109462797 1.05
tpch_q22/duckdb:vortex-compact 21196790 20954060 1.01
duckdb / parquet (0.966x ➖, 3↑ 2↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 78131338 78633874 0.99
tpch_q02/duckdb:parquet 38835945 40526697 0.96
tpch_q03/duckdb:parquet 🚀 68731200 76466230 0.90
tpch_q04/duckdb:parquet 45818943 49047437 0.93
tpch_q05/duckdb:parquet 66572704 69259252 0.96
tpch_q06/duckdb:parquet 20214028 20668701 0.98
tpch_q07/duckdb:parquet 66323290 71154573 0.93
tpch_q08/duckdb:parquet 🚀 80050343 100290104 0.80
tpch_q09/duckdb:parquet 🚀 132166510 157394847 0.84
tpch_q10/duckdb:parquet 113923314 117446462 0.97
tpch_q11/duckdb:parquet 22228132 22662478 0.98
tpch_q12/duckdb:parquet 45181501 45407636 1.00
tpch_q13/duckdb:parquet 249312897 249078233 1.00
tpch_q14/duckdb:parquet 47407763 49410661 0.96
tpch_q15/duckdb:parquet 🚨 26942914 24272752 1.11
tpch_q16/duckdb:parquet 54323015 56520138 0.96
tpch_q17/duckdb:parquet 🚨 59577694 51773501 1.15
tpch_q18/duckdb:parquet 113779995 114916559 0.99
tpch_q19/duckdb:parquet 64863296 67605133 0.96
tpch_q20/duckdb:parquet 63176493 64460041 0.98
tpch_q21/duckdb:parquet 162162238 165436553 0.98
tpch_q22/duckdb:parquet 50651606 51744724 0.98
duckdb / duckdb (0.956x ➖, 2↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15809549 16838209 0.94
tpch_q02/duckdb:duckdb 13242306 13659621 0.97
tpch_q03/duckdb:duckdb 19185424 20515771 0.94
tpch_q04/duckdb:duckdb 18952890 20229682 0.94
tpch_q05/duckdb:duckdb 20132946 21603660 0.93
tpch_q06/duckdb:duckdb 5274543 5556224 0.95
tpch_q07/duckdb:duckdb 🚀 21039576 23508501 0.89
tpch_q08/duckdb:duckdb 20559247 21041775 0.98
tpch_q09/duckdb:duckdb 53372343 57649062 0.93
tpch_q10/duckdb:duckdb 42538349 44132501 0.96
tpch_q11/duckdb:duckdb 5785745 5905367 0.98
tpch_q12/duckdb:duckdb 13574629 13693810 0.99
tpch_q13/duckdb:duckdb 37712253 38303398 0.98
tpch_q14/duckdb:duckdb 🚀 16103692 18468036 0.87
tpch_q15/duckdb:duckdb 11807529 12001758 0.98
tpch_q16/duckdb:duckdb 22938663 24776844 0.93
tpch_q17/duckdb:duckdb 13338347 13624727 0.98
tpch_q18/duckdb:duckdb 38576617 38534299 1.00
tpch_q19/duckdb:duckdb 26145812 26393854 0.99
tpch_q20/duckdb:duckdb 22166513 22987730 0.96
tpch_q21/duckdb:duckdb 55653995 57599147 0.97
tpch_q22/duckdb:duckdb 24545597 24892984 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -1.1% -1.3% +0.2% +18.7% ➖ noise
1 datafusion:vortex-compact +3.1% -1.3% +4.5% +17.0% ➖ noise
1 datafusion:vortex-file-compressed -3.5% -1.3% -2.2% +17.7% ➖ noise
1 duckdb:duckdb -6.1% -1.3% -4.9% +17.1% ➖ noise
1 duckdb:vortex-compact -2.2% -1.3% -0.9% +17.1% ➖ noise
1 duckdb:vortex-file-compressed +0.4% -1.3% +1.7% +17.3% ➖ noise
2 datafusion:arrow -0.7% -1.9% +1.2% +11.8% ➖ noise
2 datafusion:vortex-compact -0.7% -1.9% +1.2% +11.8% ➖ noise
2 datafusion:vortex-file-compressed -3.5% -1.9% -1.7% +11.8% ➖ noise
2 duckdb:duckdb -3.1% -1.9% -1.2% +11.8% ➖ noise
2 duckdb:vortex-compact -1.9% -1.9% -0.1% +11.8% ➖ noise
2 duckdb:vortex-file-compressed -0.9% -1.9% +1.0% +11.8% ➖ noise
3 datafusion:arrow -2.0% -5.9% +4.1% +11.8% ➖ noise
3 datafusion:vortex-compact +0.4% -5.9% +6.6% +11.8% ➖ noise
3 datafusion:vortex-file-compressed -1.4% -5.9% +4.7% +11.8% ➖ noise
3 duckdb:duckdb -6.5% -5.9% -0.7% +11.8% ➖ noise
3 duckdb:vortex-compact -4.0% -5.9% +2.0% +11.8% ➖ noise
3 duckdb:vortex-file-compressed +0.8% -5.9% +7.1% +11.8% ➖ noise
4 datafusion:arrow -2.4% -4.9% +2.7% +11.8% ➖ noise
4 datafusion:vortex-compact +7.0% -4.9% +12.5% +11.8% 🚨 regression
4 datafusion:vortex-file-compressed +4.8% -4.9% +10.2% +11.8% ➖ noise
4 duckdb:duckdb -6.3% -4.9% -1.5% +11.8% ➖ noise
4 duckdb:vortex-compact +2.4% -4.9% +7.6% +11.8% ➖ noise
4 duckdb:vortex-file-compressed +2.1% -4.9% +7.4% +11.8% ➖ noise
5 datafusion:arrow +4.0% -2.5% +6.6% +11.8% ➖ noise
5 datafusion:vortex-compact +4.1% -2.5% +6.7% +11.8% ➖ noise
5 datafusion:vortex-file-compressed +3.9% -2.5% +6.5% +11.8% ➖ noise
5 duckdb:duckdb -6.8% -2.5% -4.5% +11.8% ➖ noise
5 duckdb:vortex-compact +1.1% -2.5% +3.6% +11.8% ➖ noise
5 duckdb:vortex-file-compressed +0.3% -2.5% +2.9% +11.8% ➖ noise
6 datafusion:arrow +15.7% -7.7% +25.4% +13.7% 🚨 regression
6 datafusion:vortex-compact +8.3% -7.7% +17.3% +14.5% 🚨 regression
6 datafusion:vortex-file-compressed +10.0% -7.7% +19.3% +14.2% 🚨 regression
6 duckdb:duckdb -5.1% -7.7% +2.9% +16.4% ➖ noise
6 duckdb:vortex-compact +3.8% -7.7% +12.5% +16.8% ➖ noise
6 duckdb:vortex-file-compressed +7.8% -7.7% +16.8% +14.7% 🚨 regression
7 datafusion:arrow +1.9% -4.0% +6.1% +11.8% ➖ noise
7 datafusion:vortex-compact +2.7% -4.0% +7.0% +11.8% ➖ noise
7 datafusion:vortex-file-compressed +3.6% -4.0% +7.9% +11.8% ➖ noise
7 duckdb:duckdb -10.5% -4.0% -6.8% +11.8% ➖ noise
7 duckdb:vortex-compact +0.8% -4.0% +4.9% +11.8% ➖ noise
7 duckdb:vortex-file-compressed +7.6% -4.0% +12.0% +11.8% 🚨 regression
8 datafusion:arrow -3.3% -13.4% +11.6% +11.8% ➖ noise
8 datafusion:vortex-compact +1.6% -13.4% +17.3% +11.8% 🚨 regression
8 datafusion:vortex-file-compressed -1.9% -13.4% +13.3% +11.8% 🚨 regression
8 duckdb:duckdb -2.3% -13.4% +12.8% +11.8% 🚨 regression
8 duckdb:vortex-compact +0.7% -13.4% +16.2% +11.8% 🚨 regression
8 duckdb:vortex-file-compressed +0.5% -13.4% +16.1% +11.8% 🚨 regression
9 datafusion:arrow -6.1% -7.8% +1.9% +11.8% ➖ noise
9 datafusion:vortex-compact -2.3% -7.8% +6.0% +11.8% ➖ noise
9 datafusion:vortex-file-compressed +1.5% -7.8% +10.2% +11.8% ➖ noise
9 duckdb:duckdb -7.4% -7.8% +0.5% +11.8% ➖ noise
9 duckdb:vortex-compact -0.2% -7.8% +8.3% +11.8% ➖ noise
9 duckdb:vortex-file-compressed -1.8% -7.8% +6.6% +11.8% ➖ noise
10 datafusion:arrow -1.2% -1.8% +0.6% +11.8% ➖ noise
10 datafusion:vortex-compact +0.4% -1.8% +2.1% +11.8% ➖ noise
10 datafusion:vortex-file-compressed -1.0% -1.8% +0.7% +11.8% ➖ noise
10 duckdb:duckdb -3.6% -1.8% -1.9% +11.8% ➖ noise
10 duckdb:vortex-compact -0.2% -1.8% +1.6% +11.8% ➖ noise
10 duckdb:vortex-file-compressed -2.2% -1.8% -0.5% +11.8% ➖ noise
11 datafusion:arrow +0.3% -0.7% +1.0% +11.8% ➖ noise
11 datafusion:vortex-compact +1.0% -0.7% +1.7% +11.8% ➖ noise
11 datafusion:vortex-file-compressed -2.8% -0.7% -2.1% +11.8% ➖ noise
11 duckdb:duckdb -2.0% -0.7% -1.3% +11.8% ➖ noise
11 duckdb:vortex-compact +0.5% -0.7% +1.3% +11.8% ➖ noise
11 duckdb:vortex-file-compressed -0.7% -0.7% -0.0% +11.8% ➖ noise
12 datafusion:arrow -1.4% -7.3% +6.4% +11.8% ➖ noise
12 datafusion:vortex-compact +122.0% -7.3% +139.5% +78.9% 🚨 regression
12 datafusion:vortex-file-compressed +241.0% -7.3% +267.8% +101.4% 🚨 regression
12 duckdb:duckdb -0.9% -7.3% +6.9% +11.8% ➖ noise
12 duckdb:vortex-compact +166.9% -7.3% +187.9% +71.2% 🚨 regression
12 duckdb:vortex-file-compressed +381.5% -7.3% +419.3% +107.8% 🚨 regression
13 datafusion:arrow -1.4% +1.1% -2.5% +11.8% ➖ noise
13 datafusion:vortex-compact +4.2% +1.1% +3.0% +11.8% ➖ noise
13 datafusion:vortex-file-compressed +2.4% +1.1% +1.3% +11.8% ➖ noise
13 duckdb:duckdb -1.5% +1.1% -2.6% +11.8% ➖ noise
13 duckdb:vortex-compact +1.2% +1.1% +0.1% +11.8% ➖ noise
13 duckdb:vortex-file-compressed +10.1% +1.1% +8.9% +11.8% ➖ noise
14 datafusion:arrow -1.0% -4.9% +4.1% +11.8% ➖ noise
14 datafusion:vortex-compact +6.9% -4.9% +12.4% +11.8% 🚨 regression
14 datafusion:vortex-file-compressed +5.0% -4.9% +10.4% +11.8% ➖ noise
14 duckdb:duckdb -12.8% -4.9% -8.3% +18.2% ➖ noise
14 duckdb:vortex-compact +4.9% -4.9% +10.3% +11.8% ➖ noise
14 duckdb:vortex-file-compressed +8.8% -4.9% +14.4% +11.8% 🚨 regression
15 datafusion:arrow +4.8% +4.9% -0.1% +11.8% ➖ noise
15 datafusion:vortex-compact +3.6% +4.9% -1.2% +11.8% ➖ noise
15 datafusion:vortex-file-compressed +10.6% +4.9% +5.4% +31.6% ➖ noise
15 duckdb:duckdb -1.6% +4.9% -6.2% +16.2% ➖ noise
15 duckdb:vortex-compact +0.2% +4.9% -4.4% +11.8% ➖ noise
15 duckdb:vortex-file-compressed +1.2% +4.9% -3.5% +11.8% ➖ noise
16 datafusion:arrow +0.5% -3.1% +3.7% +11.8% ➖ noise
16 datafusion:vortex-compact +2.7% -3.1% +6.0% +11.8% ➖ noise
16 datafusion:vortex-file-compressed +0.1% -3.1% +3.3% +11.8% ➖ noise
16 duckdb:duckdb -7.4% -3.1% -4.5% +11.8% ➖ noise
16 duckdb:vortex-compact +0.6% -3.1% +3.8% +11.8% ➖ noise
16 duckdb:vortex-file-compressed +1.1% -3.1% +4.3% +11.8% ➖ noise
17 datafusion:arrow -2.4% +4.8% -6.8% +11.8% ➖ noise
17 datafusion:vortex-compact -6.6% +4.8% -10.9% +11.8% ✅ faster
17 datafusion:vortex-file-compressed +5.2% +4.8% +0.4% +11.8% ➖ noise
17 duckdb:duckdb -2.1% +4.8% -6.6% +11.8% ➖ noise
17 duckdb:vortex-compact -0.4% +4.8% -5.0% +11.8% ➖ noise
17 duckdb:vortex-file-compressed +0.2% +4.8% -4.4% +11.8% ➖ noise
18 datafusion:arrow +0.6% -2.2% +2.8% +11.8% ➖ noise
18 datafusion:vortex-compact -1.4% -2.2% +0.8% +11.8% ➖ noise
18 datafusion:vortex-file-compressed -2.5% -2.2% -0.3% +11.8% ➖ noise
18 duckdb:duckdb +0.1% -2.2% +2.3% +11.8% ➖ noise
18 duckdb:vortex-compact +2.5% -2.2% +4.8% +11.8% ➖ noise
18 duckdb:vortex-file-compressed -1.7% -2.2% +0.5% +11.8% ➖ noise
19 datafusion:arrow +1.2% +1.3% -0.0% +14.6% ➖ noise
19 datafusion:vortex-compact +1.1% +1.3% -0.2% +14.2% ➖ noise
19 datafusion:vortex-file-compressed +2.1% +1.3% +0.8% +14.9% ➖ noise
19 duckdb:duckdb -0.9% +1.3% -2.2% +17.3% ➖ noise
19 duckdb:vortex-compact -2.0% +1.3% -3.2% +14.6% ➖ noise
19 duckdb:vortex-file-compressed -0.9% +1.3% -2.2% +14.3% ➖ noise
20 datafusion:arrow -1.5% -2.4% +0.9% +11.8% ➖ noise
20 datafusion:vortex-compact +1.6% -2.4% +4.0% +11.8% ➖ noise
20 datafusion:vortex-file-compressed +1.6% -2.4% +4.0% +11.8% ➖ noise
20 duckdb:duckdb -3.6% -2.4% -1.2% +11.8% ➖ noise
20 duckdb:vortex-compact +3.9% -2.4% +6.4% +11.8% ➖ noise
20 duckdb:vortex-file-compressed -0.7% -2.4% +1.7% +11.8% ➖ noise
21 datafusion:arrow -0.9% +0.1% -1.0% +11.8% ➖ noise
21 datafusion:vortex-compact +3.9% +0.1% +3.8% +11.8% ➖ noise
21 datafusion:vortex-file-compressed +4.6% +0.1% +4.5% +11.8% ➖ noise
21 duckdb:duckdb -3.4% +0.1% -3.5% +11.8% ➖ noise
21 duckdb:vortex-compact +4.7% +0.1% +4.6% +11.8% ➖ noise
21 duckdb:vortex-file-compressed -2.9% +0.1% -3.0% +11.8% ➖ noise
22 datafusion:arrow +0.8% -2.3% +3.2% +11.8% ➖ noise
22 datafusion:vortex-compact +1.2% -2.3% +3.5% +11.8% ➖ noise
22 datafusion:vortex-file-compressed +8.6% -2.3% +11.1% +11.8% ➖ noise
22 duckdb:duckdb -1.4% -2.3% +0.9% +11.8% ➖ noise
22 duckdb:vortex-compact +1.2% -2.3% +3.6% +11.8% ➖ noise
22 duckdb:vortex-file-compressed +1.5% -2.3% +3.9% +11.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.8%
Vortex (geomean): 0.854x ✅
Parquet (geomean): 0.884x ✅
Shifts: Parquet (control) -11.6% · Median polish -12.2%


datafusion / vortex-file-compressed (0.818x ✅, 93↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 30154358 36399382 0.83
tpcds_q02/datafusion:vortex-file-compressed 🚀 55943879 70301342 0.80
tpcds_q03/datafusion:vortex-file-compressed 🚀 21617072 25790699 0.84
tpcds_q04/datafusion:vortex-file-compressed 🚀 310006059 418021015 0.74
tpcds_q05/datafusion:vortex-file-compressed 🚀 56585048 80570135 0.70
tpcds_q06/datafusion:vortex-file-compressed 🚀 53324751 74078539 0.72
tpcds_q07/datafusion:vortex-file-compressed 🚀 53134386 73864837 0.72
tpcds_q08/datafusion:vortex-file-compressed 🚀 37370023 49352049 0.76
tpcds_q09/datafusion:vortex-file-compressed 🚀 56842184 70336370 0.81
tpcds_q10/datafusion:vortex-file-compressed 🚀 46458155 61778651 0.75
tpcds_q11/datafusion:vortex-file-compressed 🚀 176371090 224139518 0.79
tpcds_q12/datafusion:vortex-file-compressed 🚀 24765067 30244992 0.82
tpcds_q13/datafusion:vortex-file-compressed 🚀 61247672 70754267 0.87
tpcds_q14/datafusion:vortex-file-compressed 🚀 206763485 250753335 0.82
tpcds_q15/datafusion:vortex-file-compressed 🚀 37661714 45579377 0.83
tpcds_q16/datafusion:vortex-file-compressed 🚀 31283127 39024820 0.80
tpcds_q17/datafusion:vortex-file-compressed 🚀 69191788 89861816 0.77
tpcds_q18/datafusion:vortex-file-compressed 🚀 80627986 119766256 0.67
tpcds_q19/datafusion:vortex-file-compressed 🚀 30609139 47131516 0.65
tpcds_q20/datafusion:vortex-file-compressed 🚀 26468011 40583666 0.65
tpcds_q21/datafusion:vortex-file-compressed 🚀 145696719 199674041 0.73
tpcds_q22/datafusion:vortex-file-compressed 🚀 58766883 66097274 0.89
tpcds_q23/datafusion:vortex-file-compressed 🚀 154851181 177120848 0.87
tpcds_q24/datafusion:vortex-file-compressed 🚀 117290664 136710448 0.86
tpcds_q25/datafusion:vortex-file-compressed 🚀 71532001 81778103 0.87
tpcds_q26/datafusion:vortex-file-compressed 🚀 38570419 45779529 0.84
tpcds_q27/datafusion:vortex-file-compressed 🚀 125239299 151928891 0.82
tpcds_q28/datafusion:vortex-file-compressed 52747942 56107658 0.94
tpcds_q29/datafusion:vortex-file-compressed 🚀 69330124 90221378 0.77
tpcds_q30/datafusion:vortex-file-compressed 🚀 31315733 44342525 0.71
tpcds_q31/datafusion:vortex-file-compressed 🚀 97186741 128469234 0.76
tpcds_q32/datafusion:vortex-file-compressed 🚀 23200516 32361834 0.72
tpcds_q33/datafusion:vortex-file-compressed 🚀 39889655 53297067 0.75
tpcds_q34/datafusion:vortex-file-compressed 🚀 32574651 48093283 0.68
tpcds_q35/datafusion:vortex-file-compressed 🚀 56385695 80120727 0.70
tpcds_q36/datafusion:vortex-file-compressed 🚀 78218391 113488882 0.69
tpcds_q37/datafusion:vortex-file-compressed 🚀 34235615 52418189 0.65
tpcds_q38/datafusion:vortex-file-compressed 🚀 55909605 72936013 0.77
tpcds_q39/datafusion:vortex-file-compressed 🚀 158665230 192421366 0.82
tpcds_q40/datafusion:vortex-file-compressed 🚀 55883499 70720996 0.79
tpcds_q41/datafusion:vortex-file-compressed 21967757 24063090 0.91
tpcds_q42/datafusion:vortex-file-compressed 🚀 19752030 24100190 0.82
tpcds_q43/datafusion:vortex-file-compressed 🚀 33450396 39760044 0.84
tpcds_q44/datafusion:vortex-file-compressed 🚀 41805504 53996295 0.77
tpcds_q45/datafusion:vortex-file-compressed 🚀 35444488 41364590 0.86
tpcds_q46/datafusion:vortex-file-compressed 🚀 48616132 58640411 0.83
tpcds_q47/datafusion:vortex-file-compressed 🚀 212781770 266150441 0.80
tpcds_q48/datafusion:vortex-file-compressed 45690438 49777880 0.92
tpcds_q49/datafusion:vortex-file-compressed 🚀 71174516 81092784 0.88
tpcds_q50/datafusion:vortex-file-compressed 🚀 47147774 57236482 0.82
tpcds_q51/datafusion:vortex-file-compressed 🚀 90973260 108671449 0.84
tpcds_q52/datafusion:vortex-file-compressed 🚀 19236110 24447671 0.79
tpcds_q53/datafusion:vortex-file-compressed 🚀 26958485 30951662 0.87
tpcds_q54/datafusion:vortex-file-compressed 🚀 45081223 51129411 0.88
tpcds_q55/datafusion:vortex-file-compressed 🚀 19345181 22692189 0.85
tpcds_q56/datafusion:vortex-file-compressed 🚀 42090986 47674155 0.88
tpcds_q57/datafusion:vortex-file-compressed 🚀 136466832 164575178 0.83
tpcds_q58/datafusion:vortex-file-compressed 🚀 74768146 86277885 0.87
tpcds_q59/datafusion:vortex-file-compressed 🚀 73954049 88464521 0.84
tpcds_q60/datafusion:vortex-file-compressed 🚀 41471318 50470335 0.82
tpcds_q61/datafusion:vortex-file-compressed 52168531 55007851 0.95
tpcds_q62/datafusion:vortex-file-compressed 🚀 32595173 38551806 0.85
tpcds_q63/datafusion:vortex-file-compressed 🚀 26857203 31649411 0.85
tpcds_q64/datafusion:vortex-file-compressed 🚀 492046735 567529601 0.87
tpcds_q65/datafusion:vortex-file-compressed 🚀 50054939 59471325 0.84
tpcds_q66/datafusion:vortex-file-compressed 🚀 99188915 112273048 0.88
tpcds_q67/datafusion:vortex-file-compressed 🚀 122532853 164560764 0.74
tpcds_q68/datafusion:vortex-file-compressed 🚀 45560574 70845172 0.64
tpcds_q69/datafusion:vortex-file-compressed 🚀 42558858 50123788 0.85
tpcds_q70/datafusion:vortex-file-compressed 🚀 117785783 138672882 0.85
tpcds_q71/datafusion:vortex-file-compressed 🚀 31522017 40097948 0.79
tpcds_q72/datafusion:vortex-file-compressed 🚀 2867812575 3450350508 0.83
tpcds_q73/datafusion:vortex-file-compressed 35801094 38293799 0.93
tpcds_q74/datafusion:vortex-file-compressed 🚀 121534965 143172199 0.85
tpcds_q75/datafusion:vortex-file-compressed 127231958 140697520 0.90
tpcds_q76/datafusion:vortex-file-compressed 🚀 34695035 39272468 0.88
tpcds_q77/datafusion:vortex-file-compressed 🚀 54814508 61272779 0.89
tpcds_q78/datafusion:vortex-file-compressed 🚀 129981503 155358341 0.84
tpcds_q79/datafusion:vortex-file-compressed 🚀 38886600 43880285 0.89
tpcds_q80/datafusion:vortex-file-compressed 🚀 117412339 140231157 0.84
tpcds_q81/datafusion:vortex-file-compressed 🚀 38618466 44255299 0.87
tpcds_q82/datafusion:vortex-file-compressed 🚀 37314862 46128406 0.81
tpcds_q83/datafusion:vortex-file-compressed 🚀 53508734 61969200 0.86
tpcds_q84/datafusion:vortex-file-compressed 🚀 16336742 18850409 0.87
tpcds_q85/datafusion:vortex-file-compressed 🚀 107079778 120615556 0.89
tpcds_q86/datafusion:vortex-file-compressed 🚀 20496432 23026531 0.89
tpcds_q87/datafusion:vortex-file-compressed 🚀 55279643 62868000 0.88
tpcds_q88/datafusion:vortex-file-compressed 🚀 70938420 80727967 0.88
tpcds_q89/datafusion:vortex-file-compressed 🚀 37301786 45346365 0.82
tpcds_q90/datafusion:vortex-file-compressed 🚀 19121741 21272742 0.90
tpcds_q91/datafusion:vortex-file-compressed 🚀 27188286 31961092 0.85
tpcds_q92/datafusion:vortex-file-compressed 🚀 20889253 23213322 0.90
tpcds_q93/datafusion:vortex-file-compressed 🚀 36267199 43675906 0.83
tpcds_q94/datafusion:vortex-file-compressed 🚀 26127502 29861852 0.87
tpcds_q95/datafusion:vortex-file-compressed 🚀 64135095 72448477 0.89
tpcds_q96/datafusion:vortex-file-compressed 🚀 15278345 18454629 0.83
tpcds_q97/datafusion:vortex-file-compressed 🚀 30618322 36883823 0.83
tpcds_q98/datafusion:vortex-file-compressed 🚀 35710459 41080024 0.87
tpcds_q99/datafusion:vortex-file-compressed 🚀 48671173 56207492 0.87
datafusion / vortex-compact (0.839x ✅, 73↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 37284771 40713555 0.92
tpcds_q02/datafusion:vortex-compact 65470196 71466889 0.92
tpcds_q03/datafusion:vortex-compact 🚀 28228674 32628017 0.87
tpcds_q04/datafusion:vortex-compact 🚀 352857264 474158076 0.74
tpcds_q05/datafusion:vortex-compact 🚀 68604879 85681783 0.80
tpcds_q06/datafusion:vortex-compact 🚀 59943180 74254366 0.81
tpcds_q07/datafusion:vortex-compact 70361741 76603174 0.92
tpcds_q08/datafusion:vortex-compact 🚀 46403108 60411173 0.77
tpcds_q09/datafusion:vortex-compact 🚀 74768880 91378944 0.82
tpcds_q10/datafusion:vortex-compact 🚀 68423787 90809916 0.75
tpcds_q11/datafusion:vortex-compact 🚀 203104399 230373068 0.88
tpcds_q12/datafusion:vortex-compact 🚀 29156845 35283482 0.83
tpcds_q13/datafusion:vortex-compact 126307340 137481229 0.92
tpcds_q14/datafusion:vortex-compact 🚀 273409212 344476664 0.79
tpcds_q15/datafusion:vortex-compact 🚀 39648276 56049333 0.71
tpcds_q16/datafusion:vortex-compact 🚀 40099945 45647276 0.88
tpcds_q17/datafusion:vortex-compact 🚀 96912150 109123136 0.89
tpcds_q18/datafusion:vortex-compact 🚀 92051443 108956926 0.84
tpcds_q19/datafusion:vortex-compact 🚀 46410726 52127084 0.89
tpcds_q20/datafusion:vortex-compact 🚀 30791214 36038663 0.85
tpcds_q21/datafusion:vortex-compact 🚀 149346643 176047212 0.85
tpcds_q22/datafusion:vortex-compact 🚀 69624383 87645061 0.79
tpcds_q23/datafusion:vortex-compact 🚀 193407017 237073226 0.82
tpcds_q24/datafusion:vortex-compact 🚀 145710464 198245392 0.74
tpcds_q25/datafusion:vortex-compact 🚀 100477483 111693611 0.90
tpcds_q26/datafusion:vortex-compact 🚀 51046665 60645680 0.84
tpcds_q27/datafusion:vortex-compact 🚀 166042967 212089931 0.78
tpcds_q28/datafusion:vortex-compact 92878885 94867783 0.98
tpcds_q29/datafusion:vortex-compact 🚀 95500433 106122585 0.90
tpcds_q30/datafusion:vortex-compact 39462679 41405920 0.95
tpcds_q31/datafusion:vortex-compact 141755536 156020989 0.91
tpcds_q32/datafusion:vortex-compact 28072332 31116919 0.90
tpcds_q33/datafusion:vortex-compact 56940710 62235495 0.91
tpcds_q34/datafusion:vortex-compact 🚀 52020067 58537965 0.89
tpcds_q35/datafusion:vortex-compact 🚀 72467335 88590418 0.82
tpcds_q36/datafusion:vortex-compact 🚀 105496517 122962459 0.86
tpcds_q37/datafusion:vortex-compact 🚀 51385211 57923440 0.89
tpcds_q38/datafusion:vortex-compact 🚀 70846036 80470521 0.88
tpcds_q39/datafusion:vortex-compact 🚀 148315995 186270773 0.80
tpcds_q40/datafusion:vortex-compact 🚀 62812815 72920280 0.86
tpcds_q41/datafusion:vortex-compact 22734745 24385234 0.93
tpcds_q42/datafusion:vortex-compact 🚀 26216186 29315757 0.89
tpcds_q43/datafusion:vortex-compact 🚀 39955215 44470389 0.90
tpcds_q44/datafusion:vortex-compact 77068858 84243996 0.91
tpcds_q45/datafusion:vortex-compact 🚀 40824391 46776311 0.87
tpcds_q46/datafusion:vortex-compact 🚀 74368916 83892110 0.89
tpcds_q47/datafusion:vortex-compact 🚀 247278989 291971223 0.85
tpcds_q48/datafusion:vortex-compact 95263060 99785515 0.95
tpcds_q49/datafusion:vortex-compact 🚀 94525261 119596811 0.79
tpcds_q50/datafusion:vortex-compact 🚀 66791319 91005058 0.73
tpcds_q51/datafusion:vortex-compact 🚀 101726111 116881755 0.87
tpcds_q52/datafusion:vortex-compact 🚀 25367710 31925885 0.79
tpcds_q53/datafusion:vortex-compact 37832091 41575556 0.91
tpcds_q54/datafusion:vortex-compact 62865117 68046903 0.92
tpcds_q55/datafusion:vortex-compact 26261359 28227298 0.93
tpcds_q56/datafusion:vortex-compact 🚀 57984910 64523995 0.90
tpcds_q57/datafusion:vortex-compact 🚀 154658763 174609614 0.89
tpcds_q58/datafusion:vortex-compact 🚀 88009378 110616682 0.80
tpcds_q59/datafusion:vortex-compact 🚀 91360229 118271745 0.77
tpcds_q60/datafusion:vortex-compact 🚀 60675135 72459437 0.84
tpcds_q61/datafusion:vortex-compact 🚀 76629181 93059022 0.82
tpcds_q62/datafusion:vortex-compact 🚀 35404797 45631765 0.78
tpcds_q63/datafusion:vortex-compact 🚀 37525485 42881804 0.88
tpcds_q64/datafusion:vortex-compact 🚀 567078700 686444680 0.83
tpcds_q65/datafusion:vortex-compact 🚀 75350524 93866251 0.80
tpcds_q66/datafusion:vortex-compact 🚀 102890323 139382067 0.74
tpcds_q67/datafusion:vortex-compact 133680884 145568923 0.92
tpcds_q68/datafusion:vortex-compact 75771399 83835766 0.90
tpcds_q69/datafusion:vortex-compact 🚀 65453472 81655809 0.80
tpcds_q70/datafusion:vortex-compact 135476704 149859215 0.90
tpcds_q71/datafusion:vortex-compact 🚀 52893791 61970168 0.85
tpcds_q72/datafusion:vortex-compact 🚀 2897741160 3455672542 0.84
tpcds_q73/datafusion:vortex-compact 57246109 59223944 0.97
tpcds_q74/datafusion:vortex-compact 🚀 144210769 164022648 0.88
tpcds_q75/datafusion:vortex-compact 173637044 191172767 0.91
tpcds_q76/datafusion:vortex-compact 52639339 57478733 0.92
tpcds_q77/datafusion:vortex-compact 🚀 71045358 82303580 0.86
tpcds_q78/datafusion:vortex-compact 🚀 157224473 216485736 0.73
tpcds_q79/datafusion:vortex-compact 🚀 60925986 80524107 0.76
tpcds_q80/datafusion:vortex-compact 🚀 141537619 193181703 0.73
tpcds_q81/datafusion:vortex-compact 🚀 46798572 61756618 0.76
tpcds_q82/datafusion:vortex-compact 🚀 50327247 69816097 0.72
tpcds_q83/datafusion:vortex-compact 🚀 61791169 86367993 0.72
tpcds_q84/datafusion:vortex-compact 🚀 20141111 29350316 0.69
tpcds_q85/datafusion:vortex-compact 🚀 133789700 173028213 0.77
tpcds_q86/datafusion:vortex-compact 23773682 26307143 0.90
tpcds_q87/datafusion:vortex-compact 🚀 72947814 83363732 0.88
tpcds_q88/datafusion:vortex-compact 141928499 155970146 0.91
tpcds_q89/datafusion:vortex-compact 🚀 48689424 55508488 0.88
tpcds_q90/datafusion:vortex-compact 25901199 27405590 0.95
tpcds_q91/datafusion:vortex-compact 42094725 44493876 0.95
tpcds_q92/datafusion:vortex-compact 27355750 30283458 0.90
tpcds_q93/datafusion:vortex-compact 🚀 47871307 65529666 0.73
tpcds_q94/datafusion:vortex-compact 🚀 32409812 43128629 0.75
tpcds_q95/datafusion:vortex-compact 🚀 73899036 93926009 0.79
tpcds_q96/datafusion:vortex-compact 🚀 27616684 34050424 0.81
tpcds_q97/datafusion:vortex-compact 🚀 44182392 61143122 0.72
tpcds_q98/datafusion:vortex-compact 🚀 41555680 58086029 0.72
tpcds_q99/datafusion:vortex-compact 🚀 49233763 78774251 0.62
datafusion / parquet (0.870x ✅, 70↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚀 37056955 44527967 0.83
tpcds_q02/datafusion:parquet 48344025 52139377 0.93
tpcds_q03/datafusion:parquet 15917992 17664223 0.90
tpcds_q04/datafusion:parquet 🚀 346150499 411377019 0.84
tpcds_q05/datafusion:parquet 🚀 54929594 76197214 0.72
tpcds_q06/datafusion:parquet 69133893 74004832 0.93
tpcds_q07/datafusion:parquet 🚀 96529739 110662968 0.87
tpcds_q08/datafusion:parquet 🚀 34362062 38649252 0.89
tpcds_q09/datafusion:parquet 60161742 66402524 0.91
tpcds_q10/datafusion:parquet 🚀 86296459 98307818 0.88
tpcds_q11/datafusion:parquet 🚀 191161278 223573397 0.86
tpcds_q12/datafusion:parquet 24992349 26092700 0.96
tpcds_q13/datafusion:parquet 91692817 100985886 0.91
tpcds_q14/datafusion:parquet 🚀 202586938 230520278 0.88
tpcds_q15/datafusion:parquet 🚀 28444557 33512370 0.85
tpcds_q16/datafusion:parquet 🚀 28533895 33274869 0.86
tpcds_q17/datafusion:parquet 🚀 71635860 82806812 0.87
tpcds_q18/datafusion:parquet 🚀 138969716 156135855 0.89
tpcds_q19/datafusion:parquet 29750426 32266337 0.92
tpcds_q20/datafusion:parquet 🚀 22922909 26720786 0.86
tpcds_q21/datafusion:parquet 23534950 25554887 0.92
tpcds_q22/datafusion:parquet 181632310 188106339 0.97
tpcds_q23/datafusion:parquet 🚀 175170610 200713282 0.87
tpcds_q24/datafusion:parquet 🚀 110938662 131054617 0.85
tpcds_q25/datafusion:parquet 76117459 83584400 0.91
tpcds_q26/datafusion:parquet 🚀 77182451 94598861 0.82
tpcds_q27/datafusion:parquet 🚀 171535423 204875259 0.84
tpcds_q28/datafusion:parquet 🚀 51763247 60261396 0.86
tpcds_q29/datafusion:parquet 🚀 74935830 86586074 0.87
tpcds_q30/datafusion:parquet 🚀 45839072 53417366 0.86
tpcds_q31/datafusion:parquet 81670160 88296561 0.92
tpcds_q32/datafusion:parquet 24294554 26795724 0.91
tpcds_q33/datafusion:parquet 🚀 36831773 42535644 0.87
tpcds_q34/datafusion:parquet 🚀 28902812 35964165 0.80
tpcds_q35/datafusion:parquet 🚀 89968409 102689982 0.88
tpcds_q36/datafusion:parquet 🚀 66334832 92352196 0.72
tpcds_q37/datafusion:parquet 🚀 24181131 32971136 0.73
tpcds_q38/datafusion:parquet 🚀 52653715 60076722 0.88
tpcds_q39/datafusion:parquet 🚀 85552930 123983460 0.69
tpcds_q40/datafusion:parquet 29406938 32381319 0.91
tpcds_q41/datafusion:parquet 🚀 17238561 20676022 0.83
tpcds_q42/datafusion:parquet 🚀 14657913 16344959 0.90
tpcds_q43/datafusion:parquet 20293522 22467066 0.90
tpcds_q44/datafusion:parquet 🚀 45334199 51622108 0.88
tpcds_q45/datafusion:parquet 🚀 35131450 40442653 0.87
tpcds_q46/datafusion:parquet 🚀 40797812 50233870 0.81
tpcds_q47/datafusion:parquet 🚀 144545882 173062584 0.84
tpcds_q48/datafusion:parquet 🚀 82372493 107124904 0.77
tpcds_q49/datafusion:parquet 🚀 69531798 90056258 0.77
tpcds_q50/datafusion:parquet 🚀 51828086 58483505 0.89
tpcds_q51/datafusion:parquet 🚀 90767942 103543753 0.88
tpcds_q52/datafusion:parquet 🚀 14535983 16259113 0.89
tpcds_q53/datafusion:parquet 23217155 24719484 0.94
tpcds_q54/datafusion:parquet 44352267 49102923 0.90
tpcds_q55/datafusion:parquet 🚀 14518454 17342772 0.84
tpcds_q56/datafusion:parquet 🚀 36145066 41924144 0.86
tpcds_q57/datafusion:parquet 🚀 110028550 132719426 0.83
tpcds_q58/datafusion:parquet 🚀 61687824 69446361 0.89
tpcds_q59/datafusion:parquet 64193972 66166809 0.97
tpcds_q60/datafusion:parquet 36363396 39997730 0.91
tpcds_q61/datafusion:parquet 🚀 51826085 60295760 0.86
tpcds_q62/datafusion:parquet 🚀 29939608 34201543 0.88
tpcds_q63/datafusion:parquet 23301056 24774557 0.94
tpcds_q64/datafusion:parquet 🚀 569825636 646892837 0.88
tpcds_q65/datafusion:parquet 48582135 52713949 0.92
tpcds_q66/datafusion:parquet 79537756 86348133 0.92
tpcds_q67/datafusion:parquet 🚀 159208738 182517518 0.87
tpcds_q68/datafusion:parquet 🚀 41266602 46727586 0.88
tpcds_q69/datafusion:parquet 🚀 83517176 94214035 0.89
tpcds_q70/datafusion:parquet 🚀 99670589 116113737 0.86
tpcds_q71/datafusion:parquet 🚀 27067273 30700988 0.88
tpcds_q72/datafusion:parquet 🚀 682981507 790359894 0.86
tpcds_q73/datafusion:parquet 30866807 30912636 1.00
tpcds_q74/datafusion:parquet 🚀 107943281 132621194 0.81
tpcds_q75/datafusion:parquet 125050742 137421344 0.91
tpcds_q76/datafusion:parquet 🚀 38017900 43596899 0.87
tpcds_q77/datafusion:parquet 🚀 50533697 57132165 0.88
tpcds_q78/datafusion:parquet 🚀 130925911 146785554 0.89
tpcds_q79/datafusion:parquet 32724602 35772768 0.91
tpcds_q80/datafusion:parquet 🚀 95107195 113573740 0.84
tpcds_q81/datafusion:parquet 🚀 44527797 51484863 0.86
tpcds_q82/datafusion:parquet 🚀 24387188 28122954 0.87
tpcds_q83/datafusion:parquet 🚀 50037679 57446570 0.87
tpcds_q84/datafusion:parquet 51017818 55441402 0.92
tpcds_q85/datafusion:parquet 🚀 175445798 202503371 0.87
tpcds_q86/datafusion:parquet 🚀 19032874 22970985 0.83
tpcds_q87/datafusion:parquet 🚀 53045483 64065441 0.83
tpcds_q88/datafusion:parquet 🚀 71107914 81616545 0.87
tpcds_q89/datafusion:parquet 🚀 25479435 28932172 0.88
tpcds_q90/datafusion:parquet 20054388 22034146 0.91
tpcds_q91/datafusion:parquet 75453519 82649216 0.91
tpcds_q92/datafusion:parquet 🚀 22600737 27071204 0.83
tpcds_q93/datafusion:parquet 🚀 36343724 44372126 0.82
tpcds_q94/datafusion:parquet 🚀 25284456 30201900 0.84
tpcds_q95/datafusion:parquet 🚀 70721877 79684620 0.89
tpcds_q96/datafusion:parquet 16374542 17543183 0.93
tpcds_q97/datafusion:parquet 🚀 34423383 41503079 0.83
tpcds_q98/datafusion:parquet 🚀 27623617 33938194 0.81
tpcds_q99/datafusion:parquet 30707235 32436624 0.95
duckdb / vortex-file-compressed (0.870x ✅, 64↑ 1↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚀 23338636 26089966 0.89
tpcds_q02/duckdb:vortex-file-compressed 🚨 51689292 41552522 1.24
tpcds_q03/duckdb:vortex-file-compressed 32665934 32866033 0.99
tpcds_q04/duckdb:vortex-file-compressed 103893819 114004543 0.91
tpcds_q05/duckdb:vortex-file-compressed 37475595 39714610 0.94
tpcds_q06/duckdb:vortex-file-compressed 36717481 40217010 0.91
tpcds_q07/duckdb:vortex-file-compressed 24375681 26780670 0.91
tpcds_q08/duckdb:vortex-file-compressed 🚀 26054740 31820005 0.82
tpcds_q09/duckdb:vortex-file-compressed 39910625 44125013 0.90
tpcds_q10/duckdb:vortex-file-compressed 🚀 38629105 44359871 0.87
tpcds_q11/duckdb:vortex-file-compressed 58112631 64540375 0.90
tpcds_q12/duckdb:vortex-file-compressed 🚀 15736776 17942999 0.88
tpcds_q13/duckdb:vortex-file-compressed 33794295 36872293 0.92
tpcds_q14/duckdb:vortex-file-compressed 116789791 121999181 0.96
tpcds_q15/duckdb:vortex-file-compressed 43528973 47400221 0.92
tpcds_q16/duckdb:vortex-file-compressed 32081778 34754000 0.92
tpcds_q17/duckdb:vortex-file-compressed 🚀 38294388 43070171 0.89
tpcds_q18/duckdb:vortex-file-compressed 48662782 51159132 0.95
tpcds_q19/duckdb:vortex-file-compressed 🚀 33971112 39532363 0.86
tpcds_q20/duckdb:vortex-file-compressed 17979196 18910394 0.95
tpcds_q21/duckdb:vortex-file-compressed 🚀 21634684 24246654 0.89
tpcds_q22/duckdb:vortex-file-compressed 🚀 109483588 123821093 0.88
tpcds_q23/duckdb:vortex-file-compressed 🚀 113332324 127283235 0.89
tpcds_q24/duckdb:vortex-file-compressed 🚀 56236026 64407279 0.87
tpcds_q25/duckdb:vortex-file-compressed 🚀 37929525 43246922 0.88
tpcds_q26/duckdb:vortex-file-compressed 42810029 44500893 0.96
tpcds_q27/duckdb:vortex-file-compressed 57098988 62084660 0.92
tpcds_q28/duckdb:vortex-file-compressed 🚀 38957083 43436586 0.90
tpcds_q29/duckdb:vortex-file-compressed 36735099 39835163 0.92
tpcds_q30/duckdb:vortex-file-compressed 🚀 26998093 30450047 0.89
tpcds_q31/duckdb:vortex-file-compressed 34980605 38080562 0.92
tpcds_q32/duckdb:vortex-file-compressed 🚀 18511214 21092003 0.88
tpcds_q33/duckdb:vortex-file-compressed 🚀 25473581 29295186 0.87
tpcds_q34/duckdb:vortex-file-compressed 20212009 21618317 0.93
tpcds_q35/duckdb:vortex-file-compressed 🚀 67897678 76871656 0.88
tpcds_q36/duckdb:vortex-file-compressed 29228524 31263877 0.93
tpcds_q37/duckdb:vortex-file-compressed 🚀 24958177 28566346 0.87
tpcds_q38/duckdb:vortex-file-compressed 38370670 41442747 0.93
tpcds_q39/duckdb:vortex-file-compressed 45925965 50056369 0.92
tpcds_q40/duckdb:vortex-file-compressed 25345168 27367590 0.93
tpcds_q41/duckdb:vortex-file-compressed 🚀 15226825 17516293 0.87
tpcds_q42/duckdb:vortex-file-compressed 12575879 13915848 0.90
tpcds_q43/duckdb:vortex-file-compressed 30998769 33545741 0.92
tpcds_q44/duckdb:vortex-file-compressed 23351014 25588057 0.91
tpcds_q45/duckdb:vortex-file-compressed 🚀 27794716 34586521 0.80
tpcds_q46/duckdb:vortex-file-compressed 🚀 48695422 56661423 0.86
tpcds_q47/duckdb:vortex-file-compressed 🚀 52353529 59026809 0.89
tpcds_q48/duckdb:vortex-file-compressed 🚀 31329471 36212830 0.87
tpcds_q49/duckdb:vortex-file-compressed 🚀 30608201 35407695 0.86
tpcds_q50/duckdb:vortex-file-compressed 37113394 39191120 0.95
tpcds_q51/duckdb:vortex-file-compressed 115066318 119143625 0.97
tpcds_q52/duckdb:vortex-file-compressed 🚀 13146291 15046066 0.87
tpcds_q53/duckdb:vortex-file-compressed 🚀 20879990 26588033 0.79
tpcds_q54/duckdb:vortex-file-compressed 🚀 31191994 36467241 0.86
tpcds_q55/duckdb:vortex-file-compressed 🚀 12911439 15646951 0.83
tpcds_q56/duckdb:vortex-file-compressed 25667119 27725967 0.93
tpcds_q57/duckdb:vortex-file-compressed 47489326 51051534 0.93
tpcds_q58/duckdb:vortex-file-compressed 🚀 32352872 38097666 0.85
tpcds_q59/duckdb:vortex-file-compressed 80062455 86186219 0.93
tpcds_q60/duckdb:vortex-file-compressed 🚀 26066444 32728396 0.80
tpcds_q61/duckdb:vortex-file-compressed 🚀 38831404 45406627 0.86
tpcds_q62/duckdb:vortex-file-compressed 🚀 18015963 25645164 0.70
tpcds_q63/duckdb:vortex-file-compressed 🚀 22032279 24632717 0.89
tpcds_q64/duckdb:vortex-file-compressed 🚀 85358203 97006244 0.88
tpcds_q65/duckdb:vortex-file-compressed 🚀 24603180 32559146 0.76
tpcds_q66/duckdb:vortex-file-compressed 🚀 35454049 42568665 0.83
tpcds_q67/duckdb:vortex-file-compressed 🚀 145505853 205288850 0.71
tpcds_q68/duckdb:vortex-file-compressed 🚀 41776147 58241407 0.72
tpcds_q69/duckdb:vortex-file-compressed 🚀 39372519 52888865 0.74
tpcds_q70/duckdb:vortex-file-compressed 🚀 27877390 34849420 0.80
tpcds_q71/duckdb:vortex-file-compressed 🚀 22483628 29918382 0.75
tpcds_q72/duckdb:vortex-file-compressed 🚀 179256194 210221464 0.85
tpcds_q73/duckdb:vortex-file-compressed 🚀 21191377 24569089 0.86
tpcds_q74/duckdb:vortex-file-compressed 🚀 65033992 72315250 0.90
tpcds_q75/duckdb:vortex-file-compressed 🚀 61768709 69594001 0.89
tpcds_q76/duckdb:vortex-file-compressed 🚀 22111695 29351750 0.75
tpcds_q77/duckdb:vortex-file-compressed 🚀 28727595 40085318 0.72
tpcds_q78/duckdb:vortex-file-compressed 🚀 82496497 105809768 0.78
tpcds_q79/duckdb:vortex-file-compressed 🚀 36474555 46605126 0.78
tpcds_q80/duckdb:vortex-file-compressed 🚀 54864168 72822692 0.75
tpcds_q81/duckdb:vortex-file-compressed 🚀 32227136 42697967 0.75
tpcds_q82/duckdb:vortex-file-compressed 🚀 24536064 31731235 0.77
tpcds_q83/duckdb:vortex-file-compressed 🚀 31216229 35397662 0.88
tpcds_q84/duckdb:vortex-file-compressed 🚀 18648563 22422528 0.83
tpcds_q85/duckdb:vortex-file-compressed 🚀 50608399 56728091 0.89
tpcds_q86/duckdb:vortex-file-compressed 🚀 18298582 20463597 0.89
tpcds_q87/duckdb:vortex-file-compressed 42604306 45710414 0.93
tpcds_q88/duckdb:vortex-file-compressed 🚀 36317891 41072201 0.88
tpcds_q89/duckdb:vortex-file-compressed 🚀 20537350 23652534 0.87
tpcds_q90/duckdb:vortex-file-compressed 14464443 15834225 0.91
tpcds_q91/duckdb:vortex-file-compressed 🚀 32357365 37242757 0.87
tpcds_q92/duckdb:vortex-file-compressed 16060650 17831261 0.90
tpcds_q93/duckdb:vortex-file-compressed 🚀 30337718 34055149 0.89
tpcds_q94/duckdb:vortex-file-compressed 🚀 24778591 28003482 0.88
tpcds_q95/duckdb:vortex-file-compressed 154249662 147238205 1.05
tpcds_q96/duckdb:vortex-file-compressed 🚀 11313755 13524197 0.84
tpcds_q97/duckdb:vortex-file-compressed 🚀 42051705 52594831 0.80
tpcds_q98/duckdb:vortex-file-compressed 🚀 20072282 28487179 0.70
tpcds_q99/duckdb:vortex-file-compressed 🚀 32216681 39226937 0.82
duckdb / vortex-compact (0.893x ✅, 46↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚀 27168557 37802451 0.72
tpcds_q02/duckdb:vortex-compact 🚀 55672037 69032690 0.81
tpcds_q03/duckdb:vortex-compact 🚀 56289792 65885976 0.85
tpcds_q04/duckdb:vortex-compact 🚀 117558796 143875454 0.82
tpcds_q05/duckdb:vortex-compact 🚀 39276436 49554105 0.79
tpcds_q06/duckdb:vortex-compact 🚀 40713972 52191741 0.78
tpcds_q07/duckdb:vortex-compact 🚀 36342144 45744822 0.79
tpcds_q08/duckdb:vortex-compact 🚀 37211053 42219405 0.88
tpcds_q09/duckdb:vortex-compact 58981456 64055019 0.92
tpcds_q10/duckdb:vortex-compact 49401480 54271750 0.91
tpcds_q11/duckdb:vortex-compact 62413064 67289257 0.93
tpcds_q12/duckdb:vortex-compact 🚀 19703633 22943734 0.86
tpcds_q13/duckdb:vortex-compact 49555587 54322705 0.91
tpcds_q14/duckdb:vortex-compact 126527535 137634200 0.92
tpcds_q15/duckdb:vortex-compact 47396650 51495488 0.92
tpcds_q16/duckdb:vortex-compact 🚀 35518845 40096450 0.89
tpcds_q17/duckdb:vortex-compact 51147187 54935704 0.93
tpcds_q18/duckdb:vortex-compact 🚀 60419794 68074653 0.89
tpcds_q19/duckdb:vortex-compact 42679790 46338926 0.92
tpcds_q20/duckdb:vortex-compact 22691263 24581827 0.92
tpcds_q21/duckdb:vortex-compact 29654738 32466069 0.91
tpcds_q22/duckdb:vortex-compact 🚀 119135030 137351405 0.87
tpcds_q23/duckdb:vortex-compact 110543730 122541739 0.90
tpcds_q24/duckdb:vortex-compact 🚀 69727653 79133789 0.88
tpcds_q25/duckdb:vortex-compact 🚀 50599479 58144769 0.87
tpcds_q26/duckdb:vortex-compact 51819495 56387613 0.92
tpcds_q27/duckdb:vortex-compact 69283289 73678211 0.94
tpcds_q28/duckdb:vortex-compact 88123634 89537988 0.98
tpcds_q29/duckdb:vortex-compact 🚀 49718166 55603183 0.89
tpcds_q30/duckdb:vortex-compact 🚀 31926663 39049347 0.82
tpcds_q31/duckdb:vortex-compact 🚀 35869460 39941584 0.90
tpcds_q32/duckdb:vortex-compact 24779440 26307247 0.94
tpcds_q33/duckdb:vortex-compact 🚀 32388613 36754303 0.88
tpcds_q34/duckdb:vortex-compact 🚀 26657307 30572141 0.87
tpcds_q35/duckdb:vortex-compact 🚀 73167158 89304592 0.82
tpcds_q36/duckdb:vortex-compact 36918674 39296272 0.94
tpcds_q37/duckdb:vortex-compact 35326494 37071074 0.95
tpcds_q38/duckdb:vortex-compact 42431856 44334293 0.96
tpcds_q39/duckdb:vortex-compact 53576240 57641010 0.93
tpcds_q40/duckdb:vortex-compact 31408364 32123052 0.98
tpcds_q41/duckdb:vortex-compact 18540943 19963557 0.93
tpcds_q42/duckdb:vortex-compact 17475682 19383889 0.90
tpcds_q43/duckdb:vortex-compact 39299718 40729716 0.96
tpcds_q44/duckdb:vortex-compact 🚀 31663428 35223760 0.90
tpcds_q45/duckdb:vortex-compact 🚀 33411002 40006956 0.84
tpcds_q46/duckdb:vortex-compact 🚀 60604343 68362383 0.89
tpcds_q47/duckdb:vortex-compact 🚀 58057677 72124381 0.80
tpcds_q48/duckdb:vortex-compact 🚀 42266163 50938719 0.83
tpcds_q49/duckdb:vortex-compact 🚀 44836329 55736162 0.80
tpcds_q50/duckdb:vortex-compact 48223551 53302068 0.90
tpcds_q51/duckdb:vortex-compact 131630425 121133415 1.09
tpcds_q52/duckdb:vortex-compact 🚀 16982995 19995323 0.85
tpcds_q53/duckdb:vortex-compact 29081044 31949595 0.91
tpcds_q54/duckdb:vortex-compact 39377986 40274678 0.98
tpcds_q55/duckdb:vortex-compact 17760874 19412619 0.91
tpcds_q56/duckdb:vortex-compact 🚀 29768200 34350484 0.87
tpcds_q57/duckdb:vortex-compact 🚀 48356964 57282856 0.84
tpcds_q58/duckdb:vortex-compact 🚀 46551428 53146613 0.88
tpcds_q59/duckdb:vortex-compact 🚀 80034734 112800240 0.71
tpcds_q60/duckdb:vortex-compact 33019770 36540202 0.90
tpcds_q61/duckdb:vortex-compact 🚀 50964394 57747406 0.88
tpcds_q62/duckdb:vortex-compact 20938219 22854695 0.92
tpcds_q63/duckdb:vortex-compact 🚀 29303107 33139168 0.88
tpcds_q64/duckdb:vortex-compact 🚀 104264353 126288158 0.83
tpcds_q65/duckdb:vortex-compact 32212120 33679259 0.96
tpcds_q66/duckdb:vortex-compact 40487447 42172650 0.96
tpcds_q67/duckdb:vortex-compact 🚀 156052888 176430205 0.88
tpcds_q68/duckdb:vortex-compact 54854898 58643164 0.94
tpcds_q69/duckdb:vortex-compact 51228135 56376196 0.91
tpcds_q70/duckdb:vortex-compact 35573949 38953316 0.91
tpcds_q71/duckdb:vortex-compact 28201110 29579967 0.95
tpcds_q72/duckdb:vortex-compact 198897344 214195287 0.93
tpcds_q73/duckdb:vortex-compact 26646577 28727060 0.93
tpcds_q74/duckdb:vortex-compact 69655250 74226640 0.94
tpcds_q75/duckdb:vortex-compact 72623281 74295349 0.98
tpcds_q76/duckdb:vortex-compact 42751733 44991423 0.95
tpcds_q77/duckdb:vortex-compact 🚀 37712132 44248441 0.85
tpcds_q78/duckdb:vortex-compact 87194091 96571757 0.90
tpcds_q79/duckdb:vortex-compact 57979411 60318711 0.96
tpcds_q80/duckdb:vortex-compact 🚀 67141174 79939051 0.84
tpcds_q81/duckdb:vortex-compact 🚀 36488932 41408232 0.88
tpcds_q82/duckdb:vortex-compact 33247960 35797842 0.93
tpcds_q83/duckdb:vortex-compact 47126958 52275190 0.90
tpcds_q84/duckdb:vortex-compact 🚀 23426035 26816902 0.87
tpcds_q85/duckdb:vortex-compact 🚀 63570806 71775509 0.89
tpcds_q86/duckdb:vortex-compact 20994131 22667972 0.93
tpcds_q87/duckdb:vortex-compact 🚀 42637628 51430286 0.83
tpcds_q88/duckdb:vortex-compact 41585138 44466434 0.94
tpcds_q89/duckdb:vortex-compact 28501165 31009891 0.92
tpcds_q90/duckdb:vortex-compact 17053617 17833574 0.96
tpcds_q91/duckdb:vortex-compact 🚀 51453019 59644214 0.86
tpcds_q92/duckdb:vortex-compact 🚀 21835445 24386556 0.90
tpcds_q93/duckdb:vortex-compact 🚀 33825021 39591553 0.85
tpcds_q94/duckdb:vortex-compact 🚀 26422903 31520742 0.84
tpcds_q95/duckdb:vortex-compact 144568050 156463991 0.92
tpcds_q96/duckdb:vortex-compact 14224162 15083848 0.94
tpcds_q97/duckdb:vortex-compact 43175871 46827487 0.92
tpcds_q98/duckdb:vortex-compact 🚀 24537784 28162952 0.87
tpcds_q99/duckdb:vortex-compact 35657183 38774464 0.92
duckdb / parquet (0.898x ✅, 44↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29577248 31777266 0.93
tpcds_q02/duckdb:parquet 23678207 25816945 0.92
tpcds_q03/duckdb:parquet 12082409 12819097 0.94
tpcds_q04/duckdb:parquet 172232250 183505399 0.94
tpcds_q05/duckdb:parquet 31460816 33312103 0.94
tpcds_q06/duckdb:parquet 🚀 28526216 31826034 0.90
tpcds_q07/duckdb:parquet 21363917 22195850 0.96
tpcds_q08/duckdb:parquet 28520614 30002998 0.95
tpcds_q09/duckdb:parquet 40344014 41857866 0.96
tpcds_q10/duckdb:parquet 🚀 34310461 38736719 0.89
tpcds_q11/duckdb:parquet 🚀 86450381 99643753 0.87
tpcds_q12/duckdb:parquet 🚀 15601742 19050107 0.82
tpcds_q13/duckdb:parquet 🚀 33261907 38764197 0.86
tpcds_q14/duckdb:parquet 🚀 102119340 117829851 0.87
tpcds_q15/duckdb:parquet 🚀 30915757 42437682 0.73
tpcds_q16/duckdb:parquet 🚀 22687489 28046356 0.81
tpcds_q17/duckdb:parquet 🚀 36943773 46606356 0.79
tpcds_q18/duckdb:parquet 🚀 46671145 54828780 0.85
tpcds_q19/duckdb:parquet 🚀 29607925 36236221 0.82
tpcds_q20/duckdb:parquet 🚀 15484705 18255726 0.85
tpcds_q21/duckdb:parquet 🚀 10767575 13928918 0.77
tpcds_q22/duckdb:parquet 🚀 70305977 93496204 0.75
tpcds_q23/duckdb:parquet 🚀 81627832 90799946 0.90
tpcds_q24/duckdb:parquet 🚀 44074117 49660760 0.89
tpcds_q25/duckdb:parquet 🚀 33446827 37403528 0.89
tpcds_q26/duckdb:parquet 39505467 40879196 0.97
tpcds_q27/duckdb:parquet 50108244 53671922 0.93
tpcds_q28/duckdb:parquet 37662577 41429566 0.91
tpcds_q29/duckdb:parquet 🚀 34984590 39885783 0.88
tpcds_q30/duckdb:parquet 36776813 39144813 0.94
tpcds_q31/duckdb:parquet 🚀 23008584 27289861 0.84
tpcds_q32/duckdb:parquet 12329315 12457536 0.99
tpcds_q33/duckdb:parquet 🚀 21033941 23948902 0.88
tpcds_q34/duckdb:parquet 21301020 22080937 0.96
tpcds_q35/duckdb:parquet 🚀 57629626 67576338 0.85
tpcds_q36/duckdb:parquet 19970917 21683856 0.92
tpcds_q37/duckdb:parquet 🚀 12571460 14864205 0.85
tpcds_q38/duckdb:parquet 🚀 33290110 38201807 0.87
tpcds_q39/duckdb:parquet 29512444 32627348 0.90
tpcds_q40/duckdb:parquet 18108973 20002112 0.91
tpcds_q41/duckdb:parquet 7922275 8691353 0.91
tpcds_q42/duckdb:parquet 11067176 10797916 1.02
tpcds_q43/duckdb:parquet 15603950 16368413 0.95
tpcds_q44/duckdb:parquet 22727129 24312344 0.93
tpcds_q45/duckdb:parquet 🚀 27588272 31869288 0.87
tpcds_q46/duckdb:parquet 🚀 45674913 52864267 0.86
tpcds_q47/duckdb:parquet 45295911 50144821 0.90
tpcds_q48/duckdb:parquet 29635575 32896724 0.90
tpcds_q49/duckdb:parquet 25315412 27643781 0.92
tpcds_q50/duckdb:parquet 24387648 25892742 0.94
tpcds_q51/duckdb:parquet 98295911 103233919 0.95
tpcds_q52/duckdb:parquet 11500444 11457904 1.00
tpcds_q53/duckdb:parquet 15342320 16799763 0.91
tpcds_q54/duckdb:parquet 26132717 27995696 0.93
tpcds_q55/duckdb:parquet 10592971 10991360 0.96
tpcds_q56/duckdb:parquet 🚀 21288907 24178726 0.88
tpcds_q57/duckdb:parquet 35339079 38372243 0.92
tpcds_q58/duckdb:parquet 23416364 24600202 0.95
tpcds_q59/duckdb:parquet 35028236 37911199 0.92
tpcds_q60/duckdb:parquet 22724298 24730886 0.92
tpcds_q61/duckdb:parquet 31086507 33557992 0.93
tpcds_q62/duckdb:parquet 12824415 13452275 0.95
tpcds_q63/duckdb:parquet 14588135 15521271 0.94
tpcds_q64/duckdb:parquet 🚀 74877980 85025021 0.88
tpcds_q65/duckdb:parquet 20217535 22308927 0.91
tpcds_q66/duckdb:parquet 28662909 29671230 0.97
tpcds_q67/duckdb:parquet 🚀 142367607 159091927 0.89
tpcds_q68/duckdb:parquet 37113232 40032551 0.93
tpcds_q69/duckdb:parquet 🚀 36139815 40425802 0.89
tpcds_q70/duckdb:parquet 19847933 21027170 0.94
tpcds_q71/duckdb:parquet 19936849 20686968 0.96
tpcds_q72/duckdb:parquet 166212219 183665168 0.90
tpcds_q73/duckdb:parquet 🚀 17615672 20614409 0.85
tpcds_q74/duckdb:parquet 130034761 137223543 0.95
tpcds_q75/duckdb:parquet 53717203 59050858 0.91
tpcds_q76/duckdb:parquet 🚀 20359411 23140240 0.88
tpcds_q77/duckdb:parquet 🚀 21887191 24331717 0.90
tpcds_q78/duckdb:parquet 🚀 75682680 89428133 0.85
tpcds_q79/duckdb:parquet 🚀 27533830 31105711 0.89
tpcds_q80/duckdb:parquet 🚀 40656136 45899410 0.89
tpcds_q81/duckdb:parquet 33166892 36761741 0.90
tpcds_q82/duckdb:parquet 14028118 15386813 0.91
tpcds_q83/duckdb:parquet 16579789 18135451 0.91
tpcds_q84/duckdb:parquet 🚀 19556742 22109297 0.88
tpcds_q85/duckdb:parquet 🚀 36350261 49805496 0.73
tpcds_q86/duckdb:parquet 🚀 12323274 15289963 0.81
tpcds_q87/duckdb:parquet 🚀 36054380 42280402 0.85
tpcds_q88/duckdb:parquet 49292221 51902495 0.95
tpcds_q89/duckdb:parquet 🚀 16355509 18633937 0.88
tpcds_q90/duckdb:parquet 7999655 8473256 0.94
tpcds_q91/duckdb:parquet 23158064 25393076 0.91
tpcds_q92/duckdb:parquet 🚀 12174497 14250364 0.85
tpcds_q93/duckdb:parquet 🚀 30574146 34759107 0.88
tpcds_q94/duckdb:parquet 17392879 18667700 0.93
tpcds_q95/duckdb:parquet 144941314 157242113 0.92
tpcds_q96/duckdb:parquet 🚀 8784332 9781165 0.90
tpcds_q97/duckdb:parquet 🚀 33915232 39664796 0.86
tpcds_q98/duckdb:parquet 18209306 19359906 0.94
tpcds_q99/duckdb:parquet 20184977 21149129 0.95
duckdb / duckdb (0.877x ✅, 56↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚀 20669167 24395563 0.85
tpcds_q02/duckdb:duckdb 🚀 17888140 20700271 0.86
tpcds_q03/duckdb:duckdb 🚀 8962272 10102901 0.89
tpcds_q04/duckdb:duckdb 178172559 190766902 0.93
tpcds_q05/duckdb:duckdb 21110555 20618275 1.02
tpcds_q06/duckdb:duckdb 🚀 22890660 27732188 0.83
tpcds_q07/duckdb:duckdb 39110540 43072881 0.91
tpcds_q08/duckdb:duckdb 121175003 123371247 0.98
tpcds_q09/duckdb:duckdb 20147273 21055632 0.96
tpcds_q10/duckdb:duckdb 🚀 23932843 26855842 0.89
tpcds_q11/duckdb:duckdb 95488400 101323212 0.94
tpcds_q12/duckdb:duckdb 🚀 11928398 13412170 0.89
tpcds_q13/duckdb:duckdb 24192267 26201263 0.92
tpcds_q14/duckdb:duckdb 94727613 100406694 0.94
tpcds_q15/duckdb:duckdb 🚀 25156667 29516707 0.85
tpcds_q16/duckdb:duckdb 🚀 17468458 20479665 0.85
tpcds_q17/duckdb:duckdb 🚀 22681773 26519706 0.86
tpcds_q18/duckdb:duckdb 🚀 45184421 56027601 0.81
tpcds_q19/duckdb:duckdb 🚀 17485275 22746645 0.77
tpcds_q20/duckdb:duckdb 🚀 11605584 16736621 0.69
tpcds_q21/duckdb:duckdb 🚀 7129392 8681120 0.82
tpcds_q22/duckdb:duckdb 🚀 63615301 111424145 0.57
tpcds_q23/duckdb:duckdb 🚀 80965982 90031418 0.90
tpcds_q24/duckdb:duckdb 🚀 24326098 31152680 0.78
tpcds_q25/duckdb:duckdb 🚀 17000155 21303504 0.80
tpcds_q26/duckdb:duckdb 🚀 25919914 34985918 0.74
tpcds_q27/duckdb:duckdb 🚀 40982061 48577606 0.84
tpcds_q28/duckdb:duckdb 22308051 23938341 0.93
tpcds_q29/duckdb:duckdb 🚀 20803770 23376683 0.89
tpcds_q30/duckdb:duckdb 29912629 32828633 0.91
tpcds_q31/duckdb:duckdb 🚀 50039915 57478476 0.87
tpcds_q32/duckdb:duckdb 🚀 7428303 8462899 0.88
tpcds_q33/duckdb:duckdb 13064921 14146096 0.92
tpcds_q34/duckdb:duckdb 🚀 14897819 16611035 0.90
tpcds_q35/duckdb:duckdb 33101232 35319482 0.94
tpcds_q36/duckdb:duckdb 🚀 75304550 85501262 0.88
tpcds_q37/duckdb:duckdb 🚀 7776897 9786695 0.79
tpcds_q38/duckdb:duckdb 🚀 31318229 38914145 0.80
tpcds_q39/duckdb:duckdb 🚀 24816934 31681725 0.78
tpcds_q40/duckdb:duckdb 🚀 13896129 18755248 0.74
tpcds_q41/duckdb:duckdb 🚀 8715064 11013680 0.79
tpcds_q42/duckdb:duckdb 🚀 7239490 8614531 0.84
tpcds_q43/duckdb:duckdb 🚀 11356843 12758902 0.89
tpcds_q44/duckdb:duckdb 🚀 14301696 15985417 0.89
tpcds_q45/duckdb:duckdb 🚀 17947798 20385005 0.88
tpcds_q46/duckdb:duckdb 39074770 42854582 0.91
tpcds_q47/duckdb:duckdb 41805630 44750027 0.93
tpcds_q48/duckdb:duckdb 23474251 24549018 0.96
tpcds_q49/duckdb:duckdb 16858197 18241626 0.92
tpcds_q50/duckdb:duckdb 14819303 15532459 0.95
tpcds_q51/duckdb:duckdb 92798475 100378203 0.92
tpcds_q52/duckdb:duckdb 🚀 7171692 8224604 0.87
tpcds_q53/duckdb:duckdb 13156916 14117769 0.93
tpcds_q54/duckdb:duckdb 🚀 17019313 18944970 0.90
tpcds_q55/duckdb:duckdb 7476092 8101308 0.92
tpcds_q56/duckdb:duckdb 14729866 15674967 0.94
tpcds_q57/duckdb:duckdb 🚀 33732376 40508692 0.83
tpcds_q58/duckdb:duckdb 🚀 12712038 16031824 0.79
tpcds_q59/duckdb:duckdb 🚀 36416592 40885583 0.89
tpcds_q60/duckdb:duckdb 🚀 14816130 19678747 0.75
tpcds_q61/duckdb:duckdb 🚀 14997118 17471001 0.86
tpcds_q62/duckdb:duckdb 🚀 9577914 12172839 0.79
tpcds_q63/duckdb:duckdb 🚀 12321813 15475403 0.80
tpcds_q64/duckdb:duckdb 🚀 53535353 67460228 0.79
tpcds_q65/duckdb:duckdb 🚀 33153609 38935142 0.85
tpcds_q66/duckdb:duckdb 🚀 25705370 29303121 0.88
tpcds_q67/duckdb:duckdb 🚀 134084479 175651331 0.76
tpcds_q68/duckdb:duckdb 🚀 25277532 28715180 0.88
tpcds_q69/duckdb:duckdb 🚀 24653363 28074714 0.88
tpcds_q70/duckdb:duckdb 15661965 16735450 0.94
tpcds_q71/duckdb:duckdb 🚀 12704904 15449571 0.82
tpcds_q72/duckdb:duckdb 44733745 48369017 0.92
tpcds_q73/duckdb:duckdb 11344300 12384684 0.92
tpcds_q74/duckdb:duckdb 147111297 161178600 0.91
tpcds_q75/duckdb:duckdb 44595531 47213886 0.94
tpcds_q76/duckdb:duckdb 12424643 13405038 0.93
tpcds_q77/duckdb:duckdb 12482264 13181078 0.95
tpcds_q78/duckdb:duckdb 🚀 62553760 70287348 0.89
tpcds_q79/duckdb:duckdb 18958187 20786019 0.91
tpcds_q80/duckdb:duckdb 🚀 28725854 33664655 0.85
tpcds_q81/duckdb:duckdb 🚀 36489268 43796959 0.83
tpcds_q82/duckdb:duckdb 8761961 9068757 0.97
tpcds_q83/duckdb:duckdb 9312812 10282929 0.91
tpcds_q84/duckdb:duckdb 14263839 15340092 0.93
tpcds_q85/duckdb:duckdb 🚀 24780226 28283143 0.88
tpcds_q86/duckdb:duckdb 10796773 11679306 0.92
tpcds_q87/duckdb:duckdb 34950524 37308561 0.94
tpcds_q88/duckdb:duckdb 25075368 26100343 0.96
tpcds_q89/duckdb:duckdb 14910683 15725527 0.95
tpcds_q90/duckdb:duckdb 6002202 6468993 0.93
tpcds_q91/duckdb:duckdb 13492863 13758934 0.98
tpcds_q92/duckdb:duckdb 9048284 10005467 0.90
tpcds_q93/duckdb:duckdb 🚀 23089143 25740560 0.90
tpcds_q94/duckdb:duckdb 13321297 14621136 0.91
tpcds_q95/duckdb:duckdb 132627383 133125423 1.00
tpcds_q96/duckdb:duckdb 4667803 5070495 0.92
tpcds_q97/duckdb:duckdb 🚀 31154282 35444283 0.88
tpcds_q98/duckdb:duckdb 🚀 13903239 15489707 0.90
tpcds_q99/duckdb:duckdb 16740214 17934615 0.93
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -8.4% -12.0% +4.1% +11.6% ➖ noise
1 datafusion:vortex-file-compressed -17.2% -12.0% -5.9% +14.8% ➖ noise
1 duckdb:duckdb -15.3% -12.0% -3.7% +12.3% ➖ noise
1 duckdb:vortex-compact -28.1% -12.0% -18.3% +13.3% ✅ faster
1 duckdb:vortex-file-compressed -10.5% -12.0% +1.6% +11.6% ➖ noise
2 datafusion:vortex-compact -8.4% -7.8% -0.7% +11.6% ➖ noise
2 datafusion:vortex-file-compressed -20.4% -7.8% -13.7% +11.6% ✅ faster
2 duckdb:duckdb -13.6% -7.8% -6.3% +12.9% ➖ noise
2 duckdb:vortex-compact -19.4% -7.8% -12.5% +27.4% ➖ noise
2 duckdb:vortex-file-compressed +24.4% -7.8% +34.9% +34.7% 🚨 regression
3 datafusion:vortex-compact -13.5% -7.8% -6.1% +11.6% ➖ noise
3 datafusion:vortex-file-compressed -16.2% -7.8% -9.1% +14.8% ➖ noise
3 duckdb:duckdb -11.3% -7.8% -3.7% +14.1% ➖ noise
3 duckdb:vortex-compact -14.6% -7.8% -7.3% +11.6% ➖ noise
3 duckdb:vortex-file-compressed -0.6% -7.8% +7.8% +11.6% ➖ noise
4 datafusion:vortex-compact -25.6% -11.1% -16.3% +11.6% ✅ faster
4 datafusion:vortex-file-compressed -25.8% -11.1% -16.5% +11.6% ✅ faster
4 duckdb:duckdb -6.6% -11.1% +5.1% +11.6% ➖ noise
4 duckdb:vortex-compact -18.3% -11.1% -8.1% +11.6% ➖ noise
4 duckdb:vortex-file-compressed -8.9% -11.1% +2.5% +12.9% ➖ noise
5 datafusion:vortex-compact -19.9% -17.5% -3.0% +11.6% ➖ noise
5 datafusion:vortex-file-compressed -29.8% -17.5% -14.9% +15.1% ✅ faster
5 duckdb:duckdb +2.4% -17.5% +24.1% +17.8% 🚨 regression
5 duckdb:vortex-compact -20.7% -17.5% -3.9% +11.6% ➖ noise
5 duckdb:vortex-file-compressed -5.6% -17.5% +14.4% +11.6% 🚨 regression
6 datafusion:vortex-compact -19.3% -8.5% -11.8% +11.6% ✅ faster
6 datafusion:vortex-file-compressed -28.0% -8.5% -21.3% +11.6% ✅ faster
6 duckdb:duckdb -17.5% -8.5% -9.8% +14.5% ➖ noise
6 duckdb:vortex-compact -22.0% -8.5% -14.7% +11.6% ✅ faster
6 duckdb:vortex-file-compressed -8.7% -8.5% -0.2% +11.6% ➖ noise
7 datafusion:vortex-compact -8.1% -8.4% +0.2% +11.6% ➖ noise
7 datafusion:vortex-file-compressed -28.1% -8.4% -21.5% +11.6% ✅ faster
7 duckdb:duckdb -9.2% -8.4% -0.9% +16.1% ➖ noise
7 duckdb:vortex-compact -20.6% -8.4% -13.3% +11.6% ✅ faster
7 duckdb:vortex-file-compressed -9.0% -8.4% -0.7% +11.9% ➖ noise
8 datafusion:vortex-compact -23.2% -8.1% -16.4% +11.6% ✅ faster
8 datafusion:vortex-file-compressed -24.3% -8.1% -17.6% +11.6% ✅ faster
8 duckdb:duckdb -1.8% -8.1% +6.8% +11.6% ➖ noise
8 duckdb:vortex-compact -11.9% -8.1% -4.1% +12.3% ➖ noise
8 duckdb:vortex-file-compressed -18.1% -8.1% -10.9% +13.0% ➖ noise
9 datafusion:vortex-compact -18.2% -6.6% -12.4% +11.6% ✅ faster
9 datafusion:vortex-file-compressed -19.2% -6.6% -13.5% +11.6% ✅ faster
9 duckdb:duckdb -4.3% -6.6% +2.4% +11.6% ➖ noise
9 duckdb:vortex-compact -7.9% -6.6% -1.5% +11.6% ➖ noise
9 duckdb:vortex-file-compressed -9.6% -6.6% -3.2% +13.7% ➖ noise
10 datafusion:vortex-compact -24.7% -11.8% -14.5% +11.6% ✅ faster
10 datafusion:vortex-file-compressed -24.8% -11.8% -14.7% +11.6% ✅ faster
10 duckdb:duckdb -10.9% -11.8% +1.1% +11.6% ➖ noise
10 duckdb:vortex-compact -9.0% -11.8% +3.2% +11.6% ➖ noise
10 duckdb:vortex-file-compressed -12.9% -11.8% -1.2% +11.6% ➖ noise
11 datafusion:vortex-compact -11.8% -13.9% +2.4% +13.2% ➖ noise
11 datafusion:vortex-file-compressed -21.3% -13.9% -8.6% +11.6% ➖ noise
11 duckdb:duckdb -5.8% -13.9% +9.4% +11.6% ➖ noise
11 duckdb:vortex-compact -7.2% -13.9% +7.7% +11.7% ➖ noise
11 duckdb:vortex-file-compressed -10.0% -13.9% +4.5% +11.6% ➖ noise
12 datafusion:vortex-compact -17.4% -11.4% -6.7% +11.6% ➖ noise
12 datafusion:vortex-file-compressed -18.1% -11.4% -7.6% +17.8% ➖ noise
12 duckdb:duckdb -11.1% -11.4% +0.4% +12.6% ➖ noise
12 duckdb:vortex-compact -14.1% -11.4% -3.0% +11.6% ➖ noise
12 duckdb:vortex-file-compressed -12.3% -11.4% -1.0% +11.6% ➖ noise
13 datafusion:vortex-compact -8.1% -11.7% +4.1% +11.6% ➖ noise
13 datafusion:vortex-file-compressed -13.4% -11.7% -1.9% +11.6% ➖ noise
13 duckdb:duckdb -7.7% -11.7% +4.6% +11.6% ➖ noise
13 duckdb:vortex-compact -8.8% -11.7% +3.4% +11.6% ➖ noise
13 duckdb:vortex-file-compressed -8.3% -11.7% +3.8% +11.6% ➖ noise
14 datafusion:vortex-compact -20.6% -12.7% -9.1% +11.6% ➖ noise
14 datafusion:vortex-file-compressed -17.5% -12.7% -5.5% +11.6% ➖ noise
14 duckdb:duckdb -5.7% -12.7% +8.1% +11.6% ➖ noise
14 duckdb:vortex-compact -8.1% -12.7% +5.3% +11.6% ➖ noise
14 duckdb:vortex-file-compressed -4.3% -12.7% +9.7% +11.6% ➖ noise
15 datafusion:vortex-compact -29.3% -21.4% -10.0% +15.6% ➖ noise
15 datafusion:vortex-file-compressed -17.4% -21.4% +5.1% +17.3% ➖ noise
15 duckdb:duckdb -14.8% -21.4% +8.4% +13.8% ➖ noise
15 duckdb:vortex-compact -8.0% -21.4% +17.0% +14.1% 🚨 regression
15 duckdb:vortex-file-compressed -8.2% -21.4% +16.8% +11.6% 🚨 regression
16 datafusion:vortex-compact -12.2% -16.7% +5.5% +11.7% ➖ noise
16 datafusion:vortex-file-compressed -19.8% -16.7% -3.8% +14.9% ➖ noise
16 duckdb:duckdb -14.7% -16.7% +2.4% +11.6% ➖ noise
16 duckdb:vortex-compact -11.4% -16.7% +6.4% +11.6% ➖ noise
16 duckdb:vortex-file-compressed -7.7% -16.7% +10.8% +13.2% ➖ noise
17 datafusion:vortex-compact -11.2% -17.2% +7.2% +11.6% ➖ noise
17 datafusion:vortex-file-compressed -23.0% -17.2% -7.0% +11.6% ➖ noise
17 duckdb:duckdb -14.5% -17.2% +3.3% +11.7% ➖ noise
17 duckdb:vortex-compact -6.9% -17.2% +12.4% +11.6% 🚨 regression
17 duckdb:vortex-file-compressed -11.1% -17.2% +7.4% +12.4% ➖ noise
18 datafusion:vortex-compact -15.5% -13.0% -2.9% +11.6% ➖ noise
18 datafusion:vortex-file-compressed -32.7% -13.0% -22.7% +11.6% ✅ faster
18 duckdb:duckdb -19.4% -13.0% -7.3% +12.4% ➖ noise
18 duckdb:vortex-compact -11.2% -13.0% +2.0% +11.6% ➖ noise
18 duckdb:vortex-file-compressed -4.9% -13.0% +9.3% +11.6% ➖ noise
19 datafusion:vortex-compact -11.0% -13.2% +2.6% +11.6% ➖ noise
19 datafusion:vortex-file-compressed -35.1% -13.2% -25.2% +11.6% ✅ faster
19 duckdb:duckdb -23.1% -13.2% -11.4% +14.6% ➖ noise
19 duckdb:vortex-compact -7.9% -13.2% +6.1% +11.8% ➖ noise
19 duckdb:vortex-file-compressed -14.1% -13.2% -1.0% +20.8% ➖ noise
20 datafusion:vortex-compact -14.6% -14.7% +0.2% +11.6% ➖ noise
20 datafusion:vortex-file-compressed -34.8% -14.7% -23.5% +11.6% ✅ faster
20 duckdb:duckdb -30.7% -14.7% -18.7% +11.6% ✅ faster
20 duckdb:vortex-compact -7.7% -14.7% +8.2% +11.9% ➖ noise
20 duckdb:vortex-file-compressed -4.9% -14.7% +11.5% +11.6% ➖ noise
21 datafusion:vortex-compact -15.2% -15.6% +0.5% +13.3% ➖ noise
21 datafusion:vortex-file-compressed -27.0% -15.6% -13.5% +11.6% ✅ faster
21 duckdb:duckdb -17.9% -15.6% -2.7% +11.9% ➖ noise
21 duckdb:vortex-compact -8.7% -15.6% +8.3% +11.6% ➖ noise
21 duckdb:vortex-file-compressed -10.8% -15.6% +5.7% +16.2% ➖ noise
22 datafusion:vortex-compact -20.6% -14.8% -6.8% +15.0% ➖ noise
22 datafusion:vortex-file-compressed -11.1% -14.8% +4.3% +15.2% ➖ noise
22 duckdb:duckdb -42.9% -14.8% -33.0% +13.1% ✅ faster
22 duckdb:vortex-compact -13.3% -14.8% +1.8% +13.1% ➖ noise
22 duckdb:vortex-file-compressed -11.6% -14.8% +3.8% +13.4% ➖ noise
23 datafusion:vortex-compact -18.4% -11.4% -7.9% +11.6% ➖ noise
23 datafusion:vortex-file-compressed -12.6% -11.4% -1.3% +11.6% ➖ noise
23 duckdb:duckdb -10.1% -11.4% +1.5% +16.5% ➖ noise
23 duckdb:vortex-compact -9.8% -11.4% +1.8% +11.6% ➖ noise
23 duckdb:vortex-file-compressed -11.0% -11.4% +0.5% +11.6% ➖ noise
24 datafusion:vortex-compact -26.5% -13.3% -15.2% +11.6% ✅ faster
24 datafusion:vortex-file-compressed -14.2% -13.3% -1.0% +11.6% ➖ noise
24 duckdb:duckdb -21.9% -13.3% -9.9% +11.6% ➖ noise
24 duckdb:vortex-compact -11.9% -13.3% +1.7% +11.6% ➖ noise
24 duckdb:vortex-file-compressed -12.7% -13.3% +0.7% +11.6% ➖ noise
25 datafusion:vortex-compact -10.0% -9.8% -0.3% +14.9% ➖ noise
25 datafusion:vortex-file-compressed -12.5% -9.8% -3.1% +11.6% ➖ noise
25 duckdb:duckdb -20.2% -9.8% -11.6% +13.8% ➖ noise
25 duckdb:vortex-compact -13.0% -9.8% -3.6% +11.6% ➖ noise
25 duckdb:vortex-file-compressed -12.3% -9.8% -2.8% +11.6% ➖ noise
26 datafusion:vortex-compact -15.8% -11.2% -5.2% +11.6% ➖ noise
26 datafusion:vortex-file-compressed -15.7% -11.2% -5.1% +11.8% ➖ noise
26 duckdb:duckdb -25.9% -11.2% -16.6% +14.4% ✅ faster
26 duckdb:vortex-compact -8.1% -11.2% +3.5% +19.5% ➖ noise
26 duckdb:vortex-file-compressed -3.8% -11.2% +8.3% +13.9% ➖ noise
27 datafusion:vortex-compact -21.7% -11.6% -11.5% +11.6% ✅ faster
27 datafusion:vortex-file-compressed -17.6% -11.6% -6.8% +11.6% ➖ noise
27 duckdb:duckdb -15.6% -11.6% -4.6% +17.0% ➖ noise
27 duckdb:vortex-compact -6.0% -11.6% +6.4% +11.6% ➖ noise
27 duckdb:vortex-file-compressed -8.0% -11.6% +4.0% +18.6% ➖ noise
28 datafusion:vortex-compact -2.1% -11.6% +10.8% +11.6% ➖ noise
28 datafusion:vortex-file-compressed -6.0% -11.6% +6.4% +11.6% ➖ noise
28 duckdb:duckdb -6.8% -11.6% +5.5% +17.0% ➖ noise
28 duckdb:vortex-compact -1.6% -11.6% +11.4% +11.6% ➖ noise
28 duckdb:vortex-file-compressed -10.3% -11.6% +1.5% +11.6% ➖ noise
29 datafusion:vortex-compact -10.0% -12.9% +3.3% +11.6% ➖ noise
29 datafusion:vortex-file-compressed -23.2% -12.9% -11.8% +11.6% ✅ faster
29 duckdb:duckdb -11.0% -12.9% +2.1% +11.6% ➖ noise
29 duckdb:vortex-compact -10.6% -12.9% +2.6% +11.6% ➖ noise
29 duckdb:vortex-file-compressed -7.8% -12.9% +5.8% +13.3% ➖ noise
30 datafusion:vortex-compact -4.7% -10.2% +6.1% +11.7% ➖ noise
30 datafusion:vortex-file-compressed -29.4% -10.2% -21.3% +12.4% ✅ faster
30 duckdb:duckdb -8.9% -10.2% +1.5% +14.1% ➖ noise
30 duckdb:vortex-compact -18.2% -10.2% -8.9% +16.6% ➖ noise
30 duckdb:vortex-file-compressed -11.3% -10.2% -1.3% +11.6% ➖ noise
31 datafusion:vortex-compact -9.1% -11.7% +2.9% +11.6% ➖ noise
31 datafusion:vortex-file-compressed -24.4% -11.7% -14.3% +11.6% ✅ faster
31 duckdb:duckdb -12.9% -11.7% -1.4% +11.6% ➖ noise
31 duckdb:vortex-compact -10.2% -11.7% +1.7% +11.6% ➖ noise
31 duckdb:vortex-file-compressed -8.1% -11.7% +4.0% +11.6% ➖ noise
32 datafusion:vortex-compact -9.8% -5.3% -4.8% +11.6% ➖ noise
32 datafusion:vortex-file-compressed -28.3% -5.3% -24.3% +11.6% ✅ faster
32 duckdb:duckdb -12.2% -5.3% -7.3% +22.7% ➖ noise
32 duckdb:vortex-compact -5.8% -5.3% -0.6% +11.6% ➖ noise
32 duckdb:vortex-file-compressed -12.2% -5.3% -7.4% +11.6% ➖ noise
33 datafusion:vortex-compact -8.5% -12.8% +4.9% +11.6% ➖ noise
33 datafusion:vortex-file-compressed -25.2% -12.8% -14.2% +11.6% ✅ faster
33 duckdb:duckdb -7.6% -12.8% +5.9% +11.6% ➖ noise
33 duckdb:vortex-compact -11.9% -12.8% +1.0% +11.6% ➖ noise
33 duckdb:vortex-file-compressed -13.0% -12.8% -0.3% +12.7% ➖ noise
34 datafusion:vortex-compact -11.1% -12.0% +0.9% +11.6% ➖ noise
34 datafusion:vortex-file-compressed -32.3% -12.0% -23.1% +11.6% ✅ faster
34 duckdb:duckdb -10.3% -12.0% +1.9% +11.6% ➖ noise
34 duckdb:vortex-compact -12.8% -12.0% -1.0% +11.6% ➖ noise
34 duckdb:vortex-file-compressed -6.5% -12.0% +6.2% +12.3% ➖ noise
35 datafusion:vortex-compact -18.2% -13.6% -5.4% +11.6% ➖ noise
35 datafusion:vortex-file-compressed -29.6% -13.6% -18.6% +11.6% ✅ faster
35 duckdb:duckdb -6.3% -13.6% +8.4% +16.5% ➖ noise
35 duckdb:vortex-compact -18.1% -13.6% -5.2% +11.6% ➖ noise
35 duckdb:vortex-file-compressed -11.7% -13.6% +2.2% +11.6% ➖ noise
36 datafusion:vortex-compact -14.2% -18.7% +5.5% +11.6% ➖ noise
36 datafusion:vortex-file-compressed -31.1% -18.7% -15.3% +11.6% ✅ faster
36 duckdb:duckdb -11.9% -18.7% +8.3% +11.6% ➖ noise
36 duckdb:vortex-compact -6.1% -18.7% +15.5% +11.6% 🚨 regression
36 duckdb:vortex-file-compressed -6.5% -18.7% +14.9% +11.6% 🚨 regression
37 datafusion:vortex-compact -11.3% -21.2% +12.6% +11.6% 🚨 regression
37 datafusion:vortex-file-compressed -34.7% -21.2% -17.1% +11.6% ✅ faster
37 duckdb:duckdb -20.5% -21.2% +0.9% +11.6% ➖ noise
37 duckdb:vortex-compact -4.7% -21.2% +21.0% +12.6% 🚨 regression
37 duckdb:vortex-file-compressed -12.6% -21.2% +10.9% +19.2% ➖ noise
38 datafusion:vortex-compact -12.0% -12.6% +0.7% +11.6% ➖ noise
38 datafusion:vortex-file-compressed -23.3% -12.6% -12.3% +11.6% ✅ faster
38 duckdb:duckdb -19.5% -12.6% -7.9% +14.3% ➖ noise
38 duckdb:vortex-compact -4.3% -12.6% +9.5% +16.0% ➖ noise
38 duckdb:vortex-file-compressed -7.4% -12.6% +5.9% +15.6% ➖ noise
39 datafusion:vortex-compact -20.4% -21.0% +0.8% +13.0% ➖ noise
39 datafusion:vortex-file-compressed -17.5% -21.0% +4.4% +13.9% ➖ noise
39 duckdb:duckdb -21.7% -21.0% -0.9% +24.0% ➖ noise
39 duckdb:vortex-compact -7.1% -21.0% +17.7% +14.8% 🚨 regression
39 duckdb:vortex-file-compressed -8.3% -21.0% +16.1% +21.7% ➖ noise
40 datafusion:vortex-compact -13.9% -9.3% -5.0% +11.6% ➖ noise
40 datafusion:vortex-file-compressed -21.0% -9.3% -12.9% +12.5% ✅ faster
40 duckdb:duckdb -25.9% -9.3% -18.3% +14.6% ✅ faster
40 duckdb:vortex-compact -2.2% -9.3% +7.8% +11.6% ➖ noise
40 duckdb:vortex-file-compressed -7.4% -9.3% +2.1% +14.5% ➖ noise
41 datafusion:vortex-compact -6.8% -12.8% +6.9% +13.8% ➖ noise
41 datafusion:vortex-file-compressed -8.7% -12.8% +4.7% +11.6% ➖ noise
41 duckdb:duckdb -20.9% -12.8% -9.2% +11.6% ➖ noise
41 duckdb:vortex-compact -7.1% -12.8% +6.5% +11.6% ➖ noise
41 duckdb:vortex-file-compressed -13.1% -12.8% -0.3% +11.6% ➖ noise
42 datafusion:vortex-compact -10.6% -4.1% -6.7% +11.6% ➖ noise
42 datafusion:vortex-file-compressed -18.0% -4.1% -14.5% +15.4% ✅ faster
42 duckdb:duckdb -16.0% -4.1% -12.3% +14.0% ✅ faster
42 duckdb:vortex-compact -9.8% -4.1% -6.0% +11.6% ➖ noise
42 duckdb:vortex-file-compressed -9.6% -4.1% -5.7% +19.6% ➖ noise
43 datafusion:vortex-compact -10.2% -7.2% -3.2% +11.6% ➖ noise
43 datafusion:vortex-file-compressed -15.9% -7.2% -9.3% +11.6% ➖ noise
43 duckdb:duckdb -11.0% -7.2% -4.1% +11.6% ➖ noise
43 duckdb:vortex-compact -3.5% -7.2% +4.0% +11.6% ➖ noise
43 duckdb:vortex-file-compressed -7.6% -7.2% -0.4% +11.6% ➖ noise
44 datafusion:vortex-compact -8.5% -9.4% +1.0% +11.6% ➖ noise
44 datafusion:vortex-file-compressed -22.6% -9.4% -14.5% +11.6% ✅ faster
44 duckdb:duckdb -10.5% -9.4% -1.3% +15.4% ➖ noise
44 duckdb:vortex-compact -10.1% -9.4% -0.8% +11.6% ➖ noise
44 duckdb:vortex-file-compressed -8.7% -9.4% +0.7% +11.6% ➖ noise
45 datafusion:vortex-compact -12.7% -13.3% +0.6% +11.6% ➖ noise
45 datafusion:vortex-file-compressed -14.3% -13.3% -1.2% +11.6% ➖ noise
45 duckdb:duckdb -12.0% -13.3% +1.5% +12.1% ➖ noise
45 duckdb:vortex-compact -16.5% -13.3% -3.7% +11.6% ➖ noise
45 duckdb:vortex-file-compressed -19.6% -13.3% -7.3% +12.3% ➖ noise
46 datafusion:vortex-compact -11.4% -16.2% +5.8% +11.6% ➖ noise
46 datafusion:vortex-file-compressed -17.1% -16.2% -1.0% +13.8% ➖ noise
46 duckdb:duckdb -8.8% -16.2% +8.8% +11.6% ➖ noise
46 duckdb:vortex-compact -11.3% -16.2% +5.8% +11.6% ➖ noise
46 duckdb:vortex-file-compressed -14.1% -16.2% +2.6% +11.6% ➖ noise
47 datafusion:vortex-compact -15.3% -13.1% -2.5% +11.6% ➖ noise
47 datafusion:vortex-file-compressed -20.1% -13.1% -8.0% +11.6% ➖ noise
47 duckdb:duckdb -6.6% -13.1% +7.6% +11.6% ➖ noise
47 duckdb:vortex-compact -19.5% -13.1% -7.3% +13.2% ➖ noise
47 duckdb:vortex-file-compressed -11.3% -13.1% +2.1% +11.6% ➖ noise
48 datafusion:vortex-compact -4.5% -16.8% +14.7% +11.6% 🚨 regression
48 datafusion:vortex-file-compressed -8.2% -16.8% +10.3% +11.6% ➖ noise
48 duckdb:duckdb -4.4% -16.8% +14.9% +11.6% 🚨 regression
48 duckdb:vortex-compact -17.0% -16.8% -0.3% +11.6% ➖ noise
48 duckdb:vortex-file-compressed -13.5% -16.8% +3.9% +11.6% ➖ noise
49 datafusion:vortex-compact -21.0% -15.9% -6.0% +11.6% ➖ noise
49 datafusion:vortex-file-compressed -12.2% -15.9% +4.4% +12.1% ➖ noise
49 duckdb:duckdb -7.6% -15.9% +9.9% +13.9% ➖ noise
49 duckdb:vortex-compact -19.6% -15.9% -4.3% +11.6% ➖ noise
49 duckdb:vortex-file-compressed -13.6% -15.9% +2.8% +13.8% ➖ noise
50 datafusion:vortex-compact -26.6% -8.6% -19.7% +11.6% ✅ faster
50 datafusion:vortex-file-compressed -17.6% -8.6% -9.8% +15.9% ➖ noise
50 duckdb:duckdb -4.6% -8.6% +4.4% +11.6% ➖ noise
50 duckdb:vortex-compact -9.5% -8.6% -1.0% +11.6% ➖ noise
50 duckdb:vortex-file-compressed -5.3% -8.6% +3.7% +11.6% ➖ noise
51 datafusion:vortex-compact -13.0% -8.6% -4.7% +11.6% ➖ noise
51 datafusion:vortex-file-compressed -16.3% -8.6% -8.4% +11.6% ➖ noise
51 duckdb:duckdb -7.6% -8.6% +1.2% +14.3% ➖ noise
51 duckdb:vortex-compact +8.7% -8.6% +18.9% +12.9% 🚨 regression
51 duckdb:vortex-file-compressed -3.4% -8.6% +5.7% +19.3% ➖ noise
52 datafusion:vortex-compact -20.5% -5.3% -16.1% +12.7% ✅ faster
52 datafusion:vortex-file-compressed -21.3% -5.3% -16.9% +13.9% ✅ faster
52 duckdb:duckdb -12.8% -5.3% -7.9% +16.2% ➖ noise
52 duckdb:vortex-compact -15.1% -5.3% -10.3% +13.8% ➖ noise
52 duckdb:vortex-file-compressed -12.6% -5.3% -7.8% +17.1% ➖ noise
53 datafusion:vortex-compact -9.0% -7.4% -1.7% +11.6% ➖ noise
53 datafusion:vortex-file-compressed -12.9% -7.4% -6.0% +11.6% ➖ noise
53 duckdb:duckdb -6.8% -7.4% +0.6% +11.6% ➖ noise
53 duckdb:vortex-compact -9.0% -7.4% -1.7% +11.6% ➖ noise
53 duckdb:vortex-file-compressed -21.5% -7.4% -15.2% +17.3% ✅ faster
54 datafusion:vortex-compact -7.6% -8.2% +0.6% +11.6% ➖ noise
54 datafusion:vortex-file-compressed -11.8% -8.2% -4.0% +11.6% ➖ noise
54 duckdb:duckdb -10.2% -8.2% -2.2% +11.8% ➖ noise
54 duckdb:vortex-compact -2.2% -8.2% +6.5% +11.6% ➖ noise
54 duckdb:vortex-file-compressed -14.5% -8.2% -6.8% +11.6% ➖ noise
55 datafusion:vortex-compact -7.0% -10.2% +3.6% +13.1% ➖ noise
55 datafusion:vortex-file-compressed -14.7% -10.2% -5.1% +11.6% ➖ noise
55 duckdb:duckdb -7.7% -10.2% +2.7% +13.7% ➖ noise
55 duckdb:vortex-compact -8.5% -10.2% +1.9% +11.6% ➖ noise
55 duckdb:vortex-file-compressed -17.5% -10.2% -8.1% +13.7% ➖ noise
56 datafusion:vortex-compact -10.1% -12.9% +3.1% +11.6% ➖ noise
56 datafusion:vortex-file-compressed -11.7% -12.9% +1.3% +11.6% ➖ noise
56 duckdb:duckdb -6.0% -12.9% +7.9% +13.5% ➖ noise
56 duckdb:vortex-compact -13.3% -12.9% -0.5% +12.9% ➖ noise
56 duckdb:vortex-file-compressed -7.4% -12.9% +6.3% +12.1% ➖ noise
57 datafusion:vortex-compact -11.4% -12.6% +1.4% +12.1% ➖ noise
57 datafusion:vortex-file-compressed -17.1% -12.6% -5.1% +11.6% ➖ noise
57 duckdb:duckdb -16.7% -12.6% -4.7% +17.0% ➖ noise
57 duckdb:vortex-compact -15.6% -12.6% -3.4% +20.2% ➖ noise
57 duckdb:vortex-file-compressed -7.0% -12.6% +6.5% +15.0% ➖ noise
58 datafusion:vortex-compact -20.4% -8.0% -13.5% +11.6% ✅ faster
58 datafusion:vortex-file-compressed -13.3% -8.0% -5.8% +11.6% ➖ noise
58 duckdb:duckdb -20.7% -8.0% -13.8% +11.6% ✅ faster
58 duckdb:vortex-compact -12.4% -8.0% -4.7% +14.2% ➖ noise
58 duckdb:vortex-file-compressed -15.1% -8.0% -7.6% +16.2% ➖ noise
59 datafusion:vortex-compact -22.8% -5.3% -18.4% +11.6% ✅ faster
59 datafusion:vortex-file-compressed -16.4% -5.3% -11.7% +11.6% ✅ faster
59 duckdb:duckdb -10.9% -5.3% -5.9% +11.6% ➖ noise
59 duckdb:vortex-compact -29.0% -5.3% -25.1% +20.7% ✅ faster
59 duckdb:vortex-file-compressed -7.1% -5.3% -1.9% +11.6% ➖ noise
60 datafusion:vortex-compact -16.3% -8.6% -8.4% +11.6% ➖ noise
60 datafusion:vortex-file-compressed -17.8% -8.6% -10.1% +11.6% ➖ noise
60 duckdb:duckdb -24.7% -8.6% -17.6% +11.6% ✅ faster
60 duckdb:vortex-compact -9.6% -8.6% -1.1% +11.6% ➖ noise
60 duckdb:vortex-file-compressed -20.4% -8.6% -12.9% +11.7% ✅ faster
61 datafusion:vortex-compact -17.7% -10.8% -7.7% +11.6% ➖ noise
61 datafusion:vortex-file-compressed -5.2% -10.8% +6.3% +12.8% ➖ noise
61 duckdb:duckdb -14.2% -10.8% -3.8% +11.6% ➖ noise
61 duckdb:vortex-compact -11.7% -10.8% -1.1% +11.6% ➖ noise
61 duckdb:vortex-file-compressed -14.5% -10.8% -4.2% +12.3% ➖ noise
62 datafusion:vortex-compact -22.4% -8.6% -15.1% +12.7% ✅ faster
62 datafusion:vortex-file-compressed -15.5% -8.6% -7.4% +14.7% ➖ noise
62 duckdb:duckdb -21.3% -8.6% -13.9% +33.5% ➖ noise
62 duckdb:vortex-compact -8.4% -8.6% +0.3% +23.9% ➖ noise
62 duckdb:vortex-file-compressed -29.7% -8.6% -23.1% +15.2% ✅ faster
63 datafusion:vortex-compact -12.5% -6.0% -6.9% +11.6% ➖ noise
63 datafusion:vortex-file-compressed -15.1% -6.0% -9.7% +11.6% ➖ noise
63 duckdb:duckdb -20.4% -6.0% -15.3% +11.6% ✅ faster
63 duckdb:vortex-compact -11.6% -6.0% -6.0% +15.8% ➖ noise
63 duckdb:vortex-file-compressed -10.6% -6.0% -4.9% +11.6% ➖ noise
64 datafusion:vortex-compact -17.4% -11.9% -6.2% +11.6% ➖ noise
64 datafusion:vortex-file-compressed -13.3% -11.9% -1.6% +11.6% ➖ noise
64 duckdb:duckdb -20.6% -11.9% -9.9% +11.6% ➖ noise
64 duckdb:vortex-compact -17.4% -11.9% -6.3% +11.6% ➖ noise
64 duckdb:vortex-file-compressed -12.0% -11.9% -0.1% +11.6% ➖ noise
65 datafusion:vortex-compact -19.7% -8.6% -12.2% +11.6% ✅ faster
65 datafusion:vortex-file-compressed -15.8% -8.6% -7.9% +11.7% ➖ noise
65 duckdb:duckdb -14.8% -8.6% -6.8% +13.7% ➖ noise
65 duckdb:vortex-compact -4.4% -8.6% +4.7% +11.6% ➖ noise
65 duckdb:vortex-file-compressed -24.4% -8.6% -17.3% +11.6% ✅ faster
66 datafusion:vortex-compact -26.2% -5.7% -21.7% +15.3% ✅ faster
66 datafusion:vortex-file-compressed -11.7% -5.7% -6.3% +12.4% ➖ noise
66 duckdb:duckdb -12.3% -5.7% -7.0% +11.6% ➖ noise
66 duckdb:vortex-compact -4.0% -5.7% +1.8% +16.1% ➖ noise
66 duckdb:vortex-file-compressed -16.7% -5.7% -11.7% +11.6% ✅ faster
67 datafusion:vortex-compact -8.2% -11.6% +3.9% +11.6% ➖ noise
67 datafusion:vortex-file-compressed -25.5% -11.6% -15.7% +11.6% ✅ faster
67 duckdb:duckdb -23.7% -11.6% -13.6% +11.6% ✅ faster
67 duckdb:vortex-compact -11.5% -11.6% +0.1% +11.6% ➖ noise
67 duckdb:vortex-file-compressed -29.1% -11.6% -19.8% +11.6% ✅ faster
68 datafusion:vortex-compact -9.6% -9.5% -0.1% +11.7% ➖ noise
68 datafusion:vortex-file-compressed -35.7% -9.5% -28.9% +11.6% ✅ faster
68 duckdb:duckdb -12.0% -9.5% -2.7% +11.6% ➖ noise
68 duckdb:vortex-compact -6.5% -9.5% +3.4% +11.6% ➖ noise
68 duckdb:vortex-file-compressed -28.3% -9.5% -20.7% +11.6% ✅ faster
69 datafusion:vortex-compact -19.8% -11.0% -10.0% +11.6% ➖ noise
69 datafusion:vortex-file-compressed -15.1% -11.0% -4.6% +11.6% ➖ noise
69 duckdb:duckdb -12.2% -11.0% -1.4% +11.6% ➖ noise
69 duckdb:vortex-compact -9.1% -11.0% +2.1% +11.6% ➖ noise
69 duckdb:vortex-file-compressed -25.6% -11.0% -16.4% +11.6% ✅ faster
70 datafusion:vortex-compact -9.6% -10.0% +0.4% +11.6% ➖ noise
70 datafusion:vortex-file-compressed -15.1% -10.0% -5.6% +12.5% ➖ noise
70 duckdb:duckdb -6.4% -10.0% +4.0% +13.9% ➖ noise
70 duckdb:vortex-compact -8.7% -10.0% +1.5% +12.0% ➖ noise
70 duckdb:vortex-file-compressed -20.0% -10.0% -11.1% +14.1% ➖ noise
71 datafusion:vortex-compact -14.6% -7.8% -7.4% +11.6% ➖ noise
71 datafusion:vortex-file-compressed -21.4% -7.8% -14.7% +11.6% ✅ faster
71 duckdb:duckdb -17.8% -7.8% -10.8% +12.0% ✅ faster
71 duckdb:vortex-compact -4.7% -7.8% +3.4% +11.6% ➖ noise
71 duckdb:vortex-file-compressed -24.9% -7.8% -18.5% +12.0% ✅ faster
72 datafusion:vortex-compact -16.1% -11.6% -5.2% +11.6% ➖ noise
72 datafusion:vortex-file-compressed -16.9% -11.6% -6.0% +11.6% ➖ noise
72 duckdb:duckdb -7.5% -11.6% +4.6% +15.3% ➖ noise
72 duckdb:vortex-compact -7.1% -11.6% +5.0% +11.6% ➖ noise
72 duckdb:vortex-file-compressed -14.7% -11.6% -3.6% +11.6% ➖ noise
73 datafusion:vortex-compact -3.3% -7.6% +4.6% +20.7% ➖ noise
73 datafusion:vortex-file-compressed -6.5% -7.6% +1.2% +18.1% ➖ noise
73 duckdb:duckdb -8.4% -7.6% -0.8% +11.6% ➖ noise
73 duckdb:vortex-compact -7.2% -7.6% +0.4% +11.6% ➖ noise
73 duckdb:vortex-file-compressed -13.7% -7.6% -6.6% +15.1% ➖ noise
74 datafusion:vortex-compact -12.1% -12.2% +0.1% +11.6% ➖ noise
74 datafusion:vortex-file-compressed -15.1% -12.2% -3.3% +11.6% ➖ noise
74 duckdb:duckdb -8.7% -12.2% +3.9% +11.6% ➖ noise
74 duckdb:vortex-compact -6.2% -12.2% +6.9% +12.1% ➖ noise
74 duckdb:vortex-file-compressed -10.1% -12.2% +2.4% +28.2% ➖ noise
75 datafusion:vortex-compact -9.2% -9.0% -0.2% +11.6% ➖ noise
75 datafusion:vortex-file-compressed -9.6% -9.0% -0.6% +11.6% ➖ noise
75 duckdb:duckdb -5.5% -9.0% +3.8% +11.6% ➖ noise
75 duckdb:vortex-compact -2.3% -9.0% +7.4% +11.6% ➖ noise
75 duckdb:vortex-file-compressed -11.2% -9.0% -2.4% +11.6% ➖ noise
76 datafusion:vortex-compact -8.4% -12.4% +4.6% +11.6% ➖ noise
76 datafusion:vortex-file-compressed -11.7% -12.4% +0.9% +12.1% ➖ noise
76 duckdb:duckdb -7.3% -12.4% +5.8% +13.5% ➖ noise
76 duckdb:vortex-compact -5.0% -12.4% +8.5% +12.7% ➖ noise
76 duckdb:vortex-file-compressed -24.7% -12.4% -14.0% +21.6% ➖ noise
77 datafusion:vortex-compact -13.7% -10.8% -3.2% +11.6% ➖ noise
77 datafusion:vortex-file-compressed -10.5% -10.8% +0.3% +11.6% ➖ noise
77 duckdb:duckdb -5.3% -10.8% +6.2% +11.6% ➖ noise
77 duckdb:vortex-compact -14.8% -10.8% -4.5% +13.3% ➖ noise
77 duckdb:vortex-file-compressed -28.3% -10.8% -19.7% +14.3% ✅ faster
78 datafusion:vortex-compact -27.4% -13.1% -16.4% +11.6% ✅ faster
78 datafusion:vortex-file-compressed -16.3% -13.1% -3.7% +11.6% ➖ noise
78 duckdb:duckdb -11.0% -13.1% +2.4% +11.6% ➖ noise
78 duckdb:vortex-compact -9.7% -13.1% +3.9% +11.6% ➖ noise
78 duckdb:vortex-file-compressed -22.0% -13.1% -10.3% +11.6% ➖ noise
79 datafusion:vortex-compact -24.3% -10.0% -15.9% +11.6% ✅ faster
79 datafusion:vortex-file-compressed -11.4% -10.0% -1.5% +12.0% ➖ noise
79 duckdb:duckdb -8.8% -10.0% +1.4% +11.6% ➖ noise
79 duckdb:vortex-compact -3.9% -10.0% +6.8% +11.6% ➖ noise
79 duckdb:vortex-file-compressed -21.7% -10.0% -13.0% +13.7% ✅ faster
80 datafusion:vortex-compact -26.7% -13.9% -14.9% +11.6% ✅ faster
80 datafusion:vortex-file-compressed -16.3% -13.9% -2.8% +11.6% ➖ noise
80 duckdb:duckdb -14.7% -13.9% -0.9% +11.9% ➖ noise
80 duckdb:vortex-compact -16.0% -13.9% -2.5% +11.6% ➖ noise
80 duckdb:vortex-file-compressed -24.7% -13.9% -12.5% +11.6% ✅ faster
81 datafusion:vortex-compact -24.2% -11.7% -14.2% +11.6% ✅ faster
81 datafusion:vortex-file-compressed -12.7% -11.7% -1.2% +15.4% ➖ noise
81 duckdb:duckdb -16.7% -11.7% -5.7% +11.6% ➖ noise
81 duckdb:vortex-compact -11.9% -11.7% -0.2% +12.9% ➖ noise
81 duckdb:vortex-file-compressed -24.5% -11.7% -14.6% +12.3% ✅ faster
82 datafusion:vortex-compact -27.9% -11.1% -18.9% +11.6% ✅ faster
82 datafusion:vortex-file-compressed -19.1% -11.1% -9.0% +13.3% ➖ noise
82 duckdb:duckdb -3.4% -11.1% +8.7% +16.8% ➖ noise
82 duckdb:vortex-compact -7.1% -11.1% +4.5% +12.2% ➖ noise
82 duckdb:vortex-file-compressed -22.7% -11.1% -13.0% +19.3% ➖ noise
83 datafusion:vortex-compact -28.5% -10.8% -19.8% +11.6% ✅ faster
83 datafusion:vortex-file-compressed -13.7% -10.8% -3.2% +11.6% ➖ noise
83 duckdb:duckdb -9.4% -10.8% +1.5% +13.2% ➖ noise
83 duckdb:vortex-compact -9.8% -10.8% +1.0% +11.6% ➖ noise
83 duckdb:vortex-file-compressed -11.8% -10.8% -1.2% +14.9% ➖ noise
84 datafusion:vortex-compact -31.4% -9.8% -23.9% +12.7% ✅ faster
84 datafusion:vortex-file-compressed -13.3% -9.8% -3.9% +11.6% ➖ noise
84 duckdb:duckdb -7.0% -9.8% +3.1% +11.6% ➖ noise
84 duckdb:vortex-compact -12.6% -9.8% -3.2% +11.6% ➖ noise
84 duckdb:vortex-file-compressed -16.8% -9.8% -7.8% +11.6% ➖ noise
85 datafusion:vortex-compact -22.7% -20.5% -2.8% +11.6% ➖ noise
85 datafusion:vortex-file-compressed -11.2% -20.5% +11.6% +11.6% 🚨 regression
85 duckdb:duckdb -12.4% -20.5% +10.2% +12.9% ➖ noise
85 duckdb:vortex-compact -11.4% -20.5% +11.4% +11.6% ➖ noise
85 duckdb:vortex-file-compressed -10.8% -20.5% +12.2% +11.6% 🚨 regression
86 datafusion:vortex-compact -9.6% -18.3% +10.6% +11.6% ➖ noise
86 datafusion:vortex-file-compressed -11.0% -18.3% +8.9% +11.6% ➖ noise
86 duckdb:duckdb -7.6% -18.3% +13.1% +11.6% 🚨 regression
86 duckdb:vortex-compact -7.4% -18.3% +13.3% +22.5% ➖ noise
86 duckdb:vortex-file-compressed -10.6% -18.3% +9.4% +11.6% ➖ noise
87 datafusion:vortex-compact -12.5% -16.0% +4.1% +11.6% ➖ noise
87 datafusion:vortex-file-compressed -12.1% -16.0% +4.6% +11.6% ➖ noise
87 duckdb:duckdb -6.3% -16.0% +11.5% +11.6% ➖ noise
87 duckdb:vortex-compact -17.1% -16.0% -1.3% +23.7% ➖ noise
87 duckdb:vortex-file-compressed -6.8% -16.0% +10.9% +11.6% ➖ noise
88 datafusion:vortex-compact -9.0% -9.0% +0.0% +11.6% ➖ noise
88 datafusion:vortex-file-compressed -12.1% -9.0% -3.4% +11.6% ➖ noise
88 duckdb:duckdb -3.9% -9.0% +5.6% +11.6% ➖ noise
88 duckdb:vortex-compact -6.5% -9.0% +2.8% +11.6% ➖ noise
88 duckdb:vortex-file-compressed -11.6% -9.0% -2.8% +11.6% ➖ noise
89 datafusion:vortex-compact -12.3% -12.1% -0.2% +11.6% ➖ noise
89 datafusion:vortex-file-compressed -17.7% -12.1% -6.4% +12.3% ➖ noise
89 duckdb:duckdb -5.2% -12.1% +7.8% +30.3% ➖ noise
89 duckdb:vortex-compact -8.1% -12.1% +4.5% +11.6% ➖ noise
89 duckdb:vortex-file-compressed -13.2% -12.1% -1.2% +12.6% ➖ noise
90 datafusion:vortex-compact -5.5% -7.3% +2.0% +12.4% ➖ noise
90 datafusion:vortex-file-compressed -10.1% -7.3% -3.0% +11.6% ➖ noise
90 duckdb:duckdb -7.2% -7.3% +0.1% +11.6% ➖ noise
90 duckdb:vortex-compact -4.4% -7.3% +3.2% +11.6% ➖ noise
90 duckdb:vortex-file-compressed -8.7% -7.3% -1.5% +11.6% ➖ noise
91 datafusion:vortex-compact -5.4% -8.8% +3.7% +11.6% ➖ noise
91 datafusion:vortex-file-compressed -14.9% -8.8% -6.8% +11.6% ➖ noise
91 duckdb:duckdb -1.9% -8.8% +7.5% +14.1% ➖ noise
91 duckdb:vortex-compact -13.7% -8.8% -5.5% +11.6% ➖ noise
91 duckdb:vortex-file-compressed -13.1% -8.8% -4.8% +11.8% ➖ noise
92 datafusion:vortex-compact -9.7% -15.5% +7.0% +11.6% ➖ noise
92 datafusion:vortex-file-compressed -10.0% -15.5% +6.6% +11.6% ➖ noise
92 duckdb:duckdb -9.6% -15.5% +7.1% +12.6% ➖ noise
92 duckdb:vortex-compact -10.5% -15.5% +6.0% +16.3% ➖ noise
92 duckdb:vortex-file-compressed -9.9% -15.5% +6.7% +12.8% ➖ noise
93 datafusion:vortex-compact -26.9% -15.1% -13.9% +11.6% ✅ faster
93 datafusion:vortex-file-compressed -17.0% -15.1% -2.2% +11.6% ➖ noise
93 duckdb:duckdb -10.3% -15.1% +5.7% +12.6% ➖ noise
93 duckdb:vortex-compact -14.6% -15.1% +0.7% +11.6% ➖ noise
93 duckdb:vortex-file-compressed -10.9% -15.1% +5.0% +14.4% ➖ noise
94 datafusion:vortex-compact -24.9% -11.7% -14.9% +11.6% ✅ faster
94 datafusion:vortex-file-compressed -12.5% -11.7% -0.9% +11.6% ➖ noise
94 duckdb:duckdb -8.9% -11.7% +3.2% +17.5% ➖ noise
94 duckdb:vortex-compact -16.2% -11.7% -5.1% +14.4% ➖ noise
94 duckdb:vortex-file-compressed -11.5% -11.7% +0.2% +14.3% ➖ noise
95 datafusion:vortex-compact -21.3% -9.6% -13.0% +11.6% ✅ faster
95 datafusion:vortex-file-compressed -11.5% -9.6% -2.1% +11.6% ➖ noise
95 duckdb:duckdb -0.4% -9.6% +10.1% +15.4% ➖ noise
95 duckdb:vortex-compact -7.6% -9.6% +2.2% +18.1% ➖ noise
95 duckdb:vortex-file-compressed +4.8% -9.6% +15.8% +17.9% ➖ noise
96 datafusion:vortex-compact -18.9% -8.4% -11.4% +13.1% ➖ noise
96 datafusion:vortex-file-compressed -17.2% -8.4% -9.6% +14.1% ➖ noise
96 duckdb:duckdb -7.9% -8.4% +0.5% +16.6% ➖ noise
96 duckdb:vortex-compact -5.7% -8.4% +3.0% +11.6% ➖ noise
96 duckdb:vortex-file-compressed -16.3% -8.4% -8.6% +13.5% ➖ noise
97 datafusion:vortex-compact -27.7% -15.8% -14.2% +13.9% ✅ faster
97 datafusion:vortex-file-compressed -17.0% -15.8% -1.4% +11.6% ➖ noise
97 duckdb:duckdb -12.1% -15.8% +4.4% +12.3% ➖ noise
97 duckdb:vortex-compact -7.8% -15.8% +9.5% +11.8% ➖ noise
97 duckdb:vortex-file-compressed -20.0% -15.8% -5.1% +16.3% ➖ noise
98 datafusion:vortex-compact -28.5% -12.5% -18.2% +11.6% ✅ faster
98 datafusion:vortex-file-compressed -13.1% -12.5% -0.6% +11.6% ➖ noise
98 duckdb:duckdb -10.2% -12.5% +2.6% +15.0% ➖ noise
98 duckdb:vortex-compact -12.9% -12.5% -0.4% +13.2% ➖ noise
98 duckdb:vortex-file-compressed -29.5% -12.5% -19.5% +11.6% ✅ faster
99 datafusion:vortex-compact -37.5% -4.9% -34.2% +19.9% ✅ faster
99 datafusion:vortex-file-compressed -13.4% -4.9% -8.9% +18.2% ➖ noise
99 duckdb:duckdb -6.7% -4.9% -1.8% +20.6% ➖ noise
99 duckdb:vortex-compact -8.0% -4.9% -3.3% +29.1% ➖ noise
99 duckdb:vortex-file-compressed -17.9% -4.9% -13.6% +35.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.2%
Vortex (geomean): 0.955x ➖
Parquet (geomean): 1.018x ➖
Shifts: Parquet (control) +1.8% · Median polish -3.9%


datafusion / vortex-file-compressed (1.029x ➖, 0↑ 1↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 97911040 44566271 2.20
fineweb_q01/datafusion:vortex-file-compressed 487525361 502752437 0.97
fineweb_q02/datafusion:vortex-file-compressed 513272453 572762984 0.90
fineweb_q03/datafusion:vortex-file-compressed 1519724469 2050848490 0.74
fineweb_q04/datafusion:vortex-file-compressed 1404386976 1400347440 1.00
fineweb_q05/datafusion:vortex-file-compressed 1378877672 1373742227 1.00
fineweb_q06/datafusion:vortex-file-compressed 1762566999 1887492092 0.93
fineweb_q07/datafusion:vortex-file-compressed 1422186123 1531469802 0.93
fineweb_q08/datafusion:vortex-file-compressed 685833874 652976520 1.05
datafusion / vortex-compact (0.861x ➖, 1↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 32144775 87807291 0.37
fineweb_q01/datafusion:vortex-compact 673653171 652721098 1.03
fineweb_q02/datafusion:vortex-compact 639223209 561660176 1.14
fineweb_q03/datafusion:vortex-compact 1801309520 1992825621 0.90
fineweb_q04/datafusion:vortex-compact 2178555243 2430496561 0.90
fineweb_q05/datafusion:vortex-compact 1682947039 1903389320 0.88
fineweb_q06/datafusion:vortex-compact 1481232609 1541792070 0.96
fineweb_q07/datafusion:vortex-compact 1361269391 1480788853 0.92
fineweb_q08/datafusion:vortex-compact 387080707 403633586 0.96
datafusion / parquet (1.042x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1283937678 1250895435 1.03
fineweb_q01/datafusion:parquet 2016257052 1894320286 1.06
fineweb_q02/datafusion:parquet 2007488994 2077059185 0.97
fineweb_q03/datafusion:parquet 1788408865 1917504971 0.93
fineweb_q04/datafusion:parquet 2029116927 1936742358 1.05
fineweb_q05/datafusion:parquet 1971096544 1912858316 1.03
fineweb_q06/datafusion:parquet 2130512035 1804191078 1.18
fineweb_q07/datafusion:parquet 1983345969 1854678256 1.07
fineweb_q08/datafusion:parquet 2180538896 2025809279 1.08
duckdb / vortex-file-compressed (0.970x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 87818287 87886477 1.00
fineweb_q01/duckdb:vortex-file-compressed 625582797 665755597 0.94
fineweb_q02/duckdb:vortex-file-compressed 431282951 425932823 1.01
fineweb_q03/duckdb:vortex-file-compressed 1478521420 1553335000 0.95
fineweb_q04/duckdb:vortex-file-compressed 1454433690 1593176736 0.91
fineweb_q05/duckdb:vortex-file-compressed 1545678683 1547993554 1.00
fineweb_q06/duckdb:vortex-file-compressed 1611409454 1771110367 0.91
fineweb_q07/duckdb:vortex-file-compressed 1703099076 1531703209 1.11
fineweb_q08/duckdb:vortex-file-compressed 586776540 646684593 0.91
duckdb / vortex-compact (0.970x ➖, 0↑ 1↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 84864494 78384254 1.08
fineweb_q01/duckdb:vortex-compact 585757449 559301341 1.05
fineweb_q02/duckdb:vortex-compact 583341935 596135999 0.98
fineweb_q03/duckdb:vortex-compact 1653119119 1840044866 0.90
fineweb_q04/duckdb:vortex-compact 1659607838 1934173815 0.86
fineweb_q05/duckdb:vortex-compact 1456287623 1740851064 0.84
fineweb_q06/duckdb:vortex-compact 1463001591 1610434311 0.91
fineweb_q07/duckdb:vortex-compact 1298376790 1505869559 0.86
fineweb_q08/duckdb:vortex-compact 🚨 650471776 481254136 1.35
duckdb / parquet (0.995x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1314090645 1215691731 1.08
fineweb_q01/duckdb:parquet 1363224392 1404971087 0.97
fineweb_q02/duckdb:parquet 1342057299 1506035020 0.89
fineweb_q03/duckdb:parquet 3649332676 3958670492 0.92
fineweb_q04/duckdb:parquet 2012854838 1960702986 1.03
fineweb_q05/duckdb:parquet 2234411105 2309907217 0.97
fineweb_q06/duckdb:parquet 4598365368 4409373557 1.04
fineweb_q07/duckdb:parquet 2963819743 2684912202 1.10
fineweb_q08/duckdb:parquet 1156593731 1186463596 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -63.4% +5.3% -65.2% +227.8% ➖ noise
0 datafusion:vortex-file-compressed +119.7% +5.3% +108.6% +225.4% ➖ noise
0 duckdb:vortex-compact +8.3% +5.3% +2.8% +50.4% ➖ noise
0 duckdb:vortex-file-compressed -0.1% +5.3% -5.1% +108.4% ➖ noise
1 datafusion:vortex-compact +3.2% +1.6% +1.6% +55.0% ➖ noise
1 datafusion:vortex-file-compressed -3.0% +1.6% -4.6% +89.3% ➖ noise
1 duckdb:vortex-compact +4.7% +1.6% +3.1% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -6.0% +1.6% -7.5% +45.1% ➖ noise
2 datafusion:vortex-compact +13.8% -7.2% +22.6% +40.2% ➖ noise
2 datafusion:vortex-file-compressed -10.4% -7.2% -3.4% +52.2% ➖ noise
2 duckdb:vortex-compact -2.1% -7.2% +5.4% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +1.3% -7.2% +9.1% +49.4% ➖ noise
3 datafusion:vortex-compact -9.6% -7.3% -2.5% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -25.9% -7.3% -20.1% +67.8% ➖ noise
3 duckdb:vortex-compact -10.2% -7.3% -3.1% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -4.8% -7.3% +2.7% +30.0% ➖ noise
4 datafusion:vortex-compact -10.4% +3.7% -13.6% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +0.3% +3.7% -3.3% +30.0% ➖ noise
4 duckdb:vortex-compact -14.2% +3.7% -17.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -8.7% +3.7% -12.0% +30.0% ➖ noise
5 datafusion:vortex-compact -11.6% -0.2% -11.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +0.4% -0.2% +0.5% +30.0% ➖ noise
5 duckdb:vortex-compact -16.3% -0.2% -16.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -0.1% -0.2% +0.0% +30.0% ➖ noise
6 datafusion:vortex-compact -3.9% +11.0% -13.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -6.6% +11.0% -15.9% +30.0% ➖ noise
6 duckdb:vortex-compact -9.2% +11.0% -18.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -9.0% +11.0% -18.0% +30.0% ➖ noise
7 datafusion:vortex-compact -8.1% +8.6% -15.4% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -7.1% +8.6% -14.5% +30.0% ➖ noise
7 duckdb:vortex-compact -13.8% +8.6% -20.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +11.2% +8.6% +2.3% +30.0% ➖ noise
8 datafusion:vortex-compact -4.1% +2.4% -6.4% +43.9% ➖ noise
8 datafusion:vortex-file-compressed +5.0% +2.4% +2.5% +30.0% ➖ noise
8 duckdb:vortex-compact +35.2% +2.4% +31.9% +65.8% ➖ noise
8 duckdb:vortex-file-compressed -9.3% +2.4% -11.4% +31.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.927x ➖
Parquet (geomean): 1.069x ➖


unknown / unknown (1.012x ➖, 7↑ 16↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2244263 2726422 0.82
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚨 1452164 1293547 1.12
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11875130163 11582036688 1.03
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11299733859 11284649648 1.00
random-access/feature-vectors/correlated/vortex-tokio-local-disk 10110873 9597302 1.05
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7801325 7999156 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚨 1699297 1485583 1.14
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚨 2655356 2405726 1.10
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11141064534 11281254010 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11214055808 11180983607 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk 14528317 14878159 0.98
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 14876050 14974703 0.99
random-access/lance-tokio-local-disk 764034 733918 1.04
random-access/lance-tokio-local-disk-footer 1385500 1340238 1.03
random-access/nested-lists/correlated/lance-tokio-local-disk 🚨 302332 269118 1.12
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚨 829749 705123 1.18
random-access/nested-lists/correlated/parquet-tokio-local-disk 🚨 149206023 133197659 1.12
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 🚨 147939269 133355701 1.11
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚨 830027 722035 1.15
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 825924 736863 1.12
random-access/nested-lists/uniform/lance-tokio-local-disk 🚨 1287881 1170298 1.10
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 🚨 1856155 1645958 1.13
random-access/nested-lists/uniform/parquet-tokio-local-disk 146242047 133760520 1.09
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 🚨 147574432 133861061 1.10
random-access/nested-lists/uniform/vortex-tokio-local-disk 2653744 2574511 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2684234 2523234 1.06
random-access/nested-structs/correlated/lance-tokio-local-disk 458652 461327 0.99
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 697504 703200 0.99
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 30338700 26712286 1.14
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 32011862 26625604 1.20
random-access/nested-structs/correlated/vortex-tokio-local-disk 1025919 978159 1.05
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 984134 980045 1.00
random-access/nested-structs/uniform/lance-tokio-local-disk 2976034 3046717 0.98
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3279342 3285254 1.00
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 30925646 26447669 1.17
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 30231648 26810339 1.13
random-access/nested-structs/uniform/vortex-tokio-local-disk 1962487 2039583 0.96
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1976779 2018732 0.98
random-access/parquet-tokio-local-disk 185942586 180823993 1.03
random-access/parquet-tokio-local-disk-footer 186853883 184294576 1.01
random-access/taxi/correlated/lance-tokio-local-disk 971446 959869 1.01
random-access/taxi/correlated/lance-tokio-local-disk-footer 1651810 1636725 1.01
random-access/taxi/correlated/parquet-tokio-local-disk 281961006 270207785 1.04
random-access/taxi/correlated/parquet-tokio-local-disk-footer 280038235 269375309 1.04
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1866532 3075902 0.61
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 2127276 2970291 0.72
random-access/taxi/uniform/lance-tokio-local-disk 8814916 8415928 1.05
random-access/taxi/uniform/lance-tokio-local-disk-footer 9547214 9126608 1.05
random-access/taxi/uniform/parquet-tokio-local-disk 297967699 287190371 1.04
random-access/taxi/uniform/parquet-tokio-local-disk-footer 298640052 287932353 1.04
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 5105417 5787580 0.88
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4996736 5690417 0.88
random-access/vortex-tokio-local-disk 🚀 1404833 1868164 0.75
random-access/vortex-tokio-local-disk-footer 🚀 1404921 1944123 0.72

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.3%
Vortex (geomean): 1.027x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish +2.1%


duckdb / vortex-file-compressed (1.029x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11247492 10993628 1.02
statpopgen_q01/duckdb:vortex-file-compressed 22907483 22155881 1.03
statpopgen_q02/duckdb:vortex-file-compressed 1378738938 1386885394 0.99
statpopgen_q03/duckdb:vortex-file-compressed 3157616940 3109725784 1.02
statpopgen_q04/duckdb:vortex-file-compressed 3181382653 3139165372 1.01
statpopgen_q05/duckdb:vortex-file-compressed 1540726558 1461820891 1.05
statpopgen_q06/duckdb:vortex-file-compressed 2200915879 2140748294 1.03
statpopgen_q07/duckdb:vortex-file-compressed 239010309 220605175 1.08
statpopgen_q08/duckdb:vortex-file-compressed 270125791 259051861 1.04
statpopgen_q09/duckdb:vortex-file-compressed 2934201571 2897596987 1.01
statpopgen_q10/duckdb:vortex-file-compressed 4828831481 4711531270 1.02
duckdb / vortex-compact (1.025x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11726990 11040143 1.06
statpopgen_q01/duckdb:vortex-compact 174295005 166012577 1.05
statpopgen_q02/duckdb:vortex-compact 1860291256 1835566624 1.01
statpopgen_q03/duckdb:vortex-compact 3557736729 3488402913 1.02
statpopgen_q04/duckdb:vortex-compact 3567439288 3521477300 1.01
statpopgen_q05/duckdb:vortex-compact 1914836821 1858640453 1.03
statpopgen_q06/duckdb:vortex-compact 2753476658 2695583390 1.02
statpopgen_q07/duckdb:vortex-compact 899258231 885570585 1.02
statpopgen_q08/duckdb:vortex-compact 923885549 916518994 1.01
statpopgen_q09/duckdb:vortex-compact 3357138744 3353909491 1.00
statpopgen_q10/duckdb:vortex-compact 5598616637 5383160233 1.04
duckdb / parquet (1.014x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 338553800 334768223 1.01
statpopgen_q01/duckdb:parquet 431994490 418802444 1.03
statpopgen_q02/duckdb:parquet 1025919466 1024861793 1.00
statpopgen_q03/duckdb:parquet 1557511044 1534369686 1.02
statpopgen_q04/duckdb:parquet 1549579800 1539448079 1.01
statpopgen_q05/duckdb:parquet 1031077577 1040745076 0.99
statpopgen_q06/duckdb:parquet 1522523586 1517080658 1.00
statpopgen_q07/duckdb:parquet 1333338852 1320485259 1.01
statpopgen_q08/duckdb:parquet 1350903175 1330760390 1.02
statpopgen_q09/duckdb:parquet 1463386926 1375316084 1.06
statpopgen_q10/duckdb:parquet 2760458547 2746528904 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +6.2% +1.1% +5.0% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +2.3% +1.1% +1.2% +10.0% ➖ noise
1 duckdb:vortex-compact +5.0% +3.1% +1.8% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +3.4% +3.1% +0.2% +264.1% ➖ noise
2 duckdb:vortex-compact +1.3% +0.1% +1.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.6% +0.1% -0.7% +10.0% ➖ noise
3 duckdb:vortex-compact +2.0% +1.5% +0.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.5% +1.5% +0.0% +10.0% ➖ noise
4 duckdb:vortex-compact +1.3% +0.7% +0.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.3% +0.7% +0.7% +10.0% ➖ noise
5 duckdb:vortex-compact +3.0% -0.9% +4.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +5.4% -0.9% +6.4% +10.0% ➖ noise
6 duckdb:vortex-compact +2.1% +0.4% +1.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.8% +0.4% +2.4% +10.0% ➖ noise
7 duckdb:vortex-compact +1.5% +1.0% +0.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +8.3% +1.0% +7.3% +10.0% ➖ noise
8 duckdb:vortex-compact +0.8% +1.5% -0.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +4.3% +1.5% +2.7% +10.0% ➖ noise
9 duckdb:vortex-compact +0.1% +6.4% -5.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.3% +6.4% -4.8% +10.0% ➖ noise
10 duckdb:vortex-compact +4.0% +0.5% +3.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.5% +0.5% +2.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: Likely regression (low confidence)
Attributed Vortex impact: +25.9%
Vortex (geomean): 1.424x ❌
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish +1.7%


datafusion / vortex-file-compressed (1.301x ❌, 0↑ 5↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 407338845 398121803 1.02
tpch_q02/datafusion:vortex-file-compressed 113577274 114194898 0.99
tpch_q03/datafusion:vortex-file-compressed 224079376 216217945 1.04
tpch_q04/datafusion:vortex-file-compressed 🚨 329394120 109068682 3.02
tpch_q05/datafusion:vortex-file-compressed 392416073 386624988 1.01
tpch_q06/datafusion:vortex-file-compressed 🚨 157118793 42800272 3.67
tpch_q07/datafusion:vortex-file-compressed 584577948 565322114 1.03
tpch_q08/datafusion:vortex-file-compressed 382698736 380855030 1.00
tpch_q09/datafusion:vortex-file-compressed 666292027 665884865 1.00
tpch_q10/datafusion:vortex-file-compressed 245643839 243596832 1.01
tpch_q11/datafusion:vortex-file-compressed 86085420 85899883 1.00
tpch_q12/datafusion:vortex-file-compressed 🚨 796122779 117576515 6.77
tpch_q13/datafusion:vortex-file-compressed 217653698 217977088 1.00
tpch_q14/datafusion:vortex-file-compressed 🚨 63369027 56905135 1.11
tpch_q15/datafusion:vortex-file-compressed 🚨 299818326 106869126 2.81
tpch_q16/datafusion:vortex-file-compressed 84347911 77545117 1.09
tpch_q17/datafusion:vortex-file-compressed 642798197 644878633 1.00
tpch_q18/datafusion:vortex-file-compressed 872859394 876940352 1.00
tpch_q19/datafusion:vortex-file-compressed 91449718 93222872 0.98
tpch_q20/datafusion:vortex-file-compressed 178242318 170718217 1.04
tpch_q21/datafusion:vortex-file-compressed 715124161 682348684 1.05
tpch_q22/datafusion:vortex-file-compressed 64782947 60410701 1.07
datafusion / vortex-compact (1.230x ❌, 0↑ 4↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 445537635 441641550 1.01
tpch_q02/datafusion:vortex-compact 118996208 119072426 1.00
tpch_q03/datafusion:vortex-compact 227867641 217071635 1.05
tpch_q04/datafusion:vortex-compact 🚨 321163747 118775670 2.70
tpch_q05/datafusion:vortex-compact 397775583 394353537 1.01
tpch_q06/datafusion:vortex-compact 🚨 168160743 63368141 2.65
tpch_q07/datafusion:vortex-compact 604252056 586321350 1.03
tpch_q08/datafusion:vortex-compact 391616598 385128834 1.02
tpch_q09/datafusion:vortex-compact 676959970 683717221 0.99
tpch_q10/datafusion:vortex-compact 272238455 276819169 0.98
tpch_q11/datafusion:vortex-compact 89086197 90303806 0.99
tpch_q12/datafusion:vortex-compact 🚨 820258064 165860539 4.95
tpch_q13/datafusion:vortex-compact 269647742 270592624 1.00
tpch_q14/datafusion:vortex-compact 81021209 73911463 1.10
tpch_q15/datafusion:vortex-compact 🚨 312676336 164138618 1.90
tpch_q16/datafusion:vortex-compact 88559889 82846280 1.07
tpch_q17/datafusion:vortex-compact 646484084 652849552 0.99
tpch_q18/datafusion:vortex-compact 878135256 880601181 1.00
tpch_q19/datafusion:vortex-compact 138944157 134402798 1.03
tpch_q20/datafusion:vortex-compact 204363576 196714153 1.04
tpch_q21/datafusion:vortex-compact 737624135 694689890 1.06
tpch_q22/datafusion:vortex-compact 72030724 72008614 1.00
datafusion / parquet (0.997x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 412078537 415185537 0.99
tpch_q02/datafusion:parquet 183614617 187304400 0.98
tpch_q03/datafusion:parquet 295341566 295443651 1.00
tpch_q04/datafusion:parquet 135846152 136002677 1.00
tpch_q05/datafusion:parquet 449744112 457267838 0.98
tpch_q06/datafusion:parquet 118596315 118861516 1.00
tpch_q07/datafusion:parquet 620738413 625533022 0.99
tpch_q08/datafusion:parquet 490713903 494892630 0.99
tpch_q09/datafusion:parquet 765170054 772784648 0.99
tpch_q10/datafusion:parquet 506420985 508403241 1.00
tpch_q11/datafusion:parquet 130146004 129129396 1.01
tpch_q12/datafusion:parquet 209058014 212951609 0.98
tpch_q13/datafusion:parquet 337552372 339516331 0.99
tpch_q14/datafusion:parquet 155905459 162038044 0.96
tpch_q15/datafusion:parquet 241059321 244612715 0.99
tpch_q16/datafusion:parquet 141880137 137705041 1.03
tpch_q17/datafusion:parquet 695678471 700676071 0.99
tpch_q18/datafusion:parquet 872162573 875646545 1.00
tpch_q19/datafusion:parquet 277654784 268027558 1.04
tpch_q20/datafusion:parquet 305650526 308714781 0.99
tpch_q21/datafusion:parquet 733018433 739537415 0.99
tpch_q22/datafusion:parquet 227935974 217836663 1.05
datafusion / arrow (0.991x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 576629926 582479178 0.99
tpch_q02/datafusion:arrow 165519634 162151976 1.02
tpch_q03/datafusion:arrow 437646343 446920412 0.98
tpch_q04/datafusion:arrow 330427360 339444083 0.97
tpch_q05/datafusion:arrow 867724097 891857165 0.97
tpch_q06/datafusion:arrow 257690396 266640857 0.97
tpch_q07/datafusion:arrow 1084256919 1090262694 0.99
tpch_q08/datafusion:arrow 1075346820 1092497929 0.98
tpch_q09/datafusion:arrow 1288332268 1300473558 0.99
tpch_q10/datafusion:arrow 571710954 577151098 0.99
tpch_q11/datafusion:arrow 146561414 145308934 1.01
tpch_q12/datafusion:arrow 631809529 640200279 0.99
tpch_q13/datafusion:arrow 507323391 518057587 0.98
tpch_q14/datafusion:arrow 285339722 293253627 0.97
tpch_q15/datafusion:arrow 607880476 626713970 0.97
tpch_q16/datafusion:arrow 105902833 104659459 1.01
tpch_q17/datafusion:arrow 1286725869 1303684406 0.99
tpch_q18/datafusion:arrow 1779600820 1784948125 1.00
tpch_q19/datafusion:arrow 482621313 481108284 1.00
tpch_q20/datafusion:arrow 464579655 471675274 0.98
tpch_q21/datafusion:arrow 2770352499 2761886018 1.00
tpch_q22/datafusion:arrow 144764669 139976168 1.03
duckdb / vortex-file-compressed (1.691x ❌, 0↑ 8↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 181370750 175043255 1.04
tpch_q02/duckdb:vortex-file-compressed 54558810 53233654 1.02
tpch_q03/duckdb:vortex-file-compressed 143354997 132280295 1.08
tpch_q04/duckdb:vortex-file-compressed 🚨 800558702 161086498 4.97
tpch_q05/duckdb:vortex-file-compressed 142918737 133346397 1.07
tpch_q06/duckdb:vortex-file-compressed 🚨 245687637 48685795 5.05
tpch_q07/duckdb:vortex-file-compressed 🚨 444679915 153488954 2.90
tpch_q08/duckdb:vortex-file-compressed 187548032 178888892 1.05
tpch_q09/duckdb:vortex-file-compressed 344166519 336561437 1.02
tpch_q10/duckdb:vortex-file-compressed 167317961 163667548 1.02
tpch_q11/duckdb:vortex-file-compressed 35110797 34494609 1.02
tpch_q12/duckdb:vortex-file-compressed 🚨 1647611903 98275350 16.77
tpch_q13/duckdb:vortex-file-compressed 249469779 240620740 1.04
tpch_q14/duckdb:vortex-file-compressed 🚨 207438051 70295680 2.95
tpch_q15/duckdb:vortex-file-compressed 🚨 312770205 96516342 3.24
tpch_q16/duckdb:vortex-file-compressed 86759577 81563833 1.06
tpch_q17/duckdb:vortex-file-compressed 103608823 101642689 1.02
tpch_q18/duckdb:vortex-file-compressed 311576928 296435483 1.05
tpch_q19/duckdb:vortex-file-compressed 90971334 91450486 0.99
tpch_q20/duckdb:vortex-file-compressed 🚨 333622399 165671936 2.01
tpch_q21/duckdb:vortex-file-compressed 🚨 1555302774 589630007 2.64
tpch_q22/duckdb:vortex-file-compressed 80744629 77804487 1.04
duckdb / vortex-compact (1.520x ❌, 0↑ 8↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 240347864 236088295 1.02
tpch_q02/duckdb:vortex-compact 59086953 59013515 1.00
tpch_q03/duckdb:vortex-compact 146081812 139368988 1.05
tpch_q04/duckdb:vortex-compact 🚨 821294448 174498754 4.71
tpch_q05/duckdb:vortex-compact 151816078 146349615 1.04
tpch_q06/duckdb:vortex-compact 🚨 258138316 83409113 3.09
tpch_q07/duckdb:vortex-compact 🚨 473026356 202503112 2.34
tpch_q08/duckdb:vortex-compact 198250563 187121886 1.06
tpch_q09/duckdb:vortex-compact 370715011 360643924 1.03
tpch_q10/duckdb:vortex-compact 190905054 185521751 1.03
tpch_q11/duckdb:vortex-compact 41340100 41095331 1.01
tpch_q12/duckdb:vortex-compact 🚨 1694787534 201472668 8.41
tpch_q13/duckdb:vortex-compact 294076585 294842374 1.00
tpch_q14/duckdb:vortex-compact 🚨 227326329 103868294 2.19
tpch_q15/duckdb:vortex-compact 🚨 326459779 117993460 2.77
tpch_q16/duckdb:vortex-compact 87745357 86132833 1.02
tpch_q17/duckdb:vortex-compact 116358866 115647320 1.01
tpch_q18/duckdb:vortex-compact 294264421 292263063 1.01
tpch_q19/duckdb:vortex-compact 115765963 115458497 1.00
tpch_q20/duckdb:vortex-compact 🚨 352362924 204098356 1.73
tpch_q21/duckdb:vortex-compact 🚨 1574946145 618986797 2.54
tpch_q22/duckdb:vortex-compact 92094237 90574651 1.02
duckdb / parquet (1.012x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 258119378 257717833 1.00
tpch_q02/duckdb:parquet 95058300 100463949 0.95
tpch_q03/duckdb:parquet 207792858 205915369 1.01
tpch_q04/duckdb:parquet 131654560 130948439 1.01
tpch_q05/duckdb:parquet 216605517 216781241 1.00
tpch_q06/duckdb:parquet 67307286 66216998 1.02
tpch_q07/duckdb:parquet 179611130 179862886 1.00
tpch_q08/duckdb:parquet 249245790 252653394 0.99
tpch_q09/duckdb:parquet 488477520 493771696 0.99
tpch_q10/duckdb:parquet 614039076 608013530 1.01
tpch_q11/duckdb:parquet 62111729 57470634 1.08
tpch_q12/duckdb:parquet 127789704 121086311 1.06
tpch_q13/duckdb:parquet 458211154 447897600 1.02
tpch_q14/duckdb:parquet 176795747 173369111 1.02
tpch_q15/duckdb:parquet 95833641 95730671 1.00
tpch_q16/duckdb:parquet 162639075 160212118 1.02
tpch_q17/duckdb:parquet 176249789 175136897 1.01
tpch_q18/duckdb:parquet 354490968 351397937 1.01
tpch_q19/duckdb:parquet 285669154 279196458 1.02
tpch_q20/duckdb:parquet 237765412 231559382 1.03
tpch_q21/duckdb:parquet 582244798 557921369 1.04
tpch_q22/duckdb:parquet 293477635 290134633 1.01
duckdb / duckdb (1.006x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 118562129 117390965 1.01
tpch_q02/duckdb:duckdb 44588848 44841490 0.99
tpch_q03/duckdb:duckdb 97868893 97918283 1.00
tpch_q04/duckdb:duckdb 132553945 131861984 1.01
tpch_q05/duckdb:duckdb 111928521 109632567 1.02
tpch_q06/duckdb:duckdb 41054006 37388323 1.10
tpch_q07/duckdb:duckdb 87347461 86539527 1.01
tpch_q08/duckdb:duckdb 110256443 109887011 1.00
tpch_q09/duckdb:duckdb 275681381 278278025 0.99
tpch_q10/duckdb:duckdb 203771092 203052898 1.00
tpch_q11/duckdb:duckdb 15716671 15616324 1.01
tpch_q12/duckdb:duckdb 85120948 84883584 1.00
tpch_q13/duckdb:duckdb 218344178 219206519 1.00
tpch_q14/duckdb:duckdb 71809081 71455239 1.00
tpch_q15/duckdb:duckdb 77881778 77482611 1.01
tpch_q16/duckdb:duckdb 72930152 73346491 0.99
tpch_q17/duckdb:duckdb 84262062 85240668 0.99
tpch_q18/duckdb:duckdb 209766144 211163949 0.99
tpch_q19/duckdb:duckdb 119131664 115977168 1.03
tpch_q20/duckdb:duckdb 111244861 111469185 1.00
tpch_q21/duckdb:duckdb 289465466 296027107 0.98
tpch_q22/duckdb:duckdb 68229345 68097519 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -1.0% -0.3% -0.7% +10.0% ➖ noise
1 datafusion:vortex-compact +0.9% -0.3% +1.2% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +2.3% -0.3% +2.6% +10.0% ➖ noise
1 duckdb:duckdb +1.0% -0.3% +1.3% +10.0% ➖ noise
1 duckdb:vortex-compact +1.8% -0.3% +2.1% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +3.6% -0.3% +3.9% +10.0% ➖ noise
2 datafusion:arrow +2.1% -3.7% +6.0% +10.0% ➖ noise
2 datafusion:vortex-compact -0.1% -3.7% +3.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.5% -3.7% +3.3% +10.0% ➖ noise
2 duckdb:duckdb -0.6% -3.7% +3.2% +10.0% ➖ noise
2 duckdb:vortex-compact +0.1% -3.7% +4.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +2.5% -3.7% +6.4% +10.0% ➖ noise
3 datafusion:arrow -2.1% +0.4% -2.5% +10.0% ➖ noise
3 datafusion:vortex-compact +5.0% +0.4% +4.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +3.6% +0.4% +3.2% +10.0% ➖ noise
3 duckdb:duckdb -0.1% +0.4% -0.5% +10.0% ➖ noise
3 duckdb:vortex-compact +4.8% +0.4% +4.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +8.4% +0.4% +7.9% +10.0% ➖ noise
4 datafusion:arrow -2.7% +0.2% -2.9% +10.0% ➖ noise
4 datafusion:vortex-compact +170.4% +0.2% +169.8% +37.2% 🚨 regression
4 datafusion:vortex-file-compressed +202.0% +0.2% +201.4% +40.6% 🚨 regression
4 duckdb:duckdb +0.5% +0.2% +0.3% +10.0% ➖ noise
4 duckdb:vortex-compact +370.7% +0.2% +369.7% +20.7% 🚨 regression
4 duckdb:vortex-file-compressed +397.0% +0.2% +395.9% +13.5% 🚨 regression
5 datafusion:arrow -2.7% -0.9% -1.9% +10.0% ➖ noise
5 datafusion:vortex-compact +0.9% -0.9% +1.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.5% -0.9% +2.4% +10.0% ➖ noise
5 duckdb:duckdb +2.1% -0.9% +3.0% +10.0% ➖ noise
5 duckdb:vortex-compact +3.7% -0.9% +4.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +7.2% -0.9% +8.1% +10.0% ➖ noise
6 datafusion:arrow -3.4% +0.7% -4.0% +10.0% ➖ noise
6 datafusion:vortex-compact +165.4% +0.7% +163.5% +57.1% 🚨 regression
6 datafusion:vortex-file-compressed +267.1% +0.7% +264.5% +75.1% 🚨 regression
6 duckdb:duckdb +9.8% +0.7% +9.0% +11.8% ➖ noise
6 duckdb:vortex-compact +209.5% +0.7% +207.3% +54.4% 🚨 regression
6 duckdb:vortex-file-compressed +404.6% +0.7% +401.1% +79.9% 🚨 regression
7 datafusion:arrow -0.6% -0.5% -0.1% +10.0% ➖ noise
7 datafusion:vortex-compact +3.1% -0.5% +3.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +3.4% -0.5% +3.9% +10.0% ➖ noise
7 duckdb:duckdb +0.9% -0.5% +1.4% +10.0% ➖ noise
7 duckdb:vortex-compact +133.6% -0.5% +134.7% +10.0% 🚨 regression
7 duckdb:vortex-file-compressed +189.7% -0.5% +191.0% +10.0% 🚨 regression
8 datafusion:arrow -1.6% -1.1% -0.5% +10.0% ➖ noise
8 datafusion:vortex-compact +1.7% -1.1% +2.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.5% -1.1% +1.6% +10.0% ➖ noise
8 duckdb:duckdb +0.3% -1.1% +1.4% +10.0% ➖ noise
8 duckdb:vortex-compact +5.9% -1.1% +7.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +4.8% -1.1% +6.0% +10.0% ➖ noise
9 datafusion:arrow -0.9% -1.0% +0.1% +10.0% ➖ noise
9 datafusion:vortex-compact -1.0% -1.0% +0.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.1% -1.0% +1.1% +10.0% ➖ noise
9 duckdb:duckdb -0.9% -1.0% +0.1% +10.0% ➖ noise
9 duckdb:vortex-compact +2.8% -1.0% +3.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.3% -1.0% +3.3% +10.0% ➖ noise
10 datafusion:arrow -0.9% +0.3% -1.2% +10.0% ➖ noise
10 datafusion:vortex-compact -1.7% +0.3% -1.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.8% +0.3% +0.5% +10.0% ➖ noise
10 duckdb:duckdb +0.4% +0.3% +0.1% +10.0% ➖ noise
10 duckdb:vortex-compact +2.9% +0.3% +2.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.2% +0.3% +1.9% +10.0% ➖ noise
11 datafusion:arrow +0.9% +4.4% -3.4% +10.0% ➖ noise
11 datafusion:vortex-compact -1.3% +4.4% -5.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.2% +4.4% -4.0% +10.0% ➖ noise
11 duckdb:duckdb +0.6% +4.4% -3.6% +11.5% ➖ noise
11 duckdb:vortex-compact +0.6% +4.4% -3.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +1.8% +4.4% -2.5% +10.0% ➖ noise
12 datafusion:arrow -1.3% +1.8% -3.0% +26.7% ➖ noise
12 datafusion:vortex-compact +394.5% +1.8% +385.9% +25.1% 🚨 regression
12 datafusion:vortex-file-compressed +577.1% +1.8% +565.2% +25.9% 🚨 regression
12 duckdb:duckdb +0.3% +1.8% -1.5% +10.0% ➖ noise
12 duckdb:vortex-compact +741.2% +1.8% +726.4% +10.0% 🚨 regression
12 duckdb:vortex-file-compressed +1576.5% +1.8% +1547.1% +10.2% 🚨 regression
13 datafusion:arrow -2.1% +0.9% -2.9% +10.0% ➖ noise
13 datafusion:vortex-compact -0.3% +0.9% -1.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.1% +0.9% -1.0% +10.0% ➖ noise
13 duckdb:duckdb -0.4% +0.9% -1.2% +10.0% ➖ noise
13 duckdb:vortex-compact -0.3% +0.9% -1.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +3.7% +0.9% +2.8% +10.0% ➖ noise
14 datafusion:arrow -2.7% -0.9% -1.8% +10.0% ➖ noise
14 datafusion:vortex-compact +9.6% -0.9% +10.7% +28.0% ➖ noise
14 datafusion:vortex-file-compressed +11.4% -0.9% +12.4% +38.0% ➖ noise
14 duckdb:duckdb +0.5% -0.9% +1.5% +10.0% ➖ noise
14 duckdb:vortex-compact +118.9% -0.9% +121.0% +41.2% 🚨 regression
14 duckdb:vortex-file-compressed +195.1% -0.9% +197.9% +57.7% 🚨 regression
15 datafusion:arrow -3.0% -0.7% -2.3% +10.0% ➖ noise
15 datafusion:vortex-compact +90.5% -0.7% +91.8% +10.0% 🚨 regression
15 datafusion:vortex-file-compressed +180.5% -0.7% +182.5% +10.0% 🚨 regression
15 duckdb:duckdb +0.5% -0.7% +1.2% +10.0% ➖ noise
15 duckdb:vortex-compact +176.7% -0.7% +178.6% +10.0% 🚨 regression
15 duckdb:vortex-file-compressed +224.1% -0.7% +226.3% +10.0% 🚨 regression
16 datafusion:arrow +1.2% +2.3% -1.1% +10.0% ➖ noise
16 datafusion:vortex-compact +6.9% +2.3% +4.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +8.8% +2.3% +6.4% +10.0% ➖ noise
16 duckdb:duckdb -0.6% +2.3% -2.8% +10.0% ➖ noise
16 duckdb:vortex-compact +1.9% +2.3% -0.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +6.4% +2.3% +4.0% +10.0% ➖ noise
17 datafusion:arrow -1.3% -0.0% -1.3% +10.0% ➖ noise
17 datafusion:vortex-compact -1.0% -0.0% -0.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.3% -0.0% -0.3% +10.0% ➖ noise
17 duckdb:duckdb -1.1% -0.0% -1.1% +10.0% ➖ noise
17 duckdb:vortex-compact +0.6% -0.0% +0.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.9% -0.0% +2.0% +10.0% ➖ noise
18 datafusion:arrow -0.3% +0.2% -0.5% +10.0% ➖ noise
18 datafusion:vortex-compact -0.3% +0.2% -0.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.5% +0.2% -0.7% +10.0% ➖ noise
18 duckdb:duckdb -0.7% +0.2% -0.9% +10.0% ➖ noise
18 duckdb:vortex-compact +0.7% +0.2% +0.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +5.1% +0.2% +4.9% +10.0% ➖ noise
19 datafusion:arrow +0.3% +3.0% -2.6% +10.0% ➖ noise
19 datafusion:vortex-compact +3.4% +3.0% +0.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -1.9% +3.0% -4.7% +10.0% ➖ noise
19 duckdb:duckdb +2.7% +3.0% -0.2% +10.0% ➖ noise
19 duckdb:vortex-compact +0.3% +3.0% -2.6% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.5% +3.0% -3.4% +10.0% ➖ noise
20 datafusion:arrow -1.5% +0.8% -2.3% +10.0% ➖ noise
20 datafusion:vortex-compact +3.9% +0.8% +3.0% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +4.4% +0.8% +3.6% +10.0% ➖ noise
20 duckdb:duckdb -0.2% +0.8% -1.0% +10.0% ➖ noise
20 duckdb:vortex-compact +72.6% +0.8% +71.2% +20.8% 🚨 regression
20 duckdb:vortex-file-compressed +101.4% +0.8% +99.7% +27.4% 🚨 regression
21 datafusion:arrow +0.3% +1.7% -1.4% +10.0% ➖ noise
21 datafusion:vortex-compact +6.2% +1.7% +4.4% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +4.8% +1.7% +3.0% +10.0% ➖ noise
21 duckdb:duckdb -2.2% +1.7% -3.9% +10.0% ➖ noise
21 duckdb:vortex-compact +154.4% +1.7% +150.2% +10.0% 🚨 regression
21 duckdb:vortex-file-compressed +163.8% +1.7% +159.4% +10.0% 🚨 regression
22 datafusion:arrow +3.4% +2.9% +0.5% +10.0% ➖ noise
22 datafusion:vortex-compact +0.0% +2.9% -2.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +7.2% +2.9% +4.2% +10.1% ➖ noise
22 duckdb:duckdb +0.2% +2.9% -2.6% +10.0% ➖ noise
22 duckdb:vortex-compact +1.7% +2.9% -1.2% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +3.8% +2.9% +0.9% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.2%
Vortex (geomean): 0.992x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -1.0%


datafusion / vortex-file-compressed (0.986x ➖, 3↑ 2↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1902181 1889203 1.01
clickbench_q01/datafusion:vortex-file-compressed 13703309 13939671 0.98
clickbench_q02/datafusion:vortex-file-compressed 33842757 31264638 1.08
clickbench_q03/datafusion:vortex-file-compressed 39723850 38421356 1.03
clickbench_q04/datafusion:vortex-file-compressed 305923842 310446627 0.99
clickbench_q05/datafusion:vortex-file-compressed 317056692 320204655 0.99
clickbench_q06/datafusion:vortex-file-compressed 1867543 1952097 0.96
clickbench_q07/datafusion:vortex-file-compressed 18114523 18292606 0.99
clickbench_q08/datafusion:vortex-file-compressed 372490767 384078789 0.97
clickbench_q09/datafusion:vortex-file-compressed 565573958 566643951 1.00
clickbench_q10/datafusion:vortex-file-compressed 69353296 71141010 0.97
clickbench_q11/datafusion:vortex-file-compressed 82765380 83595534 0.99
clickbench_q12/datafusion:vortex-file-compressed 271682259 273938782 0.99
clickbench_q13/datafusion:vortex-file-compressed 409155426 416784825 0.98
clickbench_q14/datafusion:vortex-file-compressed 258144476 265927485 0.97
clickbench_q15/datafusion:vortex-file-compressed 361550981 362106765 1.00
clickbench_q16/datafusion:vortex-file-compressed 691163270 703023248 0.98
clickbench_q17/datafusion:vortex-file-compressed 683034424 690992706 0.99
clickbench_q18/datafusion:vortex-file-compressed 1390001657 1425231293 0.98
clickbench_q19/datafusion:vortex-file-compressed 🚀 24702724 29457193 0.84
clickbench_q20/datafusion:vortex-file-compressed 359384805 357468484 1.01
clickbench_q21/datafusion:vortex-file-compressed 409296952 410380432 1.00
clickbench_q22/datafusion:vortex-file-compressed 500500899 498112225 1.00
clickbench_q23/datafusion:vortex-file-compressed 🚨 780534281 678127265 1.15
clickbench_q24/datafusion:vortex-file-compressed 50290425 51084111 0.98
clickbench_q25/datafusion:vortex-file-compressed 72415716 77179786 0.94
clickbench_q26/datafusion:vortex-file-compressed 🚀 45483231 50979572 0.89
clickbench_q27/datafusion:vortex-file-compressed 800457680 805667284 0.99
clickbench_q28/datafusion:vortex-file-compressed 6842623940 6773034054 1.01
clickbench_q29/datafusion:vortex-file-compressed 229632418 240289452 0.96
clickbench_q30/datafusion:vortex-file-compressed 233545641 234920960 0.99
clickbench_q31/datafusion:vortex-file-compressed 267338367 267821296 1.00
clickbench_q32/datafusion:vortex-file-compressed 🚨 1324054808 1152075470 1.15
clickbench_q33/datafusion:vortex-file-compressed 1391958167 1386736735 1.00
clickbench_q34/datafusion:vortex-file-compressed 1388689647 1410979228 0.98
clickbench_q35/datafusion:vortex-file-compressed 511360407 512752782 1.00
clickbench_q36/datafusion:vortex-file-compressed 80199913 78469854 1.02
clickbench_q37/datafusion:vortex-file-compressed 38315327 38958439 0.98
clickbench_q38/datafusion:vortex-file-compressed 22048528 23760536 0.93
clickbench_q39/datafusion:vortex-file-compressed 144988717 158633031 0.91
clickbench_q40/datafusion:vortex-file-compressed 18676814 18076950 1.03
clickbench_q41/datafusion:vortex-file-compressed 🚀 16716218 18844724 0.89
clickbench_q42/datafusion:vortex-file-compressed 18405818 19294008 0.95
datafusion / parquet (0.983x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1972672 1920311 1.03
clickbench_q01/datafusion:parquet 20849967 21971992 0.95
clickbench_q02/datafusion:parquet 54792769 59155606 0.93
clickbench_q03/datafusion:parquet 43581465 45640822 0.95
clickbench_q04/datafusion:parquet 323975221 336899338 0.96
clickbench_q05/datafusion:parquet 377234824 363436517 1.04
clickbench_q06/datafusion:parquet 1784282 1750763 1.02
clickbench_q07/datafusion:parquet 26586819 26908531 0.99
clickbench_q08/datafusion:parquet 413310555 427134131 0.97
clickbench_q09/datafusion:parquet 638685806 651010395 0.98
clickbench_q10/datafusion:parquet 111848682 112623919 0.99
clickbench_q11/datafusion:parquet 132834207 136832979 0.97
clickbench_q12/datafusion:parquet 362845295 363664601 1.00
clickbench_q13/datafusion:parquet 506086761 516715143 0.98
clickbench_q14/datafusion:parquet 359641568 357169990 1.01
clickbench_q15/datafusion:parquet 371203014 374913037 0.99
clickbench_q16/datafusion:parquet 694234938 692817899 1.00
clickbench_q17/datafusion:parquet 676002170 685266393 0.99
clickbench_q18/datafusion:parquet 1430133676 1441675345 0.99
clickbench_q19/datafusion:parquet 34165444 35103556 0.97
clickbench_q20/datafusion:parquet 620667370 635774055 0.98
clickbench_q21/datafusion:parquet 685449802 686502900 1.00
clickbench_q22/datafusion:parquet 989333593 1002645621 0.99
clickbench_q23/datafusion:parquet 3724383048 3692172146 1.01
clickbench_q24/datafusion:parquet 87233980 88760086 0.98
clickbench_q25/datafusion:parquet 141247011 142519668 0.99
clickbench_q26/datafusion:parquet 86916064 88734976 0.98
clickbench_q27/datafusion:parquet 1064880875 1082950935 0.98
clickbench_q28/datafusion:parquet 6556376277 6626676262 0.99
clickbench_q29/datafusion:parquet 246745176 246049560 1.00
clickbench_q30/datafusion:parquet 367740302 366344778 1.00
clickbench_q31/datafusion:parquet 396953483 399517785 0.99
clickbench_q32/datafusion:parquet 1293031473 1294823745 1.00
clickbench_q33/datafusion:parquet 1552452121 1584652243 0.98
clickbench_q34/datafusion:parquet 1536688538 1541082887 1.00
clickbench_q35/datafusion:parquet 525963789 528575550 1.00
clickbench_q36/datafusion:parquet 139931544 143507010 0.98
clickbench_q37/datafusion:parquet 60999529 61994008 0.98
clickbench_q38/datafusion:parquet 88215727 96545280 0.91
clickbench_q39/datafusion:parquet 264765404 280206447 0.94
clickbench_q40/datafusion:parquet 33681243 35975269 0.94
clickbench_q41/datafusion:parquet 29607478 30518422 0.97
clickbench_q42/datafusion:parquet 31403143 32467060 0.97
duckdb / vortex-file-compressed (0.997x ➖, 2↑ 3↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6221517 6281683 0.99
clickbench_q01/duckdb:vortex-file-compressed 14219725 14390149 0.99
clickbench_q02/duckdb:vortex-file-compressed 26394977 26764191 0.99
clickbench_q03/duckdb:vortex-file-compressed 31398719 31639124 0.99
clickbench_q04/duckdb:vortex-file-compressed 183188968 189376520 0.97
clickbench_q05/duckdb:vortex-file-compressed 183679386 185613519 0.99
clickbench_q06/duckdb:vortex-file-compressed 19688398 19628632 1.00
clickbench_q07/duckdb:vortex-file-compressed 15641619 15908726 0.98
clickbench_q08/duckdb:vortex-file-compressed 262653852 267649839 0.98
clickbench_q09/duckdb:vortex-file-compressed 342845681 342988254 1.00
clickbench_q10/duckdb:vortex-file-compressed 72116260 72000647 1.00
clickbench_q11/duckdb:vortex-file-compressed 81077988 83205039 0.97
clickbench_q12/duckdb:vortex-file-compressed 204993950 199982058 1.03
clickbench_q13/duckdb:vortex-file-compressed 402769042 407366127 0.99
clickbench_q14/duckdb:vortex-file-compressed 238395907 236047187 1.01
clickbench_q15/duckdb:vortex-file-compressed 245315838 249363749 0.98
clickbench_q16/duckdb:vortex-file-compressed 759990915 749860903 1.01
clickbench_q17/duckdb:vortex-file-compressed 553787062 552507657 1.00
clickbench_q18/duckdb:vortex-file-compressed 1195540510 1152589328 1.04
clickbench_q19/duckdb:vortex-file-compressed 23197221 23891430 0.97
clickbench_q20/duckdb:vortex-file-compressed 400390928 370953080 1.08
clickbench_q21/duckdb:vortex-file-compressed 409710913 410959219 1.00
clickbench_q22/duckdb:vortex-file-compressed 🚨 707641112 620649278 1.14
clickbench_q23/duckdb:vortex-file-compressed 1714376468 1770863835 0.97
clickbench_q24/duckdb:vortex-file-compressed 🚀 42321739 54021760 0.78
clickbench_q25/duckdb:vortex-file-compressed 82479588 78705065 1.05
clickbench_q26/duckdb:vortex-file-compressed 🚀 43593519 51234463 0.85
clickbench_q27/duckdb:vortex-file-compressed 505599142 505344135 1.00
clickbench_q28/duckdb:vortex-file-compressed 2984307492 2998684463 1.00
clickbench_q29/duckdb:vortex-file-compressed 28704859 29323443 0.98
clickbench_q30/duckdb:vortex-file-compressed 195293061 191972008 1.02
clickbench_q31/duckdb:vortex-file-compressed 280666585 286469700 0.98
clickbench_q32/duckdb:vortex-file-compressed 1338826757 1371739860 0.98
clickbench_q33/duckdb:vortex-file-compressed 🚨 1668438627 1417923030 1.18
clickbench_q34/duckdb:vortex-file-compressed 🚨 1711839041 1495625285 1.14
clickbench_q35/duckdb:vortex-file-compressed 380558115 380459991 1.00
clickbench_q36/duckdb:vortex-file-compressed 33418508 32113202 1.04
clickbench_q37/duckdb:vortex-file-compressed 23346668 23956677 0.97
clickbench_q38/duckdb:vortex-file-compressed 26868461 26016604 1.03
clickbench_q39/duckdb:vortex-file-compressed 46210305 47211165 0.98
clickbench_q40/duckdb:vortex-file-compressed 23330812 24278256 0.96
clickbench_q41/duckdb:vortex-file-compressed 22080571 23261150 0.95
clickbench_q42/duckdb:vortex-file-compressed 24364138 24065076 1.01
duckdb / parquet (0.993x ➖, 0↑ 1↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 25041018 26216786 0.96
clickbench_q01/duckdb:parquet 27980899 27994942 1.00
clickbench_q02/duckdb:parquet 47936158 48231345 0.99
clickbench_q03/duckdb:parquet 38093191 38660107 0.99
clickbench_q04/duckdb:parquet 202503337 201507048 1.00
clickbench_q05/duckdb:parquet 269393869 273968539 0.98
clickbench_q06/duckdb:parquet 45041621 45015264 1.00
clickbench_q07/duckdb:parquet 29090957 29167298 1.00
clickbench_q08/duckdb:parquet 264317118 266668957 0.99
clickbench_q09/duckdb:parquet 395464211 396965418 1.00
clickbench_q10/duckdb:parquet 79987785 80964438 0.99
clickbench_q11/duckdb:parquet 96999387 98177207 0.99
clickbench_q12/duckdb:parquet 291285387 296210271 0.98
clickbench_q13/duckdb:parquet 477524496 479315242 1.00
clickbench_q14/duckdb:parquet 323575580 324116975 1.00
clickbench_q15/duckdb:parquet 262588245 257740522 1.02
clickbench_q16/duckdb:parquet 649014492 641377091 1.01
clickbench_q17/duckdb:parquet 543832783 552102914 0.99
clickbench_q18/duckdb:parquet 1066933598 1086791808 0.98
clickbench_q19/duckdb:parquet 25848329 25504539 1.01
clickbench_q20/duckdb:parquet 421995288 421606981 1.00
clickbench_q21/duckdb:parquet 544411341 547558014 0.99
clickbench_q22/duckdb:parquet 932808012 939705560 0.99
clickbench_q23/duckdb:parquet 298858139 317582257 0.94
clickbench_q24/duckdb:parquet 69085731 70013793 0.99
clickbench_q25/duckdb:parquet 157436521 156983654 1.00
clickbench_q26/duckdb:parquet 47587413 49308048 0.97
clickbench_q27/duckdb:parquet 650929419 650239718 1.00
clickbench_q28/duckdb:parquet 4826036232 4812580558 1.00
clickbench_q29/duckdb:parquet 40945029 40245600 1.02
clickbench_q30/duckdb:parquet 297259212 299628315 0.99
clickbench_q31/duckdb:parquet 361384696 361091636 1.00
clickbench_q32/duckdb:parquet 1170537387 1158472475 1.01
clickbench_q33/duckdb:parquet 1281435145 1299195147 0.99
clickbench_q34/duckdb:parquet 1292087103 1329502040 0.97
clickbench_q35/duckdb:parquet 363083405 364283888 1.00
clickbench_q36/duckdb:parquet 45884426 46252952 0.99
clickbench_q37/duckdb:parquet 31113037 32721346 0.95
clickbench_q38/duckdb:parquet 31650470 34215233 0.93
clickbench_q39/duckdb:parquet 🚨 89389769 79240653 1.13
clickbench_q40/duckdb:parquet 18266837 19375282 0.94
clickbench_q41/duckdb:parquet 16871845 17021701 0.99
clickbench_q42/duckdb:parquet 21355341 20117490 1.06
duckdb / duckdb (0.946x ➖, 10↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17921503 19585998 0.92
clickbench_q01/duckdb:duckdb 33006878 36454626 0.91
clickbench_q02/duckdb:duckdb 45117741 49434076 0.91
clickbench_q03/duckdb:duckdb 46440318 49750184 0.93
clickbench_q04/duckdb:duckdb 186634012 191002203 0.98
clickbench_q05/duckdb:duckdb 267467200 271448584 0.99
clickbench_q06/duckdb:duckdb 🚀 34853069 39067298 0.89
clickbench_q07/duckdb:duckdb 35362052 38653692 0.91
clickbench_q08/duckdb:duckdb 248803830 248002658 1.00
clickbench_q09/duckdb:duckdb 371416485 367224815 1.01
clickbench_q10/duckdb:duckdb 98906975 100193420 0.99
clickbench_q11/duckdb:duckdb 107923487 109179509 0.99
clickbench_q12/duckdb:duckdb 238428992 235055110 1.01
clickbench_q13/duckdb:duckdb 461294754 492795438 0.94
clickbench_q14/duckdb:duckdb 270797200 276086105 0.98
clickbench_q15/duckdb:duckdb 220213939 219177005 1.00
clickbench_q16/duckdb:duckdb 631776443 644841390 0.98
clickbench_q17/duckdb:duckdb 544041717 569365170 0.96
clickbench_q18/duckdb:duckdb 1234897533 1232717676 1.00
clickbench_q19/duckdb:duckdb 34868347 37969062 0.92
clickbench_q20/duckdb:duckdb 🚀 909004979 1065228718 0.85
clickbench_q21/duckdb:duckdb 🚀 963053430 1070219220 0.90
clickbench_q22/duckdb:duckdb 1118280678 1051596012 1.06
clickbench_q23/duckdb:duckdb 252702311 259821083 0.97
clickbench_q24/duckdb:duckdb 60791185 64290290 0.95
clickbench_q25/duckdb:duckdb 143506310 147120418 0.98
clickbench_q26/duckdb:duckdb 59652711 61134168 0.98
clickbench_q27/duckdb:duckdb 🚀 1025074677 1204634610 0.85
clickbench_q28/duckdb:duckdb 4609036101 4688286117 0.98
clickbench_q29/duckdb:duckdb 47973975 52737118 0.91
clickbench_q30/duckdb:duckdb 264035586 260992252 1.01
clickbench_q31/duckdb:duckdb 439107886 427992187 1.03
clickbench_q32/duckdb:duckdb 1435724341 1504758043 0.95
clickbench_q33/duckdb:duckdb 🚀 1877161292 2123601441 0.88
clickbench_q34/duckdb:duckdb 2066010259 2237635559 0.92
clickbench_q35/duckdb:duckdb 282420246 287899066 0.98
clickbench_q36/duckdb:duckdb 🚀 40839684 46249536 0.88
clickbench_q37/duckdb:duckdb 🚀 30848375 34328096 0.90
clickbench_q38/duckdb:duckdb 🚀 31082386 34855035 0.89
clickbench_q39/duckdb:duckdb 65137358 68847767 0.95
clickbench_q40/duckdb:duckdb 🚀 30781695 34824142 0.88
clickbench_q41/duckdb:duckdb 30699435 33085489 0.93
clickbench_q42/duckdb:duckdb 🚀 30852388 35239903 0.88
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +0.7% -0.9% +1.6% +766.2% ➖ noise
0 duckdb:duckdb -8.5% -0.9% -7.6% +269.6% ➖ noise
0 duckdb:vortex-file-compressed -1.0% -0.9% -0.0% +356.7% ➖ noise
1 datafusion:vortex-file-compressed -1.7% -2.6% +0.9% +28.1% ➖ noise
1 duckdb:duckdb -9.5% -2.6% -7.0% +55.7% ➖ noise
1 duckdb:vortex-file-compressed -1.2% -2.6% +1.5% +18.2% ➖ noise
2 datafusion:vortex-file-compressed +8.2% -4.1% +12.8% +20.3% ➖ noise
2 duckdb:duckdb -8.7% -4.1% -4.9% +22.7% ➖ noise
2 duckdb:vortex-file-compressed -1.4% -4.1% +2.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +3.4% -3.0% +6.6% +163.7% ➖ noise
3 duckdb:duckdb -6.7% -3.0% -3.8% +52.4% ➖ noise
3 duckdb:vortex-file-compressed -0.8% -3.0% +2.3% +81.2% ➖ noise
4 datafusion:vortex-file-compressed -1.5% -1.7% +0.2% +10.0% ➖ noise
4 duckdb:duckdb -2.3% -1.7% -0.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -3.3% -1.7% -1.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.0% +1.0% -2.0% +10.0% ➖ noise
5 duckdb:duckdb -1.5% +1.0% -2.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.0% +1.0% -2.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.3% +1.0% -5.3% +42.6% ➖ noise
6 duckdb:duckdb -10.8% +1.0% -11.7% +31.2% ➖ noise
6 duckdb:vortex-file-compressed +0.3% +1.0% -0.7% +20.0% ➖ noise
7 datafusion:vortex-file-compressed -1.0% -0.7% -0.2% +12.8% ➖ noise
7 duckdb:duckdb -8.5% -0.7% -7.8% +14.8% ➖ noise
7 duckdb:vortex-file-compressed -1.7% -0.7% -1.0% +11.7% ➖ noise
8 datafusion:vortex-file-compressed -3.0% -2.1% -1.0% +10.0% ➖ noise
8 duckdb:duckdb +0.3% -2.1% +2.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.9% -2.1% +0.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.2% -1.1% +1.0% +10.0% ➖ noise
9 duckdb:duckdb +1.1% -1.1% +2.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.0% -1.1% +1.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.5% -0.9% -1.6% +11.3% ➖ noise
10 duckdb:duckdb -1.3% -0.9% -0.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.2% -0.9% +1.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.0% -2.1% +1.1% +10.0% ➖ noise
11 duckdb:duckdb -1.2% -2.1% +0.9% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -2.6% -2.1% -0.5% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.8% -0.9% +0.1% +10.0% ➖ noise
12 duckdb:duckdb +1.4% -0.9% +2.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +2.5% -0.9% +3.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.8% -1.2% -0.6% +10.0% ➖ noise
13 duckdb:duckdb -6.4% -1.2% -5.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -1.1% -1.2% +0.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.9% +0.3% -3.2% +10.0% ➖ noise
14 duckdb:duckdb -1.9% +0.3% -2.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +1.0% +0.3% +0.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.2% +0.4% -0.6% +10.0% ➖ noise
15 duckdb:duckdb +0.5% +0.4% +0.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.6% +0.4% -2.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -1.7% +0.7% -2.4% +10.0% ➖ noise
16 duckdb:duckdb -2.0% +0.7% -2.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.4% +0.7% +0.6% +17.2% ➖ noise
17 datafusion:vortex-file-compressed -1.2% -1.4% +0.3% +10.0% ➖ noise
17 duckdb:duckdb -4.4% -1.4% -3.1% +12.3% ➖ noise
17 duckdb:vortex-file-compressed +0.2% -1.4% +1.7% +20.5% ➖ noise
18 datafusion:vortex-file-compressed -2.5% -1.3% -1.2% +10.0% ➖ noise
18 duckdb:duckdb +0.2% -1.3% +1.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +3.7% -1.3% +5.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -16.1% -0.7% -15.6% +22.4% ➖ noise
19 duckdb:duckdb -8.2% -0.7% -7.5% +11.9% ➖ noise
19 duckdb:vortex-file-compressed -2.9% -0.7% -2.2% +26.7% ➖ noise
20 datafusion:vortex-file-compressed +0.5% -1.1% +1.7% +196.9% ➖ noise
20 duckdb:duckdb -14.7% -1.1% -13.7% +26.2% ➖ noise
20 duckdb:vortex-file-compressed +7.9% -1.1% +9.2% +13.6% ➖ noise
21 datafusion:vortex-file-compressed -0.3% -0.4% +0.1% +10.0% ➖ noise
21 duckdb:duckdb -10.0% -0.4% -9.7% +10.0% ✅ faster
21 duckdb:vortex-file-compressed -0.3% -0.4% +0.1% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.5% -1.0% +1.5% +11.1% ➖ noise
22 duckdb:duckdb +6.3% -1.0% +7.4% +15.8% ➖ noise
22 duckdb:vortex-file-compressed +14.0% -1.0% +15.2% +12.1% 🚨 regression
23 datafusion:vortex-file-compressed +15.1% -2.6% +18.1% +41.9% ➖ noise
23 duckdb:duckdb -2.7% -2.6% -0.2% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -3.2% -2.6% -0.6% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -1.6% -1.5% -0.0% +19.8% ➖ noise
24 duckdb:duckdb -5.4% -1.5% -4.0% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -21.7% -1.5% -20.4% +23.1% ✅ faster
25 datafusion:vortex-file-compressed -6.2% -0.3% -5.9% +14.4% ➖ noise
25 duckdb:duckdb -2.5% -0.3% -2.2% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +4.8% -0.3% +5.1% +13.2% ➖ noise
26 datafusion:vortex-file-compressed -10.8% -2.8% -8.2% +14.2% ➖ noise
26 duckdb:duckdb -2.4% -2.8% +0.4% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -14.9% -2.8% -12.5% +22.8% ➖ noise
27 datafusion:vortex-file-compressed -0.6% -0.8% +0.1% +10.0% ➖ noise
27 duckdb:duckdb -14.9% -0.8% -14.2% +10.0% ✅ faster
27 duckdb:vortex-file-compressed +0.1% -0.8% +0.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.0% -0.4% +1.4% +10.0% ➖ noise
28 duckdb:duckdb -1.7% -0.4% -1.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.5% -0.4% -0.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -4.4% +1.0% -5.4% +10.3% ➖ noise
29 duckdb:duckdb -9.0% +1.0% -9.9% +10.0% ✅ faster
29 duckdb:vortex-file-compressed -2.1% +1.0% -3.1% +13.4% ➖ noise
30 datafusion:vortex-file-compressed -0.6% -0.2% -0.4% +10.0% ➖ noise
30 duckdb:duckdb +1.2% -0.2% +1.4% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +1.7% -0.2% +1.9% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.2% -0.3% +0.1% +10.0% ➖ noise
31 duckdb:duckdb +2.6% -0.3% +2.9% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -2.0% -0.3% -1.7% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +14.9% +0.4% +14.4% +20.1% ➖ noise
32 duckdb:duckdb -4.6% +0.4% -5.0% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -2.4% +0.4% -2.8% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +0.4% -1.7% +2.1% +10.0% ➖ noise
33 duckdb:duckdb -11.6% -1.7% -10.1% +10.0% ✅ faster
33 duckdb:vortex-file-compressed +17.7% -1.7% +19.7% +10.4% 🚨 regression
34 datafusion:vortex-file-compressed -1.6% -1.6% -0.0% +10.0% ➖ noise
34 duckdb:duckdb -7.7% -1.6% -6.2% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +14.5% -1.6% +16.3% +10.0% 🚨 regression
35 datafusion:vortex-file-compressed -0.3% -0.4% +0.1% +10.0% ➖ noise
35 duckdb:duckdb -1.9% -0.4% -1.5% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.0% -0.4% +0.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +2.2% -1.6% +3.9% +13.0% ➖ noise
36 duckdb:duckdb -11.7% -1.6% -10.2% +14.3% ➖ noise
36 duckdb:vortex-file-compressed +4.1% -1.6% +5.8% +14.1% ➖ noise
37 datafusion:vortex-file-compressed -1.7% -3.3% +1.7% +10.0% ➖ noise
37 duckdb:duckdb -10.1% -3.3% -7.1% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -2.5% -3.3% +0.8% +19.1% ➖ noise
38 datafusion:vortex-file-compressed -7.2% -8.1% +0.9% +11.4% ➖ noise
38 duckdb:duckdb -10.8% -8.1% -3.0% +11.8% ➖ noise
38 duckdb:vortex-file-compressed +3.3% -8.1% +12.3% +12.6% ➖ noise
39 datafusion:vortex-file-compressed -8.6% +3.2% -11.5% +10.0% ✅ faster
39 duckdb:duckdb -5.4% +3.2% -8.4% +10.0% ➖ noise
39 duckdb:vortex-file-compressed -2.1% +3.2% -5.2% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +3.3% -6.0% +10.0% +14.7% ➖ noise
40 duckdb:duckdb -11.6% -6.0% -5.9% +12.4% ➖ noise
40 duckdb:vortex-file-compressed -3.9% -6.0% +2.3% +11.5% ➖ noise
41 datafusion:vortex-file-compressed -11.3% -1.9% -9.5% +15.4% ➖ noise
41 duckdb:duckdb -7.2% -1.9% -5.4% +10.1% ➖ noise
41 duckdb:vortex-file-compressed -5.1% -1.9% -3.2% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -4.6% +1.3% -5.9% +10.0% ➖ noise
42 duckdb:duckdb -12.5% +1.3% -13.6% +10.0% ✅ faster
42 duckdb:vortex-file-compressed +1.2% +1.3% -0.1% +22.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.6%
Vortex (geomean): 0.994x ➖
Parquet (geomean): 1.020x ➖
Shifts: Parquet (control) +2.0% · Median polish +2.3%


datafusion / vortex-file-compressed (1.004x ➖, 3↑ 3↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 421871576 222038154 1.90
tpch_q02/datafusion:vortex-file-compressed 🚨 648575949 469736879 1.38
tpch_q03/datafusion:vortex-file-compressed 410541621 383517031 1.07
tpch_q04/datafusion:vortex-file-compressed 263816453 222172264 1.19
tpch_q05/datafusion:vortex-file-compressed 522342810 545000143 0.96
tpch_q06/datafusion:vortex-file-compressed 291596651 380553601 0.77
tpch_q07/datafusion:vortex-file-compressed 🚀 366625460 606910043 0.60
tpch_q08/datafusion:vortex-file-compressed 585396408 683277187 0.86
tpch_q09/datafusion:vortex-file-compressed 419167977 529867791 0.79
tpch_q10/datafusion:vortex-file-compressed 503451442 571952835 0.88
tpch_q11/datafusion:vortex-file-compressed 🚀 279263577 403863418 0.69
tpch_q12/datafusion:vortex-file-compressed 364500387 441718116 0.83
tpch_q13/datafusion:vortex-file-compressed 153835460 157346497 0.98
tpch_q14/datafusion:vortex-file-compressed 🚀 164482900 262485696 0.63
tpch_q15/datafusion:vortex-file-compressed 394551087 356771124 1.11
tpch_q16/datafusion:vortex-file-compressed 210372519 203298523 1.03
tpch_q17/datafusion:vortex-file-compressed 536916843 427835099 1.25
tpch_q18/datafusion:vortex-file-compressed 492121351 399799954 1.23
tpch_q19/datafusion:vortex-file-compressed 525736256 529284762 0.99
tpch_q20/datafusion:vortex-file-compressed 466702850 392116890 1.19
tpch_q21/datafusion:vortex-file-compressed 🚨 605911620 443395345 1.37
tpch_q22/datafusion:vortex-file-compressed 207838637 166913543 1.25
datafusion / vortex-compact (0.993x ➖, 1↑ 2↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 252338945 248700101 1.01
tpch_q02/datafusion:vortex-compact 468648911 422772626 1.11
tpch_q03/datafusion:vortex-compact 407733934 416593895 0.98
tpch_q04/datafusion:vortex-compact 267014746 278223379 0.96
tpch_q05/datafusion:vortex-compact 421797671 450283470 0.94
tpch_q06/datafusion:vortex-compact 386528258 389917428 0.99
tpch_q07/datafusion:vortex-compact 425548350 480791263 0.89
tpch_q08/datafusion:vortex-compact 576631798 551206818 1.05
tpch_q09/datafusion:vortex-compact 466761584 406333871 1.15
tpch_q10/datafusion:vortex-compact 🚨 607072866 462425299 1.31
tpch_q11/datafusion:vortex-compact 334373219 323096883 1.03
tpch_q12/datafusion:vortex-compact 474873784 596092816 0.80
tpch_q13/datafusion:vortex-compact 152708313 195075920 0.78
tpch_q14/datafusion:vortex-compact 278545310 394658892 0.71
tpch_q15/datafusion:vortex-compact 🚀 494992559 720424764 0.69
tpch_q16/datafusion:vortex-compact 196080620 209731952 0.93
tpch_q17/datafusion:vortex-compact 521338398 420368404 1.24
tpch_q18/datafusion:vortex-compact 390976897 356906528 1.10
tpch_q19/datafusion:vortex-compact 629826667 616622537 1.02
tpch_q20/datafusion:vortex-compact 517840848 552033034 0.94
tpch_q21/datafusion:vortex-compact 646079208 626967966 1.03
tpch_q22/datafusion:vortex-compact 🚨 286651020 180183872 1.59
datafusion / parquet (1.037x ➖, 0↑ 2↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 233702053 238875126 0.98
tpch_q02/datafusion:parquet 423033100 411047296 1.03
tpch_q03/datafusion:parquet 316694175 313273176 1.01
tpch_q04/datafusion:parquet 195267127 188105161 1.04
tpch_q05/datafusion:parquet 601998396 486147440 1.24
tpch_q06/datafusion:parquet 🚨 223052926 166864844 1.34
tpch_q07/datafusion:parquet 690036006 581238729 1.19
tpch_q08/datafusion:parquet 696525876 947031810 0.74
tpch_q09/datafusion:parquet 475053067 538022860 0.88
tpch_q10/datafusion:parquet 579278976 519744086 1.11
tpch_q11/datafusion:parquet 392314071 340332767 1.15
tpch_q12/datafusion:parquet 318484625 252984828 1.26
tpch_q13/datafusion:parquet 477434544 433730375 1.10
tpch_q14/datafusion:parquet 209000490 220313667 0.95
tpch_q15/datafusion:parquet 340497737 340599847 1.00
tpch_q16/datafusion:parquet 205095220 183989280 1.11
tpch_q17/datafusion:parquet 458396651 481387202 0.95
tpch_q18/datafusion:parquet 467697695 555526525 0.84
tpch_q19/datafusion:parquet 🚨 487382776 370301385 1.32
tpch_q20/datafusion:parquet 443281792 357078777 1.24
tpch_q21/datafusion:parquet 585524589 633010305 0.92
tpch_q22/datafusion:parquet 163734315 224053225 0.73
duckdb / vortex-file-compressed (0.987x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 253467353 277452088 0.91
tpch_q02/duckdb:vortex-file-compressed 992112082 983328400 1.01
tpch_q03/duckdb:vortex-file-compressed 651025575 658185563 0.99
tpch_q04/duckdb:vortex-file-compressed 388617095 505017449 0.77
tpch_q05/duckdb:vortex-file-compressed 904244015 841449258 1.07
tpch_q06/duckdb:vortex-file-compressed 443308303 406109759 1.09
tpch_q07/duckdb:vortex-file-compressed 769658964 746621979 1.03
tpch_q08/duckdb:vortex-file-compressed 1029705404 1044574717 0.99
tpch_q09/duckdb:vortex-file-compressed 900725938 884159660 1.02
tpch_q10/duckdb:vortex-file-compressed 770704885 760425984 1.01
tpch_q11/duckdb:vortex-file-compressed 498702094 542644199 0.92
tpch_q12/duckdb:vortex-file-compressed 551612877 483624107 1.14
tpch_q13/duckdb:vortex-file-compressed 479352501 521130570 0.92
tpch_q14/duckdb:vortex-file-compressed 497053151 540798141 0.92
tpch_q15/duckdb:vortex-file-compressed 291594422 273872853 1.06
tpch_q16/duckdb:vortex-file-compressed 362991812 366238756 0.99
tpch_q17/duckdb:vortex-file-compressed 718701574 758979783 0.95
tpch_q18/duckdb:vortex-file-compressed 586334929 608345619 0.96
tpch_q19/duckdb:vortex-file-compressed 467038248 475848072 0.98
tpch_q20/duckdb:vortex-file-compressed 815529580 888060206 0.92
tpch_q21/duckdb:vortex-file-compressed 1142231850 1042167530 1.10
tpch_q22/duckdb:vortex-file-compressed 377872717 370430769 1.02
duckdb / vortex-compact (0.991x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 313721206 306385735 1.02
tpch_q02/duckdb:vortex-compact 898407328 939936344 0.96
tpch_q03/duckdb:vortex-compact 638087514 573154932 1.11
tpch_q04/duckdb:vortex-compact 352397402 379924191 0.93
tpch_q05/duckdb:vortex-compact 825720926 940766911 0.88
tpch_q06/duckdb:vortex-compact 430331550 366216509 1.18
tpch_q07/duckdb:vortex-compact 755732763 796013429 0.95
tpch_q08/duckdb:vortex-compact 937604111 977409329 0.96
tpch_q09/duckdb:vortex-compact 906064793 877993089 1.03
tpch_q10/duckdb:vortex-compact 724777234 704964046 1.03
tpch_q11/duckdb:vortex-compact 511426304 483687956 1.06
tpch_q12/duckdb:vortex-compact 461710379 451590193 1.02
tpch_q13/duckdb:vortex-compact 459976769 486440506 0.95
tpch_q14/duckdb:vortex-compact 481164723 625698538 0.77
tpch_q15/duckdb:vortex-compact 322742200 311052190 1.04
tpch_q16/duckdb:vortex-compact 361336382 359438181 1.01
tpch_q17/duckdb:vortex-compact 725888619 716172129 1.01
tpch_q18/duckdb:vortex-compact 503551309 479950912 1.05
tpch_q19/duckdb:vortex-compact 508103315 423571664 1.20
tpch_q20/duckdb:vortex-compact 730290199 798777079 0.91
tpch_q21/duckdb:vortex-compact 1092891838 1081980435 1.01
tpch_q22/duckdb:vortex-compact 320817739 382841748 0.84
duckdb / parquet (1.003x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 498918638 404684628 1.23
tpch_q02/duckdb:parquet 1373732774 1224059243 1.12
tpch_q03/duckdb:parquet 1073556619 993691791 1.08
tpch_q04/duckdb:parquet 708186948 648080836 1.09
tpch_q05/duckdb:parquet 1430725784 1713479937 0.83
tpch_q06/duckdb:parquet 400484180 441155417 0.91
tpch_q07/duckdb:parquet 1274449332 1283486265 0.99
tpch_q08/duckdb:parquet 1817714305 1853521253 0.98
tpch_q09/duckdb:parquet 1634698026 1475676912 1.11
tpch_q10/duckdb:parquet 1493799228 1338757033 1.12
tpch_q11/duckdb:parquet 899301936 874593815 1.03
tpch_q12/duckdb:parquet 751710192 917753977 0.82
tpch_q13/duckdb:parquet 888746400 892244449 1.00
tpch_q14/duckdb:parquet 725647042 634974445 1.14
tpch_q15/duckdb:parquet 476122964 555685752 0.86
tpch_q16/duckdb:parquet 587902298 637446452 0.92
tpch_q17/duckdb:parquet 817315934 747529334 1.09
tpch_q18/duckdb:parquet 900461779 900150420 1.00
tpch_q19/duckdb:parquet 785466310 834129777 0.94
tpch_q20/duckdb:parquet 1101483559 1098146543 1.00
tpch_q21/duckdb:parquet 1173428177 1176223361 1.00
tpch_q22/duckdb:parquet 581373493 635727863 0.91
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.5% +9.8% -7.6% +70.8% ➖ noise
1 datafusion:vortex-file-compressed +90.0% +9.8% +73.0% +77.4% ➖ noise
1 duckdb:vortex-compact +2.4% +9.8% -6.8% +48.6% ➖ noise
1 duckdb:vortex-file-compressed -8.6% +9.8% -16.8% +44.3% ➖ noise
2 datafusion:vortex-compact +10.9% +7.5% +3.1% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +38.1% +7.5% +28.5% +40.1% ➖ noise
2 duckdb:vortex-compact -4.4% +7.5% -11.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +0.9% +7.5% -6.1% +30.0% ➖ noise
3 datafusion:vortex-compact -2.1% +4.5% -6.3% +49.7% ➖ noise
3 datafusion:vortex-file-compressed +7.0% +4.5% +2.4% +63.4% ➖ noise
3 duckdb:vortex-compact +11.3% +4.5% +6.5% +35.3% ➖ noise
3 duckdb:vortex-file-compressed -1.1% +4.5% -5.4% +36.2% ➖ noise
4 datafusion:vortex-compact -4.0% +6.5% -9.9% +32.6% ➖ noise
4 datafusion:vortex-file-compressed +18.7% +6.5% +11.5% +35.9% ➖ noise
4 duckdb:vortex-compact -7.2% +6.5% -12.9% +37.9% ➖ noise
4 duckdb:vortex-file-compressed -23.0% +6.5% -27.7% +35.7% ✅ faster
5 datafusion:vortex-compact -6.3% +1.7% -7.9% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -4.2% +1.7% -5.7% +30.9% ➖ noise
5 duckdb:vortex-compact -12.2% +1.7% -13.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +7.5% +1.7% +5.7% +30.0% ➖ noise
6 datafusion:vortex-compact -0.9% +10.2% -10.0% +32.0% ➖ noise
6 datafusion:vortex-file-compressed -23.4% +10.2% -30.4% +30.0% ✅ faster
6 duckdb:vortex-compact +17.5% +10.2% +6.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +9.2% +10.2% -0.9% +30.0% ➖ noise
7 datafusion:vortex-compact -11.5% +8.6% -18.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -39.6% +8.6% -44.4% +32.6% ✅ faster
7 duckdb:vortex-compact -5.1% +8.6% -12.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +3.1% +8.6% -5.1% +30.0% ➖ noise
8 datafusion:vortex-compact +4.6% -15.1% +23.2% +32.9% ➖ noise
8 datafusion:vortex-file-compressed -14.3% -15.1% +0.9% +31.3% ➖ noise
8 duckdb:vortex-compact -4.1% -15.1% +13.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -1.4% -15.1% +16.1% +30.0% ➖ noise
9 datafusion:vortex-compact +14.9% -1.1% +16.1% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -20.9% -1.1% -20.0% +30.0% ➖ noise
9 duckdb:vortex-compact +3.2% -1.1% +4.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +1.9% -1.1% +3.0% +30.0% ➖ noise
10 datafusion:vortex-compact +31.3% +11.5% +17.7% +41.0% ➖ noise
10 datafusion:vortex-file-compressed -12.0% +11.5% -21.1% +33.6% ➖ noise
10 duckdb:vortex-compact +2.8% +11.5% -7.8% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +1.4% +11.5% -9.1% +30.0% ➖ noise
11 datafusion:vortex-compact +3.5% +8.9% -4.9% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -30.9% +8.9% -36.5% +30.0% ✅ faster
11 duckdb:vortex-compact +5.7% +8.9% -2.9% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -8.1% +8.9% -15.6% +30.0% ➖ noise
12 datafusion:vortex-compact -20.3% +1.5% -21.5% +30.6% ➖ noise
12 datafusion:vortex-file-compressed -17.5% +1.5% -18.7% +35.2% ➖ noise
12 duckdb:vortex-compact +2.2% +1.5% +0.7% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +14.1% +1.5% +12.3% +32.5% ➖ noise
13 datafusion:vortex-compact -21.7% +4.7% -25.2% +52.7% ➖ noise
13 datafusion:vortex-file-compressed -2.2% +4.7% -6.6% +40.4% ➖ noise
13 duckdb:vortex-compact -5.4% +4.7% -9.7% +46.3% ➖ noise
13 duckdb:vortex-file-compressed -8.0% +4.7% -12.2% +34.6% ➖ noise
14 datafusion:vortex-compact -29.4% +4.1% -32.2% +31.0% ✅ faster
14 datafusion:vortex-file-compressed -37.3% +4.1% -39.8% +30.0% ✅ faster
14 duckdb:vortex-compact -23.1% +4.1% -26.1% +30.0% ✅ faster
14 duckdb:vortex-file-compressed -8.1% +4.1% -11.7% +30.0% ➖ noise
15 datafusion:vortex-compact -31.3% -7.4% -25.8% +35.2% ➖ noise
15 datafusion:vortex-file-compressed +10.6% -7.4% +19.5% +37.4% ➖ noise
15 duckdb:vortex-compact +3.8% -7.4% +12.1% +37.0% ➖ noise
15 duckdb:vortex-file-compressed +6.5% -7.4% +15.0% +30.0% ➖ noise
16 datafusion:vortex-compact -6.5% +1.4% -7.8% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +3.5% +1.4% +2.1% +30.0% ➖ noise
16 duckdb:vortex-compact +0.5% +1.4% -0.9% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -0.9% +1.4% -2.2% +30.0% ➖ noise
17 datafusion:vortex-compact +24.0% +2.0% +21.5% +39.0% ➖ noise
17 datafusion:vortex-file-compressed +25.5% +2.0% +23.0% +37.2% ➖ noise
17 duckdb:vortex-compact +1.4% +2.0% -0.7% +30.3% ➖ noise
17 duckdb:vortex-file-compressed -5.3% +2.0% -7.2% +34.2% ➖ noise
18 datafusion:vortex-compact +9.5% -8.2% +19.4% +32.1% ➖ noise
18 datafusion:vortex-file-compressed +23.1% -8.2% +34.1% +33.2% 🚨 regression
18 duckdb:vortex-compact +4.9% -8.2% +14.3% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -3.6% -8.2% +5.0% +30.0% ➖ noise
19 datafusion:vortex-compact +2.1% +11.3% -8.3% +32.1% ➖ noise
19 datafusion:vortex-file-compressed -0.7% +11.3% -10.8% +41.2% ➖ noise
19 duckdb:vortex-compact +20.0% +11.3% +7.8% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -1.9% +11.3% -11.8% +30.0% ➖ noise
20 datafusion:vortex-compact -6.2% +11.6% -15.9% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +19.0% +11.6% +6.7% +30.0% ➖ noise
20 duckdb:vortex-compact -8.6% +11.6% -18.1% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -8.2% +11.6% -17.7% +30.0% ➖ noise
21 datafusion:vortex-compact +3.0% -3.9% +7.3% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +36.7% -3.9% +42.3% +30.0% 🚨 regression
21 duckdb:vortex-compact +1.0% -3.9% +5.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +9.6% -3.9% +14.1% +30.0% ➖ noise
22 datafusion:vortex-compact +59.1% -18.3% +94.6% +38.5% 🚨 regression
22 datafusion:vortex-file-compressed +24.5% -18.3% +52.3% +30.0% 🚨 regression
22 duckdb:vortex-compact -16.2% -18.3% +2.5% +33.0% ➖ noise
22 duckdb:vortex-file-compressed +2.0% -18.3% +24.8% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.009x ➖
Parquet (geomean): 1.005x ➖


unknown / unknown (1.007x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
compress time/Arade 1246235695 1171723909 1.06
compress time/Bimbo 7040691178 7058875539 1.00
compress time/CMSprovider 2938537453 2931874205 1.00
compress time/Euro2016 452286177 416816520 1.09
compress time/Food 371882461 391904667 0.95
compress time/HashTags 825987659 804322748 1.03
compress time/TPC-H l_comment canonical 1410108786 1310695560 1.08
compress time/TPC-H l_comment chunked 1420874472 1303005820 1.09
compress time/taxi 753473969 716777827 1.05
compress time/wide table cols=100 chunks=1 rows=1000 11757252 12992605 0.90
compress time/wide table cols=100 chunks=50 rows=1000 12920163 12634329 1.02
compress time/wide table cols=1000 chunks=1 rows=1000 134165144 135103572 0.99
compress time/wide table cols=1000 chunks=50 rows=1000 136761283 139933475 0.98
compress time/wide table cols=10000 chunks=1 rows=1000 1406233599 1417671732 0.99
compress time/wide table cols=10000 chunks=50 rows=1000 1417295749 1408684858 1.01
decompress time/Arade 31082921 31604882 0.98
decompress time/Bimbo 100370266 98521038 1.02
decompress time/CMSprovider 89384707 86378786 1.03
decompress time/Euro2016 20815698 21099887 0.99
decompress time/Food 10354507 10010841 1.03
decompress time/HashTags 81079212 81926635 0.99
decompress time/TPC-H l_comment canonical 44070580 40522509 1.09
decompress time/TPC-H l_comment chunked 44624753 40886262 1.09
decompress time/taxi 21539490 22147154 0.97
decompress time/wide table cols=100 chunks=1 rows=1000 2702711 2812508 0.96
decompress time/wide table cols=100 chunks=50 rows=1000 2732980 2703073 1.01
decompress time/wide table cols=1000 chunks=1 rows=1000 25449172 24475259 1.04
decompress time/wide table cols=1000 chunks=50 rows=1000 24918730 24491336 1.02
decompress time/wide table cols=10000 chunks=1 rows=1000 253184840 246905989 1.03
decompress time/wide table cols=10000 chunks=50 rows=1000 247953919 250237810 0.99
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3009274246 3030019091 0.99
parquet_rs-zstd compress time/Bimbo 17375522476 17061539661 1.02
parquet_rs-zstd compress time/CMSprovider 7758965881 7691092505 1.01
parquet_rs-zstd compress time/Euro2016 1345058303 1347894345 1.00
parquet_rs-zstd compress time/Food 937159917 927954541 1.01
parquet_rs-zstd compress time/HashTags 2472586686 2443589990 1.01
parquet_rs-zstd compress time/TPC-H l_comment canonical 3070549095 3117454469 0.98
parquet_rs-zstd compress time/TPC-H l_comment chunked 3092089021 3094922783 1.00
parquet_rs-zstd compress time/taxi 1502410903 1498253813 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6556899 6633598 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6558847 6671450 0.98
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 94187308 90715619 1.04
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 92586078 85805315 1.08
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 866626999 877614048 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 866319790 893786163 0.97
parquet_rs-zstd decompress time/Arade 648294993 641593374 1.01
parquet_rs-zstd decompress time/Bimbo 1725125592 1716374052 1.01
parquet_rs-zstd decompress time/CMSprovider 1939690692 1926620572 1.01
parquet_rs-zstd decompress time/Euro2016 385874355 388964304 0.99
parquet_rs-zstd decompress time/Food 220658546 219903205 1.00
parquet_rs-zstd decompress time/HashTags 633342969 635967688 1.00
parquet_rs-zstd decompress time/TPC-H l_comment canonical 562502312 568836312 0.99
parquet_rs-zstd decompress time/TPC-H l_comment chunked 558803213 562287868 0.99
parquet_rs-zstd decompress time/taxi 247869566 245271627 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2670099 2735566 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2650040 2715296 0.98
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31804687 32939138 0.97
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 31609337 32523027 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 366902884 373340892 0.98
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 367889801 376285240 0.98
vortex-file-compressed size/Arade 145363828 145363828 1.00
vortex-file-compressed size/Bimbo 468763364 468763364 1.00
vortex-file-compressed size/CMSprovider 417907844 417907844 1.00
vortex-file-compressed size/Euro2016 163395324 163599188 1.00
vortex-file-compressed size/Food 41926968 41926968 1.00
vortex-file-compressed size/HashTags 195647860 195647860 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087392 179087392 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087392 179087392 1.00
vortex-file-compressed size/taxi 52363980 52363980 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957680 92957680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957680 92957680 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.07
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.98
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.99
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.09
vortex:parquet-zstd ratio compress time/Food 0 0 0.94
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.09
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.09
vortex:parquet-zstd ratio compress time/taxi 0 0 1.05
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.92
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.96
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.91
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.97
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio decompress time/Food 0 0 1.03
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.99
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.10
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.10
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.08
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.01
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +9.5%
Vortex (geomean): 1.023x ➖
Parquet (geomean): 0.934x ➖
Shifts: Parquet (control) -6.6% · Median polish +1.2%


datafusion / vortex-file-compressed (1.001x ➖, 1↑ 1↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 719168536 694733480 1.04
tpch_q02/datafusion:vortex-file-compressed 1007344225 778675849 1.29
tpch_q03/datafusion:vortex-file-compressed 🚀 1015760592 1476964760 0.69
tpch_q04/datafusion:vortex-file-compressed 599309403 757623309 0.79
tpch_q05/datafusion:vortex-file-compressed 1153173196 1180110997 0.98
tpch_q06/datafusion:vortex-file-compressed 611520031 652820694 0.94
tpch_q07/datafusion:vortex-file-compressed 1153781546 1239903661 0.93
tpch_q08/datafusion:vortex-file-compressed 1146687751 1621544453 0.71
tpch_q09/datafusion:vortex-file-compressed 1417580569 1598645123 0.89
tpch_q10/datafusion:vortex-file-compressed 980892004 1076991465 0.91
tpch_q11/datafusion:vortex-file-compressed 548927508 604846530 0.91
tpch_q12/datafusion:vortex-file-compressed 1089341783 895187025 1.22
tpch_q13/datafusion:vortex-file-compressed 462239398 426995616 1.08
tpch_q14/datafusion:vortex-file-compressed 739043222 605415117 1.22
tpch_q15/datafusion:vortex-file-compressed 1321584489 1133951587 1.17
tpch_q16/datafusion:vortex-file-compressed 445745225 408711957 1.09
tpch_q17/datafusion:vortex-file-compressed 1145929740 1277036002 0.90
tpch_q18/datafusion:vortex-file-compressed 1270148606 1363859068 0.93
tpch_q19/datafusion:vortex-file-compressed 823259571 836300139 0.98
tpch_q20/datafusion:vortex-file-compressed 1210483703 1025289133 1.18
tpch_q21/datafusion:vortex-file-compressed 1992855115 1671174638 1.19
tpch_q22/datafusion:vortex-file-compressed 🚨 630689892 473423312 1.33
datafusion / vortex-compact (0.964x ➖, 1↑ 1↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 769516134 697190985 1.10
tpch_q02/datafusion:vortex-compact 886378935 834477466 1.06
tpch_q03/datafusion:vortex-compact 924231727 1158101256 0.80
tpch_q04/datafusion:vortex-compact 637510911 695266077 0.92
tpch_q05/datafusion:vortex-compact 1078122837 956694283 1.13
tpch_q06/datafusion:vortex-compact 707291745 613150633 1.15
tpch_q07/datafusion:vortex-compact 1268332100 1018992062 1.24
tpch_q08/datafusion:vortex-compact 1195977352 1356483661 0.88
tpch_q09/datafusion:vortex-compact 1283748183 1337576146 0.96
tpch_q10/datafusion:vortex-compact 🚨 1708607335 933338628 1.83
tpch_q11/datafusion:vortex-compact 598187458 562093362 1.06
tpch_q12/datafusion:vortex-compact 889196604 1204231088 0.74
tpch_q13/datafusion:vortex-compact 459964209 455974384 1.01
tpch_q14/datafusion:vortex-compact 595540457 735239303 0.81
tpch_q15/datafusion:vortex-compact 1074805482 1469634229 0.73
tpch_q16/datafusion:vortex-compact 🚀 355034928 732911486 0.48
tpch_q17/datafusion:vortex-compact 1459828620 1223045199 1.19
tpch_q18/datafusion:vortex-compact 1302649994 1188219078 1.10
tpch_q19/datafusion:vortex-compact 825341882 1151067595 0.72
tpch_q20/datafusion:vortex-compact 872229918 1101888528 0.79
tpch_q21/datafusion:vortex-compact 1658146753 1670635979 0.99
tpch_q22/datafusion:vortex-compact 608719443 488638109 1.25
datafusion / parquet (0.839x ➖, 3↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 801311108 828880643 0.97
tpch_q02/datafusion:parquet 643215409 827291253 0.78
tpch_q03/datafusion:parquet 966710689 1076621784 0.90
tpch_q04/datafusion:parquet 496813719 709311286 0.70
tpch_q05/datafusion:parquet 🚀 1179081033 2097896205 0.56
tpch_q06/datafusion:parquet 🚀 518984327 917378465 0.57
tpch_q07/datafusion:parquet 1255297182 1725585850 0.73
tpch_q08/datafusion:parquet 1588774570 1870552590 0.85
tpch_q09/datafusion:parquet 2155892123 2047294713 1.05
tpch_q10/datafusion:parquet 2592654287 3156715826 0.82
tpch_q11/datafusion:parquet 585489479 779493931 0.75
tpch_q12/datafusion:parquet 687081622 683990654 1.00
tpch_q13/datafusion:parquet 695585905 702341840 0.99
tpch_q14/datafusion:parquet 810237442 838549648 0.97
tpch_q15/datafusion:parquet 1376380342 1233799443 1.12
tpch_q16/datafusion:parquet 436766893 415041092 1.05
tpch_q17/datafusion:parquet 1536051533 1376854798 1.12
tpch_q18/datafusion:parquet 1531704992 1782182174 0.86
tpch_q19/datafusion:parquet 957034057 1292764564 0.74
tpch_q20/datafusion:parquet 1221799489 1661936069 0.74
tpch_q21/datafusion:parquet 1926700251 2253432283 0.86
tpch_q22/datafusion:parquet 🚀 810905901 1167118270 0.69
duckdb / vortex-file-compressed (1.039x ➖, 0↑ 1↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 673407135 646903509 1.04
tpch_q02/duckdb:vortex-file-compressed 1207449209 1182261745 1.02
tpch_q03/duckdb:vortex-file-compressed 1001368379 989889197 1.01
tpch_q04/duckdb:vortex-file-compressed 846405907 804824021 1.05
tpch_q05/duckdb:vortex-file-compressed 1109453797 1218190495 0.91
tpch_q06/duckdb:vortex-file-compressed 761784805 812516581 0.94
tpch_q07/duckdb:vortex-file-compressed 1232945995 1117503944 1.10
tpch_q08/duckdb:vortex-file-compressed 1541755954 1471597515 1.05
tpch_q09/duckdb:vortex-file-compressed 1531855302 1408565268 1.09
tpch_q10/duckdb:vortex-file-compressed 1128604797 1142996646 0.99
tpch_q11/duckdb:vortex-file-compressed 659670233 712615815 0.93
tpch_q12/duckdb:vortex-file-compressed 🚨 1660239290 715028101 2.32
tpch_q13/duckdb:vortex-file-compressed 909135970 953098135 0.95
tpch_q14/duckdb:vortex-file-compressed 849537782 856943458 0.99
tpch_q15/duckdb:vortex-file-compressed 580131215 537234880 1.08
tpch_q16/duckdb:vortex-file-compressed 469372440 488073741 0.96
tpch_q17/duckdb:vortex-file-compressed 964008905 1004654181 0.96
tpch_q18/duckdb:vortex-file-compressed 936359097 900369347 1.04
tpch_q19/duckdb:vortex-file-compressed 781135109 798816423 0.98
tpch_q20/duckdb:vortex-file-compressed 1221449795 1205690620 1.01
tpch_q21/duckdb:vortex-file-compressed 1975913961 2003474326 0.99
tpch_q22/duckdb:vortex-file-compressed 590702903 623258668 0.95
duckdb / vortex-compact (1.091x ➖, 0↑ 2↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 611428187 616480558 0.99
tpch_q02/duckdb:vortex-compact 1066590674 1042533385 1.02
tpch_q03/duckdb:vortex-compact 857698325 812400370 1.06
tpch_q04/duckdb:vortex-compact 🚨 816535578 511274130 1.60
tpch_q05/duckdb:vortex-compact 992527975 1041456949 0.95
tpch_q06/duckdb:vortex-compact 759824355 786744264 0.97
tpch_q07/duckdb:vortex-compact 1025071481 1013159579 1.01
tpch_q08/duckdb:vortex-compact 1404018005 1316720019 1.07
tpch_q09/duckdb:vortex-compact 1416703756 1341704903 1.06
tpch_q10/duckdb:vortex-compact 1107339053 1012674620 1.09
tpch_q11/duckdb:vortex-compact 731342465 634156820 1.15
tpch_q12/duckdb:vortex-compact 🚨 1682714740 775050574 2.17
tpch_q13/duckdb:vortex-compact 903793479 893794999 1.01
tpch_q14/duckdb:vortex-compact 869755820 875494448 0.99
tpch_q15/duckdb:vortex-compact 571961980 555056539 1.03
tpch_q16/duckdb:vortex-compact 481411378 433183508 1.11
tpch_q17/duckdb:vortex-compact 992138702 932560784 1.06
tpch_q18/duckdb:vortex-compact 751729495 794831067 0.95
tpch_q19/duckdb:vortex-compact 755328664 767844877 0.98
tpch_q20/duckdb:vortex-compact 1251914737 1166825534 1.07
tpch_q21/duckdb:vortex-compact 1877627232 1722446423 1.09
tpch_q22/duckdb:vortex-compact 668339632 637874709 1.05
duckdb / parquet (1.040x ➖, 0↑ 0↓)
name PR 632f898 (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 775784934 860472089 0.90
tpch_q02/duckdb:parquet 1528932401 1636559436 0.93
tpch_q03/duckdb:parquet 1801164877 1755187079 1.03
tpch_q04/duckdb:parquet 1080137797 1062290377 1.02
tpch_q05/duckdb:parquet 2227101781 2134884259 1.04
tpch_q06/duckdb:parquet 733205317 717193795 1.02
tpch_q07/duckdb:parquet 1868429075 1884825928 0.99
tpch_q08/duckdb:parquet 2796976587 2392130719 1.17
tpch_q09/duckdb:parquet 2711784865 2524677649 1.07
tpch_q10/duckdb:parquet 3366619449 3063830297 1.10
tpch_q11/duckdb:parquet 1101404440 1104838442 1.00
tpch_q12/duckdb:parquet 1160346378 1207285191 0.96
tpch_q13/duckdb:parquet 1342424962 1146144551 1.17
tpch_q14/duckdb:parquet 1354000462 1200471791 1.13
tpch_q15/duckdb:parquet 966648634 907029706 1.07
tpch_q16/duckdb:parquet 818882868 812537517 1.01
tpch_q17/duckdb:parquet 1277774031 1368832671 0.93
tpch_q18/duckdb:parquet 1529277347 1306996870 1.17
tpch_q19/duckdb:parquet 1444712225 1424535168 1.01
tpch_q20/duckdb:parquet 1878476253 1843833701 1.02
tpch_q21/duckdb:parquet 1991224778 1705882598 1.17
tpch_q22/duckdb:parquet 1116656205 1072583095 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +10.4% -6.6% +18.2% +44.7% ➖ noise
1 datafusion:vortex-file-compressed +3.5% -6.6% +10.9% +46.4% ➖ noise
1 duckdb:vortex-compact -0.8% -6.6% +6.2% +32.0% ➖ noise
1 duckdb:vortex-file-compressed +4.1% -6.6% +11.5% +32.0% ➖ noise
2 datafusion:vortex-compact +6.2% -14.8% +24.6% +40.6% ➖ noise
2 datafusion:vortex-file-compressed +29.4% -14.8% +51.8% +40.8% 🚨 regression
2 duckdb:vortex-compact +2.3% -14.8% +20.0% +32.0% ➖ noise
2 duckdb:vortex-file-compressed +2.1% -14.8% +19.8% +38.0% ➖ noise
3 datafusion:vortex-compact -20.2% -4.0% -16.9% +47.7% ➖ noise
3 datafusion:vortex-file-compressed -31.2% -4.0% -28.4% +94.9% ➖ noise
3 duckdb:vortex-compact +5.6% -4.0% +10.0% +36.5% ➖ noise
3 duckdb:vortex-file-compressed +1.2% -4.0% +5.4% +34.5% ➖ noise
4 datafusion:vortex-compact -8.3% -15.6% +8.7% +32.0% ➖ noise
4 datafusion:vortex-file-compressed -20.9% -15.6% -6.3% +32.0% ➖ noise
4 duckdb:vortex-compact +59.7% -15.6% +89.2% +32.0% 🚨 regression
4 duckdb:vortex-file-compressed +5.2% -15.6% +24.6% +32.0% ➖ noise
5 datafusion:vortex-compact +12.7% -23.4% +47.2% +32.0% 🚨 regression
5 datafusion:vortex-file-compressed -2.3% -23.4% +27.6% +32.0% ➖ noise
5 duckdb:vortex-compact -4.7% -23.4% +24.5% +32.0% ➖ noise
5 duckdb:vortex-file-compressed -8.9% -23.4% +18.9% +32.0% ➖ noise
6 datafusion:vortex-compact +15.4% -24.0% +51.7% +32.0% 🚨 regression
6 datafusion:vortex-file-compressed -6.3% -24.0% +23.2% +32.0% ➖ noise
6 duckdb:vortex-compact -3.4% -24.0% +27.0% +32.0% ➖ noise
6 duckdb:vortex-file-compressed -6.2% -24.0% +23.3% +32.0% ➖ noise
7 datafusion:vortex-compact +24.5% -15.1% +46.6% +32.0% 🚨 regression
7 datafusion:vortex-file-compressed -6.9% -15.1% +9.6% +32.0% ➖ noise
7 duckdb:vortex-compact +1.2% -15.1% +19.1% +32.0% ➖ noise
7 duckdb:vortex-file-compressed +10.3% -15.1% +29.9% +32.0% ➖ noise
8 datafusion:vortex-compact -11.8% -0.3% -11.5% +32.0% ➖ noise
8 datafusion:vortex-file-compressed -29.3% -0.3% -29.0% +32.0% ✅ faster
8 duckdb:vortex-compact +6.6% -0.3% +7.0% +32.0% ➖ noise
8 duckdb:vortex-file-compressed +4.8% -0.3% +5.1% +32.0% ➖ noise
9 datafusion:vortex-compact -4.0% +6.4% -9.8% +32.0% ➖ noise
9 datafusion:vortex-file-compressed -11.3% +6.4% -16.6% +32.0% ➖ noise
9 duckdb:vortex-compact +5.6% +6.4% -0.7% +32.0% ➖ noise
9 duckdb:vortex-file-compressed +8.8% +6.4% +2.3% +32.0% ➖ noise
10 datafusion:vortex-compact +83.1% -5.0% +92.7% +95.3% ➖ noise
10 datafusion:vortex-file-compressed -8.9% -5.0% -4.1% +32.6% ➖ noise
10 duckdb:vortex-compact +9.3% -5.0% +15.1% +32.0% ➖ noise
10 duckdb:vortex-file-compressed -1.3% -5.0% +3.9% +32.0% ➖ noise
11 datafusion:vortex-compact +6.4% -13.5% +23.0% +32.0% ➖ noise
11 datafusion:vortex-file-compressed -9.2% -13.5% +4.9% +32.0% ➖ noise
11 duckdb:vortex-compact +15.3% -13.5% +33.3% +32.0% 🚨 regression
11 duckdb:vortex-file-compressed -7.4% -13.5% +7.0% +32.0% ➖ noise
12 datafusion:vortex-compact -26.2% -1.7% -24.9% +32.0% ✅ faster
12 datafusion:vortex-file-compressed +21.7% -1.7% +23.8% +32.0% ➖ noise
12 duckdb:vortex-compact +117.1% -1.7% +121.0% +32.0% 🚨 regression
12 duckdb:vortex-file-compressed +132.2% -1.7% +136.3% +32.0% 🚨 regression
13 datafusion:vortex-compact +0.9% +7.7% -6.3% +32.0% ➖ noise
13 datafusion:vortex-file-compressed +8.3% +7.7% +0.5% +32.0% ➖ noise
13 duckdb:vortex-compact +1.1% +7.7% -6.1% +41.2% ➖ noise
13 duckdb:vortex-file-compressed -4.6% +7.7% -11.4% +42.8% ➖ noise
14 datafusion:vortex-compact -19.0% +4.4% -22.4% +32.0% ➖ noise
14 datafusion:vortex-file-compressed +22.1% +4.4% +16.9% +32.0% ➖ noise
14 duckdb:vortex-compact -0.7% +4.4% -4.8% +32.0% ➖ noise
14 duckdb:vortex-file-compressed -0.9% +4.4% -5.0% +32.0% ➖ noise
15 datafusion:vortex-compact -26.9% +9.0% -32.9% +32.0% ✅ faster
15 datafusion:vortex-file-compressed +16.5% +9.0% +6.9% +32.0% ➖ noise
15 duckdb:vortex-compact +3.0% +9.0% -5.5% +32.0% ➖ noise
15 duckdb:vortex-file-compressed +8.0% +9.0% -1.0% +32.0% ➖ noise
16 datafusion:vortex-compact -51.6% +3.0% -53.0% +40.6% ✅ faster
16 datafusion:vortex-file-compressed +9.1% +3.0% +5.9% +32.0% ➖ noise
16 duckdb:vortex-compact +11.1% +3.0% +7.9% +32.0% ➖ noise
16 duckdb:vortex-file-compressed -3.8% +3.0% -6.6% +32.0% ➖ noise
17 datafusion:vortex-compact +19.4% +2.0% +17.0% +32.0% ➖ noise
17 datafusion:vortex-file-compressed -10.3% +2.0% -12.1% +32.0% ➖ noise
17 duckdb:vortex-compact +6.4% +2.0% +4.3% +32.0% ➖ noise
17 duckdb:vortex-file-compressed -4.0% +2.0% -6.0% +32.0% ➖ noise
18 datafusion:vortex-compact +9.6% +0.3% +9.3% +32.0% ➖ noise
18 datafusion:vortex-file-compressed -6.9% +0.3% -7.1% +32.0% ➖ noise
18 duckdb:vortex-compact -5.4% +0.3% -5.7% +32.0% ➖ noise
18 duckdb:vortex-file-compressed +4.0% +0.3% +3.7% +32.0% ➖ noise
19 datafusion:vortex-compact -28.3% -13.4% -17.2% +32.0% ➖ noise
19 datafusion:vortex-file-compressed -1.6% -13.4% +13.6% +32.0% ➖ noise
19 duckdb:vortex-compact -1.6% -13.4% +13.5% +32.0% ➖ noise
19 duckdb:vortex-file-compressed -2.2% -13.4% +12.9% +32.0% ➖ noise
20 datafusion:vortex-compact -20.8% -13.5% -8.5% +32.0% ➖ noise
20 datafusion:vortex-file-compressed +18.1% -13.5% +36.4% +32.0% 🚨 regression
20 duckdb:vortex-compact +7.3% -13.5% +24.0% +32.0% ➖ noise
20 duckdb:vortex-file-compressed +1.3% -13.5% +17.1% +32.0% ➖ noise
21 datafusion:vortex-compact -0.7% -0.1% -0.6% +32.0% ➖ noise
21 datafusion:vortex-file-compressed +19.2% -0.1% +19.4% +32.0% ➖ noise
21 duckdb:vortex-compact +9.0% -0.1% +9.1% +32.0% ➖ noise
21 duckdb:vortex-file-compressed -1.4% -0.1% -1.3% +32.0% ➖ noise
22 datafusion:vortex-compact +24.6% -15.0% +46.5% +49.8% ➖ noise
22 datafusion:vortex-file-compressed +33.2% -15.0% +56.6% +33.8% 🚨 regression
22 duckdb:vortex-compact +4.8% -15.0% +23.2% +32.0% ➖ noise
22 duckdb:vortex-file-compressed -5.2% -15.0% +11.4% +32.0% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/skip Do not list PR in the changelog

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants