Skip to content

Potentially better FSST estimation#7611

Draft
connortsui20 wants to merge 3 commits intodevelopfrom
ct/fsst-estimate
Draft

Potentially better FSST estimation#7611
connortsui20 wants to merge 3 commits intodevelopfrom
ct/fsst-estimate

Conversation

@connortsui20
Copy link
Copy Markdown
Contributor

Summary

Tracking issue: #7216

API Changes

TODO maybe?

Testing

Benchmarks run.

Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20 connortsui20 added changelog/performance A performance improvement action/benchmark Trigger full benchmarks to run on this PR labels Apr 23, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done b06abf9 1 Explore Profiling Data
Previous Runs (3)
Status Commit Job Attempt Link
🟢 Done 9823b45 1 Explore Profiling Data
🟢 Done d9a6ec5 1 Explore Profiling Data
🟢 Done c1994ab 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.976x ➖


datafusion / vortex-file-compressed (0.976x ➖, 1↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 116718860 125131673 0.93
polarsignals_q01/datafusion:vortex-file-compressed 🚀 259496255 293085429 0.89
polarsignals_q02/datafusion:vortex-file-compressed 23705354 23525338 1.01
polarsignals_q03/datafusion:vortex-file-compressed 278881226 272502696 1.02
polarsignals_q04/datafusion:vortex-file-compressed 12515627 12335713 1.01
polarsignals_q05/datafusion:vortex-file-compressed 15562949 16249041 0.96
polarsignals_q06/datafusion:vortex-file-compressed 19497984 19590285 1.00
polarsignals_q07/datafusion:vortex-file-compressed 14071208 14075419 1.00
polarsignals_q08/datafusion:vortex-file-compressed 362554032 372001396 0.97
polarsignals_q09/datafusion:vortex-file-compressed 10942031 11239549 0.97

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: PolarSignals Profiling

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 689.41 MB 689.71 MB +297.55 KB +0.0%

Totals:

  • vortex-file-compressed: 689.41 MB → 689.71 MB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.6%
Vortex (geomean): 0.970x ➖
Parquet (geomean): 0.949x ➖
Shifts: Parquet (control) -5.1% · Median polish -2.9%


datafusion / vortex-file-compressed (0.952x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49392215 52388845 0.94
tpch_q02/datafusion:vortex-file-compressed 27886282 29430905 0.95
tpch_q03/datafusion:vortex-file-compressed 28895876 30885047 0.94
tpch_q04/datafusion:vortex-file-compressed 21216026 21945465 0.97
tpch_q05/datafusion:vortex-file-compressed 49314618 52994416 0.93
tpch_q06/datafusion:vortex-file-compressed 13209718 13542340 0.98
tpch_q07/datafusion:vortex-file-compressed 60894365 64943021 0.94
tpch_q08/datafusion:vortex-file-compressed 40772162 43809182 0.93
tpch_q09/datafusion:vortex-file-compressed 54652049 56601352 0.97
tpch_q10/datafusion:vortex-file-compressed 44111991 45427159 0.97
tpch_q11/datafusion:vortex-file-compressed 15831243 17042270 0.93
tpch_q12/datafusion:vortex-file-compressed 26040475 27456459 0.95
tpch_q13/datafusion:vortex-file-compressed 25003805 25642329 0.98
tpch_q14/datafusion:vortex-file-compressed 17268262 17968281 0.96
tpch_q15/datafusion:vortex-file-compressed 28170295 28799367 0.98
tpch_q16/datafusion:vortex-file-compressed 20559822 22483062 0.91
tpch_q17/datafusion:vortex-file-compressed 67983509 71231323 0.95
tpch_q18/datafusion:vortex-file-compressed 80725657 85292863 0.95
tpch_q19/datafusion:vortex-file-compressed 24738477 25052164 0.99
tpch_q20/datafusion:vortex-file-compressed 30424411 32013859 0.95
tpch_q21/datafusion:vortex-file-compressed 75430439 79903669 0.94
tpch_q22/datafusion:vortex-file-compressed 14604200 15306430 0.95
datafusion / vortex-compact (0.961x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59458844 59606664 1.00
tpch_q02/datafusion:vortex-compact 31116874 32325199 0.96
tpch_q03/datafusion:vortex-compact 30692794 32071044 0.96
tpch_q04/datafusion:vortex-compact 23940473 25247793 0.95
tpch_q05/datafusion:vortex-compact 52792567 55767687 0.95
tpch_q06/datafusion:vortex-compact 14649369 15741774 0.93
tpch_q07/datafusion:vortex-compact 66696400 68423249 0.97
tpch_q08/datafusion:vortex-compact 45898466 47830259 0.96
tpch_q09/datafusion:vortex-compact 59459874 62540581 0.95
tpch_q10/datafusion:vortex-compact 50146658 51530440 0.97
tpch_q11/datafusion:vortex-compact 17148532 18228328 0.94
tpch_q12/datafusion:vortex-compact 33207474 34738315 0.96
tpch_q13/datafusion:vortex-compact 31727255 33037121 0.96
tpch_q14/datafusion:vortex-compact 21058153 20548629 1.02
tpch_q15/datafusion:vortex-compact 33173268 34405105 0.96
tpch_q16/datafusion:vortex-compact 25067451 25962098 0.97
tpch_q17/datafusion:vortex-compact 70443591 73168569 0.96
tpch_q18/datafusion:vortex-compact 85795373 88465899 0.97
tpch_q19/datafusion:vortex-compact 31554698 32396108 0.97
tpch_q20/datafusion:vortex-compact 34189286 36491304 0.94
tpch_q21/datafusion:vortex-compact 83521459 86315040 0.97
tpch_q22/datafusion:vortex-compact 15293664 16503404 0.93
datafusion / parquet (0.963x ➖, 3↑ 1↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 105175402 113562814 0.93
tpch_q02/datafusion:parquet 62349222 63983507 0.97
tpch_q03/datafusion:parquet 73901381 74737353 0.99
tpch_q04/datafusion:parquet 46532210 45820635 1.02
tpch_q05/datafusion:parquet 95520484 95620645 1.00
tpch_q06/datafusion:parquet 41241515 44313333 0.93
tpch_q07/datafusion:parquet 104662737 107185919 0.98
tpch_q08/datafusion:parquet 🚀 90186158 100751819 0.90
tpch_q09/datafusion:parquet 🚀 121214644 136920220 0.89
tpch_q10/datafusion:parquet 113428418 114957224 0.99
tpch_q11/datafusion:parquet 41825049 43183096 0.97
tpch_q12/datafusion:parquet 🚨 92646759 80717020 1.15
tpch_q13/datafusion:parquet 192136408 198317496 0.97
tpch_q14/datafusion:parquet 🚀 41930368 49198975 0.85
tpch_q15/datafusion:parquet 58951643 61057346 0.97
tpch_q16/datafusion:parquet 43062297 45343439 0.95
tpch_q17/datafusion:parquet 135012075 140432583 0.96
tpch_q18/datafusion:parquet 161184515 167319775 0.96
tpch_q19/datafusion:parquet 88245799 93047070 0.95
tpch_q20/datafusion:parquet 70114109 71708364 0.98
tpch_q21/datafusion:parquet 133397054 140085817 0.95
tpch_q22/datafusion:parquet 30579718 30729312 1.00
datafusion / arrow (0.977x ➖, 1↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 50354984 56222087 0.90
tpch_q02/datafusion:arrow 17989882 19045191 0.94
tpch_q03/datafusion:arrow 29661360 30249856 0.98
tpch_q04/datafusion:arrow 25389816 25800377 0.98
tpch_q05/datafusion:arrow 74372489 73138004 1.02
tpch_q06/datafusion:arrow 20072924 19565307 1.03
tpch_q07/datafusion:arrow 102873656 98756183 1.04
tpch_q08/datafusion:arrow 39557912 40533677 0.98
tpch_q09/datafusion:arrow 60452389 64900216 0.93
tpch_q10/datafusion:arrow 44830964 47980943 0.93
tpch_q11/datafusion:arrow 8848789 9167396 0.97
tpch_q12/datafusion:arrow 51382951 53325391 0.96
tpch_q13/datafusion:arrow 47838537 47826142 1.00
tpch_q14/datafusion:arrow 21654326 22151136 0.98
tpch_q15/datafusion:arrow 43291363 42673392 1.01
tpch_q16/datafusion:arrow 18348212 19007090 0.97
tpch_q17/datafusion:arrow 67276478 68209006 0.99
tpch_q18/datafusion:arrow 131690702 134725928 0.98
tpch_q19/datafusion:arrow 35163637 36076446 0.97
tpch_q20/datafusion:arrow 33929305 34941261 0.97
tpch_q21/datafusion:arrow 146665967 149618231 0.98
tpch_q22/datafusion:arrow 17233321 17349312 0.99
duckdb / vortex-file-compressed (0.986x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31732075 31806493 1.00
tpch_q02/duckdb:vortex-file-compressed 24197357 25187778 0.96
tpch_q03/duckdb:vortex-file-compressed 29498760 29317101 1.01
tpch_q04/duckdb:vortex-file-compressed 29221206 29126601 1.00
tpch_q05/duckdb:vortex-file-compressed 33001654 33829911 0.98
tpch_q06/duckdb:vortex-file-compressed 10519554 10756934 0.98
tpch_q07/duckdb:vortex-file-compressed 35626765 37060174 0.96
tpch_q08/duckdb:vortex-file-compressed 38399267 38833018 0.99
tpch_q09/duckdb:vortex-file-compressed 71603129 73150292 0.98
tpch_q10/duckdb:vortex-file-compressed 34841165 34856331 1.00
tpch_q11/duckdb:vortex-file-compressed 14825490 14997752 0.99
tpch_q12/duckdb:vortex-file-compressed 21893561 22158026 0.99
tpch_q13/duckdb:vortex-file-compressed 34687321 34936377 0.99
tpch_q14/duckdb:vortex-file-compressed 22063732 21564033 1.02
tpch_q15/duckdb:vortex-file-compressed 16538606 16548880 1.00
tpch_q16/duckdb:vortex-file-compressed 28356712 29013043 0.98
tpch_q17/duckdb:vortex-file-compressed 24663053 25839382 0.95
tpch_q18/duckdb:vortex-file-compressed 50290700 49225120 1.02
tpch_q19/duckdb:vortex-file-compressed 27724309 29750166 0.93
tpch_q20/duckdb:vortex-file-compressed 33810471 34181712 0.99
tpch_q21/duckdb:vortex-file-compressed 105942264 106024261 1.00
tpch_q22/duckdb:vortex-file-compressed 16812795 17278852 0.97
duckdb / vortex-compact (0.980x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38270644 38386193 1.00
tpch_q02/duckdb:vortex-compact 34603594 35885451 0.96
tpch_q03/duckdb:vortex-compact 31619513 32118895 0.98
tpch_q04/duckdb:vortex-compact 34647685 34230526 1.01
tpch_q05/duckdb:vortex-compact 36877682 38152665 0.97
tpch_q06/duckdb:vortex-compact 14569158 14872374 0.98
tpch_q07/duckdb:vortex-compact 42124849 42784627 0.98
tpch_q08/duckdb:vortex-compact 45094054 45550436 0.99
tpch_q09/duckdb:vortex-compact 84365065 84424793 1.00
tpch_q10/duckdb:vortex-compact 39027349 39762876 0.98
tpch_q11/duckdb:vortex-compact 19918345 19332622 1.03
tpch_q12/duckdb:vortex-compact 35352772 36052827 0.98
tpch_q13/duckdb:vortex-compact 43227427 44305690 0.98
tpch_q14/duckdb:vortex-compact 28456631 29898285 0.95
tpch_q15/duckdb:vortex-compact 19497438 19685115 0.99
tpch_q16/duckdb:vortex-compact 34424342 35265075 0.98
tpch_q17/duckdb:vortex-compact 30892546 31443913 0.98
tpch_q18/duckdb:vortex-compact 49729820 50512095 0.98
tpch_q19/duckdb:vortex-compact 33975199 34736571 0.98
tpch_q20/duckdb:vortex-compact 41509969 43814381 0.95
tpch_q21/duckdb:vortex-compact 110042548 112618931 0.98
tpch_q22/duckdb:vortex-compact 19193556 20467659 0.94
duckdb / parquet (0.934x ➖, 6↑ 1↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77262175 83534221 0.92
tpch_q02/duckdb:parquet 🚀 38606217 44183305 0.87
tpch_q03/duckdb:parquet 68325537 75733957 0.90
tpch_q04/duckdb:parquet 46182058 51295589 0.90
tpch_q05/duckdb:parquet 🚀 65772933 73741531 0.89
tpch_q06/duckdb:parquet 20291326 21548793 0.94
tpch_q07/duckdb:parquet 69549624 73569517 0.95
tpch_q08/duckdb:parquet 81012559 88699062 0.91
tpch_q09/duckdb:parquet 156312244 171007400 0.91
tpch_q10/duckdb:parquet 🚀 114806678 129983092 0.88
tpch_q11/duckdb:parquet 🚀 21873851 25535939 0.86
tpch_q12/duckdb:parquet 44167898 48913552 0.90
tpch_q13/duckdb:parquet 🚀 246355607 297376172 0.83
tpch_q14/duckdb:parquet 47822367 52558605 0.91
tpch_q15/duckdb:parquet 🚨 31023628 26442400 1.17
tpch_q16/duckdb:parquet 🚀 55496752 62020917 0.89
tpch_q17/duckdb:parquet 53533542 54717835 0.98
tpch_q18/duckdb:parquet 116540403 115492625 1.01
tpch_q19/duckdb:parquet 64233512 65543679 0.98
tpch_q20/duckdb:parquet 62671326 63074966 0.99
tpch_q21/duckdb:parquet 158961530 161809517 0.98
tpch_q22/duckdb:parquet 51642563 51253720 1.01
duckdb / duckdb (0.984x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15887838 16021779 0.99
tpch_q02/duckdb:duckdb 12993741 12020874 1.08
tpch_q03/duckdb:duckdb 18813725 19975180 0.94
tpch_q04/duckdb:duckdb 19246217 19239852 1.00
tpch_q05/duckdb:duckdb 19891531 20315022 0.98
tpch_q06/duckdb:duckdb 5234781 5420315 0.97
tpch_q07/duckdb:duckdb 21996707 22070334 1.00
tpch_q08/duckdb:duckdb 20984098 21072337 1.00
tpch_q09/duckdb:duckdb 53764389 57886493 0.93
tpch_q10/duckdb:duckdb 44410883 45181080 0.98
tpch_q11/duckdb:duckdb 5681533 5803073 0.98
tpch_q12/duckdb:duckdb 13566474 13887831 0.98
tpch_q13/duckdb:duckdb 38562487 39115646 0.99
tpch_q14/duckdb:duckdb 17548834 17281552 1.02
tpch_q15/duckdb:duckdb 11920160 12972264 0.92
tpch_q16/duckdb:duckdb 22899693 25076498 0.91
tpch_q17/duckdb:duckdb 13345149 13475759 0.99
tpch_q18/duckdb:duckdb 38312298 38016875 1.01
tpch_q19/duckdb:duckdb 27437214 26803648 1.02
tpch_q20/duckdb:duckdb 23153395 22770069 1.02
tpch_q21/duckdb:duckdb 54677264 55886865 0.98
tpch_q22/duckdb:duckdb 24251977 24508083 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -10.4% -7.4% -3.2% +18.0% ➖ noise
1 datafusion:vortex-compact -0.2% -7.4% +7.8% +17.5% ➖ noise
1 datafusion:vortex-file-compressed -5.7% -7.4% +1.9% +18.7% ➖ noise
1 duckdb:duckdb -0.8% -7.4% +7.1% +18.0% ➖ noise
1 duckdb:vortex-compact -0.3% -7.4% +7.7% +17.3% ➖ noise
1 duckdb:vortex-file-compressed -0.2% -7.4% +7.8% +20.4% ➖ noise
2 datafusion:arrow -5.5% -7.7% +2.4% +12.5% ➖ noise
2 datafusion:vortex-compact -3.7% -7.7% +4.3% +12.5% ➖ noise
2 datafusion:vortex-file-compressed -5.2% -7.7% +2.7% +12.5% ➖ noise
2 duckdb:duckdb +8.1% -7.7% +17.1% +12.5% 🚨 regression
2 duckdb:vortex-compact -3.6% -7.7% +4.5% +12.5% ➖ noise
2 duckdb:vortex-file-compressed -3.9% -7.7% +4.1% +12.5% ➖ noise
3 datafusion:arrow -1.9% -5.5% +3.8% +12.5% ➖ noise
3 datafusion:vortex-compact -4.3% -5.5% +1.3% +12.5% ➖ noise
3 datafusion:vortex-file-compressed -6.4% -5.5% -0.9% +12.5% ➖ noise
3 duckdb:duckdb -5.8% -5.5% -0.3% +14.1% ➖ noise
3 duckdb:vortex-compact -1.6% -5.5% +4.2% +12.5% ➖ noise
3 duckdb:vortex-file-compressed +0.6% -5.5% +6.5% +14.4% ➖ noise
4 datafusion:arrow -1.6% -4.4% +2.9% +12.5% ➖ noise
4 datafusion:vortex-compact -5.2% -4.4% -0.8% +12.5% ➖ noise
4 datafusion:vortex-file-compressed -3.3% -4.4% +1.1% +12.5% ➖ noise
4 duckdb:duckdb +0.0% -4.4% +4.6% +12.5% ➖ noise
4 duckdb:vortex-compact +1.2% -4.4% +5.9% +12.5% ➖ noise
4 duckdb:vortex-file-compressed +0.3% -4.4% +4.9% +12.5% ➖ noise
5 datafusion:arrow +1.7% -5.6% +7.7% +12.5% ➖ noise
5 datafusion:vortex-compact -5.3% -5.6% +0.3% +12.5% ➖ noise
5 datafusion:vortex-file-compressed -6.9% -5.6% -1.4% +12.5% ➖ noise
5 duckdb:duckdb -2.1% -5.6% +3.7% +12.5% ➖ noise
5 duckdb:vortex-compact -3.3% -5.6% +2.4% +12.5% ➖ noise
5 duckdb:vortex-file-compressed -2.4% -5.6% +3.3% +12.5% ➖ noise
6 datafusion:arrow +2.6% -6.4% +9.6% +13.0% ➖ noise
6 datafusion:vortex-compact -6.9% -6.4% -0.6% +14.3% ➖ noise
6 datafusion:vortex-file-compressed -2.5% -6.4% +4.2% +13.9% ➖ noise
6 duckdb:duckdb -3.4% -6.4% +3.2% +15.8% ➖ noise
6 duckdb:vortex-compact -2.0% -6.4% +4.6% +25.3% ➖ noise
6 duckdb:vortex-file-compressed -2.2% -6.4% +4.5% +17.8% ➖ noise
7 datafusion:arrow +4.2% -3.9% +8.4% +12.5% ➖ noise
7 datafusion:vortex-compact -2.5% -3.9% +1.5% +12.5% ➖ noise
7 datafusion:vortex-file-compressed -6.2% -3.9% -2.4% +12.5% ➖ noise
7 duckdb:duckdb -0.3% -3.9% +3.7% +12.5% ➖ noise
7 duckdb:vortex-compact -1.5% -3.9% +2.5% +12.5% ➖ noise
7 duckdb:vortex-file-compressed -3.9% -3.9% +0.1% +12.5% ➖ noise
8 datafusion:arrow -2.4% -9.6% +7.9% +12.5% ➖ noise
8 datafusion:vortex-compact -4.0% -9.6% +6.1% +12.5% ➖ noise
8 datafusion:vortex-file-compressed -6.9% -9.6% +2.9% +12.5% ➖ noise
8 duckdb:duckdb -0.4% -9.6% +10.1% +12.5% ➖ noise
8 duckdb:vortex-compact -1.0% -9.6% +9.5% +12.5% ➖ noise
8 duckdb:vortex-file-compressed -1.1% -9.6% +9.4% +13.4% ➖ noise
9 datafusion:arrow -6.9% -10.0% +3.5% +12.5% ➖ noise
9 datafusion:vortex-compact -4.9% -10.0% +5.7% +12.5% ➖ noise
9 datafusion:vortex-file-compressed -3.4% -10.0% +7.3% +12.5% ➖ noise
9 duckdb:duckdb -7.1% -10.0% +3.2% +12.5% ➖ noise
9 duckdb:vortex-compact -0.1% -10.0% +11.1% +12.5% ➖ noise
9 duckdb:vortex-file-compressed -2.1% -10.0% +8.8% +12.5% ➖ noise
10 datafusion:arrow -6.6% -6.6% +0.1% +12.5% ➖ noise
10 datafusion:vortex-compact -2.7% -6.6% +4.2% +12.5% ➖ noise
10 datafusion:vortex-file-compressed -2.9% -6.6% +4.0% +12.5% ➖ noise
10 duckdb:duckdb -1.7% -6.6% +5.3% +12.5% ➖ noise
10 duckdb:vortex-compact -1.8% -6.6% +5.1% +12.5% ➖ noise
10 duckdb:vortex-file-compressed -0.0% -6.6% +7.1% +12.5% ➖ noise
11 datafusion:arrow -3.5% -8.9% +6.0% +15.0% ➖ noise
11 datafusion:vortex-compact -5.9% -8.9% +3.3% +12.5% ➖ noise
11 datafusion:vortex-file-compressed -7.1% -8.9% +2.0% +12.5% ➖ noise
11 duckdb:duckdb -2.1% -8.9% +7.5% +12.5% ➖ noise
11 duckdb:vortex-compact +3.0% -8.9% +13.1% +12.5% 🚨 regression
11 duckdb:vortex-file-compressed -1.1% -8.9% +8.5% +12.5% ➖ noise
12 datafusion:arrow -3.6% +1.8% -5.4% +18.7% ➖ noise
12 datafusion:vortex-compact -4.4% +1.8% -6.1% +12.5% ➖ noise
12 datafusion:vortex-file-compressed -5.2% +1.8% -6.8% +12.5% ➖ noise
12 duckdb:duckdb -2.3% +1.8% -4.0% +12.5% ➖ noise
12 duckdb:vortex-compact -1.9% +1.8% -3.7% +12.5% ➖ noise
12 duckdb:vortex-file-compressed -1.2% +1.8% -2.9% +12.5% ➖ noise
13 datafusion:arrow +0.0% -10.4% +11.7% +12.5% ➖ noise
13 datafusion:vortex-compact -4.0% -10.4% +7.2% +12.5% ➖ noise
13 datafusion:vortex-file-compressed -2.5% -10.4% +8.8% +12.5% ➖ noise
13 duckdb:duckdb -1.4% -10.4% +10.0% +12.8% ➖ noise
13 duckdb:vortex-compact -2.4% -10.4% +8.9% +12.5% ➖ noise
13 duckdb:vortex-file-compressed -0.7% -10.4% +10.8% +12.5% ➖ noise
14 datafusion:arrow -2.2% -11.9% +11.0% +12.5% ➖ noise
14 datafusion:vortex-compact +2.5% -11.9% +16.4% +12.5% 🚨 regression
14 datafusion:vortex-file-compressed -3.9% -11.9% +9.1% +12.5% ➖ noise
14 duckdb:duckdb +1.5% -11.9% +15.3% +16.3% ➖ noise
14 duckdb:vortex-compact -4.8% -11.9% +8.1% +12.5% ➖ noise
14 duckdb:vortex-file-compressed +2.3% -11.9% +16.2% +13.4% 🚨 regression
15 datafusion:arrow +1.4% +6.4% -4.7% +12.5% ➖ noise
15 datafusion:vortex-compact -3.6% +6.4% -9.4% +12.8% ➖ noise
15 datafusion:vortex-file-compressed -2.2% +6.4% -8.1% +12.5% ➖ noise
15 duckdb:duckdb -8.1% +6.4% -13.7% +22.0% ➖ noise
15 duckdb:vortex-compact -1.0% +6.4% -6.9% +15.4% ➖ noise
15 duckdb:vortex-file-compressed -0.1% +6.4% -6.1% +12.5% ➖ noise
16 datafusion:arrow -3.5% -7.8% +4.7% +12.5% ➖ noise
16 datafusion:vortex-compact -3.4% -7.8% +4.7% +12.5% ➖ noise
16 datafusion:vortex-file-compressed -8.6% -7.8% -0.8% +12.5% ➖ noise
16 duckdb:duckdb -8.7% -7.8% -0.9% +12.5% ➖ noise
16 duckdb:vortex-compact -2.4% -7.8% +5.9% +12.5% ➖ noise
16 duckdb:vortex-file-compressed -2.3% -7.8% +6.0% +12.5% ➖ noise
17 datafusion:arrow -1.4% -3.0% +1.7% +12.5% ➖ noise
17 datafusion:vortex-compact -3.7% -3.0% -0.7% +12.5% ➖ noise
17 datafusion:vortex-file-compressed -4.6% -3.0% -1.6% +12.5% ➖ noise
17 duckdb:duckdb -1.0% -3.0% +2.1% +12.5% ➖ noise
17 duckdb:vortex-compact -1.8% -3.0% +1.3% +12.9% ➖ noise
17 duckdb:vortex-file-compressed -4.6% -3.0% -1.6% +13.2% ➖ noise
18 datafusion:arrow -2.3% -1.4% -0.9% +12.5% ➖ noise
18 datafusion:vortex-compact -3.0% -1.4% -1.6% +12.5% ➖ noise
18 datafusion:vortex-file-compressed -5.4% -1.4% -4.0% +12.5% ➖ noise
18 duckdb:duckdb +0.8% -1.4% +2.2% +12.5% ➖ noise
18 duckdb:vortex-compact -1.5% -1.4% -0.1% +12.5% ➖ noise
18 duckdb:vortex-file-compressed +2.2% -1.4% +3.6% +12.5% ➖ noise
19 datafusion:arrow -2.5% -3.6% +1.1% +17.1% ➖ noise
19 datafusion:vortex-compact -2.6% -3.6% +1.0% +13.4% ➖ noise
19 datafusion:vortex-file-compressed -1.3% -3.6% +2.4% +14.1% ➖ noise
19 duckdb:duckdb +2.4% -3.6% +6.2% +15.9% ➖ noise
19 duckdb:vortex-compact -2.2% -3.6% +1.5% +13.2% ➖ noise
19 duckdb:vortex-file-compressed -6.8% -3.6% -3.3% +12.5% ➖ noise
20 datafusion:arrow -2.9% -1.4% -1.5% +12.5% ➖ noise
20 datafusion:vortex-compact -6.3% -1.4% -4.9% +12.5% ➖ noise
20 datafusion:vortex-file-compressed -5.0% -1.4% -3.6% +12.5% ➖ noise
20 duckdb:duckdb +1.7% -1.4% +3.2% +12.5% ➖ noise
20 duckdb:vortex-compact -5.3% -1.4% -3.9% +12.5% ➖ noise
20 duckdb:vortex-file-compressed -1.1% -1.4% +0.4% +12.5% ➖ noise
21 datafusion:arrow -2.0% -3.3% +1.4% +12.5% ➖ noise
21 datafusion:vortex-compact -3.2% -3.3% +0.0% +12.5% ➖ noise
21 datafusion:vortex-file-compressed -5.6% -3.3% -2.4% +12.5% ➖ noise
21 duckdb:duckdb -2.2% -3.3% +1.2% +12.5% ➖ noise
21 duckdb:vortex-compact -2.3% -3.3% +1.0% +12.5% ➖ noise
21 duckdb:vortex-file-compressed -0.1% -3.3% +3.3% +12.5% ➖ noise
22 datafusion:arrow -0.7% +0.1% -0.8% +12.5% ➖ noise
22 datafusion:vortex-compact -7.3% +0.1% -7.5% +12.5% ➖ noise
22 datafusion:vortex-file-compressed -4.6% +0.1% -4.7% +12.5% ➖ noise
22 duckdb:duckdb -1.0% +0.1% -1.2% +12.5% ➖ noise
22 duckdb:vortex-compact -6.2% +0.1% -6.4% +12.5% ➖ noise
22 duckdb:vortex-file-compressed -2.7% +0.1% -2.8% +12.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: TPC-H SF=1 on NVME

File Size Changes (6 files changed, -0.0% overall, 0↑ 6↓)
File Scale Format Base HEAD Change %
lineitem_0.vortex 1.0 vortex-file-compressed 85.42 MB 85.42 MB 56 B -0.0%
lineitem_1.vortex 1.0 vortex-file-compressed 84.90 MB 84.90 MB 56 B -0.0%
orders_0.vortex 1.0 vortex-file-compressed 43.43 MB 43.43 MB 56 B -0.0%
customer_0.vortex 1.0 vortex-file-compressed 10.50 MB 10.50 MB 248 B -0.0%
supplier_0.vortex 1.0 vortex-file-compressed 706.31 KB 705.69 KB 640 B -0.1%
region_0.vortex 1.0 vortex-file-compressed 6.13 KB 6.01 KB 120 B -1.9%

Totals:

  • vortex-compact: 194.82 MB → 194.82 MB (0.0%)
  • vortex-file-compressed: 266.60 MB → 266.60 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +10.9%
Vortex (geomean): 1.100x ❌
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish +3.7%


datafusion / vortex-file-compressed (1.036x ➖, 2↑ 2↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5846587 4997080 1.17
fineweb_q01/datafusion:vortex-file-compressed 🚀 19665689 22357755 0.88
fineweb_q02/datafusion:vortex-file-compressed 🚨 32468757 21411644 1.52
fineweb_q03/datafusion:vortex-file-compressed 🚀 70556836 85166032 0.83
fineweb_q04/datafusion:vortex-file-compressed 233332156 231106197 1.01
fineweb_q05/datafusion:vortex-file-compressed 217083980 218706953 0.99
fineweb_q06/datafusion:vortex-file-compressed 56206927 53555110 1.05
fineweb_q07/datafusion:vortex-file-compressed 63513778 67167308 0.95
fineweb_q08/datafusion:vortex-file-compressed 23418804 21916767 1.07
datafusion / vortex-compact (1.191x ❌, 0↑ 7↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5480906 5626038 0.97
fineweb_q01/datafusion:vortex-compact 🚨 155991082 124952194 1.25
fineweb_q02/datafusion:vortex-compact 🚨 162272236 126510624 1.28
fineweb_q03/datafusion:vortex-compact 🚨 1314805300 1030531488 1.28
fineweb_q04/datafusion:vortex-compact 🚨 1412811848 1107810564 1.28
fineweb_q05/datafusion:vortex-compact 🚨 1182687528 951528744 1.24
fineweb_q06/datafusion:vortex-compact 🚨 639017508 520888408 1.23
fineweb_q07/datafusion:vortex-compact 🚨 653665502 525683148 1.24
fineweb_q08/datafusion:vortex-compact 19556233 19540137 1.00
datafusion / parquet (0.981x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6778526 7058424 0.96
fineweb_q01/datafusion:parquet 273664789 284321752 0.96
fineweb_q02/datafusion:parquet 281653487 289091093 0.97
fineweb_q03/datafusion:parquet 284574384 278171763 1.02
fineweb_q04/datafusion:parquet 294709250 296997258 0.99
fineweb_q05/datafusion:parquet 290985766 302359208 0.96
fineweb_q06/datafusion:parquet 279636629 292864369 0.95
fineweb_q07/datafusion:parquet 277228465 276590423 1.00
fineweb_q08/datafusion:parquet 275003790 275928364 1.00
duckdb / vortex-file-compressed (1.058x ➖, 0↑ 2↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3269317 3129975 1.04
fineweb_q01/duckdb:vortex-file-compressed 21975052 21483456 1.02
fineweb_q02/duckdb:vortex-file-compressed 🚨 31816054 24009141 1.33
fineweb_q03/duckdb:vortex-file-compressed 143575917 155150615 0.93
fineweb_q04/duckdb:vortex-file-compressed 223931577 217376407 1.03
fineweb_q05/duckdb:vortex-file-compressed 205782293 213960525 0.96
fineweb_q06/duckdb:vortex-file-compressed 55188324 52068647 1.06
fineweb_q07/duckdb:vortex-file-compressed 58480294 54719235 1.07
fineweb_q08/duckdb:vortex-file-compressed 🚨 27815429 24572201 1.13
duckdb / vortex-compact (1.123x ❌, 0↑ 5↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3887798 3783726 1.03
fineweb_q01/duckdb:vortex-compact 🚨 130579588 98329827 1.33
fineweb_q02/duckdb:vortex-compact 🚨 144093629 113431910 1.27
fineweb_q03/duckdb:vortex-compact 🚨 996829352 865302868 1.15
fineweb_q04/duckdb:vortex-compact 🚨 1044029954 901460756 1.16
fineweb_q05/duckdb:vortex-compact 🚨 897157172 813183176 1.10
fineweb_q06/duckdb:vortex-compact 492404684 458706358 1.07
fineweb_q07/duckdb:vortex-compact 506680584 478448574 1.06
fineweb_q08/duckdb:vortex-compact 19275300 19605139 0.98
duckdb / parquet (1.005x ➖, 0↑ 1↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 25470288 25244829 1.01
fineweb_q01/duckdb:parquet 81340806 84811087 0.96
fineweb_q02/duckdb:parquet 82306855 81906019 1.00
fineweb_q03/duckdb:parquet 307930780 310119412 0.99
fineweb_q04/duckdb:parquet 435845654 439524766 0.99
fineweb_q05/duckdb:parquet 407221718 409793074 0.99
fineweb_q06/duckdb:parquet 196217790 196292784 1.00
fineweb_q07/duckdb:parquet 206831277 208390203 0.99
fineweb_q08/duckdb:parquet 🚨 31650586 28578917 1.11
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -2.6% -1.6% -1.0% +46.7% ➖ noise
0 datafusion:vortex-file-compressed +17.0% -1.6% +18.9% +48.6% ➖ noise
0 duckdb:vortex-compact +2.8% -1.6% +4.4% +44.1% ➖ noise
0 duckdb:vortex-file-compressed +4.5% -1.6% +6.1% +81.3% ➖ noise
1 datafusion:vortex-compact +24.8% -3.9% +29.9% +10.4% 🚨 regression
1 datafusion:vortex-file-compressed -12.0% -3.9% -8.5% +38.6% ➖ noise
1 duckdb:vortex-compact +32.8% -3.9% +38.2% +16.1% 🚨 regression
1 duckdb:vortex-file-compressed +2.3% -3.9% +6.5% +60.4% ➖ noise
2 datafusion:vortex-compact +28.3% -1.1% +29.6% +13.6% 🚨 regression
2 datafusion:vortex-file-compressed +51.6% -1.1% +53.3% +14.5% 🚨 regression
2 duckdb:vortex-compact +27.0% -1.1% +28.4% +11.8% 🚨 regression
2 duckdb:vortex-file-compressed +32.5% -1.1% +33.9% +13.2% 🚨 regression
3 datafusion:vortex-compact +27.6% +0.8% +26.6% +10.0% 🚨 regression
3 datafusion:vortex-file-compressed -17.2% +0.8% -17.8% +38.4% ➖ noise
3 duckdb:vortex-compact +15.2% +0.8% +14.3% +10.0% 🚨 regression
3 duckdb:vortex-file-compressed -7.5% +0.8% -8.2% +24.3% ➖ noise
4 datafusion:vortex-compact +27.5% -0.8% +28.6% +10.0% 🚨 regression
4 datafusion:vortex-file-compressed +1.0% -0.8% +1.8% +10.0% ➖ noise
4 duckdb:vortex-compact +15.8% -0.8% +16.8% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed +3.0% -0.8% +3.9% +10.0% ➖ noise
5 datafusion:vortex-compact +24.3% -2.2% +27.1% +10.0% 🚨 regression
5 datafusion:vortex-file-compressed -0.7% -2.2% +1.5% +10.0% ➖ noise
5 duckdb:vortex-compact +10.3% -2.2% +12.8% +10.0% 🚨 regression
5 duckdb:vortex-file-compressed -3.8% -2.2% -1.7% +10.0% ➖ noise
6 datafusion:vortex-compact +22.7% -2.3% +25.6% +10.0% 🚨 regression
6 datafusion:vortex-file-compressed +5.0% -2.3% +7.4% +12.1% ➖ noise
6 duckdb:vortex-compact +7.3% -2.3% +9.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +6.0% -2.3% +8.5% +10.0% ➖ noise
7 datafusion:vortex-compact +24.3% -0.3% +24.7% +10.0% 🚨 regression
7 datafusion:vortex-file-compressed -5.4% -0.3% -5.2% +24.0% ➖ noise
7 duckdb:vortex-compact +5.9% -0.3% +6.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +6.9% -0.3% +7.2% +21.1% ➖ noise
8 datafusion:vortex-compact +0.1% +5.1% -4.7% +14.8% ➖ noise
8 datafusion:vortex-file-compressed +6.9% +5.1% +1.7% +10.0% ➖ noise
8 duckdb:vortex-compact -1.7% +5.1% -6.4% +38.7% ➖ noise
8 duckdb:vortex-file-compressed +13.2% +5.1% +7.7% +54.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: FineWeb NVMe

File Size Changes (2 files changed, +0.1% overall, 2↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.79 GB 1.80 GB +4.22 MB +0.2%
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB +32.98 KB +0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (+0.0%)
  • vortex-file-compressed: 1.79 GB → 1.80 GB (+0.2%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 0.923x ➖
Parquet (geomean): 0.942x ➖
Shifts: Parquet (control) -5.8% · Median polish -4.9%


datafusion / vortex-file-compressed (0.879x ✅, 56↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 26910519 28105375 0.96
tpcds_q02/datafusion:vortex-file-compressed 49740032 51129410 0.97
tpcds_q03/datafusion:vortex-file-compressed 17425697 18657469 0.93
tpcds_q04/datafusion:vortex-file-compressed 269529870 294660169 0.91
tpcds_q05/datafusion:vortex-file-compressed 44848889 48378332 0.93
tpcds_q06/datafusion:vortex-file-compressed 🚀 44002100 49646593 0.89
tpcds_q07/datafusion:vortex-file-compressed 43533653 43958602 0.99
tpcds_q08/datafusion:vortex-file-compressed 30403408 33756419 0.90
tpcds_q09/datafusion:vortex-file-compressed 🚀 45583858 51145106 0.89
tpcds_q10/datafusion:vortex-file-compressed 🚀 41572444 50784743 0.82
tpcds_q11/datafusion:vortex-file-compressed 🚀 153146839 196677430 0.78
tpcds_q12/datafusion:vortex-file-compressed 22215468 24652898 0.90
tpcds_q13/datafusion:vortex-file-compressed 🚀 48309973 55809370 0.87
tpcds_q14/datafusion:vortex-file-compressed 🚀 173973493 201942566 0.86
tpcds_q15/datafusion:vortex-file-compressed 31959436 34236085 0.93
tpcds_q16/datafusion:vortex-file-compressed 29550103 32009508 0.92
tpcds_q17/datafusion:vortex-file-compressed 🚀 66202639 76789952 0.86
tpcds_q18/datafusion:vortex-file-compressed 🚀 72124712 91723771 0.79
tpcds_q19/datafusion:vortex-file-compressed 26539215 27912110 0.95
tpcds_q20/datafusion:vortex-file-compressed 23550292 24515046 0.96
tpcds_q21/datafusion:vortex-file-compressed 131861919 144606371 0.91
tpcds_q22/datafusion:vortex-file-compressed 🚀 52876014 60953362 0.87
tpcds_q23/datafusion:vortex-file-compressed 130769739 142404716 0.92
tpcds_q24/datafusion:vortex-file-compressed 102757865 113542326 0.91
tpcds_q25/datafusion:vortex-file-compressed 🚀 66140422 75214751 0.88
tpcds_q26/datafusion:vortex-file-compressed 36295936 39828556 0.91
tpcds_q27/datafusion:vortex-file-compressed 🚀 100380846 124797308 0.80
tpcds_q28/datafusion:vortex-file-compressed 🚀 42319805 47789175 0.89
tpcds_q29/datafusion:vortex-file-compressed 🚀 66807860 79364428 0.84
tpcds_q30/datafusion:vortex-file-compressed 🚀 24400132 28881075 0.84
tpcds_q31/datafusion:vortex-file-compressed 🚀 87560419 99463266 0.88
tpcds_q32/datafusion:vortex-file-compressed 🚀 21443830 24646743 0.87
tpcds_q33/datafusion:vortex-file-compressed 33198834 34782598 0.95
tpcds_q34/datafusion:vortex-file-compressed 🚀 28171834 34115981 0.83
tpcds_q35/datafusion:vortex-file-compressed 🚀 48564517 57077111 0.85
tpcds_q36/datafusion:vortex-file-compressed 🚀 65778963 83222310 0.79
tpcds_q37/datafusion:vortex-file-compressed 🚀 31679303 39363281 0.80
tpcds_q38/datafusion:vortex-file-compressed 49850785 54282282 0.92
tpcds_q39/datafusion:vortex-file-compressed 138744710 141451837 0.98
tpcds_q40/datafusion:vortex-file-compressed 49648878 51054114 0.97
tpcds_q41/datafusion:vortex-file-compressed 🚀 16026392 18064416 0.89
tpcds_q42/datafusion:vortex-file-compressed 16456850 17306880 0.95
tpcds_q43/datafusion:vortex-file-compressed 30277579 32126810 0.94
tpcds_q44/datafusion:vortex-file-compressed 35512160 37277403 0.95
tpcds_q45/datafusion:vortex-file-compressed 32774828 35244911 0.93
tpcds_q46/datafusion:vortex-file-compressed 🚀 44579368 54177258 0.82
tpcds_q47/datafusion:vortex-file-compressed 🚀 183867160 222459871 0.83
tpcds_q48/datafusion:vortex-file-compressed 🚀 39908738 46689994 0.85
tpcds_q49/datafusion:vortex-file-compressed 🚀 58995103 66671022 0.88
tpcds_q50/datafusion:vortex-file-compressed 42299950 46684245 0.91
tpcds_q51/datafusion:vortex-file-compressed 90626856 97834294 0.93
tpcds_q52/datafusion:vortex-file-compressed 16302468 16830096 0.97
tpcds_q53/datafusion:vortex-file-compressed 🚀 21687504 24430260 0.89
tpcds_q54/datafusion:vortex-file-compressed 🚀 38745632 43109558 0.90
tpcds_q55/datafusion:vortex-file-compressed 🚀 16032145 20179964 0.79
tpcds_q56/datafusion:vortex-file-compressed 🚀 31429974 37768473 0.83
tpcds_q57/datafusion:vortex-file-compressed 🚀 119524620 134111077 0.89
tpcds_q58/datafusion:vortex-file-compressed 🚀 65071738 72755695 0.89
tpcds_q59/datafusion:vortex-file-compressed 67222176 73553061 0.91
tpcds_q60/datafusion:vortex-file-compressed 🚀 32310597 36781475 0.88
tpcds_q61/datafusion:vortex-file-compressed 41776557 45267921 0.92
tpcds_q62/datafusion:vortex-file-compressed 28937812 31251249 0.93
tpcds_q63/datafusion:vortex-file-compressed 21866384 23469218 0.93
tpcds_q64/datafusion:vortex-file-compressed 🚀 433848716 483930541 0.90
tpcds_q65/datafusion:vortex-file-compressed 43403824 47131507 0.92
tpcds_q66/datafusion:vortex-file-compressed 🚀 82046137 91686067 0.89
tpcds_q67/datafusion:vortex-file-compressed 🚀 110098594 124151756 0.89
tpcds_q68/datafusion:vortex-file-compressed 🚀 40336523 46660792 0.86
tpcds_q69/datafusion:vortex-file-compressed 37313285 39224321 0.95
tpcds_q70/datafusion:vortex-file-compressed 🚀 101564792 114913219 0.88
tpcds_q71/datafusion:vortex-file-compressed 🚀 25570248 29525690 0.87
tpcds_q72/datafusion:vortex-file-compressed 🚀 2382697758 3477171056 0.69
tpcds_q73/datafusion:vortex-file-compressed 🚀 27043419 41514873 0.65
tpcds_q74/datafusion:vortex-file-compressed 🚀 104195526 143566821 0.73
tpcds_q75/datafusion:vortex-file-compressed 🚀 111651183 147402703 0.76
tpcds_q76/datafusion:vortex-file-compressed 🚀 27750985 41628148 0.67
tpcds_q77/datafusion:vortex-file-compressed 🚀 40182951 56838654 0.71
tpcds_q78/datafusion:vortex-file-compressed 🚀 127230092 185075132 0.69
tpcds_q79/datafusion:vortex-file-compressed 🚀 35068326 46544661 0.75
tpcds_q80/datafusion:vortex-file-compressed 🚀 98232655 112055177 0.88
tpcds_q81/datafusion:vortex-file-compressed 🚀 29399232 34820073 0.84
tpcds_q82/datafusion:vortex-file-compressed 🚀 32666089 36844780 0.89
tpcds_q83/datafusion:vortex-file-compressed 🚀 43526894 48542440 0.90
tpcds_q84/datafusion:vortex-file-compressed 14648845 14903294 0.98
tpcds_q85/datafusion:vortex-file-compressed 93952128 100879933 0.93
tpcds_q86/datafusion:vortex-file-compressed 🚀 18409773 20517871 0.90
tpcds_q87/datafusion:vortex-file-compressed 🚀 50463286 65178011 0.77
tpcds_q88/datafusion:vortex-file-compressed 🚀 55765213 69393938 0.80
tpcds_q89/datafusion:vortex-file-compressed 🚀 33511662 37285622 0.90
tpcds_q90/datafusion:vortex-file-compressed 15987481 17463379 0.92
tpcds_q91/datafusion:vortex-file-compressed 🚀 22060386 24912072 0.89
tpcds_q92/datafusion:vortex-file-compressed 🚀 19806953 24047854 0.82
tpcds_q93/datafusion:vortex-file-compressed 34376458 35231415 0.98
tpcds_q94/datafusion:vortex-file-compressed 25122865 26346030 0.95
tpcds_q95/datafusion:vortex-file-compressed 61505784 62867687 0.98
tpcds_q96/datafusion:vortex-file-compressed 14026312 14489964 0.97
tpcds_q97/datafusion:vortex-file-compressed 32887349 33454006 0.98
tpcds_q98/datafusion:vortex-file-compressed 28662235 29435351 0.97
tpcds_q99/datafusion:vortex-file-compressed 43922477 43480610 1.01
datafusion / vortex-compact (0.898x ✅, 40↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 27102228 28684526 0.94
tpcds_q02/datafusion:vortex-compact 54287879 56042683 0.97
tpcds_q03/datafusion:vortex-compact 🚀 22429491 25110677 0.89
tpcds_q04/datafusion:vortex-compact 298348181 327192962 0.91
tpcds_q05/datafusion:vortex-compact 52042555 56591393 0.92
tpcds_q06/datafusion:vortex-compact 46658008 51378131 0.91
tpcds_q07/datafusion:vortex-compact 🚀 55565894 61940333 0.90
tpcds_q08/datafusion:vortex-compact 37308156 41369795 0.90
tpcds_q09/datafusion:vortex-compact 🚀 62320779 77413221 0.81
tpcds_q10/datafusion:vortex-compact 🚀 51808661 61294374 0.85
tpcds_q11/datafusion:vortex-compact 🚀 168949305 206440338 0.82
tpcds_q12/datafusion:vortex-compact 🚀 25577317 28567744 0.90
tpcds_q13/datafusion:vortex-compact 96096855 98728119 0.97
tpcds_q14/datafusion:vortex-compact 205029003 213553363 0.96
tpcds_q15/datafusion:vortex-compact 🚀 33876553 38555631 0.88
tpcds_q16/datafusion:vortex-compact 35541525 39164324 0.91
tpcds_q17/datafusion:vortex-compact 🚀 77502529 91439037 0.85
tpcds_q18/datafusion:vortex-compact 79992393 87278355 0.92
tpcds_q19/datafusion:vortex-compact 34547435 34576409 1.00
tpcds_q20/datafusion:vortex-compact 26604422 27961878 0.95
tpcds_q21/datafusion:vortex-compact 🚀 128978097 147957699 0.87
tpcds_q22/datafusion:vortex-compact 🚀 59379916 70955718 0.84
tpcds_q23/datafusion:vortex-compact 145357341 155353648 0.94
tpcds_q24/datafusion:vortex-compact 🚀 115172560 129033971 0.89
tpcds_q25/datafusion:vortex-compact 80706387 89141071 0.91
tpcds_q26/datafusion:vortex-compact 🚀 47512910 52947803 0.90
tpcds_q27/datafusion:vortex-compact 🚀 125322828 144178496 0.87
tpcds_q28/datafusion:vortex-compact 79803484 88629434 0.90
tpcds_q29/datafusion:vortex-compact 🚀 77991273 89974535 0.87
tpcds_q30/datafusion:vortex-compact 🚀 28298977 32052202 0.88
tpcds_q31/datafusion:vortex-compact 110958307 123142982 0.90
tpcds_q32/datafusion:vortex-compact 27046393 29176509 0.93
tpcds_q33/datafusion:vortex-compact 37488957 40248832 0.93
tpcds_q34/datafusion:vortex-compact 🚀 36005476 45142881 0.80
tpcds_q35/datafusion:vortex-compact 🚀 59006555 72472031 0.81
tpcds_q36/datafusion:vortex-compact 🚀 78585009 91816864 0.86
tpcds_q37/datafusion:vortex-compact 🚀 44002344 49457229 0.89
tpcds_q38/datafusion:vortex-compact 58347826 64806355 0.90
tpcds_q39/datafusion:vortex-compact 138446933 146762583 0.94
tpcds_q40/datafusion:vortex-compact 52843721 55080996 0.96
tpcds_q41/datafusion:vortex-compact 18748753 20255966 0.93
tpcds_q42/datafusion:vortex-compact 20551097 21767857 0.94
tpcds_q43/datafusion:vortex-compact 35164671 36708159 0.96
tpcds_q44/datafusion:vortex-compact 52253363 57524255 0.91
tpcds_q45/datafusion:vortex-compact 🚀 37276247 47885673 0.78
tpcds_q46/datafusion:vortex-compact 🚀 53102393 59870554 0.89
tpcds_q47/datafusion:vortex-compact 🚀 205607953 229741178 0.89
tpcds_q48/datafusion:vortex-compact 72493162 78324032 0.93
tpcds_q49/datafusion:vortex-compact 71965832 77295651 0.93
tpcds_q50/datafusion:vortex-compact 51439876 55154607 0.93
tpcds_q51/datafusion:vortex-compact 97741481 101519683 0.96
tpcds_q52/datafusion:vortex-compact 🚀 20919892 23756768 0.88
tpcds_q53/datafusion:vortex-compact 29842656 30683259 0.97
tpcds_q54/datafusion:vortex-compact 🚀 45767343 52718578 0.87
tpcds_q55/datafusion:vortex-compact 20689009 21804322 0.95
tpcds_q56/datafusion:vortex-compact 🚀 39574243 45667795 0.87
tpcds_q57/datafusion:vortex-compact 128491777 139748988 0.92
tpcds_q58/datafusion:vortex-compact 75148500 80157072 0.94
tpcds_q59/datafusion:vortex-compact 76247922 84480450 0.90
tpcds_q60/datafusion:vortex-compact 40089704 44130169 0.91
tpcds_q61/datafusion:vortex-compact 55350646 59964059 0.92
tpcds_q62/datafusion:vortex-compact 31323320 33234703 0.94
tpcds_q63/datafusion:vortex-compact 28624761 30789145 0.93
tpcds_q64/datafusion:vortex-compact 481513027 517568169 0.93
tpcds_q65/datafusion:vortex-compact 58647217 60644612 0.97
tpcds_q66/datafusion:vortex-compact 90315203 95535572 0.95
tpcds_q67/datafusion:vortex-compact 122093279 133193303 0.92
tpcds_q68/datafusion:vortex-compact 🚀 52401754 59168285 0.89
tpcds_q69/datafusion:vortex-compact 48683672 51428002 0.95
tpcds_q70/datafusion:vortex-compact 114588995 127144756 0.90
tpcds_q71/datafusion:vortex-compact 33970071 37401538 0.91
tpcds_q72/datafusion:vortex-compact 🚀 2409973922 3462276625 0.70
tpcds_q73/datafusion:vortex-compact 🚀 35149618 49890567 0.70
tpcds_q74/datafusion:vortex-compact 🚀 114459733 139562989 0.82
tpcds_q75/datafusion:vortex-compact 🚀 135653268 172785423 0.79
tpcds_q76/datafusion:vortex-compact 🚀 35789182 45871282 0.78
tpcds_q77/datafusion:vortex-compact 🚀 53960061 70428736 0.77
tpcds_q78/datafusion:vortex-compact 🚀 142741407 206258122 0.69
tpcds_q79/datafusion:vortex-compact 43311782 46931058 0.92
tpcds_q80/datafusion:vortex-compact 🚀 110248214 123899890 0.89
tpcds_q81/datafusion:vortex-compact 🚀 34570616 38592015 0.90
tpcds_q82/datafusion:vortex-compact 44881736 49603583 0.90
tpcds_q83/datafusion:vortex-compact 47677618 52011085 0.92
tpcds_q84/datafusion:vortex-compact 🚀 16064766 18282876 0.88
tpcds_q85/datafusion:vortex-compact 123767229 136665232 0.91
tpcds_q86/datafusion:vortex-compact 🚀 22086943 25811985 0.86
tpcds_q87/datafusion:vortex-compact 🚀 59997798 68402288 0.88
tpcds_q88/datafusion:vortex-compact 79507707 85360624 0.93
tpcds_q89/datafusion:vortex-compact 🚀 38231301 43823682 0.87
tpcds_q90/datafusion:vortex-compact 🚀 15497651 18546379 0.84
tpcds_q91/datafusion:vortex-compact 37786227 41130142 0.92
tpcds_q92/datafusion:vortex-compact 27080488 27758265 0.98
tpcds_q93/datafusion:vortex-compact 39547934 43425926 0.91
tpcds_q94/datafusion:vortex-compact 29681676 28378668 1.05
tpcds_q95/datafusion:vortex-compact 62228552 66058637 0.94
tpcds_q96/datafusion:vortex-compact 18602726 18323700 1.02
tpcds_q97/datafusion:vortex-compact 38517529 39711318 0.97
tpcds_q98/datafusion:vortex-compact 33850460 33747102 1.00
tpcds_q99/datafusion:vortex-compact 46322081 45732205 1.01
datafusion / parquet (0.909x ➖, 31↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 29154125 29906439 0.97
tpcds_q02/datafusion:parquet 41817854 41484533 1.01
tpcds_q03/datafusion:parquet 12951961 14106549 0.92
tpcds_q04/datafusion:parquet 274026323 274866238 1.00
tpcds_q05/datafusion:parquet 42730268 43337129 0.99
tpcds_q06/datafusion:parquet 58497908 59347424 0.99
tpcds_q07/datafusion:parquet 79943517 83742327 0.95
tpcds_q08/datafusion:parquet 26962939 27394478 0.98
tpcds_q09/datafusion:parquet 45432235 49559660 0.92
tpcds_q10/datafusion:parquet 73202775 74034835 0.99
tpcds_q11/datafusion:parquet 153076009 167571929 0.91
tpcds_q12/datafusion:parquet 18322215 18357921 1.00
tpcds_q13/datafusion:parquet 79286742 82217919 0.96
tpcds_q14/datafusion:parquet 🚀 162359583 181306993 0.90
tpcds_q15/datafusion:parquet 20894629 22034841 0.95
tpcds_q16/datafusion:parquet 24471660 25440786 0.96
tpcds_q17/datafusion:parquet 61890943 66959913 0.92
tpcds_q18/datafusion:parquet 🚀 114267391 130402545 0.88
tpcds_q19/datafusion:parquet 22768184 24482927 0.93
tpcds_q20/datafusion:parquet 16140963 16804691 0.96
tpcds_q21/datafusion:parquet 18783158 20698763 0.91
tpcds_q22/datafusion:parquet 🚀 130673704 163936622 0.80
tpcds_q23/datafusion:parquet 🚀 141530532 157655673 0.90
tpcds_q24/datafusion:parquet 91968427 94416049 0.97
tpcds_q25/datafusion:parquet 64302765 66944047 0.96
tpcds_q26/datafusion:parquet 65623676 72069530 0.91
tpcds_q27/datafusion:parquet 149007498 158598594 0.94
tpcds_q28/datafusion:parquet 🚀 44106585 54678178 0.81
tpcds_q29/datafusion:parquet 🚀 67170332 85291822 0.79
tpcds_q30/datafusion:parquet 🚀 34910916 39282140 0.89
tpcds_q31/datafusion:parquet 🚀 64992642 74065076 0.88
tpcds_q32/datafusion:parquet 18390401 20034542 0.92
tpcds_q33/datafusion:parquet 27222452 29291173 0.93
tpcds_q34/datafusion:parquet 21965805 23455557 0.94
tpcds_q35/datafusion:parquet 🚀 69907795 80961858 0.86
tpcds_q36/datafusion:parquet 🚀 55177953 66632576 0.83
tpcds_q37/datafusion:parquet 🚀 19113565 23716987 0.81
tpcds_q38/datafusion:parquet 43273482 47289979 0.92
tpcds_q39/datafusion:parquet 🚀 72252734 83470668 0.87
tpcds_q40/datafusion:parquet 23233989 25550539 0.91
tpcds_q41/datafusion:parquet 13360202 14078115 0.95
tpcds_q42/datafusion:parquet 12405202 11999724 1.03
tpcds_q43/datafusion:parquet 16521703 17080829 0.97
tpcds_q44/datafusion:parquet 32653961 35464168 0.92
tpcds_q45/datafusion:parquet 28234040 28933959 0.98
tpcds_q46/datafusion:parquet 32205392 33274349 0.97
tpcds_q47/datafusion:parquet 122928460 130440555 0.94
tpcds_q48/datafusion:parquet 73308424 78901608 0.93
tpcds_q49/datafusion:parquet 54647883 56818251 0.96
tpcds_q50/datafusion:parquet 42570403 43877736 0.97
tpcds_q51/datafusion:parquet 84651522 85878226 0.99
tpcds_q52/datafusion:parquet 12018808 13314676 0.90
tpcds_q53/datafusion:parquet 18139024 19791493 0.92
tpcds_q54/datafusion:parquet 34244529 37061206 0.92
tpcds_q55/datafusion:parquet 🚀 11144444 13464776 0.83
tpcds_q56/datafusion:parquet 26699960 29384434 0.91
tpcds_q57/datafusion:parquet 🚀 92231655 114790452 0.80
tpcds_q58/datafusion:parquet 48006216 52168921 0.92
tpcds_q59/datafusion:parquet 52123514 56117338 0.93
tpcds_q60/datafusion:parquet 28152251 30327265 0.93
tpcds_q61/datafusion:parquet 42911080 46626343 0.92
tpcds_q62/datafusion:parquet 24844648 26090649 0.95
tpcds_q63/datafusion:parquet 17558661 19165327 0.92
tpcds_q64/datafusion:parquet 515551211 547866921 0.94
tpcds_q65/datafusion:parquet 37613908 39431199 0.95
tpcds_q66/datafusion:parquet 🚀 64353671 74050209 0.87
tpcds_q67/datafusion:parquet 143080068 149187132 0.96
tpcds_q68/datafusion:parquet 32131507 34424495 0.93
tpcds_q69/datafusion:parquet 69635106 70250832 0.99
tpcds_q70/datafusion:parquet 🚀 88474410 103677155 0.85
tpcds_q71/datafusion:parquet 22973265 25328458 0.91
tpcds_q72/datafusion:parquet 🚀 591818351 667221343 0.89
tpcds_q73/datafusion:parquet 🚀 21273371 29383926 0.72
tpcds_q74/datafusion:parquet 🚀 81663686 115292209 0.71
tpcds_q75/datafusion:parquet 🚀 98820141 132461136 0.75
tpcds_q76/datafusion:parquet 🚀 29241677 37512187 0.78
tpcds_q77/datafusion:parquet 🚀 40402335 51132997 0.79
tpcds_q78/datafusion:parquet 🚀 111902564 155614468 0.72
tpcds_q79/datafusion:parquet 🚀 26310291 35756168 0.74
tpcds_q80/datafusion:parquet 🚀 78647841 89589271 0.88
tpcds_q81/datafusion:parquet 🚀 31850689 35449630 0.90
tpcds_q82/datafusion:parquet 19320154 20878833 0.93
tpcds_q83/datafusion:parquet 🚀 36292893 40776064 0.89
tpcds_q84/datafusion:parquet 🚀 38969101 43416401 0.90
tpcds_q85/datafusion:parquet 150256806 165610897 0.91
tpcds_q86/datafusion:parquet 15610184 16110301 0.97
tpcds_q87/datafusion:parquet 🚀 39648131 45963837 0.86
tpcds_q88/datafusion:parquet 60024954 64788587 0.93
tpcds_q89/datafusion:parquet 🚀 21107260 25014965 0.84
tpcds_q90/datafusion:parquet 14794317 15152015 0.98
tpcds_q91/datafusion:parquet 59126706 61317482 0.96
tpcds_q92/datafusion:parquet 17746290 18835006 0.94
tpcds_q93/datafusion:parquet 31095415 32099775 0.97
tpcds_q94/datafusion:parquet 20084095 20904206 0.96
tpcds_q95/datafusion:parquet 57557628 58517378 0.98
tpcds_q96/datafusion:parquet 11945710 12531919 0.95
tpcds_q97/datafusion:parquet 29580412 29954389 0.99
tpcds_q98/datafusion:parquet 21066750 21764286 0.97
tpcds_q99/datafusion:parquet 🚀 24533055 30913468 0.79
duckdb / vortex-file-compressed (0.955x ➖, 11↑ 1↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 22696909 22941327 0.99
tpcds_q02/duckdb:vortex-file-compressed 33283816 33270604 1.00
tpcds_q03/duckdb:vortex-file-compressed 31737517 31933448 0.99
tpcds_q04/duckdb:vortex-file-compressed 105205522 107413860 0.98
tpcds_q05/duckdb:vortex-file-compressed 37184652 36452803 1.02
tpcds_q06/duckdb:vortex-file-compressed 33987217 32506868 1.05
tpcds_q07/duckdb:vortex-file-compressed 20025863 20038720 1.00
tpcds_q08/duckdb:vortex-file-compressed 28184076 28363200 0.99
tpcds_q09/duckdb:vortex-file-compressed 37502236 39803460 0.94
tpcds_q10/duckdb:vortex-file-compressed 41778493 40252283 1.04
tpcds_q11/duckdb:vortex-file-compressed 60933272 61133105 1.00
tpcds_q12/duckdb:vortex-file-compressed 🚀 14659336 17034963 0.86
tpcds_q13/duckdb:vortex-file-compressed 32138075 35232611 0.91
tpcds_q14/duckdb:vortex-file-compressed 103038089 111904079 0.92
tpcds_q15/duckdb:vortex-file-compressed 26893913 28024848 0.96
tpcds_q16/duckdb:vortex-file-compressed 27260423 28876421 0.94
tpcds_q17/duckdb:vortex-file-compressed 42479996 46085217 0.92
tpcds_q18/duckdb:vortex-file-compressed 47965632 51833135 0.93
tpcds_q19/duckdb:vortex-file-compressed 33386277 34221747 0.98
tpcds_q20/duckdb:vortex-file-compressed 15497652 16359482 0.95
tpcds_q21/duckdb:vortex-file-compressed 🚀 17266457 19920326 0.87
tpcds_q22/duckdb:vortex-file-compressed 73047968 76559728 0.95
tpcds_q23/duckdb:vortex-file-compressed 106605538 111154260 0.96
tpcds_q24/duckdb:vortex-file-compressed 49066896 49123264 1.00
tpcds_q25/duckdb:vortex-file-compressed 48398547 51441217 0.94
tpcds_q26/duckdb:vortex-file-compressed 39442818 41437463 0.95
tpcds_q27/duckdb:vortex-file-compressed 48289836 49447494 0.98
tpcds_q28/duckdb:vortex-file-compressed 36136436 36180376 1.00
tpcds_q29/duckdb:vortex-file-compressed 🚀 40174433 45601880 0.88
tpcds_q30/duckdb:vortex-file-compressed 25451836 26402753 0.96
tpcds_q31/duckdb:vortex-file-compressed 35966441 38090787 0.94
tpcds_q32/duckdb:vortex-file-compressed 🚀 14055820 18148511 0.77
tpcds_q33/duckdb:vortex-file-compressed 🚀 24789381 29810865 0.83
tpcds_q34/duckdb:vortex-file-compressed 23818883 24280901 0.98
tpcds_q35/duckdb:vortex-file-compressed 66306704 67045930 0.99
tpcds_q36/duckdb:vortex-file-compressed 24247572 25065532 0.97
tpcds_q37/duckdb:vortex-file-compressed 16045087 16419723 0.98
tpcds_q38/duckdb:vortex-file-compressed 38291525 38611022 0.99
tpcds_q39/duckdb:vortex-file-compressed 34734818 37284988 0.93
tpcds_q40/duckdb:vortex-file-compressed 20974527 20900330 1.00
tpcds_q41/duckdb:vortex-file-compressed 13222336 13981623 0.95
tpcds_q42/duckdb:vortex-file-compressed 13086594 13369008 0.98
tpcds_q43/duckdb:vortex-file-compressed 23600046 22973898 1.03
tpcds_q44/duckdb:vortex-file-compressed 20776469 22162969 0.94
tpcds_q45/duckdb:vortex-file-compressed 28841909 31035557 0.93
tpcds_q46/duckdb:vortex-file-compressed 52228829 55710677 0.94
tpcds_q47/duckdb:vortex-file-compressed 46547356 49465367 0.94
tpcds_q48/duckdb:vortex-file-compressed 29881411 31950136 0.94
tpcds_q49/duckdb:vortex-file-compressed 33945410 34277899 0.99
tpcds_q50/duckdb:vortex-file-compressed 34733966 36035145 0.96
tpcds_q51/duckdb:vortex-file-compressed 100251593 98262191 1.02
tpcds_q52/duckdb:vortex-file-compressed 13314534 14053473 0.95
tpcds_q53/duckdb:vortex-file-compressed 22863776 24774291 0.92
tpcds_q54/duckdb:vortex-file-compressed 28794550 29206696 0.99
tpcds_q55/duckdb:vortex-file-compressed 12747096 14143502 0.90
tpcds_q56/duckdb:vortex-file-compressed 25627817 25336905 1.01
tpcds_q57/duckdb:vortex-file-compressed 40010378 41368028 0.97
tpcds_q58/duckdb:vortex-file-compressed 🚀 29494185 33199456 0.89
tpcds_q59/duckdb:vortex-file-compressed 67322288 67888277 0.99
tpcds_q60/duckdb:vortex-file-compressed 26851016 27696994 0.97
tpcds_q61/duckdb:vortex-file-compressed 🚀 31987318 35844265 0.89
tpcds_q62/duckdb:vortex-file-compressed 17884652 18912229 0.95
tpcds_q63/duckdb:vortex-file-compressed 21168356 23448627 0.90
tpcds_q64/duckdb:vortex-file-compressed 82241012 87335846 0.94
tpcds_q65/duckdb:vortex-file-compressed 22873260 22813591 1.00
tpcds_q66/duckdb:vortex-file-compressed 29483709 30754473 0.96
tpcds_q67/duckdb:vortex-file-compressed 136488527 141585276 0.96
tpcds_q68/duckdb:vortex-file-compressed 40655091 43767515 0.93
tpcds_q69/duckdb:vortex-file-compressed 41920832 42566593 0.98
tpcds_q70/duckdb:vortex-file-compressed 26409811 28135398 0.94
tpcds_q71/duckdb:vortex-file-compressed 🚀 20996321 24515898 0.86
tpcds_q72/duckdb:vortex-file-compressed 171566980 176088820 0.97
tpcds_q73/duckdb:vortex-file-compressed 23243963 25466599 0.91
tpcds_q74/duckdb:vortex-file-compressed 77276664 76286174 1.01
tpcds_q75/duckdb:vortex-file-compressed 58618505 61611792 0.95
tpcds_q76/duckdb:vortex-file-compressed 18750174 19542517 0.96
tpcds_q77/duckdb:vortex-file-compressed 26229416 26916122 0.97
tpcds_q78/duckdb:vortex-file-compressed 74458274 72859752 1.02
tpcds_q79/duckdb:vortex-file-compressed 32799865 34296440 0.96
tpcds_q80/duckdb:vortex-file-compressed 50260920 47654693 1.05
tpcds_q81/duckdb:vortex-file-compressed 28703128 28993913 0.99
tpcds_q82/duckdb:vortex-file-compressed 17349705 18197210 0.95
tpcds_q83/duckdb:vortex-file-compressed 23943263 26144460 0.92
tpcds_q84/duckdb:vortex-file-compressed 🚀 19709402 22565526 0.87
tpcds_q85/duckdb:vortex-file-compressed 44743661 48049323 0.93
tpcds_q86/duckdb:vortex-file-compressed 🚀 16677128 19168066 0.87
tpcds_q87/duckdb:vortex-file-compressed 39684888 42624683 0.93
tpcds_q88/duckdb:vortex-file-compressed 35479483 36622391 0.97
tpcds_q89/duckdb:vortex-file-compressed 22865591 24260557 0.94
tpcds_q90/duckdb:vortex-file-compressed 🚀 12857535 14456856 0.89
tpcds_q91/duckdb:vortex-file-compressed 31145176 33273518 0.94
tpcds_q92/duckdb:vortex-file-compressed 21698771 22873839 0.95
tpcds_q93/duckdb:vortex-file-compressed 🚨 29157266 26288235 1.11
tpcds_q94/duckdb:vortex-file-compressed 23524219 25101753 0.94
tpcds_q95/duckdb:vortex-file-compressed 152919924 152475441 1.00
tpcds_q96/duckdb:vortex-file-compressed 13895295 15054740 0.92
tpcds_q97/duckdb:vortex-file-compressed 39054997 40242192 0.97
tpcds_q98/duckdb:vortex-file-compressed 18078822 18623675 0.97
tpcds_q99/duckdb:vortex-file-compressed 28784517 28555554 1.01
duckdb / vortex-compact (0.964x ➖, 5↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 24544851 24065033 1.02
tpcds_q02/duckdb:vortex-compact 40123941 41373924 0.97
tpcds_q03/duckdb:vortex-compact 58504992 56899339 1.03
tpcds_q04/duckdb:vortex-compact 120826001 123177567 0.98
tpcds_q05/duckdb:vortex-compact 53542552 53802549 1.00
tpcds_q06/duckdb:vortex-compact 41797243 43109572 0.97
tpcds_q07/duckdb:vortex-compact 33769354 35226747 0.96
tpcds_q08/duckdb:vortex-compact 49989600 46626895 1.07
tpcds_q09/duckdb:vortex-compact 59426110 60905423 0.98
tpcds_q10/duckdb:vortex-compact 62194798 65704375 0.95
tpcds_q11/duckdb:vortex-compact 72048115 76009472 0.95
tpcds_q12/duckdb:vortex-compact 22642840 24282877 0.93
tpcds_q13/duckdb:vortex-compact 57830680 59571309 0.97
tpcds_q14/duckdb:vortex-compact 129340480 133114684 0.97
tpcds_q15/duckdb:vortex-compact 🚀 31238548 36151973 0.86
tpcds_q16/duckdb:vortex-compact 31903835 34699889 0.92
tpcds_q17/duckdb:vortex-compact 54902051 58314202 0.94
tpcds_q18/duckdb:vortex-compact 56817817 61771530 0.92
tpcds_q19/duckdb:vortex-compact 51662864 54780850 0.94
tpcds_q20/duckdb:vortex-compact 20176590 21565036 0.94
tpcds_q21/duckdb:vortex-compact 18972183 20299882 0.93
tpcds_q22/duckdb:vortex-compact 75287964 81100779 0.93
tpcds_q23/duckdb:vortex-compact 130531622 118746307 1.10
tpcds_q24/duckdb:vortex-compact 65582542 67146508 0.98
tpcds_q25/duckdb:vortex-compact 81205049 83011067 0.98
tpcds_q26/duckdb:vortex-compact 53384009 53072998 1.01
tpcds_q27/duckdb:vortex-compact 70415913 73103982 0.96
tpcds_q28/duckdb:vortex-compact 83781118 89692316 0.93
tpcds_q29/duckdb:vortex-compact 53009127 58142544 0.91
tpcds_q30/duckdb:vortex-compact 🚀 29055629 32594793 0.89
tpcds_q31/duckdb:vortex-compact 46382476 51451694 0.90
tpcds_q32/duckdb:vortex-compact 23033006 24756699 0.93
tpcds_q33/duckdb:vortex-compact 36542085 37056666 0.99
tpcds_q34/duckdb:vortex-compact 39711229 40799934 0.97
tpcds_q35/duckdb:vortex-compact 85396534 86242976 0.99
tpcds_q36/duckdb:vortex-compact 41014547 44640153 0.92
tpcds_q37/duckdb:vortex-compact 🚀 23218818 26771341 0.87
tpcds_q38/duckdb:vortex-compact 50237863 49489686 1.02
tpcds_q39/duckdb:vortex-compact 37582607 37909568 0.99
tpcds_q40/duckdb:vortex-compact 24824971 27499880 0.90
tpcds_q41/duckdb:vortex-compact 15930683 16265950 0.98
tpcds_q42/duckdb:vortex-compact 22797226 23756281 0.96
tpcds_q43/duckdb:vortex-compact 36999035 37487031 0.99
tpcds_q44/duckdb:vortex-compact 29160580 31278186 0.93
tpcds_q45/duckdb:vortex-compact 39133325 41464064 0.94
tpcds_q46/duckdb:vortex-compact 70505574 72913931 0.97
tpcds_q47/duckdb:vortex-compact 62940960 64194105 0.98
tpcds_q48/duckdb:vortex-compact 53967763 53843306 1.00
tpcds_q49/duckdb:vortex-compact 58006335 58985013 0.98
tpcds_q50/duckdb:vortex-compact 48202479 49340657 0.98
tpcds_q51/duckdb:vortex-compact 114664624 110839162 1.03
tpcds_q52/duckdb:vortex-compact 22342299 23166436 0.96
tpcds_q53/duckdb:vortex-compact 39314014 39527787 0.99
tpcds_q54/duckdb:vortex-compact 41748042 43166086 0.97
tpcds_q55/duckdb:vortex-compact 22752351 23982405 0.95
tpcds_q56/duckdb:vortex-compact 36318703 37558880 0.97
tpcds_q57/duckdb:vortex-compact 43073229 44378193 0.97
tpcds_q58/duckdb:vortex-compact 42648320 46270831 0.92
tpcds_q59/duckdb:vortex-compact 86876334 88870650 0.98
tpcds_q60/duckdb:vortex-compact 40193384 40983256 0.98
tpcds_q61/duckdb:vortex-compact 63553107 66254968 0.96
tpcds_q62/duckdb:vortex-compact 🚀 22801020 27040079 0.84
tpcds_q63/duckdb:vortex-compact 37896424 37960876 1.00
tpcds_q64/duckdb:vortex-compact 117223696 118427109 0.99
tpcds_q65/duckdb:vortex-compact 33925654 34499919 0.98
tpcds_q66/duckdb:vortex-compact 39820344 40097092 0.99
tpcds_q67/duckdb:vortex-compact 156335894 158766648 0.98
tpcds_q68/duckdb:vortex-compact 64671347 66024076 0.98
tpcds_q69/duckdb:vortex-compact 63029938 68591394 0.92
tpcds_q70/duckdb:vortex-compact 37228353 37133079 1.00
tpcds_q71/duckdb:vortex-compact 33747392 35380693 0.95
tpcds_q72/duckdb:vortex-compact 192281085 193958531 0.99
tpcds_q73/duckdb:vortex-compact 38613871 42298397 0.91
tpcds_q74/duckdb:vortex-compact 82921944 84058274 0.99
tpcds_q75/duckdb:vortex-compact 75685191 73001029 1.04
tpcds_q76/duckdb:vortex-compact 34799481 36082145 0.96
tpcds_q77/duckdb:vortex-compact 43181980 45260556 0.95
tpcds_q78/duckdb:vortex-compact 86702474 89141152 0.97
tpcds_q79/duckdb:vortex-compact 54886503 55536132 0.99
tpcds_q80/duckdb:vortex-compact 85006634 83602322 1.02
tpcds_q81/duckdb:vortex-compact 34010761 34982921 0.97
tpcds_q82/duckdb:vortex-compact 27947513 28088656 0.99
tpcds_q83/duckdb:vortex-compact 32874887 34408929 0.96
tpcds_q84/duckdb:vortex-compact 27701850 29328772 0.94
tpcds_q85/duckdb:vortex-compact 58836247 59753716 0.98
tpcds_q86/duckdb:vortex-compact 24617395 25581770 0.96
tpcds_q87/duckdb:vortex-compact 53133763 52897746 1.00
tpcds_q88/duckdb:vortex-compact 40750234 41950972 0.97
tpcds_q89/duckdb:vortex-compact 38169020 39631830 0.96
tpcds_q90/duckdb:vortex-compact 15215565 16876205 0.90
tpcds_q91/duckdb:vortex-compact 50739712 51512617 0.98
tpcds_q92/duckdb:vortex-compact 46566476 49884306 0.93
tpcds_q93/duckdb:vortex-compact 31192431 32893097 0.95
tpcds_q94/duckdb:vortex-compact 30631481 33944162 0.90
tpcds_q95/duckdb:vortex-compact 🚀 147548119 164399324 0.90
tpcds_q96/duckdb:vortex-compact 19148210 18653449 1.03
tpcds_q97/duckdb:vortex-compact 43618956 45647061 0.96
tpcds_q98/duckdb:vortex-compact 29843334 30705083 0.97
tpcds_q99/duckdb:vortex-compact 33769369 31890572 1.06
duckdb / parquet (0.976x ➖, 5↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 🚀 27670284 32516565 0.85
tpcds_q02/duckdb:parquet 23283981 24125787 0.97
tpcds_q03/duckdb:parquet 11366953 12110311 0.94
tpcds_q04/duckdb:parquet 168887383 173568995 0.97
tpcds_q05/duckdb:parquet 29319773 30926821 0.95
tpcds_q06/duckdb:parquet 27992755 28588796 0.98
tpcds_q07/duckdb:parquet 20952456 22572793 0.93
tpcds_q08/duckdb:parquet 🚀 26953509 30059122 0.90
tpcds_q09/duckdb:parquet 39441616 38908012 1.01
tpcds_q10/duckdb:parquet 32999856 33591961 0.98
tpcds_q11/duckdb:parquet 84261255 92588543 0.91
tpcds_q12/duckdb:parquet 14742535 14513552 1.02
tpcds_q13/duckdb:parquet 32315463 32461564 1.00
tpcds_q14/duckdb:parquet 98790981 102817345 0.96
tpcds_q15/duckdb:parquet 30072719 30705384 0.98
tpcds_q16/duckdb:parquet 20348431 21239491 0.96
tpcds_q17/duckdb:parquet 36011291 38140762 0.94
tpcds_q18/duckdb:parquet 43806794 44776408 0.98
tpcds_q19/duckdb:parquet 28854908 28202765 1.02
tpcds_q20/duckdb:parquet 15397766 15744828 0.98
tpcds_q21/duckdb:parquet 9904908 10829710 0.91
tpcds_q22/duckdb:parquet 68341988 69406927 0.98
tpcds_q23/duckdb:parquet 82473138 82978237 0.99
tpcds_q24/duckdb:parquet 44759364 42912509 1.04
tpcds_q25/duckdb:parquet 32445688 31822788 1.02
tpcds_q26/duckdb:parquet 35043203 36553476 0.96
tpcds_q27/duckdb:parquet 48956762 48694429 1.01
tpcds_q28/duckdb:parquet 37017074 37942771 0.98
tpcds_q29/duckdb:parquet 35226945 33567754 1.05
tpcds_q30/duckdb:parquet 35446011 35229980 1.01
tpcds_q31/duckdb:parquet 🚀 22986796 26161981 0.88
tpcds_q32/duckdb:parquet 10966133 11340331 0.97
tpcds_q33/duckdb:parquet 20943416 20918026 1.00
tpcds_q34/duckdb:parquet 19787138 21499020 0.92
tpcds_q35/duckdb:parquet 59693125 58388791 1.02
tpcds_q36/duckdb:parquet 19332309 19717069 0.98
tpcds_q37/duckdb:parquet 12204730 12025393 1.01
tpcds_q38/duckdb:parquet 33273167 34621418 0.96
tpcds_q39/duckdb:parquet 29479784 29350747 1.00
tpcds_q40/duckdb:parquet 17193115 18255481 0.94
tpcds_q41/duckdb:parquet 7601711 7892135 0.96
tpcds_q42/duckdb:parquet 9887358 10280316 0.96
tpcds_q43/duckdb:parquet 15121929 15439338 0.98
tpcds_q44/duckdb:parquet 22606245 22716860 1.00
tpcds_q45/duckdb:parquet 25465592 25844717 0.99
tpcds_q46/duckdb:parquet 44892412 44127892 1.02
tpcds_q47/duckdb:parquet 44143214 45245662 0.98
tpcds_q48/duckdb:parquet 29190018 29500615 0.99
tpcds_q49/duckdb:parquet 24568085 24370205 1.01
tpcds_q50/duckdb:parquet 23766528 24293793 0.98
tpcds_q51/duckdb:parquet 92775264 95712307 0.97
tpcds_q52/duckdb:parquet 10020232 10286857 0.97
tpcds_q53/duckdb:parquet 14601806 15297875 0.95
tpcds_q54/duckdb:parquet 25703116 25702921 1.00
tpcds_q55/duckdb:parquet 9844749 10060177 0.98
tpcds_q56/duckdb:parquet 21491745 21601450 0.99
tpcds_q57/duckdb:parquet 35418480 34270560 1.03
tpcds_q58/duckdb:parquet 22666762 22318816 1.02
tpcds_q59/duckdb:parquet 35464451 36397523 0.97
tpcds_q60/duckdb:parquet 21924628 23477793 0.93
tpcds_q61/duckdb:parquet 31889250 29918593 1.07
tpcds_q62/duckdb:parquet 11840162 11928722 0.99
tpcds_q63/duckdb:parquet 13713538 14553144 0.94
tpcds_q64/duckdb:parquet 72708882 75569190 0.96
tpcds_q65/duckdb:parquet 19322875 19547367 0.99
tpcds_q66/duckdb:parquet 29717967 28276608 1.05
tpcds_q67/duckdb:parquet 133432025 137920837 0.97
tpcds_q68/duckdb:parquet 36145314 36695749 0.99
tpcds_q69/duckdb:parquet 37161130 35818862 1.04
tpcds_q70/duckdb:parquet 18917118 19369645 0.98
tpcds_q71/duckdb:parquet 18602844 18496551 1.01
tpcds_q72/duckdb:parquet 164913579 166402698 0.99
tpcds_q73/duckdb:parquet 17523580 17987344 0.97
tpcds_q74/duckdb:parquet 127832259 133951638 0.95
tpcds_q75/duckdb:parquet 52360058 52508490 1.00
tpcds_q76/duckdb:parquet 19327720 19037741 1.02
tpcds_q77/duckdb:parquet 21498928 21341748 1.01
tpcds_q78/duckdb:parquet 75945283 73746288 1.03
tpcds_q79/duckdb:parquet 26824761 27214459 0.99
tpcds_q80/duckdb:parquet 40948852 41163021 0.99
tpcds_q81/duckdb:parquet 31279443 31384794 1.00
tpcds_q82/duckdb:parquet 13268008 13851270 0.96
tpcds_q83/duckdb:parquet 16214605 16601434 0.98
tpcds_q84/duckdb:parquet 18757216 18596113 1.01
tpcds_q85/duckdb:parquet 38801944 37834484 1.03
tpcds_q86/duckdb:parquet 11805313 12292781 0.96
tpcds_q87/duckdb:parquet 36105909 37447737 0.96
tpcds_q88/duckdb:parquet 48364803 48936050 0.99
tpcds_q89/duckdb:parquet 15765427 16780643 0.94
tpcds_q90/duckdb:parquet 🚀 7454035 8662367 0.86
tpcds_q91/duckdb:parquet 21139303 22985245 0.92
tpcds_q92/duckdb:parquet 🚀 10381786 12918910 0.80
tpcds_q93/duckdb:parquet 28543925 31612904 0.90
tpcds_q94/duckdb:parquet 15819168 15938551 0.99
tpcds_q95/duckdb:parquet 139521609 134516894 1.04
tpcds_q96/duckdb:parquet 8449560 8898466 0.95
tpcds_q97/duckdb:parquet 35557200 35258095 1.01
tpcds_q98/duckdb:parquet 17823605 17833571 1.00
tpcds_q99/duckdb:parquet 19063684 20371564 0.94
duckdb / duckdb (0.974x ➖, 4↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20345214 19579649 1.04
tpcds_q02/duckdb:duckdb 19049308 18831311 1.01
tpcds_q03/duckdb:duckdb 9322076 9072445 1.03
tpcds_q04/duckdb:duckdb 179520697 175024789 1.03
tpcds_q05/duckdb:duckdb 19540576 20918143 0.93
tpcds_q06/duckdb:duckdb 23007892 22738051 1.01
tpcds_q07/duckdb:duckdb 37700965 38506174 0.98
tpcds_q08/duckdb:duckdb 122661250 120883142 1.01
tpcds_q09/duckdb:duckdb 19818066 20600284 0.96
tpcds_q10/duckdb:duckdb 23535012 24851158 0.95
tpcds_q11/duckdb:duckdb 91616999 88880426 1.03
tpcds_q12/duckdb:duckdb 🚀 10702517 12352761 0.87
tpcds_q13/duckdb:duckdb 24163223 24296097 0.99
tpcds_q14/duckdb:duckdb 90110550 94646153 0.95
tpcds_q15/duckdb:duckdb 24675085 24830859 0.99
tpcds_q16/duckdb:duckdb 18101501 18368365 0.99
tpcds_q17/duckdb:duckdb 22263102 22897007 0.97
tpcds_q18/duckdb:duckdb 44530466 43823126 1.02
tpcds_q19/duckdb:duckdb 16640725 18166310 0.92
tpcds_q20/duckdb:duckdb 12175137 11436789 1.06
tpcds_q21/duckdb:duckdb 🚀 6788364 8083743 0.84
tpcds_q22/duckdb:duckdb 59631224 66036694 0.90
tpcds_q23/duckdb:duckdb 78686655 79117847 0.99
tpcds_q24/duckdb:duckdb 24691107 25127688 0.98
tpcds_q25/duckdb:duckdb 17285450 17321516 1.00
tpcds_q26/duckdb:duckdb 27036438 27037752 1.00
tpcds_q27/duckdb:duckdb 38867502 38740863 1.00
tpcds_q28/duckdb:duckdb 21943743 22470977 0.98
tpcds_q29/duckdb:duckdb 20917095 20085180 1.04
tpcds_q30/duckdb:duckdb 29735641 30295283 0.98
tpcds_q31/duckdb:duckdb 48286307 49056348 0.98
tpcds_q32/duckdb:duckdb 7579653 7337336 1.03
tpcds_q33/duckdb:duckdb 12463088 13417633 0.93
tpcds_q34/duckdb:duckdb 14911753 15752768 0.95
tpcds_q35/duckdb:duckdb 31779762 33815088 0.94
tpcds_q36/duckdb:duckdb 70841180 67421560 1.05
tpcds_q37/duckdb:duckdb 🚀 7570410 8478827 0.89
tpcds_q38/duckdb:duckdb 29804510 30946866 0.96
tpcds_q39/duckdb:duckdb 25847142 26104949 0.99
tpcds_q40/duckdb:duckdb 13349852 14446325 0.92
tpcds_q41/duckdb:duckdb 8545128 8903157 0.96
tpcds_q42/duckdb:duckdb 6299229 6711605 0.94
tpcds_q43/duckdb:duckdb 11226602 11602699 0.97
tpcds_q44/duckdb:duckdb 14004092 14513362 0.96
tpcds_q45/duckdb:duckdb 17003017 18691931 0.91
tpcds_q46/duckdb:duckdb 37526794 36074307 1.04
tpcds_q47/duckdb:duckdb 39144162 41255506 0.95
tpcds_q48/duckdb:duckdb 22726735 23245168 0.98
tpcds_q49/duckdb:duckdb 16946494 17503392 0.97
tpcds_q50/duckdb:duckdb 14101679 14793298 0.95
tpcds_q51/duckdb:duckdb 91449476 92456515 0.99
tpcds_q52/duckdb:duckdb 7302662 7386998 0.99
tpcds_q53/duckdb:duckdb 13280413 13755756 0.97
tpcds_q54/duckdb:duckdb 16283566 16048033 1.01
tpcds_q55/duckdb:duckdb 6862002 7174413 0.96
tpcds_q56/duckdb:duckdb 13538311 14147915 0.96
tpcds_q57/duckdb:duckdb 32518800 32294843 1.01
tpcds_q58/duckdb:duckdb 12802797 13179556 0.97
tpcds_q59/duckdb:duckdb 35712238 36349606 0.98
tpcds_q60/duckdb:duckdb 14580452 15204507 0.96
tpcds_q61/duckdb:duckdb 14497615 15612552 0.93
tpcds_q62/duckdb:duckdb 9427405 10002597 0.94
tpcds_q63/duckdb:duckdb 12346086 12799630 0.96
tpcds_q64/duckdb:duckdb 53240920 56207041 0.95
tpcds_q65/duckdb:duckdb 33776816 32423295 1.04
tpcds_q66/duckdb:duckdb 25507210 26572945 0.96
tpcds_q67/duckdb:duckdb 128898001 130037664 0.99
tpcds_q68/duckdb:duckdb 25274278 25386439 1.00
tpcds_q69/duckdb:duckdb 25074119 25647968 0.98
tpcds_q70/duckdb:duckdb 14587754 14538668 1.00
tpcds_q71/duckdb:duckdb 12060185 13172739 0.92
tpcds_q72/duckdb:duckdb 44107976 44245880 1.00
tpcds_q73/duckdb:duckdb 11026168 10942145 1.01
tpcds_q74/duckdb:duckdb 146529524 149413011 0.98
tpcds_q75/duckdb:duckdb 42474163 42182625 1.01
tpcds_q76/duckdb:duckdb 12120375 12748297 0.95
tpcds_q77/duckdb:duckdb 13085367 12730735 1.03
tpcds_q78/duckdb:duckdb 64795112 64987347 1.00
tpcds_q79/duckdb:duckdb 18626114 18917079 0.98
tpcds_q80/duckdb:duckdb 28114968 27119732 1.04
tpcds_q81/duckdb:duckdb 36417526 38367430 0.95
tpcds_q82/duckdb:duckdb 8388616 8878055 0.94
tpcds_q83/duckdb:duckdb 9473874 9753299 0.97
tpcds_q84/duckdb:duckdb 13757460 14151552 0.97
tpcds_q85/duckdb:duckdb 24675556 24740084 1.00
tpcds_q86/duckdb:duckdb 10853636 11166965 0.97
tpcds_q87/duckdb:duckdb 34041738 35420901 0.96
tpcds_q88/duckdb:duckdb 25912667 27552616 0.94
tpcds_q89/duckdb:duckdb 15292622 14936011 1.02
tpcds_q90/duckdb:duckdb 5585488 5795525 0.96
tpcds_q91/duckdb:duckdb 13833736 13596813 1.02
tpcds_q92/duckdb:duckdb 8868724 9247114 0.96
tpcds_q93/duckdb:duckdb 22012989 23307809 0.94
tpcds_q94/duckdb:duckdb 12862876 12962096 0.99
tpcds_q95/duckdb:duckdb 🚀 108406758 130010503 0.83
tpcds_q96/duckdb:duckdb 4537531 4545358 1.00
tpcds_q97/duckdb:duckdb 30125110 32519280 0.93
tpcds_q98/duckdb:duckdb 13648436 13878572 0.98
tpcds_q99/duckdb:duckdb 16660169 16783978 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -5.5% -8.9% +3.7% +20.2% ➖ noise
1 datafusion:vortex-file-compressed -4.3% -8.9% +5.1% +21.6% ➖ noise
1 duckdb:duckdb +3.9% -8.9% +14.1% +22.0% ➖ noise
1 duckdb:vortex-compact +2.0% -8.9% +12.0% +27.7% ➖ noise
1 duckdb:vortex-file-compressed -1.1% -8.9% +8.6% +36.3% ➖ noise
2 datafusion:vortex-compact -3.1% -1.4% -1.8% +12.8% ➖ noise
2 datafusion:vortex-file-compressed -2.7% -1.4% -1.4% +11.9% ➖ noise
2 duckdb:duckdb +1.2% -1.4% +2.6% +13.5% ➖ noise
2 duckdb:vortex-compact -3.0% -1.4% -1.7% +27.5% ➖ noise
2 duckdb:vortex-file-compressed +0.0% -1.4% +1.4% +30.3% ➖ noise
3 datafusion:vortex-compact -10.7% -7.2% -3.8% +21.2% ➖ noise
3 datafusion:vortex-file-compressed -6.6% -7.2% +0.6% +13.8% ➖ noise
3 duckdb:duckdb +2.8% -7.2% +10.7% +17.2% ➖ noise
3 duckdb:vortex-compact +2.8% -7.2% +10.8% +12.8% ➖ noise
3 duckdb:vortex-file-compressed -0.6% -7.2% +7.1% +13.5% ➖ noise
4 datafusion:vortex-compact -8.8% -1.5% -7.4% +11.5% ➖ noise
4 datafusion:vortex-file-compressed -8.5% -1.5% -7.1% +11.5% ➖ noise
4 duckdb:duckdb +2.6% -1.5% +4.1% +11.5% ➖ noise
4 duckdb:vortex-compact -1.9% -1.5% -0.4% +11.5% ➖ noise
4 duckdb:vortex-file-compressed -2.1% -1.5% -0.6% +11.5% ➖ noise
5 datafusion:vortex-compact -8.0% -3.3% -4.9% +11.5% ➖ noise
5 datafusion:vortex-file-compressed -7.3% -3.3% -4.1% +11.5% ➖ noise
5 duckdb:duckdb -6.6% -3.3% -3.4% +12.6% ➖ noise
5 duckdb:vortex-compact -0.5% -3.3% +2.9% +11.5% ➖ noise
5 duckdb:vortex-file-compressed +2.0% -3.3% +5.5% +14.1% ➖ noise
6 datafusion:vortex-compact -9.2% -1.8% -7.6% +11.5% ➖ noise
6 datafusion:vortex-file-compressed -11.4% -1.8% -9.8% +11.5% ➖ noise
6 duckdb:duckdb +1.2% -1.8% +3.0% +11.5% ➖ noise
6 duckdb:vortex-compact -3.0% -1.8% -1.3% +12.3% ➖ noise
6 duckdb:vortex-file-compressed +4.6% -1.8% +6.4% +11.5% ➖ noise
7 datafusion:vortex-compact -10.3% -5.9% -4.7% +11.5% ➖ noise
7 datafusion:vortex-file-compressed -1.0% -5.9% +5.2% +11.5% ➖ noise
7 duckdb:duckdb -2.1% -5.9% +4.0% +14.7% ➖ noise
7 duckdb:vortex-compact -4.1% -5.9% +1.8% +11.5% ➖ noise
7 duckdb:vortex-file-compressed -0.1% -5.9% +6.2% +30.9% ➖ noise
8 datafusion:vortex-compact -9.8% -6.1% -4.0% +12.4% ➖ noise
8 datafusion:vortex-file-compressed -9.9% -6.1% -4.1% +13.1% ➖ noise
8 duckdb:duckdb +1.5% -6.1% +8.0% +11.5% ➖ noise
8 duckdb:vortex-compact +7.2% -6.1% +14.1% +11.5% 🚨 regression
8 duckdb:vortex-file-compressed -0.6% -6.1% +5.8% +11.5% ➖ noise
9 datafusion:vortex-compact -19.5% -3.6% -16.5% +13.1% ✅ faster
9 datafusion:vortex-file-compressed -10.9% -3.6% -7.5% +11.5% ➖ noise
9 duckdb:duckdb -3.8% -3.6% -0.2% +11.5% ➖ noise
9 duckdb:vortex-compact -2.4% -3.6% +1.2% +11.5% ➖ noise
9 duckdb:vortex-file-compressed -5.8% -3.6% -2.3% +19.7% ➖ noise
10 datafusion:vortex-compact -15.5% -1.4% -14.2% +20.6% ➖ noise
10 datafusion:vortex-file-compressed -18.1% -1.4% -16.9% +22.5% ➖ noise
10 duckdb:duckdb -5.3% -1.4% -3.9% +11.5% ➖ noise
10 duckdb:vortex-compact -5.3% -1.4% -4.0% +11.5% ➖ noise
10 duckdb:vortex-file-compressed +3.8% -1.4% +5.3% +11.5% ➖ noise
11 datafusion:vortex-compact -18.2% -8.8% -10.2% +11.5% ➖ noise
11 datafusion:vortex-file-compressed -22.1% -8.8% -14.6% +11.9% ✅ faster
11 duckdb:duckdb +3.1% -8.8% +13.1% +19.6% ➖ noise
11 duckdb:vortex-compact -5.2% -8.8% +4.0% +11.5% ➖ noise
11 duckdb:vortex-file-compressed -0.3% -8.8% +9.3% +13.7% ➖ noise
12 datafusion:vortex-compact -10.5% +0.7% -11.1% +12.1% ✅ faster
12 datafusion:vortex-file-compressed -9.9% +0.7% -10.5% +18.7% ➖ noise
12 duckdb:duckdb -13.4% +0.7% -14.0% +16.4% ➖ noise
12 duckdb:vortex-compact -6.8% +0.7% -7.4% +13.3% ➖ noise
12 duckdb:vortex-file-compressed -13.9% +0.7% -14.5% +14.3% ✅ faster
13 datafusion:vortex-compact -2.7% -2.0% -0.7% +11.5% ➖ noise
13 datafusion:vortex-file-compressed -13.4% -2.0% -11.7% +14.9% ➖ noise
13 duckdb:duckdb -0.5% -2.0% +1.5% +11.5% ➖ noise
13 duckdb:vortex-compact -2.9% -2.0% -0.9% +11.5% ➖ noise
13 duckdb:vortex-file-compressed -8.8% -2.0% -6.9% +11.5% ➖ noise
14 datafusion:vortex-compact -4.0% -7.2% +3.5% +11.5% ➖ noise
14 datafusion:vortex-file-compressed -13.9% -7.2% -7.1% +11.5% ➖ noise
14 duckdb:duckdb -4.8% -7.2% +2.6% +11.5% ➖ noise
14 duckdb:vortex-compact -2.8% -7.2% +4.7% +11.5% ➖ noise
14 duckdb:vortex-file-compressed -7.9% -7.2% -0.7% +12.3% ➖ noise
15 datafusion:vortex-compact -12.1% -3.6% -8.8% +25.5% ➖ noise
15 datafusion:vortex-file-compressed -6.6% -3.6% -3.1% +15.9% ➖ noise
15 duckdb:duckdb -0.6% -3.6% +3.1% +13.8% ➖ noise
15 duckdb:vortex-compact -13.6% -3.6% -10.3% +13.7% ➖ noise
15 duckdb:vortex-file-compressed -4.0% -3.6% -0.4% +15.5% ➖ noise
16 datafusion:vortex-compact -9.3% -4.0% -5.5% +15.5% ➖ noise
16 datafusion:vortex-file-compressed -7.7% -4.0% -3.8% +11.5% ➖ noise
16 duckdb:duckdb -1.5% -4.0% +2.7% +11.5% ➖ noise
16 duckdb:vortex-compact -8.1% -4.0% -4.2% +17.5% ➖ noise
16 duckdb:vortex-file-compressed -5.6% -4.0% -1.7% +11.5% ➖ noise
17 datafusion:vortex-compact -15.2% -6.6% -9.3% +11.5% ➖ noise
17 datafusion:vortex-file-compressed -13.8% -6.6% -7.7% +14.7% ➖ noise
17 duckdb:duckdb -2.8% -6.6% +4.1% +11.5% ➖ noise
17 duckdb:vortex-compact -5.9% -6.6% +0.8% +11.5% ➖ noise
17 duckdb:vortex-file-compressed -7.8% -6.6% -1.3% +13.9% ➖ noise
18 datafusion:vortex-compact -8.3% -7.4% -1.0% +14.1% ➖ noise
18 datafusion:vortex-file-compressed -21.4% -7.4% -15.1% +14.3% ✅ faster
18 duckdb:duckdb +1.6% -7.4% +9.7% +11.5% ➖ noise
18 duckdb:vortex-compact -8.0% -7.4% -0.7% +11.5% ➖ noise
18 duckdb:vortex-file-compressed -7.5% -7.4% -0.1% +14.8% ➖ noise
19 datafusion:vortex-compact -0.1% -2.5% +2.4% +11.5% ➖ noise
19 datafusion:vortex-file-compressed -4.9% -2.5% -2.5% +11.5% ➖ noise
19 duckdb:duckdb -8.4% -2.5% -6.1% +11.5% ➖ noise
19 duckdb:vortex-compact -5.7% -2.5% -3.3% +11.8% ➖ noise
19 duckdb:vortex-file-compressed -2.4% -2.5% +0.0% +11.5% ➖ noise
20 datafusion:vortex-compact -4.9% -3.1% -1.8% +11.5% ➖ noise
20 datafusion:vortex-file-compressed -3.9% -3.1% -0.9% +11.5% ➖ noise
20 duckdb:duckdb +6.5% -3.1% +9.8% +18.0% ➖ noise
20 duckdb:vortex-compact -6.4% -3.1% -3.5% +12.1% ➖ noise
20 duckdb:vortex-file-compressed -5.3% -3.1% -2.3% +29.2% ➖ noise
21 datafusion:vortex-compact -12.8% -8.9% -4.3% +11.6% ➖ noise
21 datafusion:vortex-file-compressed -8.8% -8.9% +0.1% +12.2% ➖ noise
21 duckdb:duckdb -16.0% -8.9% -7.8% +12.1% ➖ noise
21 duckdb:vortex-compact -6.5% -8.9% +2.6% +11.5% ➖ noise
21 duckdb:vortex-file-compressed -13.3% -8.9% -4.9% +15.2% ➖ noise
22 datafusion:vortex-compact -16.3% -11.4% -5.5% +16.5% ➖ noise
22 datafusion:vortex-file-compressed -13.3% -11.4% -2.1% +16.8% ➖ noise
22 duckdb:duckdb -9.7% -11.4% +1.9% +14.8% ➖ noise
22 duckdb:vortex-compact -7.2% -11.4% +4.8% +15.2% ➖ noise
22 duckdb:vortex-file-compressed -4.6% -11.4% +7.7% +11.5% ➖ noise
23 datafusion:vortex-compact -6.4% -5.5% -0.9% +11.5% ➖ noise
23 datafusion:vortex-file-compressed -8.2% -5.5% -2.8% +11.5% ➖ noise
23 duckdb:duckdb -0.5% -5.5% +5.3% +18.2% ➖ noise
23 duckdb:vortex-compact +9.9% -5.5% +16.4% +17.8% ➖ noise
23 duckdb:vortex-file-compressed -4.1% -5.5% +1.5% +11.5% ➖ noise
24 datafusion:vortex-compact -10.7% +0.8% -11.4% +11.5% ✅ faster
24 datafusion:vortex-file-compressed -9.5% +0.8% -10.2% +11.5% ➖ noise
24 duckdb:duckdb -1.7% +0.8% -2.5% +11.5% ➖ noise
24 duckdb:vortex-compact -2.3% +0.8% -3.1% +11.5% ➖ noise
24 duckdb:vortex-file-compressed -0.1% +0.8% -0.9% +11.5% ➖ noise
25 datafusion:vortex-compact -9.5% -1.0% -8.5% +11.5% ➖ noise
25 datafusion:vortex-file-compressed -12.1% -1.0% -11.1% +11.5% ✅ faster
25 duckdb:duckdb -0.2% -1.0% +0.8% +11.6% ➖ noise
25 duckdb:vortex-compact -2.2% -1.0% -1.1% +11.5% ➖ noise
25 duckdb:vortex-file-compressed -5.9% -1.0% -4.9% +13.6% ➖ noise
26 datafusion:vortex-compact -10.3% -6.6% -4.0% +15.4% ➖ noise
26 datafusion:vortex-file-compressed -8.9% -6.6% -2.5% +13.8% ➖ noise
26 duckdb:duckdb -0.0% -6.6% +7.0% +18.9% ➖ noise
26 duckdb:vortex-compact +0.6% -6.6% +7.7% +12.5% ➖ noise
26 duckdb:vortex-file-compressed -4.8% -6.6% +1.9% +11.5% ➖ noise
27 datafusion:vortex-compact -13.1% -2.8% -10.6% +12.9% ➖ noise
27 datafusion:vortex-file-compressed -19.6% -2.8% -17.2% +14.2% ✅ faster
27 duckdb:duckdb +0.3% -2.8% +3.2% +22.9% ➖ noise
27 duckdb:vortex-compact -3.7% -2.8% -0.9% +12.9% ➖ noise
27 duckdb:vortex-file-compressed -2.3% -2.8% +0.5% +20.3% ➖ noise
28 datafusion:vortex-compact -10.0% -11.3% +1.5% +11.5% ➖ noise
28 datafusion:vortex-file-compressed -11.4% -11.3% -0.2% +11.5% ➖ noise
28 duckdb:duckdb -2.3% -11.3% +10.1% +11.5% ➖ noise
28 duckdb:vortex-compact -6.6% -11.3% +5.3% +11.5% ➖ noise
28 duckdb:vortex-file-compressed -0.1% -11.3% +12.6% +11.5% 🚨 regression
29 datafusion:vortex-compact -13.3% -9.1% -4.7% +11.5% ➖ noise
29 datafusion:vortex-file-compressed -15.8% -9.1% -7.4% +13.0% ➖ noise
29 duckdb:duckdb +4.1% -9.1% +14.6% +14.8% ➖ noise
29 duckdb:vortex-compact -8.8% -9.1% +0.3% +11.5% ➖ noise
29 duckdb:vortex-file-compressed -11.9% -9.1% -3.1% +15.1% ➖ noise
30 datafusion:vortex-compact -11.7% -5.4% -6.6% +11.5% ➖ noise
30 datafusion:vortex-file-compressed -15.5% -5.4% -10.7% +25.0% ➖ noise
30 duckdb:duckdb -1.8% -5.4% +3.8% +11.5% ➖ noise
30 duckdb:vortex-compact -10.9% -5.4% -5.7% +11.5% ➖ noise
30 duckdb:vortex-file-compressed -3.6% -5.4% +1.9% +23.0% ➖ noise
31 datafusion:vortex-compact -9.9% -12.2% +2.6% +11.5% ➖ noise
31 datafusion:vortex-file-compressed -12.0% -12.2% +0.3% +11.5% ➖ noise
31 duckdb:duckdb -1.6% -12.2% +12.1% +11.5% 🚨 regression
31 duckdb:vortex-compact -9.9% -12.2% +2.7% +15.5% ➖ noise
31 duckdb:vortex-file-compressed -5.6% -12.2% +7.5% +12.9% ➖ noise
32 datafusion:vortex-compact -7.3% -5.8% -1.6% +11.5% ➖ noise
32 datafusion:vortex-file-compressed -13.0% -5.8% -7.7% +11.5% ➖ noise
32 duckdb:duckdb +3.3% -5.8% +9.6% +15.0% ➖ noise
32 duckdb:vortex-compact -7.0% -5.8% -1.2% +11.5% ➖ noise
32 duckdb:vortex-file-compressed -22.6% -5.8% -17.8% +18.0% ✅ faster
33 datafusion:vortex-compact -6.9% -3.5% -3.4% +12.0% ➖ noise
33 datafusion:vortex-file-compressed -4.6% -3.5% -1.1% +15.6% ➖ noise
33 duckdb:duckdb -7.1% -3.5% -3.7% +16.1% ➖ noise
33 duckdb:vortex-compact -1.4% -3.5% +2.2% +11.5% ➖ noise
33 duckdb:vortex-file-compressed -16.8% -3.5% -13.8% +11.5% ✅ faster
34 datafusion:vortex-compact -20.2% -7.2% -14.1% +20.2% ➖ noise
34 datafusion:vortex-file-compressed -17.4% -7.2% -11.1% +16.0% ➖ noise
34 duckdb:duckdb -5.3% -7.2% +2.0% +11.5% ➖ noise
34 duckdb:vortex-compact -2.7% -7.2% +4.8% +11.5% ➖ noise
34 duckdb:vortex-file-compressed -1.9% -7.2% +5.7% +12.2% ➖ noise
35 datafusion:vortex-compact -18.6% -6.0% -13.3% +12.3% ✅ faster
35 datafusion:vortex-file-compressed -14.9% -6.0% -9.4% +11.5% ➖ noise
35 duckdb:duckdb -6.0% -6.0% +0.0% +14.0% ➖ noise
35 duckdb:vortex-compact -1.0% -6.0% +5.4% +11.5% ➖ noise
35 duckdb:vortex-file-compressed -1.1% -6.0% +5.3% +11.5% ➖ noise
36 datafusion:vortex-compact -14.4% -9.9% -5.0% +11.5% ➖ noise
36 datafusion:vortex-file-compressed -21.0% -9.9% -12.3% +12.5% ✅ faster
36 duckdb:duckdb +5.1% -9.9% +16.6% +11.5% 🚨 regression
36 duckdb:vortex-compact -8.1% -9.9% +2.0% +13.5% ➖ noise
36 duckdb:vortex-file-compressed -3.3% -9.9% +7.4% +16.4% ➖ noise
37 datafusion:vortex-compact -11.0% -9.6% -1.6% +13.0% ➖ noise
37 datafusion:vortex-file-compressed -19.5% -9.6% -11.0% +22.6% ➖ noise
37 duckdb:duckdb -10.7% -9.6% -1.3% +16.8% ➖ noise
37 duckdb:vortex-compact -13.3% -9.6% -4.1% +13.6% ➖ noise
37 duckdb:vortex-file-compressed -2.3% -9.6% +8.0% +11.9% ➖ noise
38 datafusion:vortex-compact -10.0% -6.2% -4.0% +11.5% ➖ noise
38 datafusion:vortex-file-compressed -8.2% -6.2% -2.1% +11.5% ➖ noise
38 duckdb:duckdb -3.7% -6.2% +2.7% +11.5% ➖ noise
38 duckdb:vortex-compact +1.5% -6.2% +8.2% +18.7% ➖ noise
38 duckdb:vortex-file-compressed -0.8% -6.2% +5.8% +11.5% ➖ noise
39 datafusion:vortex-compact -5.7% -6.8% +1.2% +11.5% ➖ noise
39 datafusion:vortex-file-compressed -1.9% -6.8% +5.2% +11.5% ➖ noise
39 duckdb:duckdb -1.0% -6.8% +6.2% +27.5% ➖ noise
39 duckdb:vortex-compact -0.9% -6.8% +6.3% +15.5% ➖ noise
39 duckdb:vortex-file-compressed -6.8% -6.8% -0.1% +15.4% ➖ noise
40 datafusion:vortex-compact -4.1% -7.5% +3.7% +11.5% ➖ noise
40 datafusion:vortex-file-compressed -2.8% -7.5% +5.1% +12.4% ➖ noise
40 duckdb:duckdb -7.6% -7.5% -0.1% +13.6% ➖ noise
40 duckdb:vortex-compact -9.7% -7.5% -2.5% +11.7% ➖ noise
40 duckdb:vortex-file-compressed +0.4% -7.5% +8.4% +12.1% ➖ noise
41 datafusion:vortex-compact -7.4% -4.4% -3.2% +11.5% ➖ noise
41 datafusion:vortex-file-compressed -11.3% -4.4% -7.2% +11.7% ➖ noise
41 duckdb:duckdb -4.0% -4.4% +0.4% +11.5% ➖ noise
41 duckdb:vortex-compact -2.1% -4.4% +2.4% +11.9% ➖ noise
41 duckdb:vortex-file-compressed -5.4% -4.4% -1.1% +11.5% ➖ noise
42 datafusion:vortex-compact -5.6% -0.3% -5.3% +12.1% ➖ noise
42 datafusion:vortex-file-compressed -4.9% -0.3% -4.6% +14.5% ➖ noise
42 duckdb:duckdb -6.1% -0.3% -5.9% +15.0% ➖ noise
42 duckdb:vortex-compact -4.0% -0.3% -3.8% +18.5% ➖ noise
42 duckdb:vortex-file-compressed -2.1% -0.3% -1.8% +17.9% ➖ noise
43 datafusion:vortex-compact -4.2% -2.7% -1.6% +11.5% ➖ noise
43 datafusion:vortex-file-compressed -5.8% -2.7% -3.2% +11.5% ➖ noise
43 duckdb:duckdb -3.2% -2.7% -0.6% +15.8% ➖ noise
43 duckdb:vortex-compact -1.3% -2.7% +1.4% +11.5% ➖ noise
43 duckdb:vortex-file-compressed +2.7% -2.7% +5.5% +13.4% ➖ noise
44 datafusion:vortex-compact -9.2% -4.3% -5.1% +11.5% ➖ noise
44 datafusion:vortex-file-compressed -4.7% -4.3% -0.5% +11.5% ➖ noise
44 duckdb:duckdb -3.5% -4.3% +0.8% +11.5% ➖ noise
44 duckdb:vortex-compact -6.8% -4.3% -2.6% +11.5% ➖ noise
44 duckdb:vortex-file-compressed -6.3% -4.3% -2.1% +12.8% ➖ noise
45 datafusion:vortex-compact -22.2% -1.9% -20.6% +18.8% ✅ faster
45 datafusion:vortex-file-compressed -7.0% -1.9% -5.2% +11.5% ➖ noise
45 duckdb:duckdb -9.0% -1.9% -7.2% +18.9% ➖ noise
45 duckdb:vortex-compact -5.6% -1.9% -3.7% +11.5% ➖ noise
45 duckdb:vortex-file-compressed -7.1% -1.9% -5.2% +12.2% ➖ noise
46 datafusion:vortex-compact -11.3% -0.8% -10.6% +11.5% ✅ faster
46 datafusion:vortex-file-compressed -17.7% -0.8% -17.1% +13.4% ✅ faster
46 duckdb:duckdb +4.0% -0.8% +4.8% +11.5% ➖ noise
46 duckdb:vortex-compact -3.3% -0.8% -2.6% +11.5% ➖ noise
46 duckdb:vortex-file-compressed -6.2% -0.8% -5.5% +11.5% ➖ noise
47 datafusion:vortex-compact -10.5% -4.1% -6.7% +11.5% ➖ noise
47 datafusion:vortex-file-compressed -17.3% -4.1% -13.8% +11.5% ✅ faster
47 duckdb:duckdb -5.1% -4.1% -1.0% +11.5% ➖ noise
47 duckdb:vortex-compact -2.0% -4.1% +2.3% +11.5% ➖ noise
47 duckdb:vortex-file-compressed -5.9% -4.1% -1.9% +11.5% ➖ noise
48 datafusion:vortex-compact -7.4% -4.1% -3.5% +11.5% ➖ noise
48 datafusion:vortex-file-compressed -14.5% -4.1% -10.9% +12.2% ✅ faster
48 duckdb:duckdb -2.2% -4.1% +2.0% +11.5% ➖ noise
48 duckdb:vortex-compact +0.2% -4.1% +4.5% +11.5% ➖ noise
48 duckdb:vortex-file-compressed -6.5% -4.1% -2.5% +12.8% ➖ noise
49 datafusion:vortex-compact -6.9% -1.5% -5.4% +11.5% ➖ noise
49 datafusion:vortex-file-compressed -11.5% -1.5% -10.1% +11.5% ➖ noise
49 duckdb:duckdb -3.2% -1.5% -1.7% +13.9% ➖ noise
49 duckdb:vortex-compact -1.7% -1.5% -0.1% +13.9% ➖ noise
49 duckdb:vortex-file-compressed -1.0% -1.5% +0.6% +23.0% ➖ noise
50 datafusion:vortex-compact -6.7% -2.6% -4.3% +11.5% ➖ noise
50 datafusion:vortex-file-compressed -9.4% -2.6% -7.0% +11.5% ➖ noise
50 duckdb:duckdb -4.7% -2.6% -2.2% +11.5% ➖ noise
50 duckdb:vortex-compact -2.3% -2.6% +0.3% +11.5% ➖ noise
50 duckdb:vortex-file-compressed -3.6% -2.6% -1.1% +11.5% ➖ noise
51 datafusion:vortex-compact -3.7% -2.3% -1.5% +11.5% ➖ noise
51 datafusion:vortex-file-compressed -7.4% -2.3% -5.2% +11.5% ➖ noise
51 duckdb:duckdb -1.1% -2.3% +1.2% +19.2% ➖ noise
51 duckdb:vortex-compact +3.5% -2.3% +5.8% +16.0% ➖ noise
51 duckdb:vortex-file-compressed +2.0% -2.3% +4.4% +21.8% ➖ noise
52 datafusion:vortex-compact -11.9% -6.2% -6.1% +16.9% ➖ noise
52 datafusion:vortex-file-compressed -3.1% -6.2% +3.3% +18.0% ➖ noise
52 duckdb:duckdb -1.1% -6.2% +5.4% +15.0% ➖ noise
52 duckdb:vortex-compact -3.6% -6.2% +2.9% +11.5% ➖ noise
52 duckdb:vortex-file-compressed -5.3% -6.2% +1.0% +17.7% ➖ noise
53 datafusion:vortex-compact -2.7% -6.5% +4.0% +13.4% ➖ noise
53 datafusion:vortex-file-compressed -11.2% -6.5% -5.1% +11.5% ➖ noise
53 duckdb:duckdb -3.5% -6.5% +3.2% +11.8% ➖ noise
53 duckdb:vortex-compact -0.5% -6.5% +6.3% +11.7% ➖ noise
53 duckdb:vortex-file-compressed -7.7% -6.5% -1.3% +11.5% ➖ noise
54 datafusion:vortex-compact -13.2% -3.9% -9.7% +11.5% ➖ noise
54 datafusion:vortex-file-compressed -10.1% -3.9% -6.5% +12.1% ➖ noise
54 duckdb:duckdb +1.5% -3.9% +5.6% +14.4% ➖ noise
54 duckdb:vortex-compact -3.3% -3.9% +0.6% +11.5% ➖ noise
54 duckdb:vortex-file-compressed -1.4% -3.9% +2.6% +11.5% ➖ noise
55 datafusion:vortex-compact -5.1% -10.0% +5.4% +17.3% ➖ noise
55 datafusion:vortex-file-compressed -20.6% -10.0% -11.7% +18.6% ➖ noise
55 duckdb:duckdb -4.4% -10.0% +6.3% +17.0% ➖ noise
55 duckdb:vortex-compact -5.1% -10.0% +5.4% +18.5% ➖ noise
55 duckdb:vortex-file-compressed -9.9% -10.0% +0.1% +18.0% ➖ noise
56 datafusion:vortex-compact -13.3% -4.9% -8.9% +11.5% ➖ noise
56 datafusion:vortex-file-compressed -16.8% -4.9% -12.5% +13.3% ✅ faster
56 duckdb:duckdb -4.3% -4.9% +0.6% +11.5% ➖ noise
56 duckdb:vortex-compact -3.3% -4.9% +1.7% +11.5% ➖ noise
56 duckdb:vortex-file-compressed +1.1% -4.9% +6.4% +15.8% ➖ noise
57 datafusion:vortex-compact -8.1% -8.9% +0.9% +11.5% ➖ noise
57 datafusion:vortex-file-compressed -10.9% -8.9% -2.2% +11.5% ➖ noise
57 duckdb:duckdb +0.7% -8.9% +10.5% +14.2% ➖ noise
57 duckdb:vortex-compact -2.9% -8.9% +6.5% +11.5% ➖ noise
57 duckdb:vortex-file-compressed -3.3% -8.9% +6.1% +12.5% ➖ noise
58 datafusion:vortex-compact -6.2% -3.3% -3.0% +11.5% ➖ noise
58 datafusion:vortex-file-compressed -10.6% -3.3% -7.5% +11.5% ➖ noise
58 duckdb:duckdb -2.9% -3.3% +0.5% +13.2% ➖ noise
58 duckdb:vortex-compact -7.8% -3.3% -4.7% +23.0% ➖ noise
58 duckdb:vortex-file-compressed -11.2% -3.3% -8.1% +14.9% ➖ noise
59 datafusion:vortex-compact -9.7% -4.9% -5.1% +11.5% ➖ noise
59 datafusion:vortex-file-compressed -8.6% -4.9% -3.9% +11.5% ➖ noise
59 duckdb:duckdb -1.8% -4.9% +3.3% +11.5% ➖ noise
59 duckdb:vortex-compact -2.2% -4.9% +2.8% +11.5% ➖ noise
59 duckdb:vortex-file-compressed -0.8% -4.9% +4.2% +11.5% ➖ noise
60 datafusion:vortex-compact -9.2% -6.9% -2.4% +11.5% ➖ noise
60 datafusion:vortex-file-compressed -12.2% -6.9% -5.7% +13.0% ➖ noise
60 duckdb:duckdb -4.1% -6.9% +3.0% +13.1% ➖ noise
60 duckdb:vortex-compact -1.9% -6.9% +5.3% +13.4% ➖ noise
60 duckdb:vortex-file-compressed -3.1% -6.9% +4.1% +11.5% ➖ noise
61 datafusion:vortex-compact -7.7% -1.0% -6.8% +11.5% ➖ noise
61 datafusion:vortex-file-compressed -7.7% -1.0% -6.8% +11.5% ➖ noise
61 duckdb:duckdb -7.1% -1.0% -6.2% +11.5% ➖ noise
61 duckdb:vortex-compact -4.1% -1.0% -3.2% +12.4% ➖ noise
61 duckdb:vortex-file-compressed -10.8% -1.0% -9.9% +13.1% ➖ noise
62 datafusion:vortex-compact -5.8% -2.8% -3.1% +12.0% ➖ noise
62 datafusion:vortex-file-compressed -7.4% -2.8% -4.8% +11.5% ➖ noise
62 duckdb:duckdb -5.8% -2.8% -3.1% +11.5% ➖ noise
62 duckdb:vortex-compact -15.7% -2.8% -13.3% +16.4% ➖ noise
62 duckdb:vortex-file-compressed -5.4% -2.8% -2.7% +16.4% ➖ noise
63 datafusion:vortex-compact -7.0% -7.1% +0.1% +11.5% ➖ noise
63 datafusion:vortex-file-compressed -6.8% -7.1% +0.3% +11.5% ➖ noise
63 duckdb:duckdb -3.5% -7.1% +3.8% +11.5% ➖ noise
63 duckdb:vortex-compact -0.2% -7.1% +7.4% +13.6% ➖ noise
63 duckdb:vortex-file-compressed -9.7% -7.1% -2.8% +11.5% ➖ noise
64 datafusion:vortex-compact -7.0% -4.8% -2.2% +11.5% ➖ noise
64 datafusion:vortex-file-compressed -10.3% -4.8% -5.8% +11.5% ➖ noise
64 duckdb:duckdb -5.3% -4.8% -0.5% +11.5% ➖ noise
64 duckdb:vortex-compact -1.0% -4.8% +4.0% +11.5% ➖ noise
64 duckdb:vortex-file-compressed -5.8% -4.8% -1.0% +11.5% ➖ noise
65 datafusion:vortex-compact -3.3% -2.9% -0.4% +13.2% ➖ noise
65 datafusion:vortex-file-compressed -7.9% -2.9% -5.2% +13.4% ➖ noise
65 duckdb:duckdb +4.2% -2.9% +7.3% +18.1% ➖ noise
65 duckdb:vortex-compact -1.7% -2.9% +1.3% +22.7% ➖ noise
65 duckdb:vortex-file-compressed +0.3% -2.9% +3.2% +13.3% ➖ noise
66 datafusion:vortex-compact -5.5% -4.4% -1.1% +18.6% ➖ noise
66 datafusion:vortex-file-compressed -10.5% -4.4% -6.4% +19.2% ➖ noise
66 duckdb:duckdb -4.0% -4.4% +0.4% +11.5% ➖ noise
66 duckdb:vortex-compact -0.7% -4.4% +3.9% +18.2% ➖ noise
66 duckdb:vortex-file-compressed -4.1% -4.4% +0.3% +11.5% ➖ noise
67 datafusion:vortex-compact -8.3% -3.7% -4.8% +14.2% ➖ noise
67 datafusion:vortex-file-compressed -11.3% -3.7% -7.9% +12.5% ➖ noise
67 duckdb:duckdb -0.9% -3.7% +2.9% +11.5% ➖ noise
67 duckdb:vortex-compact -1.5% -3.7% +2.2% +11.5% ➖ noise
67 duckdb:vortex-file-compressed -3.6% -3.7% +0.1% +11.5% ➖ noise
68 datafusion:vortex-compact -11.4% -4.1% -7.6% +19.1% ➖ noise
68 datafusion:vortex-file-compressed -13.6% -4.1% -9.8% +16.5% ➖ noise
68 duckdb:duckdb -0.4% -4.1% +3.8% +13.3% ➖ noise
68 duckdb:vortex-compact -2.0% -4.1% +2.2% +11.5% ➖ noise
68 duckdb:vortex-file-compressed -7.1% -4.1% -3.1% +15.8% ➖ noise
69 datafusion:vortex-compact -5.3% +1.4% -6.7% +16.0% ➖ noise
69 datafusion:vortex-file-compressed -4.9% +1.4% -6.2% +13.6% ➖ noise
69 duckdb:duckdb -2.2% +1.4% -3.6% +11.5% ➖ noise
69 duckdb:vortex-compact -8.1% +1.4% -9.4% +11.5% ➖ noise
69 duckdb:vortex-file-compressed -1.5% +1.4% -2.9% +11.5% ➖ noise
70 datafusion:vortex-compact -9.9% -8.7% -1.3% +14.9% ➖ noise
70 datafusion:vortex-file-compressed -11.6% -8.7% -3.2% +14.3% ➖ noise
70 duckdb:duckdb +0.3% -8.7% +9.9% +11.9% ➖ noise
70 duckdb:vortex-compact +0.3% -8.7% +9.8% +11.5% ➖ noise
70 duckdb:vortex-file-compressed -6.1% -8.7% +2.8% +11.5% ➖ noise
71 datafusion:vortex-compact -9.2% -4.5% -4.9% +11.5% ➖ noise
71 datafusion:vortex-file-compressed -13.4% -4.5% -9.3% +18.3% ➖ noise
71 duckdb:duckdb -8.4% -4.5% -4.1% +18.5% ➖ noise
71 duckdb:vortex-compact -4.6% -4.5% -0.1% +15.3% ➖ noise
71 duckdb:vortex-file-compressed -14.4% -4.5% -10.3% +19.2% ➖ noise
72 datafusion:vortex-compact -30.4% -6.2% -25.8% +15.4% ✅ faster
72 datafusion:vortex-file-compressed -31.5% -6.2% -26.9% +13.9% ✅ faster
72 duckdb:duckdb -0.3% -6.2% +6.3% +11.5% ➖ noise
72 duckdb:vortex-compact -0.9% -6.2% +5.7% +11.5% ➖ noise
72 duckdb:vortex-file-compressed -2.6% -6.2% +3.9% +11.5% ➖ noise
73 datafusion:vortex-compact -29.5% -16.0% -16.1% +27.8% ➖ noise
73 datafusion:vortex-file-compressed -34.9% -16.0% -22.4% +11.5% ✅ faster
73 duckdb:duckdb +0.8% -16.0% +20.0% +14.8% 🚨 regression
73 duckdb:vortex-compact -8.7% -16.0% +8.7% +11.5% ➖ noise
73 duckdb:vortex-file-compressed -8.7% -16.0% +8.7% +11.8% ➖ noise
74 datafusion:vortex-compact -18.0% -17.8% -0.2% +23.0% ➖ noise
74 datafusion:vortex-file-compressed -27.4% -17.8% -11.7% +15.7% ➖ noise
74 duckdb:duckdb -1.9% -17.8% +19.3% +11.5% 🚨 regression
74 duckdb:vortex-compact -1.4% -17.8% +20.0% +19.0% 🚨 regression
74 duckdb:vortex-file-compressed +1.3% -17.8% +23.2% +24.3% ➖ noise
75 datafusion:vortex-compact -21.5% -13.7% -9.0% +11.5% ➖ noise
75 datafusion:vortex-file-compressed -24.3% -13.7% -12.2% +11.5% ✅ faster
75 duckdb:duckdb +0.7% -13.7% +16.7% +11.5% 🚨 regression
75 duckdb:vortex-compact +3.7% -13.7% +20.2% +13.6% 🚨 regression
75 duckdb:vortex-file-compressed -4.9% -13.7% +10.3% +11.5% ➖ noise
76 datafusion:vortex-compact -22.0% -11.0% -12.3% +12.2% ✅ faster
76 datafusion:vortex-file-compressed -33.3% -11.0% -25.1% +14.9% ✅ faster
76 duckdb:duckdb -4.9% -11.0% +6.9% +25.2% ➖ noise
76 duckdb:vortex-compact -3.6% -11.0% +8.4% +11.8% ➖ noise
76 duckdb:vortex-file-compressed -4.1% -11.0% +7.9% +22.3% ➖ noise
77 datafusion:vortex-compact -23.4% -10.8% -14.1% +16.7% ➖ noise
77 datafusion:vortex-file-compressed -29.3% -10.8% -20.8% +14.3% ✅ faster
77 duckdb:duckdb +2.8% -10.8% +15.2% +16.8% ➖ noise
77 duckdb:vortex-compact -4.6% -10.8% +6.9% +20.6% ➖ noise
77 duckdb:vortex-file-compressed -2.6% -10.8% +9.2% +16.0% ➖ noise
78 datafusion:vortex-compact -30.8% -13.9% -19.6% +12.0% ✅ faster
78 datafusion:vortex-file-compressed -31.3% -13.9% -20.1% +11.5% ✅ faster
78 duckdb:duckdb -0.3% -13.9% +15.9% +12.3% 🚨 regression
78 duckdb:vortex-compact -2.7% -13.9% +13.0% +11.5% 🚨 regression
78 duckdb:vortex-file-compressed +2.2% -13.9% +18.8% +11.5% 🚨 regression
79 datafusion:vortex-compact -7.7% -14.8% +8.4% +14.6% ➖ noise
79 datafusion:vortex-file-compressed -24.7% -14.8% -11.5% +18.0% ➖ noise
79 duckdb:duckdb -1.5% -14.8% +15.6% +11.5% 🚨 regression
79 duckdb:vortex-compact -1.2% -14.8% +16.0% +11.5% 🚨 regression
79 duckdb:vortex-file-compressed -4.4% -14.8% +12.3% +14.4% ➖ noise
80 datafusion:vortex-compact -11.0% -6.5% -4.8% +11.5% ➖ noise
80 datafusion:vortex-file-compressed -12.3% -6.5% -6.2% +16.5% ➖ noise
80 duckdb:duckdb +3.7% -6.5% +10.9% +16.1% ➖ noise
80 duckdb:vortex-compact +1.7% -6.5% +8.8% +12.2% ➖ noise
80 duckdb:vortex-file-compressed +5.5% -6.5% +12.9% +15.0% ➖ noise
81 datafusion:vortex-compact -10.4% -5.4% -5.3% +14.3% ➖ noise
81 datafusion:vortex-file-compressed -15.6% -5.4% -10.8% +16.0% ➖ noise
81 duckdb:duckdb -5.1% -5.4% +0.3% +14.6% ➖ noise
81 duckdb:vortex-compact -2.8% -5.4% +2.7% +11.5% ➖ noise
81 duckdb:vortex-file-compressed -1.0% -5.4% +4.6% +17.0% ➖ noise
82 datafusion:vortex-compact -9.5% -5.9% -3.9% +11.5% ➖ noise
82 datafusion:vortex-file-compressed -11.3% -5.9% -5.8% +18.7% ➖ noise
82 duckdb:duckdb -5.5% -5.9% +0.4% +11.7% ➖ noise
82 duckdb:vortex-compact -0.5% -5.9% +5.7% +15.7% ➖ noise
82 duckdb:vortex-file-compressed -4.7% -5.9% +1.3% +11.5% ➖ noise
83 datafusion:vortex-compact -8.3% -6.8% -1.7% +11.5% ➖ noise
83 datafusion:vortex-file-compressed -10.3% -6.8% -3.8% +11.5% ➖ noise
83 duckdb:duckdb -2.9% -6.8% +4.2% +11.9% ➖ noise
83 duckdb:vortex-compact -4.5% -6.8% +2.5% +11.5% ➖ noise
83 duckdb:vortex-file-compressed -8.4% -6.8% -1.8% +14.1% ➖ noise
84 datafusion:vortex-compact -12.1% -4.9% -7.7% +11.9% ➖ noise
84 datafusion:vortex-file-compressed -1.7% -4.9% +3.3% +11.5% ➖ noise
84 duckdb:duckdb -2.8% -4.9% +2.2% +11.5% ➖ noise
84 duckdb:vortex-compact -5.5% -4.9% -0.7% +11.5% ➖ noise
84 duckdb:vortex-file-compressed -12.7% -4.9% -8.2% +12.6% ➖ noise
85 datafusion:vortex-compact -9.4% -3.5% -6.1% +14.5% ➖ noise
85 datafusion:vortex-file-compressed -6.9% -3.5% -3.5% +11.5% ➖ noise
85 duckdb:duckdb -0.3% -3.5% +3.4% +11.5% ➖ noise
85 duckdb:vortex-compact -1.5% -3.5% +2.1% +11.5% ➖ noise
85 duckdb:vortex-file-compressed -6.9% -3.5% -3.5% +11.5% ➖ noise
86 datafusion:vortex-compact -14.4% -3.5% -11.3% +28.5% ➖ noise
86 datafusion:vortex-file-compressed -10.3% -3.5% -7.0% +20.9% ➖ noise
86 duckdb:duckdb -2.8% -3.5% +0.8% +21.7% ➖ noise
86 duckdb:vortex-compact -3.8% -3.5% -0.2% +24.1% ➖ noise
86 duckdb:vortex-file-compressed -13.0% -3.5% -9.8% +22.7% ➖ noise
87 datafusion:vortex-compact -12.3% -8.8% -3.8% +13.5% ➖ noise
87 datafusion:vortex-file-compressed -22.6% -8.8% -15.1% +12.4% ✅ faster
87 duckdb:duckdb -3.9% -8.8% +5.4% +15.2% ➖ noise
87 duckdb:vortex-compact +0.4% -8.8% +10.1% +17.7% ➖ noise
87 duckdb:vortex-file-compressed -6.9% -8.8% +2.1% +13.0% ➖ noise
88 datafusion:vortex-compact -6.9% -4.3% -2.7% +11.5% ➖ noise
88 datafusion:vortex-file-compressed -19.6% -4.3% -16.0% +11.5% ✅ faster
88 duckdb:duckdb -6.0% -4.3% -1.7% +11.5% ➖ noise
88 duckdb:vortex-compact -2.9% -4.3% +1.5% +11.5% ➖ noise
88 duckdb:vortex-file-compressed -3.1% -4.3% +1.2% +11.5% ➖ noise
89 datafusion:vortex-compact -12.8% -11.0% -2.0% +20.4% ➖ noise
89 datafusion:vortex-file-compressed -10.1% -11.0% +0.9% +15.7% ➖ noise
89 duckdb:duckdb +2.4% -11.0% +15.0% +18.0% ➖ noise
89 duckdb:vortex-compact -3.7% -11.0% +8.2% +16.6% ➖ noise
89 duckdb:vortex-file-compressed -5.7% -11.0% +5.9% +21.0% ➖ noise
90 datafusion:vortex-compact -16.4% -8.3% -8.8% +24.1% ➖ noise
90 datafusion:vortex-file-compressed -8.5% -8.3% -0.1% +27.6% ➖ noise
90 duckdb:duckdb -3.6% -8.3% +5.1% +11.5% ➖ noise
90 duckdb:vortex-compact -9.8% -8.3% -1.6% +11.5% ➖ noise
90 duckdb:vortex-file-compressed -11.1% -8.3% -3.0% +11.5% ➖ noise
91 datafusion:vortex-compact -8.1% -5.8% -2.4% +15.3% ➖ noise
91 datafusion:vortex-file-compressed -11.4% -5.8% -6.0% +21.7% ➖ noise
91 duckdb:duckdb +1.7% -5.8% +8.0% +11.5% ➖ noise
91 duckdb:vortex-compact -1.5% -5.8% +4.6% +11.5% ➖ noise
91 duckdb:vortex-file-compressed -6.4% -5.8% -0.6% +11.5% ➖ noise
92 datafusion:vortex-compact -2.4% -13.0% +12.1% +16.2% ➖ noise
92 datafusion:vortex-file-compressed -17.6% -13.0% -5.3% +26.6% ➖ noise
92 duckdb:duckdb -4.1% -13.0% +10.2% +17.3% ➖ noise
92 duckdb:vortex-compact -6.7% -13.0% +7.3% +20.0% ➖ noise
92 duckdb:vortex-file-compressed -5.1% -13.0% +9.0% +12.1% ➖ noise
93 datafusion:vortex-compact -8.9% -6.5% -2.6% +11.9% ➖ noise
93 datafusion:vortex-file-compressed -2.4% -6.5% +4.3% +29.2% ➖ noise
93 duckdb:duckdb -5.6% -6.5% +1.0% +13.4% ➖ noise
93 duckdb:vortex-compact -5.2% -6.5% +1.4% +17.1% ➖ noise
93 duckdb:vortex-file-compressed +10.9% -6.5% +18.6% +13.5% 🚨 regression
94 datafusion:vortex-compact +4.6% -2.3% +7.1% +11.5% ➖ noise
94 datafusion:vortex-file-compressed -4.6% -2.3% -2.3% +11.5% ➖ noise
94 duckdb:duckdb -0.8% -2.3% +1.6% +11.5% ➖ noise
94 duckdb:vortex-compact -9.8% -2.3% -7.6% +11.5% ➖ noise
94 duckdb:vortex-file-compressed -6.3% -2.3% -4.0% +11.5% ➖ noise
95 datafusion:vortex-compact -5.8% +1.0% -6.7% +12.8% ➖ noise
95 datafusion:vortex-file-compressed -2.2% +1.0% -3.1% +12.2% ➖ noise
95 duckdb:duckdb -16.6% +1.0% -17.4% +21.9% ➖ noise
95 duckdb:vortex-compact -10.3% +1.0% -11.1% +12.9% ➖ noise
95 duckdb:vortex-file-compressed +0.3% +1.0% -0.7% +19.2% ➖ noise
96 datafusion:vortex-compact +1.5% -4.9% +6.7% +14.0% ➖ noise
96 datafusion:vortex-file-compressed -3.2% -4.9% +1.7% +13.9% ➖ noise
96 duckdb:duckdb -0.2% -4.9% +4.9% +14.3% ➖ noise
96 duckdb:vortex-compact +2.7% -4.9% +7.9% +15.3% ➖ noise
96 duckdb:vortex-file-compressed -7.7% -4.9% -3.0% +15.4% ➖ noise
97 datafusion:vortex-compact -3.0% -0.2% -2.8% +11.5% ➖ noise
97 datafusion:vortex-file-compressed -1.7% -0.2% -1.5% +11.5% ➖ noise
97 duckdb:duckdb -7.4% -0.2% -7.2% +14.9% ➖ noise
97 duckdb:vortex-compact -4.4% -0.2% -4.2% +11.5% ➖ noise
97 duckdb:vortex-file-compressed -3.0% -0.2% -2.8% +11.5% ➖ noise
98 datafusion:vortex-compact +0.3% -1.6% +2.0% +11.5% ➖ noise
98 datafusion:vortex-file-compressed -2.6% -1.6% -1.0% +11.5% ➖ noise
98 duckdb:duckdb -1.7% -1.6% -0.0% +15.3% ➖ noise
98 duckdb:vortex-compact -2.8% -1.6% -1.2% +15.9% ➖ noise
98 duckdb:vortex-file-compressed -2.9% -1.6% -1.3% +13.3% ➖ noise
99 datafusion:vortex-compact +1.3% -13.8% +17.5% +18.2% ➖ noise
99 datafusion:vortex-file-compressed +1.0% -13.8% +17.2% +17.4% ➖ noise
99 duckdb:duckdb -0.7% -13.8% +15.2% +37.1% ➖ noise
99 duckdb:vortex-compact +5.9% -13.8% +22.9% +24.6% ➖ noise
99 duckdb:vortex-file-compressed +0.8% -13.8% +17.0% +23.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: TPC-DS SF=1 on NVME

File Size Changes (25 files changed, +0.1% overall, 13↑ 12↓)
File Scale Format Base HEAD Change %
time_dim.vortex 1.0 vortex-file-compressed 687.27 KB 848.10 KB +160.84 KB +23.4%
date_dim.vortex 1.0 vortex-file-compressed 1.03 MB 1.16 MB +134.60 KB +12.8%
customer_address.vortex 1.0 vortex-file-compressed 1012.93 KB 1.08 MB +92.91 KB +9.2%
customer.vortex 1.0 vortex-file-compressed 4.52 MB 4.70 MB +184.74 KB +4.0%
catalog_page.vortex 1.0 vortex-file-compressed 611.54 KB 632.93 KB +21.39 KB +3.5%
promotion.vortex 1.0 vortex-file-compressed 60.16 KB 61.42 KB +1.26 KB +2.1%
time_dim.vortex 1.0 vortex-compact 97.32 KB 98.27 KB +976 B +1.0%
item.vortex 1.0 vortex-file-compressed 1.75 MB 1.76 MB +15.58 KB +0.9%
date_dim.vortex 1.0 vortex-compact 153.96 KB 154.96 KB +1.00 KB +0.6%
promotion.vortex 1.0 vortex-compact 51.48 KB 51.77 KB +296 B +0.6%
customer_address.vortex 1.0 vortex-compact 558.59 KB 559.13 KB +552 B +0.1%
catalog_page.vortex 1.0 vortex-compact 362.64 KB 362.94 KB +304 B +0.1%
customer.vortex 1.0 vortex-compact 3.29 MB 3.29 MB +1.30 KB +0.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.49 MB 1.49 MB 112 B -0.0%
item.vortex 1.0 vortex-compact 994.18 KB 994.03 KB 160 B -0.0%
web_page.vortex 1.0 vortex-compact 27.80 KB 27.79 KB 16 B -0.1%
store.vortex 1.0 vortex-compact 45.73 KB 45.67 KB 56 B -0.1%
household_demographics.vortex 1.0 vortex-file-compressed 17.02 KB 16.96 KB 56 B -0.3%
warehouse.vortex 1.0 vortex-compact 22.20 KB 22.12 KB 80 B -0.4%
warehouse.vortex 1.0 vortex-file-compressed 23.80 KB 23.70 KB 104 B -0.4%
web_site.vortex 1.0 vortex-file-compressed 54.05 KB 53.72 KB 336 B -0.6%
store.vortex 1.0 vortex-file-compressed 49.46 KB 49.08 KB 392 B -0.8%
call_center.vortex 1.0 vortex-file-compressed 54.91 KB 54.46 KB 456 B -0.8%
ship_mode.vortex 1.0 vortex-file-compressed 13.09 KB 12.98 KB 112 B -0.8%
reason.vortex 1.0 vortex-file-compressed 7.20 KB 7.12 KB 72 B -1.0%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (+0.0%)
  • vortex-file-compressed: 272.70 MB → 273.30 MB (+0.2%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.0%
Vortex (geomean): 0.978x ➖
Parquet (geomean): 0.958x ➖
Shifts: Parquet (control) -4.2% · Median polish +0.1%


datafusion / vortex-file-compressed (0.951x ➖, 1↑ 1↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 47717464 100122092 0.48
fineweb_q01/datafusion:vortex-file-compressed 620062329 560162413 1.11
fineweb_q02/datafusion:vortex-file-compressed 🚨 726407857 548573564 1.32
fineweb_q03/datafusion:vortex-file-compressed 1430419424 1372355467 1.04
fineweb_q04/datafusion:vortex-file-compressed 1363559643 1415630889 0.96
fineweb_q05/datafusion:vortex-file-compressed 1343400880 1383385457 0.97
fineweb_q06/datafusion:vortex-file-compressed 1490099253 1633380131 0.91
fineweb_q07/datafusion:vortex-file-compressed 1371340058 1344421570 1.02
fineweb_q08/datafusion:vortex-file-compressed 517922607 514972842 1.01
datafusion / vortex-compact (0.921x ➖, 1↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 42160909 56646422 0.74
fineweb_q01/datafusion:vortex-compact 1135569521 1355736314 0.84
fineweb_q02/datafusion:vortex-compact 🚀 779120529 1288289129 0.60
fineweb_q03/datafusion:vortex-compact 1710536878 1502702366 1.14
fineweb_q04/datafusion:vortex-compact 2056878009 1796457221 1.14
fineweb_q05/datafusion:vortex-compact 1632403066 1495961161 1.09
fineweb_q06/datafusion:vortex-compact 1514656040 1402334195 1.08
fineweb_q07/datafusion:vortex-compact 1365906235 1344621154 1.02
fineweb_q08/datafusion:vortex-compact 371204183 457273460 0.81
datafusion / parquet (0.970x ➖, 1↑ 1↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 1059622121 1764567757 0.60
fineweb_q01/datafusion:parquet 1752649078 1817135804 0.96
fineweb_q02/datafusion:parquet 1752811376 1761247745 1.00
fineweb_q03/datafusion:parquet 🚨 2590345951 1716993617 1.51
fineweb_q04/datafusion:parquet 1784670402 1766143417 1.01
fineweb_q05/datafusion:parquet 1713616696 1978830559 0.87
fineweb_q06/datafusion:parquet 1874527257 1964271868 0.95
fineweb_q07/datafusion:parquet 1892886345 1948201393 0.97
fineweb_q08/datafusion:parquet 1871421634 1736198114 1.08
duckdb / vortex-file-compressed (1.060x ➖, 0↑ 1↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 97309757 88917661 1.09
fineweb_q01/duckdb:vortex-file-compressed 582353610 585594851 0.99
fineweb_q02/duckdb:vortex-file-compressed 🚨 688372948 507060585 1.36
fineweb_q03/duckdb:vortex-file-compressed 1527483063 1671083837 0.91
fineweb_q04/duckdb:vortex-file-compressed 1582337591 1524649800 1.04
fineweb_q05/duckdb:vortex-file-compressed 1504764967 1477397695 1.02
fineweb_q06/duckdb:vortex-file-compressed 1654605906 1720962542 0.96
fineweb_q07/duckdb:vortex-file-compressed 1467878784 1509913388 0.97
fineweb_q08/duckdb:vortex-file-compressed 760143223 601627258 1.26
duckdb / vortex-compact (0.984x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 84787825 81926929 1.03
fineweb_q01/duckdb:vortex-compact 547265236 605483061 0.90
fineweb_q02/duckdb:vortex-compact 583385198 787890965 0.74
fineweb_q03/duckdb:vortex-compact 1787035546 1729317266 1.03
fineweb_q04/duckdb:vortex-compact 1938703042 1839557489 1.05
fineweb_q05/duckdb:vortex-compact 1661994051 1512081916 1.10
fineweb_q06/duckdb:vortex-compact 1532236141 1534408091 1.00
fineweb_q07/duckdb:vortex-compact 1445474038 1460012882 0.99
fineweb_q08/duckdb:vortex-compact 517993021 489911579 1.06
duckdb / parquet (0.947x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1169266354 1228695891 0.95
fineweb_q01/duckdb:parquet 1397973397 1412046512 0.99
fineweb_q02/duckdb:parquet 1334124479 1355038599 0.98
fineweb_q03/duckdb:parquet 3659497191 3608102726 1.01
fineweb_q04/duckdb:parquet 1864812260 1981433931 0.94
fineweb_q05/duckdb:parquet 1983634439 2114325443 0.94
fineweb_q06/duckdb:parquet 4232870273 4494832360 0.94
fineweb_q07/duckdb:parquet 2529792542 2929426802 0.86
fineweb_q08/duckdb:parquet 1044241958 1154136905 0.90
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -25.6% -24.4% -1.5% +189.8% ➖ noise
0 datafusion:vortex-file-compressed -52.3% -24.4% -37.0% +146.9% ➖ noise
0 duckdb:vortex-compact +3.5% -24.4% +36.9% +92.1% ➖ noise
0 duckdb:vortex-file-compressed +9.4% -24.4% +44.8% +48.3% ➖ noise
1 datafusion:vortex-compact -16.2% -2.3% -14.3% +85.6% ➖ noise
1 datafusion:vortex-file-compressed +10.7% -2.3% +13.3% +82.7% ➖ noise
1 duckdb:vortex-compact -9.6% -2.3% -7.5% +47.7% ➖ noise
1 duckdb:vortex-file-compressed -0.6% -2.3% +1.8% +38.9% ➖ noise
2 datafusion:vortex-compact -39.5% -1.0% -38.9% +38.9% ✅ faster
2 datafusion:vortex-file-compressed +32.4% -1.0% +33.8% +38.9% ➖ noise
2 duckdb:vortex-compact -26.0% -1.0% -25.2% +38.9% ➖ noise
2 duckdb:vortex-file-compressed +35.8% -1.0% +37.1% +38.9% ➖ noise
3 datafusion:vortex-compact +13.8% +23.7% -8.0% +38.9% ➖ noise
3 datafusion:vortex-file-compressed +4.2% +23.7% -15.7% +38.9% ➖ noise
3 duckdb:vortex-compact +3.3% +23.7% -16.5% +38.9% ➖ noise
3 duckdb:vortex-file-compressed -8.6% +23.7% -26.1% +38.9% ➖ noise
4 datafusion:vortex-compact +14.5% -2.5% +17.4% +38.9% ➖ noise
4 datafusion:vortex-file-compressed -3.7% -2.5% -1.2% +38.9% ➖ noise
4 duckdb:vortex-compact +5.4% -2.5% +8.1% +38.9% ➖ noise
4 duckdb:vortex-file-compressed +3.8% -2.5% +6.4% +38.9% ➖ noise
5 datafusion:vortex-compact +9.1% -9.9% +21.1% +38.9% ➖ noise
5 datafusion:vortex-file-compressed -2.9% -9.9% +7.7% +38.9% ➖ noise
5 duckdb:vortex-compact +9.9% -9.9% +21.9% +38.9% ➖ noise
5 duckdb:vortex-file-compressed +1.9% -9.9% +13.0% +38.9% ➖ noise
6 datafusion:vortex-compact +8.0% -5.2% +13.9% +38.9% ➖ noise
6 datafusion:vortex-file-compressed -8.8% -5.2% -3.8% +38.9% ➖ noise
6 duckdb:vortex-compact -0.1% -5.2% +5.3% +38.9% ➖ noise
6 duckdb:vortex-file-compressed -3.9% -5.2% +1.4% +38.9% ➖ noise
7 datafusion:vortex-compact +1.6% -8.4% +10.9% +38.9% ➖ noise
7 datafusion:vortex-file-compressed +2.0% -8.4% +11.4% +38.9% ➖ noise
7 duckdb:vortex-compact -1.0% -8.4% +8.1% +38.9% ➖ noise
7 duckdb:vortex-file-compressed -2.8% -8.4% +6.1% +38.9% ➖ noise
8 datafusion:vortex-compact -18.8% -1.2% -17.8% +38.9% ➖ noise
8 datafusion:vortex-file-compressed +0.6% -1.2% +1.8% +38.9% ➖ noise
8 duckdb:vortex-compact +5.7% -1.2% +7.1% +38.9% ➖ noise
8 duckdb:vortex-file-compressed +26.3% -1.2% +27.9% +38.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (medium confidence)
Attributed Vortex impact: +5.1%
Vortex (geomean): 1.146x ❌
Parquet (geomean): 1.045x ➖
Shifts: Parquet (control) +4.5% · Median polish +12.4%


datafusion / vortex-file-compressed (1.083x ➖, 2↑ 13↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 387877751 417382943 0.93
tpch_q02/datafusion:vortex-file-compressed 🚀 109813521 124794982 0.88
tpch_q03/datafusion:vortex-file-compressed 🚀 212700297 248297021 0.86
tpch_q04/datafusion:vortex-file-compressed 114768738 116292336 0.99
tpch_q05/datafusion:vortex-file-compressed 372272290 375415025 0.99
tpch_q06/datafusion:vortex-file-compressed 45502921 46306292 0.98
tpch_q07/datafusion:vortex-file-compressed 549021657 553372381 0.99
tpch_q08/datafusion:vortex-file-compressed 415800796 379789488 1.09
tpch_q09/datafusion:vortex-file-compressed 🚨 752216651 670119348 1.12
tpch_q10/datafusion:vortex-file-compressed 290360202 264790774 1.10
tpch_q11/datafusion:vortex-file-compressed 🚨 98627324 86062709 1.15
tpch_q12/datafusion:vortex-file-compressed 🚨 147579540 127816421 1.15
tpch_q13/datafusion:vortex-file-compressed 🚨 256168476 223282182 1.15
tpch_q14/datafusion:vortex-file-compressed 🚨 69698829 60041422 1.16
tpch_q15/datafusion:vortex-file-compressed 🚨 128370862 114627164 1.12
tpch_q16/datafusion:vortex-file-compressed 🚨 88660734 78202491 1.13
tpch_q17/datafusion:vortex-file-compressed 🚨 776641243 648159566 1.20
tpch_q18/datafusion:vortex-file-compressed 🚨 1027642008 849276101 1.21
tpch_q19/datafusion:vortex-file-compressed 🚨 106739736 91591797 1.17
tpch_q20/datafusion:vortex-file-compressed 🚨 203059351 171278623 1.19
tpch_q21/datafusion:vortex-file-compressed 🚨 847912233 682214731 1.24
tpch_q22/datafusion:vortex-file-compressed 🚨 78618886 68099629 1.15
datafusion / vortex-compact (1.209x ❌, 0↑ 22↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 512801984 434888828 1.18
tpch_q02/datafusion:vortex-compact 🚨 138135347 113721708 1.21
tpch_q03/datafusion:vortex-compact 🚨 270575925 220186114 1.23
tpch_q04/datafusion:vortex-compact 🚨 149357231 124084327 1.20
tpch_q05/datafusion:vortex-compact 🚨 474561414 382623100 1.24
tpch_q06/datafusion:vortex-compact 🚨 77620921 66460804 1.17
tpch_q07/datafusion:vortex-compact 🚨 704660126 565309239 1.25
tpch_q08/datafusion:vortex-compact 🚨 456003070 356753493 1.28
tpch_q09/datafusion:vortex-compact 🚨 804721971 644971531 1.25
tpch_q10/datafusion:vortex-compact 🚨 321218628 266404290 1.21
tpch_q11/datafusion:vortex-compact 🚨 105159337 84398723 1.25
tpch_q12/datafusion:vortex-compact 🚨 199713362 168174511 1.19
tpch_q13/datafusion:vortex-compact 🚨 318766747 265881716 1.20
tpch_q14/datafusion:vortex-compact 🚨 88156507 74009257 1.19
tpch_q15/datafusion:vortex-compact 🚨 197226119 163692332 1.20
tpch_q16/datafusion:vortex-compact 🚨 93357706 80174987 1.16
tpch_q17/datafusion:vortex-compact 🚨 807590813 637229851 1.27
tpch_q18/datafusion:vortex-compact 🚨 1060900307 849479827 1.25
tpch_q19/datafusion:vortex-compact 🚨 149166786 131167006 1.14
tpch_q20/datafusion:vortex-compact 🚨 236215425 200125061 1.18
tpch_q21/datafusion:vortex-compact 🚨 861750591 714544749 1.21
tpch_q22/datafusion:vortex-compact 🚨 87312649 74434231 1.17
datafusion / parquet (0.983x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 451927749 485055227 0.93
tpch_q02/datafusion:parquet 174044043 174347314 1.00
tpch_q03/datafusion:parquet 287300399 292081058 0.98
tpch_q04/datafusion:parquet 133176825 131702699 1.01
tpch_q05/datafusion:parquet 439949512 449583106 0.98
tpch_q06/datafusion:parquet 127375887 136940761 0.93
tpch_q07/datafusion:parquet 606460233 617912605 0.98
tpch_q08/datafusion:parquet 465068107 478269967 0.97
tpch_q09/datafusion:parquet 736152902 754709654 0.98
tpch_q10/datafusion:parquet 498614729 510341551 0.98
tpch_q11/datafusion:parquet 121322618 120952203 1.00
tpch_q12/datafusion:parquet 209939501 213802759 0.98
tpch_q13/datafusion:parquet 331025782 345092401 0.96
tpch_q14/datafusion:parquet 164417850 163150423 1.01
tpch_q15/datafusion:parquet 257138860 256140432 1.00
tpch_q16/datafusion:parquet 126651220 128400851 0.99
tpch_q17/datafusion:parquet 679953348 679144562 1.00
tpch_q18/datafusion:parquet 861467923 871705145 0.99
tpch_q19/datafusion:parquet 286080844 291123807 0.98
tpch_q20/datafusion:parquet 296626053 297113808 1.00
tpch_q21/datafusion:parquet 707795529 714536187 0.99
tpch_q22/datafusion:parquet 210147096 214277058 0.98
datafusion / arrow (0.957x ➖, 3↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 588514087 617826853 0.95
tpch_q02/datafusion:arrow 161301151 161114620 1.00
tpch_q03/datafusion:arrow 465125599 483188949 0.96
tpch_q04/datafusion:arrow 339202338 362663266 0.94
tpch_q05/datafusion:arrow 926904870 965861568 0.96
tpch_q06/datafusion:arrow 282088465 281141939 1.00
tpch_q07/datafusion:arrow 1156560683 1161861446 1.00
tpch_q08/datafusion:arrow 1142880632 1142656817 1.00
tpch_q09/datafusion:arrow 1335186898 1339690013 1.00
tpch_q10/datafusion:arrow 598566246 599624246 1.00
tpch_q11/datafusion:arrow 137592713 137429914 1.00
tpch_q12/datafusion:arrow 🚀 683022369 780253810 0.88
tpch_q13/datafusion:arrow 502663272 517486941 0.97
tpch_q14/datafusion:arrow 324341821 351746488 0.92
tpch_q15/datafusion:arrow 707110429 777094560 0.91
tpch_q16/datafusion:arrow 103971439 110199449 0.94
tpch_q17/datafusion:arrow 1331313422 1472325110 0.90
tpch_q18/datafusion:arrow 🚀 1883232222 2123256404 0.89
tpch_q19/datafusion:arrow 🚀 492397564 556926541 0.88
tpch_q20/datafusion:arrow 492121360 496419468 0.99
tpch_q21/datafusion:arrow 2986351011 3035239466 0.98
tpch_q22/datafusion:arrow 129877668 129077947 1.01
duckdb / vortex-file-compressed (1.172x ❌, 0↑ 21↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 191316010 169880684 1.13
tpch_q02/duckdb:vortex-file-compressed 🚨 57294842 50545610 1.13
tpch_q03/duckdb:vortex-file-compressed 🚨 155390167 125925543 1.23
tpch_q04/duckdb:vortex-file-compressed 🚨 188259172 150957792 1.25
tpch_q05/duckdb:vortex-file-compressed 🚨 155132247 128542994 1.21
tpch_q06/duckdb:vortex-file-compressed 🚨 56351820 47310585 1.19
tpch_q07/duckdb:vortex-file-compressed 🚨 176408433 145546981 1.21
tpch_q08/duckdb:vortex-file-compressed 🚨 215751731 171619047 1.26
tpch_q09/duckdb:vortex-file-compressed 🚨 372842769 323229912 1.15
tpch_q10/duckdb:vortex-file-compressed 🚨 175585800 144448228 1.22
tpch_q11/duckdb:vortex-file-compressed 🚨 37370174 32813104 1.14
tpch_q12/duckdb:vortex-file-compressed 🚨 112677690 94472038 1.19
tpch_q13/duckdb:vortex-file-compressed 🚨 265045065 225196096 1.18
tpch_q14/duckdb:vortex-file-compressed 🚨 74973870 65520280 1.14
tpch_q15/duckdb:vortex-file-compressed 🚨 101152550 86255880 1.17
tpch_q16/duckdb:vortex-file-compressed 🚨 88087214 77801616 1.13
tpch_q17/duckdb:vortex-file-compressed 🚨 116071910 98708423 1.18
tpch_q18/duckdb:vortex-file-compressed 🚨 328324775 288457372 1.14
tpch_q19/duckdb:vortex-file-compressed 🚨 92145825 82978864 1.11
tpch_q20/duckdb:vortex-file-compressed 🚨 182069620 155807715 1.17
tpch_q21/duckdb:vortex-file-compressed 🚨 665703824 562772067 1.18
tpch_q22/duckdb:vortex-file-compressed 77779623 70797819 1.10
duckdb / vortex-compact (1.122x ❌, 0↑ 16↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 247962123 227357333 1.09
tpch_q02/duckdb:vortex-compact 🚨 61648361 55388992 1.11
tpch_q03/duckdb:vortex-compact 🚨 159459211 139732665 1.14
tpch_q04/duckdb:vortex-compact 🚨 196065281 171532581 1.14
tpch_q05/duckdb:vortex-compact 🚨 165029666 143893612 1.15
tpch_q06/duckdb:vortex-compact 🚨 93098822 82882935 1.12
tpch_q07/duckdb:vortex-compact 🚨 226279401 195776317 1.16
tpch_q08/duckdb:vortex-compact 🚨 218072434 185024167 1.18
tpch_q09/duckdb:vortex-compact 🚨 393758452 350690514 1.12
tpch_q10/duckdb:vortex-compact 🚨 197226756 174331906 1.13
tpch_q11/duckdb:vortex-compact 43967193 40408843 1.09
tpch_q12/duckdb:vortex-compact 🚨 226051117 202266915 1.12
tpch_q13/duckdb:vortex-compact 🚨 313085895 277206152 1.13
tpch_q14/duckdb:vortex-compact 🚨 111138243 99480878 1.12
tpch_q15/duckdb:vortex-compact 🚨 124404297 110375979 1.13
tpch_q16/duckdb:vortex-compact 92400314 84397834 1.09
tpch_q17/duckdb:vortex-compact 🚨 128809503 112368874 1.15
tpch_q18/duckdb:vortex-compact 313957426 291305578 1.08
tpch_q19/duckdb:vortex-compact 114801694 107196588 1.07
tpch_q20/duckdb:vortex-compact 🚨 228798104 201404054 1.14
tpch_q21/duckdb:vortex-compact 🚨 697464423 607948830 1.15
tpch_q22/duckdb:vortex-compact 91585713 84181170 1.09
duckdb / parquet (1.112x ❌, 0↑ 15↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 278823331 256371885 1.09
tpch_q02/duckdb:parquet 🚨 106894650 95330053 1.12
tpch_q03/duckdb:parquet 🚨 231733109 207230620 1.12
tpch_q04/duckdb:parquet 🚨 147715396 130623336 1.13
tpch_q05/duckdb:parquet 🚨 239060863 212739738 1.12
tpch_q06/duckdb:parquet 71916966 67509275 1.07
tpch_q07/duckdb:parquet 🚨 202696132 177878781 1.14
tpch_q08/duckdb:parquet 🚨 291340850 252628327 1.15
tpch_q09/duckdb:parquet 🚨 540234617 476426664 1.13
tpch_q10/duckdb:parquet 669623270 608848512 1.10
tpch_q11/duckdb:parquet 63976073 58609610 1.09
tpch_q12/duckdb:parquet 🚨 135137400 121658638 1.11
tpch_q13/duckdb:parquet 🚨 492255395 441046019 1.12
tpch_q14/duckdb:parquet 🚨 190400071 171745267 1.11
tpch_q15/duckdb:parquet 🚨 107516233 95271811 1.13
tpch_q16/duckdb:parquet 🚨 177915711 159451746 1.12
tpch_q17/duckdb:parquet 188044491 175209245 1.07
tpch_q18/duckdb:parquet 🚨 386447416 346913203 1.11
tpch_q19/duckdb:parquet 🚨 310097324 280455653 1.11
tpch_q20/duckdb:parquet 247246845 227919977 1.08
tpch_q21/duckdb:parquet 🚨 659508549 556613366 1.18
tpch_q22/duckdb:parquet 309384406 289684500 1.07
duckdb / duckdb (1.064x ➖, 0↑ 2↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 121482577 116772536 1.04
tpch_q02/duckdb:duckdb 🚨 50200801 44891427 1.12
tpch_q03/duckdb:duckdb 104356752 96604982 1.08
tpch_q04/duckdb:duckdb 🚨 144768973 130046488 1.11
tpch_q05/duckdb:duckdb 118476690 109976948 1.08
tpch_q06/duckdb:duckdb 39890435 36842614 1.08
tpch_q07/duckdb:duckdb 92829539 86048025 1.08
tpch_q08/duckdb:duckdb 118323229 110214452 1.07
tpch_q09/duckdb:duckdb 296503276 274356399 1.08
tpch_q10/duckdb:duckdb 217538006 198998309 1.09
tpch_q11/duckdb:duckdb 16504194 15311572 1.08
tpch_q12/duckdb:duckdb 88503027 84922893 1.04
tpch_q13/duckdb:duckdb 235728751 220250204 1.07
tpch_q14/duckdb:duckdb 74114347 70085993 1.06
tpch_q15/duckdb:duckdb 82314368 77196868 1.07
tpch_q16/duckdb:duckdb 78416460 72535797 1.08
tpch_q17/duckdb:duckdb 86808431 84500515 1.03
tpch_q18/duckdb:duckdb 220263903 212450346 1.04
tpch_q19/duckdb:duckdb 119738064 115891824 1.03
tpch_q20/duckdb:duckdb 114405496 112010746 1.02
tpch_q21/duckdb:duckdb 314413825 293891256 1.07
tpch_q22/duckdb:duckdb 68430474 68660108 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -4.7% +0.7% -5.4% +10.0% ➖ noise
1 datafusion:vortex-compact +17.9% +0.7% +17.1% +10.0% 🚨 regression
1 datafusion:vortex-file-compressed -7.1% +0.7% -7.7% +10.0% ➖ noise
1 duckdb:duckdb +4.0% +0.7% +3.3% +10.0% ➖ noise
1 duckdb:vortex-compact +9.1% +0.7% +8.3% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +12.6% +0.7% +11.9% +10.0% 🚨 regression
2 datafusion:arrow +0.1% +5.8% -5.4% +10.0% ➖ noise
2 datafusion:vortex-compact +21.5% +5.8% +14.8% +10.0% 🚨 regression
2 datafusion:vortex-file-compressed -12.0% +5.8% -16.8% +10.0% ✅ faster
2 duckdb:duckdb +11.8% +5.8% +5.7% +10.0% ➖ noise
2 duckdb:vortex-compact +11.3% +5.8% +5.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +13.4% +5.8% +7.1% +10.0% ➖ noise
3 datafusion:arrow -3.7% +4.9% -8.2% +10.0% ➖ noise
3 datafusion:vortex-compact +22.9% +4.9% +17.2% +10.0% 🚨 regression
3 datafusion:vortex-file-compressed -14.3% +4.9% -18.3% +10.0% ✅ faster
3 duckdb:duckdb +8.0% +4.9% +3.0% +10.0% ➖ noise
3 duckdb:vortex-compact +14.1% +4.9% +8.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +23.4% +4.9% +17.7% +10.0% 🚨 regression
4 datafusion:arrow -6.5% +6.9% -12.5% +10.0% ✅ faster
4 datafusion:vortex-compact +20.4% +6.9% +12.6% +10.0% 🚨 regression
4 datafusion:vortex-file-compressed -1.3% +6.9% -7.7% +10.0% ➖ noise
4 duckdb:duckdb +11.3% +6.9% +4.1% +10.0% ➖ noise
4 duckdb:vortex-compact +14.3% +6.9% +6.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +24.7% +6.9% +16.6% +10.0% 🚨 regression
5 datafusion:arrow -4.0% +4.9% -8.5% +10.0% ➖ noise
5 datafusion:vortex-compact +24.0% +4.9% +18.3% +10.0% 🚨 regression
5 datafusion:vortex-file-compressed -0.8% +4.9% -5.4% +10.0% ➖ noise
5 duckdb:duckdb +7.7% +4.9% +2.7% +10.0% ➖ noise
5 duckdb:vortex-compact +14.7% +4.9% +9.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +20.7% +4.9% +15.1% +10.0% 🚨 regression
6 datafusion:arrow +0.3% -0.5% +0.8% +10.0% ➖ noise
6 datafusion:vortex-compact +16.8% -0.5% +17.3% +10.0% 🚨 regression
6 datafusion:vortex-file-compressed -1.7% -0.5% -1.3% +10.0% ➖ noise
6 duckdb:duckdb +8.3% -0.5% +8.8% +10.0% ➖ noise
6 duckdb:vortex-compact +12.3% -0.5% +12.8% +10.0% 🚨 regression
6 duckdb:vortex-file-compressed +19.1% -0.5% +19.7% +10.0% 🚨 regression
7 datafusion:arrow -0.5% +5.8% -5.9% +10.0% ➖ noise
7 datafusion:vortex-compact +24.7% +5.8% +17.9% +10.0% 🚨 regression
7 datafusion:vortex-file-compressed -0.8% +5.8% -6.2% +10.0% ➖ noise
7 duckdb:duckdb +7.9% +5.8% +2.0% +10.0% ➖ noise
7 duckdb:vortex-compact +15.6% +5.8% +9.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +21.2% +5.8% +14.6% +10.0% 🚨 regression
8 datafusion:arrow +0.0% +5.9% -5.5% +10.0% ➖ noise
8 datafusion:vortex-compact +27.8% +5.9% +20.7% +10.0% 🚨 regression
8 datafusion:vortex-file-compressed +9.5% +5.9% +3.4% +10.0% ➖ noise
8 duckdb:duckdb +7.4% +5.9% +1.4% +10.0% ➖ noise
8 duckdb:vortex-compact +17.9% +5.9% +11.3% +10.0% 🚨 regression
8 duckdb:vortex-file-compressed +25.7% +5.9% +18.7% +10.0% 🚨 regression
9 datafusion:arrow -0.3% +5.2% -5.2% +10.0% ➖ noise
9 datafusion:vortex-compact +24.8% +5.2% +18.6% +10.0% 🚨 regression
9 datafusion:vortex-file-compressed +12.3% +5.2% +6.7% +10.0% ➖ noise
9 duckdb:duckdb +8.1% +5.2% +2.8% +10.0% ➖ noise
9 duckdb:vortex-compact +12.3% +5.2% +6.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +15.3% +5.2% +9.7% +10.0% ➖ noise
10 datafusion:arrow -0.2% +3.7% -3.7% +10.0% ➖ noise
10 datafusion:vortex-compact +20.6% +3.7% +16.3% +10.0% 🚨 regression
10 datafusion:vortex-file-compressed +9.7% +3.7% +5.8% +10.0% ➖ noise
10 duckdb:duckdb +9.3% +3.7% +5.5% +10.0% ➖ noise
10 duckdb:vortex-compact +13.1% +3.7% +9.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +21.6% +3.7% +17.3% +10.0% 🚨 regression
11 datafusion:arrow +0.1% +4.6% -4.3% +10.0% ➖ noise
11 datafusion:vortex-compact +24.6% +4.6% +19.1% +10.0% 🚨 regression
11 datafusion:vortex-file-compressed +14.6% +4.6% +9.5% +10.0% ➖ noise
11 duckdb:duckdb +7.8% +4.6% +3.0% +11.8% ➖ noise
11 duckdb:vortex-compact +8.8% +4.6% +4.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +13.9% +4.6% +8.8% +12.4% ➖ noise
12 datafusion:arrow -12.5% +4.4% -16.2% +31.3% ➖ noise
12 datafusion:vortex-compact +18.8% +4.4% +13.7% +10.0% 🚨 regression
12 datafusion:vortex-file-compressed +15.5% +4.4% +10.6% +10.0% 🚨 regression
12 duckdb:duckdb +4.2% +4.4% -0.2% +10.0% ➖ noise
12 duckdb:vortex-compact +11.8% +4.4% +7.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +19.3% +4.4% +14.2% +10.0% 🚨 regression
13 datafusion:arrow -2.9% +3.5% -6.1% +10.0% ➖ noise
13 datafusion:vortex-compact +19.9% +3.5% +15.9% +10.0% 🚨 regression
13 datafusion:vortex-file-compressed +14.7% +3.5% +10.9% +10.0% 🚨 regression
13 duckdb:duckdb +7.0% +3.5% +3.4% +10.0% ➖ noise
13 duckdb:vortex-compact +12.9% +3.5% +9.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +17.7% +3.5% +13.7% +10.0% 🚨 regression
14 datafusion:arrow -7.8% +5.7% -12.8% +10.0% ✅ faster
14 datafusion:vortex-compact +19.1% +5.7% +12.7% +10.0% 🚨 regression
14 datafusion:vortex-file-compressed +16.1% +5.7% +9.8% +10.0% ➖ noise
14 duckdb:duckdb +5.7% +5.7% +0.0% +10.0% ➖ noise
14 duckdb:vortex-compact +11.7% +5.7% +5.7% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +14.4% +5.7% +8.3% +10.0% ➖ noise
15 datafusion:arrow -9.0% +6.4% -14.5% +10.0% ✅ faster
15 datafusion:vortex-compact +20.5% +6.4% +13.2% +10.0% 🚨 regression
15 datafusion:vortex-file-compressed +12.0% +6.4% +5.2% +10.0% ➖ noise
15 duckdb:duckdb +6.6% +6.4% +0.2% +10.0% ➖ noise
15 duckdb:vortex-compact +12.7% +6.4% +5.9% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +17.3% +6.4% +10.2% +10.0% 🚨 regression
16 datafusion:arrow -5.7% +4.9% -10.1% +10.0% ✅ faster
16 datafusion:vortex-compact +16.4% +4.9% +11.0% +10.0% 🚨 regression
16 datafusion:vortex-file-compressed +13.4% +4.9% +8.1% +10.0% ➖ noise
16 duckdb:duckdb +8.1% +4.9% +3.0% +10.0% ➖ noise
16 duckdb:vortex-compact +9.5% +4.9% +4.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +13.2% +4.9% +7.9% +10.0% ➖ noise
17 datafusion:arrow -9.6% +3.7% -12.8% +10.0% ✅ faster
17 datafusion:vortex-compact +26.7% +3.7% +22.3% +10.0% 🚨 regression
17 datafusion:vortex-file-compressed +19.8% +3.7% +15.6% +10.0% 🚨 regression
17 duckdb:duckdb +2.7% +3.7% -0.9% +10.0% ➖ noise
17 duckdb:vortex-compact +14.6% +3.7% +10.6% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed +17.6% +3.7% +13.4% +10.0% 🚨 regression
18 datafusion:arrow -11.3% +4.9% -15.5% +10.0% ✅ faster
18 datafusion:vortex-compact +24.9% +4.9% +19.0% +10.0% 🚨 regression
18 datafusion:vortex-file-compressed +21.0% +4.9% +15.3% +10.0% 🚨 regression
18 duckdb:duckdb +3.7% +4.9% -1.2% +10.0% ➖ noise
18 duckdb:vortex-compact +7.8% +4.9% +2.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +13.8% +4.9% +8.5% +10.0% ➖ noise
19 datafusion:arrow -11.6% +4.2% -15.2% +10.0% ✅ faster
19 datafusion:vortex-compact +13.7% +4.2% +9.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +16.5% +4.2% +11.8% +10.0% 🚨 regression
19 duckdb:duckdb +3.3% +4.2% -0.9% +10.0% ➖ noise
19 duckdb:vortex-compact +7.1% +4.2% +2.7% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +11.0% +4.2% +6.5% +10.0% ➖ noise
20 datafusion:arrow -0.9% +4.1% -4.7% +10.0% ➖ noise
20 datafusion:vortex-compact +18.0% +4.1% +13.4% +10.0% 🚨 regression
20 datafusion:vortex-file-compressed +18.6% +4.1% +13.9% +10.0% 🚨 regression
20 duckdb:duckdb +2.1% +4.1% -1.9% +10.0% ➖ noise
20 duckdb:vortex-compact +13.6% +4.1% +9.2% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +16.9% +4.1% +12.3% +10.0% 🚨 regression
21 datafusion:arrow -1.6% +8.3% -9.2% +10.0% ✅ faster
21 datafusion:vortex-compact +20.6% +8.3% +11.3% +10.0% 🚨 regression
21 datafusion:vortex-file-compressed +24.3% +8.3% +14.7% +10.0% 🚨 regression
21 duckdb:duckdb +7.0% +8.3% -1.2% +10.0% ➖ noise
21 duckdb:vortex-compact +14.7% +8.3% +5.9% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +18.3% +8.3% +9.2% +10.0% ➖ noise
22 datafusion:arrow +0.6% +2.3% -1.7% +10.0% ➖ noise
22 datafusion:vortex-compact +17.3% +2.3% +14.6% +10.0% 🚨 regression
22 datafusion:vortex-file-compressed +15.4% +2.3% +12.8% +10.0% 🚨 regression
22 duckdb:duckdb -0.3% +2.3% -2.6% +10.0% ➖ noise
22 duckdb:vortex-compact +8.8% +2.3% +6.3% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +9.9% +2.3% +7.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: TPC-H SF=10 on NVME

File Size Changes (19 files changed, -0.0% overall, 0↑ 19↓)
File Scale Format Base HEAD Change %
orders_1.vortex 10.0 vortex-file-compressed 164.15 MB 164.15 MB 56 B -0.0%
orders_2.vortex 10.0 vortex-file-compressed 164.00 MB 164.00 MB 56 B -0.0%
orders_0.vortex 10.0 vortex-file-compressed 163.92 MB 163.92 MB 56 B -0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 134.87 MB 134.87 MB 56 B -0.0%
lineitem_0.vortex 10.0 vortex-file-compressed 134.65 MB 134.65 MB 56 B -0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.65 MB 134.65 MB 56 B -0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 134.52 MB 134.52 MB 56 B -0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 134.51 MB 134.51 MB 56 B -0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 134.43 MB 134.43 MB 56 B -0.0%
lineitem_2.vortex 10.0 vortex-file-compressed 134.38 MB 134.38 MB 56 B -0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 134.27 MB 134.27 MB 56 B -0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 134.06 MB 134.06 MB 56 B -0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 134.01 MB 134.01 MB 56 B -0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 133.86 MB 133.86 MB 56 B -0.0%
lineitem_3.vortex 10.0 vortex-file-compressed 133.74 MB 133.74 MB 56 B -0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 133.23 MB 133.23 MB 56 B -0.0%
customer_0.vortex 10.0 vortex-file-compressed 104.73 MB 104.73 MB 56 B -0.0%
supplier_0.vortex 10.0 vortex-file-compressed 6.69 MB 6.69 MB 256 B -0.0%
region_0.vortex 10.0 vortex-file-compressed 6.13 KB 6.01 KB 120 B -1.9%

Totals:

  • vortex-compact: 1.97 GB → 1.97 GB (0.0%)
  • vortex-file-compressed: 2.70 GB → 2.70 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.6%
Vortex (geomean): 1.099x ➖
Parquet (geomean): 1.082x ➖
Shifts: Parquet (control) +8.2% · Median polish +8.7%


duckdb / vortex-file-compressed (1.104x ❌, 0↑ 5↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12557428 11761738 1.07
statpopgen_q01/duckdb:vortex-file-compressed 🚨 23567691 20546847 1.15
statpopgen_q02/duckdb:vortex-file-compressed 1504027399 1391465305 1.08
statpopgen_q03/duckdb:vortex-file-compressed 3452949252 3164115806 1.09
statpopgen_q04/duckdb:vortex-file-compressed 🚨 3550702713 3127478183 1.14
statpopgen_q05/duckdb:vortex-file-compressed 1590338855 1472082451 1.08
statpopgen_q06/duckdb:vortex-file-compressed 2321185040 2140377835 1.08
statpopgen_q07/duckdb:vortex-file-compressed 🚨 249473020 221109872 1.13
statpopgen_q08/duckdb:vortex-file-compressed 🚨 288426138 252154425 1.14
statpopgen_q09/duckdb:vortex-file-compressed 🚨 3220015000 2921884889 1.10
statpopgen_q10/duckdb:vortex-file-compressed 5205719951 4783793204 1.09
duckdb / vortex-compact (1.094x ➖, 0↑ 3↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 🚨 13061635 11124527 1.17
statpopgen_q01/duckdb:vortex-compact 175933360 165105606 1.07
statpopgen_q02/duckdb:vortex-compact 🚨 2003547342 1809618080 1.11
statpopgen_q03/duckdb:vortex-compact 3794811354 3464081485 1.10
statpopgen_q04/duckdb:vortex-compact 3821500273 3495128893 1.09
statpopgen_q05/duckdb:vortex-compact 1969460977 1838086777 1.07
statpopgen_q06/duckdb:vortex-compact 2890890396 2656369780 1.09
statpopgen_q07/duckdb:vortex-compact 960100849 888404032 1.08
statpopgen_q08/duckdb:vortex-compact 989544672 927738807 1.07
statpopgen_q09/duckdb:vortex-compact 🚨 3629520725 3291248559 1.10
statpopgen_q10/duckdb:vortex-compact 5836909508 5358875240 1.09
duckdb / parquet (1.082x ➖, 0↑ 1↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 349707206 326896493 1.07
statpopgen_q01/duckdb:parquet 435643773 405384175 1.07
statpopgen_q02/duckdb:parquet 1073002484 987186583 1.09
statpopgen_q03/duckdb:parquet 🚨 1626321960 1469082035 1.11
statpopgen_q04/duckdb:parquet 1641214468 1516412113 1.08
statpopgen_q05/duckdb:parquet 1091398752 1000381835 1.09
statpopgen_q06/duckdb:parquet 1615327795 1484912127 1.09
statpopgen_q07/duckdb:parquet 1417552188 1320235806 1.07
statpopgen_q08/duckdb:parquet 1409654989 1333097278 1.06
statpopgen_q09/duckdb:parquet 1475546214 1371428015 1.08
statpopgen_q10/duckdb:parquet 2935254561 2677463022 1.10
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +17.4% +7.0% +9.8% +12.1% ➖ noise
0 duckdb:vortex-file-compressed +6.8% +7.0% -0.2% +12.4% ➖ noise
1 duckdb:vortex-compact +6.6% +7.5% -0.8% +32.3% ➖ noise
1 duckdb:vortex-file-compressed +14.7% +7.5% +6.7% +194.3% ➖ noise
2 duckdb:vortex-compact +10.7% +8.7% +1.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +8.1% +8.7% -0.6% +10.0% ➖ noise
3 duckdb:vortex-compact +9.5% +10.7% -1.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +9.1% +10.7% -1.4% +10.0% ➖ noise
4 duckdb:vortex-compact +9.3% +8.2% +1.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +13.5% +8.2% +4.9% +10.0% ➖ noise
5 duckdb:vortex-compact +7.1% +9.1% -1.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +8.0% +9.1% -1.0% +10.0% ➖ noise
6 duckdb:vortex-compact +8.8% +8.8% +0.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +8.4% +8.8% -0.3% +10.0% ➖ noise
7 duckdb:vortex-compact +8.1% +7.4% +0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +12.8% +7.4% +5.1% +10.0% ➖ noise
8 duckdb:vortex-compact +6.7% +5.7% +0.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +14.4% +5.7% +8.2% +10.0% ➖ noise
9 duckdb:vortex-compact +10.3% +7.6% +2.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +10.2% +7.6% +2.4% +10.0% ➖ noise
10 duckdb:vortex-compact +8.9% +9.6% -0.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +8.8% +9.6% -0.7% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: Statistical and Population Genetics

File Size Changes (2 files changed, +0.0% overall, 1↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 959.35 MB 959.39 MB +36.65 KB +0.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.97 GB 1.97 GB 424 B -0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.65 MB (+0.0%)
  • vortex-file-compressed: 1.97 GB → 1.97 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: Random Access

Vortex (geomean): 0.810x ✅
Parquet (geomean): 0.898x ✅


unknown / unknown (0.847x ✅, 28↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2134167 2394934 0.89
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚀 1363260 1954530 0.70
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8543734788 8799350497 0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8562327122 9450745532 0.91
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 7766049 11246423 0.69
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 7037192 10556221 0.67
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚀 5639225 7417402 0.76
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚀 6364016 8287145 0.77
random-access/feature-vectors/uniform/parquet-tokio-local-disk 🚀 8603425462 10961288965 0.78
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 🚀 8509977892 10716837697 0.79
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 12849563 19523196 0.66
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 12794843 17280303 0.74
random-access/lance-tokio-local-disk 744869 792746 0.94
random-access/lance-tokio-local-disk-footer 🚀 1227801 1369334 0.90
random-access/nested-lists/correlated/lance-tokio-local-disk 🚀 238054 347605 0.68
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚀 620808 976781 0.64
random-access/nested-lists/correlated/parquet-tokio-local-disk 🚀 131375103 158104789 0.83
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 🚀 131479317 162727048 0.81
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 596006 983886 0.61
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 619029 678645 0.91
random-access/nested-lists/uniform/lance-tokio-local-disk 🚀 1046276 1301414 0.80
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 🚀 1426013 2061512 0.69
random-access/nested-lists/uniform/parquet-tokio-local-disk 🚀 131377845 157331855 0.84
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 🚀 131931677 158940448 0.83
random-access/nested-lists/uniform/vortex-tokio-local-disk 2131897 2129661 1.00
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2139252 2132887 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk 385520 405182 0.95
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 570507 605292 0.94
random-access/nested-structs/correlated/parquet-tokio-local-disk 25969582 26504618 0.98
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 25379664 26558854 0.96
random-access/nested-structs/correlated/vortex-tokio-local-disk 769806 768939 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 777180 1010836 0.77
random-access/nested-structs/uniform/lance-tokio-local-disk 2579468 2750036 0.94
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2773332 3021409 0.92
random-access/nested-structs/uniform/parquet-tokio-local-disk 25783798 27323706 0.94
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 25843478 28384809 0.91
random-access/nested-structs/uniform/vortex-tokio-local-disk 1683352 1855239 0.91
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1664767 1804118 0.92
random-access/parquet-tokio-local-disk 🚀 173620742 203027470 0.86
random-access/parquet-tokio-local-disk-footer 173520367 185666484 0.93
random-access/taxi/correlated/lance-tokio-local-disk 922584 967987 0.95
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚀 1532116 1735385 0.88
random-access/taxi/correlated/parquet-tokio-local-disk 261504300 264746206 0.99
random-access/taxi/correlated/parquet-tokio-local-disk-footer 265518825 267432982 0.99
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1525573 2202875 0.69
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1712722 2381078 0.72
random-access/taxi/uniform/lance-tokio-local-disk 9403475 10320287 0.91
random-access/taxi/uniform/lance-tokio-local-disk-footer 10014001 10998139 0.91
random-access/taxi/uniform/parquet-tokio-local-disk 281816914 301764454 0.93
random-access/taxi/uniform/parquet-tokio-local-disk-footer 281422588 293749262 0.96
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4472567 5670130 0.79
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4431021 4759881 0.93
random-access/vortex-tokio-local-disk 🚀 1187308 1365565 0.87
random-access/vortex-tokio-local-disk-footer 🚀 1206063 1355714 0.89

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 0.986x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.2%


datafusion / vortex-file-compressed (0.989x ➖, 0↑ 1↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1817236 1765336 1.03
clickbench_q01/datafusion:vortex-file-compressed 36821918 36116892 1.02
clickbench_q02/datafusion:vortex-file-compressed 53180182 54013668 0.98
clickbench_q03/datafusion:vortex-file-compressed 57010574 59613058 0.96
clickbench_q04/datafusion:vortex-file-compressed 320358242 312240803 1.03
clickbench_q05/datafusion:vortex-file-compressed 323858333 331248381 0.98
clickbench_q06/datafusion:vortex-file-compressed 1764465 1701580 1.04
clickbench_q07/datafusion:vortex-file-compressed 39767042 40514575 0.98
clickbench_q08/datafusion:vortex-file-compressed 382460555 391999802 0.98
clickbench_q09/datafusion:vortex-file-compressed 615675740 606385333 1.02
clickbench_q10/datafusion:vortex-file-compressed 92672127 92923428 1.00
clickbench_q11/datafusion:vortex-file-compressed 101169798 99718740 1.01
clickbench_q12/datafusion:vortex-file-compressed 281652058 294346091 0.96
clickbench_q13/datafusion:vortex-file-compressed 443771589 446149164 0.99
clickbench_q14/datafusion:vortex-file-compressed 280308493 283865389 0.99
clickbench_q15/datafusion:vortex-file-compressed 354388689 360834037 0.98
clickbench_q16/datafusion:vortex-file-compressed 682686838 703946208 0.97
clickbench_q17/datafusion:vortex-file-compressed 676056459 687977619 0.98
clickbench_q18/datafusion:vortex-file-compressed 1407643404 1348562238 1.04
clickbench_q19/datafusion:vortex-file-compressed 47702307 52678551 0.91
clickbench_q20/datafusion:vortex-file-compressed 354935681 357421343 0.99
clickbench_q21/datafusion:vortex-file-compressed 390415939 399904654 0.98
clickbench_q22/datafusion:vortex-file-compressed 480650892 479988678 1.00
clickbench_q23/datafusion:vortex-file-compressed 729330177 673082850 1.08
clickbench_q24/datafusion:vortex-file-compressed 🚨 62565202 54576325 1.15
clickbench_q25/datafusion:vortex-file-compressed 85818514 89378276 0.96
clickbench_q26/datafusion:vortex-file-compressed 54038487 58386046 0.93
clickbench_q27/datafusion:vortex-file-compressed 735962639 735321047 1.00
clickbench_q28/datafusion:vortex-file-compressed 6900830768 6734538756 1.02
clickbench_q29/datafusion:vortex-file-compressed 244592705 244479724 1.00
clickbench_q30/datafusion:vortex-file-compressed 241254507 253362439 0.95
clickbench_q31/datafusion:vortex-file-compressed 273862766 279630720 0.98
clickbench_q32/datafusion:vortex-file-compressed 1149448171 1223029250 0.94
clickbench_q33/datafusion:vortex-file-compressed 1333451011 1391667970 0.96
clickbench_q34/datafusion:vortex-file-compressed 1334417745 1366558400 0.98
clickbench_q35/datafusion:vortex-file-compressed 469906390 492309789 0.95
clickbench_q36/datafusion:vortex-file-compressed 76167213 81986975 0.93
clickbench_q37/datafusion:vortex-file-compressed 38485743 39678923 0.97
clickbench_q38/datafusion:vortex-file-compressed 22747737 22745054 1.00
clickbench_q39/datafusion:vortex-file-compressed 137972394 152002039 0.91
clickbench_q40/datafusion:vortex-file-compressed 21493298 21553676 1.00
clickbench_q41/datafusion:vortex-file-compressed 21478785 21063057 1.02
clickbench_q42/datafusion:vortex-file-compressed 22496148 21950223 1.02
datafusion / parquet (0.995x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1631436 1596010 1.02
clickbench_q01/datafusion:parquet 18859658 19097765 0.99
clickbench_q02/datafusion:parquet 47085824 47327000 0.99
clickbench_q03/datafusion:parquet 37584926 37837674 0.99
clickbench_q04/datafusion:parquet 294760911 303757408 0.97
clickbench_q05/datafusion:parquet 349715402 363101988 0.96
clickbench_q06/datafusion:parquet 1663720 1774537 0.94
clickbench_q07/datafusion:parquet 22714959 22947863 0.99
clickbench_q08/datafusion:parquet 373937917 372956016 1.00
clickbench_q09/datafusion:parquet 614744043 625626494 0.98
clickbench_q10/datafusion:parquet 109975205 110584978 0.99
clickbench_q11/datafusion:parquet 136662544 135338836 1.01
clickbench_q12/datafusion:parquet 347565121 351318171 0.99
clickbench_q13/datafusion:parquet 490539820 522578464 0.94
clickbench_q14/datafusion:parquet 352575365 343869608 1.03
clickbench_q15/datafusion:parquet 343109803 344145341 1.00
clickbench_q16/datafusion:parquet 686820315 700128710 0.98
clickbench_q17/datafusion:parquet 665754525 673312779 0.99
clickbench_q18/datafusion:parquet 1354671055 1333014948 1.02
clickbench_q19/datafusion:parquet 31078947 29249601 1.06
clickbench_q20/datafusion:parquet 629162198 615380119 1.02
clickbench_q21/datafusion:parquet 689084602 669976765 1.03
clickbench_q22/datafusion:parquet 998249400 983656328 1.01
clickbench_q23/datafusion:parquet 3886432740 3797947897 1.02
clickbench_q24/datafusion:parquet 87978031 87038313 1.01
clickbench_q25/datafusion:parquet 141978899 135199206 1.05
clickbench_q26/datafusion:parquet 86429676 84222408 1.03
clickbench_q27/datafusion:parquet 1080190450 1066464046 1.01
clickbench_q28/datafusion:parquet 6791422716 6751275252 1.01
clickbench_q29/datafusion:parquet 239020651 247387861 0.97
clickbench_q30/datafusion:parquet 343153255 340580472 1.01
clickbench_q31/datafusion:parquet 378866802 381298237 0.99
clickbench_q32/datafusion:parquet 1212201168 1284193026 0.94
clickbench_q33/datafusion:parquet 1525536694 1567710167 0.97
clickbench_q34/datafusion:parquet 1559722534 1558016458 1.00
clickbench_q35/datafusion:parquet 486765918 497167465 0.98
clickbench_q36/datafusion:parquet 147271409 159245043 0.92
clickbench_q37/datafusion:parquet 60329972 63161944 0.96
clickbench_q38/datafusion:parquet 88435706 88564742 1.00
clickbench_q39/datafusion:parquet 272896762 276144919 0.99
clickbench_q40/datafusion:parquet 31551683 31695164 1.00
clickbench_q41/datafusion:parquet 29918042 27739472 1.08
clickbench_q42/datafusion:parquet 30952877 31727135 0.98
duckdb / vortex-file-compressed (0.984x ➖, 2↑ 1↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6615534 6137530 1.08
clickbench_q01/duckdb:vortex-file-compressed 14166765 13545295 1.05
clickbench_q02/duckdb:vortex-file-compressed 27359282 26280923 1.04
clickbench_q03/duckdb:vortex-file-compressed 29860248 30776485 0.97
clickbench_q04/duckdb:vortex-file-compressed 186415307 184424046 1.01
clickbench_q05/duckdb:vortex-file-compressed 173994650 179341974 0.97
clickbench_q06/duckdb:vortex-file-compressed 19149617 19089852 1.00
clickbench_q07/duckdb:vortex-file-compressed 15416730 16408846 0.94
clickbench_q08/duckdb:vortex-file-compressed 255895490 254779997 1.00
clickbench_q09/duckdb:vortex-file-compressed 339346114 335838382 1.01
clickbench_q10/duckdb:vortex-file-compressed 67650545 67454379 1.00
clickbench_q11/duckdb:vortex-file-compressed 77712441 78380012 0.99
clickbench_q12/duckdb:vortex-file-compressed 200222066 198640376 1.01
clickbench_q13/duckdb:vortex-file-compressed 401148561 403794505 0.99
clickbench_q14/duckdb:vortex-file-compressed 233261990 232536381 1.00
clickbench_q15/duckdb:vortex-file-compressed 244622181 239175621 1.02
clickbench_q16/duckdb:vortex-file-compressed 595912904 583992839 1.02
clickbench_q17/duckdb:vortex-file-compressed 471030847 461391450 1.02
clickbench_q18/duckdb:vortex-file-compressed 989954137 989914049 1.00
clickbench_q19/duckdb:vortex-file-compressed 21087468 21753119 0.97
clickbench_q20/duckdb:vortex-file-compressed 326036635 347492715 0.94
clickbench_q21/duckdb:vortex-file-compressed 371210275 382595515 0.97
clickbench_q22/duckdb:vortex-file-compressed 🚀 476574191 554983251 0.86
clickbench_q23/duckdb:vortex-file-compressed 🚀 529973523 919750078 0.58
clickbench_q24/duckdb:vortex-file-compressed 45218947 41745499 1.08
clickbench_q25/duckdb:vortex-file-compressed 73737195 80076077 0.92
clickbench_q26/duckdb:vortex-file-compressed 43884948 45340753 0.97
clickbench_q27/duckdb:vortex-file-compressed 480289818 468592924 1.02
clickbench_q28/duckdb:vortex-file-compressed 2964289134 2971270026 1.00
clickbench_q29/duckdb:vortex-file-compressed 28761956 29154084 0.99
clickbench_q30/duckdb:vortex-file-compressed 188777522 192921296 0.98
clickbench_q31/duckdb:vortex-file-compressed 277592407 289672521 0.96
clickbench_q32/duckdb:vortex-file-compressed 1184272700 1222589225 0.97
clickbench_q33/duckdb:vortex-file-compressed 1194474911 1199355375 1.00
clickbench_q34/duckdb:vortex-file-compressed 1212280355 1274303202 0.95
clickbench_q35/duckdb:vortex-file-compressed 375535056 382102542 0.98
clickbench_q36/duckdb:vortex-file-compressed 27009726 25846247 1.05
clickbench_q37/duckdb:vortex-file-compressed 19297015 20011215 0.96
clickbench_q38/duckdb:vortex-file-compressed 20339967 20631497 0.99
clickbench_q39/duckdb:vortex-file-compressed 40853577 40657732 1.00
clickbench_q40/duckdb:vortex-file-compressed 19865325 18937844 1.05
clickbench_q41/duckdb:vortex-file-compressed 🚨 20435586 18202957 1.12
clickbench_q42/duckdb:vortex-file-compressed 20996230 20387630 1.03
duckdb / parquet (1.008x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 25215667 24614343 1.02
clickbench_q01/duckdb:parquet 28412357 27135382 1.05
clickbench_q02/duckdb:parquet 48156207 48845815 0.99
clickbench_q03/duckdb:parquet 37875611 38821311 0.98
clickbench_q04/duckdb:parquet 203989965 201627253 1.01
clickbench_q05/duckdb:parquet 269786403 265132938 1.02
clickbench_q06/duckdb:parquet 45795641 46212623 0.99
clickbench_q07/duckdb:parquet 30089337 29835291 1.01
clickbench_q08/duckdb:parquet 269283026 265998505 1.01
clickbench_q09/duckdb:parquet 410208860 396096386 1.04
clickbench_q10/duckdb:parquet 80808705 78445186 1.03
clickbench_q11/duckdb:parquet 101859643 98203772 1.04
clickbench_q12/duckdb:parquet 301589254 295146103 1.02
clickbench_q13/duckdb:parquet 482982100 482791991 1.00
clickbench_q14/duckdb:parquet 338336765 326801009 1.04
clickbench_q15/duckdb:parquet 262789752 257441818 1.02
clickbench_q16/duckdb:parquet 679559844 649161589 1.05
clickbench_q17/duckdb:parquet 536928277 531615018 1.01
clickbench_q18/duckdb:parquet 1089973056 1080469599 1.01
clickbench_q19/duckdb:parquet 26255371 25392015 1.03
clickbench_q20/duckdb:parquet 424391130 415643099 1.02
clickbench_q21/duckdb:parquet 549153304 539337117 1.02
clickbench_q22/duckdb:parquet 929216201 931927485 1.00
clickbench_q23/duckdb:parquet 305625220 306526264 1.00
clickbench_q24/duckdb:parquet 69438024 67602370 1.03
clickbench_q25/duckdb:parquet 156883194 156256926 1.00
clickbench_q26/duckdb:parquet 48424121 50872608 0.95
clickbench_q27/duckdb:parquet 640915165 648798348 0.99
clickbench_q28/duckdb:parquet 4845226896 4819761994 1.01
clickbench_q29/duckdb:parquet 40953494 40589056 1.01
clickbench_q30/duckdb:parquet 300058751 300554975 1.00
clickbench_q31/duckdb:parquet 355741611 359388229 0.99
clickbench_q32/duckdb:parquet 1218408841 1157481695 1.05
clickbench_q33/duckdb:parquet 1276197367 1249281436 1.02
clickbench_q34/duckdb:parquet 1315204171 1345225129 0.98
clickbench_q35/duckdb:parquet 366070624 366208170 1.00
clickbench_q36/duckdb:parquet 46804334 47793993 0.98
clickbench_q37/duckdb:parquet 33304397 32268650 1.03
clickbench_q38/duckdb:parquet 32931909 32681961 1.01
clickbench_q39/duckdb:parquet 83199907 91856847 0.91
clickbench_q40/duckdb:parquet 18030777 17170527 1.05
clickbench_q41/duckdb:parquet 18632344 18406830 1.01
clickbench_q42/duckdb:parquet 21209839 22072132 0.96
duckdb / duckdb (1.011x ➖, 1↑ 1↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18804774 17584683 1.07
clickbench_q01/duckdb:duckdb 34551223 33816049 1.02
clickbench_q02/duckdb:duckdb 45827648 46025742 1.00
clickbench_q03/duckdb:duckdb 49042719 47744384 1.03
clickbench_q04/duckdb:duckdb 188024024 190041380 0.99
clickbench_q05/duckdb:duckdb 263022749 265654141 0.99
clickbench_q06/duckdb:duckdb 37727439 35950702 1.05
clickbench_q07/duckdb:duckdb 37066775 36149280 1.03
clickbench_q08/duckdb:duckdb 251845552 252168261 1.00
clickbench_q09/duckdb:duckdb 371250762 374706168 0.99
clickbench_q10/duckdb:duckdb 99999093 98835825 1.01
clickbench_q11/duckdb:duckdb 110561216 106496795 1.04
clickbench_q12/duckdb:duckdb 238273505 239339043 1.00
clickbench_q13/duckdb:duckdb 475077124 497737876 0.95
clickbench_q14/duckdb:duckdb 279882686 287116336 0.97
clickbench_q15/duckdb:duckdb 222673794 218246324 1.02
clickbench_q16/duckdb:duckdb 660455189 645976703 1.02
clickbench_q17/duckdb:duckdb 559921618 563219446 0.99
clickbench_q18/duckdb:duckdb 1240115730 1255225663 0.99
clickbench_q19/duckdb:duckdb 36735848 35042246 1.05
clickbench_q20/duckdb:duckdb 967190931 1045135371 0.93
clickbench_q21/duckdb:duckdb 🚀 1006159489 1150926408 0.87
clickbench_q22/duckdb:duckdb 1101076570 1076967318 1.02
clickbench_q23/duckdb:duckdb 271144528 254290643 1.07
clickbench_q24/duckdb:duckdb 65020342 61929754 1.05
clickbench_q25/duckdb:duckdb 146628870 146193918 1.00
clickbench_q26/duckdb:duckdb 63035895 60787099 1.04
clickbench_q27/duckdb:duckdb 1072964695 1119379385 0.96
clickbench_q28/duckdb:duckdb 4739202803 4652285323 1.02
clickbench_q29/duckdb:duckdb 50518128 49330016 1.02
clickbench_q30/duckdb:duckdb 257850844 260897915 0.99
clickbench_q31/duckdb:duckdb 429425458 432611085 0.99
clickbench_q32/duckdb:duckdb 1553866239 1523748154 1.02
clickbench_q33/duckdb:duckdb 🚨 2283175279 2075121193 1.10
clickbench_q34/duckdb:duckdb 2280245997 2183452992 1.04
clickbench_q35/duckdb:duckdb 277347704 279586203 0.99
clickbench_q36/duckdb:duckdb 38212760 42058910 0.91
clickbench_q37/duckdb:duckdb 33690468 31240748 1.08
clickbench_q38/duckdb:duckdb 32799368 30568812 1.07
clickbench_q39/duckdb:duckdb 66148594 70279070 0.94
clickbench_q40/duckdb:duckdb 33596392 31475496 1.07
clickbench_q41/duckdb:duckdb 32796319 30311647 1.08
clickbench_q42/duckdb:duckdb 33476578 31461271 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +2.9% +2.3% +0.6% +741.6% ➖ noise
0 duckdb:duckdb +6.9% +2.3% +4.5% +288.7% ➖ noise
0 duckdb:vortex-file-compressed +7.8% +2.3% +5.3% +477.0% ➖ noise
1 datafusion:vortex-file-compressed +2.0% +1.7% +0.3% +24.6% ➖ noise
1 duckdb:duckdb +2.2% +1.7% +0.5% +63.9% ➖ noise
1 duckdb:vortex-file-compressed +4.6% +1.7% +2.9% +26.9% ➖ noise
2 datafusion:vortex-file-compressed -1.5% -1.0% -0.6% +14.4% ➖ noise
2 duckdb:duckdb -0.4% -1.0% +0.5% +22.6% ➖ noise
2 duckdb:vortex-file-compressed +4.1% -1.0% +5.1% +11.2% ➖ noise
3 datafusion:vortex-file-compressed -4.4% -1.6% -2.9% +97.0% ➖ noise
3 duckdb:duckdb +2.7% -1.6% +4.3% +46.4% ➖ noise
3 duckdb:vortex-file-compressed -3.0% -1.6% -1.4% +54.5% ➖ noise
4 datafusion:vortex-file-compressed +2.6% -0.9% +3.5% +10.0% ➖ noise
4 duckdb:duckdb -1.1% -0.9% -0.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.1% -0.9% +2.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.2% -1.0% -1.2% +10.0% ➖ noise
5 duckdb:duckdb -1.0% -1.0% +0.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -3.0% -1.0% -2.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +3.7% -3.6% +7.6% +41.8% ➖ noise
6 duckdb:duckdb +4.9% -3.6% +8.9% +25.5% ➖ noise
6 duckdb:vortex-file-compressed +0.3% -3.6% +4.1% +14.1% ➖ noise
7 datafusion:vortex-file-compressed -1.8% -0.1% -1.8% +10.0% ➖ noise
7 duckdb:duckdb +2.5% -0.1% +2.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -6.0% -0.1% -6.0% +11.0% ➖ noise
8 datafusion:vortex-file-compressed -2.4% +0.7% -3.2% +10.0% ➖ noise
8 duckdb:duckdb -0.1% +0.7% -0.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.4% +0.7% -0.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.5% +0.9% +0.6% +10.0% ➖ noise
9 duckdb:duckdb -0.9% +0.9% -1.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.0% +0.9% +0.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.3% +1.2% -1.5% +10.6% ➖ noise
10 duckdb:duckdb +1.2% +1.2% -0.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.3% +1.2% -0.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.5% +2.3% -0.9% +10.0% ➖ noise
11 duckdb:duckdb +3.8% +2.3% +1.4% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.9% +2.3% -3.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -4.3% +0.5% -4.8% +10.0% ➖ noise
12 duckdb:duckdb -0.4% +0.5% -1.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.8% +0.5% +0.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.5% -3.1% +2.6% +10.0% ➖ noise
13 duckdb:duckdb -4.6% -3.1% -1.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.7% -3.1% +2.5% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.3% +3.0% -4.2% +10.0% ➖ noise
14 duckdb:duckdb -2.5% +3.0% -5.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.3% +3.0% -2.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -1.8% +0.9% -2.6% +10.0% ➖ noise
15 duckdb:duckdb +2.0% +0.9% +1.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +2.3% +0.9% +1.4% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -3.0% +1.3% -4.3% +10.0% ➖ noise
16 duckdb:duckdb +2.2% +1.3% +0.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.0% +1.3% +0.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.7% -0.1% -1.7% +10.0% ➖ noise
17 duckdb:duckdb -0.6% -0.1% -0.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +2.1% -0.1% +2.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +4.4% +1.3% +3.1% +10.0% ➖ noise
18 duckdb:duckdb -1.2% +1.3% -2.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.0% +1.3% -1.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -9.4% +4.8% -13.6% +20.3% ➖ noise
19 duckdb:duckdb +4.8% +4.8% +0.0% +18.8% ➖ noise
19 duckdb:vortex-file-compressed -3.1% +4.8% -7.5% +18.7% ➖ noise
20 datafusion:vortex-file-compressed -0.7% +2.2% -2.8% +199.4% ➖ noise
20 duckdb:duckdb -7.5% +2.2% -9.4% +24.7% ➖ noise
20 duckdb:vortex-file-compressed -6.2% +2.2% -8.2% +57.8% ➖ noise
21 datafusion:vortex-file-compressed -2.4% +2.3% -4.6% +10.0% ➖ noise
21 duckdb:duckdb -12.6% +2.3% -14.6% +10.0% ✅ faster
21 duckdb:vortex-file-compressed -3.0% +2.3% -5.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.1% +0.6% -0.5% +11.8% ➖ noise
22 duckdb:duckdb +2.2% +0.6% +1.6% +10.2% ➖ noise
22 duckdb:vortex-file-compressed -14.1% +0.6% -14.6% +22.6% ➖ noise
23 datafusion:vortex-file-compressed +8.4% +1.0% +7.3% +38.3% ➖ noise
23 duckdb:duckdb +6.6% +1.0% +5.6% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -42.4% +1.0% -43.0% +54.4% ✅ faster
24 datafusion:vortex-file-compressed +14.6% +1.9% +12.5% +10.8% 🚨 regression
24 duckdb:duckdb +5.0% +1.9% +3.0% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +8.3% +1.9% +6.3% +22.9% ➖ noise
25 datafusion:vortex-file-compressed -4.0% +2.7% -6.5% +10.0% ➖ noise
25 duckdb:duckdb +0.3% +2.7% -2.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -7.9% +2.7% -10.3% +10.4% ✅ faster
26 datafusion:vortex-file-compressed -7.4% -1.2% -6.4% +10.7% ➖ noise
26 duckdb:duckdb +3.7% -1.2% +4.9% +17.1% ➖ noise
26 duckdb:vortex-file-compressed -3.2% -1.2% -2.1% +36.1% ➖ noise
27 datafusion:vortex-file-compressed +0.1% +0.0% +0.1% +10.0% ➖ noise
27 duckdb:duckdb -4.1% +0.0% -4.2% +11.4% ➖ noise
27 duckdb:vortex-file-compressed +2.5% +0.0% +2.5% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.5% +0.6% +1.9% +10.0% ➖ noise
28 duckdb:duckdb +1.9% +0.6% +1.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.2% +0.6% -0.8% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +0.0% -1.3% +1.3% +10.0% ➖ noise
29 duckdb:duckdb +2.4% -1.3% +3.7% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -1.3% -1.3% -0.1% +21.2% ➖ noise
30 datafusion:vortex-file-compressed -4.8% +0.3% -5.1% +10.0% ➖ noise
30 duckdb:duckdb -1.2% +0.3% -1.5% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -2.1% +0.3% -2.4% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -2.1% -0.8% -1.2% +10.0% ➖ noise
31 duckdb:duckdb -0.7% -0.8% +0.1% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -4.2% -0.8% -3.4% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -6.0% -0.3% -5.7% +11.6% ➖ noise
32 duckdb:duckdb +2.0% -0.3% +2.3% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -3.1% -0.3% -2.8% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -4.2% -0.3% -3.9% +10.0% ➖ noise
33 duckdb:duckdb +10.0% -0.3% +10.4% +10.9% ➖ noise
33 duckdb:vortex-file-compressed -0.4% -0.3% -0.1% +11.6% ➖ noise
34 datafusion:vortex-file-compressed -2.4% -1.1% -1.3% +10.0% ➖ noise
34 duckdb:duckdb +4.4% -1.1% +5.6% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -4.9% -1.1% -3.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -4.6% -1.1% -3.5% +10.0% ➖ noise
35 duckdb:duckdb -0.8% -1.1% +0.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.7% -1.1% -0.7% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -7.1% -4.8% -2.4% +10.0% ➖ noise
36 duckdb:duckdb -9.1% -4.8% -4.5% +17.1% ➖ noise
36 duckdb:vortex-file-compressed +4.5% -4.8% +9.8% +16.0% ➖ noise
37 datafusion:vortex-file-compressed -3.0% -0.7% -2.3% +10.0% ➖ noise
37 duckdb:duckdb +7.8% -0.7% +8.6% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -3.6% -0.7% -2.9% +10.7% ➖ noise
38 datafusion:vortex-file-compressed +0.0% +0.3% -0.3% +10.0% ➖ noise
38 duckdb:duckdb +7.3% +0.3% +7.0% +10.6% ➖ noise
38 duckdb:vortex-file-compressed -1.4% +0.3% -1.7% +14.3% ➖ noise
39 datafusion:vortex-file-compressed -9.2% -5.4% -4.1% +10.0% ➖ noise
39 duckdb:duckdb -5.9% -5.4% -0.5% +14.0% ➖ noise
39 duckdb:vortex-file-compressed +0.5% -5.4% +6.2% +12.8% ➖ noise
40 datafusion:vortex-file-compressed -0.3% +2.2% -2.5% +10.0% ➖ noise
40 duckdb:duckdb +6.7% +2.2% +4.4% +10.9% ➖ noise
40 duckdb:vortex-file-compressed +4.9% +2.2% +2.6% +12.6% ➖ noise
41 datafusion:vortex-file-compressed +2.0% +4.5% -2.4% +11.5% ➖ noise
41 duckdb:duckdb +8.2% +4.5% +3.6% +11.0% ➖ noise
41 duckdb:vortex-file-compressed +12.3% +4.5% +7.4% +11.6% ➖ noise
42 datafusion:vortex-file-compressed +2.5% -3.2% +5.8% +11.5% ➖ noise
42 duckdb:duckdb +6.4% -3.2% +9.9% +11.0% ➖ noise
42 duckdb:vortex-file-compressed +3.0% -3.2% +6.4% +11.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: Clickbench on NVME

File Size Changes (110 files changed, -0.0% overall, 0↑ 110↓)
File Scale Format Base HEAD Change %
hits_41.vortex 1.0 vortex-compact 165.78 MB 165.78 MB 80 B -0.0%
hits_42.vortex 1.0 vortex-compact 164.22 MB 164.22 MB 80 B -0.0%
hits_77.vortex 1.0 vortex-compact 118.11 MB 118.11 MB 64 B -0.0%
hits_51.vortex 1.0 vortex-file-compressed 428.84 MB 428.84 MB 408 B -0.0%
hits_43.vortex 1.0 vortex-compact 168.91 MB 168.91 MB 176 B -0.0%
hits_13.vortex 1.0 vortex-compact 67.96 MB 67.96 MB 80 B -0.0%
hits_78.vortex 1.0 vortex-file-compressed 238.59 MB 238.59 MB 288 B -0.0%
hits_8.vortex 1.0 vortex-compact 62.89 MB 62.89 MB 80 B -0.0%
hits_17.vortex 1.0 vortex-compact 58.32 MB 58.32 MB 80 B -0.0%
hits_67.vortex 1.0 vortex-file-compressed 265.94 MB 265.94 MB 384 B -0.0%
hits_27.vortex 1.0 vortex-file-compressed 174.61 MB 174.61 MB 288 B -0.0%
hits_65.vortex 1.0 vortex-file-compressed 238.05 MB 238.05 MB 480 B -0.0%
hits_42.vortex 1.0 vortex-file-compressed 298.79 MB 298.79 MB 744 B -0.0%
hits_22.vortex 1.0 vortex-file-compressed 81.17 MB 81.17 MB 208 B -0.0%
hits_41.vortex 1.0 vortex-file-compressed 300.49 MB 300.49 MB 776 B -0.0%
hits_43.vortex 1.0 vortex-file-compressed 305.71 MB 305.71 MB 856 B -0.0%
hits_28.vortex 1.0 vortex-file-compressed 167.55 MB 167.55 MB 520 B -0.0%
hits_85.vortex 1.0 vortex-file-compressed 106.37 MB 106.37 MB 432 B -0.0%
hits_7.vortex 1.0 vortex-file-compressed 123.82 MB 123.82 MB 504 B -0.0%
hits_10.vortex 1.0 vortex-file-compressed 81.76 MB 81.76 MB 344 B -0.0%
hits_5.vortex 1.0 vortex-file-compressed 122.64 MB 122.64 MB 528 B -0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.86 MB 41.86 MB 200 B -0.0%
hits_87.vortex 1.0 vortex-file-compressed 221.68 MB 221.68 MB 1.11 KB -0.0%
hits_89.vortex 1.0 vortex-file-compressed 266.01 MB 266.01 MB 1.48 KB -0.0%
hits_12.vortex 1.0 vortex-file-compressed 125.34 MB 125.34 MB 784 B -0.0%
hits_14.vortex 1.0 vortex-file-compressed 135.14 MB 135.14 MB 848 B -0.0%
hits_62.vortex 1.0 vortex-file-compressed 148.36 MB 148.35 MB 1.05 KB -0.0%
hits_64.vortex 1.0 vortex-file-compressed 95.27 MB 95.27 MB 696 B -0.0%
hits_9.vortex 1.0 vortex-file-compressed 124.22 MB 124.22 MB 928 B -0.0%
hits_58.vortex 1.0 vortex-file-compressed 113.78 MB 113.78 MB 872 B -0.0%
hits_54.vortex 1.0 vortex-file-compressed 361.83 MB 361.83 MB 2.91 KB -0.0%
hits_57.vortex 1.0 vortex-file-compressed 158.37 MB 158.37 MB 1.27 KB -0.0%
hits_74.vortex 1.0 vortex-file-compressed 152.12 MB 152.12 MB 1.30 KB -0.0%
hits_94.vortex 1.0 vortex-file-compressed 185.12 MB 185.12 MB 1.64 KB -0.0%
hits_55.vortex 1.0 vortex-file-compressed 251.56 MB 251.55 MB 2.34 KB -0.0%
hits_82.vortex 1.0 vortex-file-compressed 122.77 MB 122.77 MB 1.26 KB -0.0%
hits_60.vortex 1.0 vortex-file-compressed 121.19 MB 121.19 MB 1.24 KB -0.0%
hits_92.vortex 1.0 vortex-file-compressed 196.47 MB 196.47 MB 2.02 KB -0.0%
hits_70.vortex 1.0 vortex-file-compressed 115.14 MB 115.14 MB 1.19 KB -0.0%
hits_50.vortex 1.0 vortex-file-compressed 255.24 MB 255.24 MB 2.65 KB -0.0%
hits_6.vortex 1.0 vortex-file-compressed 122.86 MB 122.86 MB 1.28 KB -0.0%
hits_90.vortex 1.0 vortex-file-compressed 204.12 MB 204.12 MB 2.14 KB -0.0%
hits_83.vortex 1.0 vortex-file-compressed 103.72 MB 103.72 MB 1.09 KB -0.0%
hits_84.vortex 1.0 vortex-file-compressed 145.05 MB 145.05 MB 1.58 KB -0.0%
hits_80.vortex 1.0 vortex-file-compressed 124.24 MB 124.24 MB 1.36 KB -0.0%
hits_24.vortex 1.0 vortex-file-compressed 79.71 MB 79.70 MB 896 B -0.0%
hits_77.vortex 1.0 vortex-file-compressed 218.96 MB 218.96 MB 2.45 KB -0.0%
hits_23.vortex 1.0 vortex-file-compressed 80.37 MB 80.37 MB 928 B -0.0%
hits_99.vortex 1.0 vortex-file-compressed 158.88 MB 158.87 MB 1.82 KB -0.0%
hits_44.vortex 1.0 vortex-file-compressed 243.64 MB 243.64 MB 2.80 KB -0.0%
hits_76.vortex 1.0 vortex-file-compressed 140.05 MB 140.05 MB 1.66 KB -0.0%
hits_63.vortex 1.0 vortex-file-compressed 80.62 MB 80.62 MB 1.01 KB -0.0%
hits_26.vortex 1.0 vortex-file-compressed 144.05 MB 144.05 MB 1.80 KB -0.0%
hits_68.vortex 1.0 vortex-compact 75.99 MB 75.99 MB 1008 B -0.0%
hits_56.vortex 1.0 vortex-file-compressed 163.76 MB 163.75 MB 2.16 KB -0.0%
hits_2.vortex 1.0 vortex-file-compressed 241.46 MB 241.45 MB 3.39 KB -0.0%
hits_8.vortex 1.0 vortex-file-compressed 122.86 MB 122.86 MB 1.76 KB -0.0%
hits_40.vortex 1.0 vortex-file-compressed 142.99 MB 142.99 MB 2.10 KB -0.0%
hits_81.vortex 1.0 vortex-file-compressed 126.55 MB 126.55 MB 1.88 KB -0.0%
hits_71.vortex 1.0 vortex-file-compressed 126.41 MB 126.41 MB 1.90 KB -0.0%
hits_13.vortex 1.0 vortex-file-compressed 123.20 MB 123.20 MB 1.88 KB -0.0%
hits_79.vortex 1.0 vortex-file-compressed 204.16 MB 204.16 MB 3.12 KB -0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.53 MB 28.53 MB 448 B -0.0%
hits_91.vortex 1.0 vortex-file-compressed 116.23 MB 116.23 MB 1.82 KB -0.0%
hits_4.vortex 1.0 vortex-file-compressed 138.86 MB 138.86 MB 2.21 KB -0.0%
hits_96.vortex 1.0 vortex-file-compressed 180.76 MB 180.75 MB 2.95 KB -0.0%
hits_1.vortex 1.0 vortex-file-compressed 181.16 MB 181.16 MB 3.04 KB -0.0%
hits_17.vortex 1.0 vortex-file-compressed 103.64 MB 103.64 MB 1.80 KB -0.0%
hits_75.vortex 1.0 vortex-file-compressed 74.18 MB 74.18 MB 1.30 KB -0.0%
hits_72.vortex 1.0 vortex-file-compressed 96.27 MB 96.27 MB 1.71 KB -0.0%
hits_37.vortex 1.0 vortex-file-compressed 97.54 MB 97.54 MB 1.79 KB -0.0%
hits_97.vortex 1.0 vortex-file-compressed 130.96 MB 130.96 MB 2.70 KB -0.0%
hits_52.vortex 1.0 vortex-file-compressed 120.78 MB 120.78 MB 2.50 KB -0.0%
hits_3.vortex 1.0 vortex-file-compressed 193.11 MB 193.11 MB 4.09 KB -0.0%
hits_66.vortex 1.0 vortex-file-compressed 105.34 MB 105.34 MB 2.23 KB -0.0%
hits_20.vortex 1.0 vortex-file-compressed 67.53 MB 67.53 MB 1.44 KB -0.0%
hits_19.vortex 1.0 vortex-file-compressed 82.10 MB 82.10 MB 1.77 KB -0.0%
hits_73.vortex 1.0 vortex-file-compressed 131.83 MB 131.83 MB 2.84 KB -0.0%
hits_88.vortex 1.0 vortex-file-compressed 137.34 MB 137.34 MB 3.08 KB -0.0%
hits_30.vortex 1.0 vortex-file-compressed 104.00 MB 104.00 MB 2.34 KB -0.0%
hits_18.vortex 1.0 vortex-file-compressed 126.06 MB 126.06 MB 3.02 KB -0.0%
hits_53.vortex 1.0 vortex-file-compressed 98.26 MB 98.25 MB 2.36 KB -0.0%
hits_69.vortex 1.0 vortex-file-compressed 147.61 MB 147.61 MB 3.58 KB -0.0%
hits_31.vortex 1.0 vortex-file-compressed 104.39 MB 104.39 MB 2.60 KB -0.0%
hits_39.vortex 1.0 vortex-file-compressed 94.06 MB 94.06 MB 2.42 KB -0.0%
hits_46.vortex 1.0 vortex-file-compressed 80.32 MB 80.32 MB 2.13 KB -0.0%
hits_86.vortex 1.0 vortex-file-compressed 81.40 MB 81.40 MB 2.16 KB -0.0%
hits_68.vortex 1.0 vortex-file-compressed 172.16 MB 172.16 MB 4.73 KB -0.0%
hits_15.vortex 1.0 vortex-file-compressed 97.01 MB 97.01 MB 2.66 KB -0.0%
hits_61.vortex 1.0 vortex-file-compressed 114.43 MB 114.43 MB 3.17 KB -0.0%
hits_98.vortex 1.0 vortex-file-compressed 150.55 MB 150.55 MB 4.44 KB -0.0%
hits_25.vortex 1.0 vortex-file-compressed 137.01 MB 137.00 MB 4.09 KB -0.0%
hits_49.vortex 1.0 vortex-file-compressed 88.67 MB 88.67 MB 2.68 KB -0.0%
hits_36.vortex 1.0 vortex-file-compressed 80.27 MB 80.27 MB 2.58 KB -0.0%
hits_35.vortex 1.0 vortex-file-compressed 138.81 MB 138.80 MB 4.46 KB -0.0%
hits_45.vortex 1.0 vortex-file-compressed 145.48 MB 145.47 MB 4.92 KB -0.0%
hits_21.vortex 1.0 vortex-file-compressed 101.28 MB 101.28 MB 3.65 KB -0.0%
hits_95.vortex 1.0 vortex-file-compressed 114.33 MB 114.33 MB 4.31 KB -0.0%
hits_16.vortex 1.0 vortex-file-compressed 87.59 MB 87.59 MB 3.41 KB -0.0%
hits_38.vortex 1.0 vortex-file-compressed 118.43 MB 118.42 MB 4.65 KB -0.0%
hits_32.vortex 1.0 vortex-file-compressed 77.12 MB 77.11 MB 3.26 KB -0.0%
hits_11.vortex 1.0 vortex-file-compressed 96.07 MB 96.07 MB 4.20 KB -0.0%
hits_29.vortex 1.0 vortex-file-compressed 65.47 MB 65.47 MB 2.88 KB -0.0%
hits_34.vortex 1.0 vortex-file-compressed 111.68 MB 111.68 MB 4.98 KB -0.0%
hits_93.vortex 1.0 vortex-file-compressed 107.66 MB 107.65 MB 4.83 KB -0.0%
hits_33.vortex 1.0 vortex-file-compressed 62.97 MB 62.96 MB 4.27 KB -0.0%
hits_59.vortex 1.0 vortex-file-compressed 121.84 MB 121.83 MB 9.94 KB -0.0%
hits_0.vortex 1.0 vortex-file-compressed 112.17 MB 112.16 MB 18.49 KB -0.0%
hits_0.vortex 1.0 vortex-compact 58.66 MB 58.64 MB 16.16 KB -0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -11.4%
Vortex (geomean): 0.930x ➖
Parquet (geomean): 1.050x ➖
Shifts: Parquet (control) +5.0% · Median polish -4.1%


datafusion / vortex-file-compressed (0.914x ➖, 2↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 253066181 259554314 0.98
tpch_q02/datafusion:vortex-file-compressed 479486829 550849015 0.87
tpch_q03/datafusion:vortex-file-compressed 400473398 470769067 0.85
tpch_q04/datafusion:vortex-file-compressed 240174025 258629440 0.93
tpch_q05/datafusion:vortex-file-compressed 388433611 406337014 0.96
tpch_q06/datafusion:vortex-file-compressed 370428186 342756807 1.08
tpch_q07/datafusion:vortex-file-compressed 424558114 401051601 1.06
tpch_q08/datafusion:vortex-file-compressed 743716991 755809023 0.98
tpch_q09/datafusion:vortex-file-compressed 417445571 593379377 0.70
tpch_q10/datafusion:vortex-file-compressed 497107012 498174786 1.00
tpch_q11/datafusion:vortex-file-compressed 326706415 340502215 0.96
tpch_q12/datafusion:vortex-file-compressed 524134803 490727461 1.07
tpch_q13/datafusion:vortex-file-compressed 162186383 137759368 1.18
tpch_q14/datafusion:vortex-file-compressed 271928121 266150575 1.02
tpch_q15/datafusion:vortex-file-compressed 618189873 511641257 1.21
tpch_q16/datafusion:vortex-file-compressed 199352006 185351888 1.08
tpch_q17/datafusion:vortex-file-compressed 355005691 435115645 0.82
tpch_q18/datafusion:vortex-file-compressed 🚀 296954179 448948634 0.66
tpch_q19/datafusion:vortex-file-compressed 494827291 590876308 0.84
tpch_q20/datafusion:vortex-file-compressed 🚀 436813111 978431821 0.45
tpch_q21/datafusion:vortex-file-compressed 549076370 587405782 0.93
tpch_q22/datafusion:vortex-file-compressed 142130226 155956671 0.91
datafusion / vortex-compact (0.869x ➖, 3↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 213267475 222526990 0.96
tpch_q02/datafusion:vortex-compact 416760611 427211658 0.98
tpch_q03/datafusion:vortex-compact 352162383 338671764 1.04
tpch_q04/datafusion:vortex-compact 177996225 243612074 0.73
tpch_q05/datafusion:vortex-compact 🚀 343860282 721934238 0.48
tpch_q06/datafusion:vortex-compact 252203976 300289139 0.84
tpch_q07/datafusion:vortex-compact 327919504 354426779 0.93
tpch_q08/datafusion:vortex-compact 472595228 496625898 0.95
tpch_q09/datafusion:vortex-compact 366311322 392419227 0.93
tpch_q10/datafusion:vortex-compact 418136409 374252027 1.12
tpch_q11/datafusion:vortex-compact 270467934 265263423 1.02
tpch_q12/datafusion:vortex-compact 🚀 468495028 682516424 0.69
tpch_q13/datafusion:vortex-compact 138343842 152038396 0.91
tpch_q14/datafusion:vortex-compact 🚀 171980937 286256214 0.60
tpch_q15/datafusion:vortex-compact 316045858 387374897 0.82
tpch_q16/datafusion:vortex-compact 183226945 196540106 0.93
tpch_q17/datafusion:vortex-compact 325655945 340400055 0.96
tpch_q18/datafusion:vortex-compact 256755689 279699272 0.92
tpch_q19/datafusion:vortex-compact 403999088 403510907 1.00
tpch_q20/datafusion:vortex-compact 360939063 377761162 0.96
tpch_q21/datafusion:vortex-compact 418276328 444337075 0.94
tpch_q22/datafusion:vortex-compact 137077472 182557462 0.75
datafusion / parquet (1.138x ➖, 0↑ 5↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 233127794 214736082 1.09
tpch_q02/datafusion:parquet 449419356 441334924 1.02
tpch_q03/datafusion:parquet 345866307 351506826 0.98
tpch_q04/datafusion:parquet 159802421 160598959 1.00
tpch_q05/datafusion:parquet 516078531 458516027 1.13
tpch_q06/datafusion:parquet 🚨 187103856 141386058 1.32
tpch_q07/datafusion:parquet 600547288 466746481 1.29
tpch_q08/datafusion:parquet 692674295 592149929 1.17
tpch_q09/datafusion:parquet 617210258 584352593 1.06
tpch_q10/datafusion:parquet 696705316 612431550 1.14
tpch_q11/datafusion:parquet 🚨 507025281 333735328 1.52
tpch_q12/datafusion:parquet 🚨 429632188 249741547 1.72
tpch_q13/datafusion:parquet 444136679 437935884 1.01
tpch_q14/datafusion:parquet 196687595 167406698 1.17
tpch_q15/datafusion:parquet 362502813 299603487 1.21
tpch_q16/datafusion:parquet 213005069 185608928 1.15
tpch_q17/datafusion:parquet 405576435 498778370 0.81
tpch_q18/datafusion:parquet 431062062 486083505 0.89
tpch_q19/datafusion:parquet 482291804 483529961 1.00
tpch_q20/datafusion:parquet 🚨 663885396 431102786 1.54
tpch_q21/datafusion:parquet 🚨 879595608 613701766 1.43
tpch_q22/datafusion:parquet 122636754 143438516 0.85
duckdb / vortex-file-compressed (0.953x ➖, 0↑ 1↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 257051190 305192534 0.84
tpch_q02/duckdb:vortex-file-compressed 932227998 969450599 0.96
tpch_q03/duckdb:vortex-file-compressed 657322534 689209726 0.95
tpch_q04/duckdb:vortex-file-compressed 🚨 513709159 386597345 1.33
tpch_q05/duckdb:vortex-file-compressed 943028308 933182513 1.01
tpch_q06/duckdb:vortex-file-compressed 371999817 395446758 0.94
tpch_q07/duckdb:vortex-file-compressed 750394092 1004068328 0.75
tpch_q08/duckdb:vortex-file-compressed 1004128010 1187506457 0.85
tpch_q09/duckdb:vortex-file-compressed 870907564 987118263 0.88
tpch_q10/duckdb:vortex-file-compressed 724626090 787483297 0.92
tpch_q11/duckdb:vortex-file-compressed 519635303 497878686 1.04
tpch_q12/duckdb:vortex-file-compressed 482589612 452584196 1.07
tpch_q13/duckdb:vortex-file-compressed 466272368 504155211 0.92
tpch_q14/duckdb:vortex-file-compressed 446746680 525109931 0.85
tpch_q15/duckdb:vortex-file-compressed 242818381 271034078 0.90
tpch_q16/duckdb:vortex-file-compressed 369268117 349865934 1.06
tpch_q17/duckdb:vortex-file-compressed 711543176 770068074 0.92
tpch_q18/duckdb:vortex-file-compressed 550611237 585208727 0.94
tpch_q19/duckdb:vortex-file-compressed 456946971 476441051 0.96
tpch_q20/duckdb:vortex-file-compressed 783358855 847972222 0.92
tpch_q21/duckdb:vortex-file-compressed 1064431056 1052473404 1.01
tpch_q22/duckdb:vortex-file-compressed 374675567 350493487 1.07
duckdb / vortex-compact (0.990x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 281990379 256053851 1.10
tpch_q02/duckdb:vortex-compact 892604029 910248448 0.98
tpch_q03/duckdb:vortex-compact 590172829 632371834 0.93
tpch_q04/duckdb:vortex-compact 357480105 351972456 1.02
tpch_q05/duckdb:vortex-compact 848096147 868099539 0.98
tpch_q06/duckdb:vortex-compact 401017021 429148260 0.93
tpch_q07/duckdb:vortex-compact 705667332 793468716 0.89
tpch_q08/duckdb:vortex-compact 917785689 917430271 1.00
tpch_q09/duckdb:vortex-compact 833950464 878147973 0.95
tpch_q10/duckdb:vortex-compact 689471427 751533108 0.92
tpch_q11/duckdb:vortex-compact 460859576 475250317 0.97
tpch_q12/duckdb:vortex-compact 458204919 446599129 1.03
tpch_q13/duckdb:vortex-compact 431925852 446386703 0.97
tpch_q14/duckdb:vortex-compact 459282223 456007153 1.01
tpch_q15/duckdb:vortex-compact 305687685 282541393 1.08
tpch_q16/duckdb:vortex-compact 378994859 346377358 1.09
tpch_q17/duckdb:vortex-compact 658641198 650477574 1.01
tpch_q18/duckdb:vortex-compact 482220919 517194578 0.93
tpch_q19/duckdb:vortex-compact 425392208 418424982 1.02
tpch_q20/duckdb:vortex-compact 766974684 784440578 0.98
tpch_q21/duckdb:vortex-compact 1077987105 1126113625 0.96
tpch_q22/duckdb:vortex-compact 368733381 343678092 1.07
duckdb / parquet (0.970x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 411407789 492082129 0.84
tpch_q02/duckdb:parquet 1246881158 1337056752 0.93
tpch_q03/duckdb:parquet 1075719047 1047935305 1.03
tpch_q04/duckdb:parquet 645655119 716822442 0.90
tpch_q05/duckdb:parquet 1492861912 1530286269 0.98
tpch_q06/duckdb:parquet 402580946 410526252 0.98
tpch_q07/duckdb:parquet 1230557499 1234265294 1.00
tpch_q08/duckdb:parquet 1701789499 1628112630 1.05
tpch_q09/duckdb:parquet 1340187680 1432207762 0.94
tpch_q10/duckdb:parquet 1300506829 1270721251 1.02
tpch_q11/duckdb:parquet 846327797 897695267 0.94
tpch_q12/duckdb:parquet 780390472 716970226 1.09
tpch_q13/duckdb:parquet 872174255 901410163 0.97
tpch_q14/duckdb:parquet 578376098 674532357 0.86
tpch_q15/duckdb:parquet 487892226 469200127 1.04
tpch_q16/duckdb:parquet 626436329 623001527 1.01
tpch_q17/duckdb:parquet 728082664 758166216 0.96
tpch_q18/duckdb:parquet 896544532 794233718 1.13
tpch_q19/duckdb:parquet 755596798 862329127 0.88
tpch_q20/duckdb:parquet 1148739438 1170888509 0.98
tpch_q21/duckdb:parquet 1084848705 1175443031 0.92
tpch_q22/duckdb:parquet 561733773 581816624 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -4.2% -4.7% +0.6% +87.3% ➖ noise
1 datafusion:vortex-file-compressed -2.5% -4.7% +2.3% +70.9% ➖ noise
1 duckdb:vortex-compact +10.1% -4.7% +15.6% +80.2% ➖ noise
1 duckdb:vortex-file-compressed -15.8% -4.7% -11.6% +44.5% ➖ noise
2 datafusion:vortex-compact -2.4% -2.6% +0.1% +32.0% ➖ noise
2 datafusion:vortex-file-compressed -13.0% -2.6% -10.7% +34.8% ➖ noise
2 duckdb:vortex-compact -1.9% -2.6% +0.6% +32.0% ➖ noise
2 duckdb:vortex-file-compressed -3.8% -2.6% -1.3% +32.0% ➖ noise
3 datafusion:vortex-compact +4.0% +0.5% +3.5% +42.0% ➖ noise
3 datafusion:vortex-file-compressed -14.9% +0.5% -15.4% +50.8% ➖ noise
3 duckdb:vortex-compact -6.7% +0.5% -7.1% +32.0% ➖ noise
3 duckdb:vortex-file-compressed -4.6% +0.5% -5.1% +32.0% ➖ noise
4 datafusion:vortex-compact -26.9% -5.3% -22.8% +36.8% ➖ noise
4 datafusion:vortex-file-compressed -7.1% -5.3% -1.9% +32.0% ➖ noise
4 duckdb:vortex-compact +1.6% -5.3% +7.3% +32.0% ➖ noise
4 duckdb:vortex-file-compressed +32.9% -5.3% +40.4% +45.8% ➖ noise
5 datafusion:vortex-compact -52.4% +4.8% -54.5% +32.7% ✅ faster
5 datafusion:vortex-file-compressed -4.4% +4.8% -8.8% +32.0% ➖ noise
5 duckdb:vortex-compact -2.3% +4.8% -6.8% +32.0% ➖ noise
5 duckdb:vortex-file-compressed +1.1% +4.8% -3.6% +32.0% ➖ noise
6 datafusion:vortex-compact -16.0% +13.9% -26.3% +32.0% ✅ faster
6 datafusion:vortex-file-compressed +8.1% +13.9% -5.1% +32.0% ➖ noise
6 duckdb:vortex-compact -6.6% +13.9% -18.0% +32.0% ➖ noise
6 duckdb:vortex-file-compressed -5.9% +13.9% -17.4% +32.0% ➖ noise
7 datafusion:vortex-compact -7.5% +13.3% -18.3% +32.0% ➖ noise
7 datafusion:vortex-file-compressed +5.9% +13.3% -6.5% +32.0% ➖ noise
7 duckdb:vortex-compact -11.1% +13.3% -21.5% +32.0% ➖ noise
7 duckdb:vortex-file-compressed -25.3% +13.3% -34.0% +32.0% ✅ faster
8 datafusion:vortex-compact -4.8% +10.6% -13.9% +32.0% ➖ noise
8 datafusion:vortex-file-compressed -1.6% +10.6% -11.0% +56.0% ➖ noise
8 duckdb:vortex-compact +0.0% +10.6% -9.5% +32.0% ➖ noise
8 duckdb:vortex-file-compressed -15.4% +10.6% -23.5% +32.0% ➖ noise
9 datafusion:vortex-compact -6.7% -0.6% -6.1% +32.0% ➖ noise
9 datafusion:vortex-file-compressed -29.6% -0.6% -29.2% +37.3% ✅ faster
9 duckdb:vortex-compact -5.0% -0.6% -4.5% +32.0% ➖ noise
9 duckdb:vortex-file-compressed -11.8% -0.6% -11.3% +32.0% ➖ noise
10 datafusion:vortex-compact +11.7% +7.9% +3.5% +32.0% ➖ noise
10 datafusion:vortex-file-compressed -0.2% +7.9% -7.5% +32.0% ➖ noise
10 duckdb:vortex-compact -8.3% +7.9% -15.0% +32.0% ➖ noise
10 duckdb:vortex-file-compressed -8.0% +7.9% -14.7% +32.0% ➖ noise
11 datafusion:vortex-compact +2.0% +19.7% -14.8% +32.0% ➖ noise
11 datafusion:vortex-file-compressed -4.1% +19.7% -19.8% +32.5% ➖ noise
11 duckdb:vortex-compact -3.0% +19.7% -19.0% +32.0% ➖ noise
11 duckdb:vortex-file-compressed +4.4% +19.7% -12.8% +32.0% ➖ noise
12 datafusion:vortex-compact -31.4% +36.8% -49.8% +42.9% ✅ faster
12 datafusion:vortex-file-compressed +6.8% +36.8% -21.9% +33.2% ➖ noise
12 duckdb:vortex-compact +2.6% +36.8% -25.0% +32.0% ✅ faster
12 duckdb:vortex-file-compressed +6.6% +36.8% -22.1% +42.0% ➖ noise
13 datafusion:vortex-compact -9.0% -0.9% -8.1% +64.7% ➖ noise
13 datafusion:vortex-file-compressed +17.7% -0.9% +18.9% +41.4% ➖ noise
13 duckdb:vortex-compact -3.2% -0.9% -2.3% +44.5% ➖ noise
13 duckdb:vortex-file-compressed -7.5% -0.9% -6.6% +40.3% ➖ noise
14 datafusion:vortex-compact -39.9% +0.4% -40.1% +32.0% ✅ faster
14 datafusion:vortex-file-compressed +2.2% +0.4% +1.8% +34.9% ➖ noise
14 duckdb:vortex-compact +0.7% +0.4% +0.3% +32.0% ➖ noise
14 duckdb:vortex-file-compressed -14.9% +0.4% -15.2% +32.0% ➖ noise
15 datafusion:vortex-compact -18.4% +12.2% -27.3% +32.0% ✅ faster
15 datafusion:vortex-file-compressed +20.8% +12.2% +7.7% +32.0% ➖ noise
15 duckdb:vortex-compact +8.2% +12.2% -3.5% +32.0% ➖ noise
15 duckdb:vortex-file-compressed -10.4% +12.2% -20.1% +32.0% ➖ noise
16 datafusion:vortex-compact -6.8% +7.4% -13.2% +32.0% ➖ noise
16 datafusion:vortex-file-compressed +7.6% +7.4% +0.1% +32.0% ➖ noise
16 duckdb:vortex-compact +9.4% +7.4% +1.9% +32.0% ➖ noise
16 duckdb:vortex-file-compressed +5.5% +7.4% -1.7% +32.0% ➖ noise
17 datafusion:vortex-compact -4.3% -11.6% +8.3% +32.0% ➖ noise
17 datafusion:vortex-file-compressed -18.4% -11.6% -7.7% +32.0% ➖ noise
17 duckdb:vortex-compact +1.3% -11.6% +14.6% +32.0% ➖ noise
17 duckdb:vortex-file-compressed -7.6% -11.6% +4.6% +32.0% ➖ noise
18 datafusion:vortex-compact -8.2% +0.1% -8.3% +32.0% ➖ noise
18 datafusion:vortex-file-compressed -33.9% +0.1% -33.9% +44.4% ✅ faster
18 duckdb:vortex-compact -6.8% +0.1% -6.8% +32.0% ➖ noise
18 duckdb:vortex-file-compressed -5.9% +0.1% -6.0% +32.0% ➖ noise
19 datafusion:vortex-compact +0.1% -6.5% +7.1% +33.5% ➖ noise
19 datafusion:vortex-file-compressed -16.3% -6.5% -10.4% +62.1% ➖ noise
19 duckdb:vortex-compact +1.7% -6.5% +8.7% +53.9% ➖ noise
19 duckdb:vortex-file-compressed -4.1% -6.5% +2.6% +34.0% ➖ noise
20 datafusion:vortex-compact -4.5% +22.9% -22.3% +32.0% ➖ noise
20 datafusion:vortex-file-compressed -55.4% +22.9% -63.7% +48.2% ✅ faster
20 duckdb:vortex-compact -2.2% +22.9% -20.5% +32.0% ➖ noise
20 duckdb:vortex-file-compressed -7.6% +22.9% -24.8% +32.0% ✅ faster
21 datafusion:vortex-compact -5.9% +15.0% -18.2% +32.0% ➖ noise
21 datafusion:vortex-file-compressed -6.5% +15.0% -18.7% +32.0% ➖ noise
21 duckdb:vortex-compact -4.3% +15.0% -16.8% +32.0% ➖ noise
21 duckdb:vortex-file-compressed +1.1% +15.0% -12.1% +32.0% ➖ noise
22 datafusion:vortex-compact -24.9% -9.1% -17.4% +36.8% ➖ noise
22 datafusion:vortex-file-compressed -8.9% -9.1% +0.3% +32.0% ➖ noise
22 duckdb:vortex-compact +7.3% -9.1% +18.1% +33.3% ➖ noise
22 duckdb:vortex-file-compressed +6.9% -9.1% +17.7% +34.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: Compression

Vortex (geomean): 1.010x ➖
Parquet (geomean): 1.000x ➖


unknown / unknown (1.000x ➖, 5↑ 6↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
compress time/Arade 1153209649 1122475234 1.03
compress time/Bimbo 6479091047 6732882899 0.96
compress time/CMSprovider 2843145960 2856638591 1.00
compress time/Euro2016 433599488 426956262 1.02
compress time/Food 393139332 387191002 1.02
compress time/HashTags 832116010 822832883 1.01
compress time/TPC-H l_comment canonical 1302890422 1389196893 0.94
compress time/TPC-H l_comment chunked 1301872990 1310641823 0.99
compress time/taxi 739243491 712012292 1.04
compress time/wide table cols=100 chunks=1 rows=1000 🚀 11557592 13716068 0.84
compress time/wide table cols=100 chunks=50 rows=1000 11944078 12018791 0.99
compress time/wide table cols=1000 chunks=1 rows=1000 🚀 128175112 151246939 0.85
compress time/wide table cols=1000 chunks=50 rows=1000 123757824 131161543 0.94
compress time/wide table cols=10000 chunks=1 rows=1000 1433679680 1403732066 1.02
compress time/wide table cols=10000 chunks=50 rows=1000 1418490657 1399868655 1.01
decompress time/Arade 🚨 31200277 26761494 1.17
decompress time/Bimbo 92271727 92913515 0.99
decompress time/CMSprovider 80440662 77445730 1.04
decompress time/Euro2016 19191538 19045814 1.01
decompress time/Food 🚨 9802862 8806213 1.11
decompress time/HashTags 76332225 70332729 1.09
decompress time/TPC-H l_comment canonical 🚀 40503563 47600655 0.85
decompress time/TPC-H l_comment chunked 40448271 42438115 0.95
decompress time/taxi 🚨 18132074 15942341 1.14
decompress time/wide table cols=100 chunks=1 rows=1000 2707924 2896876 0.93
decompress time/wide table cols=100 chunks=50 rows=1000 2736861 2518358 1.09
decompress time/wide table cols=1000 chunks=1 rows=1000 24449090 26885686 0.91
decompress time/wide table cols=1000 chunks=50 rows=1000 24887192 23202749 1.07
decompress time/wide table cols=10000 chunks=1 rows=1000 267846485 261220244 1.03
decompress time/wide table cols=10000 chunks=50 rows=1000 264563582 250898016 1.05
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3016108229 2862061546 1.05
parquet_rs-zstd compress time/Bimbo 14711326200 14855298782 0.99
parquet_rs-zstd compress time/CMSprovider 7540951417 7704234515 0.98
parquet_rs-zstd compress time/Euro2016 1359893200 1338819401 1.02
parquet_rs-zstd compress time/Food 870784190 872882045 1.00
parquet_rs-zstd compress time/HashTags 2408147740 2299655002 1.05
parquet_rs-zstd compress time/TPC-H l_comment canonical 3137691473 3481554680 0.90
parquet_rs-zstd compress time/TPC-H l_comment chunked 3070157637 3160463647 0.97
parquet_rs-zstd compress time/taxi 1467039406 1344070019 1.09
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 6815489 8979671 0.76
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 7192810 6743806 1.07
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 82694931 89257958 0.93
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 83751448 81181121 1.03
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 866116491 926851369 0.93
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 863661829 860152426 1.00
parquet_rs-zstd decompress time/Arade 657311187 635968016 1.03
parquet_rs-zstd decompress time/Bimbo 1769500264 1692782969 1.05
parquet_rs-zstd decompress time/CMSprovider 1952666138 1954963633 1.00
parquet_rs-zstd decompress time/Euro2016 383485893 383632522 1.00
parquet_rs-zstd decompress time/Food 221025468 215327460 1.03
parquet_rs-zstd decompress time/HashTags 650303084 624519472 1.04
parquet_rs-zstd decompress time/TPC-H l_comment canonical 569476212 630337455 0.90
parquet_rs-zstd decompress time/TPC-H l_comment chunked 563851318 568468068 0.99
parquet_rs-zstd decompress time/taxi 257393082 243278511 1.06
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 🚀 2769008 3542436 0.78
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2752217 2747414 1.00
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32255421 35698393 0.90
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33120670 32584554 1.02
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 342076358 366128224 0.93
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 343026897 337577066 1.02
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163383268 163364604 1.00
vortex-file-compressed size/Food 41926856 41926936 1.00
vortex-file-compressed size/HashTags 196342620 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087304 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087304 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.97
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.97
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio compress time/Food 0 0 1.02
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.97
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.04
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio compress time/taxi 0 0 0.95
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚨 1 1 1.11
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.93
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.91
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.91
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.09
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio decompress time/Arade 🚨 0 0 1.13
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.95
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.04
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio decompress time/Food 0 0 1.08
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.04
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.94
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.96
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.07
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 🚨 0 0 1.20
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.08
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 0.912x ➖
Parquet (geomean): 0.919x ➖
Shifts: Parquet (control) -8.1% · Median polish -4.2%


datafusion / vortex-file-compressed (0.796x ➖, 5↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 686875945 684624934 1.00
tpch_q02/datafusion:vortex-file-compressed 679379295 770004248 0.88
tpch_q03/datafusion:vortex-file-compressed 800561564 830833857 0.96
tpch_q04/datafusion:vortex-file-compressed 🚀 661717926 1404990893 0.47
tpch_q05/datafusion:vortex-file-compressed 🚀 1136358024 2166161622 0.52
tpch_q06/datafusion:vortex-file-compressed 696710559 745787611 0.93
tpch_q07/datafusion:vortex-file-compressed 1188586104 1607842194 0.74
tpch_q08/datafusion:vortex-file-compressed 1345891085 1721042686 0.78
tpch_q09/datafusion:vortex-file-compressed 1372240540 1659890882 0.83
tpch_q10/datafusion:vortex-file-compressed 🚀 988291524 1979644699 0.50
tpch_q11/datafusion:vortex-file-compressed 445695746 589148013 0.76
tpch_q12/datafusion:vortex-file-compressed 1091774880 980598298 1.11
tpch_q13/datafusion:vortex-file-compressed 433754331 433267857 1.00
tpch_q14/datafusion:vortex-file-compressed 732513819 904468622 0.81
tpch_q15/datafusion:vortex-file-compressed 1174168687 1345447448 0.87
tpch_q16/datafusion:vortex-file-compressed 454049124 420430409 1.08
tpch_q17/datafusion:vortex-file-compressed 1162215050 1286016244 0.90
tpch_q18/datafusion:vortex-file-compressed 1184830738 1264298213 0.94
tpch_q19/datafusion:vortex-file-compressed 🚀 947264682 1422476331 0.67
tpch_q20/datafusion:vortex-file-compressed 🚀 1058973760 1723192295 0.61
tpch_q21/datafusion:vortex-file-compressed 1599680355 2015426368 0.79
tpch_q22/datafusion:vortex-file-compressed 423284911 525579461 0.81
datafusion / vortex-compact (0.960x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 714260674 1008189170 0.71
tpch_q02/datafusion:vortex-compact 663536019 707749767 0.94
tpch_q03/datafusion:vortex-compact 623696929 744932981 0.84
tpch_q04/datafusion:vortex-compact 607170232 542336411 1.12
tpch_q05/datafusion:vortex-compact 1056826879 882851894 1.20
tpch_q06/datafusion:vortex-compact 646461327 639079483 1.01
tpch_q07/datafusion:vortex-compact 1039994350 973309642 1.07
tpch_q08/datafusion:vortex-compact 1045267515 1110797684 0.94
tpch_q09/datafusion:vortex-compact 1146939562 1174493650 0.98
tpch_q10/datafusion:vortex-compact 925172276 970149515 0.95
tpch_q11/datafusion:vortex-compact 390597813 443372619 0.88
tpch_q12/datafusion:vortex-compact 844492681 911123373 0.93
tpch_q13/datafusion:vortex-compact 399398101 425486697 0.94
tpch_q14/datafusion:vortex-compact 572267735 567576793 1.01
tpch_q15/datafusion:vortex-compact 1199234903 1254662579 0.96
tpch_q16/datafusion:vortex-compact 408591383 334519548 1.22
tpch_q17/datafusion:vortex-compact 1401868834 1193354015 1.17
tpch_q18/datafusion:vortex-compact 1260110465 1241771705 1.01
tpch_q19/datafusion:vortex-compact 705776615 793006186 0.89
tpch_q20/datafusion:vortex-compact 780378964 989701085 0.79
tpch_q21/datafusion:vortex-compact 1371551126 1477768662 0.93
tpch_q22/datafusion:vortex-compact 368168435 445020715 0.83
datafusion / parquet (0.917x ➖, 2↑ 1↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 665977024 667778003 1.00
tpch_q02/datafusion:parquet 🚀 648762335 1298976710 0.50
tpch_q03/datafusion:parquet 960429328 926204739 1.04
tpch_q04/datafusion:parquet 430920741 501206681 0.86
tpch_q05/datafusion:parquet 1145207954 1547289713 0.74
tpch_q06/datafusion:parquet 551060880 561643685 0.98
tpch_q07/datafusion:parquet 1364251980 1443254582 0.95
tpch_q08/datafusion:parquet 1683372721 1989409581 0.85
tpch_q09/datafusion:parquet 1962477465 2069672161 0.95
tpch_q10/datafusion:parquet 2096128669 2495544103 0.84
tpch_q11/datafusion:parquet 501050180 631056985 0.79
tpch_q12/datafusion:parquet 876251033 845861716 1.04
tpch_q13/datafusion:parquet 829940784 687404183 1.21
tpch_q14/datafusion:parquet 831858413 805785706 1.03
tpch_q15/datafusion:parquet 1269762367 1198342724 1.06
tpch_q16/datafusion:parquet 🚨 503577166 385089434 1.31
tpch_q17/datafusion:parquet 1304581794 1540452252 0.85
tpch_q18/datafusion:parquet 2109696912 1721803000 1.23
tpch_q19/datafusion:parquet 1348987318 1048084513 1.29
tpch_q20/datafusion:parquet 1361452604 1260585027 1.08
tpch_q21/datafusion:parquet 1756716614 1984622325 0.89
tpch_q22/datafusion:parquet 🚀 641331836 1623987328 0.39
duckdb / vortex-file-compressed (0.954x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 614194944 646790675 0.95
tpch_q02/duckdb:vortex-file-compressed 1048776693 1130054311 0.93
tpch_q03/duckdb:vortex-file-compressed 868276042 953842928 0.91
tpch_q04/duckdb:vortex-file-compressed 622801829 644969263 0.97
tpch_q05/duckdb:vortex-file-compressed 1135595464 1282726696 0.89
tpch_q06/duckdb:vortex-file-compressed 818578542 939816300 0.87
tpch_q07/duckdb:vortex-file-compressed 1168929126 1190862239 0.98
tpch_q08/duckdb:vortex-file-compressed 1377348672 1475579931 0.93
tpch_q09/duckdb:vortex-file-compressed 1426850679 1447904586 0.99
tpch_q10/duckdb:vortex-file-compressed 1057576219 1169566064 0.90
tpch_q11/duckdb:vortex-file-compressed 604795521 594291918 1.02
tpch_q12/duckdb:vortex-file-compressed 727147979 758109548 0.96
tpch_q13/duckdb:vortex-file-compressed 912448897 897755788 1.02
tpch_q14/duckdb:vortex-file-compressed 844436979 857094310 0.99
tpch_q15/duckdb:vortex-file-compressed 576270693 502551218 1.15
tpch_q16/duckdb:vortex-file-compressed 432285169 470688609 0.92
tpch_q17/duckdb:vortex-file-compressed 1031026058 989834240 1.04
tpch_q18/duckdb:vortex-file-compressed 888390670 966572372 0.92
tpch_q19/duckdb:vortex-file-compressed 776579926 803546222 0.97
tpch_q20/duckdb:vortex-file-compressed 1184934884 1343262387 0.88
tpch_q21/duckdb:vortex-file-compressed 1984507387 1916565310 1.04
tpch_q22/duckdb:vortex-file-compressed 648061417 775083861 0.84
duckdb / vortex-compact (0.949x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 607925909 615021432 0.99
tpch_q02/duckdb:vortex-compact 1056264354 1069526062 0.99
tpch_q03/duckdb:vortex-compact 806211969 798207252 1.01
tpch_q04/duckdb:vortex-compact 479341914 593411229 0.81
tpch_q05/duckdb:vortex-compact 1033488969 1159417021 0.89
tpch_q06/duckdb:vortex-compact 747446065 838344683 0.89
tpch_q07/duckdb:vortex-compact 1039217758 1138188346 0.91
tpch_q08/duckdb:vortex-compact 1333398145 1493583796 0.89
tpch_q09/duckdb:vortex-compact 1272822516 1485495895 0.86
tpch_q10/duckdb:vortex-compact 994386559 1202818813 0.83
tpch_q11/duckdb:vortex-compact 625977675 713328244 0.88
tpch_q12/duckdb:vortex-compact 655289265 648436593 1.01
tpch_q13/duckdb:vortex-compact 830572430 890798041 0.93
tpch_q14/duckdb:vortex-compact 865725591 937762170 0.92
tpch_q15/duckdb:vortex-compact 542982824 546049186 0.99
tpch_q16/duckdb:vortex-compact 461911486 500801292 0.92
tpch_q17/duckdb:vortex-compact 905318562 878366878 1.03
tpch_q18/duckdb:vortex-compact 767444854 733529955 1.05
tpch_q19/duckdb:vortex-compact 762069294 718950053 1.06
tpch_q20/duckdb:vortex-compact 1131871209 1230406919 0.92
tpch_q21/duckdb:vortex-compact 1828082738 1669597916 1.09
tpch_q22/duckdb:vortex-compact 643152374 600271536 1.07
duckdb / parquet (0.921x ➖, 0↑ 0↓)
name PR b06abf9 (ns) base 543dbe7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 758960372 993821855 0.76
tpch_q02/duckdb:parquet 1434271538 1525625720 0.94
tpch_q03/duckdb:parquet 1850037665 1635700559 1.13
tpch_q04/duckdb:parquet 896717833 1033836224 0.87
tpch_q05/duckdb:parquet 2027467817 2090609212 0.97
tpch_q06/duckdb:parquet 727894164 775541536 0.94
tpch_q07/duckdb:parquet 2013229190 2010930536 1.00
tpch_q08/duckdb:parquet 2348804325 2815862977 0.83
tpch_q09/duckdb:parquet 2349068194 2940414200 0.80
tpch_q10/duckdb:parquet 3162774361 3417194075 0.93
tpch_q11/duckdb:parquet 1045787296 1053368724 0.99
tpch_q12/duckdb:parquet 983926349 1219018466 0.81
tpch_q13/duckdb:parquet 1198367803 1460763602 0.82
tpch_q14/duckdb:parquet 1165317645 1207187351 0.97
tpch_q15/duckdb:parquet 882416822 963300482 0.92
tpch_q16/duckdb:parquet 814951001 817998392 1.00
tpch_q17/duckdb:parquet 1209825782 1233065869 0.98
tpch_q18/duckdb:parquet 1382800372 1365929938 1.01
tpch_q19/duckdb:parquet 1432403009 1529756875 0.94
tpch_q20/duckdb:parquet 1696022770 1779290608 0.95
tpch_q21/duckdb:parquet 1704075411 1852947290 0.92
tpch_q22/duckdb:parquet 1010046528 1141005790 0.89
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -29.2% -12.7% -18.8% +66.2% ➖ noise
1 datafusion:vortex-file-compressed +0.3% -12.7% +15.0% +51.8% ➖ noise
1 duckdb:vortex-compact -1.2% -12.7% +13.3% +47.8% ➖ noise
1 duckdb:vortex-file-compressed -5.0% -12.7% +8.8% +47.8% ➖ noise
2 datafusion:vortex-compact -6.2% -31.5% +36.8% +47.8% ➖ noise
2 datafusion:vortex-file-compressed -11.8% -31.5% +28.8% +49.7% ➖ noise
2 duckdb:vortex-compact -1.2% -31.5% +44.1% +47.8% ➖ noise
2 duckdb:vortex-file-compressed -7.2% -31.5% +35.4% +47.8% ➖ noise
3 datafusion:vortex-compact -16.3% +8.3% -22.7% +47.8% ➖ noise
3 datafusion:vortex-file-compressed -3.6% +8.3% -11.0% +49.6% ➖ noise
3 duckdb:vortex-compact +1.0% +8.3% -6.7% +47.8% ➖ noise
3 duckdb:vortex-file-compressed -9.0% +8.3% -15.9% +47.8% ➖ noise
4 datafusion:vortex-compact +12.0% -13.6% +29.6% +47.8% ➖ noise
4 datafusion:vortex-file-compressed -52.9% -13.6% -45.5% +76.7% ✅ faster
4 duckdb:vortex-compact -19.2% -13.6% -6.5% +47.8% ➖ noise
4 duckdb:vortex-file-compressed -3.4% -13.6% +11.8% +47.8% ➖ noise
5 datafusion:vortex-compact +19.7% -15.3% +41.3% +47.8% ➖ noise
5 datafusion:vortex-file-compressed -47.5% -15.3% -38.1% +47.8% ✅ faster
5 duckdb:vortex-compact -10.9% -15.3% +5.2% +47.8% ➖ noise
5 duckdb:vortex-file-compressed -11.5% -15.3% +4.5% +47.8% ➖ noise
6 datafusion:vortex-compact +1.2% -4.0% +5.4% +47.8% ➖ noise
6 datafusion:vortex-file-compressed -6.6% -4.0% -2.6% +47.8% ➖ noise
6 duckdb:vortex-compact -10.8% -4.0% -7.1% +47.8% ➖ noise
6 duckdb:vortex-file-compressed -12.9% -4.0% -9.2% +47.8% ➖ noise
7 datafusion:vortex-compact +6.9% -2.7% +9.8% +47.8% ➖ noise
7 datafusion:vortex-file-compressed -26.1% -2.7% -24.0% +47.8% ➖ noise
7 duckdb:vortex-compact -8.7% -2.7% -6.1% +47.8% ➖ noise
7 duckdb:vortex-file-compressed -1.8% -2.7% +0.9% +47.8% ➖ noise
8 datafusion:vortex-compact -5.9% -16.0% +12.0% +47.8% ➖ noise
8 datafusion:vortex-file-compressed -21.8% -16.0% -6.9% +47.8% ➖ noise
8 duckdb:vortex-compact -10.7% -16.0% +6.3% +47.8% ➖ noise
8 duckdb:vortex-file-compressed -6.7% -16.0% +11.1% +47.8% ➖ noise
9 datafusion:vortex-compact -2.3% -13.0% +12.2% +47.8% ➖ noise
9 datafusion:vortex-file-compressed -17.3% -13.0% -5.0% +47.8% ➖ noise
9 duckdb:vortex-compact -14.3% -13.0% -1.6% +47.8% ➖ noise
9 duckdb:vortex-file-compressed -1.5% -13.0% +13.2% +47.8% ➖ noise
10 datafusion:vortex-compact -4.6% -11.8% +8.2% +47.8% ➖ noise
10 datafusion:vortex-file-compressed -50.1% -11.8% -43.4% +47.8% ✅ faster
10 duckdb:vortex-compact -17.3% -11.8% -6.2% +47.8% ➖ noise
10 duckdb:vortex-file-compressed -9.6% -11.8% +2.6% +47.8% ➖ noise
11 datafusion:vortex-compact -11.9% -11.2% -0.8% +47.8% ➖ noise
11 datafusion:vortex-file-compressed -24.3% -11.2% -14.8% +47.8% ➖ noise
11 duckdb:vortex-compact -12.2% -11.2% -1.2% +47.8% ➖ noise
11 duckdb:vortex-file-compressed +1.8% -11.2% +14.6% +47.8% ➖ noise
12 datafusion:vortex-compact -7.3% -8.6% +1.4% +47.8% ➖ noise
12 datafusion:vortex-file-compressed +11.3% -8.6% +21.8% +47.8% ➖ noise
12 duckdb:vortex-compact +1.1% -8.6% +10.5% +47.8% ➖ noise
12 duckdb:vortex-file-compressed -4.1% -8.6% +4.9% +47.8% ➖ noise
13 datafusion:vortex-compact -6.1% -0.5% -5.7% +47.8% ➖ noise
13 datafusion:vortex-file-compressed +0.1% -0.5% +0.6% +47.8% ➖ noise
13 duckdb:vortex-compact -6.8% -0.5% -6.3% +47.8% ➖ noise
13 duckdb:vortex-file-compressed +1.6% -0.5% +2.1% +47.8% ➖ noise
14 datafusion:vortex-compact +0.8% -0.2% +1.0% +47.8% ➖ noise
14 datafusion:vortex-file-compressed -19.0% -0.2% -18.9% +47.8% ➖ noise
14 duckdb:vortex-compact -7.7% -0.2% -7.5% +47.8% ➖ noise
14 duckdb:vortex-file-compressed -1.5% -0.2% -1.3% +47.8% ➖ noise
15 datafusion:vortex-compact -4.4% -1.5% -3.0% +47.8% ➖ noise
15 datafusion:vortex-file-compressed -12.7% -1.5% -11.4% +47.8% ➖ noise
15 duckdb:vortex-compact -0.6% -1.5% +0.9% +47.8% ➖ noise
15 duckdb:vortex-file-compressed +14.7% -1.5% +16.4% +47.8% ➖ noise
16 datafusion:vortex-compact +22.1% +14.1% +7.0% +47.8% ➖ noise
16 datafusion:vortex-file-compressed +8.0% +14.1% -5.4% +47.8% ➖ noise
16 duckdb:vortex-compact -7.8% +14.1% -19.2% +47.8% ➖ noise
16 duckdb:vortex-file-compressed -8.2% +14.1% -19.5% +47.8% ➖ noise
17 datafusion:vortex-compact +17.5% -8.8% +28.9% +47.8% ➖ noise
17 datafusion:vortex-file-compressed -9.6% -8.8% -0.9% +47.8% ➖ noise
17 duckdb:vortex-compact +3.1% -8.8% +13.1% +47.8% ➖ noise
17 duckdb:vortex-file-compressed +4.2% -8.8% +14.3% +47.8% ➖ noise
18 datafusion:vortex-compact +1.5% +11.4% -8.9% +47.8% ➖ noise
18 datafusion:vortex-file-compressed -6.3% +11.4% -15.9% +47.8% ➖ noise
18 duckdb:vortex-compact +4.6% +11.4% -6.1% +47.8% ➖ noise
18 duckdb:vortex-file-compressed -8.1% +11.4% -17.5% +47.8% ➖ noise
19 datafusion:vortex-compact -11.0% +9.8% -18.9% +47.8% ➖ noise
19 datafusion:vortex-file-compressed -33.4% +9.8% -39.3% +47.8% ✅ faster
19 duckdb:vortex-compact +6.0% +9.8% -3.4% +47.8% ➖ noise
19 duckdb:vortex-file-compressed -3.4% +9.8% -12.0% +47.8% ➖ noise
20 datafusion:vortex-compact -21.2% +1.5% -22.3% +47.8% ➖ noise
20 datafusion:vortex-file-compressed -38.5% +1.5% -39.4% +47.8% ✅ faster
20 duckdb:vortex-compact -8.0% +1.5% -9.3% +47.8% ➖ noise
20 duckdb:vortex-file-compressed -11.8% +1.5% -13.1% +47.8% ➖ noise
21 datafusion:vortex-compact -7.2% -9.8% +2.9% +47.8% ➖ noise
21 datafusion:vortex-file-compressed -20.6% -9.8% -12.0% +47.8% ➖ noise
21 duckdb:vortex-compact +9.5% -9.8% +21.4% +47.8% ➖ noise
21 duckdb:vortex-file-compressed +3.5% -9.8% +14.8% +47.8% ➖ noise
22 datafusion:vortex-compact -17.3% -40.9% +39.9% +47.8% ➖ noise
22 datafusion:vortex-file-compressed -19.5% -40.9% +36.2% +47.8% ➖ noise
22 duckdb:vortex-compact +7.1% -40.9% +81.2% +47.8% 🚨 regression
22 duckdb:vortex-file-compressed -16.4% -40.9% +41.4% +47.8% ➖ noise

@connortsui20
Copy link
Copy Markdown
Contributor Author

so compress time definitely improved, but there are regressions in file size. I think I know why (chooses FSST instead of Dict), and I can fix that

@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant