Skip to content

Add spans in compressor for perfetto#7607

Merged
connortsui20 merged 1 commit intodevelopfrom
ct/compressor-perfetto
Apr 23, 2026
Merged

Add spans in compressor for perfetto#7607
connortsui20 merged 1 commit intodevelopfrom
ct/compressor-perfetto

Conversation

@connortsui20
Copy link
Copy Markdown
Contributor

@connortsui20 connortsui20 commented Apr 23, 2026

Summary

Tracking issue: #7216

Adds some more interesting spans to the compressor. This lets us use perfetto to visualize where time is being spent more easily. Also removes some noisy logs that don't tell us that much.

Also removes some tests that are probably useless.

Screenshot 2026-04-23 at 9 44 52 AM

Definitely gives us some interesting insights on things!

Testing

N/A

@connortsui20 connortsui20 added the changelog/feature A new feature label Apr 23, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 23, 2026

Merging this PR will not alter performance

✅ 1163 untouched benchmarks


Comparing ct/compressor-perfetto (d4c70e0) with develop (75808d5)

Open in CodSpeed

Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20 connortsui20 force-pushed the ct/compressor-perfetto branch from 38a5f1b to d4c70e0 Compare April 23, 2026 14:07
@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
@connortsui20 connortsui20 requested a review from robert3005 April 23, 2026 14:18
@connortsui20 connortsui20 marked this pull request as ready for review April 23, 2026 14:18
@connortsui20 connortsui20 enabled auto-merge (squash) April 23, 2026 14:18
@connortsui20 connortsui20 requested a review from a10y April 23, 2026 14:19
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done d4c70e0 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.007x ➖


datafusion / vortex-file-compressed (1.007x ➖, 0↑ 1↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 122486472 122103514 1.00
polarsignals_q01/datafusion:vortex-file-compressed 261431527 278979373 0.94
polarsignals_q02/datafusion:vortex-file-compressed 23207154 23558355 0.99
polarsignals_q03/datafusion:vortex-file-compressed 264555078 269544474 0.98
polarsignals_q04/datafusion:vortex-file-compressed 12469545 12079999 1.03
polarsignals_q05/datafusion:vortex-file-compressed 🚨 16680818 15088817 1.11
polarsignals_q06/datafusion:vortex-file-compressed 19073863 18474774 1.03
polarsignals_q07/datafusion:vortex-file-compressed 13854372 13714064 1.01
polarsignals_q08/datafusion:vortex-file-compressed 359744563 360728786 1.00
polarsignals_q09/datafusion:vortex-file-compressed 11288147 11355646 0.99

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.3%
Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.031x ➖
Shifts: Parquet (control) +3.1% · Median polish +1.0%


datafusion / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5281501 5627352 0.94
fineweb_q01/datafusion:vortex-file-compressed 21405156 20534835 1.04
fineweb_q02/datafusion:vortex-file-compressed 22928853 22624421 1.01
fineweb_q03/datafusion:vortex-file-compressed 84969648 82796689 1.03
fineweb_q04/datafusion:vortex-file-compressed 237336494 226616655 1.05
fineweb_q05/datafusion:vortex-file-compressed 218942987 217767223 1.01
fineweb_q06/datafusion:vortex-file-compressed 57180518 52997431 1.08
fineweb_q07/datafusion:vortex-file-compressed 64079178 60805771 1.05
fineweb_q08/datafusion:vortex-file-compressed 22159152 22864452 0.97
datafusion / vortex-compact (1.017x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 6187634 5864846 1.06
fineweb_q01/datafusion:vortex-compact 126932974 125850988 1.01
fineweb_q02/datafusion:vortex-compact 127707905 128180846 1.00
fineweb_q03/datafusion:vortex-compact 1046337218 1023132763 1.02
fineweb_q04/datafusion:vortex-compact 1116453505 1091902848 1.02
fineweb_q05/datafusion:vortex-compact 947216113 948770999 1.00
fineweb_q06/datafusion:vortex-compact 520228011 523715047 0.99
fineweb_q07/datafusion:vortex-compact 538676997 535208580 1.01
fineweb_q08/datafusion:vortex-compact 20094937 19095928 1.05
datafusion / parquet (1.017x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6773106 6345323 1.07
fineweb_q01/datafusion:parquet 284879603 285033581 1.00
fineweb_q02/datafusion:parquet 288558402 284550553 1.01
fineweb_q03/datafusion:parquet 293386014 285099532 1.03
fineweb_q04/datafusion:parquet 304339699 291662420 1.04
fineweb_q05/datafusion:parquet 297538151 292584431 1.02
fineweb_q06/datafusion:parquet 282590469 293988149 0.96
fineweb_q07/datafusion:parquet 283594666 278525135 1.02
fineweb_q08/datafusion:parquet 278907544 277469171 1.01
duckdb / vortex-file-compressed (1.017x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3283862 3143013 1.04
fineweb_q01/duckdb:vortex-file-compressed 23244925 22716049 1.02
fineweb_q02/duckdb:vortex-file-compressed 24460580 23268280 1.05
fineweb_q03/duckdb:vortex-file-compressed 156950711 159335603 0.99
fineweb_q04/duckdb:vortex-file-compressed 215207522 218270023 0.99
fineweb_q05/duckdb:vortex-file-compressed 213525410 215978891 0.99
fineweb_q06/duckdb:vortex-file-compressed 52463580 51808502 1.01
fineweb_q07/duckdb:vortex-file-compressed 54694978 54612814 1.00
fineweb_q08/duckdb:vortex-file-compressed 23287826 21942937 1.06
duckdb / vortex-compact (0.975x ➖, 1↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4010706 4192265 0.96
fineweb_q01/duckdb:vortex-compact 🚀 91561835 106830656 0.86
fineweb_q02/duckdb:vortex-compact 110087615 110266189 1.00
fineweb_q03/duckdb:vortex-compact 853706431 857116535 1.00
fineweb_q04/duckdb:vortex-compact 912878601 894538446 1.02
fineweb_q05/duckdb:vortex-compact 817502633 802205153 1.02
fineweb_q06/duckdb:vortex-compact 467158126 461448366 1.01
fineweb_q07/duckdb:vortex-compact 476725227 473562301 1.01
fineweb_q08/duckdb:vortex-compact 19912220 21624210 0.92
duckdb / parquet (1.045x ➖, 0↑ 2↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 30618512 25744632 1.19
fineweb_q01/duckdb:parquet 84917300 85246446 1.00
fineweb_q02/duckdb:parquet 85818956 83977252 1.02
fineweb_q03/duckdb:parquet 311927867 306996310 1.02
fineweb_q04/duckdb:parquet 442285521 437404249 1.01
fineweb_q05/duckdb:parquet 411365575 409205322 1.01
fineweb_q06/duckdb:parquet 198313183 197864535 1.00
fineweb_q07/duckdb:parquet 209059311 207871905 1.01
fineweb_q08/duckdb:parquet 🚨 33490973 28479514 1.18
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +5.5% +12.7% -6.4% +47.6% ➖ noise
0 datafusion:vortex-file-compressed -6.1% +12.7% -16.7% +50.3% ➖ noise
0 duckdb:vortex-compact -4.3% +12.7% -15.1% +97.5% ➖ noise
0 duckdb:vortex-file-compressed +4.5% +12.7% -7.3% +85.7% ➖ noise
1 datafusion:vortex-compact +0.9% -0.2% +1.1% +12.0% ➖ noise
1 datafusion:vortex-file-compressed +4.2% -0.2% +4.5% +28.1% ➖ noise
1 duckdb:vortex-compact -14.3% -0.2% -14.1% +15.8% ✅ faster
1 duckdb:vortex-file-compressed +2.3% -0.2% +2.6% +63.4% ➖ noise
2 datafusion:vortex-compact -0.4% +1.8% -2.1% +12.8% ➖ noise
2 datafusion:vortex-file-compressed +1.3% +1.8% -0.4% +13.2% ➖ noise
2 duckdb:vortex-compact -0.2% +1.8% -1.9% +11.9% ➖ noise
2 duckdb:vortex-file-compressed +5.1% +1.8% +3.3% +12.2% ➖ noise
3 datafusion:vortex-compact +2.3% +2.3% +0.0% +11.9% ➖ noise
3 datafusion:vortex-file-compressed +2.6% +2.3% +0.4% +29.1% ➖ noise
3 duckdb:vortex-compact -0.4% +2.3% -2.6% +11.9% ➖ noise
3 duckdb:vortex-file-compressed -1.5% +2.3% -3.7% +34.0% ➖ noise
4 datafusion:vortex-compact +2.2% +2.7% -0.5% +11.9% ➖ noise
4 datafusion:vortex-file-compressed +4.7% +2.7% +2.0% +11.9% ➖ noise
4 duckdb:vortex-compact +2.1% +2.7% -0.7% +11.9% ➖ noise
4 duckdb:vortex-file-compressed -1.4% +2.7% -4.0% +11.9% ➖ noise
5 datafusion:vortex-compact -0.2% +1.1% -1.3% +11.9% ➖ noise
5 datafusion:vortex-file-compressed +0.5% +1.1% -0.6% +11.9% ➖ noise
5 duckdb:vortex-compact +1.9% +1.1% +0.8% +11.9% ➖ noise
5 duckdb:vortex-file-compressed -1.1% +1.1% -2.2% +11.9% ➖ noise
6 datafusion:vortex-compact -0.7% -1.8% +1.2% +11.9% ➖ noise
6 datafusion:vortex-file-compressed +7.9% -1.8% +9.9% +11.9% ➖ noise
6 duckdb:vortex-compact +1.2% -1.8% +3.1% +11.9% ➖ noise
6 duckdb:vortex-file-compressed +1.3% -1.8% +3.2% +11.9% ➖ noise
7 datafusion:vortex-compact +0.6% +1.2% -0.5% +11.9% ➖ noise
7 datafusion:vortex-file-compressed +5.4% +1.2% +4.1% +16.5% ➖ noise
7 duckdb:vortex-compact +0.7% +1.2% -0.5% +11.9% ➖ noise
7 duckdb:vortex-file-compressed +0.2% +1.2% -1.0% +11.9% ➖ noise
8 datafusion:vortex-compact +5.2% +8.7% -3.2% +41.6% ➖ noise
8 datafusion:vortex-file-compressed -3.1% +8.7% -10.9% +11.9% ✅ faster
8 duckdb:vortex-compact -7.9% +8.7% -15.3% +23.2% ➖ noise
8 duckdb:vortex-file-compressed +6.1% +8.7% -2.4% +13.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 0.995x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.0%


datafusion / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50434214 49856103 1.01
tpch_q02/datafusion:vortex-file-compressed 27856100 28054914 0.99
tpch_q03/datafusion:vortex-file-compressed 28913944 29262331 0.99
tpch_q04/datafusion:vortex-file-compressed 21576186 21281925 1.01
tpch_q05/datafusion:vortex-file-compressed 49171737 49980936 0.98
tpch_q06/datafusion:vortex-file-compressed 13484212 13467929 1.00
tpch_q07/datafusion:vortex-file-compressed 60745417 61025427 1.00
tpch_q08/datafusion:vortex-file-compressed 40575030 41127918 0.99
tpch_q09/datafusion:vortex-file-compressed 54885633 54291050 1.01
tpch_q10/datafusion:vortex-file-compressed 43237540 44792508 0.97
tpch_q11/datafusion:vortex-file-compressed 16406366 16155708 1.02
tpch_q12/datafusion:vortex-file-compressed 26500665 26387249 1.00
tpch_q13/datafusion:vortex-file-compressed 25088266 24953274 1.01
tpch_q14/datafusion:vortex-file-compressed 17261361 17698576 0.98
tpch_q15/datafusion:vortex-file-compressed 27995832 27616932 1.01
tpch_q16/datafusion:vortex-file-compressed 21030341 20796628 1.01
tpch_q17/datafusion:vortex-file-compressed 72231527 68935095 1.05
tpch_q18/datafusion:vortex-file-compressed 82827823 79654320 1.04
tpch_q19/datafusion:vortex-file-compressed 24978507 26229195 0.95
tpch_q20/datafusion:vortex-file-compressed 31184983 30070239 1.04
tpch_q21/datafusion:vortex-file-compressed 75674149 77247294 0.98
tpch_q22/datafusion:vortex-file-compressed 14415614 14666371 0.98
datafusion / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58564412 59444301 0.99
tpch_q02/datafusion:vortex-compact 31773028 31557979 1.01
tpch_q03/datafusion:vortex-compact 30257459 29833081 1.01
tpch_q04/datafusion:vortex-compact 23866424 24733253 0.96
tpch_q05/datafusion:vortex-compact 53291431 53131678 1.00
tpch_q06/datafusion:vortex-compact 15275840 14856702 1.03
tpch_q07/datafusion:vortex-compact 65449860 66327401 0.99
tpch_q08/datafusion:vortex-compact 46359026 45885766 1.01
tpch_q09/datafusion:vortex-compact 60319005 59163367 1.02
tpch_q10/datafusion:vortex-compact 49720895 50531933 0.98
tpch_q11/datafusion:vortex-compact 16828895 17301881 0.97
tpch_q12/datafusion:vortex-compact 33726980 33480323 1.01
tpch_q13/datafusion:vortex-compact 31323223 32183740 0.97
tpch_q14/datafusion:vortex-compact 20323723 20290262 1.00
tpch_q15/datafusion:vortex-compact 33753455 33082819 1.02
tpch_q16/datafusion:vortex-compact 25409499 24795527 1.02
tpch_q17/datafusion:vortex-compact 74640569 70289718 1.06
tpch_q18/datafusion:vortex-compact 83972563 84352628 1.00
tpch_q19/datafusion:vortex-compact 32245920 33375582 0.97
tpch_q20/datafusion:vortex-compact 35526180 34776006 1.02
tpch_q21/datafusion:vortex-compact 82179377 84248008 0.98
tpch_q22/datafusion:vortex-compact 15249089 15722457 0.97
datafusion / parquet (1.016x ➖, 1↑ 1↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 136842860 105211521 1.30
tpch_q02/datafusion:parquet 63608064 63035024 1.01
tpch_q03/datafusion:parquet 70501009 68045332 1.04
tpch_q04/datafusion:parquet 44754805 45211816 0.99
tpch_q05/datafusion:parquet 93751725 95291503 0.98
tpch_q06/datafusion:parquet 42047984 38608327 1.09
tpch_q07/datafusion:parquet 105010594 105695525 0.99
tpch_q08/datafusion:parquet 96946625 99751969 0.97
tpch_q09/datafusion:parquet 127210493 125659417 1.01
tpch_q10/datafusion:parquet 113260039 112621818 1.01
tpch_q11/datafusion:parquet 42110959 41788694 1.01
tpch_q12/datafusion:parquet 90730703 88302173 1.03
tpch_q13/datafusion:parquet 192792459 191323664 1.01
tpch_q14/datafusion:parquet 🚀 40995950 47472581 0.86
tpch_q15/datafusion:parquet 61290406 60346094 1.02
tpch_q16/datafusion:parquet 43896438 44815956 0.98
tpch_q17/datafusion:parquet 144220539 137561312 1.05
tpch_q18/datafusion:parquet 163407464 159959436 1.02
tpch_q19/datafusion:parquet 91571652 84789637 1.08
tpch_q20/datafusion:parquet 67949059 70149943 0.97
tpch_q21/datafusion:parquet 139793316 136061276 1.03
tpch_q22/datafusion:parquet 30432190 31257026 0.97
datafusion / arrow (1.003x ➖, 0↑ 2↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 53321522 55665338 0.96
tpch_q02/datafusion:arrow 18544006 18971630 0.98
tpch_q03/datafusion:arrow 28642580 29803352 0.96
tpch_q04/datafusion:arrow 24524710 24622282 1.00
tpch_q05/datafusion:arrow 73803521 72228789 1.02
tpch_q06/datafusion:arrow 🚨 22066806 19922816 1.11
tpch_q07/datafusion:arrow 100785834 99768134 1.01
tpch_q08/datafusion:arrow 43162018 42967401 1.00
tpch_q09/datafusion:arrow 60758594 63508418 0.96
tpch_q10/datafusion:arrow 45538935 48525641 0.94
tpch_q11/datafusion:arrow 8887369 9024786 0.98
tpch_q12/datafusion:arrow 51393182 52522945 0.98
tpch_q13/datafusion:arrow 48481368 47119273 1.03
tpch_q14/datafusion:arrow 21450458 21421910 1.00
tpch_q15/datafusion:arrow 42933192 42647006 1.01
tpch_q16/datafusion:arrow 18908661 18633088 1.01
tpch_q17/datafusion:arrow 🚨 75171288 66854230 1.12
tpch_q18/datafusion:arrow 134880648 132784589 1.02
tpch_q19/datafusion:arrow 35573454 34851756 1.02
tpch_q20/datafusion:arrow 33734901 33938214 0.99
tpch_q21/datafusion:arrow 145825973 148111907 0.98
tpch_q22/datafusion:arrow 17624509 17516366 1.01
duckdb / vortex-file-compressed (0.979x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31371392 31700833 0.99
tpch_q02/duckdb:vortex-file-compressed 25158257 25049608 1.00
tpch_q03/duckdb:vortex-file-compressed 28946732 29891320 0.97
tpch_q04/duckdb:vortex-file-compressed 28865514 29588039 0.98
tpch_q05/duckdb:vortex-file-compressed 33495862 33660288 1.00
tpch_q06/duckdb:vortex-file-compressed 10338570 10360481 1.00
tpch_q07/duckdb:vortex-file-compressed 36539642 36694881 1.00
tpch_q08/duckdb:vortex-file-compressed 38739734 39667392 0.98
tpch_q09/duckdb:vortex-file-compressed 71194277 74199779 0.96
tpch_q10/duckdb:vortex-file-compressed 34555367 35686346 0.97
tpch_q11/duckdb:vortex-file-compressed 14745879 14966233 0.99
tpch_q12/duckdb:vortex-file-compressed 21463036 22837264 0.94
tpch_q13/duckdb:vortex-file-compressed 34749573 34962680 0.99
tpch_q14/duckdb:vortex-file-compressed 21732907 21529491 1.01
tpch_q15/duckdb:vortex-file-compressed 16444327 16289366 1.01
tpch_q16/duckdb:vortex-file-compressed 27724192 28634849 0.97
tpch_q17/duckdb:vortex-file-compressed 25573017 25443054 1.01
tpch_q18/duckdb:vortex-file-compressed 49833349 50546113 0.99
tpch_q19/duckdb:vortex-file-compressed 27935224 29560297 0.95
tpch_q20/duckdb:vortex-file-compressed 33664105 35774658 0.94
tpch_q21/duckdb:vortex-file-compressed 105242655 108154058 0.97
tpch_q22/duckdb:vortex-file-compressed 16833391 17461188 0.96
duckdb / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 37941080 39118688 0.97
tpch_q02/duckdb:vortex-compact 36739896 35545132 1.03
tpch_q03/duckdb:vortex-compact 32071643 31898114 1.01
tpch_q04/duckdb:vortex-compact 34744210 32709653 1.06
tpch_q05/duckdb:vortex-compact 37575915 38999025 0.96
tpch_q06/duckdb:vortex-compact 15003144 14233870 1.05
tpch_q07/duckdb:vortex-compact 42561046 42334722 1.01
tpch_q08/duckdb:vortex-compact 45076988 44845028 1.01
tpch_q09/duckdb:vortex-compact 83422969 83108428 1.00
tpch_q10/duckdb:vortex-compact 39407050 39662176 0.99
tpch_q11/duckdb:vortex-compact 18409296 19032660 0.97
tpch_q12/duckdb:vortex-compact 35403347 34902125 1.01
tpch_q13/duckdb:vortex-compact 44405151 44194331 1.00
tpch_q14/duckdb:vortex-compact 29419079 29231420 1.01
tpch_q15/duckdb:vortex-compact 19636846 19412879 1.01
tpch_q16/duckdb:vortex-compact 35276599 35109171 1.00
tpch_q17/duckdb:vortex-compact 31174463 30943501 1.01
tpch_q18/duckdb:vortex-compact 49637344 50524825 0.98
tpch_q19/duckdb:vortex-compact 34320658 34253887 1.00
tpch_q20/duckdb:vortex-compact 42062315 43165789 0.97
tpch_q21/duckdb:vortex-compact 110191632 111399219 0.99
tpch_q22/duckdb:vortex-compact 19705267 19648906 1.00
duckdb / parquet (0.989x ➖, 2↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 76772115 75706177 1.01
tpch_q02/duckdb:parquet 38758671 38380713 1.01
tpch_q03/duckdb:parquet 70475933 69208245 1.02
tpch_q04/duckdb:parquet 46448927 46765714 0.99
tpch_q05/duckdb:parquet 66016610 70212462 0.94
tpch_q06/duckdb:parquet 20201148 20638533 0.98
tpch_q07/duckdb:parquet 66838731 66964606 1.00
tpch_q08/duckdb:parquet 84611795 79766085 1.06
tpch_q09/duckdb:parquet 137412877 131333856 1.05
tpch_q10/duckdb:parquet 122425049 118608119 1.03
tpch_q11/duckdb:parquet 22706320 22205150 1.02
tpch_q12/duckdb:parquet 🚀 44889451 52515011 0.85
tpch_q13/duckdb:parquet 249126866 247809897 1.01
tpch_q14/duckdb:parquet 48919419 49105230 1.00
tpch_q15/duckdb:parquet 🚀 24003538 27249187 0.88
tpch_q16/duckdb:parquet 55488924 54554479 1.02
tpch_q17/duckdb:parquet 53535623 54051636 0.99
tpch_q18/duckdb:parquet 112037490 113826078 0.98
tpch_q19/duckdb:parquet 64000837 65237549 0.98
tpch_q20/duckdb:parquet 63064108 63185871 1.00
tpch_q21/duckdb:parquet 158911476 168223112 0.94
tpch_q22/duckdb:parquet 51307079 50969053 1.01
duckdb / duckdb (0.989x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15825967 15908148 0.99
tpch_q02/duckdb:duckdb 11913918 12558824 0.95
tpch_q03/duckdb:duckdb 17814287 18623216 0.96
tpch_q04/duckdb:duckdb 19035422 18599696 1.02
tpch_q05/duckdb:duckdb 19599486 19761083 0.99
tpch_q06/duckdb:duckdb 5393359 5295421 1.02
tpch_q07/duckdb:duckdb 21954702 22185089 0.99
tpch_q08/duckdb:duckdb 20716486 21090537 0.98
tpch_q09/duckdb:duckdb 54506111 54714046 1.00
tpch_q10/duckdb:duckdb 45215134 45262289 1.00
tpch_q11/duckdb:duckdb 5967450 5859768 1.02
tpch_q12/duckdb:duckdb 13721036 14120601 0.97
tpch_q13/duckdb:duckdb 37266695 39522268 0.94
tpch_q14/duckdb:duckdb 17035310 16752733 1.02
tpch_q15/duckdb:duckdb 11714932 12313476 0.95
tpch_q16/duckdb:duckdb 23786367 23035201 1.03
tpch_q17/duckdb:duckdb 13676299 13826940 0.99
tpch_q18/duckdb:duckdb 37646570 38510100 0.98
tpch_q19/duckdb:duckdb 27152948 28079618 0.97
tpch_q20/duckdb:duckdb 22412044 22457219 1.00
tpch_q21/duckdb:duckdb 55618966 56024761 0.99
tpch_q22/duckdb:duckdb 24698081 24422817 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -4.2% +14.8% -16.6% +20.7% ➖ noise
1 datafusion:vortex-compact -1.5% +14.8% -14.2% +19.3% ➖ noise
1 datafusion:vortex-file-compressed +1.2% +14.8% -11.9% +19.8% ➖ noise
1 duckdb:duckdb -0.5% +14.8% -13.4% +19.6% ➖ noise
1 duckdb:vortex-compact -3.0% +14.8% -15.5% +19.1% ➖ noise
1 duckdb:vortex-file-compressed -1.0% +14.8% -13.8% +21.8% ➖ noise
2 datafusion:arrow -2.3% +0.9% -3.2% +11.7% ➖ noise
2 datafusion:vortex-compact +0.7% +0.9% -0.3% +11.7% ➖ noise
2 datafusion:vortex-file-compressed -0.7% +0.9% -1.6% +11.7% ➖ noise
2 duckdb:duckdb -5.1% +0.9% -6.0% +11.7% ➖ noise
2 duckdb:vortex-compact +3.4% +0.9% +2.4% +11.7% ➖ noise
2 duckdb:vortex-file-compressed +0.4% +0.9% -0.5% +11.7% ➖ noise
3 datafusion:arrow -3.9% +2.7% -6.4% +11.7% ➖ noise
3 datafusion:vortex-compact +1.4% +2.7% -1.3% +11.7% ➖ noise
3 datafusion:vortex-file-compressed -1.2% +2.7% -3.8% +11.7% ➖ noise
3 duckdb:duckdb -4.3% +2.7% -6.9% +12.0% ➖ noise
3 duckdb:vortex-compact +0.5% +2.7% -2.1% +12.9% ➖ noise
3 duckdb:vortex-file-compressed -3.2% +2.7% -5.7% +12.4% ➖ noise
4 datafusion:arrow -0.4% -0.8% +0.5% +11.7% ➖ noise
4 datafusion:vortex-compact -3.5% -0.8% -2.7% +11.7% ➖ noise
4 datafusion:vortex-file-compressed +1.4% -0.8% +2.2% +11.7% ➖ noise
4 duckdb:duckdb +2.3% -0.8% +3.2% +12.0% ➖ noise
4 duckdb:vortex-compact +6.2% -0.8% +7.1% +11.7% ➖ noise
4 duckdb:vortex-file-compressed -2.4% -0.8% -1.6% +11.7% ➖ noise
5 datafusion:arrow +2.2% -3.8% +6.2% +11.7% ➖ noise
5 datafusion:vortex-compact +0.3% -3.8% +4.3% +11.7% ➖ noise
5 datafusion:vortex-file-compressed -1.6% -3.8% +2.3% +11.7% ➖ noise
5 duckdb:duckdb -0.8% -3.8% +3.1% +11.7% ➖ noise
5 duckdb:vortex-compact -3.6% -3.8% +0.2% +11.7% ➖ noise
5 duckdb:vortex-file-compressed -0.5% -3.8% +3.5% +13.6% ➖ noise
6 datafusion:arrow +10.8% +3.2% +7.3% +13.6% ➖ noise
6 datafusion:vortex-compact +2.8% +3.2% -0.4% +14.7% ➖ noise
6 datafusion:vortex-file-compressed +0.1% +3.2% -3.0% +16.1% ➖ noise
6 duckdb:duckdb +1.8% +3.2% -1.4% +16.3% ➖ noise
6 duckdb:vortex-compact +5.4% +3.2% +2.1% +18.3% ➖ noise
6 duckdb:vortex-file-compressed -0.2% +3.2% -3.4% +16.1% ➖ noise
7 datafusion:arrow +1.0% -0.4% +1.4% +11.7% ➖ noise
7 datafusion:vortex-compact -1.3% -0.4% -0.9% +11.7% ➖ noise
7 datafusion:vortex-file-compressed -0.5% -0.4% -0.0% +11.7% ➖ noise
7 duckdb:duckdb -1.0% -0.4% -0.6% +11.7% ➖ noise
7 duckdb:vortex-compact +0.5% -0.4% +1.0% +11.7% ➖ noise
7 duckdb:vortex-file-compressed -0.4% -0.4% -0.0% +11.7% ➖ noise
8 datafusion:arrow +0.5% +1.5% -1.1% +11.7% ➖ noise
8 datafusion:vortex-compact +1.0% +1.5% -0.5% +11.7% ➖ noise
8 datafusion:vortex-file-compressed -1.3% +1.5% -2.8% +11.7% ➖ noise
8 duckdb:duckdb -1.8% +1.5% -3.3% +11.7% ➖ noise
8 duckdb:vortex-compact +0.5% +1.5% -1.0% +11.7% ➖ noise
8 duckdb:vortex-file-compressed -2.3% +1.5% -3.8% +11.7% ➖ noise
9 datafusion:arrow -4.3% +2.9% -7.0% +11.7% ➖ noise
9 datafusion:vortex-compact +2.0% +2.9% -0.9% +11.7% ➖ noise
9 datafusion:vortex-file-compressed +1.1% +2.9% -1.8% +11.7% ➖ noise
9 duckdb:duckdb -0.4% +2.9% -3.2% +11.7% ➖ noise
9 duckdb:vortex-compact +0.4% +2.9% -2.5% +11.7% ➖ noise
9 duckdb:vortex-file-compressed -4.1% +2.9% -6.8% +11.7% ➖ noise
10 datafusion:arrow -6.2% +1.9% -7.9% +11.7% ➖ noise
10 datafusion:vortex-compact -1.6% +1.9% -3.4% +11.7% ➖ noise
10 datafusion:vortex-file-compressed -3.5% +1.9% -5.3% +11.7% ➖ noise
10 duckdb:duckdb -0.1% +1.9% -2.0% +11.7% ➖ noise
10 duckdb:vortex-compact -0.6% +1.9% -2.5% +11.7% ➖ noise
10 duckdb:vortex-file-compressed -3.2% +1.9% -5.0% +11.7% ➖ noise
11 datafusion:arrow -1.5% +1.5% -3.0% +12.4% ➖ noise
11 datafusion:vortex-compact -2.7% +1.5% -4.2% +11.7% ➖ noise
11 datafusion:vortex-file-compressed +1.6% +1.5% +0.0% +11.7% ➖ noise
11 duckdb:duckdb +1.8% +1.5% +0.3% +11.7% ➖ noise
11 duckdb:vortex-compact -3.3% +1.5% -4.7% +11.7% ➖ noise
11 duckdb:vortex-file-compressed -1.5% +1.5% -2.9% +11.7% ➖ noise
12 datafusion:arrow -2.2% -6.3% +4.4% +18.5% ➖ noise
12 datafusion:vortex-compact +0.7% -6.3% +7.5% +11.7% ➖ noise
12 datafusion:vortex-file-compressed +0.4% -6.3% +7.2% +11.7% ➖ noise
12 duckdb:duckdb -2.8% -6.3% +3.7% +11.7% ➖ noise
12 duckdb:vortex-compact +1.4% -6.3% +8.2% +11.7% ➖ noise
12 duckdb:vortex-file-compressed -6.0% -6.3% +0.3% +11.7% ➖ noise
13 datafusion:arrow +2.9% +0.6% +2.2% +11.7% ➖ noise
13 datafusion:vortex-compact -2.7% +0.6% -3.3% +11.7% ➖ noise
13 datafusion:vortex-file-compressed +0.5% +0.6% -0.1% +11.7% ➖ noise
13 duckdb:duckdb -5.7% +0.6% -6.3% +11.7% ➖ noise
13 duckdb:vortex-compact +0.5% +0.6% -0.2% +11.7% ➖ noise
13 duckdb:vortex-file-compressed -0.6% +0.6% -1.3% +11.7% ➖ noise
14 datafusion:arrow +0.1% -7.2% +8.0% +11.7% ➖ noise
14 datafusion:vortex-compact +0.2% -7.2% +8.0% +12.5% ➖ noise
14 datafusion:vortex-file-compressed -2.5% -7.2% +5.2% +11.7% ➖ noise
14 duckdb:duckdb +1.7% -7.2% +9.6% +15.5% ➖ noise
14 duckdb:vortex-compact +0.6% -7.2% +8.5% +11.7% ➖ noise
14 duckdb:vortex-file-compressed +0.9% -7.2% +8.8% +13.5% ➖ noise
15 datafusion:arrow +0.7% -5.4% +6.4% +11.7% ➖ noise
15 datafusion:vortex-compact +2.0% -5.4% +7.9% +11.9% ➖ noise
15 datafusion:vortex-file-compressed +1.4% -5.4% +7.2% +13.1% ➖ noise
15 duckdb:duckdb -4.9% -5.4% +0.6% +14.8% ➖ noise
15 duckdb:vortex-compact +1.2% -5.4% +6.9% +13.1% ➖ noise
15 duckdb:vortex-file-compressed +1.0% -5.4% +6.7% +11.8% ➖ noise
16 datafusion:arrow +1.5% -0.2% +1.7% +11.7% ➖ noise
16 datafusion:vortex-compact +2.5% -0.2% +2.7% +11.7% ➖ noise
16 datafusion:vortex-file-compressed +1.1% -0.2% +1.3% +11.7% ➖ noise
16 duckdb:duckdb +3.3% -0.2% +3.5% +11.7% ➖ noise
16 duckdb:vortex-compact +0.5% -0.2% +0.7% +11.7% ➖ noise
16 duckdb:vortex-file-compressed -3.2% -0.2% -3.0% +11.7% ➖ noise
17 datafusion:arrow +12.4% +1.9% +10.3% +13.7% ➖ noise
17 datafusion:vortex-compact +6.2% +1.9% +4.2% +13.3% ➖ noise
17 datafusion:vortex-file-compressed +4.8% +1.9% +2.8% +14.2% ➖ noise
17 duckdb:duckdb -1.1% +1.9% -2.9% +13.7% ➖ noise
17 duckdb:vortex-compact +0.7% +1.9% -1.1% +14.5% ➖ noise
17 duckdb:vortex-file-compressed +0.5% +1.9% -1.4% +14.7% ➖ noise
18 datafusion:arrow +1.6% +0.3% +1.3% +11.7% ➖ noise
18 datafusion:vortex-compact -0.5% +0.3% -0.7% +11.7% ➖ noise
18 datafusion:vortex-file-compressed +4.0% +0.3% +3.7% +11.7% ➖ noise
18 duckdb:duckdb -2.2% +0.3% -2.5% +11.7% ➖ noise
18 duckdb:vortex-compact -1.8% +0.3% -2.0% +11.7% ➖ noise
18 duckdb:vortex-file-compressed -1.4% +0.3% -1.7% +11.7% ➖ noise
19 datafusion:arrow +2.1% +2.9% -0.8% +13.6% ➖ noise
19 datafusion:vortex-compact -3.4% +2.9% -6.1% +11.7% ➖ noise
19 datafusion:vortex-file-compressed -4.8% +2.9% -7.5% +12.4% ➖ noise
19 duckdb:duckdb -3.3% +2.9% -6.1% +14.7% ➖ noise
19 duckdb:vortex-compact +0.2% +2.9% -2.7% +12.1% ➖ noise
19 duckdb:vortex-file-compressed -5.5% +2.9% -8.2% +12.7% ➖ noise
20 datafusion:arrow -0.6% -1.7% +1.1% +11.7% ➖ noise
20 datafusion:vortex-compact +2.2% -1.7% +3.9% +11.7% ➖ noise
20 datafusion:vortex-file-compressed +3.7% -1.7% +5.5% +11.7% ➖ noise
20 duckdb:duckdb -0.2% -1.7% +1.5% +11.7% ➖ noise
20 duckdb:vortex-compact -2.6% -1.7% -0.9% +12.5% ➖ noise
20 duckdb:vortex-file-compressed -5.9% -1.7% -4.3% +11.7% ➖ noise
21 datafusion:arrow -1.5% -1.5% -0.1% +11.7% ➖ noise
21 datafusion:vortex-compact -2.5% -1.5% -1.0% +11.7% ➖ noise
21 datafusion:vortex-file-compressed -2.0% -1.5% -0.6% +11.7% ➖ noise
21 duckdb:duckdb -0.7% -1.5% +0.8% +11.7% ➖ noise
21 duckdb:vortex-compact -1.1% -1.5% +0.4% +11.7% ➖ noise
21 duckdb:vortex-file-compressed -2.7% -1.5% -1.2% +11.7% ➖ noise
22 datafusion:arrow +0.6% -1.0% +1.6% +11.7% ➖ noise
22 datafusion:vortex-compact -3.0% -1.0% -2.0% +11.7% ➖ noise
22 datafusion:vortex-file-compressed -1.7% -1.0% -0.7% +11.7% ➖ noise
22 duckdb:duckdb +1.1% -1.0% +2.2% +11.7% ➖ noise
22 duckdb:vortex-compact +0.3% -1.0% +1.3% +11.7% ➖ noise
22 duckdb:vortex-file-compressed -3.6% -1.0% -2.6% +11.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@connortsui20 connortsui20 merged commit dfb9992 into develop Apr 23, 2026
77 checks passed
@connortsui20 connortsui20 deleted the ct/compressor-perfetto branch April 23, 2026 14:24
@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Vortex (geomean): 0.966x ➖
Parquet (geomean): 0.969x ➖
Shifts: Parquet (control) -3.1% · Median polish -3.3%


datafusion / vortex-file-compressed (0.973x ➖, 2↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27329239 27745453 0.98
tpcds_q02/datafusion:vortex-file-compressed 51314813 50921042 1.01
tpcds_q03/datafusion:vortex-file-compressed 18634914 18108969 1.03
tpcds_q04/datafusion:vortex-file-compressed 276945643 282847399 0.98
tpcds_q05/datafusion:vortex-file-compressed 45871207 48117714 0.95
tpcds_q06/datafusion:vortex-file-compressed 45249805 46628186 0.97
tpcds_q07/datafusion:vortex-file-compressed 47803061 46191131 1.03
tpcds_q08/datafusion:vortex-file-compressed 31277624 32101098 0.97
tpcds_q09/datafusion:vortex-file-compressed 46589212 46670436 1.00
tpcds_q10/datafusion:vortex-file-compressed 42616010 43609676 0.98
tpcds_q11/datafusion:vortex-file-compressed 157562560 158298954 1.00
tpcds_q12/datafusion:vortex-file-compressed 22802858 23413424 0.97
tpcds_q13/datafusion:vortex-file-compressed 48004953 49366908 0.97
tpcds_q14/datafusion:vortex-file-compressed 180866981 183510229 0.99
tpcds_q15/datafusion:vortex-file-compressed 33423423 33733410 0.99
tpcds_q16/datafusion:vortex-file-compressed 30523729 31753355 0.96
tpcds_q17/datafusion:vortex-file-compressed 67647771 68324330 0.99
tpcds_q18/datafusion:vortex-file-compressed 73483154 74457544 0.99
tpcds_q19/datafusion:vortex-file-compressed 26655473 26556158 1.00
tpcds_q20/datafusion:vortex-file-compressed 24438588 25570808 0.96
tpcds_q21/datafusion:vortex-file-compressed 130879936 138959507 0.94
tpcds_q22/datafusion:vortex-file-compressed 57279301 57340436 1.00
tpcds_q23/datafusion:vortex-file-compressed 133847044 141100518 0.95
tpcds_q24/datafusion:vortex-file-compressed 105616616 106516764 0.99
tpcds_q25/datafusion:vortex-file-compressed 68592825 72884026 0.94
tpcds_q26/datafusion:vortex-file-compressed 38984664 39509453 0.99
tpcds_q27/datafusion:vortex-file-compressed 105163154 111906728 0.94
tpcds_q28/datafusion:vortex-file-compressed 41938910 45835726 0.91
tpcds_q29/datafusion:vortex-file-compressed 69304229 68603389 1.01
tpcds_q30/datafusion:vortex-file-compressed 24287616 25969945 0.94
tpcds_q31/datafusion:vortex-file-compressed 91097812 95474885 0.95
tpcds_q32/datafusion:vortex-file-compressed 24782687 23438532 1.06
tpcds_q33/datafusion:vortex-file-compressed 32066525 32407380 0.99
tpcds_q34/datafusion:vortex-file-compressed 30042290 29682231 1.01
tpcds_q35/datafusion:vortex-file-compressed 51140623 53192441 0.96
tpcds_q36/datafusion:vortex-file-compressed 67346027 71122435 0.95
tpcds_q37/datafusion:vortex-file-compressed 🚀 30893607 35162112 0.88
tpcds_q38/datafusion:vortex-file-compressed 50912284 54016396 0.94
tpcds_q39/datafusion:vortex-file-compressed 138459126 150621713 0.92
tpcds_q40/datafusion:vortex-file-compressed 49681706 51595505 0.96
tpcds_q41/datafusion:vortex-file-compressed 17210524 18269349 0.94
tpcds_q42/datafusion:vortex-file-compressed 16377726 17406216 0.94
tpcds_q43/datafusion:vortex-file-compressed 30327020 31591049 0.96
tpcds_q44/datafusion:vortex-file-compressed 36080430 38201572 0.94
tpcds_q45/datafusion:vortex-file-compressed 34790234 34434186 1.01
tpcds_q46/datafusion:vortex-file-compressed 44300403 42985769 1.03
tpcds_q47/datafusion:vortex-file-compressed 192460385 197710086 0.97
tpcds_q48/datafusion:vortex-file-compressed 41528362 41593166 1.00
tpcds_q49/datafusion:vortex-file-compressed 61973988 63030080 0.98
tpcds_q50/datafusion:vortex-file-compressed 45572041 44716136 1.02
tpcds_q51/datafusion:vortex-file-compressed 92794450 91778831 1.01
tpcds_q52/datafusion:vortex-file-compressed 17545972 18845949 0.93
tpcds_q53/datafusion:vortex-file-compressed 23115869 23357548 0.99
tpcds_q54/datafusion:vortex-file-compressed 39345807 39862315 0.99
tpcds_q55/datafusion:vortex-file-compressed 17094932 17321540 0.99
tpcds_q56/datafusion:vortex-file-compressed 32450770 34516400 0.94
tpcds_q57/datafusion:vortex-file-compressed 127881289 129476216 0.99
tpcds_q58/datafusion:vortex-file-compressed 70787437 67354422 1.05
tpcds_q59/datafusion:vortex-file-compressed 67406357 70083944 0.96
tpcds_q60/datafusion:vortex-file-compressed 33341662 34732776 0.96
tpcds_q61/datafusion:vortex-file-compressed 43876194 44591397 0.98
tpcds_q62/datafusion:vortex-file-compressed 30092954 30949338 0.97
tpcds_q63/datafusion:vortex-file-compressed 23661303 23477239 1.01
tpcds_q64/datafusion:vortex-file-compressed 445831555 462073670 0.96
tpcds_q65/datafusion:vortex-file-compressed 44808082 45006995 1.00
tpcds_q66/datafusion:vortex-file-compressed 91499205 91472617 1.00
tpcds_q67/datafusion:vortex-file-compressed 110947950 122754244 0.90
tpcds_q68/datafusion:vortex-file-compressed 41771284 43067405 0.97
tpcds_q69/datafusion:vortex-file-compressed 40201818 41038289 0.98
tpcds_q70/datafusion:vortex-file-compressed 106518452 114645007 0.93
tpcds_q71/datafusion:vortex-file-compressed 26689132 28659005 0.93
tpcds_q72/datafusion:vortex-file-compressed 2526237396 2788576616 0.91
tpcds_q73/datafusion:vortex-file-compressed 29583737 28888929 1.02
tpcds_q74/datafusion:vortex-file-compressed 107414954 109077059 0.98
tpcds_q75/datafusion:vortex-file-compressed 112563004 119959274 0.94
tpcds_q76/datafusion:vortex-file-compressed 29462505 30250089 0.97
tpcds_q77/datafusion:vortex-file-compressed 44679292 43052618 1.04
tpcds_q78/datafusion:vortex-file-compressed 130602156 138706895 0.94
tpcds_q79/datafusion:vortex-file-compressed 35921633 36667769 0.98
tpcds_q80/datafusion:vortex-file-compressed 105336450 112100167 0.94
tpcds_q81/datafusion:vortex-file-compressed 29935370 31881533 0.94
tpcds_q82/datafusion:vortex-file-compressed 🚀 33183150 37299535 0.89
tpcds_q83/datafusion:vortex-file-compressed 45703961 45412812 1.01
tpcds_q84/datafusion:vortex-file-compressed 14318718 14720717 0.97
tpcds_q85/datafusion:vortex-file-compressed 94904787 99676969 0.95
tpcds_q86/datafusion:vortex-file-compressed 19001180 20319010 0.94
tpcds_q87/datafusion:vortex-file-compressed 52175063 57334680 0.91
tpcds_q88/datafusion:vortex-file-compressed 61241715 61815239 0.99
tpcds_q89/datafusion:vortex-file-compressed 34166006 36768569 0.93
tpcds_q90/datafusion:vortex-file-compressed 15636047 16302011 0.96
tpcds_q91/datafusion:vortex-file-compressed 23103300 23232567 0.99
tpcds_q92/datafusion:vortex-file-compressed 20936295 21829397 0.96
tpcds_q93/datafusion:vortex-file-compressed 34890544 37695865 0.93
tpcds_q94/datafusion:vortex-file-compressed 29226595 27634674 1.06
tpcds_q95/datafusion:vortex-file-compressed 64204381 65779973 0.98
tpcds_q96/datafusion:vortex-file-compressed 14952006 14760032 1.01
tpcds_q97/datafusion:vortex-file-compressed 36423032 36362380 1.00
tpcds_q98/datafusion:vortex-file-compressed 29323856 30520454 0.96
tpcds_q99/datafusion:vortex-file-compressed 46491398 43478772 1.07
datafusion / vortex-compact (0.966x ➖, 4↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 29737341 29620582 1.00
tpcds_q02/datafusion:vortex-compact 55700779 57915528 0.96
tpcds_q03/datafusion:vortex-compact 23023253 22954845 1.00
tpcds_q04/datafusion:vortex-compact 313767840 333239073 0.94
tpcds_q05/datafusion:vortex-compact 54274628 54894569 0.99
tpcds_q06/datafusion:vortex-compact 47550563 50901085 0.93
tpcds_q07/datafusion:vortex-compact 🚀 56694356 63304765 0.90
tpcds_q08/datafusion:vortex-compact 39253516 39315845 1.00
tpcds_q09/datafusion:vortex-compact 64165254 66185355 0.97
tpcds_q10/datafusion:vortex-compact 53100796 55825763 0.95
tpcds_q11/datafusion:vortex-compact 173103404 183367766 0.94
tpcds_q12/datafusion:vortex-compact 🚀 25796848 28912638 0.89
tpcds_q13/datafusion:vortex-compact 95865808 98120401 0.98
tpcds_q14/datafusion:vortex-compact 211256361 215906392 0.98
tpcds_q15/datafusion:vortex-compact 35218858 36440809 0.97
tpcds_q16/datafusion:vortex-compact 35738902 35353742 1.01
tpcds_q17/datafusion:vortex-compact 83103212 81968840 1.01
tpcds_q18/datafusion:vortex-compact 82182726 87709371 0.94
tpcds_q19/datafusion:vortex-compact 34494293 36878586 0.94
tpcds_q20/datafusion:vortex-compact 🚀 28670457 31980649 0.90
tpcds_q21/datafusion:vortex-compact 136163850 142940156 0.95
tpcds_q22/datafusion:vortex-compact 65294488 65245114 1.00
tpcds_q23/datafusion:vortex-compact 150284564 159226759 0.94
tpcds_q24/datafusion:vortex-compact 122217084 126118408 0.97
tpcds_q25/datafusion:vortex-compact 82323392 89217690 0.92
tpcds_q26/datafusion:vortex-compact 50192570 49216607 1.02
tpcds_q27/datafusion:vortex-compact 134689736 140517749 0.96
tpcds_q28/datafusion:vortex-compact 82352138 83225708 0.99
tpcds_q29/datafusion:vortex-compact 77879537 82049661 0.95
tpcds_q30/datafusion:vortex-compact 29141072 30500707 0.96
tpcds_q31/datafusion:vortex-compact 118068035 116217172 1.02
tpcds_q32/datafusion:vortex-compact 27341208 27609901 0.99
tpcds_q33/datafusion:vortex-compact 37928796 38734984 0.98
tpcds_q34/datafusion:vortex-compact 38345724 37836117 1.01
tpcds_q35/datafusion:vortex-compact 59767799 59852230 1.00
tpcds_q36/datafusion:vortex-compact 81444397 84350761 0.97
tpcds_q37/datafusion:vortex-compact 48270794 45916394 1.05
tpcds_q38/datafusion:vortex-compact 59721515 58827281 1.02
tpcds_q39/datafusion:vortex-compact 138263795 149494462 0.92
tpcds_q40/datafusion:vortex-compact 55320673 54759199 1.01
tpcds_q41/datafusion:vortex-compact 19824794 20717652 0.96
tpcds_q42/datafusion:vortex-compact 20931806 22158337 0.94
tpcds_q43/datafusion:vortex-compact 34170850 36664531 0.93
tpcds_q44/datafusion:vortex-compact 55532539 56340252 0.99
tpcds_q45/datafusion:vortex-compact 🚀 36864315 43224954 0.85
tpcds_q46/datafusion:vortex-compact 54735575 56541474 0.97
tpcds_q47/datafusion:vortex-compact 216564971 236174789 0.92
tpcds_q48/datafusion:vortex-compact 75277892 77480105 0.97
tpcds_q49/datafusion:vortex-compact 73532749 77167259 0.95
tpcds_q50/datafusion:vortex-compact 51935947 56650303 0.92
tpcds_q51/datafusion:vortex-compact 99919411 102027001 0.98
tpcds_q52/datafusion:vortex-compact 20749453 22057696 0.94
tpcds_q53/datafusion:vortex-compact 29948663 31319315 0.96
tpcds_q54/datafusion:vortex-compact 46590044 49987593 0.93
tpcds_q55/datafusion:vortex-compact 20973480 22009053 0.95
tpcds_q56/datafusion:vortex-compact 39493957 40848315 0.97
tpcds_q57/datafusion:vortex-compact 134113324 137656203 0.97
tpcds_q58/datafusion:vortex-compact 76868389 78649909 0.98
tpcds_q59/datafusion:vortex-compact 77714198 81694944 0.95
tpcds_q60/datafusion:vortex-compact 40157820 41488690 0.97
tpcds_q61/datafusion:vortex-compact 57838890 61500013 0.94
tpcds_q62/datafusion:vortex-compact 33014021 35547546 0.93
tpcds_q63/datafusion:vortex-compact 29379487 30770087 0.95
tpcds_q64/datafusion:vortex-compact 486729762 503118254 0.97
tpcds_q65/datafusion:vortex-compact 62450837 59869424 1.04
tpcds_q66/datafusion:vortex-compact 95491309 91460166 1.04
tpcds_q67/datafusion:vortex-compact 118570104 122672279 0.97
tpcds_q68/datafusion:vortex-compact 53157256 55248789 0.96
tpcds_q69/datafusion:vortex-compact 50536761 52341453 0.97
tpcds_q70/datafusion:vortex-compact 116089757 113727138 1.02
tpcds_q71/datafusion:vortex-compact 35349573 35377439 1.00
tpcds_q72/datafusion:vortex-compact 2492215164 2703768179 0.92
tpcds_q73/datafusion:vortex-compact 36916664 37180484 0.99
tpcds_q74/datafusion:vortex-compact 121128983 128863926 0.94
tpcds_q75/datafusion:vortex-compact 134315232 136945626 0.98
tpcds_q76/datafusion:vortex-compact 38709599 38620058 1.00
tpcds_q77/datafusion:vortex-compact 54142186 55477118 0.98
tpcds_q78/datafusion:vortex-compact 144528988 147507416 0.98
tpcds_q79/datafusion:vortex-compact 43987599 46589307 0.94
tpcds_q80/datafusion:vortex-compact 114116080 121060027 0.94
tpcds_q81/datafusion:vortex-compact 35144602 35579884 0.99
tpcds_q82/datafusion:vortex-compact 47276024 49834822 0.95
tpcds_q83/datafusion:vortex-compact 48425784 51505382 0.94
tpcds_q84/datafusion:vortex-compact 16400168 17879992 0.92
tpcds_q85/datafusion:vortex-compact 123791399 135617254 0.91
tpcds_q86/datafusion:vortex-compact 22959591 24121023 0.95
tpcds_q87/datafusion:vortex-compact 60093786 61585609 0.98
tpcds_q88/datafusion:vortex-compact 80477168 81866513 0.98
tpcds_q89/datafusion:vortex-compact 39302256 41160490 0.95
tpcds_q90/datafusion:vortex-compact 16176801 16728414 0.97
tpcds_q91/datafusion:vortex-compact 37771678 37451444 1.01
tpcds_q92/datafusion:vortex-compact 27468688 27470960 1.00
tpcds_q93/datafusion:vortex-compact 40596752 40205989 1.01
tpcds_q94/datafusion:vortex-compact 27545231 29598350 0.93
tpcds_q95/datafusion:vortex-compact 64730983 70707866 0.92
tpcds_q96/datafusion:vortex-compact 18069641 18470498 0.98
tpcds_q97/datafusion:vortex-compact 39164428 41504140 0.94
tpcds_q98/datafusion:vortex-compact 34605020 34090525 1.02
tpcds_q99/datafusion:vortex-compact 47683781 46800383 1.02
datafusion / parquet (0.964x ➖, 8↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30196700 31356678 0.96
tpcds_q02/datafusion:parquet 43134409 42997549 1.00
tpcds_q03/datafusion:parquet 🚀 14000067 15706136 0.89
tpcds_q04/datafusion:parquet 276768259 287693670 0.96
tpcds_q05/datafusion:parquet 43616233 42072613 1.04
tpcds_q06/datafusion:parquet 59988245 60730052 0.99
tpcds_q07/datafusion:parquet 82035371 86461509 0.95
tpcds_q08/datafusion:parquet 28047303 28078043 1.00
tpcds_q09/datafusion:parquet 47593136 49250175 0.97
tpcds_q10/datafusion:parquet 79180393 83005642 0.95
tpcds_q11/datafusion:parquet 154574936 164480263 0.94
tpcds_q12/datafusion:parquet 19362378 17948417 1.08
tpcds_q13/datafusion:parquet 78274585 80224728 0.98
tpcds_q14/datafusion:parquet 168111002 182338315 0.92
tpcds_q15/datafusion:parquet 22560141 24088214 0.94
tpcds_q16/datafusion:parquet 24691452 27098125 0.91
tpcds_q17/datafusion:parquet 67106273 67826275 0.99
tpcds_q18/datafusion:parquet 117884842 120094505 0.98
tpcds_q19/datafusion:parquet 23707813 24065748 0.99
tpcds_q20/datafusion:parquet 17417721 17330061 1.01
tpcds_q21/datafusion:parquet 19240834 20018411 0.96
tpcds_q22/datafusion:parquet 🚀 133418517 159038595 0.84
tpcds_q23/datafusion:parquet 151515944 162520044 0.93
tpcds_q24/datafusion:parquet 95925315 101244745 0.95
tpcds_q25/datafusion:parquet 68420012 70965426 0.96
tpcds_q26/datafusion:parquet 71241311 70998228 1.00
tpcds_q27/datafusion:parquet 154219526 162606797 0.95
tpcds_q28/datafusion:parquet 🚀 45946735 51463363 0.89
tpcds_q29/datafusion:parquet 67672021 70284546 0.96
tpcds_q30/datafusion:parquet 36287670 37773907 0.96
tpcds_q31/datafusion:parquet 68178351 70438882 0.97
tpcds_q32/datafusion:parquet 18809701 19511966 0.96
tpcds_q33/datafusion:parquet 27771505 28932569 0.96
tpcds_q34/datafusion:parquet 23027207 23802892 0.97
tpcds_q35/datafusion:parquet 75454202 78530760 0.96
tpcds_q36/datafusion:parquet 61404858 63499695 0.97
tpcds_q37/datafusion:parquet 21086995 20898875 1.01
tpcds_q38/datafusion:parquet 41751160 43539037 0.96
tpcds_q39/datafusion:parquet 74307917 75791295 0.98
tpcds_q40/datafusion:parquet 24656132 25058145 0.98
tpcds_q41/datafusion:parquet 13710787 15209789 0.90
tpcds_q42/datafusion:parquet 12366869 12196502 1.01
tpcds_q43/datafusion:parquet 17458393 17623742 0.99
tpcds_q44/datafusion:parquet 35287801 35417183 1.00
tpcds_q45/datafusion:parquet 29751575 31193811 0.95
tpcds_q46/datafusion:parquet 32605115 35122162 0.93
tpcds_q47/datafusion:parquet 128402094 137468648 0.93
tpcds_q48/datafusion:parquet 72166410 76316460 0.95
tpcds_q49/datafusion:parquet 57691437 58824724 0.98
tpcds_q50/datafusion:parquet 44399553 44984974 0.99
tpcds_q51/datafusion:parquet 86223298 91147271 0.95
tpcds_q52/datafusion:parquet 🚀 12317514 13825051 0.89
tpcds_q53/datafusion:parquet 18436037 19150473 0.96
tpcds_q54/datafusion:parquet 36966577 35628767 1.04
tpcds_q55/datafusion:parquet 12482114 12704117 0.98
tpcds_q56/datafusion:parquet 28398752 28413121 1.00
tpcds_q57/datafusion:parquet 103245184 104570793 0.99
tpcds_q58/datafusion:parquet 51079319 52361107 0.98
tpcds_q59/datafusion:parquet 55589931 58700095 0.95
tpcds_q60/datafusion:parquet 🚀 27664948 31269169 0.88
tpcds_q61/datafusion:parquet 43628804 46601420 0.94
tpcds_q62/datafusion:parquet 25566407 25901309 0.99
tpcds_q63/datafusion:parquet 18645509 18994928 0.98
tpcds_q64/datafusion:parquet 537573739 545931867 0.98
tpcds_q65/datafusion:parquet 38711118 41272668 0.94
tpcds_q66/datafusion:parquet 🚀 67426515 75849979 0.89
tpcds_q67/datafusion:parquet 156380209 145922160 1.07
tpcds_q68/datafusion:parquet 34196595 34751081 0.98
tpcds_q69/datafusion:parquet 73067075 71146370 1.03
tpcds_q70/datafusion:parquet 87524349 92162630 0.95
tpcds_q71/datafusion:parquet 24587267 23766911 1.03
tpcds_q72/datafusion:parquet 634553311 655959566 0.97
tpcds_q73/datafusion:parquet 21913823 22334055 0.98
tpcds_q74/datafusion:parquet 🚀 84920576 94590184 0.90
tpcds_q75/datafusion:parquet 105093523 108557741 0.97
tpcds_q76/datafusion:parquet 31128544 31428828 0.99
tpcds_q77/datafusion:parquet 41263874 44549407 0.93
tpcds_q78/datafusion:parquet 115472707 124589663 0.93
tpcds_q79/datafusion:parquet 27330478 29443546 0.93
tpcds_q80/datafusion:parquet 81951948 85043316 0.96
tpcds_q81/datafusion:parquet 35174047 33361037 1.05
tpcds_q82/datafusion:parquet 20259420 22155095 0.91
tpcds_q83/datafusion:parquet 38073130 40226799 0.95
tpcds_q84/datafusion:parquet 39988564 41078082 0.97
tpcds_q85/datafusion:parquet 159833739 157059899 1.02
tpcds_q86/datafusion:parquet 16857950 17107526 0.99
tpcds_q87/datafusion:parquet 42159987 43851781 0.96
tpcds_q88/datafusion:parquet 60904431 61532255 0.99
tpcds_q89/datafusion:parquet 22676269 23681938 0.96
tpcds_q90/datafusion:parquet 15461813 15756500 0.98
tpcds_q91/datafusion:parquet 64136169 65603126 0.98
tpcds_q92/datafusion:parquet 19214324 19832127 0.97
tpcds_q93/datafusion:parquet 31988857 33799109 0.95
tpcds_q94/datafusion:parquet 20792273 22151670 0.94
tpcds_q95/datafusion:parquet 60572633 61039710 0.99
tpcds_q96/datafusion:parquet 12534742 12904811 0.97
tpcds_q97/datafusion:parquet 30015314 31812668 0.94
tpcds_q98/datafusion:parquet 22008227 22314795 0.99
tpcds_q99/datafusion:parquet 🚀 29357580 32789492 0.90
duckdb / vortex-file-compressed (0.962x ➖, 4↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 23549841 23568946 1.00
tpcds_q02/duckdb:vortex-file-compressed 35706631 33910709 1.05
tpcds_q03/duckdb:vortex-file-compressed 32500191 33443384 0.97
tpcds_q04/duckdb:vortex-file-compressed 109316745 108684297 1.01
tpcds_q05/duckdb:vortex-file-compressed 39043761 38009596 1.03
tpcds_q06/duckdb:vortex-file-compressed 34011443 35709203 0.95
tpcds_q07/duckdb:vortex-file-compressed 23109247 25259491 0.91
tpcds_q08/duckdb:vortex-file-compressed 29397712 30574061 0.96
tpcds_q09/duckdb:vortex-file-compressed 39044250 41863740 0.93
tpcds_q10/duckdb:vortex-file-compressed 42833623 45473529 0.94
tpcds_q11/duckdb:vortex-file-compressed 62391098 66686869 0.94
tpcds_q12/duckdb:vortex-file-compressed 15758148 15717565 1.00
tpcds_q13/duckdb:vortex-file-compressed 33933087 36230298 0.94
tpcds_q14/duckdb:vortex-file-compressed 111963509 112543317 0.99
tpcds_q15/duckdb:vortex-file-compressed 27867037 29221298 0.95
tpcds_q16/duckdb:vortex-file-compressed 28110539 30522933 0.92
tpcds_q17/duckdb:vortex-file-compressed 45135004 48249441 0.94
tpcds_q18/duckdb:vortex-file-compressed 48475578 50683305 0.96
tpcds_q19/duckdb:vortex-file-compressed 34110137 35097071 0.97
tpcds_q20/duckdb:vortex-file-compressed 16221624 17236930 0.94
tpcds_q21/duckdb:vortex-file-compressed 17872976 18846877 0.95
tpcds_q22/duckdb:vortex-file-compressed 🚀 70163703 93260221 0.75
tpcds_q23/duckdb:vortex-file-compressed 🚀 107987005 120601860 0.90
tpcds_q24/duckdb:vortex-file-compressed 50599167 53361994 0.95
tpcds_q25/duckdb:vortex-file-compressed 51307824 52473265 0.98
tpcds_q26/duckdb:vortex-file-compressed 42306086 42188486 1.00
tpcds_q27/duckdb:vortex-file-compressed 50491349 52638349 0.96
tpcds_q28/duckdb:vortex-file-compressed 36118981 38354687 0.94
tpcds_q29/duckdb:vortex-file-compressed 46091249 43964393 1.05
tpcds_q30/duckdb:vortex-file-compressed 25244023 27280786 0.93
tpcds_q31/duckdb:vortex-file-compressed 36544591 38100329 0.96
tpcds_q32/duckdb:vortex-file-compressed 15433635 16138814 0.96
tpcds_q33/duckdb:vortex-file-compressed 26857591 25852810 1.04
tpcds_q34/duckdb:vortex-file-compressed 24586376 25529560 0.96
tpcds_q35/duckdb:vortex-file-compressed 69446871 68886682 1.01
tpcds_q36/duckdb:vortex-file-compressed 26031907 26842055 0.97
tpcds_q37/duckdb:vortex-file-compressed 17468693 17455481 1.00
tpcds_q38/duckdb:vortex-file-compressed 38829271 40499710 0.96
tpcds_q39/duckdb:vortex-file-compressed 34978462 35544247 0.98
tpcds_q40/duckdb:vortex-file-compressed 21774361 22060069 0.99
tpcds_q41/duckdb:vortex-file-compressed 14308024 14816212 0.97
tpcds_q42/duckdb:vortex-file-compressed 14227468 13771322 1.03
tpcds_q43/duckdb:vortex-file-compressed 24012413 25165765 0.95
tpcds_q44/duckdb:vortex-file-compressed 21038166 23318896 0.90
tpcds_q45/duckdb:vortex-file-compressed 30793782 31203002 0.99
tpcds_q46/duckdb:vortex-file-compressed 53994191 56280785 0.96
tpcds_q47/duckdb:vortex-file-compressed 48940292 51907126 0.94
tpcds_q48/duckdb:vortex-file-compressed 31590726 34149121 0.93
tpcds_q49/duckdb:vortex-file-compressed 🚀 35190460 39198035 0.90
tpcds_q50/duckdb:vortex-file-compressed 36817173 37456400 0.98
tpcds_q51/duckdb:vortex-file-compressed 100029503 102829523 0.97
tpcds_q52/duckdb:vortex-file-compressed 14748243 13594129 1.08
tpcds_q53/duckdb:vortex-file-compressed 24056330 25634445 0.94
tpcds_q54/duckdb:vortex-file-compressed 29803802 30836926 0.97
tpcds_q55/duckdb:vortex-file-compressed 13557509 14953079 0.91
tpcds_q56/duckdb:vortex-file-compressed 25145565 26507025 0.95
tpcds_q57/duckdb:vortex-file-compressed 40819047 41909968 0.97
tpcds_q58/duckdb:vortex-file-compressed 32150113 32819020 0.98
tpcds_q59/duckdb:vortex-file-compressed 66898796 66224844 1.01
tpcds_q60/duckdb:vortex-file-compressed 29355725 28816969 1.02
tpcds_q61/duckdb:vortex-file-compressed 36057030 38146184 0.95
tpcds_q62/duckdb:vortex-file-compressed 17519056 19329572 0.91
tpcds_q63/duckdb:vortex-file-compressed 23447595 23946022 0.98
tpcds_q64/duckdb:vortex-file-compressed 87651008 91755854 0.96
tpcds_q65/duckdb:vortex-file-compressed 22693158 24321983 0.93
tpcds_q66/duckdb:vortex-file-compressed 31296361 31054173 1.01
tpcds_q67/duckdb:vortex-file-compressed 139991160 152891929 0.92
tpcds_q68/duckdb:vortex-file-compressed 43498654 45207085 0.96
tpcds_q69/duckdb:vortex-file-compressed 44116759 45538044 0.97
tpcds_q70/duckdb:vortex-file-compressed 28187950 28987284 0.97
tpcds_q71/duckdb:vortex-file-compressed 🚀 22144439 25274119 0.88
tpcds_q72/duckdb:vortex-file-compressed 174891645 179619956 0.97
tpcds_q73/duckdb:vortex-file-compressed 27035524 25829532 1.05
tpcds_q74/duckdb:vortex-file-compressed 73699953 81569596 0.90
tpcds_q75/duckdb:vortex-file-compressed 60910852 63395709 0.96
tpcds_q76/duckdb:vortex-file-compressed 19685271 20378553 0.97
tpcds_q77/duckdb:vortex-file-compressed 28020793 29170539 0.96
tpcds_q78/duckdb:vortex-file-compressed 75911522 83701892 0.91
tpcds_q79/duckdb:vortex-file-compressed 36731734 35011828 1.05
tpcds_q80/duckdb:vortex-file-compressed 50400603 52714793 0.96
tpcds_q81/duckdb:vortex-file-compressed 30535322 32626378 0.94
tpcds_q82/duckdb:vortex-file-compressed 18566486 18940953 0.98
tpcds_q83/duckdb:vortex-file-compressed 25263923 27360155 0.92
tpcds_q84/duckdb:vortex-file-compressed 22324651 21122359 1.06
tpcds_q85/duckdb:vortex-file-compressed 48632681 49501751 0.98
tpcds_q86/duckdb:vortex-file-compressed 17802390 17627014 1.01
tpcds_q87/duckdb:vortex-file-compressed 41909919 42779725 0.98
tpcds_q88/duckdb:vortex-file-compressed 35305873 37105530 0.95
tpcds_q89/duckdb:vortex-file-compressed 22842236 24624144 0.93
tpcds_q90/duckdb:vortex-file-compressed 13018700 14376275 0.91
tpcds_q91/duckdb:vortex-file-compressed 34543613 34581911 1.00
tpcds_q92/duckdb:vortex-file-compressed 24089729 24115470 1.00
tpcds_q93/duckdb:vortex-file-compressed 29214907 31618997 0.92
tpcds_q94/duckdb:vortex-file-compressed 23697581 25503432 0.93
tpcds_q95/duckdb:vortex-file-compressed 145640680 153355804 0.95
tpcds_q96/duckdb:vortex-file-compressed 14872039 15335443 0.97
tpcds_q97/duckdb:vortex-file-compressed 39769814 41707377 0.95
tpcds_q98/duckdb:vortex-file-compressed 19196783 20041052 0.96
tpcds_q99/duckdb:vortex-file-compressed 28470439 29732819 0.96
duckdb / vortex-compact (0.963x ➖, 8↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 25287755 26157592 0.97
tpcds_q02/duckdb:vortex-compact 43727187 43025429 1.02
tpcds_q03/duckdb:vortex-compact 59449458 59400949 1.00
tpcds_q04/duckdb:vortex-compact 125781248 124798181 1.01
tpcds_q05/duckdb:vortex-compact 52739922 58298420 0.90
tpcds_q06/duckdb:vortex-compact 42525493 44588213 0.95
tpcds_q07/duckdb:vortex-compact 36582159 36834571 0.99
tpcds_q08/duckdb:vortex-compact 46802602 49849674 0.94
tpcds_q09/duckdb:vortex-compact 58817067 62202719 0.95
tpcds_q10/duckdb:vortex-compact 64951066 68765610 0.94
tpcds_q11/duckdb:vortex-compact 72264377 78152662 0.92
tpcds_q12/duckdb:vortex-compact 24357764 26845527 0.91
tpcds_q13/duckdb:vortex-compact 60425968 63586833 0.95
tpcds_q14/duckdb:vortex-compact 140174132 140844432 1.00
tpcds_q15/duckdb:vortex-compact 32774071 33234133 0.99
tpcds_q16/duckdb:vortex-compact 33923569 33368819 1.02
tpcds_q17/duckdb:vortex-compact 58490665 59724718 0.98
tpcds_q18/duckdb:vortex-compact 60071604 61048928 0.98
tpcds_q19/duckdb:vortex-compact 52551729 54796792 0.96
tpcds_q20/duckdb:vortex-compact 22048122 22886889 0.96
tpcds_q21/duckdb:vortex-compact 21809271 21166598 1.03
tpcds_q22/duckdb:vortex-compact 🚀 76210053 85246122 0.89
tpcds_q23/duckdb:vortex-compact 123151842 127191534 0.97
tpcds_q24/duckdb:vortex-compact 66207005 69914409 0.95
tpcds_q25/duckdb:vortex-compact 82861129 81743039 1.01
tpcds_q26/duckdb:vortex-compact 55056623 56080172 0.98
tpcds_q27/duckdb:vortex-compact 72319070 75489052 0.96
tpcds_q28/duckdb:vortex-compact 86494341 91172346 0.95
tpcds_q29/duckdb:vortex-compact 56305604 57241292 0.98
tpcds_q30/duckdb:vortex-compact 🚀 29387493 34120770 0.86
tpcds_q31/duckdb:vortex-compact 49690944 49921350 1.00
tpcds_q32/duckdb:vortex-compact 25014426 25785924 0.97
tpcds_q33/duckdb:vortex-compact 37662059 38977629 0.97
tpcds_q34/duckdb:vortex-compact 40436101 41702984 0.97
tpcds_q35/duckdb:vortex-compact 86861885 89308785 0.97
tpcds_q36/duckdb:vortex-compact 43095371 46554485 0.93
tpcds_q37/duckdb:vortex-compact 24634819 26682974 0.92
tpcds_q38/duckdb:vortex-compact 50369300 52898413 0.95
tpcds_q39/duckdb:vortex-compact 🚀 36967098 41075621 0.90
tpcds_q40/duckdb:vortex-compact 26482122 28310202 0.94
tpcds_q41/duckdb:vortex-compact 17166915 17274530 0.99
tpcds_q42/duckdb:vortex-compact 24050300 24132780 1.00
tpcds_q43/duckdb:vortex-compact 36616756 36467838 1.00
tpcds_q44/duckdb:vortex-compact 30661503 32080607 0.96
tpcds_q45/duckdb:vortex-compact 40837710 42987472 0.95
tpcds_q46/duckdb:vortex-compact 75322799 76924794 0.98
tpcds_q47/duckdb:vortex-compact 65586467 69346244 0.95
tpcds_q48/duckdb:vortex-compact 52167296 56802004 0.92
tpcds_q49/duckdb:vortex-compact 🚀 57763737 65380905 0.88
tpcds_q50/duckdb:vortex-compact 48449921 50840485 0.95
tpcds_q51/duckdb:vortex-compact 108339298 112166852 0.97
tpcds_q52/duckdb:vortex-compact 23930370 23165941 1.03
tpcds_q53/duckdb:vortex-compact 40878801 40454846 1.01
tpcds_q54/duckdb:vortex-compact 42506518 43064227 0.99
tpcds_q55/duckdb:vortex-compact 23848109 23992500 0.99
tpcds_q56/duckdb:vortex-compact 38905142 38377117 1.01
tpcds_q57/duckdb:vortex-compact 45259439 45792278 0.99
tpcds_q58/duckdb:vortex-compact 🚀 41537019 47761041 0.87
tpcds_q59/duckdb:vortex-compact 91010639 92750351 0.98
tpcds_q60/duckdb:vortex-compact 40183950 44053459 0.91
tpcds_q61/duckdb:vortex-compact 65722925 67693873 0.97
tpcds_q62/duckdb:vortex-compact 26407398 29096443 0.91
tpcds_q63/duckdb:vortex-compact 38602031 40504458 0.95
tpcds_q64/duckdb:vortex-compact 119280514 126080725 0.95
tpcds_q65/duckdb:vortex-compact 33341029 34363578 0.97
tpcds_q66/duckdb:vortex-compact 40027265 43481127 0.92
tpcds_q67/duckdb:vortex-compact 158253166 159854219 0.99
tpcds_q68/duckdb:vortex-compact 64429155 63287198 1.02
tpcds_q69/duckdb:vortex-compact 66140188 66247590 1.00
tpcds_q70/duckdb:vortex-compact 39499873 39528868 1.00
tpcds_q71/duckdb:vortex-compact 36469316 36753540 0.99
tpcds_q72/duckdb:vortex-compact 196954767 196745629 1.00
tpcds_q73/duckdb:vortex-compact 40174895 39088867 1.03
tpcds_q74/duckdb:vortex-compact 95431740 90295381 1.06
tpcds_q75/duckdb:vortex-compact 75151224 78687216 0.96
tpcds_q76/duckdb:vortex-compact 36324730 36387778 1.00
tpcds_q77/duckdb:vortex-compact 43539104 45991197 0.95
tpcds_q78/duckdb:vortex-compact 🚀 86857612 97125907 0.89
tpcds_q79/duckdb:vortex-compact 54966552 56382236 0.97
tpcds_q80/duckdb:vortex-compact 80477815 86087109 0.93
tpcds_q81/duckdb:vortex-compact 35359916 35685125 0.99
tpcds_q82/duckdb:vortex-compact 26864628 29542258 0.91
tpcds_q83/duckdb:vortex-compact 34485554 35307817 0.98
tpcds_q84/duckdb:vortex-compact 29830721 29975265 1.00
tpcds_q85/duckdb:vortex-compact 59947983 60692650 0.99
tpcds_q86/duckdb:vortex-compact 24557381 26020172 0.94
tpcds_q87/duckdb:vortex-compact 53463385 55389506 0.97
tpcds_q88/duckdb:vortex-compact 42684316 43618935 0.98
tpcds_q89/duckdb:vortex-compact 39288505 40962518 0.96
tpcds_q90/duckdb:vortex-compact 16143849 16603109 0.97
tpcds_q91/duckdb:vortex-compact 55063775 55637980 0.99
tpcds_q92/duckdb:vortex-compact 🚀 51408922 57187869 0.90
tpcds_q93/duckdb:vortex-compact 32951702 33995082 0.97
tpcds_q94/duckdb:vortex-compact 33800254 35530211 0.95
tpcds_q95/duckdb:vortex-compact 🚀 150323688 171248043 0.88
tpcds_q96/duckdb:vortex-compact 18560308 20136250 0.92
tpcds_q97/duckdb:vortex-compact 43296716 46838562 0.92
tpcds_q98/duckdb:vortex-compact 29608357 32002843 0.93
tpcds_q99/duckdb:vortex-compact 35747974 34559880 1.03
duckdb / parquet (0.974x ➖, 3↑ 1↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28517171 30024101 0.95
tpcds_q02/duckdb:parquet 23692517 23233118 1.02
tpcds_q03/duckdb:parquet 11363044 11269000 1.01
tpcds_q04/duckdb:parquet 167162088 169453201 0.99
tpcds_q05/duckdb:parquet 30298760 29656096 1.02
tpcds_q06/duckdb:parquet 28040850 28471705 0.98
tpcds_q07/duckdb:parquet 21283446 21490537 0.99
tpcds_q08/duckdb:parquet 27206686 27447844 0.99
tpcds_q09/duckdb:parquet 39504549 39884058 0.99
tpcds_q10/duckdb:parquet 32613160 33244146 0.98
tpcds_q11/duckdb:parquet 82707813 90618236 0.91
tpcds_q12/duckdb:parquet 14676675 14829212 0.99
tpcds_q13/duckdb:parquet 32543372 33532041 0.97
tpcds_q14/duckdb:parquet 105589222 99240213 1.06
tpcds_q15/duckdb:parquet 30778653 30430573 1.01
tpcds_q16/duckdb:parquet 21772484 22145585 0.98
tpcds_q17/duckdb:parquet 38789588 37643060 1.03
tpcds_q18/duckdb:parquet 46718569 46234455 1.01
tpcds_q19/duckdb:parquet 29374547 30077244 0.98
tpcds_q20/duckdb:parquet 15672992 16007392 0.98
tpcds_q21/duckdb:parquet 11094326 11067630 1.00
tpcds_q22/duckdb:parquet 68044609 71375855 0.95
tpcds_q23/duckdb:parquet 81478719 82901710 0.98
tpcds_q24/duckdb:parquet 45771774 46575336 0.98
tpcds_q25/duckdb:parquet 32027948 34546330 0.93
tpcds_q26/duckdb:parquet 36255299 39564603 0.92
tpcds_q27/duckdb:parquet 47573308 51434662 0.92
tpcds_q28/duckdb:parquet 38011978 38978414 0.98
tpcds_q29/duckdb:parquet 35776155 36885225 0.97
tpcds_q30/duckdb:parquet 37149078 36970050 1.00
tpcds_q31/duckdb:parquet 24291618 24245908 1.00
tpcds_q32/duckdb:parquet 11530450 11981485 0.96
tpcds_q33/duckdb:parquet 20762431 20843836 1.00
tpcds_q34/duckdb:parquet 20461788 21238102 0.96
tpcds_q35/duckdb:parquet 58480833 58383086 1.00
tpcds_q36/duckdb:parquet 20005896 19830606 1.01
tpcds_q37/duckdb:parquet 12697770 12468703 1.02
tpcds_q38/duckdb:parquet 33656139 36043609 0.93
tpcds_q39/duckdb:parquet 🚀 29850006 33766223 0.88
tpcds_q40/duckdb:parquet 17051904 17919802 0.95
tpcds_q41/duckdb:parquet 7879521 8140815 0.97
tpcds_q42/duckdb:parquet 9698172 10273281 0.94
tpcds_q43/duckdb:parquet 15355158 15421686 1.00
tpcds_q44/duckdb:parquet 22053482 22361251 0.99
tpcds_q45/duckdb:parquet 25746001 27597799 0.93
tpcds_q46/duckdb:parquet 45444294 47285519 0.96
tpcds_q47/duckdb:parquet 46105522 45959867 1.00
tpcds_q48/duckdb:parquet 30683365 30947165 0.99
tpcds_q49/duckdb:parquet 24309756 25149836 0.97
tpcds_q50/duckdb:parquet 24204979 25529873 0.95
tpcds_q51/duckdb:parquet 96221672 97765672 0.98
tpcds_q52/duckdb:parquet 10382523 11340230 0.92
tpcds_q53/duckdb:parquet 15181359 15851576 0.96
tpcds_q54/duckdb:parquet 25769557 26554644 0.97
tpcds_q55/duckdb:parquet 10255762 10341172 0.99
tpcds_q56/duckdb:parquet 21516276 22701251 0.95
tpcds_q57/duckdb:parquet 34168974 35845885 0.95
tpcds_q58/duckdb:parquet 22456093 23546641 0.95
tpcds_q59/duckdb:parquet 36045508 35463195 1.02
tpcds_q60/duckdb:parquet 22013419 22077616 1.00
tpcds_q61/duckdb:parquet 30469832 31130258 0.98
tpcds_q62/duckdb:parquet 12941070 12507815 1.03
tpcds_q63/duckdb:parquet 14193621 14064301 1.01
tpcds_q64/duckdb:parquet 73760145 73833965 1.00
tpcds_q65/duckdb:parquet 19701889 21088480 0.93
tpcds_q66/duckdb:parquet 32373490 32011668 1.01
tpcds_q67/duckdb:parquet 134415428 143719056 0.94
tpcds_q68/duckdb:parquet 36847891 37573481 0.98
tpcds_q69/duckdb:parquet 35972062 37457364 0.96
tpcds_q70/duckdb:parquet 19633677 19797853 0.99
tpcds_q71/duckdb:parquet 19577383 20486411 0.96
tpcds_q72/duckdb:parquet 164891486 168221453 0.98
tpcds_q73/duckdb:parquet 18645434 19054971 0.98
tpcds_q74/duckdb:parquet 128793349 127375204 1.01
tpcds_q75/duckdb:parquet 52095154 55916556 0.93
tpcds_q76/duckdb:parquet 20126229 19828779 1.02
tpcds_q77/duckdb:parquet 21391508 21862735 0.98
tpcds_q78/duckdb:parquet 74419033 77583555 0.96
tpcds_q79/duckdb:parquet 26608965 27708069 0.96
tpcds_q80/duckdb:parquet 41198931 42776877 0.96
tpcds_q81/duckdb:parquet 30783405 33545945 0.92
tpcds_q82/duckdb:parquet 13474026 14308625 0.94
tpcds_q83/duckdb:parquet 16605444 16903289 0.98
tpcds_q84/duckdb:parquet 19357160 19645666 0.99
tpcds_q85/duckdb:parquet 41354423 39240084 1.05
tpcds_q86/duckdb:parquet 12139043 12897368 0.94
tpcds_q87/duckdb:parquet 35776255 39170210 0.91
tpcds_q88/duckdb:parquet 49073434 49409277 0.99
tpcds_q89/duckdb:parquet 16753298 16259629 1.03
tpcds_q90/duckdb:parquet 7976251 7864763 1.01
tpcds_q91/duckdb:parquet 22981616 23504526 0.98
tpcds_q92/duckdb:parquet 11435759 12320102 0.93
tpcds_q93/duckdb:parquet 29084354 31987764 0.91
tpcds_q94/duckdb:parquet 15867168 16806582 0.94
tpcds_q95/duckdb:parquet 🚨 143044906 126287971 1.13
tpcds_q96/duckdb:parquet 🚀 8580774 10115460 0.85
tpcds_q97/duckdb:parquet 🚀 34430360 38664427 0.89
tpcds_q98/duckdb:parquet 17808964 18390266 0.97
tpcds_q99/duckdb:parquet 19457049 20215380 0.96
duckdb / duckdb (0.974x ➖, 6↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20671748 20477534 1.01
tpcds_q02/duckdb:duckdb 19609626 19399931 1.01
tpcds_q03/duckdb:duckdb 9522626 9006735 1.06
tpcds_q04/duckdb:duckdb 171682981 179954261 0.95
tpcds_q05/duckdb:duckdb 19342789 20893284 0.93
tpcds_q06/duckdb:duckdb 22935016 24085273 0.95
tpcds_q07/duckdb:duckdb 40705747 41122178 0.99
tpcds_q08/duckdb:duckdb 121118092 121310407 1.00
tpcds_q09/duckdb:duckdb 20404941 21106827 0.97
tpcds_q10/duckdb:duckdb 25466796 25226695 1.01
tpcds_q11/duckdb:duckdb 93687758 98719416 0.95
tpcds_q12/duckdb:duckdb 11135603 12359796 0.90
tpcds_q13/duckdb:duckdb 23926055 26395748 0.91
tpcds_q14/duckdb:duckdb 93801331 95384615 0.98
tpcds_q15/duckdb:duckdb 25226457 26170886 0.96
tpcds_q16/duckdb:duckdb 🚀 18955852 21070412 0.90
tpcds_q17/duckdb:duckdb 23198839 23589519 0.98
tpcds_q18/duckdb:duckdb 46911338 46939841 1.00
tpcds_q19/duckdb:duckdb 18333816 17465637 1.05
tpcds_q20/duckdb:duckdb 12771101 13133184 0.97
tpcds_q21/duckdb:duckdb 7243001 7493086 0.97
tpcds_q22/duckdb:duckdb 63340470 68871694 0.92
tpcds_q23/duckdb:duckdb 🚀 70527879 79911707 0.88
tpcds_q24/duckdb:duckdb 25365749 26079742 0.97
tpcds_q25/duckdb:duckdb 18356594 18751372 0.98
tpcds_q26/duckdb:duckdb 26275265 26632331 0.99
tpcds_q27/duckdb:duckdb 38941169 41816710 0.93
tpcds_q28/duckdb:duckdb 22110902 22662547 0.98
tpcds_q29/duckdb:duckdb 22453727 22245687 1.01
tpcds_q30/duckdb:duckdb 28972494 30294236 0.96
tpcds_q31/duckdb:duckdb 49492640 51606736 0.96
tpcds_q32/duckdb:duckdb 8023588 7603697 1.06
tpcds_q33/duckdb:duckdb 13754538 14143160 0.97
tpcds_q34/duckdb:duckdb 14916644 16534732 0.90
tpcds_q35/duckdb:duckdb 35179484 35582507 0.99
tpcds_q36/duckdb:duckdb 70931023 74552482 0.95
tpcds_q37/duckdb:duckdb 8187752 8017449 1.02
tpcds_q38/duckdb:duckdb 30937619 31044293 1.00
tpcds_q39/duckdb:duckdb 25781110 27340693 0.94
tpcds_q40/duckdb:duckdb 13768491 14733372 0.93
tpcds_q41/duckdb:duckdb 8715793 9360185 0.93
tpcds_q42/duckdb:duckdb 6674414 6935365 0.96
tpcds_q43/duckdb:duckdb 11909406 12026274 0.99
tpcds_q44/duckdb:duckdb 13559412 14809129 0.92
tpcds_q45/duckdb:duckdb 17939100 18064932 0.99
tpcds_q46/duckdb:duckdb 🚀 38030104 42310350 0.90
tpcds_q47/duckdb:duckdb 🚀 40317472 45386007 0.89
tpcds_q48/duckdb:duckdb 23528800 24410818 0.96
tpcds_q49/duckdb:duckdb 17021997 17949428 0.95
tpcds_q50/duckdb:duckdb 14701981 15955764 0.92
tpcds_q51/duckdb:duckdb 93978235 94091549 1.00
tpcds_q52/duckdb:duckdb 7620085 7612487 1.00
tpcds_q53/duckdb:duckdb 13789961 13825620 1.00
tpcds_q54/duckdb:duckdb 18176977 17878458 1.02
tpcds_q55/duckdb:duckdb 7810146 7759049 1.01
tpcds_q56/duckdb:duckdb 🚀 13595211 15161847 0.90
tpcds_q57/duckdb:duckdb 33582374 33493221 1.00
tpcds_q58/duckdb:duckdb 13350367 12832210 1.04
tpcds_q59/duckdb:duckdb 36048179 37603227 0.96
tpcds_q60/duckdb:duckdb 14946058 16459392 0.91
tpcds_q61/duckdb:duckdb 15310790 15243727 1.00
tpcds_q62/duckdb:duckdb 10267856 10137054 1.01
tpcds_q63/duckdb:duckdb 12642746 12676245 1.00
tpcds_q64/duckdb:duckdb 54592157 58494621 0.93
tpcds_q65/duckdb:duckdb 35737072 36486274 0.98
tpcds_q66/duckdb:duckdb 26605834 25976981 1.02
tpcds_q67/duckdb:duckdb 135773384 134003880 1.01
tpcds_q68/duckdb:duckdb 25637369 26037024 0.98
tpcds_q69/duckdb:duckdb 24976144 26501410 0.94
tpcds_q70/duckdb:duckdb 15848414 15233840 1.04
tpcds_q71/duckdb:duckdb 13388705 12987891 1.03
tpcds_q72/duckdb:duckdb 42698247 44997809 0.95
tpcds_q73/duckdb:duckdb 11467415 11044601 1.04
tpcds_q74/duckdb:duckdb 145339827 147891534 0.98
tpcds_q75/duckdb:duckdb 43966030 42727704 1.03
tpcds_q76/duckdb:duckdb 12955663 12732185 1.02
tpcds_q77/duckdb:duckdb 12597670 13446412 0.94
tpcds_q78/duckdb:duckdb 63077492 65317440 0.97
tpcds_q79/duckdb:duckdb 19427387 19995908 0.97
tpcds_q80/duckdb:duckdb 🚀 27217098 32432228 0.84
tpcds_q81/duckdb:duckdb 39787715 41446918 0.96
tpcds_q82/duckdb:duckdb 9143887 9600681 0.95
tpcds_q83/duckdb:duckdb 9844200 10713020 0.92
tpcds_q84/duckdb:duckdb 15813777 14907521 1.06
tpcds_q85/duckdb:duckdb 26357782 25924363 1.02
tpcds_q86/duckdb:duckdb 11411372 12084673 0.94
tpcds_q87/duckdb:duckdb 34464669 33001533 1.04
tpcds_q88/duckdb:duckdb 26706676 26756456 1.00
tpcds_q89/duckdb:duckdb 14798420 15233318 0.97
tpcds_q90/duckdb:duckdb 6007663 6096810 0.99
tpcds_q91/duckdb:duckdb 14104958 13320186 1.06
tpcds_q92/duckdb:duckdb 9124206 9137955 1.00
tpcds_q93/duckdb:duckdb 23220407 22823275 1.02
tpcds_q94/duckdb:duckdb 13178062 14161209 0.93
tpcds_q95/duckdb:duckdb 110854030 113697791 0.97
tpcds_q96/duckdb:duckdb 4910808 4805627 1.02
tpcds_q97/duckdb:duckdb 29901487 30945160 0.97
tpcds_q98/duckdb:duckdb 13990338 14190994 0.99
tpcds_q99/duckdb:duckdb 17418585 17810039 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +0.4% -4.4% +5.0% +20.0% ➖ noise
1 datafusion:vortex-file-compressed -1.5% -4.4% +3.0% +19.5% ➖ noise
1 duckdb:duckdb +0.9% -4.4% +5.6% +23.2% ➖ noise
1 duckdb:vortex-compact -3.3% -4.4% +1.1% +22.7% ➖ noise
1 duckdb:vortex-file-compressed -0.1% -4.4% +4.5% +33.7% ➖ noise
2 datafusion:vortex-compact -3.8% +1.1% -4.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.8% +1.1% -0.4% +13.5% ➖ noise
2 duckdb:duckdb +1.1% +1.1% -0.1% +10.6% ➖ noise
2 duckdb:vortex-compact +1.6% +1.1% +0.5% +18.8% ➖ noise
2 duckdb:vortex-file-compressed +5.3% +1.1% +4.1% +29.4% ➖ noise
3 datafusion:vortex-compact +0.3% -5.2% +5.8% +17.8% ➖ noise
3 datafusion:vortex-file-compressed +2.9% -5.2% +8.5% +12.4% ➖ noise
3 duckdb:duckdb +5.7% -5.2% +11.5% +17.2% ➖ noise
3 duckdb:vortex-compact +0.1% -5.2% +5.6% +10.7% ➖ noise
3 duckdb:vortex-file-compressed -2.8% -5.2% +2.5% +13.4% ➖ noise
4 datafusion:vortex-compact -5.8% -2.6% -3.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.1% -2.6% +0.5% +10.0% ➖ noise
4 duckdb:duckdb -4.6% -2.6% -2.1% +10.0% ➖ noise
4 duckdb:vortex-compact +0.8% -2.6% +3.5% +11.4% ➖ noise
4 duckdb:vortex-file-compressed +0.6% -2.6% +3.2% +15.5% ➖ noise
5 datafusion:vortex-compact -1.1% +2.9% -3.9% +15.0% ➖ noise
5 datafusion:vortex-file-compressed -4.7% +2.9% -7.4% +11.4% ➖ noise
5 duckdb:duckdb -7.4% +2.9% -10.0% +15.6% ➖ noise
5 duckdb:vortex-compact -9.5% +2.9% -12.1% +14.3% ➖ noise
5 duckdb:vortex-file-compressed +2.7% +2.9% -0.2% +13.2% ➖ noise
6 datafusion:vortex-compact -6.6% -1.4% -5.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.0% -1.4% -1.6% +15.2% ➖ noise
6 duckdb:duckdb -4.8% -1.4% -3.5% +12.6% ➖ noise
6 duckdb:vortex-compact -4.6% -1.4% -3.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -4.8% -1.4% -3.4% +10.0% ➖ noise
7 datafusion:vortex-compact -10.4% -3.1% -7.6% +11.0% ➖ noise
7 datafusion:vortex-file-compressed +3.5% -3.1% +6.8% +10.0% ➖ noise
7 duckdb:duckdb -1.0% -3.1% +2.1% +18.2% ➖ noise
7 duckdb:vortex-compact -0.7% -3.1% +2.5% +17.2% ➖ noise
7 duckdb:vortex-file-compressed -8.5% -3.1% -5.6% +29.5% ➖ noise
8 datafusion:vortex-compact -0.2% -0.5% +0.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -2.6% -0.5% -2.1% +10.0% ➖ noise
8 duckdb:duckdb -0.2% -0.5% +0.3% +10.0% ➖ noise
8 duckdb:vortex-compact -6.1% -0.5% -5.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.8% -0.5% -3.4% +10.0% ➖ noise
9 datafusion:vortex-compact -3.1% -2.2% -0.9% +10.4% ➖ noise
9 datafusion:vortex-file-compressed -0.2% -2.2% +2.0% +10.0% ➖ noise
9 duckdb:duckdb -3.3% -2.2% -1.2% +10.0% ➖ noise
9 duckdb:vortex-compact -5.4% -2.2% -3.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -6.7% -2.2% -4.7% +10.0% ➖ noise
10 datafusion:vortex-compact -4.9% -3.3% -1.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.3% -3.3% +1.0% +10.0% ➖ noise
10 duckdb:duckdb +1.0% -3.3% +4.4% +10.0% ➖ noise
10 duckdb:vortex-compact -5.5% -3.3% -2.4% +13.0% ➖ noise
10 duckdb:vortex-file-compressed -5.8% -3.3% -2.6% +10.0% ➖ noise
11 datafusion:vortex-compact -5.6% -7.4% +1.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.5% -7.4% +7.5% +10.0% ➖ noise
11 duckdb:duckdb -5.1% -7.4% +2.5% +10.0% ➖ noise
11 duckdb:vortex-compact -7.5% -7.4% -0.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -6.4% -7.4% +1.0% +14.7% ➖ noise
12 datafusion:vortex-compact -10.8% +3.3% -13.7% +11.5% ✅ faster
12 datafusion:vortex-file-compressed -2.6% +3.3% -5.7% +10.5% ➖ noise
12 duckdb:duckdb -9.9% +3.3% -12.8% +12.9% ✅ faster
12 duckdb:vortex-compact -9.3% +3.3% -12.2% +12.5% ✅ faster
12 duckdb:vortex-file-compressed +0.3% +3.3% -3.0% +10.0% ➖ noise
13 datafusion:vortex-compact -2.3% -2.7% +0.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.8% -2.7% -0.1% +10.9% ➖ noise
13 duckdb:duckdb -9.4% -2.7% -6.9% +10.0% ➖ noise
13 duckdb:vortex-compact -5.0% -2.7% -2.3% +10.3% ➖ noise
13 duckdb:vortex-file-compressed -6.3% -2.7% -3.8% +10.0% ➖ noise
14 datafusion:vortex-compact -2.2% -1.0% -1.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.4% -1.0% -0.5% +10.0% ➖ noise
14 duckdb:duckdb -1.7% -1.0% -0.7% +10.0% ➖ noise
14 duckdb:vortex-compact -0.5% -1.0% +0.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.5% -1.0% +0.4% +10.0% ➖ noise
15 datafusion:vortex-compact -3.4% -2.7% -0.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.9% -2.7% +1.8% +10.0% ➖ noise
15 duckdb:duckdb -3.6% -2.7% -1.0% +14.4% ➖ noise
15 duckdb:vortex-compact -1.4% -2.7% +1.3% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -4.6% -2.7% -2.0% +10.0% ➖ noise
16 datafusion:vortex-compact +1.1% -5.4% +6.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -3.9% -5.4% +1.6% +10.0% ➖ noise
16 duckdb:duckdb -10.0% -5.4% -4.9% +10.2% ➖ noise
16 duckdb:vortex-compact +1.7% -5.4% +7.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -7.9% -5.4% -2.7% +11.8% ➖ noise
17 datafusion:vortex-compact +1.4% +1.0% +0.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.0% +1.0% -1.9% +10.0% ➖ noise
17 duckdb:duckdb -1.7% +1.0% -2.6% +10.0% ➖ noise
17 duckdb:vortex-compact -2.1% +1.0% -3.0% +11.6% ➖ noise
17 duckdb:vortex-file-compressed -6.5% +1.0% -7.4% +13.7% ➖ noise
18 datafusion:vortex-compact -6.3% -0.4% -5.9% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -1.3% -0.4% -0.9% +13.7% ➖ noise
18 duckdb:duckdb -0.1% -0.4% +0.3% +11.5% ➖ noise
18 duckdb:vortex-compact -1.6% -0.4% -1.2% +10.6% ➖ noise
18 duckdb:vortex-file-compressed -4.4% -0.4% -4.0% +10.2% ➖ noise
19 datafusion:vortex-compact -6.5% -1.9% -4.6% +11.2% ➖ noise
19 datafusion:vortex-file-compressed +0.4% -1.9% +2.3% +10.0% ➖ noise
19 duckdb:duckdb +5.0% -1.9% +7.0% +10.0% ➖ noise
19 duckdb:vortex-compact -4.1% -1.9% -2.2% +13.9% ➖ noise
19 duckdb:vortex-file-compressed -2.8% -1.9% -0.9% +15.6% ➖ noise
20 datafusion:vortex-compact -10.4% -0.8% -9.6% +10.0% ✅ faster
20 datafusion:vortex-file-compressed -4.4% -0.8% -3.7% +10.0% ➖ noise
20 duckdb:duckdb -2.8% -0.8% -2.0% +22.3% ➖ noise
20 duckdb:vortex-compact -3.7% -0.8% -2.9% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -5.9% -0.8% -5.1% +10.0% ➖ noise
21 datafusion:vortex-compact -4.7% -1.8% -3.0% +11.0% ➖ noise
21 datafusion:vortex-file-compressed -5.8% -1.8% -4.0% +12.5% ➖ noise
21 duckdb:duckdb -3.3% -1.8% -1.5% +19.9% ➖ noise
21 duckdb:vortex-compact +3.0% -1.8% +5.0% +16.5% ➖ noise
21 duckdb:vortex-file-compressed -5.2% -1.8% -3.4% +16.1% ➖ noise
22 datafusion:vortex-compact +0.1% -10.6% +11.9% +18.0% ➖ noise
22 datafusion:vortex-file-compressed -0.1% -10.6% +11.7% +13.5% ➖ noise
22 duckdb:duckdb -8.0% -10.6% +2.8% +13.2% ➖ noise
22 duckdb:vortex-compact -10.6% -10.6% -0.0% +13.6% ➖ noise
22 duckdb:vortex-file-compressed -24.8% -10.6% -15.9% +13.2% ✅ faster
23 datafusion:vortex-compact -5.6% -4.3% -1.4% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -5.1% -4.3% -0.9% +10.0% ➖ noise
23 duckdb:duckdb -11.7% -4.3% -7.8% +10.0% ➖ noise
23 duckdb:vortex-compact -3.2% -4.3% +1.2% +11.6% ➖ noise
23 duckdb:vortex-file-compressed -10.5% -4.3% -6.5% +10.0% ➖ noise
24 datafusion:vortex-compact -3.1% -3.5% +0.4% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -0.8% -3.5% +2.8% +10.0% ➖ noise
24 duckdb:duckdb -2.7% -3.5% +0.8% +12.2% ➖ noise
24 duckdb:vortex-compact -5.3% -3.5% -1.9% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -5.2% -3.5% -1.7% +14.0% ➖ noise
25 datafusion:vortex-compact -7.7% -5.5% -2.4% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -5.9% -5.5% -0.5% +10.0% ➖ noise
25 duckdb:duckdb -2.1% -5.5% +3.5% +10.2% ➖ noise
25 duckdb:vortex-compact +1.4% -5.5% +7.2% +12.6% ➖ noise
25 duckdb:vortex-file-compressed -2.2% -5.5% +3.4% +15.2% ➖ noise
26 datafusion:vortex-compact +2.0% -4.1% +6.4% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -1.3% -4.1% +2.9% +10.0% ➖ noise
26 duckdb:duckdb -1.3% -4.1% +2.9% +13.1% ➖ noise
26 duckdb:vortex-compact -1.8% -4.1% +2.4% +11.6% ➖ noise
26 duckdb:vortex-file-compressed +0.3% -4.1% +4.6% +10.0% ➖ noise
27 datafusion:vortex-compact -4.1% -6.3% +2.3% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -6.0% -6.3% +0.3% +13.9% ➖ noise
27 duckdb:duckdb -6.9% -6.3% -0.6% +16.1% ➖ noise
27 duckdb:vortex-compact -4.2% -6.3% +2.3% +10.8% ➖ noise
27 duckdb:vortex-file-compressed -4.1% -6.3% +2.4% +12.1% ➖ noise
28 datafusion:vortex-compact -1.0% -6.7% +6.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -8.5% -6.7% -1.9% +11.8% ➖ noise
28 duckdb:duckdb -2.4% -6.7% +4.6% +10.0% ➖ noise
28 duckdb:vortex-compact -5.1% -6.7% +1.7% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -5.8% -6.7% +0.9% +10.0% ➖ noise
29 datafusion:vortex-compact -5.1% -3.4% -1.8% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +1.0% -3.4% +4.5% +10.0% ➖ noise
29 duckdb:duckdb +0.9% -3.4% +4.4% +10.0% ➖ noise
29 duckdb:vortex-compact -1.6% -3.4% +1.8% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +4.8% -3.4% +8.5% +13.5% ➖ noise
30 datafusion:vortex-compact -4.5% -1.7% -2.8% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -6.5% -1.7% -4.8% +10.0% ➖ noise
30 duckdb:duckdb -4.4% -1.7% -2.7% +10.0% ➖ noise
30 duckdb:vortex-compact -13.9% -1.7% -12.3% +10.9% ✅ faster
30 duckdb:vortex-file-compressed -7.5% -1.7% -5.8% +15.4% ➖ noise
31 datafusion:vortex-compact +1.6% -1.5% +3.2% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -4.6% -1.5% -3.1% +10.0% ➖ noise
31 duckdb:duckdb -4.1% -1.5% -2.6% +10.0% ➖ noise
31 duckdb:vortex-compact -0.5% -1.5% +1.1% +12.6% ➖ noise
31 duckdb:vortex-file-compressed -4.1% -1.5% -2.6% +10.0% ➖ noise
32 datafusion:vortex-compact -1.0% -3.7% +2.8% +15.3% ➖ noise
32 datafusion:vortex-file-compressed +5.7% -3.7% +9.8% +15.5% ➖ noise
32 duckdb:duckdb +5.5% -3.7% +9.6% +13.3% ➖ noise
32 duckdb:vortex-compact -3.0% -3.7% +0.7% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -4.4% -3.7% -0.7% +10.4% ➖ noise
33 datafusion:vortex-compact -2.1% -2.2% +0.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -1.1% -2.2% +1.2% +11.2% ➖ noise
33 duckdb:duckdb -2.7% -2.2% -0.5% +11.6% ➖ noise
33 duckdb:vortex-compact -3.4% -2.2% -1.2% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +3.9% -2.2% +6.2% +16.7% ➖ noise
34 datafusion:vortex-compact +1.3% -3.5% +5.0% +11.6% ➖ noise
34 datafusion:vortex-file-compressed +1.2% -3.5% +4.8% +10.0% ➖ noise
34 duckdb:duckdb -9.8% -3.5% -6.6% +10.4% ➖ noise
34 duckdb:vortex-compact -3.0% -3.5% +0.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -3.7% -3.5% -0.2% +10.1% ➖ noise
35 datafusion:vortex-compact -0.1% -1.9% +1.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -3.9% -1.9% -2.0% +10.0% ➖ noise
35 duckdb:duckdb -1.1% -1.9% +0.8% +18.5% ➖ noise
35 duckdb:vortex-compact -2.7% -1.9% -0.9% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.8% -1.9% +2.8% +10.2% ➖ noise
36 datafusion:vortex-compact -3.4% -1.2% -2.2% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -5.3% -1.2% -4.1% +10.0% ➖ noise
36 duckdb:duckdb -4.9% -1.2% -3.7% +10.0% ➖ noise
36 duckdb:vortex-compact -7.4% -1.2% -6.3% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -3.0% -1.2% -1.8% +10.0% ➖ noise
37 datafusion:vortex-compact +5.1% +1.4% +3.7% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -12.1% +1.4% -13.3% +10.0% ✅ faster
37 duckdb:duckdb +2.1% +1.4% +0.7% +13.3% ➖ noise
37 duckdb:vortex-compact -7.7% +1.4% -8.9% +11.6% ➖ noise
37 duckdb:vortex-file-compressed +0.1% +1.4% -1.3% +19.2% ➖ noise
38 datafusion:vortex-compact +1.5% -5.4% +7.3% +12.0% ➖ noise
38 datafusion:vortex-file-compressed -5.7% -5.4% -0.4% +10.3% ➖ noise
38 duckdb:duckdb -0.3% -5.4% +5.3% +17.7% ➖ noise
38 duckdb:vortex-compact -4.8% -5.4% +0.6% +11.8% ➖ noise
38 duckdb:vortex-file-compressed -4.1% -5.4% +1.3% +16.8% ➖ noise
39 datafusion:vortex-compact -7.5% -6.9% -0.7% +17.7% ➖ noise
39 datafusion:vortex-file-compressed -8.1% -6.9% -1.3% +14.5% ➖ noise
39 duckdb:duckdb -5.7% -6.9% +1.3% +22.9% ➖ noise
39 duckdb:vortex-compact -10.0% -6.9% -3.3% +16.3% ➖ noise
39 duckdb:vortex-file-compressed -1.6% -6.9% +5.7% +10.0% ➖ noise
40 datafusion:vortex-compact +1.0% -3.2% +4.4% +13.0% ➖ noise
40 datafusion:vortex-file-compressed -3.7% -3.2% -0.5% +10.0% ➖ noise
40 duckdb:duckdb -6.5% -3.2% -3.4% +14.7% ➖ noise
40 duckdb:vortex-compact -6.5% -3.2% -3.3% +12.2% ➖ noise
40 duckdb:vortex-file-compressed -1.3% -3.2% +2.0% +17.9% ➖ noise
41 datafusion:vortex-compact -4.3% -6.6% +2.4% +10.3% ➖ noise
41 datafusion:vortex-file-compressed -5.8% -6.6% +0.9% +10.0% ➖ noise
41 duckdb:duckdb -6.9% -6.6% -0.3% +11.4% ➖ noise
41 duckdb:vortex-compact -0.6% -6.6% +6.4% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -3.4% -6.6% +3.4% +11.3% ➖ noise
42 datafusion:vortex-compact -5.5% -2.2% -3.4% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -5.9% -2.2% -3.8% +10.8% ➖ noise
42 duckdb:duckdb -3.8% -2.2% -1.6% +14.6% ➖ noise
42 duckdb:vortex-compact -0.3% -2.2% +1.9% +13.7% ➖ noise
42 duckdb:vortex-file-compressed +3.3% -2.2% +5.6% +14.6% ➖ noise
43 datafusion:vortex-compact -6.8% -0.7% -6.2% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -4.0% -0.7% -3.3% +10.0% ➖ noise
43 duckdb:duckdb -1.0% -0.7% -0.3% +10.0% ➖ noise
43 duckdb:vortex-compact +0.4% -0.7% +1.1% +12.3% ➖ noise
43 duckdb:vortex-file-compressed -4.6% -0.7% -3.9% +11.3% ➖ noise
44 datafusion:vortex-compact -1.4% -0.9% -0.6% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -5.6% -0.9% -4.7% +10.0% ➖ noise
44 duckdb:duckdb -8.4% -0.9% -7.6% +12.3% ➖ noise
44 duckdb:vortex-compact -4.4% -0.9% -3.6% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -9.8% -0.9% -9.0% +17.4% ➖ noise
45 datafusion:vortex-compact -14.7% -5.7% -9.6% +11.7% ➖ noise
45 datafusion:vortex-file-compressed +1.0% -5.7% +7.1% +13.3% ➖ noise
45 duckdb:duckdb -0.7% -5.7% +5.3% +10.0% ➖ noise
45 duckdb:vortex-compact -5.0% -5.7% +0.7% +13.3% ➖ noise
45 duckdb:vortex-file-compressed -1.3% -5.7% +4.6% +10.6% ➖ noise
46 datafusion:vortex-compact -3.2% -5.5% +2.5% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +3.1% -5.5% +9.1% +10.0% ➖ noise
46 duckdb:duckdb -10.1% -5.5% -4.8% +11.8% ➖ noise
46 duckdb:vortex-compact -2.1% -5.5% +3.7% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -4.1% -5.5% +1.6% +10.0% ➖ noise
47 datafusion:vortex-compact -8.3% -3.2% -5.3% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -2.7% -3.2% +0.6% +10.0% ➖ noise
47 duckdb:duckdb -11.2% -3.2% -8.2% +12.0% ➖ noise
47 duckdb:vortex-compact -5.4% -3.2% -2.3% +12.9% ➖ noise
47 duckdb:vortex-file-compressed -5.7% -3.2% -2.6% +10.0% ➖ noise
48 datafusion:vortex-compact -2.8% -3.2% +0.3% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -0.2% -3.2% +3.1% +10.0% ➖ noise
48 duckdb:duckdb -3.6% -3.2% -0.5% +10.0% ➖ noise
48 duckdb:vortex-compact -8.2% -3.2% -5.2% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -7.5% -3.2% -4.5% +10.0% ➖ noise
49 datafusion:vortex-compact -4.7% -2.6% -2.1% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -1.7% -2.6% +1.0% +10.0% ➖ noise
49 duckdb:duckdb -5.2% -2.6% -2.6% +11.4% ➖ noise
49 duckdb:vortex-compact -11.7% -2.6% -9.3% +10.0% ✅ faster
49 duckdb:vortex-file-compressed -10.2% -2.6% -7.8% +18.7% ➖ noise
50 datafusion:vortex-compact -8.3% -3.3% -5.2% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +1.9% -3.3% +5.4% +11.7% ➖ noise
50 duckdb:duckdb -7.9% -3.3% -4.7% +10.0% ➖ noise
50 duckdb:vortex-compact -4.7% -3.3% -1.5% +10.9% ➖ noise
50 duckdb:vortex-file-compressed -1.7% -3.3% +1.6% +13.2% ➖ noise
51 datafusion:vortex-compact -2.1% -3.5% +1.5% +12.0% ➖ noise
51 datafusion:vortex-file-compressed +1.1% -3.5% +4.8% +11.4% ➖ noise
51 duckdb:duckdb -0.1% -3.5% +3.5% +21.7% ➖ noise
51 duckdb:vortex-compact -3.4% -3.5% +0.1% +18.0% ➖ noise
51 duckdb:vortex-file-compressed -2.7% -3.5% +0.8% +19.3% ➖ noise
52 datafusion:vortex-compact -5.9% -9.7% +4.2% +10.0% ➖ noise
52 datafusion:vortex-file-compressed -6.9% -9.7% +3.1% +12.0% ➖ noise
52 duckdb:duckdb +0.1% -9.7% +10.8% +13.3% ➖ noise
52 duckdb:vortex-compact +3.3% -9.7% +14.4% +22.1% ➖ noise
52 duckdb:vortex-file-compressed +8.5% -9.7% +20.1% +11.4% 🚨 regression
53 datafusion:vortex-compact -4.4% -4.0% -0.4% +10.0% ➖ noise
53 datafusion:vortex-file-compressed -1.0% -4.0% +3.1% +11.7% ➖ noise
53 duckdb:duckdb -0.3% -4.0% +3.9% +11.2% ➖ noise
53 duckdb:vortex-compact +1.0% -4.0% +5.2% +15.2% ➖ noise
53 duckdb:vortex-file-compressed -6.2% -4.0% -2.3% +12.4% ➖ noise
54 datafusion:vortex-compact -6.8% +0.3% -7.1% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -1.3% +0.3% -1.6% +10.0% ➖ noise
54 duckdb:duckdb +1.7% +0.3% +1.3% +12.0% ➖ noise
54 duckdb:vortex-compact -1.3% +0.3% -1.6% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -3.4% +0.3% -3.7% +10.0% ➖ noise
55 datafusion:vortex-compact -4.7% -1.3% -3.5% +12.0% ➖ noise
55 datafusion:vortex-file-compressed -1.3% -1.3% -0.0% +12.8% ➖ noise
55 duckdb:duckdb +0.7% -1.3% +2.0% +17.2% ➖ noise
55 duckdb:vortex-compact -0.6% -1.3% +0.7% +12.6% ➖ noise
55 duckdb:vortex-file-compressed -9.3% -1.3% -8.2% +13.1% ➖ noise
56 datafusion:vortex-compact -3.3% -2.7% -0.7% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -6.0% -2.7% -3.4% +10.8% ➖ noise
56 duckdb:duckdb -10.3% -2.7% -7.9% +10.0% ➖ noise
56 duckdb:vortex-compact +1.4% -2.7% +4.2% +12.4% ➖ noise
56 duckdb:vortex-file-compressed -5.1% -2.7% -2.5% +10.0% ➖ noise
57 datafusion:vortex-compact -2.6% -3.0% +0.4% +13.2% ➖ noise
57 datafusion:vortex-file-compressed -1.2% -3.0% +1.8% +13.8% ➖ noise
57 duckdb:duckdb +0.3% -3.0% +3.4% +21.4% ➖ noise
57 duckdb:vortex-compact -1.2% -3.0% +1.9% +16.8% ➖ noise
57 duckdb:vortex-file-compressed -2.6% -3.0% +0.4% +19.5% ➖ noise
58 datafusion:vortex-compact -2.3% -3.5% +1.3% +10.3% ➖ noise
58 datafusion:vortex-file-compressed +5.1% -3.5% +9.0% +10.0% ➖ noise
58 duckdb:duckdb +4.0% -3.5% +7.9% +12.9% ➖ noise
58 duckdb:vortex-compact -13.0% -3.5% -9.8% +10.8% ✅ faster
58 duckdb:vortex-file-compressed -2.0% -3.5% +1.6% +18.1% ➖ noise
59 datafusion:vortex-compact -4.9% -1.9% -3.0% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -3.8% -1.9% -2.0% +10.0% ➖ noise
59 duckdb:duckdb -4.1% -1.9% -2.3% +10.0% ➖ noise
59 duckdb:vortex-compact -1.9% -1.9% +0.0% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +1.0% -1.9% +3.0% +18.2% ➖ noise
60 datafusion:vortex-compact -3.2% -6.1% +3.1% +13.2% ➖ noise
60 datafusion:vortex-file-compressed -4.0% -6.1% +2.2% +10.0% ➖ noise
60 duckdb:duckdb -9.2% -6.1% -3.3% +10.7% ➖ noise
60 duckdb:vortex-compact -8.8% -6.1% -2.9% +11.2% ➖ noise
60 duckdb:vortex-file-compressed +1.9% -6.1% +8.5% +22.9% ➖ noise
61 datafusion:vortex-compact -6.0% -4.3% -1.8% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -1.6% -4.3% +2.8% +10.0% ➖ noise
61 duckdb:duckdb +0.4% -4.3% +4.9% +10.0% ➖ noise
61 duckdb:vortex-compact -2.9% -4.3% +1.4% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -5.5% -4.3% -1.3% +19.1% ➖ noise
62 datafusion:vortex-compact -7.1% +1.1% -8.1% +15.4% ➖ noise
62 datafusion:vortex-file-compressed -2.8% +1.1% -3.8% +13.7% ➖ noise
62 duckdb:duckdb +1.3% +1.1% +0.2% +19.5% ➖ noise
62 duckdb:vortex-compact -9.2% +1.1% -10.2% +21.5% ➖ noise
62 duckdb:vortex-file-compressed -9.4% +1.1% -10.3% +14.9% ➖ noise
63 datafusion:vortex-compact -4.5% -0.5% -4.1% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +0.8% -0.5% +1.3% +10.0% ➖ noise
63 duckdb:duckdb -0.3% -0.5% +0.2% +10.1% ➖ noise
63 duckdb:vortex-compact -4.7% -0.5% -4.2% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -2.1% -0.5% -1.6% +10.0% ➖ noise
64 datafusion:vortex-compact -3.3% -0.8% -2.5% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -3.5% -0.8% -2.7% +10.0% ➖ noise
64 duckdb:duckdb -6.7% -0.8% -5.9% +10.0% ➖ noise
64 duckdb:vortex-compact -5.4% -0.8% -4.6% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -4.5% -0.8% -3.7% +11.9% ➖ noise
65 datafusion:vortex-compact +4.3% -6.4% +11.4% +13.0% ➖ noise
65 datafusion:vortex-file-compressed -0.4% -6.4% +6.4% +10.0% ➖ noise
65 duckdb:duckdb -2.1% -6.4% +4.6% +13.9% ➖ noise
65 duckdb:vortex-compact -3.0% -6.4% +3.6% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -6.7% -6.4% -0.3% +10.0% ➖ noise
66 datafusion:vortex-compact +4.4% -5.2% +10.1% +10.9% ➖ noise
66 datafusion:vortex-file-compressed +0.0% -5.2% +5.5% +11.5% ➖ noise
66 duckdb:duckdb +2.4% -5.2% +8.0% +12.6% ➖ noise
66 duckdb:vortex-compact -7.9% -5.2% -2.9% +10.4% ➖ noise
66 duckdb:vortex-file-compressed +0.8% -5.2% +6.3% +10.0% ➖ noise
67 datafusion:vortex-compact -3.3% +0.1% -3.5% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -9.6% +0.1% -9.7% +10.0% ✅ faster
67 duckdb:duckdb +1.3% +0.1% +1.2% +10.0% ➖ noise
67 duckdb:vortex-compact -1.0% +0.1% -1.1% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -8.4% +0.1% -8.5% +10.0% ➖ noise
68 datafusion:vortex-compact -3.8% -1.8% -2.1% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -3.0% -1.8% -1.3% +15.3% ➖ noise
68 duckdb:duckdb -1.5% -1.8% +0.2% +10.0% ➖ noise
68 duckdb:vortex-compact +1.8% -1.8% +3.6% +11.1% ➖ noise
68 duckdb:vortex-file-compressed -3.8% -1.8% -2.1% +13.5% ➖ noise
69 datafusion:vortex-compact -3.4% -0.7% -2.8% +11.6% ➖ noise
69 datafusion:vortex-file-compressed -2.0% -0.7% -1.4% +10.0% ➖ noise
69 duckdb:duckdb -5.8% -0.7% -5.1% +10.0% ➖ noise
69 duckdb:vortex-compact -0.2% -0.7% +0.5% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -3.1% -0.7% -2.4% +10.0% ➖ noise
70 datafusion:vortex-compact +2.1% -3.0% +5.2% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -7.1% -3.0% -4.3% +11.1% ➖ noise
70 duckdb:duckdb +4.0% -3.0% +7.2% +11.9% ➖ noise
70 duckdb:vortex-compact -0.1% -3.0% +3.0% +10.8% ➖ noise
70 duckdb:vortex-file-compressed -2.8% -3.0% +0.2% +10.0% ➖ noise
71 datafusion:vortex-compact -0.1% -0.6% +0.5% +12.4% ➖ noise
71 datafusion:vortex-file-compressed -6.9% -0.6% -6.3% +10.9% ➖ noise
71 duckdb:duckdb +3.1% -0.6% +3.7% +38.3% ➖ noise
71 duckdb:vortex-compact -0.8% -0.6% -0.2% +11.0% ➖ noise
71 duckdb:vortex-file-compressed -12.4% -0.6% -11.9% +20.3% ➖ noise
72 datafusion:vortex-compact -7.8% -2.6% -5.3% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -9.4% -2.6% -7.0% +10.0% ➖ noise
72 duckdb:duckdb -5.1% -2.6% -2.6% +11.3% ➖ noise
72 duckdb:vortex-compact +0.1% -2.6% +2.8% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -2.6% -2.6% -0.0% +10.0% ➖ noise
73 datafusion:vortex-compact -0.7% -2.0% +1.3% +10.0% ➖ noise
73 datafusion:vortex-file-compressed +2.4% -2.0% +4.5% +25.4% ➖ noise
73 duckdb:duckdb +3.8% -2.0% +6.0% +12.5% ➖ noise
73 duckdb:vortex-compact +2.8% -2.0% +4.9% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +4.7% -2.0% +6.8% +15.5% ➖ noise
74 datafusion:vortex-compact -6.0% -4.7% -1.3% +12.7% ➖ noise
74 datafusion:vortex-file-compressed -1.5% -4.7% +3.4% +10.0% ➖ noise
74 duckdb:duckdb -1.7% -4.7% +3.1% +10.0% ➖ noise
74 duckdb:vortex-compact +5.7% -4.7% +10.9% +18.5% ➖ noise
74 duckdb:vortex-file-compressed -9.6% -4.7% -5.2% +21.6% ➖ noise
75 datafusion:vortex-compact -1.9% -5.0% +3.3% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -6.2% -5.0% -1.2% +10.6% ➖ noise
75 duckdb:duckdb +2.9% -5.0% +8.3% +12.8% ➖ noise
75 duckdb:vortex-compact -4.5% -5.0% +0.6% +12.3% ➖ noise
75 duckdb:vortex-file-compressed -3.9% -5.0% +1.2% +11.0% ➖ noise
76 datafusion:vortex-compact +0.2% +0.3% -0.0% +10.6% ➖ noise
76 datafusion:vortex-file-compressed -2.6% +0.3% -2.9% +10.2% ➖ noise
76 duckdb:duckdb +1.8% +0.3% +1.5% +13.7% ➖ noise
76 duckdb:vortex-compact -0.2% +0.3% -0.4% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -3.4% +0.3% -3.7% +10.0% ➖ noise
77 datafusion:vortex-compact -2.4% -4.8% +2.5% +14.5% ➖ noise
77 datafusion:vortex-file-compressed +3.8% -4.8% +9.0% +16.5% ➖ noise
77 duckdb:duckdb -6.3% -4.8% -1.6% +15.8% ➖ noise
77 duckdb:vortex-compact -5.3% -4.8% -0.6% +17.4% ➖ noise
77 duckdb:vortex-file-compressed -3.9% -4.8% +0.9% +15.3% ➖ noise
78 datafusion:vortex-compact -2.0% -5.7% +3.9% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -5.8% -5.7% -0.1% +10.1% ➖ noise
78 duckdb:duckdb -3.4% -5.7% +2.4% +10.0% ➖ noise
78 duckdb:vortex-compact -10.6% -5.7% -5.2% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -9.3% -5.7% -3.8% +10.0% ➖ noise
79 datafusion:vortex-compact -5.6% -5.6% +0.0% +12.7% ➖ noise
79 datafusion:vortex-file-compressed -2.0% -5.6% +3.8% +16.5% ➖ noise
79 duckdb:duckdb -2.8% -5.6% +2.9% +10.0% ➖ noise
79 duckdb:vortex-compact -2.5% -5.6% +3.3% +10.0% ➖ noise
79 duckdb:vortex-file-compressed +4.9% -5.6% +11.1% +13.5% ➖ noise
80 datafusion:vortex-compact -5.7% -3.7% -2.2% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -6.0% -3.7% -2.5% +10.0% ➖ noise
80 duckdb:duckdb -16.1% -3.7% -12.9% +11.9% ✅ faster
80 duckdb:vortex-compact -6.5% -3.7% -3.0% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -4.4% -3.7% -0.8% +13.7% ➖ noise
81 datafusion:vortex-compact -1.2% -1.6% +0.4% +10.0% ➖ noise
81 datafusion:vortex-file-compressed -6.1% -1.6% -4.5% +12.0% ➖ noise
81 duckdb:duckdb -4.0% -1.6% -2.4% +11.6% ➖ noise
81 duckdb:vortex-compact -0.9% -1.6% +0.7% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -6.4% -1.6% -4.9% +11.7% ➖ noise
82 datafusion:vortex-compact -5.1% -7.2% +2.2% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -11.0% -7.2% -4.1% +10.0% ➖ noise
82 duckdb:duckdb -4.8% -7.2% +2.6% +12.3% ➖ noise
82 duckdb:vortex-compact -9.1% -7.2% -2.0% +12.7% ➖ noise
82 duckdb:vortex-file-compressed -2.0% -7.2% +5.6% +30.3% ➖ noise
83 datafusion:vortex-compact -6.0% -3.6% -2.5% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +0.6% -3.6% +4.4% +10.0% ➖ noise
83 duckdb:duckdb -8.1% -3.6% -4.7% +11.4% ➖ noise
83 duckdb:vortex-compact -2.3% -3.6% +1.3% +10.0% ➖ noise
83 duckdb:vortex-file-compressed -7.7% -3.6% -4.2% +10.0% ➖ noise
84 datafusion:vortex-compact -8.3% -2.1% -6.3% +11.9% ➖ noise
84 datafusion:vortex-file-compressed -2.7% -2.1% -0.7% +10.0% ➖ noise
84 duckdb:duckdb +6.1% -2.1% +8.3% +10.0% ➖ noise
84 duckdb:vortex-compact -0.5% -2.1% +1.6% +13.9% ➖ noise
84 duckdb:vortex-file-compressed +5.7% -2.1% +7.9% +10.0% ➖ noise
85 datafusion:vortex-compact -8.7% +3.6% -11.9% +10.9% ✅ faster
85 datafusion:vortex-file-compressed -4.8% +3.6% -8.1% +10.0% ➖ noise
85 duckdb:duckdb +1.7% +3.6% -1.8% +10.0% ➖ noise
85 duckdb:vortex-compact -1.2% +3.6% -4.6% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -1.8% +3.6% -5.1% +10.0% ➖ noise
86 datafusion:vortex-compact -4.8% -3.7% -1.2% +17.8% ➖ noise
86 datafusion:vortex-file-compressed -6.5% -3.7% -2.9% +13.3% ➖ noise
86 duckdb:duckdb -5.6% -3.7% -1.9% +34.8% ➖ noise
86 duckdb:vortex-compact -5.6% -3.7% -2.0% +12.2% ➖ noise
86 duckdb:vortex-file-compressed +1.0% -3.7% +4.9% +15.5% ➖ noise
87 datafusion:vortex-compact -2.4% -6.3% +4.1% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -9.0% -6.3% -2.9% +10.0% ➖ noise
87 duckdb:duckdb +4.4% -6.3% +11.4% +11.8% ➖ noise
87 duckdb:vortex-compact -3.5% -6.3% +3.0% +14.5% ➖ noise
87 duckdb:vortex-file-compressed -2.0% -6.3% +4.5% +14.4% ➖ noise
88 datafusion:vortex-compact -1.7% -0.9% -0.9% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -0.9% -0.9% -0.1% +12.0% ➖ noise
88 duckdb:duckdb -0.2% -0.9% +0.7% +10.0% ➖ noise
88 duckdb:vortex-compact -2.1% -0.9% -1.3% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -4.9% -0.9% -4.0% +10.0% ➖ noise
89 datafusion:vortex-compact -4.5% -0.7% -3.9% +11.4% ➖ noise
89 datafusion:vortex-file-compressed -7.1% -0.7% -6.4% +10.0% ➖ noise
89 duckdb:duckdb -2.9% -0.7% -2.2% +12.7% ➖ noise
89 duckdb:vortex-compact -4.1% -0.7% -3.4% +17.4% ➖ noise
89 duckdb:vortex-file-compressed -7.2% -0.7% -6.6% +10.0% ➖ noise
90 datafusion:vortex-compact -3.3% -0.2% -3.1% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -4.1% -0.2% -3.9% +15.6% ➖ noise
90 duckdb:duckdb -1.5% -0.2% -1.2% +13.6% ➖ noise
90 duckdb:vortex-compact -2.8% -0.2% -2.5% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -9.4% -0.2% -9.2% +10.0% ✅ faster
91 datafusion:vortex-compact +0.9% -2.2% +3.2% +11.1% ➖ noise
91 datafusion:vortex-file-compressed -0.6% -2.2% +1.7% +10.5% ➖ noise
91 duckdb:duckdb +5.9% -2.2% +8.3% +10.0% ➖ noise
91 duckdb:vortex-compact -1.0% -2.2% +1.2% +13.8% ➖ noise
91 duckdb:vortex-file-compressed -0.1% -2.2% +2.2% +12.2% ➖ noise
92 datafusion:vortex-compact -0.0% -5.2% +5.4% +18.5% ➖ noise
92 datafusion:vortex-file-compressed -4.1% -5.2% +1.1% +10.6% ➖ noise
92 duckdb:duckdb -0.2% -5.2% +5.3% +14.4% ➖ noise
92 duckdb:vortex-compact -10.1% -5.2% -5.2% +23.5% ➖ noise
92 duckdb:vortex-file-compressed -0.1% -5.2% +5.3% +12.0% ➖ noise
93 datafusion:vortex-compact +1.0% -7.2% +8.8% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -7.4% -7.2% -0.2% +10.1% ➖ noise
93 duckdb:duckdb +1.7% -7.2% +9.7% +11.9% ➖ noise
93 duckdb:vortex-compact -3.1% -7.2% +4.5% +15.2% ➖ noise
93 duckdb:vortex-file-compressed -7.6% -7.2% -0.4% +14.2% ➖ noise
94 datafusion:vortex-compact -6.9% -5.9% -1.1% +12.3% ➖ noise
94 datafusion:vortex-file-compressed +5.8% -5.9% +12.3% +11.7% 🚨 regression
94 duckdb:duckdb -6.9% -5.9% -1.1% +13.2% ➖ noise
94 duckdb:vortex-compact -4.9% -5.9% +1.1% +11.5% ➖ noise
94 duckdb:vortex-file-compressed -7.1% -5.9% -1.3% +10.0% ➖ noise
95 datafusion:vortex-compact -8.5% +6.0% -13.7% +13.6% ✅ faster
95 datafusion:vortex-file-compressed -2.4% +6.0% -7.9% +13.9% ➖ noise
95 duckdb:duckdb -2.5% +6.0% -8.0% +21.6% ➖ noise
95 duckdb:vortex-compact -12.2% +6.0% -17.2% +17.2% ✅ faster
95 duckdb:vortex-file-compressed -5.0% +6.0% -10.4% +20.2% ➖ noise
96 datafusion:vortex-compact -2.2% -9.2% +7.8% +17.1% ➖ noise
96 datafusion:vortex-file-compressed +1.3% -9.2% +11.6% +10.0% 🚨 regression
96 duckdb:duckdb +2.2% -9.2% +12.6% +12.1% 🚨 regression
96 duckdb:vortex-compact -7.8% -9.2% +1.5% +11.9% ➖ noise
96 duckdb:vortex-file-compressed -3.0% -9.2% +6.8% +15.2% ➖ noise
97 datafusion:vortex-compact -5.6% -8.3% +2.9% +11.8% ➖ noise
97 datafusion:vortex-file-compressed +0.2% -8.3% +9.3% +11.5% ➖ noise
97 duckdb:duckdb -3.4% -8.3% +5.4% +15.4% ➖ noise
97 duckdb:vortex-compact -7.6% -8.3% +0.8% +13.3% ➖ noise
97 duckdb:vortex-file-compressed -4.6% -8.3% +4.0% +13.2% ➖ noise
98 datafusion:vortex-compact +1.5% -2.3% +3.9% +10.6% ➖ noise
98 datafusion:vortex-file-compressed -3.9% -2.3% -1.7% +10.0% ➖ noise
98 duckdb:duckdb -1.4% -2.3% +0.9% +13.2% ➖ noise
98 duckdb:vortex-compact -7.5% -2.3% -5.3% +13.2% ➖ noise
98 duckdb:vortex-file-compressed -4.2% -2.3% -2.0% +14.9% ➖ noise
99 datafusion:vortex-compact +1.9% -7.2% +9.8% +13.6% ➖ noise
99 datafusion:vortex-file-compressed +6.9% -7.2% +15.2% +13.1% 🚨 regression
99 duckdb:duckdb -2.2% -7.2% +5.4% +25.7% ➖ noise
99 duckdb:vortex-compact +3.4% -7.2% +11.4% +17.2% ➖ noise
99 duckdb:vortex-file-compressed -4.2% -7.2% +3.1% +13.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.9%
Vortex (geomean): 1.022x ➖
Parquet (geomean): 0.983x ➖
Shifts: Parquet (control) -1.7% · Median polish -0.5%


datafusion / vortex-file-compressed (1.020x ➖, 0↑ 1↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 65313374 33580100 1.95
fineweb_q01/datafusion:vortex-file-compressed 681749569 900378576 0.76
fineweb_q02/datafusion:vortex-file-compressed 512112275 666299973 0.77
fineweb_q03/datafusion:vortex-file-compressed 1431492496 1442101076 0.99
fineweb_q04/datafusion:vortex-file-compressed 1352088887 1370309668 0.99
fineweb_q05/datafusion:vortex-file-compressed 1353653148 1379975573 0.98
fineweb_q06/datafusion:vortex-file-compressed 1601558630 1511717888 1.06
fineweb_q07/datafusion:vortex-file-compressed 1381091953 1323245601 1.04
fineweb_q08/datafusion:vortex-file-compressed 534475328 539939385 0.99
datafusion / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 44226164 37738667 1.17
fineweb_q01/datafusion:vortex-compact 699362694 694074754 1.01
fineweb_q02/datafusion:vortex-compact 506283270 498615153 1.02
fineweb_q03/datafusion:vortex-compact 1493307581 1518349036 0.98
fineweb_q04/datafusion:vortex-compact 1793932943 1871500380 0.96
fineweb_q05/datafusion:vortex-compact 1443975956 1473724059 0.98
fineweb_q06/datafusion:vortex-compact 1327055822 1306691485 1.02
fineweb_q07/datafusion:vortex-compact 1189560768 1275876047 0.93
fineweb_q08/datafusion:vortex-compact 404856187 405252380 1.00
datafusion / parquet (0.960x ➖, 1↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 1136303325 1825386265 0.62
fineweb_q01/datafusion:parquet 1750401524 1887231500 0.93
fineweb_q02/datafusion:parquet 1880432009 1787744881 1.05
fineweb_q03/datafusion:parquet 1761600607 1678796663 1.05
fineweb_q04/datafusion:parquet 1792455305 1733812917 1.03
fineweb_q05/datafusion:parquet 1666165461 1963854979 0.85
fineweb_q06/datafusion:parquet 1986773020 1819056629 1.09
fineweb_q07/datafusion:parquet 1767019811 1626121166 1.09
fineweb_q08/datafusion:parquet 1753852497 1676867087 1.05
duckdb / vortex-file-compressed (1.028x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 85231104 80444050 1.06
fineweb_q01/duckdb:vortex-file-compressed 679460539 554011989 1.23
fineweb_q02/duckdb:vortex-file-compressed 435929534 453416131 0.96
fineweb_q03/duckdb:vortex-file-compressed 1550277087 1559531324 0.99
fineweb_q04/duckdb:vortex-file-compressed 1565189500 1677772468 0.93
fineweb_q05/duckdb:vortex-file-compressed 1651563949 1537885088 1.07
fineweb_q06/duckdb:vortex-file-compressed 1710397907 1686849835 1.01
fineweb_q07/duckdb:vortex-file-compressed 1440513444 1598334175 0.90
fineweb_q08/duckdb:vortex-file-compressed 728756821 647918049 1.12
duckdb / vortex-compact (1.034x ➖, 0↑ 1↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 124282436 84793174 1.47
fineweb_q01/duckdb:vortex-compact 628182343 526003895 1.19
fineweb_q02/duckdb:vortex-compact 610317151 578415435 1.06
fineweb_q03/duckdb:vortex-compact 1783084973 1784246593 1.00
fineweb_q04/duckdb:vortex-compact 1732981846 1915323491 0.90
fineweb_q05/duckdb:vortex-compact 1571748914 1647293886 0.95
fineweb_q06/duckdb:vortex-compact 1516823218 1564503622 0.97
fineweb_q07/duckdb:vortex-compact 1359939875 1439086942 0.95
fineweb_q08/duckdb:vortex-compact 462782940 500802018 0.92
duckdb / parquet (1.006x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1043450637 1071196824 0.97
fineweb_q01/duckdb:parquet 1389158738 1317625430 1.05
fineweb_q02/duckdb:parquet 1339510509 1315472477 1.02
fineweb_q03/duckdb:parquet 3497292305 3682739994 0.95
fineweb_q04/duckdb:parquet 1881877994 1828341060 1.03
fineweb_q05/duckdb:parquet 2107779612 2095229311 1.01
fineweb_q06/duckdb:parquet 4316809490 4254615434 1.01
fineweb_q07/duckdb:parquet 2647337009 2536081021 1.04
fineweb_q08/duckdb:parquet 1077102733 1111180594 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +17.2% -22.1% +50.5% +223.3% ➖ noise
0 datafusion:vortex-file-compressed +94.5% -22.1% +149.8% +256.1% ➖ noise
0 duckdb:vortex-compact +46.6% -22.1% +88.2% +67.3% 🚨 regression
0 duckdb:vortex-file-compressed +6.0% -22.1% +36.1% +42.5% ➖ noise
1 datafusion:vortex-compact +0.8% -1.1% +1.9% +67.0% ➖ noise
1 datafusion:vortex-file-compressed -24.3% -1.1% -23.4% +76.8% ➖ noise
1 duckdb:vortex-compact +19.4% -1.1% +20.8% +34.6% ➖ noise
1 duckdb:vortex-file-compressed +22.6% -1.1% +24.0% +30.0% ➖ noise
2 datafusion:vortex-compact +1.5% +3.5% -1.9% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -23.1% +3.5% -25.7% +57.4% ➖ noise
2 duckdb:vortex-compact +5.5% +3.5% +2.0% +54.2% ➖ noise
2 duckdb:vortex-file-compressed -3.9% +3.5% -7.1% +30.0% ➖ noise
3 datafusion:vortex-compact -1.6% -0.2% -1.5% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -0.7% -0.2% -0.6% +30.0% ➖ noise
3 duckdb:vortex-compact -0.1% -0.2% +0.1% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -0.6% -0.2% -0.4% +30.0% ➖ noise
4 datafusion:vortex-compact -4.1% +3.2% -7.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -1.3% +3.2% -4.3% +30.0% ➖ noise
4 duckdb:vortex-compact -9.5% +3.2% -12.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -6.7% +3.2% -9.6% +30.0% ➖ noise
5 datafusion:vortex-compact -2.0% -7.6% +6.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -1.9% -7.6% +6.2% +30.0% ➖ noise
5 duckdb:vortex-compact -4.6% -7.6% +3.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +7.4% -7.6% +16.2% +30.0% ➖ noise
6 datafusion:vortex-compact +1.6% +5.3% -3.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +5.9% +5.3% +0.6% +30.0% ➖ noise
6 duckdb:vortex-compact -3.0% +5.3% -7.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +1.4% +5.3% -3.7% +30.0% ➖ noise
7 datafusion:vortex-compact -6.8% +6.5% -12.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +4.4% +6.5% -2.0% +30.0% ➖ noise
7 duckdb:vortex-compact -5.5% +6.5% -11.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -9.9% +6.5% -15.4% +30.0% ➖ noise
8 datafusion:vortex-compact -0.1% +0.7% -0.8% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -1.0% +0.7% -1.7% +30.0% ➖ noise
8 duckdb:vortex-compact -7.6% +0.7% -8.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +12.5% +0.7% +11.7% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Vortex (geomean): 0.990x ➖
Parquet (geomean): 0.984x ➖
Shifts: Parquet (control) -1.6% · Median polish -0.6%


duckdb / vortex-file-compressed (0.987x ➖, 1↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11672177 12642239 0.92
statpopgen_q01/duckdb:vortex-file-compressed 🚀 26144355 29500203 0.89
statpopgen_q02/duckdb:vortex-file-compressed 1389911491 1377288392 1.01
statpopgen_q03/duckdb:vortex-file-compressed 3132595063 3132328265 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3100122746 3129865741 0.99
statpopgen_q05/duckdb:vortex-file-compressed 1466356968 1466316940 1.00
statpopgen_q06/duckdb:vortex-file-compressed 2130132254 2145695878 0.99
statpopgen_q07/duckdb:vortex-file-compressed 225211200 221227778 1.02
statpopgen_q08/duckdb:vortex-file-compressed 264431151 251245559 1.05
statpopgen_q09/duckdb:vortex-file-compressed 2937006542 2961880847 0.99
statpopgen_q10/duckdb:vortex-file-compressed 4725894728 4734794753 1.00
duckdb / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11314604 11357596 1.00
statpopgen_q01/duckdb:vortex-compact 164959989 171105958 0.96
statpopgen_q02/duckdb:vortex-compact 1800842330 1842092578 0.98
statpopgen_q03/duckdb:vortex-compact 3498065532 3510908709 1.00
statpopgen_q04/duckdb:vortex-compact 3533812119 3500590315 1.01
statpopgen_q05/duckdb:vortex-compact 1842799726 1868658692 0.99
statpopgen_q06/duckdb:vortex-compact 2655358099 2666440768 1.00
statpopgen_q07/duckdb:vortex-compact 894452089 899840344 0.99
statpopgen_q08/duckdb:vortex-compact 930342784 927298610 1.00
statpopgen_q09/duckdb:vortex-compact 3295668439 3295983694 1.00
statpopgen_q10/duckdb:vortex-compact 5367493661 5372692604 1.00
duckdb / parquet (0.984x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 322506840 327681301 0.98
statpopgen_q01/duckdb:parquet 404672343 404115597 1.00
statpopgen_q02/duckdb:parquet 1001560069 998442725 1.00
statpopgen_q03/duckdb:parquet 1479771171 1503554451 0.98
statpopgen_q04/duckdb:parquet 1506328351 1533251185 0.98
statpopgen_q05/duckdb:parquet 998906586 1013145127 0.99
statpopgen_q06/duckdb:parquet 1474205460 1496592771 0.99
statpopgen_q07/duckdb:parquet 1277755029 1321793519 0.97
statpopgen_q08/duckdb:parquet 1276644325 1304349074 0.98
statpopgen_q09/duckdb:parquet 1332678085 1373995227 0.97
statpopgen_q10/duckdb:parquet 2653528577 2690412549 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -0.4% -1.6% +1.2% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -7.7% -1.6% -6.2% +13.6% ➖ noise
1 duckdb:vortex-compact -3.6% +0.1% -3.7% +24.7% ➖ noise
1 duckdb:vortex-file-compressed -11.4% +0.1% -11.5% +179.4% ➖ noise
2 duckdb:vortex-compact -2.2% +0.3% -2.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.9% +0.3% +0.6% +10.0% ➖ noise
3 duckdb:vortex-compact -0.4% -1.6% +1.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.0% -1.6% +1.6% +10.0% ➖ noise
4 duckdb:vortex-compact +0.9% -1.8% +2.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.0% -1.8% +0.8% +10.0% ➖ noise
5 duckdb:vortex-compact -1.4% -1.4% +0.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.0% -1.4% +1.4% +10.0% ➖ noise
6 duckdb:vortex-compact -0.4% -1.5% +1.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.7% -1.5% +0.8% +10.0% ➖ noise
7 duckdb:vortex-compact -0.6% -3.3% +2.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.8% -3.3% +5.3% +10.0% ➖ noise
8 duckdb:vortex-compact +0.3% -2.1% +2.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +5.2% -2.1% +7.5% +10.0% ➖ noise
9 duckdb:vortex-compact -0.0% -3.0% +3.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.8% -3.0% +2.2% +10.0% ➖ noise
10 duckdb:vortex-compact -0.1% -1.4% +1.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.2% -1.4% +1.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.0%


datafusion / vortex-file-compressed (0.974x ➖, 1↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 388688748 387135278 1.00
tpch_q02/datafusion:vortex-file-compressed 110536358 111107427 0.99
tpch_q03/datafusion:vortex-file-compressed 214519345 213314777 1.01
tpch_q04/datafusion:vortex-file-compressed 113028951 115178009 0.98
tpch_q05/datafusion:vortex-file-compressed 368276338 375555569 0.98
tpch_q06/datafusion:vortex-file-compressed 44829401 47261524 0.95
tpch_q07/datafusion:vortex-file-compressed 548862200 555144906 0.99
tpch_q08/datafusion:vortex-file-compressed 354535833 355933036 1.00
tpch_q09/datafusion:vortex-file-compressed 637445575 668114649 0.95
tpch_q10/datafusion:vortex-file-compressed 246998976 249349129 0.99
tpch_q11/datafusion:vortex-file-compressed 81105073 85519416 0.95
tpch_q12/datafusion:vortex-file-compressed 120907864 132882194 0.91
tpch_q13/datafusion:vortex-file-compressed 213869007 213855484 1.00
tpch_q14/datafusion:vortex-file-compressed 58340127 60738620 0.96
tpch_q15/datafusion:vortex-file-compressed 109544526 109454505 1.00
tpch_q16/datafusion:vortex-file-compressed 75198467 79668652 0.94
tpch_q17/datafusion:vortex-file-compressed 626986151 643555026 0.97
tpch_q18/datafusion:vortex-file-compressed 833424912 838223159 0.99
tpch_q19/datafusion:vortex-file-compressed 93680590 94480085 0.99
tpch_q20/datafusion:vortex-file-compressed 🚀 167431281 188636046 0.89
tpch_q21/datafusion:vortex-file-compressed 662486164 670434636 0.99
tpch_q22/datafusion:vortex-file-compressed 66023819 65612729 1.01
datafusion / vortex-compact (0.997x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 436377620 444358503 0.98
tpch_q02/datafusion:vortex-compact 111401728 113105851 0.98
tpch_q03/datafusion:vortex-compact 213257737 216732935 0.98
tpch_q04/datafusion:vortex-compact 122396069 121734829 1.01
tpch_q05/datafusion:vortex-compact 369788848 370267664 1.00
tpch_q06/datafusion:vortex-compact 63880379 65236696 0.98
tpch_q07/datafusion:vortex-compact 562393691 564993388 1.00
tpch_q08/datafusion:vortex-compact 355844622 353143301 1.01
tpch_q09/datafusion:vortex-compact 636856330 640182830 0.99
tpch_q10/datafusion:vortex-compact 264969661 264161148 1.00
tpch_q11/datafusion:vortex-compact 84983192 82807223 1.03
tpch_q12/datafusion:vortex-compact 167188628 166576351 1.00
tpch_q13/datafusion:vortex-compact 261556798 261093422 1.00
tpch_q14/datafusion:vortex-compact 73890801 73183972 1.01
tpch_q15/datafusion:vortex-compact 161639549 162664331 0.99
tpch_q16/datafusion:vortex-compact 77898224 78303685 0.99
tpch_q17/datafusion:vortex-compact 623062709 628095627 0.99
tpch_q18/datafusion:vortex-compact 833070419 825963945 1.01
tpch_q19/datafusion:vortex-compact 129509074 133432339 0.97
tpch_q20/datafusion:vortex-compact 189627490 191164897 0.99
tpch_q21/datafusion:vortex-compact 668614726 670172431 1.00
tpch_q22/datafusion:vortex-compact 72199882 71292618 1.01
datafusion / parquet (1.000x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 486657761 466148383 1.04
tpch_q02/datafusion:parquet 170323621 173621392 0.98
tpch_q03/datafusion:parquet 290329178 288308488 1.01
tpch_q04/datafusion:parquet 133493054 131013119 1.02
tpch_q05/datafusion:parquet 435618965 437291022 1.00
tpch_q06/datafusion:parquet 127007339 127021461 1.00
tpch_q07/datafusion:parquet 606551462 606043377 1.00
tpch_q08/datafusion:parquet 468060411 466018291 1.00
tpch_q09/datafusion:parquet 745478859 745345976 1.00
tpch_q10/datafusion:parquet 499296243 497227487 1.00
tpch_q11/datafusion:parquet 120699070 121222959 1.00
tpch_q12/datafusion:parquet 207878707 212915699 0.98
tpch_q13/datafusion:parquet 330817373 334327489 0.99
tpch_q14/datafusion:parquet 164046027 160737894 1.02
tpch_q15/datafusion:parquet 252936106 255243960 0.99
tpch_q16/datafusion:parquet 128492163 129846097 0.99
tpch_q17/datafusion:parquet 676541160 672252431 1.01
tpch_q18/datafusion:parquet 873719744 870961316 1.00
tpch_q19/datafusion:parquet 284276700 286197302 0.99
tpch_q20/datafusion:parquet 293380208 292790985 1.00
tpch_q21/datafusion:parquet 694139392 700817468 0.99
tpch_q22/datafusion:parquet 208739436 210366594 0.99
datafusion / arrow (1.000x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 592004456 583035731 1.02
tpch_q02/datafusion:arrow 159061760 157795839 1.01
tpch_q03/datafusion:arrow 463021199 453094473 1.02
tpch_q04/datafusion:arrow 333042487 332437887 1.00
tpch_q05/datafusion:arrow 912498049 902308858 1.01
tpch_q06/datafusion:arrow 277794502 287612715 0.97
tpch_q07/datafusion:arrow 1117873333 1135220215 0.98
tpch_q08/datafusion:arrow 1118884029 1107274474 1.01
tpch_q09/datafusion:arrow 1315293811 1306891919 1.01
tpch_q10/datafusion:arrow 582643095 578931117 1.01
tpch_q11/datafusion:arrow 135017676 135082140 1.00
tpch_q12/datafusion:arrow 689160366 737053648 0.94
tpch_q13/datafusion:arrow 489405971 485180331 1.01
tpch_q14/datafusion:arrow 312593426 314241116 0.99
tpch_q15/datafusion:arrow 685421291 680119005 1.01
tpch_q16/datafusion:arrow 103375336 102822319 1.01
tpch_q17/datafusion:arrow 1295418430 1289413129 1.00
tpch_q18/datafusion:arrow 1844155801 1816294401 1.02
tpch_q19/datafusion:arrow 481568324 485768921 0.99
tpch_q20/datafusion:arrow 474860692 474335078 1.00
tpch_q21/datafusion:arrow 2971038895 2961403147 1.00
tpch_q22/datafusion:arrow 124912684 125263109 1.00
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169332480 171243663 0.99
tpch_q02/duckdb:vortex-file-compressed 51808525 51491074 1.01
tpch_q03/duckdb:vortex-file-compressed 128836772 126725397 1.02
tpch_q04/duckdb:vortex-file-compressed 153583326 151866113 1.01
tpch_q05/duckdb:vortex-file-compressed 128754928 128424876 1.00
tpch_q06/duckdb:vortex-file-compressed 46029153 46201491 1.00
tpch_q07/duckdb:vortex-file-compressed 147353437 144883947 1.02
tpch_q08/duckdb:vortex-file-compressed 170092252 171849203 0.99
tpch_q09/duckdb:vortex-file-compressed 320005701 323869931 0.99
tpch_q10/duckdb:vortex-file-compressed 146879335 144992600 1.01
tpch_q11/duckdb:vortex-file-compressed 32343121 32169947 1.01
tpch_q12/duckdb:vortex-file-compressed 94931892 94385217 1.01
tpch_q13/duckdb:vortex-file-compressed 226876552 225732504 1.01
tpch_q14/duckdb:vortex-file-compressed 67693812 67644718 1.00
tpch_q15/duckdb:vortex-file-compressed 86945112 85697141 1.01
tpch_q16/duckdb:vortex-file-compressed 77928498 76422893 1.02
tpch_q17/duckdb:vortex-file-compressed 98526260 99398443 0.99
tpch_q18/duckdb:vortex-file-compressed 285287024 289429725 0.99
tpch_q19/duckdb:vortex-file-compressed 84580670 83592002 1.01
tpch_q20/duckdb:vortex-file-compressed 158889483 158476757 1.00
tpch_q21/duckdb:vortex-file-compressed 560236162 561948433 1.00
tpch_q22/duckdb:vortex-file-compressed 70857918 71621740 0.99
duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 230541546 228549302 1.01
tpch_q02/duckdb:vortex-compact 55611584 56779465 0.98
tpch_q03/duckdb:vortex-compact 137911258 137400893 1.00
tpch_q04/duckdb:vortex-compact 172645333 169909286 1.02
tpch_q05/duckdb:vortex-compact 145549949 143222445 1.02
tpch_q06/duckdb:vortex-compact 82628118 81966664 1.01
tpch_q07/duckdb:vortex-compact 195769300 195329401 1.00
tpch_q08/duckdb:vortex-compact 184332124 184135336 1.00
tpch_q09/duckdb:vortex-compact 353156586 350632352 1.01
tpch_q10/duckdb:vortex-compact 176489106 176029351 1.00
tpch_q11/duckdb:vortex-compact 40671616 40115858 1.01
tpch_q12/duckdb:vortex-compact 201796767 201937775 1.00
tpch_q13/duckdb:vortex-compact 275870686 274354098 1.01
tpch_q14/duckdb:vortex-compact 98349048 98898764 0.99
tpch_q15/duckdb:vortex-compact 112904028 110881124 1.02
tpch_q16/duckdb:vortex-compact 83060296 83564633 0.99
tpch_q17/duckdb:vortex-compact 114617039 113524313 1.01
tpch_q18/duckdb:vortex-compact 290194550 288972364 1.00
tpch_q19/duckdb:vortex-compact 107584624 106893061 1.01
tpch_q20/duckdb:vortex-compact 201198341 200244843 1.00
tpch_q21/duckdb:vortex-compact 610912104 610483993 1.00
tpch_q22/duckdb:vortex-compact 85391716 84483074 1.01
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 261956392 257230441 1.02
tpch_q02/duckdb:parquet 95833299 99387613 0.96
tpch_q03/duckdb:parquet 206087863 205669441 1.00
tpch_q04/duckdb:parquet 134191737 131800752 1.02
tpch_q05/duckdb:parquet 217843624 217546962 1.00
tpch_q06/duckdb:parquet 67710210 65418346 1.04
tpch_q07/duckdb:parquet 177350090 180539282 0.98
tpch_q08/duckdb:parquet 251289543 254171346 0.99
tpch_q09/duckdb:parquet 491704618 485587632 1.01
tpch_q10/duckdb:parquet 606183549 612753272 0.99
tpch_q11/duckdb:parquet 55389733 58650361 0.94
tpch_q12/duckdb:parquet 122633119 122832749 1.00
tpch_q13/duckdb:parquet 437279796 445478488 0.98
tpch_q14/duckdb:parquet 174087507 172654862 1.01
tpch_q15/duckdb:parquet 96145572 94770253 1.01
tpch_q16/duckdb:parquet 158352148 157626475 1.00
tpch_q17/duckdb:parquet 172254369 172871888 1.00
tpch_q18/duckdb:parquet 347277704 352460045 0.99
tpch_q19/duckdb:parquet 280633451 285233308 0.98
tpch_q20/duckdb:parquet 228058475 229722123 0.99
tpch_q21/duckdb:parquet 554267284 556585320 1.00
tpch_q22/duckdb:parquet 288635076 291672663 0.99
duckdb / duckdb (1.000x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116675611 116937348 1.00
tpch_q02/duckdb:duckdb 47943290 48486709 0.99
tpch_q03/duckdb:duckdb 96329138 96663093 1.00
tpch_q04/duckdb:duckdb 131827171 131905413 1.00
tpch_q05/duckdb:duckdb 111371270 108260541 1.03
tpch_q06/duckdb:duckdb 37485382 37503992 1.00
tpch_q07/duckdb:duckdb 86801282 86176966 1.01
tpch_q08/duckdb:duckdb 110409090 110251325 1.00
tpch_q09/duckdb:duckdb 275745480 276252733 1.00
tpch_q10/duckdb:duckdb 203710918 206222519 0.99
tpch_q11/duckdb:duckdb 15511834 15823369 0.98
tpch_q12/duckdb:duckdb 85467671 85592336 1.00
tpch_q13/duckdb:duckdb 221812383 220711989 1.00
tpch_q14/duckdb:duckdb 71100860 70588205 1.01
tpch_q15/duckdb:duckdb 77460029 77235568 1.00
tpch_q16/duckdb:duckdb 74182753 73356094 1.01
tpch_q17/duckdb:duckdb 84442696 84980475 0.99
tpch_q18/duckdb:duckdb 210234465 213861533 0.98
tpch_q19/duckdb:duckdb 116022876 115978958 1.00
tpch_q20/duckdb:duckdb 112016669 112183406 1.00
tpch_q21/duckdb:duckdb 289099051 291340293 0.99
tpch_q22/duckdb:duckdb 70446298 69531992 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +1.5% +3.1% -1.5% +10.0% ➖ noise
1 datafusion:vortex-compact -1.8% +3.1% -4.8% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +0.4% +3.1% -2.6% +10.0% ➖ noise
1 duckdb:duckdb -0.2% +3.1% -3.2% +10.0% ➖ noise
1 duckdb:vortex-compact +0.9% +3.1% -2.2% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -1.1% +3.1% -4.1% +10.0% ➖ noise
2 datafusion:arrow +0.8% -2.7% +3.6% +10.0% ➖ noise
2 datafusion:vortex-compact -1.5% -2.7% +1.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.5% -2.7% +2.3% +10.0% ➖ noise
2 duckdb:duckdb -1.1% -2.7% +1.7% +10.0% ➖ noise
2 duckdb:vortex-compact -2.1% -2.7% +0.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.6% -2.7% +3.5% +10.0% ➖ noise
3 datafusion:arrow +2.2% +0.5% +1.7% +10.0% ➖ noise
3 datafusion:vortex-compact -1.6% +0.5% -2.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.6% +0.5% +0.1% +10.0% ➖ noise
3 duckdb:duckdb -0.3% +0.5% -0.8% +10.0% ➖ noise
3 duckdb:vortex-compact +0.4% +0.5% -0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.7% +0.5% +1.2% +10.0% ➖ noise
4 datafusion:arrow +0.2% +1.9% -1.6% +10.0% ➖ noise
4 datafusion:vortex-compact +0.5% +1.9% -1.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.9% +1.9% -3.7% +10.0% ➖ noise
4 duckdb:duckdb -0.1% +1.9% -1.9% +10.0% ➖ noise
4 duckdb:vortex-compact +1.6% +1.9% -0.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.1% +1.9% -0.7% +10.0% ➖ noise
5 datafusion:arrow +1.1% -0.1% +1.3% +10.0% ➖ noise
5 datafusion:vortex-compact -0.1% -0.1% -0.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.9% -0.1% -1.8% +10.0% ➖ noise
5 duckdb:duckdb +2.9% -0.1% +3.0% +10.0% ➖ noise
5 duckdb:vortex-compact +1.6% -0.1% +1.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.3% -0.1% +0.4% +10.0% ➖ noise
6 datafusion:arrow -3.4% +1.7% -5.1% +10.0% ➖ noise
6 datafusion:vortex-compact -2.1% +1.7% -3.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -5.1% +1.7% -6.8% +10.0% ➖ noise
6 duckdb:duckdb -0.0% +1.7% -1.8% +10.0% ➖ noise
6 duckdb:vortex-compact +0.8% +1.7% -0.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.4% +1.7% -2.1% +10.1% ➖ noise
7 datafusion:arrow -1.5% -0.8% -0.7% +10.0% ➖ noise
7 datafusion:vortex-compact -0.5% -0.8% +0.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.1% -0.8% -0.3% +10.0% ➖ noise
7 duckdb:duckdb +0.7% -0.8% +1.6% +10.0% ➖ noise
7 duckdb:vortex-compact +0.2% -0.8% +1.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.7% -0.8% +2.6% +10.0% ➖ noise
8 datafusion:arrow +1.0% -0.4% +1.4% +10.0% ➖ noise
8 datafusion:vortex-compact +0.8% -0.4% +1.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.4% -0.4% -0.0% +10.0% ➖ noise
8 duckdb:duckdb +0.1% -0.4% +0.5% +10.0% ➖ noise
8 duckdb:vortex-compact +0.1% -0.4% +0.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.0% -0.4% -0.7% +10.0% ➖ noise
9 datafusion:arrow +0.6% +0.6% +0.0% +10.0% ➖ noise
9 datafusion:vortex-compact -0.5% +0.6% -1.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -4.6% +0.6% -5.2% +10.0% ➖ noise
9 duckdb:duckdb -0.2% +0.6% -0.8% +10.0% ➖ noise
9 duckdb:vortex-compact +0.7% +0.6% +0.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.2% +0.6% -1.8% +10.0% ➖ noise
10 datafusion:arrow +0.6% -0.3% +1.0% +10.0% ➖ noise
10 datafusion:vortex-compact +0.3% -0.3% +0.6% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.9% -0.3% -0.6% +10.0% ➖ noise
10 duckdb:duckdb -1.2% -0.3% -0.9% +10.0% ➖ noise
10 duckdb:vortex-compact +0.3% -0.3% +0.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.3% -0.3% +1.6% +10.0% ➖ noise
11 datafusion:arrow -0.0% -3.0% +3.1% +10.0% ➖ noise
11 datafusion:vortex-compact +2.6% -3.0% +5.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -5.2% -3.0% -2.2% +10.0% ➖ noise
11 duckdb:duckdb -2.0% -3.0% +1.1% +11.3% ➖ noise
11 duckdb:vortex-compact +1.4% -3.0% +4.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +0.5% -3.0% +3.7% +10.0% ➖ noise
12 datafusion:arrow -6.5% -1.3% -5.3% +34.2% ➖ noise
12 datafusion:vortex-compact +0.4% -1.3% +1.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -9.0% -1.3% -7.8% +10.0% ➖ noise
12 duckdb:duckdb -0.1% -1.3% +1.1% +10.0% ➖ noise
12 duckdb:vortex-compact -0.1% -1.3% +1.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.6% -1.3% +1.9% +10.0% ➖ noise
13 datafusion:arrow +0.9% -1.4% +2.4% +10.0% ➖ noise
13 datafusion:vortex-compact +0.2% -1.4% +1.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.0% -1.4% +1.5% +10.0% ➖ noise
13 duckdb:duckdb +0.5% -1.4% +2.0% +10.0% ➖ noise
13 duckdb:vortex-compact +0.6% -1.4% +2.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.5% -1.4% +2.0% +10.0% ➖ noise
14 datafusion:arrow -0.5% +1.4% -1.9% +10.0% ➖ noise
14 datafusion:vortex-compact +1.0% +1.4% -0.5% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -3.9% +1.4% -5.3% +10.0% ➖ noise
14 duckdb:duckdb +0.7% +1.4% -0.7% +10.0% ➖ noise
14 duckdb:vortex-compact -0.6% +1.4% -2.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.1% +1.4% -1.4% +10.0% ➖ noise
15 datafusion:arrow +0.8% +0.3% +0.5% +10.0% ➖ noise
15 datafusion:vortex-compact -0.6% +0.3% -0.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.1% +0.3% -0.2% +10.0% ➖ noise
15 duckdb:duckdb +0.3% +0.3% +0.0% +10.0% ➖ noise
15 duckdb:vortex-compact +1.8% +0.3% +1.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +1.5% +0.3% +1.2% +10.0% ➖ noise
16 datafusion:arrow +0.5% -0.3% +0.8% +10.0% ➖ noise
16 datafusion:vortex-compact -0.5% -0.3% -0.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -5.6% -0.3% -5.3% +10.0% ➖ noise
16 duckdb:duckdb +1.1% -0.3% +1.4% +10.0% ➖ noise
16 duckdb:vortex-compact -0.6% -0.3% -0.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.0% -0.3% +2.3% +10.0% ➖ noise
17 datafusion:arrow +0.5% +0.1% +0.3% +10.0% ➖ noise
17 datafusion:vortex-compact -0.8% +0.1% -0.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -2.6% +0.1% -2.7% +10.0% ➖ noise
17 duckdb:duckdb -0.6% +0.1% -0.8% +10.0% ➖ noise
17 duckdb:vortex-compact +1.0% +0.1% +0.8% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.9% +0.1% -1.0% +10.0% ➖ noise
18 datafusion:arrow +1.5% -0.6% +2.1% +10.0% ➖ noise
18 datafusion:vortex-compact +0.9% -0.6% +1.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.6% -0.6% +0.0% +10.0% ➖ noise
18 duckdb:duckdb -1.7% -0.6% -1.1% +10.0% ➖ noise
18 duckdb:vortex-compact +0.4% -0.6% +1.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.4% -0.6% -0.9% +10.0% ➖ noise
19 datafusion:arrow -0.9% -1.1% +0.3% +10.0% ➖ noise
19 datafusion:vortex-compact -2.9% -1.1% -1.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.8% -1.1% +0.3% +10.0% ➖ noise
19 duckdb:duckdb +0.0% -1.1% +1.2% +10.0% ➖ noise
19 duckdb:vortex-compact +0.6% -1.1% +1.8% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.2% -1.1% +2.4% +10.0% ➖ noise
20 datafusion:arrow +0.1% -0.3% +0.4% +10.0% ➖ noise
20 datafusion:vortex-compact -0.8% -0.3% -0.5% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -11.2% -0.3% -11.0% +10.0% ✅ faster
20 duckdb:duckdb -0.1% -0.3% +0.1% +10.0% ➖ noise
20 duckdb:vortex-compact +0.5% -0.3% +0.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.3% -0.3% +0.5% +10.0% ➖ noise
21 datafusion:arrow +0.3% -0.7% +1.0% +10.0% ➖ noise
21 datafusion:vortex-compact -0.2% -0.7% +0.5% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -1.2% -0.7% -0.5% +10.0% ➖ noise
21 duckdb:duckdb -0.8% -0.7% -0.1% +10.0% ➖ noise
21 duckdb:vortex-compact +0.1% -0.7% +0.8% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -0.3% -0.7% +0.4% +10.0% ➖ noise
22 datafusion:arrow -0.3% -0.9% +0.6% +10.0% ➖ noise
22 datafusion:vortex-compact +1.3% -0.9% +2.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.6% -0.9% +1.5% +10.0% ➖ noise
22 duckdb:duckdb +1.3% -0.9% +2.2% +10.0% ➖ noise
22 duckdb:vortex-compact +1.1% -0.9% +2.0% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -1.1% -0.9% -0.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.3%
Vortex (geomean): 0.990x ➖
Parquet (geomean): 0.980x ➖
Shifts: Parquet (control) -2.0% · Median polish -2.1%


datafusion / vortex-file-compressed (0.992x ➖, 0↑ 1↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 2094623 1647775 1.27
clickbench_q01/datafusion:vortex-file-compressed 34645002 35044027 0.99
clickbench_q02/datafusion:vortex-file-compressed 51702382 52005382 0.99
clickbench_q03/datafusion:vortex-file-compressed 57933468 55337742 1.05
clickbench_q04/datafusion:vortex-file-compressed 298845786 303988795 0.98
clickbench_q05/datafusion:vortex-file-compressed 311293748 311422062 1.00
clickbench_q06/datafusion:vortex-file-compressed 1649605 1701928 0.97
clickbench_q07/datafusion:vortex-file-compressed 38336368 39014659 0.98
clickbench_q08/datafusion:vortex-file-compressed 367782028 362447708 1.01
clickbench_q09/datafusion:vortex-file-compressed 560581611 573344145 0.98
clickbench_q10/datafusion:vortex-file-compressed 90142850 86997195 1.04
clickbench_q11/datafusion:vortex-file-compressed 98949182 102835802 0.96
clickbench_q12/datafusion:vortex-file-compressed 267454212 276698512 0.97
clickbench_q13/datafusion:vortex-file-compressed 420258110 424984108 0.99
clickbench_q14/datafusion:vortex-file-compressed 261833341 270049379 0.97
clickbench_q15/datafusion:vortex-file-compressed 334327217 343006329 0.97
clickbench_q16/datafusion:vortex-file-compressed 644739956 658031695 0.98
clickbench_q17/datafusion:vortex-file-compressed 645218558 657469647 0.98
clickbench_q18/datafusion:vortex-file-compressed 1299222927 1378959840 0.94
clickbench_q19/datafusion:vortex-file-compressed 50745645 47582556 1.07
clickbench_q20/datafusion:vortex-file-compressed 348548662 350283573 1.00
clickbench_q21/datafusion:vortex-file-compressed 380307427 378956304 1.00
clickbench_q22/datafusion:vortex-file-compressed 458214593 455760650 1.01
clickbench_q23/datafusion:vortex-file-compressed 676006760 724547787 0.93
clickbench_q24/datafusion:vortex-file-compressed 55419150 57540983 0.96
clickbench_q25/datafusion:vortex-file-compressed 84609451 89540157 0.94
clickbench_q26/datafusion:vortex-file-compressed 54082744 52496290 1.03
clickbench_q27/datafusion:vortex-file-compressed 725636570 726811378 1.00
clickbench_q28/datafusion:vortex-file-compressed 6940384019 6818444174 1.02
clickbench_q29/datafusion:vortex-file-compressed 249921632 253878976 0.98
clickbench_q30/datafusion:vortex-file-compressed 230632156 235164099 0.98
clickbench_q31/datafusion:vortex-file-compressed 268637360 269835902 1.00
clickbench_q32/datafusion:vortex-file-compressed 1104230733 1153737164 0.96
clickbench_q33/datafusion:vortex-file-compressed 1284350087 1307853613 0.98
clickbench_q34/datafusion:vortex-file-compressed 1288485248 1294239032 1.00
clickbench_q35/datafusion:vortex-file-compressed 455638943 468829927 0.97
clickbench_q36/datafusion:vortex-file-compressed 72470998 74157326 0.98
clickbench_q37/datafusion:vortex-file-compressed 37853429 38254592 0.99
clickbench_q38/datafusion:vortex-file-compressed 21647004 22654156 0.96
clickbench_q39/datafusion:vortex-file-compressed 137212506 134862933 1.02
clickbench_q40/datafusion:vortex-file-compressed 19637773 21079391 0.93
clickbench_q41/datafusion:vortex-file-compressed 18715840 19333322 0.97
clickbench_q42/datafusion:vortex-file-compressed 21010885 21031553 1.00
datafusion / parquet (0.973x ➖, 1↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1552012 1533127 1.01
clickbench_q01/datafusion:parquet 🚀 18703945 22207663 0.84
clickbench_q02/datafusion:parquet 46086879 48985097 0.94
clickbench_q03/datafusion:parquet 37269836 37478956 0.99
clickbench_q04/datafusion:parquet 292696174 297663592 0.98
clickbench_q05/datafusion:parquet 343583255 353393222 0.97
clickbench_q06/datafusion:parquet 1510395 1576919 0.96
clickbench_q07/datafusion:parquet 24206267 22872333 1.06
clickbench_q08/datafusion:parquet 364291353 388849303 0.94
clickbench_q09/datafusion:parquet 606205123 621429982 0.98
clickbench_q10/datafusion:parquet 109535449 114975030 0.95
clickbench_q11/datafusion:parquet 134250587 135452420 0.99
clickbench_q12/datafusion:parquet 342705535 351913325 0.97
clickbench_q13/datafusion:parquet 502702557 494444339 1.02
clickbench_q14/datafusion:parquet 345788084 342508257 1.01
clickbench_q15/datafusion:parquet 331976700 340737733 0.97
clickbench_q16/datafusion:parquet 678860470 677150872 1.00
clickbench_q17/datafusion:parquet 638906999 657463730 0.97
clickbench_q18/datafusion:parquet 1306318657 1327493914 0.98
clickbench_q19/datafusion:parquet 28042019 29721784 0.94
clickbench_q20/datafusion:parquet 598367152 612586072 0.98
clickbench_q21/datafusion:parquet 665482291 679481962 0.98
clickbench_q22/datafusion:parquet 985294337 998620457 0.99
clickbench_q23/datafusion:parquet 3720506554 3773346265 0.99
clickbench_q24/datafusion:parquet 80454892 85237750 0.94
clickbench_q25/datafusion:parquet 137845429 135271324 1.02
clickbench_q26/datafusion:parquet 81717343 85378812 0.96
clickbench_q27/datafusion:parquet 1053767286 1056261664 1.00
clickbench_q28/datafusion:parquet 6766475549 6684316219 1.01
clickbench_q29/datafusion:parquet 242742573 253652442 0.96
clickbench_q30/datafusion:parquet 326780762 331015464 0.99
clickbench_q31/datafusion:parquet 363964181 372016001 0.98
clickbench_q32/datafusion:parquet 1181778664 1197640930 0.99
clickbench_q33/datafusion:parquet 1454958826 1510483535 0.96
clickbench_q34/datafusion:parquet 1451187657 1492309435 0.97
clickbench_q35/datafusion:parquet 451019384 465751546 0.97
clickbench_q36/datafusion:parquet 132155674 143478653 0.92
clickbench_q37/datafusion:parquet 56598096 58805259 0.96
clickbench_q38/datafusion:parquet 83544001 87328556 0.96
clickbench_q39/datafusion:parquet 254908594 259606904 0.98
clickbench_q40/datafusion:parquet 29413686 31126353 0.94
clickbench_q41/datafusion:parquet 27075659 28719246 0.94
clickbench_q42/datafusion:parquet 28899267 29763568 0.97
duckdb / vortex-file-compressed (0.989x ➖, 1↑ 2↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6109228 6188348 0.99
clickbench_q01/duckdb:vortex-file-compressed 13671551 13770293 0.99
clickbench_q02/duckdb:vortex-file-compressed 25755124 27276429 0.94
clickbench_q03/duckdb:vortex-file-compressed 29756923 31067460 0.96
clickbench_q04/duckdb:vortex-file-compressed 178041077 187318975 0.95
clickbench_q05/duckdb:vortex-file-compressed 170468547 178620719 0.95
clickbench_q06/duckdb:vortex-file-compressed 19229044 19935295 0.96
clickbench_q07/duckdb:vortex-file-compressed 15275190 15623290 0.98
clickbench_q08/duckdb:vortex-file-compressed 258536979 260828787 0.99
clickbench_q09/duckdb:vortex-file-compressed 330444243 341857007 0.97
clickbench_q10/duckdb:vortex-file-compressed 65395480 69617466 0.94
clickbench_q11/duckdb:vortex-file-compressed 78170831 81263551 0.96
clickbench_q12/duckdb:vortex-file-compressed 192026185 200960983 0.96
clickbench_q13/duckdb:vortex-file-compressed 406156010 406997594 1.00
clickbench_q14/duckdb:vortex-file-compressed 232690496 239618976 0.97
clickbench_q15/duckdb:vortex-file-compressed 239915351 246735352 0.97
clickbench_q16/duckdb:vortex-file-compressed 578791114 596854202 0.97
clickbench_q17/duckdb:vortex-file-compressed 462458296 479773562 0.96
clickbench_q18/duckdb:vortex-file-compressed 968330868 997465639 0.97
clickbench_q19/duckdb:vortex-file-compressed 21314293 22044681 0.97
clickbench_q20/duckdb:vortex-file-compressed 327156898 342349083 0.96
clickbench_q21/duckdb:vortex-file-compressed 363277355 366606225 0.99
clickbench_q22/duckdb:vortex-file-compressed 🚀 488996275 633359080 0.77
clickbench_q23/duckdb:vortex-file-compressed 🚨 1626657975 1224673503 1.33
clickbench_q24/duckdb:vortex-file-compressed 43590965 41962635 1.04
clickbench_q25/duckdb:vortex-file-compressed 78993832 75356145 1.05
clickbench_q26/duckdb:vortex-file-compressed 🚨 50477277 43650654 1.16
clickbench_q27/duckdb:vortex-file-compressed 474645989 482946407 0.98
clickbench_q28/duckdb:vortex-file-compressed 2956350897 2995474217 0.99
clickbench_q29/duckdb:vortex-file-compressed 29323611 29472326 0.99
clickbench_q30/duckdb:vortex-file-compressed 194423191 192924051 1.01
clickbench_q31/duckdb:vortex-file-compressed 280746644 287389716 0.98
clickbench_q32/duckdb:vortex-file-compressed 1201932158 1235763020 0.97
clickbench_q33/duckdb:vortex-file-compressed 1179533296 1215460720 0.97
clickbench_q34/duckdb:vortex-file-compressed 1249632537 1243292762 1.01
clickbench_q35/duckdb:vortex-file-compressed 375487468 388281833 0.97
clickbench_q36/duckdb:vortex-file-compressed 27372230 28204875 0.97
clickbench_q37/duckdb:vortex-file-compressed 20596199 20046397 1.03
clickbench_q38/duckdb:vortex-file-compressed 21451889 21465159 1.00
clickbench_q39/duckdb:vortex-file-compressed 41132885 41245610 1.00
clickbench_q40/duckdb:vortex-file-compressed 20057369 19411113 1.03
clickbench_q41/duckdb:vortex-file-compressed 20948925 19696319 1.06
clickbench_q42/duckdb:vortex-file-compressed 22044383 21182324 1.04
duckdb / parquet (0.988x ➖, 1↑ 1↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 24567920 25061575 0.98
clickbench_q01/duckdb:parquet 28275890 27923465 1.01
clickbench_q02/duckdb:parquet 48607660 48694345 1.00
clickbench_q03/duckdb:parquet 37915713 39057711 0.97
clickbench_q04/duckdb:parquet 200726968 205453125 0.98
clickbench_q05/duckdb:parquet 266549290 274008691 0.97
clickbench_q06/duckdb:parquet 46083432 46037974 1.00
clickbench_q07/duckdb:parquet 29727868 29716484 1.00
clickbench_q08/duckdb:parquet 270126750 270757095 1.00
clickbench_q09/duckdb:parquet 395617704 404624932 0.98
clickbench_q10/duckdb:parquet 80641276 84308938 0.96
clickbench_q11/duckdb:parquet 98083289 100451910 0.98
clickbench_q12/duckdb:parquet 289880096 294485239 0.98
clickbench_q13/duckdb:parquet 471610748 493768260 0.96
clickbench_q14/duckdb:parquet 326848189 336621929 0.97
clickbench_q15/duckdb:parquet 257039987 271061304 0.95
clickbench_q16/duckdb:parquet 635787307 652198418 0.97
clickbench_q17/duckdb:parquet 534845550 552783067 0.97
clickbench_q18/duckdb:parquet 1072318118 1090223498 0.98
clickbench_q19/duckdb:parquet 26052615 27342610 0.95
clickbench_q20/duckdb:parquet 418889064 434117341 0.96
clickbench_q21/duckdb:parquet 537954630 552773405 0.97
clickbench_q22/duckdb:parquet 921893289 936358750 0.98
clickbench_q23/duckdb:parquet 314492834 317457569 0.99
clickbench_q24/duckdb:parquet 70876644 70092628 1.01
clickbench_q25/duckdb:parquet 155824611 158479914 0.98
clickbench_q26/duckdb:parquet 49325267 49143974 1.00
clickbench_q27/duckdb:parquet 645193982 648490949 0.99
clickbench_q28/duckdb:parquet 4819276370 4871672197 0.99
clickbench_q29/duckdb:parquet 40659000 40888024 0.99
clickbench_q30/duckdb:parquet 300946819 303035838 0.99
clickbench_q31/duckdb:parquet 358181108 363913526 0.98
clickbench_q32/duckdb:parquet 1241067580 1179983325 1.05
clickbench_q33/duckdb:parquet 1271649661 1244576779 1.02
clickbench_q34/duckdb:parquet 1347626076 1286299469 1.05
clickbench_q35/duckdb:parquet 360688667 366398458 0.98
clickbench_q36/duckdb:parquet 🚨 49351593 44831586 1.10
clickbench_q37/duckdb:parquet 32444487 30794185 1.05
clickbench_q38/duckdb:parquet 32818553 34640569 0.95
clickbench_q39/duckdb:parquet 83592747 82394375 1.01
clickbench_q40/duckdb:parquet 🚀 17872180 20325777 0.88
clickbench_q41/duckdb:parquet 18132686 18096531 1.00
clickbench_q42/duckdb:parquet 22125507 22475951 0.98
duckdb / duckdb (0.998x ➖, 5↑ 6↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 19143244 17550484 1.09
clickbench_q01/duckdb:duckdb 36247888 33267081 1.09
clickbench_q02/duckdb:duckdb 48647612 46066665 1.06
clickbench_q03/duckdb:duckdb 50854061 47228687 1.08
clickbench_q04/duckdb:duckdb 185448972 189709408 0.98
clickbench_q05/duckdb:duckdb 261067187 264943535 0.99
clickbench_q06/duckdb:duckdb 38250545 35865809 1.07
clickbench_q07/duckdb:duckdb 🚨 38787965 34956251 1.11
clickbench_q08/duckdb:duckdb 248424640 254720473 0.98
clickbench_q09/duckdb:duckdb 365725810 370414826 0.99
clickbench_q10/duckdb:duckdb 100309980 98619113 1.02
clickbench_q11/duckdb:duckdb 108610378 108550000 1.00
clickbench_q12/duckdb:duckdb 236216615 242301336 0.97
clickbench_q13/duckdb:duckdb 458755135 485964749 0.94
clickbench_q14/duckdb:duckdb 272998617 275301284 0.99
clickbench_q15/duckdb:duckdb 220542643 225087293 0.98
clickbench_q16/duckdb:duckdb 632693860 681302531 0.93
clickbench_q17/duckdb:duckdb 550133809 594743875 0.92
clickbench_q18/duckdb:duckdb 1198669008 1272804796 0.94
clickbench_q19/duckdb:duckdb 🚨 38487464 34241092 1.12
clickbench_q20/duckdb:duckdb 🚀 864492962 1045252122 0.83
clickbench_q21/duckdb:duckdb 🚀 884377428 1085124063 0.82
clickbench_q22/duckdb:duckdb 1143796656 1066902042 1.07
clickbench_q23/duckdb:duckdb 265848694 265935698 1.00
clickbench_q24/duckdb:duckdb 65483058 61584042 1.06
clickbench_q25/duckdb:duckdb 143821091 145617915 0.99
clickbench_q26/duckdb:duckdb 58677930 60822215 0.96
clickbench_q27/duckdb:duckdb 978583063 1058445403 0.92
clickbench_q28/duckdb:duckdb 4668044605 4716449456 0.99
clickbench_q29/duckdb:duckdb 53417236 48571264 1.10
clickbench_q30/duckdb:duckdb 262386378 267258384 0.98
clickbench_q31/duckdb:duckdb 🚀 414358432 472007141 0.88
clickbench_q32/duckdb:duckdb 🚀 1421838077 1627743601 0.87
clickbench_q33/duckdb:duckdb 1915165209 2077037638 0.92
clickbench_q34/duckdb:duckdb 🚀 1990059829 2265389254 0.88
clickbench_q35/duckdb:duckdb 278698120 276725551 1.01
clickbench_q36/duckdb:duckdb 44777715 42397599 1.06
clickbench_q37/duckdb:duckdb 🚨 34933444 31335058 1.11
clickbench_q38/duckdb:duckdb 🚨 34254932 30901384 1.11
clickbench_q39/duckdb:duckdb 66761712 73581497 0.91
clickbench_q40/duckdb:duckdb 🚨 35929534 31448563 1.14
clickbench_q41/duckdb:duckdb 33647072 30629386 1.10
clickbench_q42/duckdb:duckdb 🚨 35071007 31554957 1.11
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +27.1% -0.4% +27.6% +755.7% ➖ noise
0 duckdb:duckdb +9.1% -0.4% +9.5% +297.7% ➖ noise
0 duckdb:vortex-file-compressed -1.3% -0.4% -0.9% +501.7% ➖ noise
1 datafusion:vortex-file-compressed -1.1% -7.6% +7.1% +21.9% ➖ noise
1 duckdb:duckdb +9.0% -7.6% +18.0% +59.7% ➖ noise
1 duckdb:vortex-file-compressed -0.7% -7.6% +7.5% +22.3% ➖ noise
2 datafusion:vortex-file-compressed -0.6% -3.1% +2.6% +10.6% ➖ noise
2 duckdb:duckdb +5.6% -3.1% +9.0% +21.3% ➖ noise
2 duckdb:vortex-file-compressed -5.6% -3.1% -2.6% +15.2% ➖ noise
3 datafusion:vortex-file-compressed +4.7% -1.7% +6.6% +102.3% ➖ noise
3 duckdb:duckdb +7.7% -1.7% +9.6% +45.8% ➖ noise
3 duckdb:vortex-file-compressed -4.2% -1.7% -2.5% +44.9% ➖ noise
4 datafusion:vortex-file-compressed -1.7% -2.0% +0.3% +10.0% ➖ noise
4 duckdb:duckdb -2.2% -2.0% -0.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -5.0% -2.0% -3.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -0.0% -2.7% +2.8% +10.0% ➖ noise
5 duckdb:duckdb -1.5% -2.7% +1.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.6% -2.7% -1.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.1% -2.1% -1.0% +41.3% ➖ noise
6 duckdb:duckdb +6.6% -2.1% +8.9% +29.6% ➖ noise
6 duckdb:vortex-file-compressed -3.5% -2.1% -1.5% +19.8% ➖ noise
7 datafusion:vortex-file-compressed -1.7% +2.9% -4.5% +10.0% ➖ noise
7 duckdb:duckdb +11.0% +2.9% +7.8% +11.3% ➖ noise
7 duckdb:vortex-file-compressed -2.2% +2.9% -5.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +1.5% -3.3% +5.0% +10.0% ➖ noise
8 duckdb:duckdb -2.5% -3.3% +0.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.9% -3.3% +2.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -2.2% -2.3% +0.1% +10.0% ➖ noise
9 duckdb:duckdb -1.3% -2.3% +1.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -3.3% -2.3% -1.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +3.6% -4.5% +8.5% +10.0% ➖ noise
10 duckdb:duckdb +1.7% -4.5% +6.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -6.1% -4.5% -1.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.8% -1.6% -2.2% +10.0% ➖ noise
11 duckdb:duckdb +0.1% -1.6% +1.7% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -3.8% -1.6% -2.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -3.3% -2.1% -1.3% +10.0% ➖ noise
12 duckdb:duckdb -2.5% -2.1% -0.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -4.4% -2.1% -2.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.1% -1.5% +0.3% +10.0% ➖ noise
13 duckdb:duckdb -5.6% -1.5% -4.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.2% -1.5% +1.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -3.0% -1.0% -2.1% +10.0% ➖ noise
14 duckdb:duckdb -0.8% -1.0% +0.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.9% -1.0% -1.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -2.5% -3.9% +1.4% +10.0% ➖ noise
15 duckdb:duckdb -2.0% -3.9% +1.9% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -2.8% -3.9% +1.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.0% -1.1% -0.9% +10.0% ➖ noise
16 duckdb:duckdb -7.1% -1.1% -6.1% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -3.0% -1.1% -1.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.9% -3.0% +1.2% +10.0% ➖ noise
17 duckdb:duckdb -7.5% -3.0% -4.6% +11.5% ➖ noise
17 duckdb:vortex-file-compressed -3.6% -3.0% -0.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -5.8% -1.6% -4.2% +10.0% ➖ noise
18 duckdb:duckdb -5.8% -1.6% -4.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -2.9% -1.6% -1.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +6.6% -5.2% +12.5% +17.6% ➖ noise
19 duckdb:duckdb +12.4% -5.2% +18.5% +12.9% 🚨 regression
19 duckdb:vortex-file-compressed -3.3% -5.2% +2.0% +12.0% ➖ noise
20 datafusion:vortex-file-compressed -0.5% -2.9% +2.5% +200.0% ➖ noise
20 duckdb:duckdb -17.3% -2.9% -14.8% +23.3% ➖ noise
20 duckdb:vortex-file-compressed -4.4% -2.9% -1.6% +26.7% ➖ noise
21 datafusion:vortex-file-compressed +0.4% -2.4% +2.8% +10.0% ➖ noise
21 duckdb:duckdb -18.5% -2.4% -16.5% +10.6% ✅ faster
21 duckdb:vortex-file-compressed -0.9% -2.4% +1.5% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.5% -1.4% +2.0% +14.7% ➖ noise
22 duckdb:duckdb +7.2% -1.4% +8.8% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -22.8% -1.4% -21.7% +21.4% ✅ faster
23 datafusion:vortex-file-compressed -6.7% -1.2% -5.6% +47.7% ➖ noise
23 duckdb:duckdb -0.0% -1.2% +1.1% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +32.8% -1.2% +34.4% +12.7% 🚨 regression
24 datafusion:vortex-file-compressed -3.7% -2.3% -1.4% +14.4% ➖ noise
24 duckdb:duckdb +6.3% -2.3% +8.8% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +3.9% -2.3% +6.3% +21.5% ➖ noise
25 datafusion:vortex-file-compressed -5.5% +0.1% -5.6% +10.0% ➖ noise
25 duckdb:duckdb -1.2% +0.1% -1.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +4.8% +0.1% +4.7% +17.8% ➖ noise
26 datafusion:vortex-file-compressed +3.0% -2.0% +5.1% +10.0% ➖ noise
26 duckdb:duckdb -3.5% -2.0% -1.6% +13.7% ➖ noise
26 duckdb:vortex-file-compressed +15.6% -2.0% +18.0% +48.7% ➖ noise
27 datafusion:vortex-file-compressed -0.2% -0.4% +0.2% +10.0% ➖ noise
27 duckdb:duckdb -7.5% -0.4% -7.2% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -1.7% -0.4% -1.4% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.8% +0.1% +1.7% +10.0% ➖ noise
28 duckdb:duckdb -1.0% +0.1% -1.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -1.3% +0.1% -1.4% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -1.6% -2.4% +0.9% +10.0% ➖ noise
29 duckdb:duckdb +10.0% -2.4% +12.7% +11.1% 🚨 regression
29 duckdb:vortex-file-compressed -0.5% -2.4% +2.0% +12.7% ➖ noise
30 datafusion:vortex-file-compressed -1.9% -1.0% -1.0% +10.0% ➖ noise
30 duckdb:duckdb -1.8% -1.0% -0.8% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.8% -1.0% +1.8% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.4% -1.9% +1.5% +10.0% ➖ noise
31 duckdb:duckdb -12.2% -1.9% -10.5% +10.0% ✅ faster
31 duckdb:vortex-file-compressed -2.3% -1.9% -0.4% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -4.3% +1.9% -6.1% +10.0% ➖ noise
32 duckdb:duckdb -12.6% +1.9% -14.3% +10.0% ✅ faster
32 duckdb:vortex-file-compressed -2.7% +1.9% -4.5% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -1.8% -0.8% -1.0% +10.0% ➖ noise
33 duckdb:duckdb -7.8% -0.8% -7.1% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -3.0% -0.8% -2.2% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -0.4% +0.9% -1.4% +10.0% ➖ noise
34 duckdb:duckdb -12.2% +0.9% -13.0% +10.0% ✅ faster
34 duckdb:vortex-file-compressed +0.5% +0.9% -0.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -2.8% -2.4% -0.5% +10.0% ➖ noise
35 duckdb:duckdb +0.7% -2.4% +3.2% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -3.3% -2.4% -1.0% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -2.3% +0.7% -2.9% +10.0% ➖ noise
36 duckdb:duckdb +5.6% +0.7% +4.9% +13.6% ➖ noise
36 duckdb:vortex-file-compressed -3.0% +0.7% -3.6% +11.5% ➖ noise
37 datafusion:vortex-file-compressed -1.0% +0.7% -1.7% +10.0% ➖ noise
37 duckdb:duckdb +11.5% +0.7% +10.7% +10.3% 🚨 regression
37 duckdb:vortex-file-compressed +2.7% +0.7% +2.0% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -4.4% -4.8% +0.4% +10.0% ➖ noise
38 duckdb:duckdb +10.9% -4.8% +16.4% +10.0% 🚨 regression
38 duckdb:vortex-file-compressed -0.1% -4.8% +5.0% +10.6% ➖ noise
39 datafusion:vortex-file-compressed +1.7% -0.2% +1.9% +10.0% ➖ noise
39 duckdb:duckdb -9.3% -0.2% -9.1% +11.0% ➖ noise
39 duckdb:vortex-file-compressed -0.3% -0.2% -0.1% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -6.8% -8.8% +2.2% +15.0% ➖ noise
40 duckdb:duckdb +14.2% -8.8% +25.3% +10.2% 🚨 regression
40 duckdb:vortex-file-compressed +3.3% -8.8% +13.4% +10.0% 🚨 regression
41 datafusion:vortex-file-compressed -3.2% -2.8% -0.4% +10.3% ➖ noise
41 duckdb:duckdb +9.9% -2.8% +13.0% +12.8% 🚨 regression
41 duckdb:vortex-file-compressed +6.4% -2.8% +9.4% +11.7% ➖ noise
42 datafusion:vortex-file-compressed -0.1% -2.2% +2.2% +10.0% ➖ noise
42 duckdb:duckdb +11.1% -2.2% +13.7% +10.0% 🚨 regression
42 duckdb:vortex-file-compressed +4.1% -2.2% +6.4% +14.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.0%
Vortex (geomean): 1.048x ➖
Parquet (geomean): 1.038x ➖
Shifts: Parquet (control) +3.8% · Median polish +3.7%


datafusion / vortex-file-compressed (1.001x ➖, 1↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 290460139 248553591 1.17
tpch_q02/datafusion:vortex-file-compressed 498471146 465858616 1.07
tpch_q03/datafusion:vortex-file-compressed 509622067 481783736 1.06
tpch_q04/datafusion:vortex-file-compressed 255121312 241872698 1.05
tpch_q05/datafusion:vortex-file-compressed 404319892 409396819 0.99
tpch_q06/datafusion:vortex-file-compressed 367038972 340401709 1.08
tpch_q07/datafusion:vortex-file-compressed 423921634 408508416 1.04
tpch_q08/datafusion:vortex-file-compressed 606118751 677442715 0.89
tpch_q09/datafusion:vortex-file-compressed 🚀 388400606 593632803 0.65
tpch_q10/datafusion:vortex-file-compressed 483935187 581559725 0.83
tpch_q11/datafusion:vortex-file-compressed 321442725 290100570 1.11
tpch_q12/datafusion:vortex-file-compressed 516930389 461310532 1.12
tpch_q13/datafusion:vortex-file-compressed 135115935 167601506 0.81
tpch_q14/datafusion:vortex-file-compressed 288025444 323604679 0.89
tpch_q15/datafusion:vortex-file-compressed 494933563 486090646 1.02
tpch_q16/datafusion:vortex-file-compressed 192135244 199299555 0.96
tpch_q17/datafusion:vortex-file-compressed 352648604 329268195 1.07
tpch_q18/datafusion:vortex-file-compressed 311851992 321210468 0.97
tpch_q19/datafusion:vortex-file-compressed 452142603 416114622 1.09
tpch_q20/datafusion:vortex-file-compressed 436341944 443872337 0.98
tpch_q21/datafusion:vortex-file-compressed 617301243 554538170 1.11
tpch_q22/datafusion:vortex-file-compressed 175034017 137803671 1.27
datafusion / vortex-compact (1.095x ➖, 0↑ 4↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 234340466 218028241 1.07
tpch_q02/datafusion:vortex-compact 466814360 399755125 1.17
tpch_q03/datafusion:vortex-compact 🚨 405388672 308184618 1.32
tpch_q04/datafusion:vortex-compact 225276004 216963634 1.04
tpch_q05/datafusion:vortex-compact 451073390 394453505 1.14
tpch_q06/datafusion:vortex-compact 318482608 433076437 0.74
tpch_q07/datafusion:vortex-compact 399535611 373399954 1.07
tpch_q08/datafusion:vortex-compact 488393134 543635083 0.90
tpch_q09/datafusion:vortex-compact 463644716 362187866 1.28
tpch_q10/datafusion:vortex-compact 420335184 404689334 1.04
tpch_q11/datafusion:vortex-compact 261827629 299101531 0.88
tpch_q12/datafusion:vortex-compact 357258666 375249917 0.95
tpch_q13/datafusion:vortex-compact 🚨 166039939 105445632 1.57
tpch_q14/datafusion:vortex-compact 196060549 200353625 0.98
tpch_q15/datafusion:vortex-compact 348028776 339909109 1.02
tpch_q16/datafusion:vortex-compact 180518714 189371532 0.95
tpch_q17/datafusion:vortex-compact 383117834 338167286 1.13
tpch_q18/datafusion:vortex-compact 275346738 288804705 0.95
tpch_q19/datafusion:vortex-compact 399065218 407191682 0.98
tpch_q20/datafusion:vortex-compact 364600910 378062508 0.96
tpch_q21/datafusion:vortex-compact 🚨 580062542 439460401 1.32
tpch_q22/datafusion:vortex-compact 🚨 318818361 134920350 2.36
datafusion / parquet (1.026x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 229165398 248299672 0.92
tpch_q02/datafusion:parquet 427558076 522856743 0.82
tpch_q03/datafusion:parquet 320700976 286733978 1.12
tpch_q04/datafusion:parquet 148667329 145974303 1.02
tpch_q05/datafusion:parquet 452832498 443523772 1.02
tpch_q06/datafusion:parquet 132487263 131167655 1.01
tpch_q07/datafusion:parquet 456748310 452723592 1.01
tpch_q08/datafusion:parquet 557885287 557818462 1.00
tpch_q09/datafusion:parquet 465533510 465774581 1.00
tpch_q10/datafusion:parquet 539369292 532382256 1.01
tpch_q11/datafusion:parquet 332879369 335370691 0.99
tpch_q12/datafusion:parquet 245821276 230495059 1.07
tpch_q13/datafusion:parquet 429431993 432156073 0.99
tpch_q14/datafusion:parquet 212216363 196640390 1.08
tpch_q15/datafusion:parquet 359512429 311412290 1.15
tpch_q16/datafusion:parquet 169487126 174479206 0.97
tpch_q17/datafusion:parquet 459605911 425663943 1.08
tpch_q18/datafusion:parquet 453812254 449567067 1.01
tpch_q19/datafusion:parquet 351690319 349549694 1.01
tpch_q20/datafusion:parquet 321334266 327824118 0.98
tpch_q21/datafusion:parquet 610882138 507574999 1.20
tpch_q22/datafusion:parquet 140050284 118537294 1.18
duckdb / vortex-file-compressed (1.051x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 289884778 265759275 1.09
tpch_q02/duckdb:vortex-file-compressed 923146558 963546386 0.96
tpch_q03/duckdb:vortex-file-compressed 700113483 656078411 1.07
tpch_q04/duckdb:vortex-file-compressed 421770528 373107549 1.13
tpch_q05/duckdb:vortex-file-compressed 901092138 897087725 1.00
tpch_q06/duckdb:vortex-file-compressed 412441809 388132702 1.06
tpch_q07/duckdb:vortex-file-compressed 848255023 801151077 1.06
tpch_q08/duckdb:vortex-file-compressed 976388750 992290073 0.98
tpch_q09/duckdb:vortex-file-compressed 922377674 819930636 1.12
tpch_q10/duckdb:vortex-file-compressed 766520073 752625400 1.02
tpch_q11/duckdb:vortex-file-compressed 513451218 483914734 1.06
tpch_q12/duckdb:vortex-file-compressed 507577694 456630174 1.11
tpch_q13/duckdb:vortex-file-compressed 484852390 455232209 1.07
tpch_q14/duckdb:vortex-file-compressed 486557494 437456523 1.11
tpch_q15/duckdb:vortex-file-compressed 285509218 279545269 1.02
tpch_q16/duckdb:vortex-file-compressed 365629435 378622672 0.97
tpch_q17/duckdb:vortex-file-compressed 745921900 675174659 1.10
tpch_q18/duckdb:vortex-file-compressed 449812906 521602068 0.86
tpch_q19/duckdb:vortex-file-compressed 434383754 406761290 1.07
tpch_q20/duckdb:vortex-file-compressed 907383298 810574739 1.12
tpch_q21/duckdb:vortex-file-compressed 1125858176 1017005070 1.11
tpch_q22/duckdb:vortex-file-compressed 371931771 344053938 1.08
duckdb / vortex-compact (1.046x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 285104385 269219137 1.06
tpch_q02/duckdb:vortex-compact 931438999 908121972 1.03
tpch_q03/duckdb:vortex-compact 637869258 604507773 1.06
tpch_q04/duckdb:vortex-compact 375687993 342007011 1.10
tpch_q05/duckdb:vortex-compact 839418464 862143737 0.97
tpch_q06/duckdb:vortex-compact 392217372 398822779 0.98
tpch_q07/duckdb:vortex-compact 811260648 777872435 1.04
tpch_q08/duckdb:vortex-compact 973130316 858483558 1.13
tpch_q09/duckdb:vortex-compact 914938970 843498680 1.08
tpch_q10/duckdb:vortex-compact 661327371 733181301 0.90
tpch_q11/duckdb:vortex-compact 537457479 458877526 1.17
tpch_q12/duckdb:vortex-compact 474562993 469408331 1.01
tpch_q13/duckdb:vortex-compact 447617207 431381963 1.04
tpch_q14/duckdb:vortex-compact 456928846 429869349 1.06
tpch_q15/duckdb:vortex-compact 278015612 267610180 1.04
tpch_q16/duckdb:vortex-compact 382870128 342363745 1.12
tpch_q17/duckdb:vortex-compact 587481214 613134129 0.96
tpch_q18/duckdb:vortex-compact 461562050 450683766 1.02
tpch_q19/duckdb:vortex-compact 454718307 401350959 1.13
tpch_q20/duckdb:vortex-compact 714649592 725235162 0.99
tpch_q21/duckdb:vortex-compact 1038146285 950641310 1.09
tpch_q22/duckdb:vortex-compact 354461422 335409356 1.06
duckdb / parquet (1.049x ➖, 0↑ 1↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 435415720 422338885 1.03
tpch_q02/duckdb:parquet 1257136481 1201149337 1.05
tpch_q03/duckdb:parquet 1131149343 964355847 1.17
tpch_q04/duckdb:parquet 🚨 762407048 584464320 1.30
tpch_q05/duckdb:parquet 1540422145 1587371726 0.97
tpch_q06/duckdb:parquet 385979362 412480084 0.94
tpch_q07/duckdb:parquet 1342538413 1206869747 1.11
tpch_q08/duckdb:parquet 1777890850 1628709805 1.09
tpch_q09/duckdb:parquet 1469514065 1322518892 1.11
tpch_q10/duckdb:parquet 1367607130 1240610735 1.10
tpch_q11/duckdb:parquet 798367446 769612961 1.04
tpch_q12/duckdb:parquet 754362356 668566623 1.13
tpch_q13/duckdb:parquet 911635131 890291677 1.02
tpch_q14/duckdb:parquet 640521266 659303020 0.97
tpch_q15/duckdb:parquet 454039552 472233711 0.96
tpch_q16/duckdb:parquet 625781724 642731380 0.97
tpch_q17/duckdb:parquet 793815070 698354190 1.14
tpch_q18/duckdb:parquet 903561875 874180506 1.03
tpch_q19/duckdb:parquet 745490634 727596922 1.02
tpch_q20/duckdb:parquet 984203789 995196947 0.99
tpch_q21/duckdb:parquet 1171190649 1195403947 0.98
tpch_q22/duckdb:parquet 583779606 573457530 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +7.5% -2.5% +10.2% +85.4% ➖ noise
1 datafusion:vortex-file-compressed +16.9% -2.5% +19.8% +72.0% ➖ noise
1 duckdb:vortex-compact +5.9% -2.5% +8.6% +45.8% ➖ noise
1 duckdb:vortex-file-compressed +9.1% -2.5% +11.8% +47.7% ➖ noise
2 datafusion:vortex-compact +16.8% -7.5% +26.2% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +7.0% -7.5% +15.7% +30.8% ➖ noise
2 duckdb:vortex-compact +2.6% -7.5% +10.9% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -4.2% -7.5% +3.6% +30.0% ➖ noise
3 datafusion:vortex-compact +31.5% +14.5% +14.8% +60.4% ➖ noise
3 datafusion:vortex-file-compressed +5.8% +14.5% -7.6% +57.1% ➖ noise
3 duckdb:vortex-compact +5.5% +14.5% -7.9% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +6.7% +14.5% -6.8% +32.3% ➖ noise
4 datafusion:vortex-compact +3.8% +15.3% -9.9% +37.7% ➖ noise
4 datafusion:vortex-file-compressed +5.5% +15.3% -8.5% +31.2% ➖ noise
4 duckdb:vortex-compact +9.8% +15.3% -4.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +13.0% +15.3% -1.9% +30.0% ➖ noise
5 datafusion:vortex-compact +14.4% -0.5% +14.9% +42.3% ➖ noise
5 datafusion:vortex-file-compressed -1.2% -0.5% -0.8% +30.0% ➖ noise
5 duckdb:vortex-compact -2.6% -0.5% -2.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +0.4% -0.5% +0.9% +30.0% ➖ noise
6 datafusion:vortex-compact -26.5% -2.8% -24.4% +36.9% ➖ noise
6 datafusion:vortex-file-compressed +7.8% -2.8% +10.9% +31.9% ➖ noise
6 duckdb:vortex-compact -1.7% -2.8% +1.2% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +6.3% -2.8% +9.3% +30.0% ➖ noise
7 datafusion:vortex-compact +7.0% +5.9% +1.0% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +3.8% +5.9% -2.0% +30.0% ➖ noise
7 duckdb:vortex-compact +4.3% +5.9% -1.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +5.9% +5.9% -0.1% +30.0% ➖ noise
8 datafusion:vortex-compact -10.2% +4.5% -14.0% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -10.5% +4.5% -14.4% +30.0% ➖ noise
8 duckdb:vortex-compact +13.4% +4.5% +8.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -1.6% +4.5% -5.8% +30.0% ➖ noise
9 datafusion:vortex-compact +28.0% +5.4% +21.5% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -34.6% +5.4% -37.9% +30.0% ✅ faster
9 duckdb:vortex-compact +8.5% +5.4% +2.9% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +12.5% +5.4% +6.7% +30.0% ➖ noise
10 datafusion:vortex-compact +3.9% +5.7% -1.7% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -16.8% +5.7% -21.3% +30.0% ➖ noise
10 duckdb:vortex-compact -9.8% +5.7% -14.6% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +1.8% +5.7% -3.6% +30.0% ➖ noise
11 datafusion:vortex-compact -12.5% +1.5% -13.7% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +10.8% +1.5% +9.2% +30.0% ➖ noise
11 duckdb:vortex-compact +17.1% +1.5% +15.4% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +6.1% +1.5% +4.6% +30.0% ➖ noise
12 datafusion:vortex-compact -4.8% +9.7% -13.2% +43.7% ➖ noise
12 datafusion:vortex-file-compressed +12.1% +9.7% +2.2% +30.0% ➖ noise
12 duckdb:vortex-compact +1.1% +9.7% -7.8% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +11.2% +9.7% +1.3% +30.0% ➖ noise
13 datafusion:vortex-compact +57.5% +0.9% +56.1% +50.6% 🚨 regression
13 datafusion:vortex-file-compressed -19.4% +0.9% -20.1% +44.3% ➖ noise
13 duckdb:vortex-compact +3.8% +0.9% +2.9% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +6.5% +0.9% +5.6% +30.0% ➖ noise
14 datafusion:vortex-compact -2.1% +2.4% -4.4% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -11.0% +2.4% -13.1% +32.3% ➖ noise
14 duckdb:vortex-compact +6.3% +2.4% +3.8% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +11.2% +2.4% +8.6% +30.0% ➖ noise
15 datafusion:vortex-compact +2.4% +5.4% -2.8% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +1.8% +5.4% -3.4% +30.0% ➖ noise
15 duckdb:vortex-compact +3.9% +5.4% -1.4% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +2.1% +5.4% -3.1% +30.0% ➖ noise
16 datafusion:vortex-compact -4.7% -2.7% -2.0% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -3.6% -2.7% -0.9% +30.0% ➖ noise
16 duckdb:vortex-compact +11.8% -2.7% +15.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -3.4% -2.7% -0.7% +30.0% ➖ noise
17 datafusion:vortex-compact +13.3% +10.8% +2.3% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +7.1% +10.8% -3.3% +30.0% ➖ noise
17 duckdb:vortex-compact -4.2% +10.8% -13.5% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +10.5% +10.8% -0.3% +30.0% ➖ noise
18 datafusion:vortex-compact -4.7% +2.1% -6.7% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -2.9% +2.1% -5.0% +30.0% ➖ noise
18 duckdb:vortex-compact +2.4% +2.1% +0.3% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -13.8% +2.1% -15.6% +30.0% ➖ noise
19 datafusion:vortex-compact -2.0% +1.5% -3.5% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +8.7% +1.5% +7.0% +30.0% ➖ noise
19 duckdb:vortex-compact +13.3% +1.5% +11.6% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +6.8% +1.5% +5.2% +30.0% ➖ noise
20 datafusion:vortex-compact -3.6% -1.5% -2.0% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -1.7% -1.5% -0.2% +30.0% ➖ noise
20 duckdb:vortex-compact -1.5% -1.5% +0.1% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +11.9% -1.5% +13.7% +30.0% ➖ noise
21 datafusion:vortex-compact +32.0% +8.6% +21.6% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +11.3% +8.6% +2.5% +30.0% ➖ noise
21 duckdb:vortex-compact +9.2% +8.6% +0.6% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +10.7% +8.6% +1.9% +30.0% ➖ noise
22 datafusion:vortex-compact +136.3% +9.7% +115.5% +39.2% 🚨 regression
22 datafusion:vortex-file-compressed +27.0% +9.7% +15.8% +30.0% ➖ noise
22 duckdb:vortex-compact +5.7% +9.7% -3.6% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +8.1% +9.7% -1.4% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 1.100x ➖
Parquet (geomean): 1.067x ➖


unknown / unknown (1.079x ➖, 1↑ 13↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2059920 2493055 0.83
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1491237 1368981 1.09
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8950244967 8537703964 1.05
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8827534702 8419719172 1.05
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8365868 8135410 1.03
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚨 8385491 7501720 1.12
random-access/feature-vectors/uniform/lance-tokio-local-disk 6259638 5740122 1.09
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 7038222 6461343 1.09
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8966187219 8418165543 1.07
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8914247169 8439872921 1.06
random-access/feature-vectors/uniform/vortex-tokio-local-disk 14484531 13222257 1.10
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 14330667 13132312 1.09
random-access/lance-tokio-local-disk 784082 727390 1.08
random-access/lance-tokio-local-disk-footer 🚨 1387570 1226444 1.13
random-access/nested-lists/correlated/lance-tokio-local-disk 268898 247251 1.09
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚨 715612 616293 1.16
random-access/nested-lists/correlated/parquet-tokio-local-disk 135811035 129378289 1.05
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 136655004 128866060 1.06
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚨 709424 632742 1.12
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 724150 628881 1.15
random-access/nested-lists/uniform/lance-tokio-local-disk 1123786 1079482 1.04
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1576538 1455069 1.08
random-access/nested-lists/uniform/parquet-tokio-local-disk 137278482 131708258 1.04
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 137160897 129526861 1.06
random-access/nested-lists/uniform/vortex-tokio-local-disk 2315990 2129585 1.09
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2315093 2119551 1.09
random-access/nested-structs/correlated/lance-tokio-local-disk 411351 388346 1.06
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 🚨 636904 577357 1.10
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 28067666 25514815 1.10
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 28432971 25554722 1.11
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚨 892016 751309 1.19
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 904784 782757 1.16
random-access/nested-structs/uniform/lance-tokio-local-disk 2799837 2683328 1.04
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3085266 2891835 1.07
random-access/nested-structs/uniform/parquet-tokio-local-disk 27892691 26325433 1.06
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 28462510 26359660 1.08
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚨 1919860 1590830 1.21
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚨 1876092 1693060 1.11
random-access/parquet-tokio-local-disk 189473501 176817811 1.07
random-access/parquet-tokio-local-disk-footer 190188937 176854623 1.08
random-access/taxi/correlated/lance-tokio-local-disk 976250 917461 1.06
random-access/taxi/correlated/lance-tokio-local-disk-footer 1679846 1527581 1.10
random-access/taxi/correlated/parquet-tokio-local-disk 282746837 264024455 1.07
random-access/taxi/correlated/parquet-tokio-local-disk-footer 283421846 264184152 1.07
random-access/taxi/correlated/vortex-tokio-local-disk 1879145 1839154 1.02
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚨 2072206 1847822 1.12
random-access/taxi/uniform/lance-tokio-local-disk 10457812 9642294 1.08
random-access/taxi/uniform/lance-tokio-local-disk-footer 11214615 10229994 1.10
random-access/taxi/uniform/parquet-tokio-local-disk 298264855 279275173 1.07
random-access/taxi/uniform/parquet-tokio-local-disk-footer 296876808 280124295 1.06
random-access/taxi/uniform/vortex-tokio-local-disk 4967471 4602203 1.08
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4928644 4560394 1.08
random-access/vortex-tokio-local-disk 1343178 1293000 1.04
random-access/vortex-tokio-local-disk-footer 1365816 1323527 1.03

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.006x ➖
Parquet (geomean): 1.000x ➖


unknown / unknown (1.001x ➖, 0↑ 3↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
compress time/Arade 1100229826 1147130497 0.96
compress time/Bimbo 6633751684 6735376951 0.98
compress time/CMSprovider 2828543412 2878647346 0.98
compress time/Euro2016 425181511 425044384 1.00
compress time/Food 395518245 392527053 1.01
compress time/HashTags 807293510 838819777 0.96
compress time/TPC-H l_comment canonical 1304202819 1308397113 1.00
compress time/TPC-H l_comment chunked 1301482599 1301632402 1.00
compress time/taxi 703811434 717379108 0.98
compress time/wide table cols=100 chunks=1 rows=1000 12410420 12233997 1.01
compress time/wide table cols=100 chunks=50 rows=1000 10955071 11944540 0.92
compress time/wide table cols=1000 chunks=1 rows=1000 122780969 122634774 1.00
compress time/wide table cols=1000 chunks=50 rows=1000 122631197 127614229 0.96
compress time/wide table cols=10000 chunks=1 rows=1000 1421558824 1407386930 1.01
compress time/wide table cols=10000 chunks=50 rows=1000 1415717947 1422185028 1.00
decompress time/Arade 27934060 27889979 1.00
decompress time/Bimbo 92255058 92699028 1.00
decompress time/CMSprovider 86044871 80251862 1.07
decompress time/Euro2016 🚨 19714600 17905516 1.10
decompress time/Food 🚨 10163833 9202418 1.10
decompress time/HashTags 69373538 73384957 0.95
decompress time/TPC-H l_comment canonical 39494477 40073442 0.99
decompress time/TPC-H l_comment chunked 40828641 39879491 1.02
decompress time/taxi 16383506 16896679 0.97
decompress time/wide table cols=100 chunks=1 rows=1000 2627541 2601379 1.01
decompress time/wide table cols=100 chunks=50 rows=1000 2632945 2569127 1.02
decompress time/wide table cols=1000 chunks=1 rows=1000 23661262 22789427 1.04
decompress time/wide table cols=1000 chunks=50 rows=1000 24086742 23393968 1.03
decompress time/wide table cols=10000 chunks=1 rows=1000 256187319 254605380 1.01
decompress time/wide table cols=10000 chunks=50 rows=1000 260698520 265675635 0.98
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2918113462 2913863894 1.00
parquet_rs-zstd compress time/Bimbo 14610984084 15175461047 0.96
parquet_rs-zstd compress time/CMSprovider 7351796595 7570451696 0.97
parquet_rs-zstd compress time/Euro2016 1343097631 1349900131 0.99
parquet_rs-zstd compress time/Food 871944663 879740820 0.99
parquet_rs-zstd compress time/HashTags 2293870193 2319866560 0.99
parquet_rs-zstd compress time/TPC-H l_comment canonical 3109466794 3188294468 0.98
parquet_rs-zstd compress time/TPC-H l_comment chunked 3111899158 3119881014 1.00
parquet_rs-zstd compress time/taxi 1339441571 1365609905 0.98
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6757241 6741584 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6697444 6845618 0.98
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 83366234 82198814 1.01
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 81518387 84165099 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 864866023 874287848 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 864908029 913029290 0.95
parquet_rs-zstd decompress time/Arade 640812039 643526558 1.00
parquet_rs-zstd decompress time/Bimbo 1706298835 1698642290 1.00
parquet_rs-zstd decompress time/CMSprovider 1964388914 1925451192 1.02
parquet_rs-zstd decompress time/Euro2016 381361685 379347096 1.01
parquet_rs-zstd decompress time/Food 217564722 219501768 0.99
parquet_rs-zstd decompress time/HashTags 637408310 623489368 1.02
parquet_rs-zstd decompress time/TPC-H l_comment canonical 564010798 572714643 0.98
parquet_rs-zstd decompress time/TPC-H l_comment chunked 570630779 572048895 1.00
parquet_rs-zstd decompress time/taxi 243790374 245095613 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2730702 2767104 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2749319 2776734 0.99
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31982232 32249013 0.99
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 31823580 32845027 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 341227120 346067183 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 342324474 346280192 0.99
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163364604 163599156 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.96
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.02
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.01
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio compress time/Food 0 0 1.02
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.97
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.94
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.05
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.01
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.05
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.10
vortex:parquet-zstd ratio decompress time/Food 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.92
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.99
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.5%
Vortex (geomean): 0.977x ➖
Parquet (geomean): 0.972x ➖
Shifts: Parquet (control) -2.8% · Median polish -1.4%


datafusion / vortex-file-compressed (0.997x ➖, 1↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 713523050 692521770 1.03
tpch_q02/datafusion:vortex-file-compressed 713089651 817304909 0.87
tpch_q03/datafusion:vortex-file-compressed 🚀 817332263 1208817058 0.68
tpch_q04/datafusion:vortex-file-compressed 561464623 743910718 0.75
tpch_q05/datafusion:vortex-file-compressed 1029402018 985549307 1.04
tpch_q06/datafusion:vortex-file-compressed 712415008 657603525 1.08
tpch_q07/datafusion:vortex-file-compressed 1140996296 1021655447 1.12
tpch_q08/datafusion:vortex-file-compressed 1363545460 1139087314 1.20
tpch_q09/datafusion:vortex-file-compressed 1371795400 1251388468 1.10
tpch_q10/datafusion:vortex-file-compressed 927585076 871965442 1.06
tpch_q11/datafusion:vortex-file-compressed 452176568 441784426 1.02
tpch_q12/datafusion:vortex-file-compressed 852700943 1016289596 0.84
tpch_q13/datafusion:vortex-file-compressed 443581676 462256119 0.96
tpch_q14/datafusion:vortex-file-compressed 775886766 690141495 1.12
tpch_q15/datafusion:vortex-file-compressed 1431810463 1173531794 1.22
tpch_q16/datafusion:vortex-file-compressed 389341721 362003353 1.08
tpch_q17/datafusion:vortex-file-compressed 1236800633 1221064489 1.01
tpch_q18/datafusion:vortex-file-compressed 1186520315 1346802924 0.88
tpch_q19/datafusion:vortex-file-compressed 773054746 869267987 0.89
tpch_q20/datafusion:vortex-file-compressed 1027094336 1073214260 0.96
tpch_q21/datafusion:vortex-file-compressed 1697674220 1569499931 1.08
tpch_q22/datafusion:vortex-file-compressed 442196975 379007127 1.17
datafusion / vortex-compact (0.986x ➖, 0↑ 1↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 678291279 776486936 0.87
tpch_q02/datafusion:vortex-compact 516485994 681494876 0.76
tpch_q03/datafusion:vortex-compact 680629377 719297507 0.95
tpch_q04/datafusion:vortex-compact 537739788 516532204 1.04
tpch_q05/datafusion:vortex-compact 898316328 851490442 1.05
tpch_q06/datafusion:vortex-compact 583536827 591079255 0.99
tpch_q07/datafusion:vortex-compact 1276907096 1019521350 1.25
tpch_q08/datafusion:vortex-compact 1277821719 1026099600 1.25
tpch_q09/datafusion:vortex-compact 1145344607 1134686724 1.01
tpch_q10/datafusion:vortex-compact 935184856 811842761 1.15
tpch_q11/datafusion:vortex-compact 398995009 378623417 1.05
tpch_q12/datafusion:vortex-compact 899065229 1052936409 0.85
tpch_q13/datafusion:vortex-compact 399036650 520336310 0.77
tpch_q14/datafusion:vortex-compact 610628725 805793351 0.76
tpch_q15/datafusion:vortex-compact 1087418099 1228895943 0.88
tpch_q16/datafusion:vortex-compact 265493179 311750804 0.85
tpch_q17/datafusion:vortex-compact 1085806709 1154311837 0.94
tpch_q18/datafusion:vortex-compact 1078168609 1112709470 0.97
tpch_q19/datafusion:vortex-compact 🚨 960063006 737053633 1.30
tpch_q20/datafusion:vortex-compact 953178405 824737040 1.16
tpch_q21/datafusion:vortex-compact 1338215555 1359797810 0.98
tpch_q22/datafusion:vortex-compact 382926913 339038932 1.13
datafusion / parquet (0.943x ➖, 2↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 700214897 678719929 1.03
tpch_q02/datafusion:parquet 672527003 601491236 1.12
tpch_q03/datafusion:parquet 922249638 1244940050 0.74
tpch_q04/datafusion:parquet 564178091 606604810 0.93
tpch_q05/datafusion:parquet 1179299400 1229971667 0.96
tpch_q06/datafusion:parquet 520211740 510983122 1.02
tpch_q07/datafusion:parquet 1322986788 1237976743 1.07
tpch_q08/datafusion:parquet 1474281202 1483091167 0.99
tpch_q09/datafusion:parquet 1758985127 1673558558 1.05
tpch_q10/datafusion:parquet 2010340677 1973944384 1.02
tpch_q11/datafusion:parquet 514442605 527560765 0.98
tpch_q12/datafusion:parquet 🚀 669460070 1041508653 0.64
tpch_q13/datafusion:parquet 700870944 748492384 0.94
tpch_q14/datafusion:parquet 793798372 782839840 1.01
tpch_q15/datafusion:parquet 1122910788 1239259996 0.91
tpch_q16/datafusion:parquet 352802439 454550756 0.78
tpch_q17/datafusion:parquet 1345132748 1415685240 0.95
tpch_q18/datafusion:parquet 1396135152 1574789157 0.89
tpch_q19/datafusion:parquet 974906511 965044130 1.01
tpch_q20/datafusion:parquet 1357741162 1103350031 1.23
tpch_q21/datafusion:parquet 1716574631 1628147556 1.05
tpch_q22/datafusion:parquet 🚀 656305305 962792038 0.68
duckdb / vortex-file-compressed (0.977x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 601530985 650156158 0.93
tpch_q02/duckdb:vortex-file-compressed 1102423356 1108989694 0.99
tpch_q03/duckdb:vortex-file-compressed 959966223 1160489561 0.83
tpch_q04/duckdb:vortex-file-compressed 593052239 696676603 0.85
tpch_q05/duckdb:vortex-file-compressed 1127189491 1147182522 0.98
tpch_q06/duckdb:vortex-file-compressed 840832659 851101464 0.99
tpch_q07/duckdb:vortex-file-compressed 1240448025 1207515303 1.03
tpch_q08/duckdb:vortex-file-compressed 1383969807 1467921659 0.94
tpch_q09/duckdb:vortex-file-compressed 1418083127 1493817833 0.95
tpch_q10/duckdb:vortex-file-compressed 1077138584 1190440203 0.90
tpch_q11/duckdb:vortex-file-compressed 709195991 643759730 1.10
tpch_q12/duckdb:vortex-file-compressed 689297912 706404960 0.98
tpch_q13/duckdb:vortex-file-compressed 971022571 894807581 1.09
tpch_q14/duckdb:vortex-file-compressed 907949252 899290509 1.01
tpch_q15/duckdb:vortex-file-compressed 551208848 573300425 0.96
tpch_q16/duckdb:vortex-file-compressed 470777141 500729160 0.94
tpch_q17/duckdb:vortex-file-compressed 1081232087 1044557342 1.04
tpch_q18/duckdb:vortex-file-compressed 942230422 937378789 1.01
tpch_q19/duckdb:vortex-file-compressed 740722434 801968027 0.92
tpch_q20/duckdb:vortex-file-compressed 1147679966 1196944794 0.96
tpch_q21/duckdb:vortex-file-compressed 2042212025 2029196782 1.01
tpch_q22/duckdb:vortex-file-compressed 723387544 627238395 1.15
duckdb / vortex-compact (0.948x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 609938949 627863879 0.97
tpch_q02/duckdb:vortex-compact 1002823662 1026861851 0.98
tpch_q03/duckdb:vortex-compact 752252030 817320748 0.92
tpch_q04/duckdb:vortex-compact 494820782 561612850 0.88
tpch_q05/duckdb:vortex-compact 920795726 1031423997 0.89
tpch_q06/duckdb:vortex-compact 728118816 920000455 0.79
tpch_q07/duckdb:vortex-compact 1022092073 1160181263 0.88
tpch_q08/duckdb:vortex-compact 1279598114 1330642386 0.96
tpch_q09/duckdb:vortex-compact 1294964613 1368465852 0.95
tpch_q10/duckdb:vortex-compact 959862272 1064856749 0.90
tpch_q11/duckdb:vortex-compact 720244270 687156059 1.05
tpch_q12/duckdb:vortex-compact 628661584 650175168 0.97
tpch_q13/duckdb:vortex-compact 879243724 827993698 1.06
tpch_q14/duckdb:vortex-compact 839140055 884235304 0.95
tpch_q15/duckdb:vortex-compact 558724627 568053685 0.98
tpch_q16/duckdb:vortex-compact 411700402 465494306 0.88
tpch_q17/duckdb:vortex-compact 931122764 923976418 1.01
tpch_q18/duckdb:vortex-compact 733867377 728438056 1.01
tpch_q19/duckdb:vortex-compact 708074856 744370551 0.95
tpch_q20/duckdb:vortex-compact 1200967679 1250037055 0.96
tpch_q21/duckdb:vortex-compact 1781595187 1698955811 1.05
tpch_q22/duckdb:vortex-compact 558212683 617629595 0.90
duckdb / parquet (1.001x ➖, 0↑ 0↓)
name PR d4c70e0 (ns) base 75808d5 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 793979251 763701293 1.04
tpch_q02/duckdb:parquet 1409438109 1442825585 0.98
tpch_q03/duckdb:parquet 1911510493 1690320632 1.13
tpch_q04/duckdb:parquet 882003918 1108042206 0.80
tpch_q05/duckdb:parquet 1946687670 2011374604 0.97
tpch_q06/duckdb:parquet 679403465 697538645 0.97
tpch_q07/duckdb:parquet 1875804688 1826674018 1.03
tpch_q08/duckdb:parquet 2456520344 2568871010 0.96
tpch_q09/duckdb:parquet 2286075077 2621986835 0.87
tpch_q10/duckdb:parquet 3336527842 2919126990 1.14
tpch_q11/duckdb:parquet 1098050980 1118279272 0.98
tpch_q12/duckdb:parquet 1104959033 1094392488 1.01
tpch_q13/duckdb:parquet 1220989276 1206537779 1.01
tpch_q14/duckdb:parquet 1297766035 1211209652 1.07
tpch_q15/duckdb:parquet 885369978 856095660 1.03
tpch_q16/duckdb:parquet 772243090 847871733 0.91
tpch_q17/duckdb:parquet 1281819260 1240543826 1.03
tpch_q18/duckdb:parquet 1453085289 1328253421 1.09
tpch_q19/duckdb:parquet 1470307850 1457149739 1.01
tpch_q20/duckdb:parquet 1804906152 1747090119 1.03
tpch_q21/duckdb:parquet 1792566299 1866452620 0.96
tpch_q22/duckdb:parquet 1086363721 1032733142 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -12.6% +3.6% -15.7% +44.4% ➖ noise
1 datafusion:vortex-file-compressed +3.0% +3.6% -0.5% +52.6% ➖ noise
1 duckdb:vortex-compact -2.9% +3.6% -6.2% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -7.5% +3.6% -10.7% +32.6% ➖ noise
2 datafusion:vortex-compact -24.2% +4.5% -27.5% +50.0% ➖ noise
2 datafusion:vortex-file-compressed -12.8% +4.5% -16.5% +39.7% ➖ noise
2 duckdb:vortex-compact -2.3% +4.5% -6.6% +33.2% ➖ noise
2 duckdb:vortex-file-compressed -0.6% +4.5% -4.9% +40.6% ➖ noise
3 datafusion:vortex-compact -5.4% -8.5% +3.4% +48.5% ➖ noise
3 datafusion:vortex-file-compressed -32.4% -8.5% -26.1% +45.3% ➖ noise
3 duckdb:vortex-compact -8.0% -8.5% +0.6% +38.2% ➖ noise
3 duckdb:vortex-file-compressed -17.3% -8.5% -9.6% +39.2% ➖ noise
4 datafusion:vortex-compact +4.1% -14.0% +21.0% +32.0% ➖ noise
4 datafusion:vortex-file-compressed -24.5% -14.0% -12.3% +35.8% ➖ noise
4 duckdb:vortex-compact -11.9% -14.0% +2.4% +36.7% ➖ noise
4 duckdb:vortex-file-compressed -14.9% -14.0% -1.1% +30.0% ➖ noise
5 datafusion:vortex-compact +5.5% -3.7% +9.5% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +4.4% -3.7% +8.4% +30.0% ➖ noise
5 duckdb:vortex-compact -10.7% -3.7% -7.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -1.7% -3.7% +2.0% +35.6% ➖ noise
6 datafusion:vortex-compact -1.3% -0.4% -0.9% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +8.3% -0.4% +8.8% +30.0% ➖ noise
6 duckdb:vortex-compact -20.9% -0.4% -20.5% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -1.2% -0.4% -0.8% +30.0% ➖ noise
7 datafusion:vortex-compact +25.2% +4.8% +19.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +11.7% +4.8% +6.6% +30.0% ➖ noise
7 duckdb:vortex-compact -11.9% +4.8% -15.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +2.7% +4.8% -1.9% +30.0% ➖ noise
8 datafusion:vortex-compact +24.5% -2.5% +27.7% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +19.7% -2.5% +22.8% +30.0% ➖ noise
8 duckdb:vortex-compact -3.8% -2.5% -1.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -5.7% -2.5% -3.3% +30.0% ➖ noise
9 datafusion:vortex-compact +0.9% -4.3% +5.4% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +9.6% -4.3% +14.5% +30.0% ➖ noise
9 duckdb:vortex-compact -5.4% -4.3% -1.1% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -5.1% -4.3% -0.8% +30.0% ➖ noise
10 datafusion:vortex-compact +15.2% +7.9% +6.8% +55.4% ➖ noise
10 datafusion:vortex-file-compressed +6.4% +7.9% -1.4% +55.7% ➖ noise
10 duckdb:vortex-compact -9.9% +7.9% -16.5% +59.2% ➖ noise
10 duckdb:vortex-file-compressed -9.5% +7.9% -16.1% +55.7% ➖ noise
11 datafusion:vortex-compact +5.4% -2.1% +7.7% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +2.4% -2.1% +4.6% +30.0% ➖ noise
11 duckdb:vortex-compact +4.8% -2.1% +7.1% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +10.2% -2.1% +12.6% +30.0% ➖ noise
12 datafusion:vortex-compact -14.6% -19.4% +6.0% +36.9% ➖ noise
12 datafusion:vortex-file-compressed -16.1% -19.4% +4.2% +30.0% ➖ noise
12 duckdb:vortex-compact -3.3% -19.4% +20.0% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -2.4% -19.4% +21.1% +30.0% ➖ noise
13 datafusion:vortex-compact -23.3% -2.7% -21.2% +30.0% ➖ noise
13 datafusion:vortex-file-compressed -4.0% -2.7% -1.4% +35.3% ➖ noise
13 duckdb:vortex-compact +6.2% -2.7% +9.1% +38.2% ➖ noise
13 duckdb:vortex-file-compressed +8.5% -2.7% +11.5% +44.4% ➖ noise
14 datafusion:vortex-compact -24.2% +4.2% -27.3% +30.0% ✅ faster
14 datafusion:vortex-file-compressed +12.4% +4.2% +7.9% +30.0% ➖ noise
14 duckdb:vortex-compact -5.1% +4.2% -9.0% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +1.0% +4.2% -3.1% +30.0% ➖ noise
15 datafusion:vortex-compact -11.5% -3.2% -8.6% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +22.0% -3.2% +26.0% +30.0% ➖ noise
15 duckdb:vortex-compact -1.6% -3.2% +1.6% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -3.9% -3.2% -0.7% +30.0% ➖ noise
16 datafusion:vortex-compact -14.8% -15.9% +1.3% +34.6% ➖ noise
16 datafusion:vortex-file-compressed +7.6% -15.9% +27.9% +44.2% ➖ noise
16 duckdb:vortex-compact -11.6% -15.9% +5.2% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -6.0% -15.9% +11.8% +30.0% ➖ noise
17 datafusion:vortex-compact -5.9% -0.9% -5.1% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +1.3% -0.9% +2.2% +30.0% ➖ noise
17 duckdb:vortex-compact +0.8% -0.9% +1.7% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +3.5% -0.9% +4.5% +30.0% ➖ noise
18 datafusion:vortex-compact -3.1% -1.5% -1.6% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -11.9% -1.5% -10.5% +30.0% ➖ noise
18 duckdb:vortex-compact +0.7% -1.5% +2.3% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +0.5% -1.5% +2.1% +30.0% ➖ noise
19 datafusion:vortex-compact +30.3% +1.0% +29.0% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -11.1% +1.0% -11.9% +30.0% ➖ noise
19 duckdb:vortex-compact -4.9% +1.0% -5.8% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -7.6% +1.0% -8.5% +30.0% ➖ noise
20 datafusion:vortex-compact +15.6% +12.8% +2.5% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -4.3% +12.8% -15.1% +30.0% ➖ noise
20 duckdb:vortex-compact -3.9% +12.8% -14.8% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -4.1% +12.8% -15.0% +30.0% ➖ noise
21 datafusion:vortex-compact -1.6% +0.6% -2.2% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +8.2% +0.6% +7.5% +30.0% ➖ noise
21 duckdb:vortex-compact +4.9% +0.6% +4.2% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +0.6% +0.6% +0.0% +30.0% ➖ noise
22 datafusion:vortex-compact +12.9% -15.3% +33.4% +36.4% ➖ noise
22 datafusion:vortex-file-compressed +16.7% -15.3% +37.8% +30.0% 🚨 regression
22 duckdb:vortex-compact -9.6% -15.3% +6.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +15.3% -15.3% +36.2% +30.0% 🚨 regression

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants