Skip to content

feat: very wide column benchmark#8252

Open
joseph-isaacs wants to merge 1 commit into
developfrom
ji/wide-col-projection
Open

feat: very wide column benchmark#8252
joseph-isaacs wants to merge 1 commit into
developfrom
ji/wide-col-projection

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

Summary

Closes: #000

Testing

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Jun 4, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 4, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 9a0f3ba 2 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done 9a0f3ba 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.012x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.012x ➖, 1↑ 1↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 114273366 113925796 1.00
polarsignals_q01/datafusion:vortex-file-compressed 262471309 273776064 0.96
polarsignals_q02/datafusion:vortex-file-compressed 21721023 22652918 0.96
polarsignals_q03/datafusion:vortex-file-compressed 283126408 265760231 1.07
polarsignals_q04/datafusion:vortex-file-compressed 🚨 10181621 9170514 1.11
polarsignals_q05/datafusion:vortex-file-compressed 14367708 13347714 1.08
polarsignals_q06/datafusion:vortex-file-compressed 18308793 17666009 1.04
polarsignals_q07/datafusion:vortex-file-compressed 13636998 12601399 1.08
polarsignals_q08/datafusion:vortex-file-compressed 384382169 400989053 0.96
polarsignals_q09/datafusion:vortex-file-compressed 🚀 10060559 11274453 0.89

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.7%, environment too noisy confidence) · DuckDB No clear signal (-1.1%, environment too noisy confidence)
Vortex (geomean): 0.971x ➖
Parquet (geomean): 0.964x ➖
Shifts: Parquet (control) -3.6% · Median polish -3.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.986x ➖, 0↑ 1↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51721820 52920068 0.98
tpch_q02/datafusion:vortex-file-compressed 22933490 23756854 0.97
tpch_q03/datafusion:vortex-file-compressed 27634078 27175522 1.02
tpch_q04/datafusion:vortex-file-compressed 20285677 20842541 0.97
tpch_q05/datafusion:vortex-file-compressed 49420538 52853858 0.94
tpch_q06/datafusion:vortex-file-compressed 10531273 10006619 1.05
tpch_q07/datafusion:vortex-file-compressed 55973005 59781288 0.94
tpch_q08/datafusion:vortex-file-compressed 41667591 42312438 0.98
tpch_q09/datafusion:vortex-file-compressed 52409366 54969486 0.95
tpch_q10/datafusion:vortex-file-compressed 43868492 44952807 0.98
tpch_q11/datafusion:vortex-file-compressed 16400838 17115431 0.96
tpch_q12/datafusion:vortex-file-compressed 25125657 23829531 1.05
tpch_q13/datafusion:vortex-file-compressed 26762233 27944023 0.96
tpch_q14/datafusion:vortex-file-compressed 15985787 15906891 1.00
tpch_q15/datafusion:vortex-file-compressed 24416278 23303918 1.05
tpch_q16/datafusion:vortex-file-compressed 19781975 21071142 0.94
tpch_q17/datafusion:vortex-file-compressed 66699787 69522698 0.96
tpch_q18/datafusion:vortex-file-compressed 84751166 88436305 0.96
tpch_q19/datafusion:vortex-file-compressed 🚨 21416299 18942773 1.13
tpch_q20/datafusion:vortex-file-compressed 29030742 30277380 0.96
tpch_q21/datafusion:vortex-file-compressed 71280215 73287037 0.97
tpch_q22/datafusion:vortex-file-compressed 11824733 11773481 1.00
datafusion / vortex-compact (0.973x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 57793976 59680196 0.97
tpch_q02/datafusion:vortex-compact 26095871 27572478 0.95
tpch_q03/datafusion:vortex-compact 28748487 28950609 0.99
tpch_q04/datafusion:vortex-compact 22003124 22687349 0.97
tpch_q05/datafusion:vortex-compact 49438520 54461830 0.91
tpch_q06/datafusion:vortex-compact 12686086 11697176 1.08
tpch_q07/datafusion:vortex-compact 59407154 60983545 0.97
tpch_q08/datafusion:vortex-compact 42683864 44762807 0.95
tpch_q09/datafusion:vortex-compact 57077469 58988145 0.97
tpch_q10/datafusion:vortex-compact 45183220 46933801 0.96
tpch_q11/datafusion:vortex-compact 17271766 18504869 0.93
tpch_q12/datafusion:vortex-compact 32133938 30521683 1.05
tpch_q13/datafusion:vortex-compact 31678495 34169019 0.93
tpch_q14/datafusion:vortex-compact 19119032 19542318 0.98
tpch_q15/datafusion:vortex-compact 30709960 30421640 1.01
tpch_q16/datafusion:vortex-compact 25553577 26674253 0.96
tpch_q17/datafusion:vortex-compact 71565958 74409604 0.96
tpch_q18/datafusion:vortex-compact 84949183 92046882 0.92
tpch_q19/datafusion:vortex-compact 31149333 29112923 1.07
tpch_q20/datafusion:vortex-compact 34528928 35295395 0.98
tpch_q21/datafusion:vortex-compact 76770668 80544473 0.95
tpch_q22/datafusion:vortex-compact 12743363 13274824 0.96
datafusion / parquet (0.953x ➖, 3↑ 1↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 118677339 123345295 0.96
tpch_q02/datafusion:parquet 61563521 65946082 0.93
tpch_q03/datafusion:parquet 72127581 75821628 0.95
tpch_q04/datafusion:parquet 43153099 45500586 0.95
tpch_q05/datafusion:parquet 93627286 98550442 0.95
tpch_q06/datafusion:parquet 41046729 42690162 0.96
tpch_q07/datafusion:parquet 105617494 111671097 0.95
tpch_q08/datafusion:parquet 94861572 101079122 0.94
tpch_q09/datafusion:parquet 123544059 132690992 0.93
tpch_q10/datafusion:parquet 112138699 117462906 0.95
tpch_q11/datafusion:parquet 40642484 44242091 0.92
tpch_q12/datafusion:parquet 🚨 86889327 78481287 1.11
tpch_q13/datafusion:parquet 🚀 195979779 218136611 0.90
tpch_q14/datafusion:parquet 48059540 48243720 1.00
tpch_q15/datafusion:parquet 58503994 59536894 0.98
tpch_q16/datafusion:parquet 🚀 39558555 45665170 0.87
tpch_q17/datafusion:parquet 🚀 128685832 143914033 0.89
tpch_q18/datafusion:parquet 159996364 172751444 0.93
tpch_q19/datafusion:parquet 78776619 78327202 1.01
tpch_q20/datafusion:parquet 69250653 70891496 0.98
tpch_q21/datafusion:parquet 135882861 140362571 0.97
tpch_q22/datafusion:parquet 31827466 32482613 0.98
datafusion / arrow (0.922x ➖, 8↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 56057416 61238822 0.92
tpch_q02/datafusion:arrow 🚀 18362185 21807201 0.84
tpch_q03/datafusion:arrow 29363208 31749626 0.92
tpch_q04/datafusion:arrow 24924801 27283083 0.91
tpch_q05/datafusion:arrow 85060952 78919172 1.08
tpch_q06/datafusion:arrow 21401686 20881284 1.02
tpch_q07/datafusion:arrow 104113842 107856006 0.97
tpch_q08/datafusion:arrow 42782961 47032680 0.91
tpch_q09/datafusion:arrow 🚀 64690446 77014275 0.84
tpch_q10/datafusion:arrow 🚀 45426366 52612026 0.86
tpch_q11/datafusion:arrow 9157236 9735936 0.94
tpch_q12/datafusion:arrow 🚀 50101261 56043421 0.89
tpch_q13/datafusion:arrow 46894094 48656288 0.96
tpch_q14/datafusion:arrow 🚀 21164103 23732552 0.89
tpch_q15/datafusion:arrow 🚀 42020663 46919181 0.90
tpch_q16/datafusion:arrow 19117496 19649454 0.97
tpch_q17/datafusion:arrow 🚀 66841922 76580056 0.87
tpch_q18/datafusion:arrow 134794558 149315469 0.90
tpch_q19/datafusion:arrow 35315406 39151554 0.90
tpch_q20/datafusion:arrow 🚀 34836779 38757032 0.90
tpch_q21/datafusion:arrow 155206792 154891741 1.00
tpch_q22/datafusion:arrow 17582164 19206234 0.92
duckdb / vortex-file-compressed (0.966x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31424522 31889384 0.99
tpch_q02/duckdb:vortex-file-compressed 26151300 25945071 1.01
tpch_q03/duckdb:vortex-file-compressed 32899234 34201272 0.96
tpch_q04/duckdb:vortex-file-compressed 29049906 29735264 0.98
tpch_q05/duckdb:vortex-file-compressed 38284724 39210303 0.98
tpch_q06/duckdb:vortex-file-compressed 8331441 8784126 0.95
tpch_q07/duckdb:vortex-file-compressed 35179028 37012856 0.95
tpch_q08/duckdb:vortex-file-compressed 36904536 38359871 0.96
tpch_q09/duckdb:vortex-file-compressed 58901065 61754070 0.95
tpch_q10/duckdb:vortex-file-compressed 41739698 43068720 0.97
tpch_q11/duckdb:vortex-file-compressed 15515608 16241356 0.96
tpch_q12/duckdb:vortex-file-compressed 22741011 23966799 0.95
tpch_q13/duckdb:vortex-file-compressed 41376576 43415155 0.95
tpch_q14/duckdb:vortex-file-compressed 21945479 22541277 0.97
tpch_q15/duckdb:vortex-file-compressed 17255211 17404643 0.99
tpch_q16/duckdb:vortex-file-compressed 30222042 31371608 0.96
tpch_q17/duckdb:vortex-file-compressed 25101499 25594739 0.98
tpch_q18/duckdb:vortex-file-compressed 53680449 56327860 0.95
tpch_q19/duckdb:vortex-file-compressed 30316505 31327746 0.97
tpch_q20/duckdb:vortex-file-compressed 33775346 35222952 0.96
tpch_q21/duckdb:vortex-file-compressed 105093589 107617372 0.98
tpch_q22/duckdb:vortex-file-compressed 17175077 18173666 0.95
duckdb / vortex-compact (0.960x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38757069 39175716 0.99
tpch_q02/duckdb:vortex-compact 33376661 36496839 0.91
tpch_q03/duckdb:vortex-compact 34573319 36328603 0.95
tpch_q04/duckdb:vortex-compact 31356056 32937146 0.95
tpch_q05/duckdb:vortex-compact 41810192 43325473 0.97
tpch_q06/duckdb:vortex-compact 10844260 11516471 0.94
tpch_q07/duckdb:vortex-compact 41423397 43465525 0.95
tpch_q08/duckdb:vortex-compact 41638220 43154856 0.96
tpch_q09/duckdb:vortex-compact 66747963 69040829 0.97
tpch_q10/duckdb:vortex-compact 45765296 47956195 0.95
tpch_q11/duckdb:vortex-compact 18580047 18492344 1.00
tpch_q12/duckdb:vortex-compact 30323826 31797749 0.95
tpch_q13/duckdb:vortex-compact 47746811 48954001 0.98
tpch_q14/duckdb:vortex-compact 26103933 28069131 0.93
tpch_q15/duckdb:vortex-compact 20413247 20677372 0.99
tpch_q16/duckdb:vortex-compact 31528159 34552507 0.91
tpch_q17/duckdb:vortex-compact 29634903 29533815 1.00
tpch_q18/duckdb:vortex-compact 55570210 56423819 0.98
tpch_q19/duckdb:vortex-compact 34372078 35461102 0.97
tpch_q20/duckdb:vortex-compact 40293081 41444842 0.97
tpch_q21/duckdb:vortex-compact 103324500 109042539 0.95
tpch_q22/duckdb:vortex-compact 18874702 20202981 0.93
duckdb / parquet (0.975x ➖, 3↑ 1↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77818997 78438383 0.99
tpch_q02/duckdb:parquet 39309609 41204968 0.95
tpch_q03/duckdb:parquet 70913545 72641271 0.98
tpch_q04/duckdb:parquet 🚀 49941031 56747725 0.88
tpch_q05/duckdb:parquet 68727507 69487043 0.99
tpch_q06/duckdb:parquet 22413862 23032415 0.97
tpch_q07/duckdb:parquet 76135107 76122326 1.00
tpch_q08/duckdb:parquet 🚀 82130072 92735016 0.89
tpch_q09/duckdb:parquet 🚀 133755289 150124244 0.89
tpch_q10/duckdb:parquet 128679659 130345327 0.99
tpch_q11/duckdb:parquet 22905698 23331603 0.98
tpch_q12/duckdb:parquet 🚨 59336804 53166391 1.12
tpch_q13/duckdb:parquet 255377357 273552783 0.93
tpch_q14/duckdb:parquet 52399418 52426434 1.00
tpch_q15/duckdb:parquet 26099550 26660643 0.98
tpch_q16/duckdb:parquet 58702203 60699053 0.97
tpch_q17/duckdb:parquet 58390692 58991398 0.99
tpch_q18/duckdb:parquet 120636207 122512121 0.98
tpch_q19/duckdb:parquet 85117427 82217212 1.04
tpch_q20/duckdb:parquet 66470558 66615229 1.00
tpch_q21/duckdb:parquet 177270269 182208223 0.97
tpch_q22/duckdb:parquet 54211546 54942380 0.99
duckdb / duckdb (0.965x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17547107 18324035 0.96
tpch_q02/duckdb:duckdb 14938863 15615998 0.96
tpch_q03/duckdb:duckdb 22266738 23626030 0.94
tpch_q04/duckdb:duckdb 22526166 23757244 0.95
tpch_q05/duckdb:duckdb 24050523 24215817 0.99
tpch_q06/duckdb:duckdb 6999999 7276125 0.96
tpch_q07/duckdb:duckdb 25588174 27214524 0.94
tpch_q08/duckdb:duckdb 24449741 25100959 0.97
tpch_q09/duckdb:duckdb 59381932 60737412 0.98
tpch_q10/duckdb:duckdb 50623150 53624601 0.94
tpch_q11/duckdb:duckdb 7457050 7693432 0.97
tpch_q12/duckdb:duckdb 18098418 18259509 0.99
tpch_q13/duckdb:duckdb 39731522 41696495 0.95
tpch_q14/duckdb:duckdb 22187403 22465309 0.99
tpch_q15/duckdb:duckdb 13774219 14123344 0.98
tpch_q16/duckdb:duckdb 26358610 27457737 0.96
tpch_q17/duckdb:duckdb 16384282 17101769 0.96
tpch_q18/duckdb:duckdb 41092589 41608512 0.99
tpch_q19/duckdb:duckdb 31438762 33091391 0.95
tpch_q20/duckdb:duckdb 25258534 26451904 0.95
tpch_q21/duckdb:duckdb 62365055 64907792 0.96
tpch_q22/duckdb:duckdb 25543896 25740565 0.99

File Size Changes (10 files changed, -0.2% overall, 4↑ 6↓)
File Scale Format Base HEAD Change %
partsupp_0.vortex 1.0 vortex-compact 20.91 MB 21.09 MB +184.09 KB +0.9%
part_0.vortex 1.0 vortex-file-compressed 4.98 MB 5.02 MB +31.66 KB +0.6%
lineitem_1.vortex 1.0 vortex-file-compressed 84.61 MB 84.69 MB +77.90 KB +0.1%
partsupp_0.vortex 1.0 vortex-file-compressed 23.82 MB 23.83 MB +10.20 KB +0.0%
part_0.vortex 1.0 vortex-compact 3.49 MB 3.48 MB 4.41 KB -0.1%
lineitem_0.vortex 1.0 vortex-file-compressed 85.27 MB 85.09 MB 187.77 KB -0.2%
customer_0.vortex 1.0 vortex-file-compressed 8.91 MB 8.89 MB 21.07 KB -0.2%
orders_0.vortex 1.0 vortex-file-compressed 38.69 MB 38.14 MB 564.12 KB -1.4%
orders_0.vortex 1.0 vortex-compact 32.20 MB 31.73 MB 482.27 KB -1.5%
supplier_0.vortex 1.0 vortex-file-compressed 615.19 KB 605.09 KB 10.09 KB -1.6%

Totals:

  • vortex-compact: 190.82 MB → 190.53 MB (-0.2%)
  • vortex-file-compressed: 247.16 MB → 246.51 MB (-0.3%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -8.5% -2.3% -6.3% +18.6% ➖ noise
1 datafusion:vortex-compact -3.2% -2.3% -0.9% +16.9% ➖ noise
1 datafusion:vortex-file-compressed -2.3% -2.3% +0.0% +17.3% ➖ noise
1 duckdb:duckdb -4.2% -2.3% -2.0% +15.5% ➖ noise
1 duckdb:vortex-compact -1.1% -2.3% +1.3% +15.9% ➖ noise
1 duckdb:vortex-file-compressed -1.5% -2.3% +0.9% +18.3% ➖ noise
2 datafusion:arrow -15.8% -5.6% -10.8% +12.3% ➖ noise
2 datafusion:vortex-compact -5.4% -5.6% +0.3% +12.3% ➖ noise
2 datafusion:vortex-file-compressed -3.5% -5.6% +2.3% +12.3% ➖ noise
2 duckdb:duckdb -4.3% -5.6% +1.4% +12.3% ➖ noise
2 duckdb:vortex-compact -8.5% -5.6% -3.1% +12.3% ➖ noise
2 duckdb:vortex-file-compressed +0.8% -5.6% +6.8% +12.3% ➖ noise
3 datafusion:arrow -7.5% -3.6% -4.0% +12.3% ➖ noise
3 datafusion:vortex-compact -0.7% -3.6% +3.0% +12.3% ➖ noise
3 datafusion:vortex-file-compressed +1.7% -3.6% +5.5% +12.3% ➖ noise
3 duckdb:duckdb -5.8% -3.6% -2.2% +12.3% ➖ noise
3 duckdb:vortex-compact -4.8% -3.6% -1.2% +12.3% ➖ noise
3 duckdb:vortex-file-compressed -3.8% -3.6% -0.2% +12.3% ➖ noise
4 datafusion:arrow -8.6% -8.6% -0.0% +12.3% ➖ noise
4 datafusion:vortex-compact -3.0% -8.6% +6.2% +12.3% ➖ noise
4 datafusion:vortex-file-compressed -2.7% -8.6% +6.5% +12.3% ➖ noise
4 duckdb:duckdb -5.2% -8.6% +3.8% +12.3% ➖ noise
4 duckdb:vortex-compact -4.8% -8.6% +4.2% +12.3% ➖ noise
4 duckdb:vortex-file-compressed -2.3% -8.6% +6.9% +12.3% ➖ noise
5 datafusion:arrow +7.8% -3.1% +11.2% +12.3% ➖ noise
5 datafusion:vortex-compact -9.2% -3.1% -6.4% +12.3% ➖ noise
5 datafusion:vortex-file-compressed -6.5% -3.1% -3.5% +13.8% ➖ noise
5 duckdb:duckdb -0.7% -3.1% +2.5% +12.3% ➖ noise
5 duckdb:vortex-compact -3.5% -3.1% -0.4% +12.3% ➖ noise
5 duckdb:vortex-file-compressed -2.4% -3.1% +0.7% +12.3% ➖ noise
6 datafusion:arrow +2.5% -3.3% +6.0% +12.8% ➖ noise
6 datafusion:vortex-compact +8.5% -3.3% +12.1% +15.5% ➖ noise
6 datafusion:vortex-file-compressed +5.2% -3.3% +8.8% +22.1% ➖ noise
6 duckdb:duckdb -3.8% -3.3% -0.5% +15.4% ➖ noise
6 duckdb:vortex-compact -5.8% -3.3% -2.7% +15.9% ➖ noise
6 duckdb:vortex-file-compressed -5.2% -3.3% -1.9% +14.6% ➖ noise
7 datafusion:arrow -3.5% -2.7% -0.8% +12.3% ➖ noise
7 datafusion:vortex-compact -2.6% -2.7% +0.2% +12.3% ➖ noise
7 datafusion:vortex-file-compressed -6.4% -2.7% -3.7% +12.3% ➖ noise
7 duckdb:duckdb -6.0% -2.7% -3.3% +12.3% ➖ noise
7 duckdb:vortex-compact -4.7% -2.7% -2.0% +12.9% ➖ noise
7 duckdb:vortex-file-compressed -5.0% -2.7% -2.3% +12.3% ➖ noise
8 datafusion:arrow -9.0% -8.8% -0.2% +12.3% ➖ noise
8 datafusion:vortex-compact -4.6% -8.8% +4.6% +12.3% ➖ noise
8 datafusion:vortex-file-compressed -1.5% -8.8% +8.0% +12.3% ➖ noise
8 duckdb:duckdb -2.6% -8.8% +6.8% +12.3% ➖ noise
8 duckdb:vortex-compact -3.5% -8.8% +5.8% +12.3% ➖ noise
8 duckdb:vortex-file-compressed -3.8% -8.8% +5.5% +12.7% ➖ noise
9 datafusion:arrow -16.0% -8.9% -7.8% +12.3% ➖ noise
9 datafusion:vortex-compact -3.2% -8.9% +6.2% +12.3% ➖ noise
9 datafusion:vortex-file-compressed -4.7% -8.9% +4.7% +12.3% ➖ noise
9 duckdb:duckdb -2.2% -8.9% +7.3% +12.3% ➖ noise
9 duckdb:vortex-compact -3.3% -8.9% +6.1% +12.3% ➖ noise
9 duckdb:vortex-file-compressed -4.6% -8.9% +4.7% +12.3% ➖ noise
10 datafusion:arrow -13.7% -2.9% -11.1% +12.3% ✅ faster
10 datafusion:vortex-compact -3.7% -2.9% -0.8% +12.3% ➖ noise
10 datafusion:vortex-file-compressed -2.4% -2.9% +0.5% +12.3% ➖ noise
10 duckdb:duckdb -5.6% -2.9% -2.8% +12.3% ➖ noise
10 duckdb:vortex-compact -4.6% -2.9% -1.7% +12.3% ➖ noise
10 duckdb:vortex-file-compressed -3.1% -2.9% -0.2% +12.3% ➖ noise
11 datafusion:arrow -5.9% -5.0% -1.0% +12.3% ➖ noise
11 datafusion:vortex-compact -6.7% -5.0% -1.7% +12.3% ➖ noise
11 datafusion:vortex-file-compressed -4.2% -5.0% +0.9% +12.3% ➖ noise
11 duckdb:duckdb -3.1% -5.0% +2.1% +12.3% ➖ noise
11 duckdb:vortex-compact +0.5% -5.0% +5.8% +12.3% ➖ noise
11 duckdb:vortex-file-compressed -4.5% -5.0% +0.6% +17.1% ➖ noise
12 datafusion:arrow -10.6% +11.2% -19.6% +18.9% ✅ faster
12 datafusion:vortex-compact +5.3% +11.2% -5.3% +12.5% ➖ noise
12 datafusion:vortex-file-compressed +5.4% +11.2% -5.1% +15.8% ➖ noise
12 duckdb:duckdb -0.9% +11.2% -10.8% +12.3% ➖ noise
12 duckdb:vortex-compact -4.6% +11.2% -14.2% +12.3% ✅ faster
12 duckdb:vortex-file-compressed -5.1% +11.2% -14.6% +12.3% ✅ faster
13 datafusion:arrow -3.6% -8.4% +5.2% +12.3% ➖ noise
13 datafusion:vortex-compact -7.3% -8.4% +1.2% +12.3% ➖ noise
13 datafusion:vortex-file-compressed -4.2% -8.4% +4.6% +12.3% ➖ noise
13 duckdb:duckdb -4.7% -8.4% +4.0% +12.3% ➖ noise
13 duckdb:vortex-compact -2.5% -8.4% +6.5% +12.3% ➖ noise
13 duckdb:vortex-file-compressed -4.7% -8.4% +4.1% +12.3% ➖ noise
14 datafusion:arrow -10.8% -0.2% -10.6% +12.3% ➖ noise
14 datafusion:vortex-compact -2.2% -0.2% -2.0% +12.3% ➖ noise
14 datafusion:vortex-file-compressed +0.5% -0.2% +0.7% +20.3% ➖ noise
14 duckdb:duckdb -1.2% -0.2% -1.0% +12.3% ➖ noise
14 duckdb:vortex-compact -7.0% -0.2% -6.8% +12.3% ➖ noise
14 duckdb:vortex-file-compressed -2.6% -0.2% -2.4% +12.3% ➖ noise
15 datafusion:arrow -10.4% -1.9% -8.7% +12.3% ➖ noise
15 datafusion:vortex-compact +0.9% -1.9% +2.9% +13.8% ➖ noise
15 datafusion:vortex-file-compressed +4.8% -1.9% +6.8% +12.7% ➖ noise
15 duckdb:duckdb -2.5% -1.9% -0.6% +12.3% ➖ noise
15 duckdb:vortex-compact -1.3% -1.9% +0.7% +13.9% ➖ noise
15 duckdb:vortex-file-compressed -0.9% -1.9% +1.1% +12.3% ➖ noise
16 datafusion:arrow -2.7% -8.5% +6.3% +12.3% ➖ noise
16 datafusion:vortex-compact -4.2% -8.5% +4.7% +12.3% ➖ noise
16 datafusion:vortex-file-compressed -6.1% -8.5% +2.6% +12.3% ➖ noise
16 duckdb:duckdb -4.0% -8.5% +4.9% +12.3% ➖ noise
16 duckdb:vortex-compact -8.8% -8.5% -0.3% +12.3% ➖ noise
16 duckdb:vortex-file-compressed -3.7% -8.5% +5.3% +12.3% ➖ noise
17 datafusion:arrow -12.7% -5.9% -7.2% +12.3% ➖ noise
17 datafusion:vortex-compact -3.8% -5.9% +2.2% +12.3% ➖ noise
17 datafusion:vortex-file-compressed -4.1% -5.9% +2.0% +13.4% ➖ noise
17 duckdb:duckdb -4.2% -5.9% +1.8% +12.3% ➖ noise
17 duckdb:vortex-compact +0.3% -5.9% +6.7% +12.3% ➖ noise
17 duckdb:vortex-file-compressed -1.9% -5.9% +4.2% +12.3% ➖ noise
18 datafusion:arrow -9.7% -4.5% -5.5% +12.3% ➖ noise
18 datafusion:vortex-compact -7.7% -4.5% -3.4% +12.3% ➖ noise
18 datafusion:vortex-file-compressed -4.2% -4.5% +0.4% +12.3% ➖ noise
18 duckdb:duckdb -1.2% -4.5% +3.4% +12.3% ➖ noise
18 duckdb:vortex-compact -1.5% -4.5% +3.1% +12.3% ➖ noise
18 duckdb:vortex-file-compressed -4.7% -4.5% -0.2% +12.3% ➖ noise
19 datafusion:arrow -9.8% +2.0% -11.6% +14.3% ➖ noise
19 datafusion:vortex-compact +7.0% +2.0% +4.9% +18.1% ➖ noise
19 datafusion:vortex-file-compressed +13.1% +2.0% +10.8% +15.2% ➖ noise
19 duckdb:duckdb -5.0% +2.0% -6.9% +12.8% ➖ noise
19 duckdb:vortex-compact -3.1% +2.0% -5.0% +13.7% ➖ noise
19 duckdb:vortex-file-compressed -3.2% +2.0% -5.2% +12.3% ➖ noise
20 datafusion:arrow -10.1% -1.3% -9.0% +14.5% ➖ noise
20 datafusion:vortex-compact -2.2% -1.3% -0.9% +12.3% ➖ noise
20 datafusion:vortex-file-compressed -4.1% -1.3% -2.9% +14.4% ➖ noise
20 duckdb:duckdb -4.5% -1.3% -3.3% +12.3% ➖ noise
20 duckdb:vortex-compact -2.8% -1.3% -1.5% +12.3% ➖ noise
20 duckdb:vortex-file-compressed -4.1% -1.3% -2.9% +14.1% ➖ noise
21 datafusion:arrow +0.2% -3.0% +3.3% +12.3% ➖ noise
21 datafusion:vortex-compact -4.7% -3.0% -1.8% +12.3% ➖ noise
21 datafusion:vortex-file-compressed -2.7% -3.0% +0.2% +12.3% ➖ noise
21 duckdb:duckdb -3.9% -3.0% -1.0% +12.3% ➖ noise
21 duckdb:vortex-compact -5.2% -3.0% -2.4% +12.3% ➖ noise
21 duckdb:vortex-file-compressed -2.3% -3.0% +0.6% +12.3% ➖ noise
22 datafusion:arrow -8.5% -1.7% -6.9% +12.3% ➖ noise
22 datafusion:vortex-compact -4.0% -1.7% -2.4% +12.3% ➖ noise
22 datafusion:vortex-file-compressed +0.4% -1.7% +2.1% +12.3% ➖ noise
22 duckdb:duckdb -0.8% -1.7% +0.9% +12.3% ➖ noise
22 duckdb:vortex-compact -6.6% -1.7% -5.0% +13.9% ➖ noise
22 duckdb:vortex-file-compressed -5.5% -1.7% -3.9% +12.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (+1.5%, low confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.968x ➖, 2↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5410052 5288370 1.02
fineweb_q01/datafusion:vortex-file-compressed 32218358 33951181 0.95
fineweb_q02/datafusion:vortex-file-compressed 🚀 37799236 42081217 0.90
fineweb_q03/datafusion:vortex-file-compressed 63863371 61284089 1.04
fineweb_q04/datafusion:vortex-file-compressed 277484231 284838973 0.97
fineweb_q05/datafusion:vortex-file-compressed 213669503 222025886 0.96
fineweb_q06/datafusion:vortex-file-compressed 50670916 49579910 1.02
fineweb_q07/datafusion:vortex-file-compressed 52240146 54560278 0.96
fineweb_q08/datafusion:vortex-file-compressed 🚀 19631355 22015487 0.89
datafusion / vortex-compact (0.990x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5575303 5536066 1.01
fineweb_q01/datafusion:vortex-compact 97363752 97054099 1.00
fineweb_q02/datafusion:vortex-compact 102235437 102132562 1.00
fineweb_q03/datafusion:vortex-compact 873455984 871985014 1.00
fineweb_q04/datafusion:vortex-compact 919502486 918307246 1.00
fineweb_q05/datafusion:vortex-compact 825813083 836303055 0.99
fineweb_q06/datafusion:vortex-compact 462541810 463019576 1.00
fineweb_q07/datafusion:vortex-compact 479059643 481359168 1.00
fineweb_q08/datafusion:vortex-compact 19212513 20884479 0.92
datafusion / parquet (0.987x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6971240 6872622 1.01
fineweb_q01/datafusion:parquet 281572141 296330882 0.95
fineweb_q02/datafusion:parquet 289570997 300348519 0.96
fineweb_q03/datafusion:parquet 295396373 285051286 1.04
fineweb_q04/datafusion:parquet 307247736 308708150 1.00
fineweb_q05/datafusion:parquet 299028639 313432916 0.95
fineweb_q06/datafusion:parquet 287565907 299845067 0.96
fineweb_q07/datafusion:parquet 287839635 283667113 1.01
fineweb_q08/datafusion:parquet 277918631 278963933 1.00
duckdb / vortex-file-compressed (1.029x ➖, 1↑ 2↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3347449 4478335 0.75
fineweb_q01/duckdb:vortex-file-compressed 34140976 33148615 1.03
fineweb_q02/duckdb:vortex-file-compressed 38751973 39188727 0.99
fineweb_q03/duckdb:vortex-file-compressed 🚨 163647075 114294799 1.43
fineweb_q04/duckdb:vortex-file-compressed 267967720 269741341 0.99
fineweb_q05/duckdb:vortex-file-compressed 213467232 210785247 1.01
fineweb_q06/duckdb:vortex-file-compressed 49900679 51160958 0.98
fineweb_q07/duckdb:vortex-file-compressed 54957631 52178493 1.05
fineweb_q08/duckdb:vortex-file-compressed 🚨 23324824 20323733 1.15
duckdb / vortex-compact (0.994x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4092845 4162894 0.98
fineweb_q01/duckdb:vortex-compact 110991411 109667956 1.01
fineweb_q02/duckdb:vortex-compact 111387560 112089713 0.99
fineweb_q03/duckdb:vortex-compact 851296738 851815405 1.00
fineweb_q04/duckdb:vortex-compact 904277851 901155576 1.00
fineweb_q05/duckdb:vortex-compact 798002400 801522869 1.00
fineweb_q06/duckdb:vortex-compact 457017041 461965756 0.99
fineweb_q07/duckdb:vortex-compact 480823931 483915752 0.99
fineweb_q08/duckdb:vortex-compact 18863045 19326185 0.98
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 31949438 31216366 1.02
fineweb_q01/duckdb:parquet 84124133 86521385 0.97
fineweb_q02/duckdb:parquet 85211609 84692906 1.01
fineweb_q03/duckdb:parquet 315127748 319279001 0.99
fineweb_q04/duckdb:parquet 446631356 445293055 1.00
fineweb_q05/duckdb:parquet 416398468 416296398 1.00
fineweb_q06/duckdb:parquet 203585246 205205290 0.99
fineweb_q07/duckdb:parquet 215310297 216362884 1.00
fineweb_q08/duckdb:parquet 33981267 34497126 0.99

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB 888.44 KB -0.1%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (-0.1%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +0.7% +1.9% -1.2% +47.7% ➖ noise
0 datafusion:vortex-file-compressed +2.3% +1.9% +0.4% +58.4% ➖ noise
0 duckdb:vortex-compact -1.7% +1.9% -3.5% +53.5% ➖ noise
0 duckdb:vortex-file-compressed -25.3% +1.9% -26.6% +68.3% ➖ noise
1 datafusion:vortex-compact +0.3% -3.9% +4.4% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -5.1% -3.9% -1.3% +23.3% ➖ noise
1 duckdb:vortex-compact +1.2% -3.9% +5.3% +19.5% ➖ noise
1 duckdb:vortex-file-compressed +3.0% -3.9% +7.2% +48.1% ➖ noise
2 datafusion:vortex-compact +0.1% -1.5% +1.6% +14.9% ➖ noise
2 datafusion:vortex-file-compressed -10.2% -1.5% -8.8% +13.6% ➖ noise
2 duckdb:vortex-compact -0.6% -1.5% +0.9% +10.8% ➖ noise
2 duckdb:vortex-file-compressed -1.1% -1.5% +0.4% +10.0% ➖ noise
3 datafusion:vortex-compact +0.2% +1.1% -1.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +4.2% +1.1% +3.0% +24.0% ➖ noise
3 duckdb:vortex-compact -0.1% +1.1% -1.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +43.2% +1.1% +41.6% +42.2% ➖ noise
4 datafusion:vortex-compact +0.1% -0.1% +0.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.6% -0.1% -2.5% +10.0% ➖ noise
4 duckdb:vortex-compact +0.3% -0.1% +0.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.7% -0.1% -0.6% +10.0% ➖ noise
5 datafusion:vortex-compact -1.3% -2.3% +1.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -3.8% -2.3% -1.5% +10.0% ➖ noise
5 duckdb:vortex-compact -0.4% -2.3% +1.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.3% -2.3% +3.7% +10.0% ➖ noise
6 datafusion:vortex-compact -0.1% -2.5% +2.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +2.2% -2.5% +4.8% +14.1% ➖ noise
6 duckdb:vortex-compact -1.1% -2.5% +1.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.5% -2.5% -0.0% +20.5% ➖ noise
7 datafusion:vortex-compact -0.5% +0.5% -1.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -4.3% +0.5% -4.7% +12.2% ➖ noise
7 duckdb:vortex-compact -0.6% +0.5% -1.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +5.3% +0.5% +4.8% +12.4% ➖ noise
8 datafusion:vortex-compact -8.0% -0.9% -7.1% +20.7% ➖ noise
8 datafusion:vortex-file-compressed -10.8% -0.9% -10.0% +10.9% ✅ faster
8 duckdb:vortex-compact -2.4% -0.9% -1.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +14.8% -0.9% +15.9% +57.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+2.8%, environment too noisy confidence) · DuckDB No clear signal (-1.5%, low confidence)
Vortex (geomean): 0.945x ➖
Parquet (geomean): 0.939x ➖
Shifts: Parquet (control) -6.1% · Median polish -5.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.947x ➖, 14↑ 1↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 28091489 28739478 0.98
tpcds_q02/datafusion:vortex-file-compressed 48047149 50016158 0.96
tpcds_q03/datafusion:vortex-file-compressed 15363430 16006464 0.96
tpcds_q04/datafusion:vortex-file-compressed 🚀 255906355 285406477 0.90
tpcds_q05/datafusion:vortex-file-compressed 44256950 47714356 0.93
tpcds_q06/datafusion:vortex-file-compressed 61944495 60676792 1.02
tpcds_q07/datafusion:vortex-file-compressed 🚀 41142191 46703035 0.88
tpcds_q08/datafusion:vortex-file-compressed 28670925 30151163 0.95
tpcds_q09/datafusion:vortex-file-compressed 38974306 39193008 0.99
tpcds_q10/datafusion:vortex-file-compressed 39589205 40587813 0.98
tpcds_q11/datafusion:vortex-file-compressed 128992842 143171434 0.90
tpcds_q12/datafusion:vortex-file-compressed 19984190 21409451 0.93
tpcds_q13/datafusion:vortex-file-compressed 51515260 47317177 1.09
tpcds_q14/datafusion:vortex-file-compressed 174845224 176123797 0.99
tpcds_q15/datafusion:vortex-file-compressed 30173010 29065485 1.04
tpcds_q16/datafusion:vortex-file-compressed 28608077 28874705 0.99
tpcds_q17/datafusion:vortex-file-compressed 61680183 66502627 0.93
tpcds_q18/datafusion:vortex-file-compressed 68300354 72906892 0.94
tpcds_q19/datafusion:vortex-file-compressed 24039201 22818636 1.05
tpcds_q20/datafusion:vortex-file-compressed 22339887 22672827 0.99
tpcds_q21/datafusion:vortex-file-compressed 🚀 34353264 38647485 0.89
tpcds_q22/datafusion:vortex-file-compressed 🚨 150606082 128039443 1.18
tpcds_q23/datafusion:vortex-file-compressed 153010930 165390312 0.93
tpcds_q24/datafusion:vortex-file-compressed 90081979 89323623 1.01
tpcds_q25/datafusion:vortex-file-compressed 64770017 71867334 0.90
tpcds_q26/datafusion:vortex-file-compressed 34101561 35138172 0.97
tpcds_q27/datafusion:vortex-file-compressed 111744233 107197410 1.04
tpcds_q28/datafusion:vortex-file-compressed 33421765 32600545 1.03
tpcds_q29/datafusion:vortex-file-compressed 61612171 68248969 0.90
tpcds_q30/datafusion:vortex-file-compressed 23793889 25639228 0.93
tpcds_q31/datafusion:vortex-file-compressed 73537459 78230831 0.94
tpcds_q32/datafusion:vortex-file-compressed 19811506 21034065 0.94
tpcds_q33/datafusion:vortex-file-compressed 29542605 31394530 0.94
tpcds_q34/datafusion:vortex-file-compressed 25549888 25681771 0.99
tpcds_q35/datafusion:vortex-file-compressed 44939050 46907883 0.96
tpcds_q36/datafusion:vortex-file-compressed 🚀 57881825 64866411 0.89
tpcds_q37/datafusion:vortex-file-compressed 🚀 23465458 26977868 0.87
tpcds_q38/datafusion:vortex-file-compressed 42401186 46489440 0.91
tpcds_q39/datafusion:vortex-file-compressed 108046481 116361328 0.93
tpcds_q40/datafusion:vortex-file-compressed 32582517 35226889 0.92
tpcds_q41/datafusion:vortex-file-compressed 15902805 16473494 0.97
tpcds_q42/datafusion:vortex-file-compressed 13863132 14764929 0.94
tpcds_q43/datafusion:vortex-file-compressed 18689658 20160017 0.93
tpcds_q44/datafusion:vortex-file-compressed 31515315 33137958 0.95
tpcds_q45/datafusion:vortex-file-compressed 28999086 31102657 0.93
tpcds_q46/datafusion:vortex-file-compressed 34631476 37799897 0.92
tpcds_q47/datafusion:vortex-file-compressed 132697889 142305904 0.93
tpcds_q48/datafusion:vortex-file-compressed 35565623 36564821 0.97
tpcds_q49/datafusion:vortex-file-compressed 57347367 60901182 0.94
tpcds_q50/datafusion:vortex-file-compressed 39185293 42403197 0.92
tpcds_q51/datafusion:vortex-file-compressed 88052917 91585566 0.96
tpcds_q52/datafusion:vortex-file-compressed 14865766 14942256 0.99
tpcds_q53/datafusion:vortex-file-compressed 21615139 23822141 0.91
tpcds_q54/datafusion:vortex-file-compressed 34393128 36746750 0.94
tpcds_q55/datafusion:vortex-file-compressed 14186789 14794799 0.96
tpcds_q56/datafusion:vortex-file-compressed 30619327 31401622 0.98
tpcds_q57/datafusion:vortex-file-compressed 108796972 116281281 0.94
tpcds_q58/datafusion:vortex-file-compressed 53627334 55110013 0.97
tpcds_q59/datafusion:vortex-file-compressed 56491847 59467729 0.95
tpcds_q60/datafusion:vortex-file-compressed 30163440 31392344 0.96
tpcds_q61/datafusion:vortex-file-compressed 🚀 40837495 46247960 0.88
tpcds_q62/datafusion:vortex-file-compressed 24144990 23066100 1.05
tpcds_q63/datafusion:vortex-file-compressed 21906434 23382027 0.94
tpcds_q64/datafusion:vortex-file-compressed 426065228 442275144 0.96
tpcds_q65/datafusion:vortex-file-compressed 39232931 41909879 0.94
tpcds_q66/datafusion:vortex-file-compressed 72713297 78295052 0.93
tpcds_q67/datafusion:vortex-file-compressed 145555603 152933741 0.95
tpcds_q68/datafusion:vortex-file-compressed 35721785 38708399 0.92
tpcds_q69/datafusion:vortex-file-compressed 35501459 39359992 0.90
tpcds_q70/datafusion:vortex-file-compressed 84649816 89079273 0.95
tpcds_q71/datafusion:vortex-file-compressed 🚀 22763589 25472266 0.89
tpcds_q72/datafusion:vortex-file-compressed 2186867602 2419245648 0.90
tpcds_q73/datafusion:vortex-file-compressed 🚀 23537981 26409178 0.89
tpcds_q74/datafusion:vortex-file-compressed 80770432 82394064 0.98
tpcds_q75/datafusion:vortex-file-compressed 🚀 107425339 120836506 0.89
tpcds_q76/datafusion:vortex-file-compressed 32995110 32946810 1.00
tpcds_q77/datafusion:vortex-file-compressed 40125505 41744269 0.96
tpcds_q78/datafusion:vortex-file-compressed 122755811 135265085 0.91
tpcds_q79/datafusion:vortex-file-compressed 29992160 30297649 0.99
tpcds_q80/datafusion:vortex-file-compressed 🚀 92655335 108330310 0.86
tpcds_q81/datafusion:vortex-file-compressed 🚀 23784897 26719150 0.89
tpcds_q82/datafusion:vortex-file-compressed 25464268 26717160 0.95
tpcds_q83/datafusion:vortex-file-compressed 34464548 35578100 0.97
tpcds_q84/datafusion:vortex-file-compressed 12516460 13575077 0.92
tpcds_q85/datafusion:vortex-file-compressed 🚀 93148996 103750063 0.90
tpcds_q86/datafusion:vortex-file-compressed 17694152 17870815 0.99
tpcds_q87/datafusion:vortex-file-compressed 43186895 47884650 0.90
tpcds_q88/datafusion:vortex-file-compressed 56891130 58055176 0.98
tpcds_q89/datafusion:vortex-file-compressed 24916134 26615204 0.94
tpcds_q90/datafusion:vortex-file-compressed 14422232 15642281 0.92
tpcds_q91/datafusion:vortex-file-compressed 🚀 17888427 20225304 0.88
tpcds_q92/datafusion:vortex-file-compressed 18434342 19527975 0.94
tpcds_q93/datafusion:vortex-file-compressed 33197779 35409219 0.94
tpcds_q94/datafusion:vortex-file-compressed 🚀 22774190 25377813 0.90
tpcds_q95/datafusion:vortex-file-compressed 62674984 65017613 0.96
tpcds_q96/datafusion:vortex-file-compressed 13680500 14715626 0.93
tpcds_q97/datafusion:vortex-file-compressed 31660751 34497215 0.92
tpcds_q98/datafusion:vortex-file-compressed 23530657 25487968 0.92
tpcds_q99/datafusion:vortex-file-compressed 27849250 29268557 0.95
datafusion / vortex-compact (0.944x ➖, 16↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚀 25513102 28933344 0.88
tpcds_q02/datafusion:vortex-compact 54793569 55290008 0.99
tpcds_q03/datafusion:vortex-compact 20383765 20664544 0.99
tpcds_q04/datafusion:vortex-compact 310943427 325653206 0.95
tpcds_q05/datafusion:vortex-compact 48384038 50747568 0.95
tpcds_q06/datafusion:vortex-compact 62045940 65890186 0.94
tpcds_q07/datafusion:vortex-compact 🚀 51292613 57690243 0.89
tpcds_q08/datafusion:vortex-compact 36142419 38246361 0.94
tpcds_q09/datafusion:vortex-compact 51245255 52903610 0.97
tpcds_q10/datafusion:vortex-compact 50081298 51448454 0.97
tpcds_q11/datafusion:vortex-compact 153214625 161652501 0.95
tpcds_q12/datafusion:vortex-compact 🚀 23054244 27308886 0.84
tpcds_q13/datafusion:vortex-compact 122621263 127938669 0.96
tpcds_q14/datafusion:vortex-compact 199216038 206480613 0.96
tpcds_q15/datafusion:vortex-compact 31043775 32234940 0.96
tpcds_q16/datafusion:vortex-compact 32760585 33421810 0.98
tpcds_q17/datafusion:vortex-compact 73927090 79737445 0.93
tpcds_q18/datafusion:vortex-compact 81546323 83857090 0.97
tpcds_q19/datafusion:vortex-compact 31108613 31034263 1.00
tpcds_q20/datafusion:vortex-compact 26785567 26433113 1.01
tpcds_q21/datafusion:vortex-compact 38705879 42836310 0.90
tpcds_q22/datafusion:vortex-compact 136719105 142811146 0.96
tpcds_q23/datafusion:vortex-compact 173393936 178924433 0.97
tpcds_q24/datafusion:vortex-compact 96310456 103937208 0.93
tpcds_q25/datafusion:vortex-compact 78297951 85266058 0.92
tpcds_q26/datafusion:vortex-compact 44768668 46121639 0.97
tpcds_q27/datafusion:vortex-compact 125867168 135255396 0.93
tpcds_q28/datafusion:vortex-compact 99100004 98649428 1.00
tpcds_q29/datafusion:vortex-compact 74176727 78413012 0.95
tpcds_q30/datafusion:vortex-compact 🚀 26485114 30280764 0.87
tpcds_q31/datafusion:vortex-compact 98644156 99757511 0.99
tpcds_q32/datafusion:vortex-compact 🚀 25767404 29652497 0.87
tpcds_q33/datafusion:vortex-compact 37601918 39877645 0.94
tpcds_q34/datafusion:vortex-compact 34004748 34794350 0.98
tpcds_q35/datafusion:vortex-compact 52795485 54545816 0.97
tpcds_q36/datafusion:vortex-compact 🚀 73204941 83416270 0.88
tpcds_q37/datafusion:vortex-compact 🚀 33400090 37321538 0.89
tpcds_q38/datafusion:vortex-compact 50650372 51856496 0.98
tpcds_q39/datafusion:vortex-compact 🚀 112046604 134786320 0.83
tpcds_q40/datafusion:vortex-compact 37006215 37630762 0.98
tpcds_q41/datafusion:vortex-compact 17921459 18069472 0.99
tpcds_q42/datafusion:vortex-compact 18115935 19581142 0.93
tpcds_q43/datafusion:vortex-compact 25234044 27296916 0.92
tpcds_q44/datafusion:vortex-compact 49258605 50841431 0.97
tpcds_q45/datafusion:vortex-compact 🚀 31356177 36244087 0.87
tpcds_q46/datafusion:vortex-compact 44096945 47905238 0.92
tpcds_q47/datafusion:vortex-compact 149943322 160856352 0.93
tpcds_q48/datafusion:vortex-compact 80978677 84676799 0.96
tpcds_q49/datafusion:vortex-compact 🚀 71218505 80140502 0.89
tpcds_q50/datafusion:vortex-compact 47625431 51596408 0.92
tpcds_q51/datafusion:vortex-compact 96674927 101157675 0.96
tpcds_q52/datafusion:vortex-compact 20694763 19575880 1.06
tpcds_q53/datafusion:vortex-compact 28319778 30189005 0.94
tpcds_q54/datafusion:vortex-compact 43585599 43395872 1.00
tpcds_q55/datafusion:vortex-compact 18072351 18488709 0.98
tpcds_q56/datafusion:vortex-compact 37601609 37134432 1.01
tpcds_q57/datafusion:vortex-compact 115792701 123553612 0.94
tpcds_q58/datafusion:vortex-compact 63320619 64924352 0.98
tpcds_q59/datafusion:vortex-compact 73157564 71663454 1.02
tpcds_q60/datafusion:vortex-compact 36245578 38831141 0.93
tpcds_q61/datafusion:vortex-compact 56074801 55082252 1.02
tpcds_q62/datafusion:vortex-compact 29414301 32199808 0.91
tpcds_q63/datafusion:vortex-compact 27932856 29396151 0.95
tpcds_q64/datafusion:vortex-compact 450305511 494557247 0.91
tpcds_q65/datafusion:vortex-compact 53525238 55673655 0.96
tpcds_q66/datafusion:vortex-compact 80820193 85963633 0.94
tpcds_q67/datafusion:vortex-compact 158201438 161868767 0.98
tpcds_q68/datafusion:vortex-compact 🚀 44651193 54955939 0.81
tpcds_q69/datafusion:vortex-compact 47267924 48907333 0.97
tpcds_q70/datafusion:vortex-compact 98301388 100737136 0.98
tpcds_q71/datafusion:vortex-compact 30904463 32483804 0.95
tpcds_q72/datafusion:vortex-compact 2246025766 2400712582 0.94
tpcds_q73/datafusion:vortex-compact 31868129 32938699 0.97
tpcds_q74/datafusion:vortex-compact 94390583 100794420 0.94
tpcds_q75/datafusion:vortex-compact 132700826 137517764 0.96
tpcds_q76/datafusion:vortex-compact 32441894 33776878 0.96
tpcds_q77/datafusion:vortex-compact 50171645 52494787 0.96
tpcds_q78/datafusion:vortex-compact 140482962 152265663 0.92
tpcds_q79/datafusion:vortex-compact 38475610 42104592 0.91
tpcds_q80/datafusion:vortex-compact 🚀 105525993 118849977 0.89
tpcds_q81/datafusion:vortex-compact 27626019 28526062 0.97
tpcds_q82/datafusion:vortex-compact 34540385 36569456 0.94
tpcds_q83/datafusion:vortex-compact 🚀 33007118 36915285 0.89
tpcds_q84/datafusion:vortex-compact 🚀 14185548 16538221 0.86
tpcds_q85/datafusion:vortex-compact 🚀 149460132 171837719 0.87
tpcds_q86/datafusion:vortex-compact 🚀 19548150 23048356 0.85
tpcds_q87/datafusion:vortex-compact 53584148 55066055 0.97
tpcds_q88/datafusion:vortex-compact 79586517 82549384 0.96
tpcds_q89/datafusion:vortex-compact 33276755 36403896 0.91
tpcds_q90/datafusion:vortex-compact 15221332 16206009 0.94
tpcds_q91/datafusion:vortex-compact 31743140 33737084 0.94
tpcds_q92/datafusion:vortex-compact 23442942 23957905 0.98
tpcds_q93/datafusion:vortex-compact 38766790 42732357 0.91
tpcds_q94/datafusion:vortex-compact 25740442 27105817 0.95
tpcds_q95/datafusion:vortex-compact 64652342 69636188 0.93
tpcds_q96/datafusion:vortex-compact 17362322 17619199 0.99
tpcds_q97/datafusion:vortex-compact 35844031 38121845 0.94
tpcds_q98/datafusion:vortex-compact 30830595 32851772 0.94
tpcds_q99/datafusion:vortex-compact 34531406 31466269 1.10
datafusion / parquet (0.920x ➖, 23↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚀 29209350 34267501 0.85
tpcds_q02/datafusion:parquet 41458139 43486649 0.95
tpcds_q03/datafusion:parquet 13177141 14328679 0.92
tpcds_q04/datafusion:parquet 273196733 301489253 0.91
tpcds_q05/datafusion:parquet 40366743 43140073 0.94
tpcds_q06/datafusion:parquet 59394600 62150757 0.96
tpcds_q07/datafusion:parquet 79261139 81668183 0.97
tpcds_q08/datafusion:parquet 25773658 26767806 0.96
tpcds_q09/datafusion:parquet 45554245 47591235 0.96
tpcds_q10/datafusion:parquet 71743974 75551197 0.95
tpcds_q11/datafusion:parquet 142354600 157379383 0.90
tpcds_q12/datafusion:parquet 18418077 18729521 0.98
tpcds_q13/datafusion:parquet 76064834 79976727 0.95
tpcds_q14/datafusion:parquet 163168174 176258548 0.93
tpcds_q15/datafusion:parquet 🚀 20756086 25569270 0.81
tpcds_q16/datafusion:parquet 🚀 23062623 27245305 0.85
tpcds_q17/datafusion:parquet 61960510 68275569 0.91
tpcds_q18/datafusion:parquet 111623580 120420150 0.93
tpcds_q19/datafusion:parquet 21946451 24207165 0.91
tpcds_q20/datafusion:parquet 16616921 18265850 0.91
tpcds_q21/datafusion:parquet 🚀 17996846 20415525 0.88
tpcds_q22/datafusion:parquet 146889165 162831785 0.90
tpcds_q23/datafusion:parquet 🚀 146680076 168347796 0.87
tpcds_q24/datafusion:parquet 90385874 98581337 0.92
tpcds_q25/datafusion:parquet 63518458 68992238 0.92
tpcds_q26/datafusion:parquet 64393345 69131346 0.93
tpcds_q27/datafusion:parquet 🚀 142711442 159598297 0.89
tpcds_q28/datafusion:parquet 45656982 47346280 0.96
tpcds_q29/datafusion:parquet 65555914 69153832 0.95
tpcds_q30/datafusion:parquet 33988665 36098740 0.94
tpcds_q31/datafusion:parquet 64379369 69026657 0.93
tpcds_q32/datafusion:parquet 🚀 17815365 19872601 0.90
tpcds_q33/datafusion:parquet 26193251 28857591 0.91
tpcds_q34/datafusion:parquet 23597607 23272361 1.01
tpcds_q35/datafusion:parquet 69892271 76458488 0.91
tpcds_q36/datafusion:parquet 58417425 62500095 0.93
tpcds_q37/datafusion:parquet 18373936 20088760 0.91
tpcds_q38/datafusion:parquet 42669093 45722318 0.93
tpcds_q39/datafusion:parquet 🚀 74250392 85268652 0.87
tpcds_q40/datafusion:parquet 🚀 22430766 25501235 0.88
tpcds_q41/datafusion:parquet 🚀 13019320 15188451 0.86
tpcds_q42/datafusion:parquet 11681870 12754481 0.92
tpcds_q43/datafusion:parquet 16677401 18386503 0.91
tpcds_q44/datafusion:parquet 34053814 34551788 0.99
tpcds_q45/datafusion:parquet 28337184 29837524 0.95
tpcds_q46/datafusion:parquet 31606184 34300711 0.92
tpcds_q47/datafusion:parquet 125332295 136977681 0.91
tpcds_q48/datafusion:parquet 68405661 74565775 0.92
tpcds_q49/datafusion:parquet 55028354 59416040 0.93
tpcds_q50/datafusion:parquet 43938159 46156980 0.95
tpcds_q51/datafusion:parquet 84679485 93626960 0.90
tpcds_q52/datafusion:parquet 12000341 12718753 0.94
tpcds_q53/datafusion:parquet 🚀 17287061 20521394 0.84
tpcds_q54/datafusion:parquet 33787638 36200739 0.93
tpcds_q55/datafusion:parquet 11858318 12037484 0.99
tpcds_q56/datafusion:parquet 27050899 28879216 0.94
tpcds_q57/datafusion:parquet 98504569 101632935 0.97
tpcds_q58/datafusion:parquet 48833914 52729551 0.93
tpcds_q59/datafusion:parquet 58797379 61521419 0.96
tpcds_q60/datafusion:parquet 27144313 28569935 0.95
tpcds_q61/datafusion:parquet 45734212 43476744 1.05
tpcds_q62/datafusion:parquet 🚀 19875819 27301797 0.73
tpcds_q63/datafusion:parquet 17259383 18208411 0.95
tpcds_q64/datafusion:parquet 519040774 547248991 0.95
tpcds_q65/datafusion:parquet 38035221 40221737 0.95
tpcds_q66/datafusion:parquet 69942187 73106207 0.96
tpcds_q67/datafusion:parquet 🚀 139614333 158133904 0.88
tpcds_q68/datafusion:parquet 32385209 33393650 0.97
tpcds_q69/datafusion:parquet 66447268 69122238 0.96
tpcds_q70/datafusion:parquet 86452199 94380878 0.92
tpcds_q71/datafusion:parquet 22445531 23008036 0.98
tpcds_q72/datafusion:parquet 608402361 665675705 0.91
tpcds_q73/datafusion:parquet 20015729 22010592 0.91
tpcds_q74/datafusion:parquet 86175800 92398061 0.93
tpcds_q75/datafusion:parquet 🚀 99243935 111834430 0.89
tpcds_q76/datafusion:parquet 30126398 32706377 0.92
tpcds_q77/datafusion:parquet 39642492 40556665 0.98
tpcds_q78/datafusion:parquet 🚀 112361956 127585733 0.88
tpcds_q79/datafusion:parquet 27766804 28674714 0.97
tpcds_q80/datafusion:parquet 79185934 85601742 0.93
tpcds_q81/datafusion:parquet 🚀 31315096 36595676 0.86
tpcds_q82/datafusion:parquet 19376769 20517776 0.94
tpcds_q83/datafusion:parquet 🚀 35946759 41017069 0.88
tpcds_q84/datafusion:parquet 38196529 41192316 0.93
tpcds_q85/datafusion:parquet 147535692 158871480 0.93
tpcds_q86/datafusion:parquet 🚀 13475445 17602868 0.77
tpcds_q87/datafusion:parquet 42352595 44012291 0.96
tpcds_q88/datafusion:parquet 🚀 59021491 65662508 0.90
tpcds_q89/datafusion:parquet 21860060 23867505 0.92
tpcds_q90/datafusion:parquet 14227605 15195305 0.94
tpcds_q91/datafusion:parquet 56006543 61116961 0.92
tpcds_q92/datafusion:parquet 🚀 17971387 20276306 0.89
tpcds_q93/datafusion:parquet 31532016 34798739 0.91
tpcds_q94/datafusion:parquet 20554156 21690884 0.95
tpcds_q95/datafusion:parquet 58149291 61974248 0.94
tpcds_q96/datafusion:parquet 🚀 11564217 13423702 0.86
tpcds_q97/datafusion:parquet 🚀 29025808 32743009 0.89
tpcds_q98/datafusion:parquet 21652530 22977650 0.94
tpcds_q99/datafusion:parquet 🚀 28536410 32918858 0.87
duckdb / vortex-file-compressed (0.946x ➖, 13↑ 1↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24261878 26239144 0.92
tpcds_q02/duckdb:vortex-file-compressed 34137256 34876964 0.98
tpcds_q03/duckdb:vortex-file-compressed 🚨 21806236 19415122 1.12
tpcds_q04/duckdb:vortex-file-compressed 92939847 100317993 0.93
tpcds_q05/duckdb:vortex-file-compressed 33194571 36047062 0.92
tpcds_q06/duckdb:vortex-file-compressed 32822761 36357072 0.90
tpcds_q07/duckdb:vortex-file-compressed 22182742 22382900 0.99
tpcds_q08/duckdb:vortex-file-compressed 🚀 26118511 30437551 0.86
tpcds_q09/duckdb:vortex-file-compressed 16873915 15573978 1.08
tpcds_q10/duckdb:vortex-file-compressed 36855320 40879669 0.90
tpcds_q11/duckdb:vortex-file-compressed 65865372 66958920 0.98
tpcds_q12/duckdb:vortex-file-compressed 15521147 17129310 0.91
tpcds_q13/duckdb:vortex-file-compressed 32835306 32738617 1.00
tpcds_q14/duckdb:vortex-file-compressed 96338210 101102896 0.95
tpcds_q15/duckdb:vortex-file-compressed 26458756 27948896 0.95
tpcds_q16/duckdb:vortex-file-compressed 28232929 26810935 1.05
tpcds_q17/duckdb:vortex-file-compressed 43511902 45382736 0.96
tpcds_q18/duckdb:vortex-file-compressed 37061250 38623573 0.96
tpcds_q19/duckdb:vortex-file-compressed 32813093 34432754 0.95
tpcds_q20/duckdb:vortex-file-compressed 🚀 16196979 18133751 0.89
tpcds_q21/duckdb:vortex-file-compressed 16500109 17443871 0.95
tpcds_q22/duckdb:vortex-file-compressed 78197591 82558724 0.95
tpcds_q23/duckdb:vortex-file-compressed 94531461 97293747 0.97
tpcds_q24/duckdb:vortex-file-compressed 🚀 46169503 51770401 0.89
tpcds_q25/duckdb:vortex-file-compressed 🚀 39207044 44388461 0.88
tpcds_q26/duckdb:vortex-file-compressed 19208732 19177537 1.00
tpcds_q27/duckdb:vortex-file-compressed 22490616 23882929 0.94
tpcds_q28/duckdb:vortex-file-compressed 12087422 12535278 0.96
tpcds_q29/duckdb:vortex-file-compressed 40016509 44151896 0.91
tpcds_q30/duckdb:vortex-file-compressed 24580797 26588207 0.92
tpcds_q31/duckdb:vortex-file-compressed 28458550 29195813 0.97
tpcds_q32/duckdb:vortex-file-compressed 🚀 12832605 14687476 0.87
tpcds_q33/duckdb:vortex-file-compressed 🚀 23550691 26676494 0.88
tpcds_q34/duckdb:vortex-file-compressed 24597675 26473804 0.93
tpcds_q35/duckdb:vortex-file-compressed 62921140 66455942 0.95
tpcds_q36/duckdb:vortex-file-compressed 25077872 24820122 1.01
tpcds_q37/duckdb:vortex-file-compressed 19545114 21610001 0.90
tpcds_q38/duckdb:vortex-file-compressed 🚀 36139614 40920080 0.88
tpcds_q39/duckdb:vortex-file-compressed 35209554 36646567 0.96
tpcds_q40/duckdb:vortex-file-compressed 21861556 22240571 0.98
tpcds_q41/duckdb:vortex-file-compressed 9927704 9554653 1.04
tpcds_q42/duckdb:vortex-file-compressed 13636676 14118407 0.97
tpcds_q43/duckdb:vortex-file-compressed 20978996 23023742 0.91
tpcds_q44/duckdb:vortex-file-compressed 20024289 21223935 0.94
tpcds_q45/duckdb:vortex-file-compressed 29168250 31914135 0.91
tpcds_q46/duckdb:vortex-file-compressed 31503942 31631125 1.00
tpcds_q47/duckdb:vortex-file-compressed 52160104 56309541 0.93
tpcds_q48/duckdb:vortex-file-compressed 28324564 30000169 0.94
tpcds_q49/duckdb:vortex-file-compressed 35620683 34268493 1.04
tpcds_q50/duckdb:vortex-file-compressed 26690997 29303916 0.91
tpcds_q51/duckdb:vortex-file-compressed 104268840 109851594 0.95
tpcds_q52/duckdb:vortex-file-compressed 13174345 13463153 0.98
tpcds_q53/duckdb:vortex-file-compressed 22477384 24159987 0.93
tpcds_q54/duckdb:vortex-file-compressed 28291891 29533710 0.96
tpcds_q55/duckdb:vortex-file-compressed 12310456 13132705 0.94
tpcds_q56/duckdb:vortex-file-compressed 25150478 25450027 0.99
tpcds_q57/duckdb:vortex-file-compressed 🚀 41133305 46453813 0.89
tpcds_q58/duckdb:vortex-file-compressed 28940649 31995587 0.90
tpcds_q59/duckdb:vortex-file-compressed 56495292 58748460 0.96
tpcds_q60/duckdb:vortex-file-compressed 🚀 24866373 28038440 0.89
tpcds_q61/duckdb:vortex-file-compressed 31083716 31953246 0.97
tpcds_q62/duckdb:vortex-file-compressed 15458871 16759269 0.92
tpcds_q63/duckdb:vortex-file-compressed 20346854 21447553 0.95
tpcds_q64/duckdb:vortex-file-compressed 93932048 96703921 0.97
tpcds_q65/duckdb:vortex-file-compressed 23064912 22689491 1.02
tpcds_q66/duckdb:vortex-file-compressed 30182981 31151956 0.97
tpcds_q67/duckdb:vortex-file-compressed 138033017 148331640 0.93
tpcds_q68/duckdb:vortex-file-compressed 29301924 31744266 0.92
tpcds_q69/duckdb:vortex-file-compressed 39364197 43217622 0.91
tpcds_q70/duckdb:vortex-file-compressed 37399689 38787625 0.96
tpcds_q71/duckdb:vortex-file-compressed 20892741 22158014 0.94
tpcds_q72/duckdb:vortex-file-compressed 167638717 175783219 0.95
tpcds_q73/duckdb:vortex-file-compressed 25676146 25183001 1.02
tpcds_q74/duckdb:vortex-file-compressed 42853298 43470915 0.99
tpcds_q75/duckdb:vortex-file-compressed 48187964 53119117 0.91
tpcds_q76/duckdb:vortex-file-compressed 21228256 21492302 0.99
tpcds_q77/duckdb:vortex-file-compressed 🚀 23351364 26441889 0.88
tpcds_q78/duckdb:vortex-file-compressed 77567053 83344239 0.93
tpcds_q79/duckdb:vortex-file-compressed 24509593 25711353 0.95
tpcds_q80/duckdb:vortex-file-compressed 47128795 51909542 0.91
tpcds_q81/duckdb:vortex-file-compressed 28677098 31118652 0.92
tpcds_q82/duckdb:vortex-file-compressed 45011715 48142130 0.93
tpcds_q83/duckdb:vortex-file-compressed 26694952 27149831 0.98
tpcds_q84/duckdb:vortex-file-compressed 17336042 17741545 0.98
tpcds_q85/duckdb:vortex-file-compressed 🚀 38575268 43194793 0.89
tpcds_q86/duckdb:vortex-file-compressed 16493459 16592568 0.99
tpcds_q87/duckdb:vortex-file-compressed 40211425 43064322 0.93
tpcds_q88/duckdb:vortex-file-compressed 52413845 54195365 0.97
tpcds_q89/duckdb:vortex-file-compressed 21424774 22715976 0.94
tpcds_q90/duckdb:vortex-file-compressed 10125633 11121787 0.91
tpcds_q91/duckdb:vortex-file-compressed 21449917 23329565 0.92
tpcds_q92/duckdb:vortex-file-compressed 19923392 19910036 1.00
tpcds_q93/duckdb:vortex-file-compressed 🚀 29571871 32945692 0.90
tpcds_q94/duckdb:vortex-file-compressed 21180130 23031222 0.92
tpcds_q95/duckdb:vortex-file-compressed 🚀 142444752 163326534 0.87
tpcds_q96/duckdb:vortex-file-compressed 11871948 12190246 0.97
tpcds_q97/duckdb:vortex-file-compressed 37234874 40895074 0.91
tpcds_q98/duckdb:vortex-file-compressed 18764409 19930301 0.94
tpcds_q99/duckdb:vortex-file-compressed 22315861 24533868 0.91
duckdb / vortex-compact (0.946x ➖, 15↑ 1↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 25892102 27492958 0.94
tpcds_q02/duckdb:vortex-compact 🚨 39258931 33749021 1.16
tpcds_q03/duckdb:vortex-compact 48911895 48251230 1.01
tpcds_q04/duckdb:vortex-compact 108601113 113075632 0.96
tpcds_q05/duckdb:vortex-compact 41779446 44906434 0.93
tpcds_q06/duckdb:vortex-compact 39492749 41548311 0.95
tpcds_q07/duckdb:vortex-compact 35334508 35619659 0.99
tpcds_q08/duckdb:vortex-compact 41125595 41742000 0.99
tpcds_q09/duckdb:vortex-compact 19537186 21107676 0.93
tpcds_q10/duckdb:vortex-compact 52346540 55779322 0.94
tpcds_q11/duckdb:vortex-compact 74214864 75679919 0.98
tpcds_q12/duckdb:vortex-compact 🚀 22415929 25058755 0.89
tpcds_q13/duckdb:vortex-compact 53206446 56179602 0.95
tpcds_q14/duckdb:vortex-compact 🚀 114439084 128069882 0.89
tpcds_q15/duckdb:vortex-compact 31025993 31704588 0.98
tpcds_q16/duckdb:vortex-compact 🚀 26527855 30016648 0.88
tpcds_q17/duckdb:vortex-compact 54979801 58060991 0.95
tpcds_q18/duckdb:vortex-compact 50306323 50053116 1.01
tpcds_q19/duckdb:vortex-compact 44402039 45967041 0.97
tpcds_q20/duckdb:vortex-compact 🚀 20814471 23566855 0.88
tpcds_q21/duckdb:vortex-compact 🚀 17825457 20041345 0.89
tpcds_q22/duckdb:vortex-compact 82029629 85793183 0.96
tpcds_q23/duckdb:vortex-compact 107516959 115150641 0.93
tpcds_q24/duckdb:vortex-compact 59364447 60358689 0.98
tpcds_q25/duckdb:vortex-compact 54397520 58164916 0.94
tpcds_q26/duckdb:vortex-compact 31464749 32917873 0.96
tpcds_q27/duckdb:vortex-compact 36239432 36381145 1.00
tpcds_q28/duckdb:vortex-compact 33710364 36895236 0.91
tpcds_q29/duckdb:vortex-compact 53403974 58346051 0.92
tpcds_q30/duckdb:vortex-compact 28719586 30757099 0.93
tpcds_q31/duckdb:vortex-compact 38418558 38243783 1.00
tpcds_q32/duckdb:vortex-compact 20782994 22802862 0.91
tpcds_q33/duckdb:vortex-compact 31431996 34108696 0.92
tpcds_q34/duckdb:vortex-compact 29808092 31356038 0.95
tpcds_q35/duckdb:vortex-compact 76172651 80214239 0.95
tpcds_q36/duckdb:vortex-compact 36380903 37852104 0.96
tpcds_q37/duckdb:vortex-compact 🚀 23333445 26028227 0.90
tpcds_q38/duckdb:vortex-compact 41912162 45382498 0.92
tpcds_q39/duckdb:vortex-compact 38203633 40252732 0.95
tpcds_q40/duckdb:vortex-compact 23502001 25347813 0.93
tpcds_q41/duckdb:vortex-compact 11608655 11286272 1.03
tpcds_q42/duckdb:vortex-compact 🚀 18193581 20222671 0.90
tpcds_q43/duckdb:vortex-compact 30746279 33652786 0.91
tpcds_q44/duckdb:vortex-compact 28409663 30642726 0.93
tpcds_q45/duckdb:vortex-compact 36633710 38070763 0.96
tpcds_q46/duckdb:vortex-compact 44546777 46675961 0.95
tpcds_q47/duckdb:vortex-compact 63992885 65302848 0.98
tpcds_q48/duckdb:vortex-compact 45836319 47885571 0.96
tpcds_q49/duckdb:vortex-compact 48959270 49239133 0.99
tpcds_q50/duckdb:vortex-compact 36506079 39047792 0.93
tpcds_q51/duckdb:vortex-compact 110192806 117183348 0.94
tpcds_q52/duckdb:vortex-compact 19901863 20165969 0.99
tpcds_q53/duckdb:vortex-compact 32617478 33256020 0.98
tpcds_q54/duckdb:vortex-compact 36134289 37814962 0.96
tpcds_q55/duckdb:vortex-compact 18510887 19107176 0.97
tpcds_q56/duckdb:vortex-compact 33209067 34232238 0.97
tpcds_q57/duckdb:vortex-compact 44570827 46029693 0.97
tpcds_q58/duckdb:vortex-compact 🚀 37401738 42647248 0.88
tpcds_q59/duckdb:vortex-compact 67698559 67736461 1.00
tpcds_q60/duckdb:vortex-compact 36202105 37734834 0.96
tpcds_q61/duckdb:vortex-compact 53031115 57349951 0.92
tpcds_q62/duckdb:vortex-compact 🚀 20739445 23194848 0.89
tpcds_q63/duckdb:vortex-compact 32717465 32345967 1.01
tpcds_q64/duckdb:vortex-compact 122694781 132994402 0.92
tpcds_q65/duckdb:vortex-compact 31461980 31483010 1.00
tpcds_q66/duckdb:vortex-compact 36032180 39098146 0.92
tpcds_q67/duckdb:vortex-compact 152578681 164505626 0.93
tpcds_q68/duckdb:vortex-compact 45681201 47473969 0.96
tpcds_q69/duckdb:vortex-compact 54844159 57006272 0.96
tpcds_q70/duckdb:vortex-compact 58935010 60626711 0.97
tpcds_q71/duckdb:vortex-compact 31240754 30542016 1.02
tpcds_q72/duckdb:vortex-compact 182952608 193951963 0.94
tpcds_q73/duckdb:vortex-compact 27998294 30593057 0.92
tpcds_q74/duckdb:vortex-compact 🚀 46841776 52648791 0.89
tpcds_q75/duckdb:vortex-compact 59151991 62958412 0.94
tpcds_q76/duckdb:vortex-compact 29340300 30438896 0.96
tpcds_q77/duckdb:vortex-compact 38879820 40586597 0.96
tpcds_q78/duckdb:vortex-compact 85901368 89009957 0.97
tpcds_q79/duckdb:vortex-compact 39745258 42630301 0.93
tpcds_q80/duckdb:vortex-compact 73376418 72393990 1.01
tpcds_q81/duckdb:vortex-compact 32992247 35738050 0.92
tpcds_q82/duckdb:vortex-compact 49911308 53369303 0.94
tpcds_q83/duckdb:vortex-compact 35739921 39684570 0.90
tpcds_q84/duckdb:vortex-compact 20939892 22866040 0.92
tpcds_q85/duckdb:vortex-compact 53148465 57970484 0.92
tpcds_q86/duckdb:vortex-compact 🚀 20818034 23232894 0.90
tpcds_q87/duckdb:vortex-compact 🚀 43139925 49076223 0.88
tpcds_q88/duckdb:vortex-compact 75609241 77198484 0.98
tpcds_q89/duckdb:vortex-compact 32211454 32983207 0.98
tpcds_q90/duckdb:vortex-compact 10735776 11666911 0.92
tpcds_q91/duckdb:vortex-compact 40980461 43091923 0.95
tpcds_q92/duckdb:vortex-compact 🚀 43396139 50728841 0.86
tpcds_q93/duckdb:vortex-compact 🚀 32359994 36774977 0.88
tpcds_q94/duckdb:vortex-compact 🚀 26596883 30649275 0.87
tpcds_q95/duckdb:vortex-compact 165679553 174717827 0.95
tpcds_q96/duckdb:vortex-compact 16157027 17101999 0.94
tpcds_q97/duckdb:vortex-compact 40717268 44624842 0.91
tpcds_q98/duckdb:vortex-compact 26932639 29135595 0.92
tpcds_q99/duckdb:vortex-compact 27556669 27703368 0.99
duckdb / parquet (0.958x ➖, 5↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 30584036 30495895 1.00
tpcds_q02/duckdb:parquet 24317427 25221963 0.96
tpcds_q03/duckdb:parquet 13044733 13162840 0.99
tpcds_q04/duckdb:parquet 166037143 172741047 0.96
tpcds_q05/duckdb:parquet 30591222 32738968 0.93
tpcds_q06/duckdb:parquet 33186609 34571480 0.96
tpcds_q07/duckdb:parquet 23983459 25421191 0.94
tpcds_q08/duckdb:parquet 30234444 30106567 1.00
tpcds_q09/duckdb:parquet 44332886 44927644 0.99
tpcds_q10/duckdb:parquet 38474725 39333827 0.98
tpcds_q11/duckdb:parquet 92901767 94814914 0.98
tpcds_q12/duckdb:parquet 17150968 17956004 0.96
tpcds_q13/duckdb:parquet 35184028 35160259 1.00
tpcds_q14/duckdb:parquet 102180475 106064975 0.96
tpcds_q15/duckdb:parquet 🚀 29980376 35057027 0.86
tpcds_q16/duckdb:parquet 22332937 24339836 0.92
tpcds_q17/duckdb:parquet 40980502 40443256 1.01
tpcds_q18/duckdb:parquet 47393209 50156791 0.94
tpcds_q19/duckdb:parquet 31274628 33573796 0.93
tpcds_q20/duckdb:parquet 18530072 19858603 0.93
tpcds_q21/duckdb:parquet 11976709 12227931 0.98
tpcds_q22/duckdb:parquet 71940882 78675521 0.91
tpcds_q23/duckdb:parquet 79927783 84583183 0.94
tpcds_q24/duckdb:parquet 46716191 49845789 0.94
tpcds_q25/duckdb:parquet 35491975 37359075 0.95
tpcds_q26/duckdb:parquet 39482241 42002694 0.94
tpcds_q27/duckdb:parquet 52255868 55200608 0.95
tpcds_q28/duckdb:parquet 42900406 43668038 0.98
tpcds_q29/duckdb:parquet 36925023 38340639 0.96
tpcds_q30/duckdb:parquet 37393740 39502562 0.95
tpcds_q31/duckdb:parquet 27915632 29607822 0.94
tpcds_q32/duckdb:parquet 🚀 12338392 14035732 0.88
tpcds_q33/duckdb:parquet 23997137 24127363 0.99
tpcds_q34/duckdb:parquet 23002369 23866950 0.96
tpcds_q35/duckdb:parquet 🚀 60861270 67883403 0.90
tpcds_q36/duckdb:parquet 22090020 23092757 0.96
tpcds_q37/duckdb:parquet 14784452 15769387 0.94
tpcds_q38/duckdb:parquet 36382851 39619622 0.92
tpcds_q39/duckdb:parquet 🚀 32063001 38748459 0.83
tpcds_q40/duckdb:parquet 19168533 20877385 0.92
tpcds_q41/duckdb:parquet 8777600 9441683 0.93
tpcds_q42/duckdb:parquet 12928064 12421682 1.04
tpcds_q43/duckdb:parquet 17694816 17997003 0.98
tpcds_q44/duckdb:parquet 25827605 26850295 0.96
tpcds_q45/duckdb:parquet 28632628 30964955 0.92
tpcds_q46/duckdb:parquet 47094010 49507573 0.95
tpcds_q47/duckdb:parquet 49219767 53197219 0.93
tpcds_q48/duckdb:parquet 32543664 33434510 0.97
tpcds_q49/duckdb:parquet 28586703 30187775 0.95
tpcds_q50/duckdb:parquet 26390463 27150016 0.97
tpcds_q51/duckdb:parquet 101477545 108101730 0.94
tpcds_q52/duckdb:parquet 13487677 13268722 1.02
tpcds_q53/duckdb:parquet 19635050 19691103 1.00
tpcds_q54/duckdb:parquet 28764421 29678780 0.97
tpcds_q55/duckdb:parquet 13070735 12436030 1.05
tpcds_q56/duckdb:parquet 24563534 24560683 1.00
tpcds_q57/duckdb:parquet 38399776 39063334 0.98
tpcds_q58/duckdb:parquet 26089659 26441941 0.99
tpcds_q59/duckdb:parquet 36090997 37557100 0.96
tpcds_q60/duckdb:parquet 25394846 25366706 1.00
tpcds_q61/duckdb:parquet 33034406 35053915 0.94
tpcds_q62/duckdb:parquet 12740541 13458627 0.95
tpcds_q63/duckdb:parquet 17659344 17920124 0.99
tpcds_q64/duckdb:parquet 74564313 78130616 0.95
tpcds_q65/duckdb:parquet 22864609 23158059 0.99
tpcds_q66/duckdb:parquet 30711753 31172612 0.99
tpcds_q67/duckdb:parquet 137832801 142383436 0.97
tpcds_q68/duckdb:parquet 39214440 39901686 0.98
tpcds_q69/duckdb:parquet 38320724 38956657 0.98
tpcds_q70/duckdb:parquet 22185969 24182110 0.92
tpcds_q71/duckdb:parquet 22991101 23443696 0.98
tpcds_q72/duckdb:parquet 167149546 170050224 0.98
tpcds_q73/duckdb:parquet 20301869 21926920 0.93
tpcds_q74/duckdb:parquet 126969899 130799749 0.97
tpcds_q75/duckdb:parquet 55441638 60752852 0.91
tpcds_q76/duckdb:parquet 22219615 22950219 0.97
tpcds_q77/duckdb:parquet 25264277 26505041 0.95
tpcds_q78/duckdb:parquet 77149647 79951616 0.96
tpcds_q79/duckdb:parquet 30022770 31091347 0.97
tpcds_q80/duckdb:parquet 43415162 45078903 0.96
tpcds_q81/duckdb:parquet 35322511 35985661 0.98
tpcds_q82/duckdb:parquet 16338467 18114586 0.90
tpcds_q83/duckdb:parquet 18548677 18940444 0.98
tpcds_q84/duckdb:parquet 21794358 21732444 1.00
tpcds_q85/duckdb:parquet 42067679 45358322 0.93
tpcds_q86/duckdb:parquet 13985528 14571398 0.96
tpcds_q87/duckdb:parquet 39623732 41729117 0.95
tpcds_q88/duckdb:parquet 53179625 54453450 0.98
tpcds_q89/duckdb:parquet 21329934 21982321 0.97
tpcds_q90/duckdb:parquet 8403999 8876188 0.95
tpcds_q91/duckdb:parquet 26117185 26477261 0.99
tpcds_q92/duckdb:parquet 13113953 13754390 0.95
tpcds_q93/duckdb:parquet 31977942 34328992 0.93
tpcds_q94/duckdb:parquet 17847210 19017930 0.94
tpcds_q95/duckdb:parquet 144429868 153225271 0.94
tpcds_q96/duckdb:parquet 10231922 10698829 0.96
tpcds_q97/duckdb:parquet 38412762 39515706 0.97
tpcds_q98/duckdb:parquet 24964179 24043705 1.04
tpcds_q99/duckdb:parquet 🚀 20275020 23058964 0.88
duckdb / duckdb (0.940x ➖, 8↑ 1↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22033271 24008647 0.92
tpcds_q02/duckdb:duckdb 19904912 20519702 0.97
tpcds_q03/duckdb:duckdb 10219551 11194490 0.91
tpcds_q04/duckdb:duckdb 177678571 188025333 0.94
tpcds_q05/duckdb:duckdb 20337195 22112236 0.92
tpcds_q06/duckdb:duckdb 28209794 29455961 0.96
tpcds_q07/duckdb:duckdb 40241575 43487233 0.93
tpcds_q08/duckdb:duckdb 119672823 122685166 0.98
tpcds_q09/duckdb:duckdb 20480847 21416945 0.96
tpcds_q10/duckdb:duckdb 27696029 29756308 0.93
tpcds_q11/duckdb:duckdb 91865125 100433257 0.91
tpcds_q12/duckdb:duckdb 14144472 14665467 0.96
tpcds_q13/duckdb:duckdb 26119574 26933415 0.97
tpcds_q14/duckdb:duckdb 93589682 96803401 0.97
tpcds_q15/duckdb:duckdb 24812225 26551243 0.93
tpcds_q16/duckdb:duckdb 19322521 21076402 0.92
tpcds_q17/duckdb:duckdb 26056309 25330486 1.03
tpcds_q18/duckdb:duckdb 45542679 49554210 0.92
tpcds_q19/duckdb:duckdb 19493931 20184441 0.97
tpcds_q20/duckdb:duckdb 14147211 14995936 0.94
tpcds_q21/duckdb:duckdb 🚨 8735335 7851517 1.11
tpcds_q22/duckdb:duckdb 63154880 68095587 0.93
tpcds_q23/duckdb:duckdb 75704920 82269026 0.92
tpcds_q24/duckdb:duckdb 25310666 26635878 0.95
tpcds_q25/duckdb:duckdb 18722622 19471919 0.96
tpcds_q26/duckdb:duckdb 28476846 29773190 0.96
tpcds_q27/duckdb:duckdb 41452466 43572028 0.95
tpcds_q28/duckdb:duckdb 26060749 26523483 0.98
tpcds_q29/duckdb:duckdb 23596204 25167500 0.94
tpcds_q30/duckdb:duckdb 30635237 32265274 0.95
tpcds_q31/duckdb:duckdb 52608613 57270667 0.92
tpcds_q32/duckdb:duckdb 8208537 8688162 0.94
tpcds_q33/duckdb:duckdb 16165270 17301370 0.93
tpcds_q34/duckdb:duckdb 18675609 18871992 0.99
tpcds_q35/duckdb:duckdb 35277773 38935472 0.91
tpcds_q36/duckdb:duckdb 70711446 77044708 0.92
tpcds_q37/duckdb:duckdb 8667689 8964382 0.97
tpcds_q38/duckdb:duckdb 33846365 34683358 0.98
tpcds_q39/duckdb:duckdb 28157981 29592445 0.95
tpcds_q40/duckdb:duckdb 14240137 15722028 0.91
tpcds_q41/duckdb:duckdb 9212963 10091308 0.91
tpcds_q42/duckdb:duckdb 9433985 9668460 0.98
tpcds_q43/duckdb:duckdb 15194010 15216047 1.00
tpcds_q44/duckdb:duckdb 15921843 16413252 0.97
tpcds_q45/duckdb:duckdb 18346027 19793080 0.93
tpcds_q46/duckdb:duckdb 39419962 40516227 0.97
tpcds_q47/duckdb:duckdb 46887684 50083930 0.94
tpcds_q48/duckdb:duckdb 24016954 25751125 0.93
tpcds_q49/duckdb:duckdb 20103007 22260496 0.90
tpcds_q50/duckdb:duckdb 15904874 17086452 0.93
tpcds_q51/duckdb:duckdb 97816795 104251281 0.94
tpcds_q52/duckdb:duckdb 9154353 9942518 0.92
tpcds_q53/duckdb:duckdb 18011492 18687315 0.96
tpcds_q54/duckdb:duckdb 18747601 19479843 0.96
tpcds_q55/duckdb:duckdb 🚀 8730033 9843264 0.89
tpcds_q56/duckdb:duckdb 16815452 17287057 0.97
tpcds_q57/duckdb:duckdb 36634119 38449329 0.95
tpcds_q58/duckdb:duckdb 16978059 18017911 0.94
tpcds_q59/duckdb:duckdb 36764839 37793207 0.97
tpcds_q60/duckdb:duckdb 18266619 19424723 0.94
tpcds_q61/duckdb:duckdb 🚀 16265853 18253425 0.89
tpcds_q62/duckdb:duckdb 9828524 10592168 0.93
tpcds_q63/duckdb:duckdb 16281087 17055755 0.95
tpcds_q64/duckdb:duckdb 58077620 62661548 0.93
tpcds_q65/duckdb:duckdb 36213648 38260244 0.95
tpcds_q66/duckdb:duckdb 🚀 26039365 29512355 0.88
tpcds_q67/duckdb:duckdb 130067577 141053822 0.92
tpcds_q68/duckdb:duckdb 26575536 27325217 0.97
tpcds_q69/duckdb:duckdb 27584841 29464089 0.94
tpcds_q70/duckdb:duckdb 16535532 17928647 0.92
tpcds_q71/duckdb:duckdb 16153548 17013001 0.95
tpcds_q72/duckdb:duckdb 45655329 47954110 0.95
tpcds_q73/duckdb:duckdb 13784198 14669775 0.94
tpcds_q74/duckdb:duckdb 143775019 152505981 0.94
tpcds_q75/duckdb:duckdb 46035339 47374586 0.97
tpcds_q76/duckdb:duckdb 14794130 15192880 0.97
tpcds_q77/duckdb:duckdb 15707346 16461307 0.95
tpcds_q78/duckdb:duckdb 🚀 64956701 72649393 0.89
tpcds_q79/duckdb:duckdb 20267974 20889512 0.97
tpcds_q80/duckdb:duckdb 30803873 33227260 0.93
tpcds_q81/duckdb:duckdb 40621206 43306339 0.94
tpcds_q82/duckdb:duckdb 🚀 10024148 11624152 0.86
tpcds_q83/duckdb:duckdb 10891986 11931570 0.91
tpcds_q84/duckdb:duckdb 14214462 15641257 0.91
tpcds_q85/duckdb:duckdb 25185944 27183192 0.93
tpcds_q86/duckdb:duckdb 11981554 13092697 0.92
tpcds_q87/duckdb:duckdb 35637346 38224962 0.93
tpcds_q88/duckdb:duckdb 29935933 31345468 0.96
tpcds_q89/duckdb:duckdb 22090501 22362203 0.99
tpcds_q90/duckdb:duckdb 🚀 6082751 6918083 0.88
tpcds_q91/duckdb:duckdb 14479152 15419677 0.94
tpcds_q92/duckdb:duckdb 🚀 9592700 10728685 0.89
tpcds_q93/duckdb:duckdb 23511400 26015761 0.90
tpcds_q94/duckdb:duckdb 14418918 15421961 0.93
tpcds_q95/duckdb:duckdb 110466859 117670979 0.94
tpcds_q96/duckdb:duckdb 🚀 5749789 7430203 0.77
tpcds_q97/duckdb:duckdb 32299058 34663319 0.93
tpcds_q98/duckdb:duckdb 20508665 21597512 0.95
tpcds_q99/duckdb:duckdb 16736738 17831598 0.94

File Size Changes (6 files changed, +0.0% overall, 5↑ 1↓)
File Scale Format Base HEAD Change %
time_dim.vortex 1.0 vortex-file-compressed 379.63 KB 380.77 KB +1.14 KB +0.3%
customer.vortex 1.0 vortex-file-compressed 4.26 MB 4.27 MB +8.02 KB +0.2%
catalog_page.vortex 1.0 vortex-file-compressed 572.17 KB 572.53 KB +368 B +0.1%
item.vortex 1.0 vortex-compact 994.25 KB 994.61 KB +376 B +0.0%
customer_address.vortex 1.0 vortex-file-compressed 826.10 KB 826.37 KB +272 B +0.0%
item.vortex 1.0 vortex-file-compressed 1.66 MB 1.66 MB 864 B -0.0%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (+0.0%)
  • vortex-file-compressed: 271.84 MB → 271.85 MB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -11.8% -7.5% -4.6% +22.4% ➖ noise
1 datafusion:vortex-file-compressed -2.3% -7.5% +5.7% +30.0% ➖ noise
1 duckdb:duckdb -8.2% -7.5% -0.7% +20.7% ➖ noise
1 duckdb:vortex-compact -5.8% -7.5% +1.9% +23.7% ➖ noise
1 duckdb:vortex-file-compressed -7.5% -7.5% +0.0% +30.6% ➖ noise
2 datafusion:vortex-compact -0.9% -4.1% +3.4% +18.0% ➖ noise
2 datafusion:vortex-file-compressed -3.9% -4.1% +0.2% +10.6% ➖ noise
2 duckdb:duckdb -3.0% -4.1% +1.2% +10.8% ➖ noise
2 duckdb:vortex-compact +16.3% -4.1% +21.3% +24.8% ➖ noise
2 duckdb:vortex-file-compressed -2.1% -4.1% +2.1% +22.4% ➖ noise
3 datafusion:vortex-compact -1.4% -4.5% +3.3% +25.9% ➖ noise
3 datafusion:vortex-file-compressed -4.0% -4.5% +0.5% +10.0% ➖ noise
3 duckdb:duckdb -8.7% -4.5% -4.4% +10.0% ➖ noise
3 duckdb:vortex-compact +1.4% -4.5% +6.2% +10.2% ➖ noise
3 duckdb:vortex-file-compressed +12.3% -4.5% +17.6% +10.5% 🚨 regression
4 datafusion:vortex-compact -4.5% -6.7% +2.3% +10.5% ➖ noise
4 datafusion:vortex-file-compressed -10.3% -6.7% -3.9% +10.0% ➖ noise
4 duckdb:duckdb -5.5% -6.7% +1.3% +10.0% ➖ noise
4 duckdb:vortex-compact -4.0% -6.7% +2.9% +14.5% ➖ noise
4 duckdb:vortex-file-compressed -7.4% -6.7% -0.7% +16.8% ➖ noise
5 datafusion:vortex-compact -4.7% -6.5% +2.0% +17.1% ➖ noise
5 datafusion:vortex-file-compressed -7.2% -6.5% -0.8% +12.6% ➖ noise
5 duckdb:duckdb -8.0% -6.5% -1.6% +11.3% ➖ noise
5 duckdb:vortex-compact -7.0% -6.5% -0.5% +14.7% ➖ noise
5 duckdb:vortex-file-compressed -7.9% -6.5% -1.5% +10.0% ➖ noise
6 datafusion:vortex-compact -5.8% -4.2% -1.7% +14.3% ➖ noise
6 datafusion:vortex-file-compressed +2.1% -4.2% +6.6% +12.2% ➖ noise
6 duckdb:duckdb -4.2% -4.2% -0.0% +10.0% ➖ noise
6 duckdb:vortex-compact -4.9% -4.2% -0.8% +15.2% ➖ noise
6 duckdb:vortex-file-compressed -9.7% -4.2% -5.7% +10.0% ➖ noise
7 datafusion:vortex-compact -11.1% -4.3% -7.1% +14.1% ➖ noise
7 datafusion:vortex-file-compressed -11.9% -4.3% -7.9% +10.4% ➖ noise
7 duckdb:duckdb -7.5% -4.3% -3.3% +10.0% ➖ noise
7 duckdb:vortex-compact -0.8% -4.3% +3.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.9% -4.3% +3.6% +12.4% ➖ noise
8 datafusion:vortex-compact -5.5% -1.7% -3.9% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -4.9% -1.7% -3.3% +10.0% ➖ noise
8 duckdb:duckdb -2.5% -1.7% -0.8% +10.0% ➖ noise
8 duckdb:vortex-compact -1.5% -1.7% +0.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -14.2% -1.7% -12.7% +16.9% ➖ noise
9 datafusion:vortex-compact -3.1% -2.8% -0.3% +17.4% ➖ noise
9 datafusion:vortex-file-compressed -0.6% -2.8% +2.3% +19.9% ➖ noise
9 duckdb:duckdb -4.4% -2.8% -1.6% +10.0% ➖ noise
9 duckdb:vortex-compact -7.4% -2.8% -4.8% +11.6% ➖ noise
9 duckdb:vortex-file-compressed +8.3% -2.8% +11.5% +11.5% ➖ noise
10 datafusion:vortex-compact -2.7% -3.6% +1.0% +12.5% ➖ noise
10 datafusion:vortex-file-compressed -2.5% -3.6% +1.2% +14.0% ➖ noise
10 duckdb:duckdb -6.9% -3.6% -3.4% +10.0% ➖ noise
10 duckdb:vortex-compact -6.2% -3.6% -2.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -9.8% -3.6% -6.5% +10.0% ➖ noise
11 datafusion:vortex-compact -5.2% -5.9% +0.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -9.9% -5.9% -4.3% +11.6% ➖ noise
11 duckdb:duckdb -8.5% -5.9% -2.8% +10.0% ➖ noise
11 duckdb:vortex-compact -1.9% -5.9% +4.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.6% -5.9% +4.5% +10.0% ➖ noise
12 datafusion:vortex-compact -15.6% -3.1% -12.9% +12.1% ✅ faster
12 datafusion:vortex-file-compressed -6.7% -3.1% -3.7% +19.6% ➖ noise
12 duckdb:duckdb -3.6% -3.1% -0.5% +10.0% ➖ noise
12 duckdb:vortex-compact -10.5% -3.1% -7.7% +14.2% ➖ noise
12 duckdb:vortex-file-compressed -9.4% -3.1% -6.5% +12.4% ➖ noise
13 datafusion:vortex-compact -4.2% -2.4% -1.8% +18.3% ➖ noise
13 datafusion:vortex-file-compressed +8.9% -2.4% +11.6% +10.0% 🚨 regression
13 duckdb:duckdb -3.0% -2.4% -0.6% +10.0% ➖ noise
13 duckdb:vortex-compact -5.3% -2.4% -2.9% +10.1% ➖ noise
13 duckdb:vortex-file-compressed +0.3% -2.4% +2.8% +12.8% ➖ noise
14 datafusion:vortex-compact -3.5% -5.6% +2.2% +10.4% ➖ noise
14 datafusion:vortex-file-compressed -0.7% -5.6% +5.1% +10.0% ➖ noise
14 duckdb:duckdb -3.3% -5.6% +2.4% +10.0% ➖ noise
14 duckdb:vortex-compact -10.6% -5.6% -5.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -4.7% -5.6% +0.9% +10.0% ➖ noise
15 datafusion:vortex-compact -3.7% -16.7% +15.6% +49.0% ➖ noise
15 datafusion:vortex-file-compressed +3.8% -16.7% +24.6% +12.1% 🚨 regression
15 duckdb:duckdb -6.5% -16.7% +12.2% +10.0% 🚨 regression
15 duckdb:vortex-compact -2.1% -16.7% +17.5% +11.1% 🚨 regression
15 duckdb:vortex-file-compressed -5.3% -16.7% +13.6% +19.7% ➖ noise
16 datafusion:vortex-compact -2.0% -11.9% +11.2% +11.8% ➖ noise
16 datafusion:vortex-file-compressed -0.9% -11.9% +12.4% +12.3% 🚨 regression
16 duckdb:duckdb -8.3% -11.9% +4.0% +13.1% ➖ noise
16 duckdb:vortex-compact -11.6% -11.9% +0.3% +13.6% ➖ noise
16 duckdb:vortex-file-compressed +5.3% -11.9% +19.5% +15.8% 🚨 regression
17 datafusion:vortex-compact -7.3% -4.1% -3.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -7.3% -4.1% -3.3% +10.0% ➖ noise
17 duckdb:duckdb +2.9% -4.1% +7.3% +11.9% ➖ noise
17 duckdb:vortex-compact -5.3% -4.1% -1.3% +19.8% ➖ noise
17 duckdb:vortex-file-compressed -4.1% -4.1% -0.0% +10.0% ➖ noise
18 datafusion:vortex-compact -2.8% -6.4% +3.9% +11.9% ➖ noise
18 datafusion:vortex-file-compressed -6.3% -6.4% +0.1% +12.9% ➖ noise
18 duckdb:duckdb -8.1% -6.4% -1.8% +10.0% ➖ noise
18 duckdb:vortex-compact +0.5% -6.4% +7.4% +12.1% ➖ noise
18 duckdb:vortex-file-compressed -4.0% -6.4% +2.5% +16.3% ➖ noise
19 datafusion:vortex-compact +0.2% -8.1% +9.1% +10.1% ➖ noise
19 datafusion:vortex-file-compressed +5.3% -8.1% +14.6% +10.4% 🚨 regression
19 duckdb:duckdb -3.4% -8.1% +5.1% +10.0% ➖ noise
19 duckdb:vortex-compact -3.4% -8.1% +5.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -4.7% -8.1% +3.7% +10.7% ➖ noise
20 datafusion:vortex-compact +1.3% -7.9% +10.0% +10.1% ➖ noise
20 datafusion:vortex-file-compressed -1.5% -7.9% +6.9% +10.0% ➖ noise
20 duckdb:duckdb -5.7% -7.9% +2.4% +10.0% ➖ noise
20 duckdb:vortex-compact -11.7% -7.9% -4.1% +17.2% ➖ noise
20 duckdb:vortex-file-compressed -10.7% -7.9% -3.1% +10.0% ➖ noise
21 datafusion:vortex-compact -9.6% -7.1% -2.8% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -11.1% -7.1% -4.3% +10.4% ➖ noise
21 duckdb:duckdb +11.3% -7.1% +19.7% +13.4% 🚨 regression
21 duckdb:vortex-compact -11.1% -7.1% -4.3% +11.9% ➖ noise
21 duckdb:vortex-file-compressed -5.4% -7.1% +1.8% +10.0% ➖ noise
22 datafusion:vortex-compact -4.3% -9.2% +5.4% +20.2% ➖ noise
22 datafusion:vortex-file-compressed +17.6% -9.2% +29.5% +34.7% ➖ noise
22 duckdb:duckdb -7.3% -9.2% +2.1% +11.9% ➖ noise
22 duckdb:vortex-compact -4.4% -9.2% +5.3% +13.1% ➖ noise
22 duckdb:vortex-file-compressed -5.3% -9.2% +4.3% +13.2% ➖ noise
23 datafusion:vortex-compact -3.1% -9.3% +6.8% +10.5% ➖ noise
23 datafusion:vortex-file-compressed -7.5% -9.3% +2.0% +10.0% ➖ noise
23 duckdb:duckdb -8.0% -9.3% +1.4% +10.7% ➖ noise
23 duckdb:vortex-compact -6.6% -9.3% +2.9% +13.9% ➖ noise
23 duckdb:vortex-file-compressed -2.8% -9.3% +7.1% +14.7% ➖ noise
24 datafusion:vortex-compact -7.3% -7.3% -0.0% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +0.8% -7.3% +8.8% +10.0% ➖ noise
24 duckdb:duckdb -5.0% -7.3% +2.5% +10.0% ➖ noise
24 duckdb:vortex-compact -1.6% -7.3% +6.1% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -10.8% -7.3% -3.8% +10.0% ➖ noise
25 datafusion:vortex-compact -8.2% -6.5% -1.8% +20.9% ➖ noise
25 datafusion:vortex-file-compressed -9.9% -6.5% -3.6% +13.1% ➖ noise
25 duckdb:duckdb -3.8% -6.5% +2.8% +11.7% ➖ noise
25 duckdb:vortex-compact -6.5% -6.5% +0.0% +11.7% ➖ noise
25 duckdb:vortex-file-compressed -11.7% -6.5% -5.6% +14.1% ➖ noise
26 datafusion:vortex-compact -2.9% -6.4% +3.7% +11.2% ➖ noise
26 datafusion:vortex-file-compressed -3.0% -6.4% +3.7% +10.0% ➖ noise
26 duckdb:duckdb -4.4% -6.4% +2.2% +10.0% ➖ noise
26 duckdb:vortex-compact -4.4% -6.4% +2.2% +13.9% ➖ noise
26 duckdb:vortex-file-compressed +0.2% -6.4% +7.0% +10.1% ➖ noise
27 datafusion:vortex-compact -6.9% -8.0% +1.1% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +4.2% -8.0% +13.3% +17.1% ➖ noise
27 duckdb:duckdb -4.9% -8.0% +3.4% +10.0% ➖ noise
27 duckdb:vortex-compact -0.4% -8.0% +8.3% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -5.8% -8.0% +2.4% +10.0% ➖ noise
28 datafusion:vortex-compact +0.5% -2.7% +3.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.5% -2.7% +5.3% +20.5% ➖ noise
28 duckdb:duckdb -1.7% -2.7% +0.9% +10.0% ➖ noise
28 duckdb:vortex-compact -8.6% -2.7% -6.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -3.6% -2.7% -0.9% +10.1% ➖ noise
29 datafusion:vortex-compact -5.4% -4.5% -1.0% +17.3% ➖ noise
29 datafusion:vortex-file-compressed -9.7% -4.5% -5.5% +10.0% ➖ noise
29 duckdb:duckdb -6.2% -4.5% -1.9% +10.0% ➖ noise
29 duckdb:vortex-compact -8.5% -4.5% -4.2% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -9.4% -4.5% -5.1% +16.0% ➖ noise
30 datafusion:vortex-compact -12.5% -5.6% -7.4% +14.2% ➖ noise
30 datafusion:vortex-file-compressed -7.2% -5.6% -1.7% +25.1% ➖ noise
30 duckdb:duckdb -5.1% -5.6% +0.6% +10.0% ➖ noise
30 duckdb:vortex-compact -6.6% -5.6% -1.1% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -7.6% -5.6% -2.1% +10.0% ➖ noise
31 datafusion:vortex-compact -1.1% -6.2% +5.4% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -6.0% -6.2% +0.2% +10.0% ➖ noise
31 duckdb:duckdb -8.1% -6.2% -2.0% +10.0% ➖ noise
31 duckdb:vortex-compact +0.5% -6.2% +7.1% +18.4% ➖ noise
31 duckdb:vortex-file-compressed -2.5% -6.2% +3.9% +19.9% ➖ noise
32 datafusion:vortex-compact -13.1% -11.2% -2.1% +23.7% ➖ noise
32 datafusion:vortex-file-compressed -5.8% -11.2% +6.1% +19.5% ➖ noise
32 duckdb:duckdb -5.5% -11.2% +6.4% +11.3% ➖ noise
32 duckdb:vortex-compact -8.9% -11.2% +2.7% +10.3% ➖ noise
32 duckdb:vortex-file-compressed -12.6% -11.2% -1.6% +11.6% ➖ noise
33 datafusion:vortex-compact -5.7% -5.0% -0.8% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -5.9% -5.0% -1.0% +10.0% ➖ noise
33 duckdb:duckdb -6.6% -5.0% -1.7% +10.0% ➖ noise
33 duckdb:vortex-compact -7.8% -5.0% -3.0% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -11.7% -5.0% -7.1% +30.2% ➖ noise
34 datafusion:vortex-compact -2.3% -1.1% -1.1% +11.4% ➖ noise
34 datafusion:vortex-file-compressed -0.5% -1.1% +0.6% +13.7% ➖ noise
34 duckdb:duckdb -1.0% -1.1% +0.1% +12.0% ➖ noise
34 duckdb:vortex-compact -4.9% -1.1% -3.8% +14.4% ➖ noise
34 duckdb:vortex-file-compressed -7.1% -1.1% -6.0% +12.0% ➖ noise
35 datafusion:vortex-compact -3.2% -9.5% +6.9% +21.1% ➖ noise
35 datafusion:vortex-file-compressed -4.2% -9.5% +5.8% +13.3% ➖ noise
35 duckdb:duckdb -9.4% -9.5% +0.1% +12.4% ➖ noise
35 duckdb:vortex-compact -5.0% -9.5% +4.9% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -5.3% -9.5% +4.6% +13.0% ➖ noise
36 datafusion:vortex-compact -12.2% -5.4% -7.2% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -10.8% -5.4% -5.6% +12.9% ➖ noise
36 duckdb:duckdb -8.2% -5.4% -2.9% +10.0% ➖ noise
36 duckdb:vortex-compact -3.9% -5.4% +1.6% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +1.0% -5.4% +6.9% +10.0% ➖ noise
37 datafusion:vortex-compact -10.5% -7.4% -3.4% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -13.0% -7.4% -6.1% +17.7% ➖ noise
37 duckdb:duckdb -3.3% -7.4% +4.4% +10.0% ➖ noise
37 duckdb:vortex-compact -10.4% -7.4% -3.2% +10.9% ➖ noise
37 duckdb:vortex-file-compressed -9.6% -7.4% -2.3% +19.7% ➖ noise
38 datafusion:vortex-compact -2.3% -7.4% +5.5% +16.5% ➖ noise
38 datafusion:vortex-file-compressed -8.8% -7.4% -1.5% +10.0% ➖ noise
38 duckdb:duckdb -2.4% -7.4% +5.4% +12.3% ➖ noise
38 duckdb:vortex-compact -7.6% -7.4% -0.2% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -11.7% -7.4% -4.6% +10.0% ➖ noise
39 datafusion:vortex-compact -16.9% -15.1% -2.1% +13.0% ➖ noise
39 datafusion:vortex-file-compressed -7.1% -15.1% +9.4% +10.0% ➖ noise
39 duckdb:duckdb -4.8% -15.1% +12.1% +10.0% 🚨 regression
39 duckdb:vortex-compact -5.1% -15.1% +11.8% +12.2% ➖ noise
39 duckdb:vortex-file-compressed -3.9% -15.1% +13.2% +14.1% ➖ noise
40 datafusion:vortex-compact -1.7% -10.1% +9.4% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -7.5% -10.1% +2.9% +10.0% ➖ noise
40 duckdb:duckdb -9.4% -10.1% +0.8% +10.0% ➖ noise
40 duckdb:vortex-compact -7.3% -10.1% +3.2% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -1.7% -10.1% +9.4% +10.0% ➖ noise
41 datafusion:vortex-compact -0.8% -10.7% +11.1% +10.1% 🚨 regression
41 datafusion:vortex-file-compressed -3.5% -10.7% +8.1% +10.0% ➖ noise
41 duckdb:duckdb -8.7% -10.7% +2.3% +10.0% ➖ noise
41 duckdb:vortex-compact +2.9% -10.7% +15.2% +10.0% 🚨 regression
41 duckdb:vortex-file-compressed +3.9% -10.7% +16.4% +30.3% ➖ noise
42 datafusion:vortex-compact -7.5% -2.4% -5.2% +31.5% ➖ noise
42 datafusion:vortex-file-compressed -6.1% -2.4% -3.8% +11.0% ➖ noise
42 duckdb:duckdb -2.4% -2.4% -0.1% +18.6% ➖ noise
42 duckdb:vortex-compact -10.0% -2.4% -7.9% +24.5% ➖ noise
42 duckdb:vortex-file-compressed -3.4% -2.4% -1.1% +16.1% ➖ noise
43 datafusion:vortex-compact -7.6% -5.6% -2.1% +11.2% ➖ noise
43 datafusion:vortex-file-compressed -7.3% -5.6% -1.8% +10.0% ➖ noise
43 duckdb:duckdb -0.1% -5.6% +5.7% +10.0% ➖ noise
43 duckdb:vortex-compact -8.6% -5.6% -3.3% +15.6% ➖ noise
43 duckdb:vortex-file-compressed -8.9% -5.6% -3.5% +24.9% ➖ noise
44 datafusion:vortex-compact -3.1% -2.6% -0.5% +10.1% ➖ noise
44 datafusion:vortex-file-compressed -4.9% -2.6% -2.3% +10.0% ➖ noise
44 duckdb:duckdb -3.0% -2.6% -0.4% +10.0% ➖ noise
44 duckdb:vortex-compact -7.3% -2.6% -4.8% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -5.7% -2.6% -3.1% +10.0% ➖ noise
45 datafusion:vortex-compact -13.5% -6.3% -7.7% +15.1% ➖ noise
45 datafusion:vortex-file-compressed -6.8% -6.3% -0.5% +16.2% ➖ noise
45 duckdb:duckdb -7.3% -6.3% -1.1% +10.0% ➖ noise
45 duckdb:vortex-compact -3.8% -6.3% +2.7% +10.0% ➖ noise
45 duckdb:vortex-file-compressed -8.6% -6.3% -2.5% +10.0% ➖ noise
46 datafusion:vortex-compact -7.9% -6.4% -1.7% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -8.4% -6.4% -2.1% +13.6% ➖ noise
46 duckdb:duckdb -2.7% -6.4% +3.9% +10.0% ➖ noise
46 duckdb:vortex-compact -4.6% -6.4% +1.9% +15.9% ➖ noise
46 duckdb:vortex-file-compressed -0.4% -6.4% +6.4% +26.7% ➖ noise
47 datafusion:vortex-compact -6.8% -8.0% +1.3% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -6.8% -8.0% +1.3% +10.0% ➖ noise
47 duckdb:duckdb -6.4% -8.0% +1.7% +10.0% ➖ noise
47 duckdb:vortex-compact -2.0% -8.0% +6.5% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -7.4% -8.0% +0.7% +10.0% ➖ noise
48 datafusion:vortex-compact -4.4% -5.5% +1.2% +18.5% ➖ noise
48 datafusion:vortex-file-compressed -2.7% -5.5% +2.9% +15.6% ➖ noise
48 duckdb:duckdb -6.7% -5.5% -1.3% +10.6% ➖ noise
48 duckdb:vortex-compact -4.3% -5.5% +1.3% +11.7% ➖ noise
48 duckdb:vortex-file-compressed -5.6% -5.5% -0.1% +10.0% ➖ noise
49 datafusion:vortex-compact -11.1% -6.3% -5.1% +15.1% ➖ noise
49 datafusion:vortex-file-compressed -5.8% -6.3% +0.5% +10.0% ➖ noise
49 duckdb:duckdb -9.7% -6.3% -3.6% +13.7% ➖ noise
49 duckdb:vortex-compact -0.6% -6.3% +6.2% +11.1% ➖ noise
49 duckdb:vortex-file-compressed +3.9% -6.3% +11.0% +23.6% ➖ noise
50 datafusion:vortex-compact -7.7% -3.8% -4.0% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -7.6% -3.8% -3.9% +10.0% ➖ noise
50 duckdb:duckdb -6.9% -3.8% -3.2% +10.0% ➖ noise
50 duckdb:vortex-compact -6.5% -3.8% -2.8% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -8.9% -3.8% -5.3% +25.4% ➖ noise
51 datafusion:vortex-compact -4.4% -7.9% +3.7% +11.6% ➖ noise
51 datafusion:vortex-file-compressed -3.9% -7.9% +4.3% +12.9% ➖ noise
51 duckdb:duckdb -6.2% -7.9% +1.8% +10.2% ➖ noise
51 duckdb:vortex-compact -6.0% -7.9% +2.1% +20.0% ➖ noise
51 duckdb:vortex-file-compressed -5.1% -7.9% +3.0% +20.4% ➖ noise
52 datafusion:vortex-compact +5.7% -2.1% +7.9% +20.5% ➖ noise
52 datafusion:vortex-file-compressed -0.5% -2.1% +1.6% +24.8% ➖ noise
52 duckdb:duckdb -7.9% -2.1% -6.0% +17.4% ➖ noise
52 duckdb:vortex-compact -1.3% -2.1% +0.8% +26.6% ➖ noise
52 duckdb:vortex-file-compressed -2.1% -2.1% -0.1% +35.8% ➖ noise
53 datafusion:vortex-compact -6.2% -8.3% +2.4% +13.8% ➖ noise
53 datafusion:vortex-file-compressed -9.3% -8.3% -1.0% +22.1% ➖ noise
53 duckdb:duckdb -3.6% -8.3% +5.2% +10.0% ➖ noise
53 duckdb:vortex-compact -1.9% -8.3% +7.0% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -7.0% -8.3% +1.5% +10.0% ➖ noise
54 datafusion:vortex-compact +0.4% -4.9% +5.6% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -6.4% -4.9% -1.6% +10.0% ➖ noise
54 duckdb:duckdb -3.8% -4.9% +1.2% +10.0% ➖ noise
54 duckdb:vortex-compact -4.4% -4.9% +0.5% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -4.2% -4.9% +0.7% +10.0% ➖ noise
55 datafusion:vortex-compact -2.3% +1.8% -3.9% +11.7% ➖ noise
55 datafusion:vortex-file-compressed -4.1% +1.8% -5.8% +10.1% ➖ noise
55 duckdb:duckdb -11.3% +1.8% -12.8% +12.5% ✅ faster
55 duckdb:vortex-compact -3.1% +1.8% -4.8% +10.0% ➖ noise
55 duckdb:vortex-file-compressed -6.3% +1.8% -7.9% +10.0% ➖ noise
56 datafusion:vortex-compact +1.3% -3.2% +4.6% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -2.5% -3.2% +0.7% +10.0% ➖ noise
56 duckdb:duckdb -2.7% -3.2% +0.5% +12.0% ➖ noise
56 duckdb:vortex-compact -3.0% -3.2% +0.2% +13.9% ➖ noise
56 duckdb:vortex-file-compressed -1.2% -3.2% +2.1% +10.0% ➖ noise
57 datafusion:vortex-compact -6.3% -2.4% -4.0% +11.9% ➖ noise
57 datafusion:vortex-file-compressed -6.4% -2.4% -4.1% +11.9% ➖ noise
57 duckdb:duckdb -4.7% -2.4% -2.4% +11.9% ➖ noise
57 duckdb:vortex-compact -3.2% -2.4% -0.8% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -11.5% -2.4% -9.3% +22.1% ➖ noise
58 datafusion:vortex-compact -2.5% -4.4% +2.0% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -2.7% -4.4% +1.8% +10.0% ➖ noise
58 duckdb:duckdb -5.8% -4.4% -1.4% +10.0% ➖ noise
58 duckdb:vortex-compact -12.3% -4.4% -8.3% +12.1% ➖ noise
58 duckdb:vortex-file-compressed -9.5% -4.4% -5.4% +14.1% ➖ noise
59 datafusion:vortex-compact +2.1% -4.2% +6.5% +15.0% ➖ noise
59 datafusion:vortex-file-compressed -5.0% -4.2% -0.9% +10.0% ➖ noise
59 duckdb:duckdb -2.7% -4.2% +1.5% +10.0% ➖ noise
59 duckdb:vortex-compact -0.1% -4.2% +4.3% +29.3% ➖ noise
59 duckdb:vortex-file-compressed -3.8% -4.2% +0.3% +10.0% ➖ noise
60 datafusion:vortex-compact -6.7% -2.5% -4.3% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -3.9% -2.5% -1.5% +10.0% ➖ noise
60 duckdb:duckdb -6.0% -2.5% -3.6% +10.0% ➖ noise
60 duckdb:vortex-compact -4.1% -2.5% -1.6% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -11.3% -2.5% -9.1% +19.6% ➖ noise
61 datafusion:vortex-compact +1.8% -0.4% +2.2% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -11.7% -0.4% -11.3% +16.8% ➖ noise
61 duckdb:duckdb -10.9% -0.4% -10.5% +10.0% ✅ faster
61 duckdb:vortex-compact -7.5% -0.4% -7.1% +13.2% ➖ noise
61 duckdb:vortex-file-compressed -2.7% -0.4% -2.3% +14.0% ➖ noise
62 datafusion:vortex-compact -8.7% -17.0% +10.0% +24.5% ➖ noise
62 datafusion:vortex-file-compressed +4.7% -17.0% +26.1% +23.0% 🚨 regression
62 duckdb:duckdb -7.2% -17.0% +11.8% +21.7% ➖ noise
62 duckdb:vortex-compact -10.6% -17.0% +7.7% +26.0% ➖ noise
62 duckdb:vortex-file-compressed -7.8% -17.0% +11.1% +18.9% ➖ noise
63 datafusion:vortex-compact -5.0% -3.4% -1.7% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -6.3% -3.4% -3.1% +10.0% ➖ noise
63 duckdb:duckdb -4.5% -3.4% -1.2% +10.0% ➖ noise
63 duckdb:vortex-compact +1.1% -3.4% +4.7% +15.0% ➖ noise
63 duckdb:vortex-file-compressed -5.1% -3.4% -1.8% +10.0% ➖ noise
64 datafusion:vortex-compact -8.9% -4.9% -4.3% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -3.7% -4.9% +1.3% +10.0% ➖ noise
64 duckdb:duckdb -7.3% -4.9% -2.6% +10.0% ➖ noise
64 duckdb:vortex-compact -7.7% -4.9% -3.0% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -2.9% -4.9% +2.1% +10.0% ➖ noise
65 datafusion:vortex-compact -3.9% -3.4% -0.5% +12.5% ➖ noise
65 datafusion:vortex-file-compressed -6.4% -3.4% -3.1% +10.0% ➖ noise
65 duckdb:duckdb -5.3% -3.4% -2.0% +10.0% ➖ noise
65 duckdb:vortex-compact -0.1% -3.4% +3.4% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +1.7% -3.4% +5.2% +10.0% ➖ noise
66 datafusion:vortex-compact -6.0% -2.9% -3.2% +18.1% ➖ noise
66 datafusion:vortex-file-compressed -7.1% -2.9% -4.3% +18.6% ➖ noise
66 duckdb:duckdb -11.8% -2.9% -9.1% +10.3% ➖ noise
66 duckdb:vortex-compact -7.8% -2.9% -5.1% +10.0% ➖ noise
66 duckdb:vortex-file-compressed -3.1% -2.9% -0.2% +10.0% ➖ noise
67 datafusion:vortex-compact -2.3% -7.6% +5.7% +12.1% ➖ noise
67 datafusion:vortex-file-compressed -4.8% -7.6% +3.0% +13.1% ➖ noise
67 duckdb:duckdb -7.8% -7.6% -0.3% +10.0% ➖ noise
67 duckdb:vortex-compact -7.3% -7.6% +0.3% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -6.9% -7.6% +0.7% +10.0% ➖ noise
68 datafusion:vortex-compact -18.8% -2.4% -16.8% +21.8% ➖ noise
68 datafusion:vortex-file-compressed -7.7% -2.4% -5.5% +30.9% ➖ noise
68 duckdb:duckdb -2.7% -2.4% -0.4% +10.0% ➖ noise
68 duckdb:vortex-compact -3.8% -2.4% -1.4% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -7.7% -2.4% -5.4% +12.3% ➖ noise
69 datafusion:vortex-compact -3.4% -2.8% -0.6% +19.6% ➖ noise
69 datafusion:vortex-file-compressed -9.8% -2.8% -7.2% +11.7% ➖ noise
69 duckdb:duckdb -6.4% -2.8% -3.7% +10.3% ➖ noise
69 duckdb:vortex-compact -3.8% -2.8% -1.1% +16.4% ➖ noise
69 duckdb:vortex-file-compressed -8.9% -2.8% -6.3% +15.2% ➖ noise
70 datafusion:vortex-compact -2.4% -8.3% +6.4% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -5.0% -8.3% +3.7% +10.0% ➖ noise
70 duckdb:duckdb -7.8% -8.3% +0.6% +11.1% ➖ noise
70 duckdb:vortex-compact -2.8% -8.3% +6.0% +16.2% ➖ noise
70 duckdb:vortex-file-compressed -3.6% -8.3% +5.2% +12.3% ➖ noise
71 datafusion:vortex-compact -4.9% -2.2% -2.7% +28.9% ➖ noise
71 datafusion:vortex-file-compressed -10.6% -2.2% -8.6% +25.9% ➖ noise
71 duckdb:duckdb -5.1% -2.2% -2.9% +10.0% ➖ noise
71 duckdb:vortex-compact +2.3% -2.2% +4.6% +13.4% ➖ noise
71 duckdb:vortex-file-compressed -5.7% -2.2% -3.6% +10.0% ➖ noise
72 datafusion:vortex-compact -6.4% -5.2% -1.3% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -9.6% -5.2% -4.6% +10.0% ➖ noise
72 duckdb:duckdb -4.8% -5.2% +0.4% +10.0% ➖ noise
72 duckdb:vortex-compact -5.7% -5.2% -0.5% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -4.6% -5.2% +0.6% +10.0% ➖ noise
73 datafusion:vortex-compact -3.3% -8.2% +5.4% +11.3% ➖ noise
73 datafusion:vortex-file-compressed -10.9% -8.2% -2.9% +32.2% ➖ noise
73 duckdb:duckdb -6.0% -8.2% +2.4% +10.0% ➖ noise
73 duckdb:vortex-compact -8.5% -8.2% -0.3% +10.8% ➖ noise
73 duckdb:vortex-file-compressed +2.0% -8.2% +11.1% +13.3% ➖ noise
74 datafusion:vortex-compact -6.4% -4.9% -1.6% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -2.0% -4.9% +3.0% +10.0% ➖ noise
74 duckdb:duckdb -5.7% -4.9% -0.9% +10.0% ➖ noise
74 duckdb:vortex-compact -11.0% -4.9% -6.5% +20.5% ➖ noise
74 duckdb:vortex-file-compressed -1.4% -4.9% +3.6% +15.4% ➖ noise
75 datafusion:vortex-compact -3.5% -10.0% +7.2% +19.3% ➖ noise
75 datafusion:vortex-file-compressed -11.1% -10.0% -1.2% +18.9% ➖ noise
75 duckdb:duckdb -2.8% -10.0% +8.0% +10.0% ➖ noise
75 duckdb:vortex-compact -6.0% -10.0% +4.4% +10.0% ➖ noise
75 duckdb:vortex-file-compressed -9.3% -10.0% +0.8% +15.0% ➖ noise
76 datafusion:vortex-compact -4.0% -5.6% +1.7% +10.2% ➖ noise
76 datafusion:vortex-file-compressed +0.1% -5.6% +6.0% +30.1% ➖ noise
76 duckdb:duckdb -2.6% -5.6% +3.1% +12.0% ➖ noise
76 duckdb:vortex-compact -3.6% -5.6% +2.1% +14.1% ➖ noise
76 duckdb:vortex-file-compressed -1.2% -5.6% +4.6% +13.4% ➖ noise
77 datafusion:vortex-compact -4.4% -3.5% -1.0% +12.3% ➖ noise
77 datafusion:vortex-file-compressed -3.9% -3.5% -0.4% +11.7% ➖ noise
77 duckdb:duckdb -4.6% -3.5% -1.1% +10.5% ➖ noise
77 duckdb:vortex-compact -4.2% -3.5% -0.8% +13.2% ➖ noise
77 duckdb:vortex-file-compressed -11.7% -3.5% -8.5% +15.8% ➖ noise
78 datafusion:vortex-compact -7.7% -7.8% +0.1% +11.5% ➖ noise
78 datafusion:vortex-file-compressed -9.2% -7.8% -1.6% +10.0% ➖ noise
78 duckdb:duckdb -10.6% -7.8% -3.0% +10.0% ➖ noise
78 duckdb:vortex-compact -3.5% -7.8% +4.7% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -6.9% -7.8% +1.0% +10.0% ➖ noise
79 datafusion:vortex-compact -8.6% -3.3% -5.5% +12.7% ➖ noise
79 datafusion:vortex-file-compressed -1.0% -3.3% +2.4% +38.2% ➖ noise
79 duckdb:duckdb -3.0% -3.3% +0.3% +10.6% ➖ noise
79 duckdb:vortex-compact -6.8% -3.3% -3.6% +27.8% ➖ noise
79 duckdb:vortex-file-compressed -4.7% -3.3% -1.4% +16.6% ➖ noise
80 datafusion:vortex-compact -11.2% -5.6% -5.9% +15.6% ➖ noise
80 datafusion:vortex-file-compressed -14.5% -5.6% -9.4% +10.0% ✅ faster
80 duckdb:duckdb -7.3% -5.6% -1.8% +10.0% ➖ noise
80 duckdb:vortex-compact +1.4% -5.6% +7.4% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -9.2% -5.6% -3.8% +13.3% ➖ noise
81 datafusion:vortex-compact -3.2% -8.4% +5.7% +18.7% ➖ noise
81 datafusion:vortex-file-compressed -11.0% -8.4% -2.9% +21.0% ➖ noise
81 duckdb:duckdb -6.2% -8.4% +2.3% +10.0% ➖ noise
81 duckdb:vortex-compact -7.7% -8.4% +0.7% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -7.8% -8.4% +0.6% +10.0% ➖ noise
82 datafusion:vortex-compact -5.5% -7.7% +2.3% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -4.7% -7.7% +3.3% +10.0% ➖ noise
82 duckdb:duckdb -13.8% -7.7% -6.6% +20.6% ➖ noise
82 duckdb:vortex-compact -6.5% -7.7% +1.3% +13.9% ➖ noise
82 duckdb:vortex-file-compressed -6.5% -7.7% +1.3% +10.0% ➖ noise
83 datafusion:vortex-compact -10.6% -7.4% -3.5% +18.7% ➖ noise
83 datafusion:vortex-file-compressed -3.1% -7.4% +4.6% +17.2% ➖ noise
83 duckdb:duckdb -8.7% -7.4% -1.5% +10.0% ➖ noise
83 duckdb:vortex-compact -9.9% -7.4% -2.8% +18.1% ➖ noise
83 duckdb:vortex-file-compressed -1.7% -7.4% +6.1% +10.0% ➖ noise
84 datafusion:vortex-compact -14.2% -3.6% -11.1% +10.0% ✅ faster
84 datafusion:vortex-file-compressed -7.8% -3.6% -4.4% +10.0% ➖ noise
84 duckdb:duckdb -9.1% -3.6% -5.8% +10.0% ➖ noise
84 duckdb:vortex-compact -8.4% -3.6% -5.0% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -2.3% -3.6% +1.3% +28.9% ➖ noise
85 datafusion:vortex-compact -13.0% -7.2% -6.3% +21.6% ➖ noise
85 datafusion:vortex-file-compressed -10.2% -7.2% -3.3% +10.0% ➖ noise
85 duckdb:duckdb -7.3% -7.2% -0.2% +10.0% ➖ noise
85 duckdb:vortex-compact -8.3% -7.2% -1.2% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -10.7% -7.2% -3.8% +10.0% ➖ noise
86 datafusion:vortex-compact -15.2% -14.3% -1.1% +20.8% ➖ noise
86 datafusion:vortex-file-compressed -1.0% -14.3% +15.5% +17.2% ➖ noise
86 duckdb:duckdb -8.5% -14.3% +6.8% +10.8% ➖ noise
86 duckdb:vortex-compact -10.4% -14.3% +4.5% +20.5% ➖ noise
86 duckdb:vortex-file-compressed -0.6% -14.3% +16.0% +13.7% 🚨 regression
87 datafusion:vortex-compact -2.7% -4.4% +1.8% +14.9% ➖ noise
87 datafusion:vortex-file-compressed -9.8% -4.4% -5.6% +10.0% ➖ noise
87 duckdb:duckdb -6.8% -4.4% -2.5% +12.4% ➖ noise
87 duckdb:vortex-compact -12.1% -4.4% -8.0% +10.0% ➖ noise
87 duckdb:vortex-file-compressed -6.6% -4.4% -2.3% +10.0% ➖ noise
88 datafusion:vortex-compact -3.6% -6.3% +2.9% +10.1% ➖ noise
88 datafusion:vortex-file-compressed -2.0% -6.3% +4.6% +10.3% ➖ noise
88 duckdb:duckdb -4.5% -6.3% +1.9% +10.0% ➖ noise
88 duckdb:vortex-compact -2.1% -6.3% +4.5% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -3.3% -6.3% +3.2% +10.0% ➖ noise
89 datafusion:vortex-compact -8.6% -5.7% -3.0% +19.7% ➖ noise
89 datafusion:vortex-file-compressed -6.4% -5.7% -0.7% +19.1% ➖ noise
89 duckdb:duckdb -1.2% -5.7% +4.8% +10.0% ➖ noise
89 duckdb:vortex-compact -2.3% -5.7% +3.6% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -5.7% -5.7% +0.0% +10.0% ➖ noise
90 datafusion:vortex-compact -6.1% -5.8% -0.2% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -7.8% -5.8% -2.1% +10.0% ➖ noise
90 duckdb:duckdb -12.1% -5.8% -6.6% +10.0% ➖ noise
90 duckdb:vortex-compact -8.0% -5.8% -2.3% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -9.0% -5.8% -3.3% +10.0% ➖ noise
91 datafusion:vortex-compact -5.9% -4.9% -1.0% +10.5% ➖ noise
91 datafusion:vortex-file-compressed -11.6% -4.9% -7.0% +21.8% ➖ noise
91 duckdb:duckdb -6.1% -4.9% -1.2% +10.0% ➖ noise
91 duckdb:vortex-compact -4.9% -4.9% +0.0% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -8.1% -4.9% -3.3% +10.0% ➖ noise
92 datafusion:vortex-compact -2.1% -8.1% +6.4% +11.6% ➖ noise
92 datafusion:vortex-file-compressed -5.6% -8.1% +2.7% +10.0% ➖ noise
92 duckdb:duckdb -10.6% -8.1% -2.7% +10.0% ➖ noise
92 duckdb:vortex-compact -14.5% -8.1% -6.9% +16.7% ➖ noise
92 duckdb:vortex-file-compressed +0.1% -8.1% +8.9% +35.7% ➖ noise
93 datafusion:vortex-compact -9.3% -8.1% -1.3% +23.1% ➖ noise
93 datafusion:vortex-file-compressed -6.2% -8.1% +2.0% +10.0% ➖ noise
93 duckdb:duckdb -9.6% -8.1% -1.6% +10.0% ➖ noise
93 duckdb:vortex-compact -12.0% -8.1% -4.2% +16.1% ➖ noise
93 duckdb:vortex-file-compressed -10.2% -8.1% -2.3% +20.0% ➖ noise
94 datafusion:vortex-compact -5.0% -5.7% +0.7% +11.4% ➖ noise
94 datafusion:vortex-file-compressed -10.3% -5.7% -4.8% +12.1% ➖ noise
94 duckdb:duckdb -6.5% -5.7% -0.9% +10.0% ➖ noise
94 duckdb:vortex-compact -13.2% -5.7% -8.0% +12.8% ➖ noise
94 duckdb:vortex-file-compressed -8.0% -5.7% -2.5% +10.0% ➖ noise
95 datafusion:vortex-compact -7.2% -6.0% -1.3% +11.1% ➖ noise
95 datafusion:vortex-file-compressed -3.6% -6.0% +2.5% +11.4% ➖ noise
95 duckdb:duckdb -6.1% -6.0% -0.2% +18.9% ➖ noise
95 duckdb:vortex-compact -5.2% -6.0% +0.8% +18.4% ➖ noise
95 duckdb:vortex-file-compressed -12.8% -6.0% -7.3% +19.8% ➖ noise
96 datafusion:vortex-compact -1.5% -9.2% +8.6% +10.0% ➖ noise
96 datafusion:vortex-file-compressed -7.0% -9.2% +2.4% +26.5% ➖ noise
96 duckdb:duckdb -22.6% -9.2% -14.7% +18.6% ➖ noise
96 duckdb:vortex-compact -5.5% -9.2% +4.1% +10.0% ➖ noise
96 duckdb:vortex-file-compressed -2.6% -9.2% +7.3% +10.0% ➖ noise
97 datafusion:vortex-compact -6.0% -7.2% +1.3% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -8.2% -7.2% -1.1% +15.2% ➖ noise
97 duckdb:duckdb -6.8% -7.2% +0.4% +10.0% ➖ noise
97 duckdb:vortex-compact -8.8% -7.2% -1.7% +10.0% ➖ noise
97 duckdb:vortex-file-compressed -9.0% -7.2% -1.9% +10.0% ➖ noise
98 datafusion:vortex-compact -6.2% -1.1% -5.1% +18.6% ➖ noise
98 datafusion:vortex-file-compressed -7.7% -1.1% -6.7% +10.5% ➖ noise
98 duckdb:duckdb -5.0% -1.1% -4.0% +10.0% ➖ noise
98 duckdb:vortex-compact -7.6% -1.1% -6.5% +11.5% ➖ noise
98 duckdb:vortex-file-compressed -5.8% -1.1% -4.8% +10.0% ➖ noise
99 datafusion:vortex-compact +9.7% -12.7% +25.7% +22.3% 🚨 regression
99 datafusion:vortex-file-compressed -4.8% -12.7% +9.0% +25.7% ➖ noise
99 duckdb:duckdb -6.1% -12.7% +7.5% +30.7% ➖ noise
99 duckdb:vortex-compact -0.5% -12.7% +13.9% +26.3% ➖ noise
99 duckdb:vortex-file-compressed -9.0% -12.7% +4.2% +25.4% ➖ noise

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Jun 4, 2026

Merging this PR will improve performance by 30.19%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 3 improved benchmarks
✅ 1504 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_bool_canonical_into[(1000, 10)] 45.3 µs 30.3 µs +49.41%
Simulation chunked_varbinview_canonical_into[(1000, 10)] 197.1 µs 160.8 µs +22.53%
Simulation chunked_varbinview_into_canonical[(1000, 10)] 211.7 µs 175.6 µs +20.54%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/wide-col-projection (9a0f3ba) with develop (3ac6c77)

Open in CodSpeed

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.8%
Engines: DataFusion No clear signal (-14.9%, environment too noisy confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): 0.986x ➖
Parquet (geomean): 1.069x ➖
Shifts: Parquet (control) +6.9% · Median polish +3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.870x ➖, 1↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 48176516 58302929 0.83
fineweb_q01/datafusion:vortex-file-compressed 686107164 854569248 0.80
fineweb_q02/datafusion:vortex-file-compressed 🚀 611084538 901419825 0.68
fineweb_q03/datafusion:vortex-file-compressed 1247384263 1137862896 1.10
fineweb_q04/datafusion:vortex-file-compressed 1162151466 1184403811 0.98
fineweb_q05/datafusion:vortex-file-compressed 1084366051 1186611823 0.91
fineweb_q06/datafusion:vortex-file-compressed 1164148142 1570856652 0.74
fineweb_q07/datafusion:vortex-file-compressed 1081667745 1098324319 0.98
fineweb_q08/datafusion:vortex-file-compressed 420745144 474994501 0.89
datafusion / vortex-compact (0.985x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 33831262 35229892 0.96
fineweb_q01/datafusion:vortex-compact 646638957 730675464 0.88
fineweb_q02/datafusion:vortex-compact 770154610 632581973 1.22
fineweb_q03/datafusion:vortex-compact 1363813370 1328098530 1.03
fineweb_q04/datafusion:vortex-compact 1472770408 1637615513 0.90
fineweb_q05/datafusion:vortex-compact 1359209161 1382312244 0.98
fineweb_q06/datafusion:vortex-compact 1292894541 1317358890 0.98
fineweb_q07/datafusion:vortex-compact 1177176891 1144816691 1.03
fineweb_q08/datafusion:vortex-compact 375896622 407076005 0.92
datafusion / parquet (1.088x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1187559274 1390906568 0.85
fineweb_q01/datafusion:parquet 2278215022 1885956737 1.21
fineweb_q02/datafusion:parquet 1987866817 1960661626 1.01
fineweb_q03/datafusion:parquet 2221330700 2041420031 1.09
fineweb_q04/datafusion:parquet 2241836126 2021355971 1.11
fineweb_q05/datafusion:parquet 2392655284 1855197234 1.29
fineweb_q06/datafusion:parquet 2443338698 2075644097 1.18
fineweb_q07/datafusion:parquet 2044942378 1976964810 1.03
fineweb_q08/datafusion:parquet 2228038853 2065392435 1.08
duckdb / vortex-file-compressed (1.080x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 100414765 81685458 1.23
fineweb_q01/duckdb:vortex-file-compressed 690902565 615209913 1.12
fineweb_q02/duckdb:vortex-file-compressed 575909442 678687447 0.85
fineweb_q03/duckdb:vortex-file-compressed 1460664526 1540334912 0.95
fineweb_q04/duckdb:vortex-file-compressed 1859839517 1441020721 1.29
fineweb_q05/duckdb:vortex-file-compressed 1536743459 1338603066 1.15
fineweb_q06/duckdb:vortex-file-compressed 1581385359 1470993344 1.08
fineweb_q07/duckdb:vortex-file-compressed 1463346742 1410603203 1.04
fineweb_q08/duckdb:vortex-file-compressed 579186544 532349141 1.09
duckdb / vortex-compact (1.019x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 92638946 91570290 1.01
fineweb_q01/duckdb:vortex-compact 629381347 570870601 1.10
fineweb_q02/duckdb:vortex-compact 622233181 630716462 0.99
fineweb_q03/duckdb:vortex-compact 1897485436 1738355448 1.09
fineweb_q04/duckdb:vortex-compact 1922411585 1856632312 1.04
fineweb_q05/duckdb:vortex-compact 1689686753 1660293843 1.02
fineweb_q06/duckdb:vortex-compact 1685412232 1623852595 1.04
fineweb_q07/duckdb:vortex-compact 1364819599 1415347251 0.96
fineweb_q08/duckdb:vortex-compact 478536640 512308265 0.93
duckdb / parquet (1.050x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1197740511 1160631488 1.03
fineweb_q01/duckdb:parquet 1486188673 1548408001 0.96
fineweb_q02/duckdb:parquet 1535648964 1408879106 1.09
fineweb_q03/duckdb:parquet 4066760808 3723655237 1.09
fineweb_q04/duckdb:parquet 2230517949 1996977347 1.12
fineweb_q05/duckdb:parquet 2261090408 2184744955 1.03
fineweb_q06/duckdb:parquet 4552857065 4415957303 1.03
fineweb_q07/duckdb:parquet 2894144755 2734573865 1.06
fineweb_q08/duckdb:parquet 1272115324 1216014413 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -4.0% -6.1% +2.3% +221.4% ➖ noise
0 datafusion:vortex-file-compressed -17.4% -6.1% -12.0% +208.9% ➖ noise
0 duckdb:vortex-compact +1.2% -6.1% +7.8% +90.9% ➖ noise
0 duckdb:vortex-file-compressed +22.9% -6.1% +31.0% +49.7% ➖ noise
1 datafusion:vortex-compact -11.5% +7.7% -17.8% +88.9% ➖ noise
1 datafusion:vortex-file-compressed -19.7% +7.7% -25.4% +94.0% ➖ noise
1 duckdb:vortex-compact +10.2% +7.7% +2.4% +32.2% ➖ noise
1 duckdb:vortex-file-compressed +12.3% +7.7% +4.3% +48.1% ➖ noise
2 datafusion:vortex-compact +21.7% +5.1% +15.8% +37.5% ➖ noise
2 datafusion:vortex-file-compressed -32.2% +5.1% -35.5% +68.1% ➖ noise
2 duckdb:vortex-compact -1.3% +5.1% -6.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -15.1% +5.1% -19.3% +32.5% ➖ noise
3 datafusion:vortex-compact +2.7% +9.0% -5.8% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +9.6% +9.0% +0.6% +30.0% ➖ noise
3 duckdb:vortex-compact +9.2% +9.0% +0.1% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -5.2% +9.0% -13.0% +35.1% ➖ noise
4 datafusion:vortex-compact -10.1% +11.3% -19.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -1.9% +11.3% -11.8% +30.0% ➖ noise
4 duckdb:vortex-compact +3.5% +11.3% -7.0% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +29.1% +11.3% +16.0% +30.0% ➖ noise
5 datafusion:vortex-compact -1.7% +15.5% -14.9% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -8.6% +15.5% -20.9% +30.0% ➖ noise
5 duckdb:vortex-compact +1.8% +15.5% -11.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +14.8% +15.5% -0.6% +30.0% ➖ noise
6 datafusion:vortex-compact -1.9% +10.2% -10.9% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -25.9% +10.2% -32.7% +33.3% ✅ faster
6 duckdb:vortex-compact +3.8% +10.2% -5.8% +32.5% ➖ noise
6 duckdb:vortex-file-compressed +7.5% +10.2% -2.4% +30.0% ➖ noise
7 datafusion:vortex-compact +2.8% +4.6% -1.7% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -1.5% +4.6% -5.9% +30.0% ➖ noise
7 duckdb:vortex-compact -3.6% +4.6% -7.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +3.7% +4.6% -0.9% +30.0% ➖ noise
8 datafusion:vortex-compact -7.7% +6.2% -13.1% +46.5% ➖ noise
8 datafusion:vortex-file-compressed -11.4% +6.2% -16.6% +36.9% ➖ noise
8 duckdb:vortex-compact -6.6% +6.2% -12.1% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +8.8% +6.2% +2.4% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): 1.004x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed (1.007x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12010273 12092081 0.99
statpopgen_q01/duckdb:vortex-file-compressed 27120330 25965545 1.04
statpopgen_q02/duckdb:vortex-file-compressed 537533092 529502315 1.02
statpopgen_q03/duckdb:vortex-file-compressed 1058035662 1048547335 1.01
statpopgen_q04/duckdb:vortex-file-compressed 1056045180 1065997860 0.99
statpopgen_q05/duckdb:vortex-file-compressed 488228775 508021276 0.96
statpopgen_q06/duckdb:vortex-file-compressed 1545374455 1541643172 1.00
statpopgen_q07/duckdb:vortex-file-compressed 206282692 202732093 1.02
statpopgen_q08/duckdb:vortex-file-compressed 238126079 227732123 1.05
statpopgen_q09/duckdb:vortex-file-compressed 819062491 816112119 1.00
statpopgen_q10/duckdb:vortex-file-compressed 2551708967 2558797662 1.00
duckdb / vortex-compact (1.000x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11493507 11463299 1.00
statpopgen_q01/duckdb:vortex-compact 215546341 215841019 1.00
statpopgen_q02/duckdb:vortex-compact 563973704 558269332 1.01
statpopgen_q03/duckdb:vortex-compact 1151395759 1147275339 1.00
statpopgen_q04/duckdb:vortex-compact 1141627636 1160117808 0.98
statpopgen_q05/duckdb:vortex-compact 564437938 565491355 1.00
statpopgen_q06/duckdb:vortex-compact 1488567798 1513905984 0.98
statpopgen_q07/duckdb:vortex-compact 886220338 882463553 1.00
statpopgen_q08/duckdb:vortex-compact 922137611 916721657 1.01
statpopgen_q09/duckdb:vortex-compact 933108798 913585384 1.02
statpopgen_q10/duckdb:vortex-compact 2587001603 2609469000 0.99
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 301606895 300108967 1.00
statpopgen_q01/duckdb:parquet 385018060 376034097 1.02
statpopgen_q02/duckdb:parquet 760955400 769138457 0.99
statpopgen_q03/duckdb:parquet 1172088647 1184584148 0.99
statpopgen_q04/duckdb:parquet 1199303560 1175644288 1.02
statpopgen_q05/duckdb:parquet 816563598 817236622 1.00
statpopgen_q06/duckdb:parquet 1410099840 1418862568 0.99
statpopgen_q07/duckdb:parquet 836145445 844156375 0.99
statpopgen_q08/duckdb:parquet 843814354 845751646 1.00
statpopgen_q09/duckdb:parquet 1003458563 1020203579 0.98
statpopgen_q10/duckdb:parquet 2201271687 2181346989 1.01

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB 18.14 KB -0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +0.3% +0.5% -0.2% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -0.7% +0.5% -1.2% +10.0% ➖ noise
1 duckdb:vortex-compact -0.1% +2.4% -2.5% +33.3% ➖ noise
1 duckdb:vortex-file-compressed +4.4% +2.4% +2.0% +223.8% ➖ noise
2 duckdb:vortex-compact +1.0% -1.1% +2.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.5% -1.1% +2.6% +10.0% ➖ noise
3 duckdb:vortex-compact +0.4% -1.1% +1.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.9% -1.1% +2.0% +10.0% ➖ noise
4 duckdb:vortex-compact -1.6% +2.0% -3.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.9% +2.0% -2.9% +10.0% ➖ noise
5 duckdb:vortex-compact -0.2% -0.1% -0.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -3.9% -0.1% -3.8% +10.0% ➖ noise
6 duckdb:vortex-compact -1.7% -0.6% -1.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.2% -0.6% +0.9% +10.0% ➖ noise
7 duckdb:vortex-compact +0.4% -0.9% +1.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.8% -0.9% +2.7% +10.0% ➖ noise
8 duckdb:vortex-compact +0.6% -0.2% +0.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +4.6% -0.2% +4.8% +10.0% ➖ noise
9 duckdb:vortex-compact +2.1% -1.6% +3.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.4% -1.6% +2.0% +10.0% ➖ noise
10 duckdb:vortex-compact -0.9% +0.9% -1.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.3% +0.9% -1.2% +10.0% ➖ noise

@joseph-isaacs joseph-isaacs added the changelog/feature A new feature label Jun 4, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: Random Access

Vortex (geomean): 0.978x ➖
Parquet (geomean): 0.996x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (1.025x ➖, 2↑ 2↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 1754962 366237 4.79
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1050355 1062305 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8286192862 8349555584 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8283921787 8290026874 1.00
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 3838671 4544989 0.84
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 2646358 3179298 0.83
random-access/feature-vectors/uniform/lance-tokio-local-disk 1213354 1161030 1.05
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1868498 1834331 1.02
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8303014224 8261732838 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8264776144 8145024880 1.01
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚨 5994518 4451858 1.35
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 5871323 6076310 0.97
random-access/lance-tokio-local-disk 641777 635763 1.01
random-access/lance-tokio-local-disk-footer 1294066 1288952 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk 234806 235831 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 579363 578599 1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk 127901840 128702798 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 127274173 128823872 0.99
random-access/nested-lists/correlated/vortex-tokio-local-disk 558361 523749 1.07
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 543507 596571 0.91
random-access/nested-lists/uniform/lance-tokio-local-disk 1023364 990382 1.03
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1365907 1336401 1.02
random-access/nested-lists/uniform/parquet-tokio-local-disk 126099341 129309427 0.98
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 125846673 129561367 0.97
random-access/nested-lists/uniform/vortex-tokio-local-disk 2020900 2001027 1.01
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2014642 2051327 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk 366883 361932 1.01
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 542906 541689 1.00
random-access/nested-structs/correlated/parquet-tokio-local-disk 22299181 21915784 1.02
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 22187965 22092594 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk 720424 662226 1.09
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 684282 726433 0.94
random-access/nested-structs/uniform/lance-tokio-local-disk 2701438 2577624 1.05
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2822087 2709476 1.04
random-access/nested-structs/uniform/parquet-tokio-local-disk 22143736 22046465 1.00
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 22170586 21945282 1.01
random-access/nested-structs/uniform/vortex-tokio-local-disk 1534950 1525900 1.01
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1521207 1579225 0.96
random-access/parquet-tokio-local-disk 165180064 165748529 1.00
random-access/parquet-tokio-local-disk-footer 165542944 167347272 0.99
random-access/taxi/correlated/lance-tokio-local-disk 933039 930783 1.00
random-access/taxi/correlated/lance-tokio-local-disk-footer 1784794 1809715 0.99
random-access/taxi/correlated/parquet-tokio-local-disk 249193861 251986598 0.99
random-access/taxi/correlated/parquet-tokio-local-disk-footer 249418652 249796015 1.00
random-access/taxi/correlated/vortex-tokio-local-disk 1400615 1528040 0.92
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1548791 1649765 0.94
random-access/taxi/uniform/lance-tokio-local-disk 9484956 9216425 1.03
random-access/taxi/uniform/lance-tokio-local-disk-footer 10071171 9764878 1.03
random-access/taxi/uniform/parquet-tokio-local-disk 264599338 267190725 0.99
random-access/taxi/uniform/parquet-tokio-local-disk-footer 264679159 267955823 0.99
random-access/taxi/uniform/vortex-tokio-local-disk 3965812 3875440 1.02
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3943710 4168085 0.95
random-access/vortex-tokio-local-disk 1038283 1051012 0.99
random-access/vortex-tokio-local-disk-footer 1071758 1154076 0.93

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): 0.942x ➖
Parquet (geomean): 0.942x ➖
Shifts: Parquet (control) -5.8% · Median polish -6.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.930x ➖, 4↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 396086113 428878609 0.92
tpch_q02/datafusion:vortex-file-compressed 112166327 121894661 0.92
tpch_q03/datafusion:vortex-file-compressed 215084418 232414752 0.93
tpch_q04/datafusion:vortex-file-compressed 116830249 121795383 0.96
tpch_q05/datafusion:vortex-file-compressed 393205676 421230652 0.93
tpch_q06/datafusion:vortex-file-compressed 38831183 39012918 1.00
tpch_q07/datafusion:vortex-file-compressed 507068519 556741399 0.91
tpch_q08/datafusion:vortex-file-compressed 372996477 409106654 0.91
tpch_q09/datafusion:vortex-file-compressed 🚀 644444265 727754481 0.89
tpch_q10/datafusion:vortex-file-compressed 🚀 231020869 256904611 0.90
tpch_q11/datafusion:vortex-file-compressed 🚀 84895311 94350042 0.90
tpch_q12/datafusion:vortex-file-compressed 117865244 124946885 0.94
tpch_q13/datafusion:vortex-file-compressed 221694286 233708245 0.95
tpch_q14/datafusion:vortex-file-compressed 52348082 55208868 0.95
tpch_q15/datafusion:vortex-file-compressed 98651742 106833142 0.92
tpch_q16/datafusion:vortex-file-compressed 76266865 82267878 0.93
tpch_q17/datafusion:vortex-file-compressed 642917488 703297228 0.91
tpch_q18/datafusion:vortex-file-compressed 871842340 957984936 0.91
tpch_q19/datafusion:vortex-file-compressed 75067788 72092788 1.04
tpch_q20/datafusion:vortex-file-compressed 163118170 177800504 0.92
tpch_q21/datafusion:vortex-file-compressed 🚀 663892341 752188567 0.88
tpch_q22/datafusion:vortex-file-compressed 65411631 69000532 0.95
datafusion / vortex-compact (0.926x ➖, 4↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 433734805 471772575 0.92
tpch_q02/datafusion:vortex-compact 116952375 121775780 0.96
tpch_q03/datafusion:vortex-compact 214886495 230989111 0.93
tpch_q04/datafusion:vortex-compact 119749836 128538068 0.93
tpch_q05/datafusion:vortex-compact 🚀 382314112 430636313 0.89
tpch_q06/datafusion:vortex-compact 61254001 64206441 0.95
tpch_q07/datafusion:vortex-compact 522155768 578925876 0.90
tpch_q08/datafusion:vortex-compact 🚀 365863999 411537513 0.89
tpch_q09/datafusion:vortex-compact 650606428 722503523 0.90
tpch_q10/datafusion:vortex-compact 248804158 272963632 0.91
tpch_q11/datafusion:vortex-compact 86925203 92220749 0.94
tpch_q12/datafusion:vortex-compact 158656098 167602999 0.95
tpch_q13/datafusion:vortex-compact 266542908 293676341 0.91
tpch_q14/datafusion:vortex-compact 70105061 76975555 0.91
tpch_q15/datafusion:vortex-compact 155376901 165239038 0.94
tpch_q16/datafusion:vortex-compact 80439537 85399873 0.94
tpch_q17/datafusion:vortex-compact 644915766 715960497 0.90
tpch_q18/datafusion:vortex-compact 🚀 860764745 960649459 0.90
tpch_q19/datafusion:vortex-compact 125358437 120734471 1.04
tpch_q20/datafusion:vortex-compact 186740263 206106768 0.91
tpch_q21/datafusion:vortex-compact 🚀 676094652 757499099 0.89
tpch_q22/datafusion:vortex-compact 76652540 79234310 0.97
datafusion / parquet (0.926x ➖, 6↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 462983326 528479589 0.88
tpch_q02/datafusion:parquet 176439752 185501321 0.95
tpch_q03/datafusion:parquet 🚀 284472299 322949154 0.88
tpch_q04/datafusion:parquet 127952749 138015633 0.93
tpch_q05/datafusion:parquet 447209333 486323443 0.92
tpch_q06/datafusion:parquet 132644262 130186875 1.02
tpch_q07/datafusion:parquet 🚀 610807885 680007172 0.90
tpch_q08/datafusion:parquet 470249111 519702057 0.90
tpch_q09/datafusion:parquet 759238864 829541307 0.92
tpch_q10/datafusion:parquet 505853781 548317181 0.92
tpch_q11/datafusion:parquet 119771875 127396083 0.94
tpch_q12/datafusion:parquet 205108387 212018262 0.97
tpch_q13/datafusion:parquet 329210286 349195259 0.94
tpch_q14/datafusion:parquet 157749619 173693197 0.91
tpch_q15/datafusion:parquet 🚀 256067621 287300083 0.89
tpch_q16/datafusion:parquet 129826754 133244409 0.97
tpch_q17/datafusion:parquet 685878799 759252744 0.90
tpch_q18/datafusion:parquet 🚀 910685611 1025902657 0.89
tpch_q19/datafusion:parquet 264653074 274660381 0.96
tpch_q20/datafusion:parquet 295345639 319834945 0.92
tpch_q21/datafusion:parquet 🚀 707119666 797984030 0.89
tpch_q22/datafusion:parquet 220549456 226316247 0.97
datafusion / arrow (0.904x ➖, 11↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 595622884 660705236 0.90
tpch_q02/datafusion:arrow 165365447 180394967 0.92
tpch_q03/datafusion:arrow 🚀 451805650 529368558 0.85
tpch_q04/datafusion:arrow 🚀 337318524 378036040 0.89
tpch_q05/datafusion:arrow 🚀 933087507 1043734230 0.89
tpch_q06/datafusion:arrow 🚀 277501566 310513110 0.89
tpch_q07/datafusion:arrow 🚀 1159180502 1299470844 0.89
tpch_q08/datafusion:arrow 🚀 1126555706 1254429338 0.90
tpch_q09/datafusion:arrow 1346542376 1467166027 0.92
tpch_q10/datafusion:arrow 🚀 579049019 657800761 0.88
tpch_q11/datafusion:arrow 140071478 149043485 0.94
tpch_q12/datafusion:arrow 🚀 677298801 784170732 0.86
tpch_q13/datafusion:arrow 514107993 532704534 0.97
tpch_q14/datafusion:arrow 🚀 320806444 358762600 0.89
tpch_q15/datafusion:arrow 🚀 696362199 791403593 0.88
tpch_q16/datafusion:arrow 108222017 115218100 0.94
tpch_q17/datafusion:arrow 1349587454 1477806396 0.91
tpch_q18/datafusion:arrow 1950697376 2138977773 0.91
tpch_q19/datafusion:arrow 483260448 526199449 0.92
tpch_q20/datafusion:arrow 491029168 543108373 0.90
tpch_q21/datafusion:arrow 2984430372 3192441853 0.93
tpch_q22/datafusion:arrow 🚀 131442388 146770889 0.90
duckdb / vortex-file-compressed (0.951x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170013362 174675551 0.97
tpch_q02/duckdb:vortex-file-compressed 51068193 53236777 0.96
tpch_q03/duckdb:vortex-file-compressed 121839323 131709200 0.93
tpch_q04/duckdb:vortex-file-compressed 158672608 170179647 0.93
tpch_q05/duckdb:vortex-file-compressed 135756548 143960061 0.94
tpch_q06/duckdb:vortex-file-compressed 34926069 35694278 0.98
tpch_q07/duckdb:vortex-file-compressed 130820636 141308345 0.93
tpch_q08/duckdb:vortex-file-compressed 167088384 182073390 0.92
tpch_q09/duckdb:vortex-file-compressed 392452189 409525418 0.96
tpch_q10/duckdb:vortex-file-compressed 189999312 201943463 0.94
tpch_q11/duckdb:vortex-file-compressed 31629428 32910877 0.96
tpch_q12/duckdb:vortex-file-compressed 99851223 105866205 0.94
tpch_q13/duckdb:vortex-file-compressed 271599791 282894549 0.96
tpch_q14/duckdb:vortex-file-compressed 52573499 55327102 0.95
tpch_q15/duckdb:vortex-file-compressed 89542693 93208761 0.96
tpch_q16/duckdb:vortex-file-compressed 77704671 82344176 0.94
tpch_q17/duckdb:vortex-file-compressed 92375130 96846065 0.95
tpch_q18/duckdb:vortex-file-compressed 285945083 300760493 0.95
tpch_q19/duckdb:vortex-file-compressed 79817631 81682440 0.98
tpch_q20/duckdb:vortex-file-compressed 141721960 148938073 0.95
tpch_q21/duckdb:vortex-file-compressed 492765857 520178229 0.95
tpch_q22/duckdb:vortex-file-compressed 64319819 66713675 0.96
duckdb / vortex-compact (0.964x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229322607 236686129 0.97
tpch_q02/duckdb:vortex-compact 57261421 58143542 0.98
tpch_q03/duckdb:vortex-compact 135520329 141968223 0.95
tpch_q04/duckdb:vortex-compact 171465328 180695737 0.95
tpch_q05/duckdb:vortex-compact 166089914 171268311 0.97
tpch_q06/duckdb:vortex-compact 56386721 56506768 1.00
tpch_q07/duckdb:vortex-compact 172404610 182433798 0.95
tpch_q08/duckdb:vortex-compact 189850453 199827473 0.95
tpch_q09/duckdb:vortex-compact 424060896 442030181 0.96
tpch_q10/duckdb:vortex-compact 217369640 229768434 0.95
tpch_q11/duckdb:vortex-compact 38197080 40928799 0.93
tpch_q12/duckdb:vortex-compact 165117298 170935271 0.97
tpch_q13/duckdb:vortex-compact 325305585 336574933 0.97
tpch_q14/duckdb:vortex-compact 72175893 75183463 0.96
tpch_q15/duckdb:vortex-compact 115775934 119722043 0.97
tpch_q16/duckdb:vortex-compact 81334191 83731036 0.97
tpch_q17/duckdb:vortex-compact 109493609 110206990 0.99
tpch_q18/duckdb:vortex-compact 287432846 301649775 0.95
tpch_q19/duckdb:vortex-compact 97142110 98233015 0.99
tpch_q20/duckdb:vortex-compact 176821499 182736121 0.97
tpch_q21/duckdb:vortex-compact 513825731 540194995 0.95
tpch_q22/duckdb:vortex-compact 71459209 74357575 0.96
duckdb / parquet (0.958x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 266159507 267038143 1.00
tpch_q02/duckdb:parquet 101287168 107788287 0.94
tpch_q03/duckdb:parquet 207481304 221391253 0.94
tpch_q04/duckdb:parquet 130176276 144383844 0.90
tpch_q05/duckdb:parquet 225489729 233988019 0.96
tpch_q06/duckdb:parquet 73402764 77497019 0.95
tpch_q07/duckdb:parquet 188026117 193094879 0.97
tpch_q08/duckdb:parquet 265314791 278094011 0.95
tpch_q09/duckdb:parquet 484006680 509689286 0.95
tpch_q10/duckdb:parquet 623988410 641469447 0.97
tpch_q11/duckdb:parquet 65349221 67257645 0.97
tpch_q12/duckdb:parquet 129355332 136381298 0.95
tpch_q13/duckdb:parquet 450366861 457507989 0.98
tpch_q14/duckdb:parquet 177455499 187545703 0.95
tpch_q15/duckdb:parquet 103200984 109407706 0.94
tpch_q16/duckdb:parquet 162024317 170779950 0.95
tpch_q17/duckdb:parquet 181960569 184844985 0.98
tpch_q18/duckdb:parquet 359921510 370090677 0.97
tpch_q19/duckdb:parquet 281790545 293856495 0.96
tpch_q20/duckdb:parquet 230950222 236365122 0.98
tpch_q21/duckdb:parquet 550064276 585988924 0.94
tpch_q22/duckdb:parquet 294137558 299921156 0.98
duckdb / duckdb (0.976x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 119389640 121556281 0.98
tpch_q02/duckdb:duckdb 48203913 50081243 0.96
tpch_q03/duckdb:duckdb 103368415 105910942 0.98
tpch_q04/duckdb:duckdb 139998949 143093632 0.98
tpch_q05/duckdb:duckdb 118793099 122559665 0.97
tpch_q06/duckdb:duckdb 44552650 45266721 0.98
tpch_q07/duckdb:duckdb 90745972 92559505 0.98
tpch_q08/duckdb:duckdb 117954823 121288021 0.97
tpch_q09/duckdb:duckdb 278108729 287563416 0.97
tpch_q10/duckdb:duckdb 216153109 217403613 0.99
tpch_q11/duckdb:duckdb 18988317 19547068 0.97
tpch_q12/duckdb:duckdb 89225272 91746157 0.97
tpch_q13/duckdb:duckdb 227480850 238299961 0.95
tpch_q14/duckdb:duckdb 77760188 79885293 0.97
tpch_q15/duckdb:duckdb 81509630 83080784 0.98
tpch_q16/duckdb:duckdb 75281039 79264157 0.95
tpch_q17/duckdb:duckdb 87939868 88516459 0.99
tpch_q18/duckdb:duckdb 233122898 240636347 0.97
tpch_q19/duckdb:duckdb 124394573 125923904 0.99
tpch_q20/duckdb:duckdb 117286913 119772055 0.98
tpch_q21/duckdb:duckdb 294181661 306544222 0.96
tpch_q22/duckdb:duckdb 71639270 70734429 1.01

File Size Changes (27 files changed, -0.0% overall, 12↑ 15↓)
File Scale Format Base HEAD Change %
part_0.vortex 10.0 vortex-compact 16.86 MB 17.15 MB +292.35 KB +1.7%
part_1.vortex 10.0 vortex-file-compressed 24.62 MB 24.90 MB +294.81 KB +1.2%
orders_2.vortex 10.0 vortex-file-compressed 145.46 MB 146.06 MB +611.06 KB +0.4%
part_0.vortex 10.0 vortex-file-compressed 24.79 MB 24.84 MB +51.83 KB +0.2%
lineitem_3.vortex 10.0 vortex-file-compressed 133.28 MB 133.41 MB +137.62 KB +0.1%
lineitem_1.vortex 10.0 vortex-file-compressed 133.62 MB 133.70 MB +77.71 KB +0.1%
partsupp_0.vortex 10.0 vortex-file-compressed 120.28 MB 120.34 MB +63.34 KB +0.1%
lineitem_5.vortex 10.0 vortex-file-compressed 133.43 MB 133.48 MB +57.11 KB +0.0%
partsupp_0.vortex 10.0 vortex-compact 105.30 MB 105.34 MB +38.70 KB +0.0%
customer_0.vortex 10.0 vortex-compact 74.09 MB 74.12 MB +25.59 KB +0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 132.78 MB 132.82 MB +42.61 KB +0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 134.14 MB 134.15 MB +2.38 KB +0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 120.33 MB 120.32 MB 6.09 KB -0.0%
orders_0.vortex 10.0 vortex-file-compressed 144.61 MB 144.60 MB 8.43 KB -0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 134.15 MB 134.13 MB 16.91 KB -0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 134.04 MB 134.00 MB 43.45 KB -0.0%
lineitem_2.vortex 10.0 vortex-file-compressed 133.99 MB 133.92 MB 70.58 KB -0.1%
customer_0.vortex 10.0 vortex-file-compressed 88.53 MB 88.46 MB 75.91 KB -0.1%
lineitem_0.vortex 10.0 vortex-file-compressed 134.22 MB 134.10 MB 118.11 KB -0.1%
lineitem_8.vortex 10.0 vortex-file-compressed 133.60 MB 133.43 MB 168.92 KB -0.1%
lineitem_9.vortex 10.0 vortex-file-compressed 134.34 MB 134.17 MB 176.11 KB -0.1%
lineitem_7.vortex 10.0 vortex-file-compressed 133.70 MB 133.51 MB 196.42 KB -0.1%
lineitem_11.vortex 10.0 vortex-file-compressed 134.46 MB 134.25 MB 215.38 KB -0.2%
supplier_0.vortex 10.0 vortex-file-compressed 5.71 MB 5.69 MB 17.51 KB -0.3%
partsupp_1.vortex 10.0 vortex-compact 105.20 MB 104.87 MB 330.55 KB -0.3%
orders_1.vortex 10.0 vortex-file-compressed 146.32 MB 145.58 MB 751.90 KB -0.5%
part_1.vortex 10.0 vortex-compact 17.00 MB 16.75 MB 255.16 KB -1.5%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (-0.0%)
  • vortex-file-compressed: 2.50 GB → 2.50 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -9.9% -6.6% -3.5% +10.0% ➖ noise
1 datafusion:vortex-compact -8.1% -6.6% -1.6% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -7.6% -6.6% -1.2% +10.0% ➖ noise
1 duckdb:duckdb -1.8% -6.6% +5.1% +10.0% ➖ noise
1 duckdb:vortex-compact -3.1% -6.6% +3.7% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -2.7% -6.6% +4.2% +10.0% ➖ noise
2 datafusion:arrow -8.3% -5.5% -3.0% +10.0% ➖ noise
2 datafusion:vortex-compact -4.0% -5.5% +1.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -8.0% -5.5% -2.7% +10.0% ➖ noise
2 duckdb:duckdb -3.7% -5.5% +1.8% +10.0% ➖ noise
2 duckdb:vortex-compact -1.5% -5.5% +4.2% +16.2% ➖ noise
2 duckdb:vortex-file-compressed -4.1% -5.5% +1.5% +10.0% ➖ noise
3 datafusion:arrow -14.7% -9.1% -6.1% +10.0% ➖ noise
3 datafusion:vortex-compact -7.0% -9.1% +2.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -7.5% -9.1% +1.9% +10.0% ➖ noise
3 duckdb:duckdb -2.4% -9.1% +7.4% +10.0% ➖ noise
3 duckdb:vortex-compact -4.5% -9.1% +5.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -7.5% -9.1% +1.8% +10.0% ➖ noise
4 datafusion:arrow -10.8% -8.6% -2.4% +10.0% ➖ noise
4 datafusion:vortex-compact -6.8% -8.6% +1.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -4.1% -8.6% +4.9% +10.0% ➖ noise
4 duckdb:duckdb -2.2% -8.6% +7.0% +10.0% ➖ noise
4 duckdb:vortex-compact -5.1% -8.6% +3.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -6.8% -8.6% +2.0% +10.0% ➖ noise
5 datafusion:arrow -10.6% -5.9% -5.0% +10.0% ➖ noise
5 datafusion:vortex-compact -11.2% -5.9% -5.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -6.7% -5.9% -0.8% +10.0% ➖ noise
5 duckdb:duckdb -3.1% -5.9% +3.0% +10.0% ➖ noise
5 duckdb:vortex-compact -3.0% -5.9% +3.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -5.7% -5.9% +0.2% +10.0% ➖ noise
6 datafusion:arrow -10.6% -1.8% -9.0% +10.0% ➖ noise
6 datafusion:vortex-compact -4.6% -1.8% -2.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.5% -1.8% +1.3% +10.0% ➖ noise
6 duckdb:duckdb -1.6% -1.8% +0.2% +10.0% ➖ noise
6 duckdb:vortex-compact -0.2% -1.8% +1.6% +10.1% ➖ noise
6 duckdb:vortex-file-compressed -2.2% -1.8% -0.4% +14.5% ➖ noise
7 datafusion:arrow -10.8% -6.5% -4.6% +10.0% ➖ noise
7 datafusion:vortex-compact -9.8% -6.5% -3.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -8.9% -6.5% -2.6% +10.0% ➖ noise
7 duckdb:duckdb -2.0% -6.5% +4.8% +10.0% ➖ noise
7 duckdb:vortex-compact -5.5% -6.5% +1.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -7.4% -6.5% -1.0% +10.0% ➖ noise
8 datafusion:arrow -10.2% -7.1% -3.3% +10.0% ➖ noise
8 datafusion:vortex-compact -11.1% -7.1% -4.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -8.8% -7.1% -1.9% +10.0% ➖ noise
8 duckdb:duckdb -2.7% -7.1% +4.7% +10.0% ➖ noise
8 duckdb:vortex-compact -5.0% -7.1% +2.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -8.2% -7.1% -1.2% +10.0% ➖ noise
9 datafusion:arrow -8.2% -6.8% -1.6% +10.0% ➖ noise
9 datafusion:vortex-compact -10.0% -6.8% -3.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -11.4% -6.8% -5.0% +10.0% ➖ noise
9 duckdb:duckdb -3.3% -6.8% +3.7% +10.0% ➖ noise
9 duckdb:vortex-compact -4.1% -6.8% +2.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -4.2% -6.8% +2.8% +10.0% ➖ noise
10 datafusion:arrow -12.0% -5.3% -7.1% +10.0% ➖ noise
10 datafusion:vortex-compact -8.9% -5.3% -3.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -10.1% -5.3% -5.1% +10.0% ➖ noise
10 duckdb:duckdb -0.6% -5.3% +5.0% +10.0% ➖ noise
10 duckdb:vortex-compact -5.4% -5.3% -0.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -5.9% -5.3% -0.7% +10.0% ➖ noise
11 datafusion:arrow -6.0% -4.4% -1.7% +13.5% ➖ noise
11 datafusion:vortex-compact -5.7% -4.4% -1.4% +11.3% ➖ noise
11 datafusion:vortex-file-compressed -10.0% -4.4% -5.9% +10.3% ➖ noise
11 duckdb:duckdb -2.9% -4.4% +1.6% +10.0% ➖ noise
11 duckdb:vortex-compact -6.7% -4.4% -2.4% +12.3% ➖ noise
11 duckdb:vortex-file-compressed -3.9% -4.4% +0.6% +14.0% ➖ noise
12 datafusion:arrow -13.6% -4.2% -9.8% +37.5% ➖ noise
12 datafusion:vortex-compact -5.3% -4.2% -1.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -5.7% -4.2% -1.5% +10.0% ➖ noise
12 duckdb:duckdb -2.7% -4.2% +1.5% +10.0% ➖ noise
12 duckdb:vortex-compact -3.4% -4.2% +0.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -5.7% -4.2% -1.5% +10.0% ➖ noise
13 datafusion:arrow -3.5% -3.7% +0.2% +10.0% ➖ noise
13 datafusion:vortex-compact -9.2% -3.7% -5.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -5.1% -3.7% -1.5% +10.0% ➖ noise
13 duckdb:duckdb -4.5% -3.7% -0.9% +10.0% ➖ noise
13 duckdb:vortex-compact -3.3% -3.7% +0.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -4.0% -3.7% -0.3% +10.0% ➖ noise
14 datafusion:arrow -10.6% -7.3% -3.5% +10.0% ➖ noise
14 datafusion:vortex-compact -8.9% -7.3% -1.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -5.2% -7.3% +2.3% +10.0% ➖ noise
14 duckdb:duckdb -2.7% -7.3% +5.0% +10.0% ➖ noise
14 duckdb:vortex-compact -4.0% -7.3% +3.6% +11.0% ➖ noise
14 duckdb:vortex-file-compressed -5.0% -7.3% +2.5% +10.0% ➖ noise
15 datafusion:arrow -12.0% -8.3% -4.0% +10.0% ➖ noise
15 datafusion:vortex-compact -6.0% -8.3% +2.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -7.7% -8.3% +0.7% +10.0% ➖ noise
15 duckdb:duckdb -1.9% -8.3% +7.0% +10.0% ➖ noise
15 duckdb:vortex-compact -3.3% -8.3% +5.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -3.9% -8.3% +4.8% +10.0% ➖ noise
16 datafusion:arrow -6.1% -3.9% -2.3% +10.0% ➖ noise
16 datafusion:vortex-compact -5.8% -3.9% -2.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -7.3% -3.9% -3.6% +10.0% ➖ noise
16 duckdb:duckdb -5.0% -3.9% -1.2% +10.0% ➖ noise
16 duckdb:vortex-compact -2.9% -3.9% +1.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -5.6% -3.9% -1.9% +10.0% ➖ noise
17 datafusion:arrow -8.7% -5.7% -3.2% +10.0% ➖ noise
17 datafusion:vortex-compact -9.9% -5.7% -4.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -8.6% -5.7% -3.1% +10.0% ➖ noise
17 duckdb:duckdb -0.7% -5.7% +5.4% +10.0% ➖ noise
17 duckdb:vortex-compact -0.6% -5.7% +5.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -4.6% -5.7% +1.1% +10.0% ➖ noise
18 datafusion:arrow -8.8% -7.1% -1.8% +10.0% ➖ noise
18 datafusion:vortex-compact -10.4% -7.1% -3.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -9.0% -7.1% -2.1% +10.0% ➖ noise
18 duckdb:duckdb -3.1% -7.1% +4.3% +10.0% ➖ noise
18 duckdb:vortex-compact -4.7% -7.1% +2.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -4.9% -7.1% +2.3% +10.0% ➖ noise
19 datafusion:arrow -8.2% -3.9% -4.5% +10.0% ➖ noise
19 datafusion:vortex-compact +3.8% -3.9% +8.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +4.1% -3.9% +8.3% +10.0% ➖ noise
19 duckdb:duckdb -1.2% -3.9% +2.8% +10.0% ➖ noise
19 duckdb:vortex-compact -1.1% -3.9% +2.9% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -2.3% -3.9% +1.7% +10.0% ➖ noise
20 datafusion:arrow -9.6% -5.0% -4.8% +10.0% ➖ noise
20 datafusion:vortex-compact -9.4% -5.0% -4.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -8.3% -5.0% -3.4% +10.0% ➖ noise
20 duckdb:duckdb -2.1% -5.0% +3.1% +10.0% ➖ noise
20 duckdb:vortex-compact -3.2% -5.0% +1.9% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -4.8% -5.0% +0.2% +10.0% ➖ noise
21 datafusion:arrow -6.5% -8.8% +2.5% +10.0% ➖ noise
21 datafusion:vortex-compact -10.7% -8.8% -2.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -11.7% -8.8% -3.2% +10.0% ➖ noise
21 duckdb:duckdb -4.0% -8.8% +5.2% +10.0% ➖ noise
21 duckdb:vortex-compact -4.9% -8.8% +4.3% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -5.3% -8.8% +3.9% +10.0% ➖ noise
22 datafusion:arrow -10.4% -2.2% -8.4% +10.0% ➖ noise
22 datafusion:vortex-compact -3.3% -2.2% -1.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -5.2% -2.2% -3.0% +10.0% ➖ noise
22 duckdb:duckdb +1.3% -2.2% +3.6% +10.0% ➖ noise
22 duckdb:vortex-compact -3.9% -2.2% -1.7% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -3.6% -2.2% -1.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (+3.2%, low confidence) · DuckDB No clear signal (-2.9%, low confidence)
Vortex (geomean): 1.010x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.019x ➖, 1↑ 2↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1665120 1697749 0.98
clickbench_q01/datafusion:vortex-file-compressed 🚨 17711972 15378218 1.15
clickbench_q02/datafusion:vortex-file-compressed 36600623 34437312 1.06
clickbench_q03/datafusion:vortex-file-compressed 42903029 40663616 1.06
clickbench_q04/datafusion:vortex-file-compressed 286262060 289899439 0.99
clickbench_q05/datafusion:vortex-file-compressed 315123838 318933434 0.99
clickbench_q06/datafusion:vortex-file-compressed 1652697 1709332 0.97
clickbench_q07/datafusion:vortex-file-compressed 19974835 19130821 1.04
clickbench_q08/datafusion:vortex-file-compressed 352527645 347447378 1.01
clickbench_q09/datafusion:vortex-file-compressed 561279431 559131828 1.00
clickbench_q10/datafusion:vortex-file-compressed 73771179 74238281 0.99
clickbench_q11/datafusion:vortex-file-compressed 84126438 84886401 0.99
clickbench_q12/datafusion:vortex-file-compressed 295682174 297968642 0.99
clickbench_q13/datafusion:vortex-file-compressed 425451670 436648357 0.97
clickbench_q14/datafusion:vortex-file-compressed 276458390 268903307 1.03
clickbench_q15/datafusion:vortex-file-compressed 326967412 328250021 1.00
clickbench_q16/datafusion:vortex-file-compressed 681294748 671125041 1.02
clickbench_q17/datafusion:vortex-file-compressed 653691160 655395497 1.00
clickbench_q18/datafusion:vortex-file-compressed 1389115316 1357990992 1.02
clickbench_q19/datafusion:vortex-file-compressed 🚨 30186123 27149042 1.11
clickbench_q20/datafusion:vortex-file-compressed 333795409 323182107 1.03
clickbench_q21/datafusion:vortex-file-compressed 424649403 403298528 1.05
clickbench_q22/datafusion:vortex-file-compressed 518273613 508088623 1.02
clickbench_q23/datafusion:vortex-file-compressed 536945229 543116382 0.99
clickbench_q24/datafusion:vortex-file-compressed 52669686 48476458 1.09
clickbench_q25/datafusion:vortex-file-compressed 79511516 80537803 0.99
clickbench_q26/datafusion:vortex-file-compressed 50816440 46349593 1.10
clickbench_q27/datafusion:vortex-file-compressed 770054548 764543585 1.01
clickbench_q28/datafusion:vortex-file-compressed 5923747190 5892335678 1.01
clickbench_q29/datafusion:vortex-file-compressed 216849221 223187563 0.97
clickbench_q30/datafusion:vortex-file-compressed 261042114 245537646 1.06
clickbench_q31/datafusion:vortex-file-compressed 299797808 292832786 1.02
clickbench_q32/datafusion:vortex-file-compressed 🚀 1154136287 1293740914 0.89
clickbench_q33/datafusion:vortex-file-compressed 1401197141 1354907155 1.03
clickbench_q34/datafusion:vortex-file-compressed 1378901227 1377981639 1.00
clickbench_q35/datafusion:vortex-file-compressed 459652984 433331736 1.06
clickbench_q36/datafusion:vortex-file-compressed 74431861 72187190 1.03
clickbench_q37/datafusion:vortex-file-compressed 36060224 34989693 1.03
clickbench_q38/datafusion:vortex-file-compressed 20256202 20438744 0.99
clickbench_q39/datafusion:vortex-file-compressed 142556063 142177065 1.00
clickbench_q40/datafusion:vortex-file-compressed 16504019 16063775 1.03
clickbench_q41/datafusion:vortex-file-compressed 15323899 14945221 1.03
clickbench_q42/datafusion:vortex-file-compressed 17619642 16690175 1.06
datafusion / parquet (0.987x ➖, 1↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1528351 1594954 0.96
clickbench_q01/datafusion:parquet 19047169 19887460 0.96
clickbench_q02/datafusion:parquet 46629497 47140967 0.99
clickbench_q03/datafusion:parquet 37140547 36565080 1.02
clickbench_q04/datafusion:parquet 298391067 312276432 0.96
clickbench_q05/datafusion:parquet 367785228 360249006 1.02
clickbench_q06/datafusion:parquet 🚀 1615130 1939718 0.83
clickbench_q07/datafusion:parquet 22890774 22206954 1.03
clickbench_q08/datafusion:parquet 374047054 376094031 0.99
clickbench_q09/datafusion:parquet 610984780 631649056 0.97
clickbench_q10/datafusion:parquet 106308676 109698374 0.97
clickbench_q11/datafusion:parquet 131883918 133108433 0.99
clickbench_q12/datafusion:parquet 346886347 359579017 0.96
clickbench_q13/datafusion:parquet 512552896 511066543 1.00
clickbench_q14/datafusion:parquet 336550366 350836003 0.96
clickbench_q15/datafusion:parquet 344006844 339879984 1.01
clickbench_q16/datafusion:parquet 707458206 705657030 1.00
clickbench_q17/datafusion:parquet 671052063 657951549 1.02
clickbench_q18/datafusion:parquet 1374204051 1430303774 0.96
clickbench_q19/datafusion:parquet 30071120 29430181 1.02
clickbench_q20/datafusion:parquet 603269908 607034067 0.99
clickbench_q21/datafusion:parquet 665278821 664448555 1.00
clickbench_q22/datafusion:parquet 976773881 976018644 1.00
clickbench_q23/datafusion:parquet 3732712796 3789664073 0.98
clickbench_q24/datafusion:parquet 80931982 83334602 0.97
clickbench_q25/datafusion:parquet 132109661 131614799 1.00
clickbench_q26/datafusion:parquet 86114922 81153027 1.06
clickbench_q27/datafusion:parquet 1084196700 1069033466 1.01
clickbench_q28/datafusion:parquet 6657870653 6669446526 1.00
clickbench_q29/datafusion:parquet 237285086 242681335 0.98
clickbench_q30/datafusion:parquet 332288957 331302035 1.00
clickbench_q31/datafusion:parquet 363857250 369254692 0.99
clickbench_q32/datafusion:parquet 1226107851 1246514862 0.98
clickbench_q33/datafusion:parquet 1524824460 1508821014 1.01
clickbench_q34/datafusion:parquet 1496406290 1564505142 0.96
clickbench_q35/datafusion:parquet 471432193 473672800 1.00
clickbench_q36/datafusion:parquet 145310256 149744798 0.97
clickbench_q37/datafusion:parquet 56217075 58144666 0.97
clickbench_q38/datafusion:parquet 88349866 85351022 1.04
clickbench_q39/datafusion:parquet 271233614 273684487 0.99
clickbench_q40/datafusion:parquet 32220126 31105931 1.04
clickbench_q41/datafusion:parquet 27505635 29313479 0.94
clickbench_q42/datafusion:parquet 29378741 29959177 0.98
duckdb / vortex-file-compressed (1.000x ➖, 5↑ 3↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 7480184 6548447 1.14
clickbench_q01/duckdb:vortex-file-compressed 11136337 10178307 1.09
clickbench_q02/duckdb:vortex-file-compressed 26290579 25045666 1.05
clickbench_q03/duckdb:vortex-file-compressed 29660567 30147636 0.98
clickbench_q04/duckdb:vortex-file-compressed 186257836 184902939 1.01
clickbench_q05/duckdb:vortex-file-compressed 181957324 177453878 1.03
clickbench_q06/duckdb:vortex-file-compressed 20028171 19109075 1.05
clickbench_q07/duckdb:vortex-file-compressed 🚨 15434251 13638247 1.13
clickbench_q08/duckdb:vortex-file-compressed 264973403 265792377 1.00
clickbench_q09/duckdb:vortex-file-compressed 342071148 339031969 1.01
clickbench_q10/duckdb:vortex-file-compressed 69748544 68551916 1.02
clickbench_q11/duckdb:vortex-file-compressed 79196849 77995325 1.02
clickbench_q12/duckdb:vortex-file-compressed 203934951 198368232 1.03
clickbench_q13/duckdb:vortex-file-compressed 416371262 406518546 1.02
clickbench_q14/duckdb:vortex-file-compressed 237210073 232727057 1.02
clickbench_q15/duckdb:vortex-file-compressed 240907177 241689629 1.00
clickbench_q16/duckdb:vortex-file-compressed 537678279 530926215 1.01
clickbench_q17/duckdb:vortex-file-compressed 431340196 419301334 1.03
clickbench_q18/duckdb:vortex-file-compressed 958307181 934342084 1.03
clickbench_q19/duckdb:vortex-file-compressed 21939789 20410618 1.07
clickbench_q20/duckdb:vortex-file-compressed 305592153 310379062 0.98
clickbench_q21/duckdb:vortex-file-compressed 408875961 389118902 1.05
clickbench_q22/duckdb:vortex-file-compressed 558780982 560620744 1.00
clickbench_q23/duckdb:vortex-file-compressed 170520678 167389795 1.02
clickbench_q24/duckdb:vortex-file-compressed 41009315 42531663 0.96
clickbench_q25/duckdb:vortex-file-compressed 76344692 72189406 1.06
clickbench_q26/duckdb:vortex-file-compressed 🚨 50128964 45381176 1.10
clickbench_q27/duckdb:vortex-file-compressed 532245155 520539652 1.02
clickbench_q28/duckdb:vortex-file-compressed 3055428248 3071057297 0.99
clickbench_q29/duckdb:vortex-file-compressed 30541638 28202064 1.08
clickbench_q30/duckdb:vortex-file-compressed 214607915 216066823 0.99
clickbench_q31/duckdb:vortex-file-compressed 315177079 312659747 1.01
clickbench_q32/duckdb:vortex-file-compressed 1130420140 1109535668 1.02
clickbench_q33/duckdb:vortex-file-compressed 1108027726 1148181515 0.97
clickbench_q34/duckdb:vortex-file-compressed 1204512928 1206388804 1.00
clickbench_q35/duckdb:vortex-file-compressed 374147497 383131456 0.98
clickbench_q36/duckdb:vortex-file-compressed 🚀 24805302 28377831 0.87
clickbench_q37/duckdb:vortex-file-compressed 🚀 16013128 18465093 0.87
clickbench_q38/duckdb:vortex-file-compressed 🚀 18837349 21504136 0.88
clickbench_q39/duckdb:vortex-file-compressed 🚀 41551851 48436196 0.86
clickbench_q40/duckdb:vortex-file-compressed 16970931 18799205 0.90
clickbench_q41/duckdb:vortex-file-compressed 17259048 18754131 0.92
clickbench_q42/duckdb:vortex-file-compressed 🚀 16485849 19331945 0.85
duckdb / parquet (1.006x ➖, 0↑ 1↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 22639627 22344304 1.01
clickbench_q01/duckdb:parquet 29541229 29066806 1.02
clickbench_q02/duckdb:parquet 49346074 49449310 1.00
clickbench_q03/duckdb:parquet 39973622 40024049 1.00
clickbench_q04/duckdb:parquet 203435686 204289035 1.00
clickbench_q05/duckdb:parquet 256997600 257523757 1.00
clickbench_q06/duckdb:parquet 47453483 46688151 1.02
clickbench_q07/duckdb:parquet 30816509 31124579 0.99
clickbench_q08/duckdb:parquet 273859459 268616946 1.02
clickbench_q09/duckdb:parquet 402170865 399243542 1.01
clickbench_q10/duckdb:parquet 82351692 82522881 1.00
clickbench_q11/duckdb:parquet 100522859 99497450 1.01
clickbench_q12/duckdb:parquet 281833640 277491141 1.02
clickbench_q13/duckdb:parquet 470939412 473962964 0.99
clickbench_q14/duckdb:parquet 317426021 312146426 1.02
clickbench_q15/duckdb:parquet 252987248 253478409 1.00
clickbench_q16/duckdb:parquet 595406025 595113889 1.00
clickbench_q17/duckdb:parquet 499931820 496218975 1.01
clickbench_q18/duckdb:parquet 1032832508 1038749725 0.99
clickbench_q19/duckdb:parquet 28076185 28665301 0.98
clickbench_q20/duckdb:parquet 422852023 419521582 1.01
clickbench_q21/duckdb:parquet 531798140 530515348 1.00
clickbench_q22/duckdb:parquet 930471957 922538591 1.01
clickbench_q23/duckdb:parquet 271490007 270080480 1.01
clickbench_q24/duckdb:parquet 69883929 71970125 0.97
clickbench_q25/duckdb:parquet 163630916 162954042 1.00
clickbench_q26/duckdb:parquet 55084117 54245581 1.02
clickbench_q27/duckdb:parquet 644092192 639756522 1.01
clickbench_q28/duckdb:parquet 4894952039 4871411804 1.00
clickbench_q29/duckdb:parquet 42955875 41689911 1.03
clickbench_q30/duckdb:parquet 313066004 311235230 1.01
clickbench_q31/duckdb:parquet 373764090 372114226 1.00
clickbench_q32/duckdb:parquet 1108305107 1106985157 1.00
clickbench_q33/duckdb:parquet 1112473254 1096137927 1.01
clickbench_q34/duckdb:parquet 1154971144 1152713516 1.00
clickbench_q35/duckdb:parquet 372520137 372640107 1.00
clickbench_q36/duckdb:parquet 🚨 52845083 45195477 1.17
clickbench_q37/duckdb:parquet 34011580 33551293 1.01
clickbench_q38/duckdb:parquet 35641143 37249605 0.96
clickbench_q39/duckdb:parquet 80717636 83410918 0.97
clickbench_q40/duckdb:parquet 20717215 20622603 1.00
clickbench_q41/duckdb:parquet 20743137 20501142 1.01
clickbench_q42/duckdb:parquet 22246192 22415881 0.99
duckdb / duckdb (0.953x ➖, 10↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17885360 17669687 1.01
clickbench_q01/duckdb:duckdb 36036083 34426028 1.05
clickbench_q02/duckdb:duckdb 52591196 51153236 1.03
clickbench_q03/duckdb:duckdb 57129533 55476712 1.03
clickbench_q04/duckdb:duckdb 218574884 212774799 1.03
clickbench_q05/duckdb:duckdb 292371083 284493911 1.03
clickbench_q06/duckdb:duckdb 35585716 34394418 1.03
clickbench_q07/duckdb:duckdb 35571133 35267038 1.01
clickbench_q08/duckdb:duckdb 280064442 279173256 1.00
clickbench_q09/duckdb:duckdb 393717021 412383330 0.95
clickbench_q10/duckdb:duckdb 117366363 119008775 0.99
clickbench_q11/duckdb:duckdb 126543904 133755240 0.95
clickbench_q12/duckdb:duckdb 🚀 259357500 288249994 0.90
clickbench_q13/duckdb:duckdb 🚀 444036519 544909373 0.81
clickbench_q14/duckdb:duckdb 🚀 286391657 347699649 0.82
clickbench_q15/duckdb:duckdb 🚀 244454960 294607944 0.83
clickbench_q16/duckdb:duckdb 🚀 566270739 694095107 0.82
clickbench_q17/duckdb:duckdb 🚀 467515861 567714312 0.82
clickbench_q18/duckdb:duckdb 🚀 1000414006 1306288838 0.77
clickbench_q19/duckdb:duckdb 🚀 34142254 38314973 0.89
clickbench_q20/duckdb:duckdb 🚀 460751542 556482962 0.83
clickbench_q21/duckdb:duckdb 🚀 464258195 542771186 0.86
clickbench_q22/duckdb:duckdb 538951391 586786110 0.92
clickbench_q23/duckdb:duckdb 246901930 271294093 0.91
clickbench_q24/duckdb:duckdb 60917281 64250895 0.95
clickbench_q25/duckdb:duckdb 147629851 152506717 0.97
clickbench_q26/duckdb:duckdb 62271599 64431683 0.97
clickbench_q27/duckdb:duckdb 545889039 566272754 0.96
clickbench_q28/duckdb:duckdb 4536931021 4582166869 0.99
clickbench_q29/duckdb:duckdb 50256749 50600861 0.99
clickbench_q30/duckdb:duckdb 276913886 277829719 1.00
clickbench_q31/duckdb:duckdb 366078969 362144786 1.01
clickbench_q32/duckdb:duckdb 1114069775 1104660965 1.01
clickbench_q33/duckdb:duckdb 1123145114 1121959184 1.00
clickbench_q34/duckdb:duckdb 1189533029 1195238606 1.00
clickbench_q35/duckdb:duckdb 301780416 298215109 1.01
clickbench_q36/duckdb:duckdb 49214433 49683841 0.99
clickbench_q37/duckdb:duckdb 28583819 28817020 0.99
clickbench_q38/duckdb:duckdb 34009154 33747629 1.01
clickbench_q39/duckdb:duckdb 81980271 78631057 1.04
clickbench_q40/duckdb:duckdb 28054089 28638402 0.98
clickbench_q41/duckdb:duckdb 27200806 27718567 0.98
clickbench_q42/duckdb:duckdb 29298196 29595809 0.99

File Size Changes (105 files changed, +0.0% overall, 58↑ 47↓)
File Scale Format Base HEAD Change %
hits_55.vortex 1.0 vortex-file-compressed 166.54 MB 169.19 MB +2.65 MB +1.6%
hits_90.vortex 1.0 vortex-compact 81.72 MB 82.52 MB +816.95 KB +1.0%
hits_52.vortex 1.0 vortex-file-compressed 105.00 MB 105.28 MB +282.08 KB +0.3%
hits_21.vortex 1.0 vortex-file-compressed 94.01 MB 94.22 MB +218.30 KB +0.2%
hits_29.vortex 1.0 vortex-file-compressed 59.80 MB 59.93 MB +134.73 KB +0.2%
hits_27.vortex 1.0 vortex-compact 69.81 MB 69.95 MB +143.06 KB +0.2%
hits_69.vortex 1.0 vortex-file-compressed 122.97 MB 123.20 MB +239.07 KB +0.2%
hits_58.vortex 1.0 vortex-file-compressed 90.33 MB 90.50 MB +172.70 KB +0.2%
hits_53.vortex 1.0 vortex-file-compressed 87.30 MB 87.46 MB +164.19 KB +0.2%
hits_71.vortex 1.0 vortex-file-compressed 102.04 MB 102.21 MB +171.41 KB +0.2%
hits_2.vortex 1.0 vortex-file-compressed 186.36 MB 186.61 MB +250.40 KB +0.1%
hits_75.vortex 1.0 vortex-file-compressed 63.32 MB 63.40 MB +78.53 KB +0.1%
hits_28.vortex 1.0 vortex-file-compressed 119.81 MB 119.95 MB +145.27 KB +0.1%
hits_25.vortex 1.0 vortex-file-compressed 114.22 MB 114.36 MB +138.04 KB +0.1%
hits_33.vortex 1.0 vortex-file-compressed 57.24 MB 57.30 MB +64.86 KB +0.1%
hits_92.vortex 1.0 vortex-file-compressed 146.86 MB 147.02 MB +161.33 KB +0.1%
hits_42.vortex 1.0 vortex-file-compressed 223.06 MB 223.24 MB +189.44 KB +0.1%
hits_49.vortex 1.0 vortex-file-compressed 75.81 MB 75.87 MB +61.15 KB +0.1%
hits_1.vortex 1.0 vortex-file-compressed 138.47 MB 138.58 MB +108.62 KB +0.1%
hits_31.vortex 1.0 vortex-file-compressed 90.07 MB 90.14 MB +67.70 KB +0.1%
hits_80.vortex 1.0 vortex-file-compressed 105.02 MB 105.09 MB +76.21 KB +0.1%
hits_61.vortex 1.0 vortex-file-compressed 101.25 MB 101.32 MB +72.23 KB +0.1%
hits_27.vortex 1.0 vortex-file-compressed 122.88 MB 122.96 MB +79.58 KB +0.1%
hits_65.vortex 1.0 vortex-file-compressed 183.70 MB 183.81 MB +118.85 KB +0.1%
hits_32.vortex 1.0 vortex-file-compressed 66.83 MB 66.87 MB +39.54 KB +0.1%
hits_16.vortex 1.0 vortex-file-compressed 79.96 MB 80.00 MB +46.92 KB +0.1%
hits_14.vortex 1.0 vortex-file-compressed 111.36 MB 111.42 MB +64.01 KB +0.1%
hits_76.vortex 1.0 vortex-file-compressed 114.38 MB 114.44 MB +64.52 KB +0.1%
hits_7.vortex 1.0 vortex-file-compressed 93.96 MB 94.01 MB +52.55 KB +0.1%
hits_24.vortex 1.0 vortex-file-compressed 77.46 MB 77.50 MB +42.27 KB +0.1%
hits_12.vortex 1.0 vortex-file-compressed 100.99 MB 101.04 MB +54.73 KB +0.1%
hits_91.vortex 1.0 vortex-file-compressed 97.18 MB 97.23 MB +49.80 KB +0.1%
hits_26.vortex 1.0 vortex-file-compressed 110.05 MB 110.09 MB +48.77 KB +0.0%
hits_34.vortex 1.0 vortex-file-compressed 97.83 MB 97.87 MB +43.20 KB +0.0%
hits_97.vortex 1.0 vortex-file-compressed 107.29 MB 107.34 MB +47.26 KB +0.0%
hits_84.vortex 1.0 vortex-file-compressed 117.34 MB 117.39 MB +51.43 KB +0.0%
hits_99.vortex 1.0 vortex-file-compressed 123.17 MB 123.22 MB +52.88 KB +0.0%
hits_17.vortex 1.0 vortex-file-compressed 87.43 MB 87.46 MB +35.77 KB +0.0%
hits_64.vortex 1.0 vortex-file-compressed 81.27 MB 81.30 MB +32.99 KB +0.0%
hits_4.vortex 1.0 vortex-file-compressed 108.81 MB 108.85 MB +43.70 KB +0.0%
hits_94.vortex 1.0 vortex-file-compressed 138.74 MB 138.80 MB +55.17 KB +0.0%
hits_60.vortex 1.0 vortex-file-compressed 103.44 MB 103.48 MB +39.31 KB +0.0%
hits_57.vortex 1.0 vortex-file-compressed 128.41 MB 128.46 MB +47.20 KB +0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.57 MB 277.66 MB +96.92 KB +0.0%
hits_19.vortex 1.0 vortex-file-compressed 73.62 MB 73.64 MB +25.57 KB +0.0%
hits_23.vortex 1.0 vortex-file-compressed 77.91 MB 77.94 MB +24.56 KB +0.0%
hits_37.vortex 1.0 vortex-file-compressed 86.01 MB 86.04 MB +27.01 KB +0.0%
hits_56.vortex 1.0 vortex-file-compressed 123.60 MB 123.64 MB +38.71 KB +0.0%
hits_83.vortex 1.0 vortex-file-compressed 89.81 MB 89.83 MB +19.12 KB +0.0%
hits_70.vortex 1.0 vortex-file-compressed 93.65 MB 93.67 MB +18.44 KB +0.0%
hits_93.vortex 1.0 vortex-file-compressed 90.53 MB 90.54 MB +15.30 KB +0.0%
hits_85.vortex 1.0 vortex-file-compressed 91.88 MB 91.90 MB +11.62 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.71 MB 135.73 MB +11.48 KB +0.0%
hits_9.vortex 1.0 vortex-file-compressed 99.25 MB 99.26 MB +6.82 KB +0.0%
hits_5.vortex 1.0 vortex-file-compressed 92.97 MB 92.98 MB +3.56 KB +0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.03 MB 28.03 MB +656 B +0.0%
hits_81.vortex 1.0 vortex-file-compressed 100.82 MB 100.82 MB +1.80 KB +0.0%
hits_40.vortex 1.0 vortex-file-compressed 117.82 MB 117.83 MB +656 B +0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.56 MB 96.56 MB 2.27 KB -0.0%
hits_68.vortex 1.0 vortex-file-compressed 123.15 MB 123.15 MB 4.33 KB -0.0%
hits_43.vortex 1.0 vortex-file-compressed 227.33 MB 227.32 MB 11.53 KB -0.0%
hits_11.vortex 1.0 vortex-file-compressed 80.00 MB 80.00 MB 6.75 KB -0.0%
hits_74.vortex 1.0 vortex-file-compressed 119.94 MB 119.93 MB 11.52 KB -0.0%
hits_59.vortex 1.0 vortex-file-compressed 101.85 MB 101.84 MB 11.22 KB -0.0%
hits_13.vortex 1.0 vortex-file-compressed 99.38 MB 99.37 MB 12.86 KB -0.0%
hits_20.vortex 1.0 vortex-file-compressed 63.00 MB 62.99 MB 9.91 KB -0.0%
hits_8.vortex 1.0 vortex-file-compressed 93.37 MB 93.35 MB 16.07 KB -0.0%
hits_38.vortex 1.0 vortex-file-compressed 99.31 MB 99.29 MB 18.04 KB -0.0%
hits_72.vortex 1.0 vortex-file-compressed 84.86 MB 84.84 MB 19.20 KB -0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.30 MB 164.26 MB 48.24 KB -0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.30 MB 90.27 MB 28.12 KB -0.0%
hits_87.vortex 1.0 vortex-file-compressed 172.65 MB 172.59 MB 54.66 KB -0.0%
hits_88.vortex 1.0 vortex-file-compressed 111.45 MB 111.41 MB 35.58 KB -0.0%
hits_63.vortex 1.0 vortex-file-compressed 69.36 MB 69.34 MB 22.49 KB -0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.52 MB 221.44 MB 73.09 KB -0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.33 MB 41.32 MB 16.00 KB -0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.47 MB 179.40 MB 71.13 KB -0.0%
hits_45.vortex 1.0 vortex-file-compressed 122.19 MB 122.13 MB 56.11 KB -0.0%
hits_15.vortex 1.0 vortex-file-compressed 89.31 MB 89.26 MB 42.09 KB -0.0%
hits_3.vortex 1.0 vortex-file-compressed 142.21 MB 142.14 MB 73.78 KB -0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.42 MB 80.38 MB 45.96 KB -0.1%
hits_18.vortex 1.0 vortex-file-compressed 104.84 MB 104.78 MB 59.99 KB -0.1%
hits_98.vortex 1.0 vortex-file-compressed 118.52 MB 118.46 MB 69.44 KB -0.1%
hits_30.vortex 1.0 vortex-file-compressed 87.15 MB 87.10 MB 52.48 KB -0.1%
hits_82.vortex 1.0 vortex-file-compressed 99.89 MB 99.82 MB 64.68 KB -0.1%
hits_44.vortex 1.0 vortex-file-compressed 186.97 MB 186.84 MB 132.38 KB -0.1%
hits_22.vortex 1.0 vortex-file-compressed 78.63 MB 78.58 MB 55.71 KB -0.1%
hits_77.vortex 1.0 vortex-file-compressed 168.77 MB 168.64 MB 130.20 KB -0.1%
hits_97.vortex 1.0 vortex-compact 69.04 MB 68.98 MB 60.21 KB -0.1%
hits_41.vortex 1.0 vortex-file-compressed 224.26 MB 224.07 MB 197.86 KB -0.1%
hits_6.vortex 1.0 vortex-file-compressed 93.42 MB 93.34 MB 86.02 KB -0.1%
hits_35.vortex 1.0 vortex-file-compressed 115.26 MB 115.16 MB 106.48 KB -0.1%
hits_86.vortex 1.0 vortex-file-compressed 69.45 MB 69.38 MB 68.61 KB -0.1%
hits_62.vortex 1.0 vortex-file-compressed 117.50 MB 117.38 MB 120.50 KB -0.1%
hits_67.vortex 1.0 vortex-file-compressed 184.21 MB 184.02 MB 192.72 KB -0.1%
hits_46.vortex 1.0 vortex-file-compressed 69.53 MB 69.45 MB 76.78 KB -0.1%
hits_79.vortex 1.0 vortex-file-compressed 145.24 MB 145.08 MB 162.80 KB -0.1%
hits_10.vortex 1.0 vortex-file-compressed 69.71 MB 69.60 MB 103.61 KB -0.1%
hits_0.vortex 1.0 vortex-file-compressed 89.72 MB 89.59 MB 133.92 KB -0.1%
hits_89.vortex 1.0 vortex-file-compressed 184.63 MB 184.36 MB 282.63 KB -0.1%
hits_36.vortex 1.0 vortex-file-compressed 68.57 MB 68.46 MB 113.79 KB -0.2%
hits_73.vortex 1.0 vortex-file-compressed 110.75 MB 110.57 MB 188.81 KB -0.2%
hits_16.vortex 1.0 vortex-compact 48.22 MB 48.08 MB 140.69 KB -0.3%
hits_90.vortex 1.0 vortex-file-compressed 142.04 MB 140.05 MB 2.00 MB -1.4%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.05 GB → 7.05 GB (+0.0%)
  • vortex-file-compressed: 11.02 GB → 11.02 GB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -1.9% -1.5% -0.5% +924.9% ➖ noise
0 duckdb:duckdb +1.2% -1.5% +2.7% +276.6% ➖ noise
0 duckdb:vortex-file-compressed +14.2% -1.5% +15.9% +438.9% ➖ noise
1 datafusion:vortex-file-compressed +15.2% -1.3% +16.7% +28.3% ➖ noise
1 duckdb:duckdb +4.7% -1.3% +6.1% +49.0% ➖ noise
1 duckdb:vortex-file-compressed +9.4% -1.3% +10.9% +27.8% ➖ noise
2 datafusion:vortex-file-compressed +6.3% -0.6% +7.0% +18.4% ➖ noise
2 duckdb:duckdb +2.8% -0.6% +3.5% +26.1% ➖ noise
2 duckdb:vortex-file-compressed +5.0% -0.6% +5.7% +10.2% ➖ noise
3 datafusion:vortex-file-compressed +5.5% +0.7% +4.8% +144.8% ➖ noise
3 duckdb:duckdb +3.0% +0.7% +2.2% +44.0% ➖ noise
3 duckdb:vortex-file-compressed -1.6% +0.7% -2.3% +48.1% ➖ noise
4 datafusion:vortex-file-compressed -1.3% -2.5% +1.2% +11.0% ➖ noise
4 duckdb:duckdb +2.7% -2.5% +5.3% +10.4% ➖ noise
4 duckdb:vortex-file-compressed +0.7% -2.5% +3.3% +10.9% ➖ noise
5 datafusion:vortex-file-compressed -1.2% +0.9% -2.1% +10.0% ➖ noise
5 duckdb:duckdb +2.8% +0.9% +1.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.5% +0.9% +1.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.3% -8.0% +5.1% +43.1% ➖ noise
6 duckdb:duckdb +3.5% -8.0% +12.5% +19.9% ➖ noise
6 duckdb:vortex-file-compressed +4.8% -8.0% +13.9% +20.6% ➖ noise
7 datafusion:vortex-file-compressed +4.4% +1.0% +3.4% +30.9% ➖ noise
7 duckdb:duckdb +0.9% +1.0% -0.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +13.2% +1.0% +12.0% +43.8% ➖ noise
8 datafusion:vortex-file-compressed +1.5% +0.7% +0.8% +10.0% ➖ noise
8 duckdb:duckdb +0.3% +0.7% -0.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.3% +0.7% -1.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.4% -1.3% +1.7% +10.0% ➖ noise
9 duckdb:duckdb -4.5% -1.3% -3.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.9% -1.3% +2.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.6% -1.7% +1.0% +12.2% ➖ noise
10 duckdb:duckdb -1.4% -1.7% +0.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.7% -1.7% +3.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.9% +0.1% -0.9% +10.0% ➖ noise
11 duckdb:duckdb -5.4% +0.1% -5.4% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +1.5% +0.1% +1.5% +12.4% ➖ noise
12 datafusion:vortex-file-compressed -0.8% -1.0% +0.3% +10.0% ➖ noise
12 duckdb:duckdb -10.0% -1.0% -9.1% +10.0% ✅ faster
12 duckdb:vortex-file-compressed +2.8% -1.0% +3.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.6% -0.2% -2.4% +10.0% ➖ noise
13 duckdb:duckdb -18.5% -0.2% -18.4% +10.0% ✅ faster
13 duckdb:vortex-file-compressed +2.4% -0.2% +2.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +2.8% -1.2% +4.1% +10.0% ➖ noise
14 duckdb:duckdb -17.6% -1.2% -16.6% +10.0% ✅ faster
14 duckdb:vortex-file-compressed +1.9% -1.2% +3.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.4% +0.5% -0.9% +10.0% ➖ noise
15 duckdb:duckdb -17.0% +0.5% -17.4% +10.0% ✅ faster
15 duckdb:vortex-file-compressed -0.3% +0.5% -0.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.5% +0.2% +1.4% +10.0% ➖ noise
16 duckdb:duckdb -18.4% +0.2% -18.5% +10.0% ✅ faster
16 duckdb:vortex-file-compressed +1.3% +0.2% +1.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.3% +1.4% -1.6% +10.0% ➖ noise
17 duckdb:duckdb -17.6% +1.4% -18.8% +10.0% ✅ faster
17 duckdb:vortex-file-compressed +2.9% +1.4% +1.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +2.3% -2.3% +4.7% +10.0% ➖ noise
18 duckdb:duckdb -23.4% -2.3% -21.6% +10.0% ✅ faster
18 duckdb:vortex-file-compressed +2.6% -2.3% +4.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +11.2% +0.0% +11.1% +32.6% ➖ noise
19 duckdb:duckdb -10.9% +0.0% -10.9% +12.0% ✅ faster
19 duckdb:vortex-file-compressed +7.5% +0.0% +7.5% +27.9% ➖ noise
20 datafusion:vortex-file-compressed +3.3% +0.1% +3.2% +110.4% ➖ noise
20 duckdb:duckdb -17.2% +0.1% -17.3% +76.9% ➖ noise
20 duckdb:vortex-file-compressed -1.5% +0.1% -1.6% +19.2% ➖ noise
21 datafusion:vortex-file-compressed +5.3% +0.2% +5.1% +10.0% ➖ noise
21 duckdb:duckdb -14.5% +0.2% -14.6% +10.0% ✅ faster
21 duckdb:vortex-file-compressed +5.1% +0.2% +4.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +2.0% +0.5% +1.5% +10.0% ➖ noise
22 duckdb:duckdb -8.2% +0.5% -8.6% +38.5% ➖ noise
22 duckdb:vortex-file-compressed -0.3% +0.5% -0.8% +13.1% ➖ noise
23 datafusion:vortex-file-compressed -1.1% -0.5% -0.6% +39.9% ➖ noise
23 duckdb:duckdb -9.0% -0.5% -8.5% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +1.9% -0.5% +2.4% +16.9% ➖ noise
24 datafusion:vortex-file-compressed +8.7% -2.9% +11.9% +12.8% ➖ noise
24 duckdb:duckdb -5.2% -2.9% -2.4% +31.3% ➖ noise
24 duckdb:vortex-file-compressed -3.6% -2.9% -0.7% +18.9% ➖ noise
25 datafusion:vortex-file-compressed -1.3% +0.4% -1.7% +15.3% ➖ noise
25 duckdb:duckdb -3.2% +0.4% -3.6% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +5.8% +0.4% +5.3% +12.0% ➖ noise
26 datafusion:vortex-file-compressed +9.6% +3.8% +5.6% +12.9% ➖ noise
26 duckdb:duckdb -3.4% +3.8% -6.9% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +10.5% +3.8% +6.4% +19.4% ➖ noise
27 datafusion:vortex-file-compressed +0.7% +1.0% -0.3% +10.0% ➖ noise
27 duckdb:duckdb -3.6% +1.0% -4.6% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +2.2% +1.0% +1.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.5% +0.2% +0.4% +10.0% ➖ noise
28 duckdb:duckdb -1.0% +0.2% -1.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.5% +0.2% -0.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -2.8% +0.4% -3.2% +13.2% ➖ noise
29 duckdb:duckdb -0.7% +0.4% -1.0% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +8.3% +0.4% +7.9% +30.6% ➖ noise
30 datafusion:vortex-file-compressed +6.3% +0.4% +5.8% +10.0% ➖ noise
30 duckdb:duckdb -0.3% +0.4% -0.8% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -0.7% +0.4% -1.1% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +2.4% -0.5% +2.9% +10.0% ➖ noise
31 duckdb:duckdb +1.1% -0.5% +1.6% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.8% -0.5% +1.3% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -10.8% -0.8% -10.1% +12.5% ➖ noise
32 duckdb:duckdb +0.9% -0.8% +1.6% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +1.9% -0.8% +2.7% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +3.4% +1.3% +2.1% +10.0% ➖ noise
33 duckdb:duckdb +0.1% +1.3% -1.2% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -3.5% +1.3% -4.7% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.1% -2.1% +2.2% +10.0% ➖ noise
34 duckdb:duckdb -0.5% -2.1% +1.7% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -0.2% -2.1% +2.0% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +6.1% -0.3% +6.3% +10.0% ➖ noise
35 duckdb:duckdb +1.2% -0.3% +1.5% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -2.3% -0.3% -2.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +3.1% +6.5% -3.2% +15.3% ➖ noise
36 duckdb:duckdb -0.9% +6.5% -7.0% +17.0% ➖ noise
36 duckdb:vortex-file-compressed -12.6% +6.5% -17.9% +10.0% ✅ faster
37 datafusion:vortex-file-compressed +3.1% -1.0% +4.1% +13.6% ➖ noise
37 duckdb:duckdb -0.8% -1.0% +0.2% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -13.3% -1.0% -12.4% +20.7% ➖ noise
38 datafusion:vortex-file-compressed -0.9% -0.5% -0.4% +14.2% ➖ noise
38 duckdb:duckdb +0.8% -0.5% +1.3% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -12.4% -0.5% -12.0% +10.0% ✅ faster
39 datafusion:vortex-file-compressed +0.3% -2.1% +2.4% +10.0% ➖ noise
39 duckdb:duckdb +4.3% -2.1% +6.5% +15.5% ➖ noise
39 duckdb:vortex-file-compressed -14.2% -2.1% -12.4% +12.5% ✅ faster
40 datafusion:vortex-file-compressed +2.7% +2.0% +0.7% +12.7% ➖ noise
40 duckdb:duckdb -2.0% +2.0% -4.0% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -9.7% +2.0% -11.5% +14.1% ➖ noise
41 datafusion:vortex-file-compressed +2.5% -2.6% +5.2% +13.1% ➖ noise
41 duckdb:duckdb -1.9% -2.6% +0.7% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -8.0% -2.6% -5.6% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +5.6% -1.3% +7.0% +10.0% ➖ noise
42 duckdb:duckdb -1.0% -1.3% +0.3% +10.3% ➖ noise
42 duckdb:vortex-file-compressed -14.7% -1.3% -13.6% +13.7% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.6%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+2.6%, low confidence)
Vortex (geomean): 0.926x ➖
Parquet (geomean): 0.914x ➖
Shifts: Parquet (control) -8.6% · Median polish -3.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.875x ✅, 7↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 🚀 131453664 147124910 0.89
appian_q02/datafusion:vortex-file-compressed 🚀 656548207 750668710 0.87
appian_q03/datafusion:vortex-file-compressed 🚀 356969201 416184406 0.86
appian_q04/datafusion:vortex-file-compressed 27718622348 28811263026 0.96
appian_q05/datafusion:vortex-file-compressed 🚀 265961156 321400946 0.83
appian_q06/datafusion:vortex-file-compressed 🚀 413134938 484761810 0.85
appian_q07/datafusion:vortex-file-compressed 🚀 449554857 521834869 0.86
appian_q08/datafusion:vortex-file-compressed 🚀 1859945284 2128597091 0.87
datafusion / parquet (0.871x ✅, 7↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 🚀 128965091 154976281 0.83
appian_q02/datafusion:parquet 🚀 670873007 768885326 0.87
appian_q03/datafusion:parquet 🚀 355087990 415961953 0.85
appian_q04/datafusion:parquet 27630995109 28895571312 0.96
appian_q05/datafusion:parquet 🚀 285610853 326916962 0.87
appian_q06/datafusion:parquet 🚀 428812694 502212715 0.85
appian_q07/datafusion:parquet 🚀 451429282 528653889 0.85
appian_q08/datafusion:parquet 🚀 1832176020 2097135630 0.87
duckdb / vortex-file-compressed (0.980x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 191289870 198809558 0.96
appian_q02/duckdb:vortex-file-compressed 610286196 630053114 0.97
appian_q03/duckdb:vortex-file-compressed 261856784 269375513 0.97
appian_q04/duckdb:vortex-file-compressed 1323402754 1341776652 0.99
appian_q05/duckdb:vortex-file-compressed 290910499 302612909 0.96
appian_q06/duckdb:vortex-file-compressed 805207808 806374280 1.00
appian_q07/duckdb:vortex-file-compressed 344114113 345566384 1.00
appian_q08/duckdb:vortex-file-compressed 1306501386 1310675681 1.00
duckdb / parquet (0.960x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 202190600 208637816 0.97
appian_q02/duckdb:parquet 601610087 619039778 0.97
appian_q03/duckdb:parquet 285030210 297885612 0.96
appian_q04/duckdb:parquet 1315156597 1376410157 0.96
appian_q05/duckdb:parquet 304963800 333483527 0.91
appian_q06/duckdb:parquet 791322775 806638248 0.98
appian_q07/duckdb:parquet 361772905 374529945 0.97
appian_q08/duckdb:parquet 1259991464 1305303889 0.97
duckdb / duckdb (0.990x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 171551539 172596547 0.99
appian_q02/duckdb:duckdb 541673359 554588877 0.98
appian_q03/duckdb:duckdb 385963069 391417858 0.99
appian_q04/duckdb:duckdb 1297505471 1320315091 0.98
appian_q05/duckdb:duckdb 282488058 286607432 0.99
appian_q06/duckdb:duckdb 782479321 778588875 1.00
appian_q07/duckdb:duckdb 324832164 325739716 1.00
appian_q08/duckdb:duckdb 1219154047 1227659117 0.99

File Size Changes (4 files changed, -0.0% overall, 2↑ 2↓)
File Scale Format Base HEAD Change %
orderview.vortex 1.0 vortex-file-compressed 81.10 MB 81.12 MB +22.46 KB +0.0%
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB +8 B +0.0%
creditcardview.vortex 1.0 vortex-file-compressed 61.05 MB 60.94 MB 114.55 KB -0.2%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 513.78 MB → 513.69 MB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-file-compressed -10.7% -10.2% -0.5% +11.9% ➖ noise
1 duckdb:duckdb -0.6% -10.2% +10.7% +10.0% 🚨 regression
1 duckdb:vortex-file-compressed -3.8% -10.2% +7.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -12.5% -7.9% -5.0% +10.0% ➖ noise
2 duckdb:duckdb -2.3% -7.9% +6.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -3.1% -7.9% +5.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -14.2% -9.6% -5.1% +10.0% ➖ noise
3 duckdb:duckdb -1.4% -9.6% +9.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.8% -9.6% +7.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -3.8% -4.4% +0.6% +10.0% ➖ noise
4 duckdb:duckdb -1.7% -4.4% +2.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.4% -4.4% +3.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -17.2% -10.6% -7.4% +10.5% ➖ noise
5 duckdb:duckdb -1.4% -10.6% +10.3% +10.0% 🚨 regression
5 duckdb:vortex-file-compressed -3.9% -10.6% +7.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -14.8% -8.5% -6.9% +10.0% ➖ noise
6 duckdb:duckdb +0.5% -8.5% +9.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.1% -8.5% +9.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -13.9% -9.2% -5.1% +10.0% ➖ noise
7 duckdb:duckdb -0.3% -9.2% +9.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.4% -9.2% +9.6% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -12.6% -8.2% -4.9% +10.0% ➖ noise
8 duckdb:duckdb -0.7% -8.2% +8.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.3% -8.2% +8.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (+0.3%, environment too noisy confidence) · DuckDB No clear signal (-0.9%, environment too noisy confidence)
Vortex (geomean): 1.052x ➖
Parquet (geomean): 1.055x ➖
Shifts: Parquet (control) +5.5% · Median polish +5.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.993x ➖, 1↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 286473594 304514594 0.94
tpch_q02/datafusion:vortex-file-compressed 591738297 606395428 0.98
tpch_q03/datafusion:vortex-file-compressed 457628235 538039445 0.85
tpch_q04/datafusion:vortex-file-compressed 278824945 310010175 0.90
tpch_q05/datafusion:vortex-file-compressed 505384622 550197793 0.92
tpch_q06/datafusion:vortex-file-compressed 376351139 357062617 1.05
tpch_q07/datafusion:vortex-file-compressed 460801417 515613245 0.89
tpch_q08/datafusion:vortex-file-compressed 785106324 671481151 1.17
tpch_q09/datafusion:vortex-file-compressed 531570158 539259578 0.99
tpch_q10/datafusion:vortex-file-compressed 🚀 685820725 1193223589 0.57
tpch_q11/datafusion:vortex-file-compressed 354108709 350435575 1.01
tpch_q12/datafusion:vortex-file-compressed 503411941 507094470 0.99
tpch_q13/datafusion:vortex-file-compressed 239346946 224694665 1.07
tpch_q14/datafusion:vortex-file-compressed 334057143 325193644 1.03
tpch_q15/datafusion:vortex-file-compressed 654319324 600673716 1.09
tpch_q16/datafusion:vortex-file-compressed 289921901 301830831 0.96
tpch_q17/datafusion:vortex-file-compressed 459401680 401752307 1.14
tpch_q18/datafusion:vortex-file-compressed 398173358 316895090 1.26
tpch_q19/datafusion:vortex-file-compressed 524925074 500942491 1.05
tpch_q20/datafusion:vortex-file-compressed 417508044 413487719 1.01
tpch_q21/datafusion:vortex-file-compressed 649802217 552002452 1.18
tpch_q22/datafusion:vortex-file-compressed 125457440 122290387 1.03
datafusion / vortex-compact (1.123x ➖, 0↑ 4↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 316600774 251381026 1.26
tpch_q02/datafusion:vortex-compact 503938749 497919681 1.01
tpch_q03/datafusion:vortex-compact 399823787 412282829 0.97
tpch_q04/datafusion:vortex-compact 247150420 230541535 1.07
tpch_q05/datafusion:vortex-compact 524637903 479346591 1.09
tpch_q06/datafusion:vortex-compact 🚨 492631990 338917606 1.45
tpch_q07/datafusion:vortex-compact 🚨 718722275 463826296 1.55
tpch_q08/datafusion:vortex-compact 669764857 586926303 1.14
tpch_q09/datafusion:vortex-compact 605359493 470303425 1.29
tpch_q10/datafusion:vortex-compact 551443178 575305805 0.96
tpch_q11/datafusion:vortex-compact 343998162 342292164 1.00
tpch_q12/datafusion:vortex-compact 393485603 388665945 1.01
tpch_q13/datafusion:vortex-compact 193899302 205602366 0.94
tpch_q14/datafusion:vortex-compact 🚨 405628741 279598231 1.45
tpch_q15/datafusion:vortex-compact 🚨 678181163 490829896 1.38
tpch_q16/datafusion:vortex-compact 252481206 247207719 1.02
tpch_q17/datafusion:vortex-compact 481708445 426447000 1.13
tpch_q18/datafusion:vortex-compact 351010554 308485906 1.14
tpch_q19/datafusion:vortex-compact 576310820 496529493 1.16
tpch_q20/datafusion:vortex-compact 493594225 484880469 1.02
tpch_q21/datafusion:vortex-compact 642394678 623145691 1.03
tpch_q22/datafusion:vortex-compact 165920714 181896176 0.91
datafusion / parquet (1.052x ➖, 1↑ 4↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 235080721 238167757 0.99
tpch_q02/datafusion:parquet 🚨 921465257 422662364 2.18
tpch_q03/datafusion:parquet 🚨 557416108 388513301 1.43
tpch_q04/datafusion:parquet 205965106 249507875 0.83
tpch_q05/datafusion:parquet 589337570 544748064 1.08
tpch_q06/datafusion:parquet 🚨 211315851 140561386 1.50
tpch_q07/datafusion:parquet 605691603 474017384 1.28
tpch_q08/datafusion:parquet 619500619 579184624 1.07
tpch_q09/datafusion:parquet 604010341 525052631 1.15
tpch_q10/datafusion:parquet 693253850 594118104 1.17
tpch_q11/datafusion:parquet 🚨 522218079 384402586 1.36
tpch_q12/datafusion:parquet 265093326 272652259 0.97
tpch_q13/datafusion:parquet 438327202 523330317 0.84
tpch_q14/datafusion:parquet 🚀 216446652 310325781 0.70
tpch_q15/datafusion:parquet 349658438 468314736 0.75
tpch_q16/datafusion:parquet 203020159 236452225 0.86
tpch_q17/datafusion:parquet 436413788 523010423 0.83
tpch_q18/datafusion:parquet 512962228 565466720 0.91
tpch_q19/datafusion:parquet 367755467 370967441 0.99
tpch_q20/datafusion:parquet 405176573 388277440 1.04
tpch_q21/datafusion:parquet 549403964 585128257 0.94
tpch_q22/datafusion:parquet 139595052 125738381 1.11
duckdb / vortex-file-compressed (1.064x ➖, 0↑ 1↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 353999678 279341292 1.27
tpch_q02/duckdb:vortex-file-compressed 1078822723 971348841 1.11
tpch_q03/duckdb:vortex-file-compressed 784014120 740693611 1.06
tpch_q04/duckdb:vortex-file-compressed 506817691 476012047 1.06
tpch_q05/duckdb:vortex-file-compressed 876008505 822149089 1.07
tpch_q06/duckdb:vortex-file-compressed 400713267 328234517 1.22
tpch_q07/duckdb:vortex-file-compressed 1072505421 993296682 1.08
tpch_q08/duckdb:vortex-file-compressed 1046437795 1028679853 1.02
tpch_q09/duckdb:vortex-file-compressed 963562668 1194720304 0.81
tpch_q10/duckdb:vortex-file-compressed 760440788 692711683 1.10
tpch_q11/duckdb:vortex-file-compressed 516978773 507123553 1.02
tpch_q12/duckdb:vortex-file-compressed 708878280 757370136 0.94
tpch_q13/duckdb:vortex-file-compressed 445394205 506552897 0.88
tpch_q14/duckdb:vortex-file-compressed 382433824 421899612 0.91
tpch_q15/duckdb:vortex-file-compressed 335072661 299553988 1.12
tpch_q16/duckdb:vortex-file-compressed 368194356 378201262 0.97
tpch_q17/duckdb:vortex-file-compressed 727020369 668356886 1.09
tpch_q18/duckdb:vortex-file-compressed 567496496 526873899 1.08
tpch_q19/duckdb:vortex-file-compressed 520223597 437744131 1.19
tpch_q20/duckdb:vortex-file-compressed 946501565 819919918 1.15
tpch_q21/duckdb:vortex-file-compressed 1196755655 1190770710 1.01
tpch_q22/duckdb:vortex-file-compressed 🚨 327640884 225978120 1.45
duckdb / vortex-compact (1.033x ➖, 0↑ 1↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 343216478 261396233 1.31
tpch_q02/duckdb:vortex-compact 976515586 1049587795 0.93
tpch_q03/duckdb:vortex-compact 678908617 599667155 1.13
tpch_q04/duckdb:vortex-compact 413940068 399613558 1.04
tpch_q05/duckdb:vortex-compact 790424012 871118567 0.91
tpch_q06/duckdb:vortex-compact 353213341 420851567 0.84
tpch_q07/duckdb:vortex-compact 888527360 892237219 1.00
tpch_q08/duckdb:vortex-compact 1042173898 995122334 1.05
tpch_q09/duckdb:vortex-compact 1062508397 1071267318 0.99
tpch_q10/duckdb:vortex-compact 732817777 785478415 0.93
tpch_q11/duckdb:vortex-compact 512003297 490559660 1.04
tpch_q12/duckdb:vortex-compact 634035884 664801922 0.95
tpch_q13/duckdb:vortex-compact 487885560 459977092 1.06
tpch_q14/duckdb:vortex-compact 479886824 410150785 1.17
tpch_q15/duckdb:vortex-compact 281460375 293483057 0.96
tpch_q16/duckdb:vortex-compact 351598574 315511355 1.11
tpch_q17/duckdb:vortex-compact 709912391 752836751 0.94
tpch_q18/duckdb:vortex-compact 546423298 493955187 1.11
tpch_q19/duckdb:vortex-compact 524223817 492618680 1.06
tpch_q20/duckdb:vortex-compact 872186117 767551868 1.14
tpch_q21/duckdb:vortex-compact 994042680 990165718 1.00
tpch_q22/duckdb:vortex-compact 338880874 293077422 1.16
duckdb / parquet (1.057x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 498487998 533557226 0.93
tpch_q02/duckdb:parquet 1165552560 1149931267 1.01
tpch_q03/duckdb:parquet 1050629905 1071009633 0.98
tpch_q04/duckdb:parquet 767202279 706044016 1.09
tpch_q05/duckdb:parquet 1402665121 1296348333 1.08
tpch_q06/duckdb:parquet 543025414 435033768 1.25
tpch_q07/duckdb:parquet 1387022671 1248538839 1.11
tpch_q08/duckdb:parquet 1658512224 1622344845 1.02
tpch_q09/duckdb:parquet 1453803986 1503709983 0.97
tpch_q10/duckdb:parquet 1371306504 1428094049 0.96
tpch_q11/duckdb:parquet 818247858 744603823 1.10
tpch_q12/duckdb:parquet 773108306 753008011 1.03
tpch_q13/duckdb:parquet 929371527 952491400 0.98
tpch_q14/duckdb:parquet 784527967 675226146 1.16
tpch_q15/duckdb:parquet 596824324 519294634 1.15
tpch_q16/duckdb:parquet 722313014 735688911 0.98
tpch_q17/duckdb:parquet 894171385 821366419 1.09
tpch_q18/duckdb:parquet 1061306682 969382696 1.09
tpch_q19/duckdb:parquet 910884826 832386604 1.09
tpch_q20/duckdb:parquet 1334065214 1263397152 1.06
tpch_q21/duckdb:parquet 1247840824 1101933873 1.13
tpch_q22/duckdb:parquet 594106757 562475317 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +25.9% -4.0% +31.2% +78.6% ➖ noise
1 datafusion:vortex-file-compressed -5.9% -4.0% -2.0% +66.5% ➖ noise
1 duckdb:vortex-compact +31.3% -4.0% +36.7% +52.3% ➖ noise
1 duckdb:vortex-file-compressed +26.7% -4.0% +32.0% +66.1% ➖ noise
2 datafusion:vortex-compact +1.2% +48.7% -31.9% +41.8% ✅ faster
2 datafusion:vortex-file-compressed -2.4% +48.7% -34.4% +40.1% ✅ faster
2 duckdb:vortex-compact -7.0% +48.7% -37.4% +40.1% ✅ faster
2 duckdb:vortex-file-compressed +11.1% +48.7% -25.3% +40.1% ➖ noise
3 datafusion:vortex-compact -3.0% +18.6% -18.3% +45.3% ➖ noise
3 datafusion:vortex-file-compressed -14.9% +18.6% -28.3% +59.6% ➖ noise
3 duckdb:vortex-compact +13.2% +18.6% -4.6% +40.1% ➖ noise
3 duckdb:vortex-file-compressed +5.8% +18.6% -10.8% +40.1% ➖ noise
4 datafusion:vortex-compact +7.2% -5.3% +13.2% +44.3% ➖ noise
4 datafusion:vortex-file-compressed -10.1% -5.3% -5.0% +40.1% ➖ noise
4 duckdb:vortex-compact +3.6% -5.3% +9.4% +40.1% ➖ noise
4 duckdb:vortex-file-compressed +6.5% -5.3% +12.4% +48.8% ➖ noise
5 datafusion:vortex-compact +9.4% +8.2% +1.2% +40.1% ➖ noise
5 datafusion:vortex-file-compressed -8.1% +8.2% -15.1% +40.1% ➖ noise
5 duckdb:vortex-compact -9.3% +8.2% -16.1% +40.1% ➖ noise
5 duckdb:vortex-file-compressed +6.6% +8.2% -1.5% +40.1% ➖ noise
6 datafusion:vortex-compact +45.4% +37.0% +6.1% +44.6% ➖ noise
6 datafusion:vortex-file-compressed +5.4% +37.0% -23.1% +40.1% ➖ noise
6 duckdb:vortex-compact -16.1% +37.0% -38.7% +40.1% ✅ faster
6 duckdb:vortex-file-compressed +22.1% +37.0% -10.9% +40.1% ➖ noise
7 datafusion:vortex-compact +55.0% +19.1% +30.1% +40.1% ➖ noise
7 datafusion:vortex-file-compressed -10.6% +19.1% -25.0% +40.1% ➖ noise
7 duckdb:vortex-compact -0.4% +19.1% -16.4% +40.1% ➖ noise
7 duckdb:vortex-file-compressed +8.0% +19.1% -9.4% +40.1% ➖ noise
8 datafusion:vortex-compact +14.1% +4.6% +9.1% +40.1% ➖ noise
8 datafusion:vortex-file-compressed +16.9% +4.6% +11.8% +40.1% ➖ noise
8 duckdb:vortex-compact +4.7% +4.6% +0.2% +40.1% ➖ noise
8 duckdb:vortex-file-compressed +1.7% +4.6% -2.7% +40.1% ➖ noise
9 datafusion:vortex-compact +28.7% +5.5% +22.1% +40.1% ➖ noise
9 datafusion:vortex-file-compressed -1.4% +5.5% -6.5% +40.1% ➖ noise
9 duckdb:vortex-compact -0.8% +5.5% -6.0% +40.1% ➖ noise
9 duckdb:vortex-file-compressed -19.3% +5.5% -23.5% +40.1% ➖ noise
10 datafusion:vortex-compact -4.1% +5.9% -9.4% +40.1% ➖ noise
10 datafusion:vortex-file-compressed -42.5% +5.9% -45.7% +48.6% ✅ faster
10 duckdb:vortex-compact -6.7% +5.9% -11.9% +40.1% ➖ noise
10 duckdb:vortex-file-compressed +9.8% +5.9% +3.7% +40.1% ➖ noise
11 datafusion:vortex-compact +0.5% +22.2% -17.7% +40.1% ➖ noise
11 datafusion:vortex-file-compressed +1.0% +22.2% -17.3% +40.1% ➖ noise
11 duckdb:vortex-compact +4.4% +22.2% -14.6% +40.1% ➖ noise
11 duckdb:vortex-file-compressed +1.9% +22.2% -16.6% +40.1% ➖ noise
12 datafusion:vortex-compact +1.2% -0.1% +1.3% +40.1% ➖ noise
12 datafusion:vortex-file-compressed -0.7% -0.1% -0.6% +40.1% ➖ noise
12 duckdb:vortex-compact -4.6% -0.1% -4.5% +40.1% ➖ noise
12 duckdb:vortex-file-compressed -6.4% -0.1% -6.3% +40.1% ➖ noise
13 datafusion:vortex-compact -5.7% -9.6% +4.3% +60.6% ➖ noise
13 datafusion:vortex-file-compressed +6.5% -9.6% +17.8% +64.5% ➖ noise
13 duckdb:vortex-compact +6.1% -9.6% +17.3% +40.1% ➖ noise
13 duckdb:vortex-file-compressed -12.1% -9.6% -2.7% +42.7% ➖ noise
14 datafusion:vortex-compact +45.1% -10.0% +61.2% +40.1% 🚨 regression
14 datafusion:vortex-file-compressed +2.7% -10.0% +14.1% +40.1% ➖ noise
14 duckdb:vortex-compact +17.0% -10.0% +30.0% +40.1% ➖ noise
14 duckdb:vortex-file-compressed -9.4% -10.0% +0.7% +40.1% ➖ noise
15 datafusion:vortex-compact +38.2% -7.4% +49.2% +40.1% 🚨 regression
15 datafusion:vortex-file-compressed +8.9% -7.4% +17.6% +40.1% ➖ noise
15 duckdb:vortex-compact -4.1% -7.4% +3.5% +40.1% ➖ noise
15 duckdb:vortex-file-compressed +11.9% -7.4% +20.8% +40.1% ➖ noise
16 datafusion:vortex-compact +2.1% -8.2% +11.2% +40.1% ➖ noise
16 datafusion:vortex-file-compressed -3.9% -8.2% +4.6% +43.1% ➖ noise
16 duckdb:vortex-compact +11.4% -8.2% +21.4% +40.1% ➖ noise
16 duckdb:vortex-file-compressed -2.6% -8.2% +6.0% +40.1% ➖ noise
17 datafusion:vortex-compact +13.0% -4.7% +18.5% +40.1% ➖ noise
17 datafusion:vortex-file-compressed +14.3% -4.7% +20.0% +40.1% ➖ noise
17 duckdb:vortex-compact -5.7% -4.7% -1.1% +40.1% ➖ noise
17 duckdb:vortex-file-compressed +8.8% -4.7% +14.1% +40.1% ➖ noise
18 datafusion:vortex-compact +13.8% -0.3% +14.2% +40.1% ➖ noise
18 datafusion:vortex-file-compressed +25.6% -0.3% +26.1% +40.1% ➖ noise
18 duckdb:vortex-compact +10.6% -0.3% +11.0% +40.1% ➖ noise
18 duckdb:vortex-file-compressed +7.7% -0.3% +8.1% +40.1% ➖ noise
19 datafusion:vortex-compact +16.1% +4.2% +11.4% +40.1% ➖ noise
19 datafusion:vortex-file-compressed +4.8% +4.2% +0.6% +40.1% ➖ noise
19 duckdb:vortex-compact +6.4% +4.2% +2.2% +40.1% ➖ noise
19 duckdb:vortex-file-compressed +18.8% +4.2% +14.1% +40.1% ➖ noise
20 datafusion:vortex-compact +1.8% +5.0% -3.0% +40.1% ➖ noise
20 datafusion:vortex-file-compressed +1.0% +5.0% -3.8% +40.1% ➖ noise
20 duckdb:vortex-compact +13.6% +5.0% +8.3% +40.1% ➖ noise
20 duckdb:vortex-file-compressed +15.4% +5.0% +10.0% +40.1% ➖ noise
21 datafusion:vortex-compact +3.1% +3.1% -0.0% +40.1% ➖ noise
21 datafusion:vortex-file-compressed +17.7% +3.1% +14.2% +40.1% ➖ noise
21 duckdb:vortex-compact +0.4% +3.1% -2.6% +40.1% ➖ noise
21 duckdb:vortex-file-compressed +0.5% +3.1% -2.5% +40.1% ➖ noise
22 datafusion:vortex-compact -8.8% +8.3% -15.8% +46.5% ➖ noise
22 datafusion:vortex-file-compressed +2.6% +8.3% -5.3% +40.1% ➖ noise
22 duckdb:vortex-compact +15.6% +8.3% +6.8% +40.1% ➖ noise
22 duckdb:vortex-file-compressed +45.0% +8.3% +33.9% +40.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: Compression

Vortex (geomean): 1.006x ➖
Parquet (geomean): 1.008x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (1.011x ➖, 0↑ 7↓)
name PR 9a0f3ba (ns) base 3ac6c77 (ns) ratio (PR/base)
compress time/Arade 1097182497 1107484044 0.99
compress time/Bimbo 5626733388 5652511010 1.00
compress time/CMSprovider 2754722582 2702660558 1.02
compress time/Euro2016 480534842 482517302 1.00
compress time/Food 366898359 345457255 1.06
compress time/HashTags 870048956 850803806 1.02
compress time/TPC-H l_comment canonical 1244959367 1216135910 1.02
compress time/TPC-H l_comment chunked 1253668350 1233542814 1.02
compress time/taxi 672088481 681787742 0.99
compress time/wide table cols=100 chunks=1 rows=1000 11727624 11574252 1.01
compress time/wide table cols=100 chunks=50 rows=1000 12381868 11824847 1.05
compress time/wide table cols=1000 chunks=1 rows=1000 124648842 123256187 1.01
compress time/wide table cols=1000 chunks=50 rows=1000 123579551 130365145 0.95
compress time/wide table cols=10000 chunks=1 rows=1000 1481627962 1459379364 1.02
compress time/wide table cols=10000 chunks=50 rows=1000 1491447903 1461584673 1.02
compress time/wide table cols=100000 chunks=10 rows=1000 project=10000 15322961750 nan
decompress time/Arade 28529405 26053868 1.10
decompress time/Bimbo 77347655 76051061 1.02
decompress time/CMSprovider 77167581 77776411 0.99
decompress time/Euro2016 19850551 18920354 1.05
decompress time/Food 8065560 8333685 0.97
decompress time/HashTags 91032160 88617178 1.03
decompress time/TPC-H l_comment canonical 39550033 40083422 0.99
decompress time/TPC-H l_comment chunked 40826941 39253778 1.04
decompress time/taxi 14230175 15689161 0.91
decompress time/wide table cols=100 chunks=1 rows=1000 2483888 2375356 1.05
decompress time/wide table cols=100 chunks=50 rows=1000 2609473 2482741 1.05
decompress time/wide table cols=1000 chunks=1 rows=1000 23406924 21858454 1.07
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 24423275 22030827 1.11
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 261269743 230432865 1.13
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 273624075 244828079 1.12
decompress time/wide table cols=100000 chunks=10 rows=1000 project=10000 6023803825 nan
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=100000 chunks=10 rows=1000 project=10000 932400004 nan
parquet_rs-zstd compress time/Arade 2666264967 2618388313 1.02
parquet_rs-zstd compress time/Bimbo 12979027745 12697533532 1.02
parquet_rs-zstd compress time/CMSprovider 7023119286 6904669249 1.02
parquet_rs-zstd compress time/Euro2016 1310319748 1313572445 1.00
parquet_rs-zstd compress time/Food 808568851 799988098 1.01
parquet_rs-zstd compress time/HashTags 2201088682 2171753094 1.01
parquet_rs-zstd compress time/TPC-H l_comment canonical 3243529591 3215737925 1.01
parquet_rs-zstd compress time/TPC-H l_comment chunked 3199892439 3179134800 1.01
parquet_rs-zstd compress time/taxi 1190337417 1179819686 1.01
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6210803 6050204 1.03
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 6760836 6030096 1.12
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 76964256 75282000 1.02
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 76243055 74883091 1.02
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 785442294 781718642 1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 782803149 773919185 1.01
parquet_rs-zstd compress time/wide table cols=100000 chunks=10 rows=1000 project=10000 9514596704 nan
parquet_rs-zstd decompress time/Arade 617652143 623627456 0.99
parquet_rs-zstd decompress time/Bimbo 1694559387 1697905252 1.00
parquet_rs-zstd decompress time/CMSprovider 1691437093 1697472550 1.00
parquet_rs-zstd decompress time/Euro2016 373044705 378205301 0.99
parquet_rs-zstd decompress time/Food 195201150 197957305 0.99
parquet_rs-zstd decompress time/HashTags 639614875 628224579 1.02
parquet_rs-zstd decompress time/TPC-H l_comment canonical 589466585 588166438 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked 592922286 591715865 1.00
parquet_rs-zstd decompress time/taxi 243560072 243031612 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2833202 2821673 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2899862 2774204 1.05
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32630896 32072823 1.02
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33255427 32624882 1.02
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 350704676 346708375 1.01
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 350722714 345290677 1.02
parquet_rs-zstd decompress time/wide table cols=100000 chunks=10 rows=1000 project=10000 603271856 nan
vortex-file-compressed size/Arade 145363860 145363860 1.00
vortex-file-compressed size/Bimbo 468763396 468763396 1.00
vortex-file-compressed size/CMSprovider 417904596 417904844 1.00
vortex-file-compressed size/Euro2016 158920524 158032060 1.01
vortex-file-compressed size/Food 41927000 41927000 1.00
vortex-file-compressed size/HashTags 185022916 184900324 1.00
vortex-file-compressed size/TPC-H l_comment canonical 178517656 178459064 1.00
vortex-file-compressed size/TPC-H l_comment chunked 178662440 178608968 1.00
vortex-file-compressed size/taxi 52364012 52364012 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=100000 chunks=10 rows=1000 project=10000 929597712 nan
vortex:parquet-zstd ratio compress time/Arade 0 0 0.97
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.97
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio compress time/Food 0 0 1.05
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio compress time/taxi 0 0 0.98
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.93
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.93
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=100000 chunks=10 rows=1000 project=10000 1 nan
vortex:parquet-zstd ratio decompress time/Arade 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.02
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.06
vortex:parquet-zstd ratio decompress time/Food 0 0 0.98
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.98
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.04
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.09
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 0 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=100000 chunks=10 rows=1000 project=10000 9 nan
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.01
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100000 chunks=10 rows=1000 project=10000 0 nan

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.7%
Engines: DataFusion No clear signal (-8.6%, environment too noisy confidence) · DuckDB No clear signal (-0.7%, environment too noisy confidence)
Vortex (geomean): 1.059x ➖
Parquet (geomean): 1.111x ➖
Shifts: Parquet (control) +11.1% · Median polish +7.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.229x ➖, 0↑ 11↓)
name PR 9a0f3ba (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 901708548 661634690 1.36
tpch_q02/datafusion:vortex-file-compressed 🚨 1051841709 742906365 1.42
tpch_q03/datafusion:vortex-file-compressed 990920344 1331018627 0.74
tpch_q04/datafusion:vortex-file-compressed 🚨 942007699 620526305 1.52
tpch_q05/datafusion:vortex-file-compressed 🚨 1403454767 1042576290 1.35
tpch_q06/datafusion:vortex-file-compressed 695359866 678475093 1.02
tpch_q07/datafusion:vortex-file-compressed 1298178165 1092150417 1.19
tpch_q08/datafusion:vortex-file-compressed 🚨 2673822775 1329107398 2.01
tpch_q09/datafusion:vortex-file-compressed 1827615568 1608919796 1.14
tpch_q10/datafusion:vortex-file-compressed 1389157774 1250984281 1.11
tpch_q11/datafusion:vortex-file-compressed 665905742 609038152 1.09
tpch_q12/datafusion:vortex-file-compressed 1059954114 1370278139 0.77
tpch_q13/datafusion:vortex-file-compressed 510228860 527434716 0.97
tpch_q14/datafusion:vortex-file-compressed 🚨 764507922 578287213 1.32
tpch_q15/datafusion:vortex-file-compressed 1271313514 1171390243 1.09
tpch_q16/datafusion:vortex-file-compressed 🚨 553073005 421498883 1.31
tpch_q17/datafusion:vortex-file-compressed 🚨 1683241732 1242900003 1.35
tpch_q18/datafusion:vortex-file-compressed 1428790185 1276023476 1.12
tpch_q19/datafusion:vortex-file-compressed 🚨 1175989700 880019056 1.34
tpch_q20/datafusion:vortex-file-compressed 🚨 1280757545 879250454 1.46
tpch_q21/datafusion:vortex-file-compressed 1859534609 1600464724 1.16
tpch_q22/datafusion:vortex-file-compressed 🚨 787892296 404447065 1.95
datafusion / vortex-compact (1.068x ➖, 1↑ 5↓)
name PR 9a0f3ba (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 1007018682 702581755 1.43
tpch_q02/datafusion:vortex-compact 903862400 790351302 1.14
tpch_q03/datafusion:vortex-compact 🚨 1240982004 751089234 1.65
tpch_q04/datafusion:vortex-compact 🚨 717632165 528921638 1.36
tpch_q05/datafusion:vortex-compact 1109575508 982253515 1.13
tpch_q06/datafusion:vortex-compact 623429069 781883763 0.80
tpch_q07/datafusion:vortex-compact 🚀 1142448521 2341767239 0.49
tpch_q08/datafusion:vortex-compact 1472371303 1285657850 1.15
tpch_q09/datafusion:vortex-compact 1588156520 1356607607 1.17
tpch_q10/datafusion:vortex-compact 1279111225 1235262175 1.04
tpch_q11/datafusion:vortex-compact 604323632 828097569 0.73
tpch_q12/datafusion:vortex-compact 949561500 1292860516 0.73
tpch_q13/datafusion:vortex-compact 453796377 635167380 0.71
tpch_q14/datafusion:vortex-compact 655614021 822687816 0.80
tpch_q15/datafusion:vortex-compact 1133323132 985321821 1.15
tpch_q16/datafusion:vortex-compact 459182526 506138769 0.91
tpch_q17/datafusion:vortex-compact 1534072320 1253021039 1.22
tpch_q18/datafusion:vortex-compact 1547712393 1318695722 1.17
tpch_q19/datafusion:vortex-compact 954539441 1080914075 0.88
tpch_q20/datafusion:vortex-compact 🚨 2674279841 1046710304 2.55
tpch_q21/datafusion:vortex-compact 1912480699 1814654661 1.05
tpch_q22/datafusion:vortex-compact 🚨 1240239978 713062093 1.74
datafusion / parquet (1.253x ➖, 0↑ 9↓)
name PR 9a0f3ba (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 938746594 836977697 1.12
tpch_q02/datafusion:parquet 🚨 1168728432 738531151 1.58
tpch_q03/datafusion:parquet 1000175818 1011154528 0.99
tpch_q04/datafusion:parquet 🚨 812580499 508679977 1.60
tpch_q05/datafusion:parquet 🚨 1557508818 1088276653 1.43
tpch_q06/datafusion:parquet 598512318 536947030 1.11
tpch_q07/datafusion:parquet 🚨 1891484389 1239164893 1.53
tpch_q08/datafusion:parquet 🚨 2142618474 1564495302 1.37
tpch_q09/datafusion:parquet 2386019957 1845520920 1.29
tpch_q10/datafusion:parquet 2398693696 2140226729 1.12
tpch_q11/datafusion:parquet 634932354 653332872 0.97
tpch_q12/datafusion:parquet 802074659 742854172 1.08
tpch_q13/datafusion:parquet 1039484402 1038162732 1.00
tpch_q14/datafusion:parquet 🚨 1130849215 816712709 1.38
tpch_q15/datafusion:parquet 1707619552 1342567198 1.27
tpch_q16/datafusion:parquet 🚨 581705414 408956831 1.42
tpch_q17/datafusion:parquet 1673471951 1471117544 1.14
tpch_q18/datafusion:parquet 1795993750 1727827331 1.04
tpch_q19/datafusion:parquet 1007153014 903229750 1.12
tpch_q20/datafusion:parquet 🚨 2140118999 1195102457 1.79
tpch_q21/datafusion:parquet 2265118391 1855971158 1.22
tpch_q22/datafusion:parquet 🚨 1175982780 840258450 1.40
duckdb / vortex-file-compressed (0.989x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 688475565 666591362 1.03
tpch_q02/duckdb:vortex-file-compressed 1255543899 1325733478 0.95
tpch_q03/duckdb:vortex-file-compressed 1078771752 971344003 1.11
tpch_q04/duckdb:vortex-file-compressed 917518881 979369230 0.94
tpch_q05/duckdb:vortex-file-compressed 1269533446 1305074077 0.97
tpch_q06/duckdb:vortex-file-compressed 648558654 666576020 0.97
tpch_q07/duckdb:vortex-file-compressed 1330902216 1427476393 0.93
tpch_q08/duckdb:vortex-file-compressed 1565382428 1646216457 0.95
tpch_q09/duckdb:vortex-file-compressed 1940962438 1816063471 1.07
tpch_q10/duckdb:vortex-file-compressed 1326300651 1273845720 1.04
tpch_q11/duckdb:vortex-file-compressed 677193359 750859791 0.90
tpch_q12/duckdb:vortex-file-compressed 1390916317 1307943677 1.06
tpch_q13/duckdb:vortex-file-compressed 921781013 985229556 0.94
tpch_q14/duckdb:vortex-file-compressed 777360598 703855378 1.10
tpch_q15/duckdb:vortex-file-compressed 635234783 558374668 1.14
tpch_q16/duckdb:vortex-file-compressed 562584841 725722864 0.78
tpch_q17/duckdb:vortex-file-compressed 1081156297 1146320936 0.94
tpch_q18/duckdb:vortex-file-compressed 1093540615 1067047549 1.02
tpch_q19/duckdb:vortex-file-compressed 933092700 878852023 1.06
tpch_q20/duckdb:vortex-file-compressed 1460746641 1464551523 1.00
tpch_q21/duckdb:vortex-file-compressed 2231237456 2255404613 0.99
tpch_q22/duckdb:vortex-file-compressed 505722188 539659979 0.94
duckdb / vortex-compact (0.968x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 642593330 605378457 1.06
tpch_q02/duckdb:vortex-compact 1195112216 1294732537 0.92
tpch_q03/duckdb:vortex-compact 924143596 991669652 0.93
tpch_q04/duckdb:vortex-compact 757262239 671097737 1.13
tpch_q05/duckdb:vortex-compact 1259963311 1479974705 0.85
tpch_q06/duckdb:vortex-compact 640945965 606435436 1.06
tpch_q07/duckdb:vortex-compact 1394604513 1381782476 1.01
tpch_q08/duckdb:vortex-compact 1546084277 1588479335 0.97
tpch_q09/duckdb:vortex-compact 1801583510 1861738070 0.97
tpch_q10/duckdb:vortex-compact 1142003090 1348901417 0.85
tpch_q11/duckdb:vortex-compact 768338144 873726748 0.88
tpch_q12/duckdb:vortex-compact 1165376568 1258408876 0.93
tpch_q13/duckdb:vortex-compact 965850225 924387407 1.04
tpch_q14/duckdb:vortex-compact 743855249 770415961 0.97
tpch_q15/duckdb:vortex-compact 568512739 594304955 0.96
tpch_q16/duckdb:vortex-compact 493519304 458039791 1.08
tpch_q17/duckdb:vortex-compact 1021635655 1006588033 1.01
tpch_q18/duckdb:vortex-compact 906662639 960528057 0.94
tpch_q19/duckdb:vortex-compact 825324951 798351177 1.03
tpch_q20/duckdb:vortex-compact 1317854606 1362934371 0.97
tpch_q21/duckdb:vortex-compact 1927497520 1977235194 0.97
tpch_q22/duckdb:vortex-compact 491174903 593708711 0.83
duckdb / parquet (0.985x ➖, 0↑ 0↓)
name PR 9a0f3ba (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 979082168 1312627571 0.75
tpch_q02/duckdb:parquet 1436231773 1492176909 0.96
tpch_q03/duckdb:parquet 1982352716 1835294093 1.08
tpch_q04/duckdb:parquet 1303371521 1088048938 1.20
tpch_q05/duckdb:parquet 2090792162 2420790927 0.86
tpch_q06/duckdb:parquet 998682787 820241155 1.22
tpch_q07/duckdb:parquet 2127511844 2221223498 0.96
tpch_q08/duckdb:parquet 2737553411 2720693426 1.01
tpch_q09/duckdb:parquet 2801756812 2713890432 1.03
tpch_q10/duckdb:parquet 3413248182 3507739529 0.97
tpch_q11/duckdb:parquet 1008781410 969001658 1.04
tpch_q12/duckdb:parquet 1548844458 1425157251 1.09
tpch_q13/duckdb:parquet 1387134763 1492911183 0.93
tpch_q14/duckdb:parquet 1399378824 1543481170 0.91
tpch_q15/duckdb:parquet 1165398212 1199396339 0.97
tpch_q16/duckdb:parquet 897141006 1151841331 0.78
tpch_q17/duckdb:parquet 1511853683 1406759020 1.07
tpch_q18/duckdb:parquet 1766171717 1776725583 0.99
tpch_q19/duckdb:parquet 1524818229 1744781026 0.87
tpch_q20/duckdb:parquet 2546354476 2430264499 1.05
tpch_q21/duckdb:parquet 2052696336 1994186976 1.03
tpch_q22/duckdb:parquet 1245557482 1192839740 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +43.3% -8.5% +56.7% +49.6% 🚨 regression
1 datafusion:vortex-file-compressed +36.3% -8.5% +49.0% +61.3% ➖ noise
1 duckdb:vortex-compact +6.1% -8.5% +16.1% +43.1% ➖ noise
1 duckdb:vortex-file-compressed +3.3% -8.5% +12.9% +56.8% ➖ noise
2 datafusion:vortex-compact +14.4% +23.4% -7.3% +41.6% ➖ noise
2 datafusion:vortex-file-compressed +41.6% +23.4% +14.7% +46.4% ➖ noise
2 duckdb:vortex-compact -7.7% +23.4% -25.2% +34.5% ➖ noise
2 duckdb:vortex-file-compressed -5.3% +23.4% -23.3% +34.1% ➖ noise
3 datafusion:vortex-compact +65.2% +3.4% +59.8% +64.0% ➖ noise
3 datafusion:vortex-file-compressed -25.6% +3.4% -28.0% +60.9% ➖ noise
3 duckdb:vortex-compact -6.8% +3.4% -9.8% +49.2% ➖ noise
3 duckdb:vortex-file-compressed +11.1% +3.4% +7.4% +55.2% ➖ noise
4 datafusion:vortex-compact +35.7% +38.3% -1.9% +30.7% ➖ noise
4 datafusion:vortex-file-compressed +51.8% +38.3% +9.7% +40.4% ➖ noise
4 duckdb:vortex-compact +12.8% +38.3% -18.4% +30.7% ➖ noise
4 duckdb:vortex-file-compressed -6.3% +38.3% -32.3% +38.4% ✅ faster
5 datafusion:vortex-compact +13.0% +11.2% +1.6% +46.8% ➖ noise
5 datafusion:vortex-file-compressed +34.6% +11.2% +21.1% +38.2% ➖ noise
5 duckdb:vortex-compact -14.9% +11.2% -23.4% +68.2% ➖ noise
5 duckdb:vortex-file-compressed -2.7% +11.2% -12.5% +63.0% ➖ noise
6 datafusion:vortex-compact -20.3% +16.5% -31.6% +38.6% ✅ faster
6 datafusion:vortex-file-compressed +2.5% +16.5% -12.0% +30.7% ➖ noise
6 duckdb:vortex-compact +5.7% +16.5% -9.3% +30.7% ➖ noise
6 duckdb:vortex-file-compressed -2.7% +16.5% -16.5% +30.7% ➖ noise
7 datafusion:vortex-compact -51.2% +20.9% -59.7% +39.2% ✅ faster
7 datafusion:vortex-file-compressed +18.9% +20.9% -1.7% +30.7% ➖ noise
7 duckdb:vortex-compact +0.9% +20.9% -16.5% +30.7% ➖ noise
7 duckdb:vortex-file-compressed -6.8% +20.9% -22.9% +30.7% ➖ noise
8 datafusion:vortex-compact +14.5% +17.4% -2.4% +30.7% ➖ noise
8 datafusion:vortex-file-compressed +101.2% +17.4% +71.4% +40.9% 🚨 regression
8 duckdb:vortex-compact -2.7% +17.4% -17.1% +30.7% ➖ noise
8 duckdb:vortex-file-compressed -4.9% +17.4% -19.0% +30.7% ➖ noise
9 datafusion:vortex-compact +17.1% +15.5% +1.3% +30.7% ➖ noise
9 datafusion:vortex-file-compressed +13.6% +15.5% -1.7% +30.7% ➖ noise
9 duckdb:vortex-compact -3.2% +15.5% -16.2% +30.7% ➖ noise
9 duckdb:vortex-file-compressed +6.9% +15.5% -7.5% +30.7% ➖ noise
10 datafusion:vortex-compact +3.5% +4.4% -0.8% +38.1% ➖ noise
10 datafusion:vortex-file-compressed +11.0% +4.4% +6.3% +37.6% ➖ noise
10 duckdb:vortex-compact -15.3% +4.4% -18.9% +32.9% ➖ noise
10 duckdb:vortex-file-compressed +4.1% +4.4% -0.3% +41.8% ➖ noise
11 datafusion:vortex-compact -27.0% +0.6% -27.4% +35.8% ✅ faster
11 datafusion:vortex-file-compressed +9.3% +0.6% +8.7% +41.9% ➖ noise
11 duckdb:vortex-compact -12.1% +0.6% -12.6% +30.7% ➖ noise
11 duckdb:vortex-file-compressed -9.8% +0.6% -10.3% +30.7% ➖ noise
12 datafusion:vortex-compact -26.6% +8.3% -32.2% +30.7% ✅ faster
12 datafusion:vortex-file-compressed -22.6% +8.3% -28.6% +30.7% ✅ faster
12 duckdb:vortex-compact -7.4% +8.3% -14.5% +30.7% ➖ noise
12 duckdb:vortex-file-compressed +6.3% +8.3% -1.8% +30.7% ➖ noise
13 datafusion:vortex-compact -28.6% -3.5% -25.9% +33.5% ✅ faster
13 datafusion:vortex-file-compressed -3.3% -3.5% +0.3% +52.2% ➖ noise
13 duckdb:vortex-compact +4.5% -3.5% +8.3% +30.7% ➖ noise
13 duckdb:vortex-file-compressed -6.4% -3.5% -3.0% +31.1% ➖ noise
14 datafusion:vortex-compact -20.3% +12.0% -28.9% +30.7% ✅ faster
14 datafusion:vortex-file-compressed +32.2% +12.0% +18.0% +34.0% ➖ noise
14 duckdb:vortex-compact -3.4% +12.0% -13.8% +30.7% ➖ noise
14 duckdb:vortex-file-compressed +10.4% +12.0% -1.4% +30.7% ➖ noise
15 datafusion:vortex-compact +15.0% +11.2% +3.5% +32.0% ➖ noise
15 datafusion:vortex-file-compressed +8.5% +11.2% -2.4% +32.0% ➖ noise
15 duckdb:vortex-compact -4.3% +11.2% -14.0% +30.7% ➖ noise
15 duckdb:vortex-file-compressed +13.8% +11.2% +2.3% +30.7% ➖ noise
16 datafusion:vortex-compact -9.3% +5.3% -13.8% +46.2% ➖ noise
16 datafusion:vortex-file-compressed +31.2% +5.3% +24.7% +48.4% ➖ noise
16 duckdb:vortex-compact +7.7% +5.3% +2.4% +30.7% ➖ noise
16 duckdb:vortex-file-compressed -22.5% +5.3% -26.4% +36.4% ➖ noise
17 datafusion:vortex-compact +22.4% +10.6% +10.7% +30.7% ➖ noise
17 datafusion:vortex-file-compressed +35.4% +10.6% +22.5% +30.7% ➖ noise
17 duckdb:vortex-compact +1.5% +10.6% -8.2% +30.7% ➖ noise
17 duckdb:vortex-file-compressed -5.7% +10.6% -14.7% +30.7% ➖ noise
18 datafusion:vortex-compact +17.4% +1.7% +15.5% +30.7% ➖ noise
18 datafusion:vortex-file-compressed +12.0% +1.7% +10.2% +30.7% ➖ noise
18 duckdb:vortex-compact -5.6% +1.7% -7.1% +30.7% ➖ noise
18 duckdb:vortex-file-compressed +2.5% +1.7% +0.8% +30.7% ➖ noise
19 datafusion:vortex-compact -11.7% -1.3% -10.5% +52.8% ➖ noise
19 datafusion:vortex-file-compressed +33.6% -1.3% +35.4% +30.7% 🚨 regression
19 duckdb:vortex-compact +3.4% -1.3% +4.7% +30.7% ➖ noise
19 duckdb:vortex-file-compressed +6.2% -1.3% +7.6% +88.5% ➖ noise
20 datafusion:vortex-compact +155.5% +37.0% +86.5% +39.5% 🚨 regression
20 datafusion:vortex-file-compressed +45.7% +37.0% +6.3% +30.7% ➖ noise
20 duckdb:vortex-compact -3.3% +37.0% -29.4% +34.6% ✅ faster
20 duckdb:vortex-file-compressed -0.3% +37.0% -27.2% +30.7% ✅ faster
21 datafusion:vortex-compact +5.4% +12.1% -6.0% +31.3% ➖ noise
21 datafusion:vortex-file-compressed +16.2% +12.1% +3.7% +30.7% ➖ noise
21 duckdb:vortex-compact -2.5% +12.1% -13.0% +30.7% ➖ noise
21 duckdb:vortex-file-compressed -1.1% +12.1% -11.7% +30.7% ➖ noise
22 datafusion:vortex-compact +73.9% +20.9% +43.9% +51.6% ➖ noise
22 datafusion:vortex-file-compressed +94.8% +20.9% +61.1% +33.2% 🚨 regression
22 duckdb:vortex-compact -17.3% +20.9% -31.6% +106.7% ➖ noise
22 duckdb:vortex-file-compressed -6.3% +20.9% -22.5% +40.4% ➖ noise

@joseph-isaacs joseph-isaacs marked this pull request as ready for review June 4, 2026 15:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant