Skip to content

Explicit Precision::Absent variant instead of Option<Precision>#8042

Open
AdamGS wants to merge 9 commits into
developfrom
adamg/absent-precision-variant
Open

Explicit Precision::Absent variant instead of Option<Precision>#8042
AdamGS wants to merge 9 commits into
developfrom
adamg/absent-precision-variant

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented May 20, 2026

This PR adds a new Precision::Absent variant only after serialization because its a more idiomatic API. The serialization format is unchanged.

@AdamGS AdamGS added the changelog/feature A new feature label May 20, 2026
@AdamGS AdamGS changed the title Explicit abset Precision variant instead of Option<Precision> Explicit Precision::Absent variant instead of Option<Precision> May 20, 2026
@AdamGS AdamGS force-pushed the adamg/absent-precision-variant branch from a36f976 to a6f0110 Compare May 20, 2026 17:04
AdamGS added 5 commits May 20, 2026 18:21
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 20, 2026

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 1 improved benchmark
❌ 1 regressed benchmark
✅ 1235 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_varbinview_canonical_into[(100, 100)] 273.1 µs 308.8 µs -11.56%
Simulation chunked_varbinview_opt_canonical_into[(1000, 10)] 224.9 µs 188.2 µs +19.47%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing adamg/absent-precision-variant (5ebeb8b) with develop (19a1fb3)

Open in CodSpeed

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/absent-precision-variant branch from 4187154 to 024dacb Compare May 20, 2026 17:27
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label May 20, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 20, 2026
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS marked this pull request as ready for review May 20, 2026 17:31
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 5ebeb8b 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done 024dacb 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.967x ➖


datafusion / vortex-file-compressed (0.967x ➖, 1↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 120782925 126817457 0.95
polarsignals_q01/datafusion:vortex-file-compressed 293143644 312556831 0.94
polarsignals_q02/datafusion:vortex-file-compressed 🚀 23946260 26734188 0.90
polarsignals_q03/datafusion:vortex-file-compressed 309700333 287958073 1.08
polarsignals_q04/datafusion:vortex-file-compressed 13202383 12755006 1.04
polarsignals_q05/datafusion:vortex-file-compressed 17169024 18694174 0.92
polarsignals_q06/datafusion:vortex-file-compressed 18943270 19869010 0.95
polarsignals_q07/datafusion:vortex-file-compressed 15553804 15246886 1.02
polarsignals_q08/datafusion:vortex-file-compressed 415505826 446651203 0.93
polarsignals_q09/datafusion:vortex-file-compressed 10915925 11314180 0.96

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Vortex (geomean): 0.944x ➖
Parquet (geomean): 0.946x ➖
Shifts: Parquet (control) -5.4% · Median polish -4.4%


datafusion / vortex-file-compressed (0.961x ➖, 1↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 5094706 6197408 0.82
fineweb_q01/datafusion:vortex-file-compressed 20747562 21104201 0.98
fineweb_q02/datafusion:vortex-file-compressed 22747054 23299537 0.98
fineweb_q03/datafusion:vortex-file-compressed 80400024 78897221 1.02
fineweb_q04/datafusion:vortex-file-compressed 224233971 229149081 0.98
fineweb_q05/datafusion:vortex-file-compressed 216819843 216102663 1.00
fineweb_q06/datafusion:vortex-file-compressed 50801774 53647645 0.95
fineweb_q07/datafusion:vortex-file-compressed 57344123 56735410 1.01
fineweb_q08/datafusion:vortex-file-compressed 19893640 21504364 0.93
datafusion / vortex-compact (0.962x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 6113564 6464880 0.95
fineweb_q01/datafusion:vortex-compact 91775065 94567218 0.97
fineweb_q02/datafusion:vortex-compact 106464256 107806537 0.99
fineweb_q03/datafusion:vortex-compact 867622453 881447345 0.98
fineweb_q04/datafusion:vortex-compact 910512904 973714420 0.94
fineweb_q05/datafusion:vortex-compact 816231323 899171898 0.91
fineweb_q06/datafusion:vortex-compact 459426164 479235826 0.96
fineweb_q07/datafusion:vortex-compact 479585281 495521284 0.97
fineweb_q08/datafusion:vortex-compact 18968721 18919292 1.00
datafusion / parquet (0.941x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6128128 6685629 0.92
fineweb_q01/datafusion:parquet 283607972 309008253 0.92
fineweb_q02/datafusion:parquet 291593157 312738740 0.93
fineweb_q03/datafusion:parquet 297864162 310722515 0.96
fineweb_q04/datafusion:parquet 300615275 326359950 0.92
fineweb_q05/datafusion:parquet 295561585 317855560 0.93
fineweb_q06/datafusion:parquet 287360528 296488157 0.97
fineweb_q07/datafusion:parquet 290273697 293998073 0.99
fineweb_q08/datafusion:parquet 278794989 296728322 0.94
duckdb / vortex-file-compressed (0.936x ➖, 1↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3408798 3735223 0.91
fineweb_q01/duckdb:vortex-file-compressed 22039414 23544185 0.94
fineweb_q02/duckdb:vortex-file-compressed 24178311 25913005 0.93
fineweb_q03/duckdb:vortex-file-compressed 126012148 130503417 0.97
fineweb_q04/duckdb:vortex-file-compressed 217723981 226965259 0.96
fineweb_q05/duckdb:vortex-file-compressed 213351224 223608091 0.95
fineweb_q06/duckdb:vortex-file-compressed 🚀 53944385 60488287 0.89
fineweb_q07/duckdb:vortex-file-compressed 53424973 57440694 0.93
fineweb_q08/duckdb:vortex-file-compressed 21970039 23356846 0.94
duckdb / vortex-compact (0.920x ➖, 2↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 4104120 4638465 0.88
fineweb_q01/duckdb:vortex-compact 🚀 93376491 112512519 0.83
fineweb_q02/duckdb:vortex-compact 122795976 121288093 1.01
fineweb_q03/duckdb:vortex-compact 841820744 913648522 0.92
fineweb_q04/duckdb:vortex-compact 890403245 956310381 0.93
fineweb_q05/duckdb:vortex-compact 797629436 857750131 0.93
fineweb_q06/duckdb:vortex-compact 455714269 494007207 0.92
fineweb_q07/duckdb:vortex-compact 476626610 520969956 0.91
fineweb_q08/duckdb:vortex-compact 21187535 22492741 0.94
duckdb / parquet (0.950x ➖, 1↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚀 29803027 34109236 0.87
fineweb_q01/duckdb:parquet 84884048 93845298 0.90
fineweb_q02/duckdb:parquet 84455582 90261327 0.94
fineweb_q03/duckdb:parquet 315630550 331793745 0.95
fineweb_q04/duckdb:parquet 444170500 456591980 0.97
fineweb_q05/duckdb:parquet 416261791 423096668 0.98
fineweb_q06/duckdb:parquet 204227685 209198751 0.98
fineweb_q07/duckdb:parquet 214805442 220577264 0.97
fineweb_q08/duckdb:parquet 32596081 32994298 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -5.4% -10.5% +5.7% +73.6% ➖ noise
0 datafusion:vortex-file-compressed -17.8% -10.5% -8.1% +53.6% ➖ noise
0 duckdb:vortex-compact -11.5% -10.5% -1.1% +84.0% ➖ noise
0 duckdb:vortex-file-compressed -8.7% -10.5% +2.0% +74.3% ➖ noise
1 datafusion:vortex-compact -3.0% -8.9% +6.5% +21.6% ➖ noise
1 datafusion:vortex-file-compressed -1.7% -8.9% +7.9% +17.9% ➖ noise
1 duckdb:vortex-compact -17.0% -8.9% -8.9% +21.3% ➖ noise
1 duckdb:vortex-file-compressed -6.4% -8.9% +2.7% +70.2% ➖ noise
2 datafusion:vortex-compact -1.2% -6.6% +5.7% +14.3% ➖ noise
2 datafusion:vortex-file-compressed -2.4% -6.6% +4.5% +14.1% ➖ noise
2 duckdb:vortex-compact +1.2% -6.6% +8.4% +17.4% ➖ noise
2 duckdb:vortex-file-compressed -6.7% -6.6% -0.1% +11.1% ➖ noise
3 datafusion:vortex-compact -1.6% -4.5% +3.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +1.9% -4.5% +6.7% +36.1% ➖ noise
3 duckdb:vortex-compact -7.9% -4.5% -3.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -3.4% -4.5% +1.1% +31.9% ➖ noise
4 datafusion:vortex-compact -6.5% -5.3% -1.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.1% -5.3% +3.4% +10.0% ➖ noise
4 duckdb:vortex-compact -6.9% -5.3% -1.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -4.1% -5.3% +1.3% +10.0% ➖ noise
5 datafusion:vortex-compact -9.2% -4.4% -5.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.3% -4.4% +4.9% +10.0% ➖ noise
5 duckdb:vortex-compact -7.0% -4.4% -2.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.6% -4.4% -0.2% +10.0% ➖ noise
6 datafusion:vortex-compact -4.1% -2.7% -1.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -5.3% -2.7% -2.6% +10.0% ➖ noise
6 duckdb:vortex-compact -7.8% -2.7% -5.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -10.8% -2.7% -8.3% +19.2% ➖ noise
7 datafusion:vortex-compact -3.2% -1.9% -1.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +1.1% -1.9% +3.1% +15.4% ➖ noise
7 duckdb:vortex-compact -8.5% -1.9% -6.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -7.0% -1.9% -5.1% +10.0% ➖ noise
8 datafusion:vortex-compact +0.3% -3.7% +4.1% +15.8% ➖ noise
8 datafusion:vortex-file-compressed -7.5% -3.7% -4.0% +10.0% ➖ noise
8 duckdb:vortex-compact -5.8% -3.7% -2.2% +17.4% ➖ noise
8 duckdb:vortex-file-compressed -5.9% -3.7% -2.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Vortex (geomean): 1.054x ➖
Parquet (geomean): 1.057x ➖
Shifts: Parquet (control) +5.7% · Median polish +5.2%


datafusion / vortex-file-compressed (1.106x ❌, 0↑ 52↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨 27823421 24914939 1.12
tpcds_q02/datafusion:vortex-file-compressed 🚨 51656207 46464994 1.11
tpcds_q03/datafusion:vortex-file-compressed 🚨 17472362 15199906 1.15
tpcds_q04/datafusion:vortex-file-compressed 🚨 293027324 257819403 1.14
tpcds_q05/datafusion:vortex-file-compressed 45556201 42499517 1.07
tpcds_q06/datafusion:vortex-file-compressed 60621969 59684997 1.02
tpcds_q07/datafusion:vortex-file-compressed 48786469 44517378 1.10
tpcds_q08/datafusion:vortex-file-compressed 31100345 28568127 1.09
tpcds_q09/datafusion:vortex-file-compressed 41273429 38484022 1.07
tpcds_q10/datafusion:vortex-file-compressed 40912508 39025898 1.05
tpcds_q11/datafusion:vortex-file-compressed 🚨 150407005 135690226 1.11
tpcds_q12/datafusion:vortex-file-compressed 21276810 20172414 1.05
tpcds_q13/datafusion:vortex-file-compressed 42631716 39315109 1.08
tpcds_q14/datafusion:vortex-file-compressed 🚨 188283730 169971503 1.11
tpcds_q15/datafusion:vortex-file-compressed 🚨 31692991 27804480 1.14
tpcds_q16/datafusion:vortex-file-compressed 🚨 32609271 28067809 1.16
tpcds_q17/datafusion:vortex-file-compressed 69807120 64162962 1.09
tpcds_q18/datafusion:vortex-file-compressed 75781266 69569281 1.09
tpcds_q19/datafusion:vortex-file-compressed 🚨 24692728 22041984 1.12
tpcds_q20/datafusion:vortex-file-compressed 🚨 24132053 20404860 1.18
tpcds_q21/datafusion:vortex-file-compressed 🚨 38665345 34256584 1.13
tpcds_q22/datafusion:vortex-file-compressed 🚨 138190460 111686524 1.24
tpcds_q23/datafusion:vortex-file-compressed 🚨 168772667 147849549 1.14
tpcds_q24/datafusion:vortex-file-compressed 🚨 95839029 81905697 1.17
tpcds_q25/datafusion:vortex-file-compressed 71595914 66990321 1.07
tpcds_q26/datafusion:vortex-file-compressed 🚨 37493579 32997975 1.14
tpcds_q27/datafusion:vortex-file-compressed 🚨 121490471 103944321 1.17
tpcds_q28/datafusion:vortex-file-compressed 36132843 34280245 1.05
tpcds_q29/datafusion:vortex-file-compressed 🚨 68953480 61588856 1.12
tpcds_q30/datafusion:vortex-file-compressed 🚨 26348577 22523511 1.17
tpcds_q31/datafusion:vortex-file-compressed 🚨 80812813 73108313 1.11
tpcds_q32/datafusion:vortex-file-compressed 🚨 22820224 19766259 1.15
tpcds_q33/datafusion:vortex-file-compressed 🚨 32521429 29451433 1.10
tpcds_q34/datafusion:vortex-file-compressed 🚨 26863075 24070253 1.12
tpcds_q35/datafusion:vortex-file-compressed 49246529 45426859 1.08
tpcds_q36/datafusion:vortex-file-compressed 🚨 64051682 56958729 1.12
tpcds_q37/datafusion:vortex-file-compressed 🚨 28944181 23595749 1.23
tpcds_q38/datafusion:vortex-file-compressed 🚨 49002964 42552907 1.15
tpcds_q39/datafusion:vortex-file-compressed 🚨 114001000 103377060 1.10
tpcds_q40/datafusion:vortex-file-compressed 🚨 35934882 32300233 1.11
tpcds_q41/datafusion:vortex-file-compressed 🚨 17871053 15156276 1.18
tpcds_q42/datafusion:vortex-file-compressed 🚨 16157329 13614102 1.19
tpcds_q43/datafusion:vortex-file-compressed 20680296 18873295 1.10
tpcds_q44/datafusion:vortex-file-compressed 35747417 34754096 1.03
tpcds_q45/datafusion:vortex-file-compressed 29764123 27514962 1.08
tpcds_q46/datafusion:vortex-file-compressed 🚨 37799871 33518283 1.13
tpcds_q47/datafusion:vortex-file-compressed 🚨 146082020 130272649 1.12
tpcds_q48/datafusion:vortex-file-compressed 38724202 35434544 1.09
tpcds_q49/datafusion:vortex-file-compressed 🚨 64367956 55921497 1.15
tpcds_q50/datafusion:vortex-file-compressed 🚨 43511996 39105047 1.11
tpcds_q51/datafusion:vortex-file-compressed 94892253 86540982 1.10
tpcds_q52/datafusion:vortex-file-compressed 🚨 15996137 13872574 1.15
tpcds_q53/datafusion:vortex-file-compressed 🚨 23114230 20933502 1.10
tpcds_q54/datafusion:vortex-file-compressed 🚨 40124007 34560530 1.16
tpcds_q55/datafusion:vortex-file-compressed 🚨 15368247 13304250 1.16
tpcds_q56/datafusion:vortex-file-compressed 🚨 32885931 29872228 1.10
tpcds_q57/datafusion:vortex-file-compressed 115814193 109875152 1.05
tpcds_q58/datafusion:vortex-file-compressed 57694713 54192470 1.06
tpcds_q59/datafusion:vortex-file-compressed 60023461 55943319 1.07
tpcds_q60/datafusion:vortex-file-compressed 🚨 32398956 28956219 1.12
tpcds_q61/datafusion:vortex-file-compressed 47320503 43356798 1.09
tpcds_q62/datafusion:vortex-file-compressed 23744630 23035997 1.03
tpcds_q63/datafusion:vortex-file-compressed 23500972 21436940 1.10
tpcds_q64/datafusion:vortex-file-compressed 458665321 419502985 1.09
tpcds_q65/datafusion:vortex-file-compressed 44564357 40768935 1.09
tpcds_q66/datafusion:vortex-file-compressed 80791600 74588718 1.08
tpcds_q67/datafusion:vortex-file-compressed 159205907 147127754 1.08
tpcds_q68/datafusion:vortex-file-compressed 36092587 34794812 1.04
tpcds_q69/datafusion:vortex-file-compressed 40018023 36578994 1.09
tpcds_q70/datafusion:vortex-file-compressed 🚨 95170433 84275706 1.13
tpcds_q71/datafusion:vortex-file-compressed 🚨 27103884 23585950 1.15
tpcds_q72/datafusion:vortex-file-compressed 🚨 2376567587 2133737505 1.11
tpcds_q73/datafusion:vortex-file-compressed 25129959 22916308 1.10
tpcds_q74/datafusion:vortex-file-compressed 89033487 86994644 1.02
tpcds_q75/datafusion:vortex-file-compressed 117970376 107947611 1.09
tpcds_q76/datafusion:vortex-file-compressed 26051143 24863482 1.05
tpcds_q77/datafusion:vortex-file-compressed 43173266 40474373 1.07
tpcds_q78/datafusion:vortex-file-compressed 137298921 127085216 1.08
tpcds_q79/datafusion:vortex-file-compressed 30511120 29387991 1.04
tpcds_q80/datafusion:vortex-file-compressed 🚨 107595886 97614133 1.10
tpcds_q81/datafusion:vortex-file-compressed 25336112 23723603 1.07
tpcds_q82/datafusion:vortex-file-compressed 26987901 26229546 1.03
tpcds_q83/datafusion:vortex-file-compressed 36742532 33725871 1.09
tpcds_q84/datafusion:vortex-file-compressed 🚨 14468167 12658731 1.14
tpcds_q85/datafusion:vortex-file-compressed 🚨 100342566 90205007 1.11
tpcds_q86/datafusion:vortex-file-compressed 17622338 17620147 1.00
tpcds_q87/datafusion:vortex-file-compressed 48492569 44364927 1.09
tpcds_q88/datafusion:vortex-file-compressed 🚨 62715671 55852797 1.12
tpcds_q89/datafusion:vortex-file-compressed 26876194 25594626 1.05
tpcds_q90/datafusion:vortex-file-compressed 🚨 17552913 15231013 1.15
tpcds_q91/datafusion:vortex-file-compressed 🚨 20977820 18238758 1.15
tpcds_q92/datafusion:vortex-file-compressed 🚨 20246342 18167872 1.11
tpcds_q93/datafusion:vortex-file-compressed 🚨 38767420 33250457 1.17
tpcds_q94/datafusion:vortex-file-compressed 25021782 23510601 1.06
tpcds_q95/datafusion:vortex-file-compressed 66318366 61194336 1.08
tpcds_q96/datafusion:vortex-file-compressed 14993327 13999464 1.07
tpcds_q97/datafusion:vortex-file-compressed 🚨 36870792 30737469 1.20
tpcds_q98/datafusion:vortex-file-compressed 25800904 24495058 1.05
tpcds_q99/datafusion:vortex-file-compressed 🚨 34305985 28924601 1.19
datafusion / vortex-compact (1.030x ➖, 0↑ 13↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 27576598 25853034 1.07
tpcds_q02/datafusion:vortex-compact 59245100 54130585 1.09
tpcds_q03/datafusion:vortex-compact 21733817 20053814 1.08
tpcds_q04/datafusion:vortex-compact 329654060 323324791 1.02
tpcds_q05/datafusion:vortex-compact 53062169 54525844 0.97
tpcds_q06/datafusion:vortex-compact 63838385 63457802 1.01
tpcds_q07/datafusion:vortex-compact 59847686 61032670 0.98
tpcds_q08/datafusion:vortex-compact 41691522 38003371 1.10
tpcds_q09/datafusion:vortex-compact 55435485 57811177 0.96
tpcds_q10/datafusion:vortex-compact 54592657 53151659 1.03
tpcds_q11/datafusion:vortex-compact 170451133 167050657 1.02
tpcds_q12/datafusion:vortex-compact 28018010 28998910 0.97
tpcds_q13/datafusion:vortex-compact 131728545 128306556 1.03
tpcds_q14/datafusion:vortex-compact 213777631 222000754 0.96
tpcds_q15/datafusion:vortex-compact 32729770 34088059 0.96
tpcds_q16/datafusion:vortex-compact 34506046 35259304 0.98
tpcds_q17/datafusion:vortex-compact 79600342 81876576 0.97
tpcds_q18/datafusion:vortex-compact 84647183 87633926 0.97
tpcds_q19/datafusion:vortex-compact 30893369 32182505 0.96
tpcds_q20/datafusion:vortex-compact 27341683 28586959 0.96
tpcds_q21/datafusion:vortex-compact 41571443 45351737 0.92
tpcds_q22/datafusion:vortex-compact 138240449 133841487 1.03
tpcds_q23/datafusion:vortex-compact 182866127 181417641 1.01
tpcds_q24/datafusion:vortex-compact 106833064 108013698 0.99
tpcds_q25/datafusion:vortex-compact 83583289 84404952 0.99
tpcds_q26/datafusion:vortex-compact 49672891 46467679 1.07
tpcds_q27/datafusion:vortex-compact 🚨 137412639 123129394 1.12
tpcds_q28/datafusion:vortex-compact 102736494 99336260 1.03
tpcds_q29/datafusion:vortex-compact 80139139 75132090 1.07
tpcds_q30/datafusion:vortex-compact 30061946 28241797 1.06
tpcds_q31/datafusion:vortex-compact 103826385 99546414 1.04
tpcds_q32/datafusion:vortex-compact 27902779 27341043 1.02
tpcds_q33/datafusion:vortex-compact 39112788 37678288 1.04
tpcds_q34/datafusion:vortex-compact 35403433 33918188 1.04
tpcds_q35/datafusion:vortex-compact 55321962 52231161 1.06
tpcds_q36/datafusion:vortex-compact 79009512 80275999 0.98
tpcds_q37/datafusion:vortex-compact 36473248 34884220 1.05
tpcds_q38/datafusion:vortex-compact 55068800 51506621 1.07
tpcds_q39/datafusion:vortex-compact 128286071 121793933 1.05
tpcds_q40/datafusion:vortex-compact 39735623 43160766 0.92
tpcds_q41/datafusion:vortex-compact 19162171 18763741 1.02
tpcds_q42/datafusion:vortex-compact 19676387 18633527 1.06
tpcds_q43/datafusion:vortex-compact 26240275 26329768 1.00
tpcds_q44/datafusion:vortex-compact 50998618 50548545 1.01
tpcds_q45/datafusion:vortex-compact 33089875 34883041 0.95
tpcds_q46/datafusion:vortex-compact 46246633 47245292 0.98
tpcds_q47/datafusion:vortex-compact 161867891 167907920 0.96
tpcds_q48/datafusion:vortex-compact 84992828 84649174 1.00
tpcds_q49/datafusion:vortex-compact 73852655 75283778 0.98
tpcds_q50/datafusion:vortex-compact 50440165 52389690 0.96
tpcds_q51/datafusion:vortex-compact 100577788 103750413 0.97
tpcds_q52/datafusion:vortex-compact 19326942 21152134 0.91
tpcds_q53/datafusion:vortex-compact 30046098 30664985 0.98
tpcds_q54/datafusion:vortex-compact 45779196 45433272 1.01
tpcds_q55/datafusion:vortex-compact 19582130 20060587 0.98
tpcds_q56/datafusion:vortex-compact 39054142 39927188 0.98
tpcds_q57/datafusion:vortex-compact 127509989 125280546 1.02
tpcds_q58/datafusion:vortex-compact 69175685 70561751 0.98
tpcds_q59/datafusion:vortex-compact 72265237 74727648 0.97
tpcds_q60/datafusion:vortex-compact 37761273 39468077 0.96
tpcds_q61/datafusion:vortex-compact 58230500 60312301 0.97
tpcds_q62/datafusion:vortex-compact 29742763 27964380 1.06
tpcds_q63/datafusion:vortex-compact 32982238 30843613 1.07
tpcds_q64/datafusion:vortex-compact 490867336 532400518 0.92
tpcds_q65/datafusion:vortex-compact 56590813 60854793 0.93
tpcds_q66/datafusion:vortex-compact 79351740 82521123 0.96
tpcds_q67/datafusion:vortex-compact 166930913 175581765 0.95
tpcds_q68/datafusion:vortex-compact 47313353 48506105 0.98
tpcds_q69/datafusion:vortex-compact 50140982 48200865 1.04
tpcds_q70/datafusion:vortex-compact 103889561 99602028 1.04
tpcds_q71/datafusion:vortex-compact 🚨 32435033 29238680 1.11
tpcds_q72/datafusion:vortex-compact 🚨 2381846475 2118053263 1.12
tpcds_q73/datafusion:vortex-compact 31963243 30662254 1.04
tpcds_q74/datafusion:vortex-compact 🚨 103819349 88886456 1.17
tpcds_q75/datafusion:vortex-compact 137810954 129435253 1.06
tpcds_q76/datafusion:vortex-compact 🚨 35593786 31851006 1.12
tpcds_q77/datafusion:vortex-compact 🚨 57395716 49391882 1.16
tpcds_q78/datafusion:vortex-compact 152693711 139076597 1.10
tpcds_q79/datafusion:vortex-compact 40036757 37352921 1.07
tpcds_q80/datafusion:vortex-compact 114335100 107469685 1.06
tpcds_q81/datafusion:vortex-compact 30271403 27952348 1.08
tpcds_q82/datafusion:vortex-compact 36503290 33911848 1.08
tpcds_q83/datafusion:vortex-compact 35890796 32801524 1.09
tpcds_q84/datafusion:vortex-compact 15861866 15338554 1.03
tpcds_q85/datafusion:vortex-compact 165749760 159609724 1.04
tpcds_q86/datafusion:vortex-compact 19540753 19543048 1.00
tpcds_q87/datafusion:vortex-compact 🚨 57274253 50116104 1.14
tpcds_q88/datafusion:vortex-compact 85546589 77869728 1.10
tpcds_q89/datafusion:vortex-compact 🚨 34673805 30822322 1.12
tpcds_q90/datafusion:vortex-compact 🚨 16953277 14363031 1.18
tpcds_q91/datafusion:vortex-compact 35677366 32717001 1.09
tpcds_q92/datafusion:vortex-compact 🚨 27323977 24247954 1.13
tpcds_q93/datafusion:vortex-compact 🚨 42426941 38325591 1.11
tpcds_q94/datafusion:vortex-compact 🚨 32449120 26663268 1.22
tpcds_q95/datafusion:vortex-compact 70390412 64488820 1.09
tpcds_q96/datafusion:vortex-compact 18665725 17621813 1.06
tpcds_q97/datafusion:vortex-compact 🚨 40956412 35297148 1.16
tpcds_q98/datafusion:vortex-compact 32229100 29492856 1.09
tpcds_q99/datafusion:vortex-compact 36633409 34388901 1.07
datafusion / parquet (1.062x ➖, 0↑ 27↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 33716944 32342306 1.04
tpcds_q02/datafusion:parquet 43260377 41839159 1.03
tpcds_q03/datafusion:parquet 13701736 12927024 1.06
tpcds_q04/datafusion:parquet 283586285 274899202 1.03
tpcds_q05/datafusion:parquet 42961069 41736976 1.03
tpcds_q06/datafusion:parquet 60444120 59105525 1.02
tpcds_q07/datafusion:parquet 🚨 84635204 76530608 1.11
tpcds_q08/datafusion:parquet 28053540 26902947 1.04
tpcds_q09/datafusion:parquet 46475421 45120483 1.03
tpcds_q10/datafusion:parquet 74481151 68231340 1.09
tpcds_q11/datafusion:parquet 162151947 150655209 1.08
tpcds_q12/datafusion:parquet 19341626 18266599 1.06
tpcds_q13/datafusion:parquet 82123768 75076161 1.09
tpcds_q14/datafusion:parquet 170929518 165002498 1.04
tpcds_q15/datafusion:parquet 22918295 21601616 1.06
tpcds_q16/datafusion:parquet 25909437 26952757 0.96
tpcds_q17/datafusion:parquet 67485191 66131451 1.02
tpcds_q18/datafusion:parquet 121896553 114496268 1.06
tpcds_q19/datafusion:parquet 24203220 22514873 1.07
tpcds_q20/datafusion:parquet 18262299 17213517 1.06
tpcds_q21/datafusion:parquet 20263896 18655230 1.09
tpcds_q22/datafusion:parquet 🚨 169383830 151252574 1.12
tpcds_q23/datafusion:parquet 🚨 161892280 145423945 1.11
tpcds_q24/datafusion:parquet 97234590 91961029 1.06
tpcds_q25/datafusion:parquet 68423660 63529867 1.08
tpcds_q26/datafusion:parquet 69335224 66024173 1.05
tpcds_q27/datafusion:parquet 🚨 158681396 143312588 1.11
tpcds_q28/datafusion:parquet 46483444 44654256 1.04
tpcds_q29/datafusion:parquet 70812163 64456064 1.10
tpcds_q30/datafusion:parquet 36807400 33857561 1.09
tpcds_q31/datafusion:parquet 69614532 63725709 1.09
tpcds_q32/datafusion:parquet 19447479 17826964 1.09
tpcds_q33/datafusion:parquet 27897640 26815058 1.04
tpcds_q34/datafusion:parquet 🚨 23693174 21261051 1.11
tpcds_q35/datafusion:parquet 🚨 74063937 66454225 1.11
tpcds_q36/datafusion:parquet 60006924 55785143 1.08
tpcds_q37/datafusion:parquet 🚨 20211363 18345836 1.10
tpcds_q38/datafusion:parquet 43374788 40071091 1.08
tpcds_q39/datafusion:parquet 🚨 83157143 73006165 1.14
tpcds_q40/datafusion:parquet 🚨 27273187 23004655 1.19
tpcds_q41/datafusion:parquet 🚨 14941995 12981060 1.15
tpcds_q42/datafusion:parquet 🚨 12819867 11637251 1.10
tpcds_q43/datafusion:parquet 🚨 18486513 16731866 1.10
tpcds_q44/datafusion:parquet 🚨 35878437 32424252 1.11
tpcds_q45/datafusion:parquet 29604151 27775655 1.07
tpcds_q46/datafusion:parquet 34780571 31956420 1.09
tpcds_q47/datafusion:parquet 🚨 136753193 122650861 1.11
tpcds_q48/datafusion:parquet 72351947 69434174 1.04
tpcds_q49/datafusion:parquet 59271103 55883001 1.06
tpcds_q50/datafusion:parquet 🚨 47763655 42893149 1.11
tpcds_q51/datafusion:parquet 🚨 92119148 83691245 1.10
tpcds_q52/datafusion:parquet 🚨 13333646 11628276 1.15
tpcds_q53/datafusion:parquet 18365897 17165346 1.07
tpcds_q54/datafusion:parquet 36516471 33533269 1.09
tpcds_q55/datafusion:parquet 11961311 11027005 1.08
tpcds_q56/datafusion:parquet 29245767 27499151 1.06
tpcds_q57/datafusion:parquet 108844546 104076874 1.05
tpcds_q58/datafusion:parquet 🚨 55017190 48815883 1.13
tpcds_q59/datafusion:parquet 60037460 56697670 1.06
tpcds_q60/datafusion:parquet 28024589 27732123 1.01
tpcds_q61/datafusion:parquet 45201619 43192524 1.05
tpcds_q62/datafusion:parquet 21341795 19561836 1.09
tpcds_q63/datafusion:parquet 18786960 17395501 1.08
tpcds_q64/datafusion:parquet 541988157 518547438 1.05
tpcds_q65/datafusion:parquet 40746663 40273329 1.01
tpcds_q66/datafusion:parquet 🚨 73917124 64824935 1.14
tpcds_q67/datafusion:parquet 🚨 162536051 145551622 1.12
tpcds_q68/datafusion:parquet 34545322 31583067 1.09
tpcds_q69/datafusion:parquet 68699465 67183399 1.02
tpcds_q70/datafusion:parquet 92353926 94462249 0.98
tpcds_q71/datafusion:parquet 24027459 24339809 0.99
tpcds_q72/datafusion:parquet 672242616 710850737 0.95
tpcds_q73/datafusion:parquet 21701264 23178553 0.94
tpcds_q74/datafusion:parquet 90663971 92845929 0.98
tpcds_q75/datafusion:parquet 106647689 109779875 0.97
tpcds_q76/datafusion:parquet 32273849 33118060 0.97
tpcds_q77/datafusion:parquet 41212717 43138407 0.96
tpcds_q78/datafusion:parquet 124772380 127743412 0.98
tpcds_q79/datafusion:parquet 27289096 28784998 0.95
tpcds_q80/datafusion:parquet 85033918 89040703 0.96
tpcds_q81/datafusion:parquet 33711757 34263526 0.98
tpcds_q82/datafusion:parquet 20828834 21850816 0.95
tpcds_q83/datafusion:parquet 38962667 40543045 0.96
tpcds_q84/datafusion:parquet 43010747 40883525 1.05
tpcds_q85/datafusion:parquet 157546907 160856940 0.98
tpcds_q86/datafusion:parquet 16702812 17081896 0.98
tpcds_q87/datafusion:parquet 47078089 42951650 1.10
tpcds_q88/datafusion:parquet 62815440 61950078 1.01
tpcds_q89/datafusion:parquet 21871103 21454883 1.02
tpcds_q90/datafusion:parquet 🚨 15966759 14416215 1.11
tpcds_q91/datafusion:parquet 61519669 56666758 1.09
tpcds_q92/datafusion:parquet 🚨 21078306 17149624 1.23
tpcds_q93/datafusion:parquet 34810982 32254341 1.08
tpcds_q94/datafusion:parquet 🚨 21011261 18961771 1.11
tpcds_q95/datafusion:parquet 62149453 58923895 1.05
tpcds_q96/datafusion:parquet 🚨 13719017 11728159 1.17
tpcds_q97/datafusion:parquet 🚨 33145799 29950794 1.11
tpcds_q98/datafusion:parquet 🚨 23246416 20348616 1.14
tpcds_q99/datafusion:parquet 🚨 33681023 25428069 1.32
duckdb / vortex-file-compressed (1.024x ➖, 2↑ 14↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25264668 24889351 1.02
tpcds_q02/duckdb:vortex-file-compressed 36260194 35962352 1.01
tpcds_q03/duckdb:vortex-file-compressed 28129665 26759037 1.05
tpcds_q04/duckdb:vortex-file-compressed 107848435 98616817 1.09
tpcds_q05/duckdb:vortex-file-compressed 35326671 32493356 1.09
tpcds_q06/duckdb:vortex-file-compressed 36298580 34528311 1.05
tpcds_q07/duckdb:vortex-file-compressed 23339287 22052180 1.06
tpcds_q08/duckdb:vortex-file-compressed 29052381 26675734 1.09
tpcds_q09/duckdb:vortex-file-compressed 16686108 16366592 1.02
tpcds_q10/duckdb:vortex-file-compressed 40171055 37541179 1.07
tpcds_q11/duckdb:vortex-file-compressed 🚨 72853720 63916773 1.14
tpcds_q12/duckdb:vortex-file-compressed 17722093 16411916 1.08
tpcds_q13/duckdb:vortex-file-compressed 35569284 33761327 1.05
tpcds_q14/duckdb:vortex-file-compressed 103570348 97229239 1.07
tpcds_q15/duckdb:vortex-file-compressed 29477775 27386555 1.08
tpcds_q16/duckdb:vortex-file-compressed 28799129 26476511 1.09
tpcds_q17/duckdb:vortex-file-compressed 🚨 52590733 47079054 1.12
tpcds_q18/duckdb:vortex-file-compressed 🚨 42177853 37381030 1.13
tpcds_q19/duckdb:vortex-file-compressed 34502841 32726110 1.05
tpcds_q20/duckdb:vortex-file-compressed 🚨 18594113 16495916 1.13
tpcds_q21/duckdb:vortex-file-compressed 17580962 16241242 1.08
tpcds_q22/duckdb:vortex-file-compressed 🚨 87414214 74396456 1.17
tpcds_q23/duckdb:vortex-file-compressed 109945726 108438750 1.01
tpcds_q24/duckdb:vortex-file-compressed 52594702 48740604 1.08
tpcds_q25/duckdb:vortex-file-compressed 52715831 51752245 1.02
tpcds_q26/duckdb:vortex-file-compressed 20721825 19247190 1.08
tpcds_q27/duckdb:vortex-file-compressed 🚨 26538638 23576906 1.13
tpcds_q28/duckdb:vortex-file-compressed 13305878 13372401 1.00
tpcds_q29/duckdb:vortex-file-compressed 45719210 42873355 1.07
tpcds_q30/duckdb:vortex-file-compressed 27135408 25159005 1.08
tpcds_q31/duckdb:vortex-file-compressed 🚨 32243730 28880042 1.12
tpcds_q32/duckdb:vortex-file-compressed 🚨 16037856 14075647 1.14
tpcds_q33/duckdb:vortex-file-compressed 25499015 24077773 1.06
tpcds_q34/duckdb:vortex-file-compressed 25985461 25237895 1.03
tpcds_q35/duckdb:vortex-file-compressed 71424728 65762537 1.09
tpcds_q36/duckdb:vortex-file-compressed 26144002 25017817 1.05
tpcds_q37/duckdb:vortex-file-compressed 🚨 22137083 19925936 1.11
tpcds_q38/duckdb:vortex-file-compressed 39818636 37272094 1.07
tpcds_q39/duckdb:vortex-file-compressed 37274846 35836093 1.04
tpcds_q40/duckdb:vortex-file-compressed 🚨 23448166 19258368 1.22
tpcds_q41/duckdb:vortex-file-compressed 🚨 11663924 10174641 1.15
tpcds_q42/duckdb:vortex-file-compressed 🚨 14404206 12968101 1.11
tpcds_q43/duckdb:vortex-file-compressed 22138172 21297426 1.04
tpcds_q44/duckdb:vortex-file-compressed 23210988 21273194 1.09
tpcds_q45/duckdb:vortex-file-compressed 🚨 32710453 29104738 1.12
tpcds_q46/duckdb:vortex-file-compressed 33581517 31442483 1.07
tpcds_q47/duckdb:vortex-file-compressed 56658108 60836213 0.93
tpcds_q48/duckdb:vortex-file-compressed 32879487 32872847 1.00
tpcds_q49/duckdb:vortex-file-compressed 34585424 36797052 0.94
tpcds_q50/duckdb:vortex-file-compressed 31881204 34159338 0.93
tpcds_q51/duckdb:vortex-file-compressed 114783751 113601915 1.01
tpcds_q52/duckdb:vortex-file-compressed 13658374 14702356 0.93
tpcds_q53/duckdb:vortex-file-compressed 25058053 24654925 1.02
tpcds_q54/duckdb:vortex-file-compressed 32267578 32833206 0.98
tpcds_q55/duckdb:vortex-file-compressed 13499292 14550335 0.93
tpcds_q56/duckdb:vortex-file-compressed 27143784 27950578 0.97
tpcds_q57/duckdb:vortex-file-compressed 46109575 47242691 0.98
tpcds_q58/duckdb:vortex-file-compressed 32096693 32247818 1.00
tpcds_q59/duckdb:vortex-file-compressed 68489615 70835266 0.97
tpcds_q60/duckdb:vortex-file-compressed 27593051 28741515 0.96
tpcds_q61/duckdb:vortex-file-compressed 34891160 35186738 0.99
tpcds_q62/duckdb:vortex-file-compressed 17094187 17504422 0.98
tpcds_q63/duckdb:vortex-file-compressed 24162819 24004907 1.01
tpcds_q64/duckdb:vortex-file-compressed 112900730 118105175 0.96
tpcds_q65/duckdb:vortex-file-compressed 24248253 25045354 0.97
tpcds_q66/duckdb:vortex-file-compressed 30722043 31852151 0.96
tpcds_q67/duckdb:vortex-file-compressed 151831267 167877982 0.90
tpcds_q68/duckdb:vortex-file-compressed 33873882 37247145 0.91
tpcds_q69/duckdb:vortex-file-compressed 🚀 43878970 50814940 0.86
tpcds_q70/duckdb:vortex-file-compressed 40778700 39652678 1.03
tpcds_q71/duckdb:vortex-file-compressed 22504448 23125121 0.97
tpcds_q72/duckdb:vortex-file-compressed 175579888 181139161 0.97
tpcds_q73/duckdb:vortex-file-compressed 🚀 26275609 29814590 0.88
tpcds_q74/duckdb:vortex-file-compressed 46984208 48179411 0.98
tpcds_q75/duckdb:vortex-file-compressed 58017863 56076093 1.03
tpcds_q76/duckdb:vortex-file-compressed 20235309 22432805 0.90
tpcds_q77/duckdb:vortex-file-compressed 26346464 27863177 0.95
tpcds_q78/duckdb:vortex-file-compressed 86362236 89642564 0.96
tpcds_q79/duckdb:vortex-file-compressed 26977460 28914339 0.93
tpcds_q80/duckdb:vortex-file-compressed 50203461 49657918 1.01
tpcds_q81/duckdb:vortex-file-compressed 32700127 30849302 1.06
tpcds_q82/duckdb:vortex-file-compressed 48093809 46522335 1.03
tpcds_q83/duckdb:vortex-file-compressed 29298050 28197677 1.04
tpcds_q84/duckdb:vortex-file-compressed 21625526 21910189 0.99
tpcds_q85/duckdb:vortex-file-compressed 50376158 48057365 1.05
tpcds_q86/duckdb:vortex-file-compressed 18240638 17080872 1.07
tpcds_q87/duckdb:vortex-file-compressed 44848324 41103681 1.09
tpcds_q88/duckdb:vortex-file-compressed 🚨 55717510 50521875 1.10
tpcds_q89/duckdb:vortex-file-compressed 23766075 22060863 1.08
tpcds_q90/duckdb:vortex-file-compressed 11274391 11431466 0.99
tpcds_q91/duckdb:vortex-file-compressed 26499473 27938667 0.95
tpcds_q92/duckdb:vortex-file-compressed 21331416 23662973 0.90
tpcds_q93/duckdb:vortex-file-compressed 32469411 31909288 1.02
tpcds_q94/duckdb:vortex-file-compressed 24144464 24126425 1.00
tpcds_q95/duckdb:vortex-file-compressed 159583140 171676865 0.93
tpcds_q96/duckdb:vortex-file-compressed 12923051 12931965 1.00
tpcds_q97/duckdb:vortex-file-compressed 43993026 46141822 0.95
tpcds_q98/duckdb:vortex-file-compressed 22476060 21709907 1.04
tpcds_q99/duckdb:vortex-file-compressed 28587865 28539325 1.00
duckdb / vortex-compact (1.057x ➖, 0↑ 23↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 28325286 29856862 0.95
tpcds_q02/duckdb:vortex-compact 41325009 42424201 0.97
tpcds_q03/duckdb:vortex-compact 50541545 51578140 0.98
tpcds_q04/duckdb:vortex-compact 120134736 122390582 0.98
tpcds_q05/duckdb:vortex-compact 47240714 45457215 1.04
tpcds_q06/duckdb:vortex-compact 42401446 44527544 0.95
tpcds_q07/duckdb:vortex-compact 37921608 39176292 0.97
tpcds_q08/duckdb:vortex-compact 45017148 43057426 1.05
tpcds_q09/duckdb:vortex-compact 20701394 21393302 0.97
tpcds_q10/duckdb:vortex-compact 57538989 59718907 0.96
tpcds_q11/duckdb:vortex-compact 81638116 80493269 1.01
tpcds_q12/duckdb:vortex-compact 23914499 24409990 0.98
tpcds_q13/duckdb:vortex-compact 56449913 56138666 1.01
tpcds_q14/duckdb:vortex-compact 124316613 128604076 0.97
tpcds_q15/duckdb:vortex-compact 33239916 34228131 0.97
tpcds_q16/duckdb:vortex-compact 32176604 30061594 1.07
tpcds_q17/duckdb:vortex-compact 60994714 61529266 0.99
tpcds_q18/duckdb:vortex-compact 56143253 54941332 1.02
tpcds_q19/duckdb:vortex-compact 46920351 45422054 1.03
tpcds_q20/duckdb:vortex-compact 23242883 22187198 1.05
tpcds_q21/duckdb:vortex-compact 20463023 21084810 0.97
tpcds_q22/duckdb:vortex-compact 🚨 89838277 78888637 1.14
tpcds_q23/duckdb:vortex-compact 134332593 138637777 0.97
tpcds_q24/duckdb:vortex-compact 60341841 57920058 1.04
tpcds_q25/duckdb:vortex-compact 85251271 85518723 1.00
tpcds_q26/duckdb:vortex-compact 32789367 32263032 1.02
tpcds_q27/duckdb:vortex-compact 38196232 36167184 1.06
tpcds_q28/duckdb:vortex-compact 35323097 34793881 1.02
tpcds_q29/duckdb:vortex-compact 59848907 55124917 1.09
tpcds_q30/duckdb:vortex-compact 31528448 29477186 1.07
tpcds_q31/duckdb:vortex-compact 39046870 35822147 1.09
tpcds_q32/duckdb:vortex-compact 🚨 22796193 20623982 1.11
tpcds_q33/duckdb:vortex-compact 🚨 36481533 32018221 1.14
tpcds_q34/duckdb:vortex-compact 32582781 30727941 1.06
tpcds_q35/duckdb:vortex-compact 81731772 75909751 1.08
tpcds_q36/duckdb:vortex-compact 37383379 36062909 1.04
tpcds_q37/duckdb:vortex-compact 🚨 26371205 23152152 1.14
tpcds_q38/duckdb:vortex-compact 🚨 44961657 39769249 1.13
tpcds_q39/duckdb:vortex-compact 40419464 39823076 1.01
tpcds_q40/duckdb:vortex-compact 🚨 26503331 23601717 1.12
tpcds_q41/duckdb:vortex-compact 12866709 11835535 1.09
tpcds_q42/duckdb:vortex-compact 20854460 19516626 1.07
tpcds_q43/duckdb:vortex-compact 🚨 33857557 29816703 1.14
tpcds_q44/duckdb:vortex-compact 31219416 29736513 1.05
tpcds_q45/duckdb:vortex-compact 🚨 41186032 35599299 1.16
tpcds_q46/duckdb:vortex-compact 50780034 47066882 1.08
tpcds_q47/duckdb:vortex-compact 68511617 63632088 1.08
tpcds_q48/duckdb:vortex-compact 🚨 50574976 45889969 1.10
tpcds_q49/duckdb:vortex-compact 53852747 49404924 1.09
tpcds_q50/duckdb:vortex-compact 39932498 38546332 1.04
tpcds_q51/duckdb:vortex-compact 118607795 111854732 1.06
tpcds_q52/duckdb:vortex-compact 19717100 20383440 0.97
tpcds_q53/duckdb:vortex-compact 34484263 32947096 1.05
tpcds_q54/duckdb:vortex-compact 🚨 41343161 36172991 1.14
tpcds_q55/duckdb:vortex-compact 19751669 18379323 1.07
tpcds_q56/duckdb:vortex-compact 34904157 33211858 1.05
tpcds_q57/duckdb:vortex-compact 49124211 45665952 1.08
tpcds_q58/duckdb:vortex-compact 🚨 41603605 37033186 1.12
tpcds_q59/duckdb:vortex-compact 86926907 87850429 0.99
tpcds_q60/duckdb:vortex-compact 38233835 35179695 1.09
tpcds_q61/duckdb:vortex-compact 56496304 53108953 1.06
tpcds_q62/duckdb:vortex-compact 22439030 20592500 1.09
tpcds_q63/duckdb:vortex-compact 34036389 32210178 1.06
tpcds_q64/duckdb:vortex-compact 140383873 134592732 1.04
tpcds_q65/duckdb:vortex-compact 33366787 31681199 1.05
tpcds_q66/duckdb:vortex-compact 37263564 35366787 1.05
tpcds_q67/duckdb:vortex-compact 160791793 151154461 1.06
tpcds_q68/duckdb:vortex-compact 47051782 46392576 1.01
tpcds_q69/duckdb:vortex-compact 59239956 55144305 1.07
tpcds_q70/duckdb:vortex-compact 60863132 57643866 1.06
tpcds_q71/duckdb:vortex-compact 29860273 29061002 1.03
tpcds_q72/duckdb:vortex-compact 196430269 183757210 1.07
tpcds_q73/duckdb:vortex-compact 🚨 31002465 27978063 1.11
tpcds_q74/duckdb:vortex-compact 50978862 49874640 1.02
tpcds_q75/duckdb:vortex-compact 🚨 66895704 60050547 1.11
tpcds_q76/duckdb:vortex-compact 🚨 32590674 29557820 1.10
tpcds_q77/duckdb:vortex-compact 38385930 38674831 0.99
tpcds_q78/duckdb:vortex-compact 95306076 91169400 1.05
tpcds_q79/duckdb:vortex-compact 43389222 40980033 1.06
tpcds_q80/duckdb:vortex-compact 73495813 69438224 1.06
tpcds_q81/duckdb:vortex-compact 🚨 38133397 33224722 1.15
tpcds_q82/duckdb:vortex-compact 53339677 48942633 1.09
tpcds_q83/duckdb:vortex-compact 🚨 43061638 36836547 1.17
tpcds_q84/duckdb:vortex-compact 29536494 27515892 1.07
tpcds_q85/duckdb:vortex-compact 🚨 68255173 60155378 1.13
tpcds_q86/duckdb:vortex-compact 23119975 22064878 1.05
tpcds_q87/duckdb:vortex-compact 49117957 45986647 1.07
tpcds_q88/duckdb:vortex-compact 81132187 76916575 1.05
tpcds_q89/duckdb:vortex-compact 35824335 32683186 1.10
tpcds_q90/duckdb:vortex-compact 🚨 12174945 10791333 1.13
tpcds_q91/duckdb:vortex-compact 46633737 42799984 1.09
tpcds_q92/duckdb:vortex-compact 43984367 42530674 1.03
tpcds_q93/duckdb:vortex-compact 🚨 38346357 32556200 1.18
tpcds_q94/duckdb:vortex-compact 🚨 29811062 26649083 1.12
tpcds_q95/duckdb:vortex-compact 🚨 170495775 150876584 1.13
tpcds_q96/duckdb:vortex-compact 17712946 16236163 1.09
tpcds_q97/duckdb:vortex-compact 🚨 45598975 41225999 1.11
tpcds_q98/duckdb:vortex-compact 🚨 30074917 26606339 1.13
tpcds_q99/duckdb:vortex-compact 30563456 29514783 1.04
duckdb / parquet (1.051x ➖, 0↑ 6↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 31138081 29102905 1.07
tpcds_q02/duckdb:parquet 25141135 24615559 1.02
tpcds_q03/duckdb:parquet 13665028 12793001 1.07
tpcds_q04/duckdb:parquet 176217416 169154715 1.04
tpcds_q05/duckdb:parquet 32598594 33297671 0.98
tpcds_q06/duckdb:parquet 35209270 33587497 1.05
tpcds_q07/duckdb:parquet 25263362 24152229 1.05
tpcds_q08/duckdb:parquet 31308821 29715360 1.05
tpcds_q09/duckdb:parquet 45215392 44402979 1.02
tpcds_q10/duckdb:parquet 40141606 38347352 1.05
tpcds_q11/duckdb:parquet 96322916 92546267 1.04
tpcds_q12/duckdb:parquet 18090931 17294997 1.05
tpcds_q13/duckdb:parquet 36266758 35293720 1.03
tpcds_q14/duckdb:parquet 101724365 103881676 0.98
tpcds_q15/duckdb:parquet 33238415 30387593 1.09
tpcds_q16/duckdb:parquet 24473397 22581574 1.08
tpcds_q17/duckdb:parquet 41198129 40760347 1.01
tpcds_q18/duckdb:parquet 50424374 47693345 1.06
tpcds_q19/duckdb:parquet 33329124 31987944 1.04
tpcds_q20/duckdb:parquet 20100017 18693219 1.08
tpcds_q21/duckdb:parquet 12508210 11578402 1.08
tpcds_q22/duckdb:parquet 79152497 72339232 1.09
tpcds_q23/duckdb:parquet 86471060 80747666 1.07
tpcds_q24/duckdb:parquet 51229057 47160224 1.09
tpcds_q25/duckdb:parquet 37896630 35324875 1.07
tpcds_q26/duckdb:parquet 43191768 39425391 1.10
tpcds_q27/duckdb:parquet 56506128 52833373 1.07
tpcds_q28/duckdb:parquet 44124300 42120253 1.05
tpcds_q29/duckdb:parquet 39054290 42196609 0.93
tpcds_q30/duckdb:parquet 39842488 37463425 1.06
tpcds_q31/duckdb:parquet 28499735 28784133 0.99
tpcds_q32/duckdb:parquet 13614547 12396464 1.10
tpcds_q33/duckdb:parquet 24983059 24294171 1.03
tpcds_q34/duckdb:parquet 23993807 23077470 1.04
tpcds_q35/duckdb:parquet 65511636 61892720 1.06
tpcds_q36/duckdb:parquet 23317365 23068542 1.01
tpcds_q37/duckdb:parquet 🚨 16049773 13955966 1.15
tpcds_q38/duckdb:parquet 38641333 37167043 1.04
tpcds_q39/duckdb:parquet 33070076 32313284 1.02
tpcds_q40/duckdb:parquet 🚨 22067659 19752697 1.12
tpcds_q41/duckdb:parquet 9620076 8750152 1.10
tpcds_q42/duckdb:parquet 12712040 12337270 1.03
tpcds_q43/duckdb:parquet 🚨 19151682 17315889 1.11
tpcds_q44/duckdb:parquet 26839983 26041083 1.03
tpcds_q45/duckdb:parquet 30906393 28721545 1.08
tpcds_q46/duckdb:parquet 52464562 47858236 1.10
tpcds_q47/duckdb:parquet 52560512 49666849 1.06
tpcds_q48/duckdb:parquet 33791153 32093961 1.05
tpcds_q49/duckdb:parquet 29835972 29173762 1.02
tpcds_q50/duckdb:parquet 27419644 26222356 1.05
tpcds_q51/duckdb:parquet 115960893 105671018 1.10
tpcds_q52/duckdb:parquet 12788662 12438703 1.03
tpcds_q53/duckdb:parquet 19581485 19344597 1.01
tpcds_q54/duckdb:parquet 30984915 29158947 1.06
tpcds_q55/duckdb:parquet 13229973 12788205 1.03
tpcds_q56/duckdb:parquet 25170305 23945302 1.05
tpcds_q57/duckdb:parquet 40448382 39185339 1.03
tpcds_q58/duckdb:parquet 27846669 25631592 1.09
tpcds_q59/duckdb:parquet 37715844 36864225 1.02
tpcds_q60/duckdb:parquet 27097858 25044016 1.08
tpcds_q61/duckdb:parquet 34893595 33136273 1.05
tpcds_q62/duckdb:parquet 13495654 12634636 1.07
tpcds_q63/duckdb:parquet 18524556 17768110 1.04
tpcds_q64/duckdb:parquet 82461990 76701757 1.08
tpcds_q65/duckdb:parquet 23523547 22269564 1.06
tpcds_q66/duckdb:parquet 🚨 34250008 29679129 1.15
tpcds_q67/duckdb:parquet 149304224 139015844 1.07
tpcds_q68/duckdb:parquet 39989463 38802988 1.03
tpcds_q69/duckdb:parquet 39663688 39323779 1.01
tpcds_q70/duckdb:parquet 23672793 22507272 1.05
tpcds_q71/duckdb:parquet 24113387 24581687 0.98
tpcds_q72/duckdb:parquet 169421121 168541888 1.01
tpcds_q73/duckdb:parquet 20652524 19859875 1.04
tpcds_q74/duckdb:parquet 131971191 127514285 1.03
tpcds_q75/duckdb:parquet 61826255 56722469 1.09
tpcds_q76/duckdb:parquet 22886521 22024697 1.04
tpcds_q77/duckdb:parquet 26810023 25418260 1.05
tpcds_q78/duckdb:parquet 82171028 78446722 1.05
tpcds_q79/duckdb:parquet 31310058 30557784 1.02
tpcds_q80/duckdb:parquet 45664713 44777939 1.02
tpcds_q81/duckdb:parquet 37421241 35375227 1.06
tpcds_q82/duckdb:parquet 18412937 18942428 0.97
tpcds_q83/duckdb:parquet 19757851 18511474 1.07
tpcds_q84/duckdb:parquet 21861756 21057918 1.04
tpcds_q85/duckdb:parquet 44872637 42289657 1.06
tpcds_q86/duckdb:parquet 14414699 13887226 1.04
tpcds_q87/duckdb:parquet 41294971 40278788 1.03
tpcds_q88/duckdb:parquet 54311118 53660898 1.01
tpcds_q89/duckdb:parquet 21275952 21560066 0.99
tpcds_q90/duckdb:parquet 9019090 8553363 1.05
tpcds_q91/duckdb:parquet 27266705 24902358 1.09
tpcds_q92/duckdb:parquet 14271376 13502229 1.06
tpcds_q93/duckdb:parquet 🚨 35388069 31983040 1.11
tpcds_q94/duckdb:parquet 19599661 18307286 1.07
tpcds_q95/duckdb:parquet 🚨 162976830 134172200 1.21
tpcds_q96/duckdb:parquet 11189190 10748228 1.04
tpcds_q97/duckdb:parquet 41290460 37834328 1.09
tpcds_q98/duckdb:parquet 24952473 24879170 1.00
tpcds_q99/duckdb:parquet 21320249 20284351 1.05
duckdb / duckdb (1.058x ➖, 0↑ 16↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 23523529 24055768 0.98
tpcds_q02/duckdb:duckdb 20182200 20316124 0.99
tpcds_q03/duckdb:duckdb 11399511 10591283 1.08
tpcds_q04/duckdb:duckdb 187504401 175796993 1.07
tpcds_q05/duckdb:duckdb 🚨 22614702 20274193 1.12
tpcds_q06/duckdb:duckdb 30191716 28017214 1.08
tpcds_q07/duckdb:duckdb 43178952 40687402 1.06
tpcds_q08/duckdb:duckdb 121896124 120038876 1.02
tpcds_q09/duckdb:duckdb 21670182 20497113 1.06
tpcds_q10/duckdb:duckdb 30005636 28012812 1.07
tpcds_q11/duckdb:duckdb 94597248 94489645 1.00
tpcds_q12/duckdb:duckdb 14796035 14120029 1.05
tpcds_q13/duckdb:duckdb 27473889 26369698 1.04
tpcds_q14/duckdb:duckdb 96763503 93946198 1.03
tpcds_q15/duckdb:duckdb 🚨 26780272 24120842 1.11
tpcds_q16/duckdb:duckdb 20621714 19089401 1.08
tpcds_q17/duckdb:duckdb 26135085 26471313 0.99
tpcds_q18/duckdb:duckdb 51272999 48696736 1.05
tpcds_q19/duckdb:duckdb 🚨 21149642 19027081 1.11
tpcds_q20/duckdb:duckdb 15418099 14270090 1.08
tpcds_q21/duckdb:duckdb 🚨 8376676 7477143 1.12
tpcds_q22/duckdb:duckdb 68520504 64284929 1.07
tpcds_q23/duckdb:duckdb 78441611 76439134 1.03
tpcds_q24/duckdb:duckdb 27504323 25116259 1.10
tpcds_q25/duckdb:duckdb 20415468 18704797 1.09
tpcds_q26/duckdb:duckdb 30887484 28589769 1.08
tpcds_q27/duckdb:duckdb 44207173 41389555 1.07
tpcds_q28/duckdb:duckdb 25482083 26072662 0.98
tpcds_q29/duckdb:duckdb 25405658 24164743 1.05
tpcds_q30/duckdb:duckdb 33145486 31203824 1.06
tpcds_q31/duckdb:duckdb 56382569 51396055 1.10
tpcds_q32/duckdb:duckdb 🚨 9037888 7907741 1.14
tpcds_q33/duckdb:duckdb 16279589 16351005 1.00
tpcds_q34/duckdb:duckdb 18836299 18477802 1.02
tpcds_q35/duckdb:duckdb 39754521 36876906 1.08
tpcds_q36/duckdb:duckdb 🚨 78743789 69911441 1.13
tpcds_q37/duckdb:duckdb 🚨 9945905 8949367 1.11
tpcds_q38/duckdb:duckdb 34776469 32760500 1.06
tpcds_q39/duckdb:duckdb 🚨 34375598 30071305 1.14
tpcds_q40/duckdb:duckdb 🚨 16472119 14584490 1.13
tpcds_q41/duckdb:duckdb 🚨 11066642 9261729 1.19
tpcds_q42/duckdb:duckdb 🚨 11431382 8533169 1.34
tpcds_q43/duckdb:duckdb 14357472 15061459 0.95
tpcds_q44/duckdb:duckdb 15816479 15578437 1.02
tpcds_q45/duckdb:duckdb 🚨 20604435 18343871 1.12
tpcds_q46/duckdb:duckdb 🚨 41843999 37855762 1.11
tpcds_q47/duckdb:duckdb 48986075 45068128 1.09
tpcds_q48/duckdb:duckdb 25868620 24617012 1.05
tpcds_q49/duckdb:duckdb 22010487 22056696 1.00
tpcds_q50/duckdb:duckdb 17488895 16000252 1.09
tpcds_q51/duckdb:duckdb 105599202 100731102 1.05
tpcds_q52/duckdb:duckdb 10034795 9297834 1.08
tpcds_q53/duckdb:duckdb 18687993 17690242 1.06
tpcds_q54/duckdb:duckdb 20592444 19582631 1.05
tpcds_q55/duckdb:duckdb 9993739 9668187 1.03
tpcds_q56/duckdb:duckdb 17334258 17462203 0.99
tpcds_q57/duckdb:duckdb 38554652 36361753 1.06
tpcds_q58/duckdb:duckdb 17517807 17907959 0.98
tpcds_q59/duckdb:duckdb 39061712 36884539 1.06
tpcds_q60/duckdb:duckdb 19007637 18339437 1.04
tpcds_q61/duckdb:duckdb 17660492 16379229 1.08
tpcds_q62/duckdb:duckdb 10749250 9981271 1.08
tpcds_q63/duckdb:duckdb 17231701 16574637 1.04
tpcds_q64/duckdb:duckdb 60867250 58168006 1.05
tpcds_q65/duckdb:duckdb 39362300 36249683 1.09
tpcds_q66/duckdb:duckdb 28407242 26313825 1.08
tpcds_q67/duckdb:duckdb 140928377 133833415 1.05
tpcds_q68/duckdb:duckdb 28304410 28534059 0.99
tpcds_q69/duckdb:duckdb 29548692 28932208 1.02
tpcds_q70/duckdb:duckdb 17020840 17293437 0.98
tpcds_q71/duckdb:duckdb 17373212 16370724 1.06
tpcds_q72/duckdb:duckdb 47995966 46639893 1.03
tpcds_q73/duckdb:duckdb 14267800 14326294 1.00
tpcds_q74/duckdb:duckdb 152439852 149077905 1.02
tpcds_q75/duckdb:duckdb 🚨 51085205 45940591 1.11
tpcds_q76/duckdb:duckdb 15863061 14871101 1.07
tpcds_q77/duckdb:duckdb 16283559 15721921 1.04
tpcds_q78/duckdb:duckdb 🚨 73375963 66232199 1.11
tpcds_q79/duckdb:duckdb 21507775 20418437 1.05
tpcds_q80/duckdb:duckdb 35156241 32647637 1.08
tpcds_q81/duckdb:duckdb 43458215 41962193 1.04
tpcds_q82/duckdb:duckdb 🚨 11978974 10762780 1.11
tpcds_q83/duckdb:duckdb 11741920 10990957 1.07
tpcds_q84/duckdb:duckdb 16006868 14951211 1.07
tpcds_q85/duckdb:duckdb 28901375 26344701 1.10
tpcds_q86/duckdb:duckdb 13042026 12517237 1.04
tpcds_q87/duckdb:duckdb 37618831 37537184 1.00
tpcds_q88/duckdb:duckdb 30276663 31016533 0.98
tpcds_q89/duckdb:duckdb 22696905 22357058 1.02
tpcds_q90/duckdb:duckdb 6871983 6444582 1.07
tpcds_q91/duckdb:duckdb 16044627 14863131 1.08
tpcds_q92/duckdb:duckdb 10848814 10711194 1.01
tpcds_q93/duckdb:duckdb 26409657 24330650 1.09
tpcds_q94/duckdb:duckdb 15599744 14832412 1.05
tpcds_q95/duckdb:duckdb 132927178 134334315 0.99
tpcds_q96/duckdb:duckdb 6124377 5974503 1.03
tpcds_q97/duckdb:duckdb 34564326 32635987 1.06
tpcds_q98/duckdb:duckdb 21496971 20875654 1.03
tpcds_q99/duckdb:duckdb 17885813 17104624 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +6.7% +5.6% +1.0% +18.9% ➖ noise
1 datafusion:vortex-file-compressed +11.7% +5.6% +5.7% +20.2% ➖ noise
1 duckdb:duckdb -2.2% +5.6% -7.4% +19.8% ➖ noise
1 duckdb:vortex-compact -5.1% +5.6% -10.2% +24.4% ➖ noise
1 duckdb:vortex-file-compressed +1.5% +5.6% -3.9% +26.2% ➖ noise
2 datafusion:vortex-compact +9.4% +2.8% +6.5% +10.5% ➖ noise
2 datafusion:vortex-file-compressed +11.2% +2.8% +8.2% +10.5% ➖ noise
2 duckdb:duckdb -0.7% +2.8% -3.3% +10.5% ➖ noise
2 duckdb:vortex-compact -2.6% +2.8% -5.2% +37.5% ➖ noise
2 duckdb:vortex-file-compressed +0.8% +2.8% -1.9% +23.5% ➖ noise
3 datafusion:vortex-compact +8.4% +6.4% +1.9% +18.9% ➖ noise
3 datafusion:vortex-file-compressed +15.0% +6.4% +8.0% +10.5% ➖ noise
3 duckdb:duckdb +7.6% +6.4% +1.2% +10.5% ➖ noise
3 duckdb:vortex-compact -2.0% +6.4% -7.9% +10.5% ➖ noise
3 duckdb:vortex-file-compressed +5.1% +6.4% -1.2% +10.5% ➖ noise
4 datafusion:vortex-compact +2.0% +3.7% -1.6% +10.5% ➖ noise
4 datafusion:vortex-file-compressed +13.7% +3.7% +9.6% +12.1% ➖ noise
4 duckdb:duckdb +6.7% +3.7% +2.9% +10.5% ➖ noise
4 duckdb:vortex-compact -1.8% +3.7% -5.3% +10.5% ➖ noise
4 duckdb:vortex-file-compressed +9.4% +3.7% +5.5% +10.5% ➖ noise
5 datafusion:vortex-compact -2.7% +0.4% -3.1% +10.6% ➖ noise
5 datafusion:vortex-file-compressed +7.2% +0.4% +6.8% +10.5% ➖ noise
5 duckdb:duckdb +11.5% +0.4% +11.1% +10.5% 🚨 regression
5 duckdb:vortex-compact +3.9% +0.4% +3.5% +10.5% ➖ noise
5 duckdb:vortex-file-compressed +8.7% +0.4% +8.3% +10.5% ➖ noise
6 datafusion:vortex-compact +0.6% +3.5% -2.8% +10.5% ➖ noise
6 datafusion:vortex-file-compressed +1.6% +3.5% -1.9% +10.5% ➖ noise
6 duckdb:duckdb +7.8% +3.5% +4.1% +10.5% ➖ noise
6 duckdb:vortex-compact -4.8% +3.5% -8.0% +10.5% ➖ noise
6 duckdb:vortex-file-compressed +5.1% +3.5% +1.5% +10.5% ➖ noise
7 datafusion:vortex-compact -1.9% +7.6% -8.8% +10.5% ➖ noise
7 datafusion:vortex-file-compressed +9.6% +7.6% +1.9% +14.7% ➖ noise
7 duckdb:duckdb +6.1% +7.6% -1.3% +10.5% ➖ noise
7 duckdb:vortex-compact -3.2% +7.6% -10.0% +10.5% ✅ faster
7 duckdb:vortex-file-compressed +5.8% +7.6% -1.6% +17.9% ➖ noise
8 datafusion:vortex-compact +9.7% +4.8% +4.7% +10.5% ➖ noise
8 datafusion:vortex-file-compressed +8.9% +4.8% +3.9% +10.5% ➖ noise
8 duckdb:duckdb +1.5% +4.8% -3.1% +10.5% ➖ noise
8 duckdb:vortex-compact +4.6% +4.8% -0.3% +10.5% ➖ noise
8 duckdb:vortex-file-compressed +8.9% +4.8% +3.9% +10.5% ➖ noise
9 datafusion:vortex-compact -4.1% +2.4% -6.4% +10.5% ➖ noise
9 datafusion:vortex-file-compressed +7.2% +2.4% +4.7% +10.5% ➖ noise
9 duckdb:duckdb +5.7% +2.4% +3.2% +10.5% ➖ noise
9 duckdb:vortex-compact -3.2% +2.4% -5.5% +10.5% ➖ noise
9 duckdb:vortex-file-compressed +2.0% +2.4% -0.5% +11.4% ➖ noise
10 datafusion:vortex-compact +2.7% +6.9% -3.9% +10.5% ➖ noise
10 datafusion:vortex-file-compressed +4.8% +6.9% -1.9% +10.5% ➖ noise
10 duckdb:duckdb +7.1% +6.9% +0.2% +10.5% ➖ noise
10 duckdb:vortex-compact -3.7% +6.9% -9.9% +12.9% ➖ noise
10 duckdb:vortex-file-compressed +7.0% +6.9% +0.1% +11.9% ➖ noise
11 datafusion:vortex-compact +2.0% +5.8% -3.6% +10.5% ➖ noise
11 datafusion:vortex-file-compressed +10.8% +5.8% +4.7% +10.5% ➖ noise
11 duckdb:duckdb +0.1% +5.8% -5.4% +12.9% ➖ noise
11 duckdb:vortex-compact +1.4% +5.8% -4.2% +10.5% ➖ noise
11 duckdb:vortex-file-compressed +14.0% +5.8% +7.7% +12.2% ➖ noise
12 datafusion:vortex-compact -3.4% +5.2% -8.2% +14.9% ➖ noise
12 datafusion:vortex-file-compressed +5.5% +5.2% +0.2% +10.5% ➖ noise
12 duckdb:duckdb +4.8% +5.2% -0.4% +10.5% ➖ noise
12 duckdb:vortex-compact -2.0% +5.2% -6.9% +15.8% ➖ noise
12 duckdb:vortex-file-compressed +8.0% +5.2% +2.6% +17.6% ➖ noise
13 datafusion:vortex-compact +2.7% +6.0% -3.2% +23.7% ➖ noise
13 datafusion:vortex-file-compressed +8.4% +6.0% +2.3% +10.5% ➖ noise
13 duckdb:duckdb +4.2% +6.0% -1.7% +10.5% ➖ noise
13 duckdb:vortex-compact +0.6% +6.0% -5.2% +10.5% ➖ noise
13 duckdb:vortex-file-compressed +5.4% +6.0% -0.6% +10.5% ➖ noise
14 datafusion:vortex-compact -3.7% +0.7% -4.4% +10.5% ➖ noise
14 datafusion:vortex-file-compressed +10.8% +0.7% +10.0% +10.5% ➖ noise
14 duckdb:duckdb +3.0% +0.7% +2.3% +10.5% ➖ noise
14 duckdb:vortex-compact -3.3% +0.7% -4.0% +10.5% ➖ noise
14 duckdb:vortex-file-compressed +6.5% +0.7% +5.8% +10.5% ➖ noise
15 datafusion:vortex-compact -4.0% +7.7% -10.9% +10.5% ✅ faster
15 datafusion:vortex-file-compressed +14.0% +7.7% +5.8% +19.2% ➖ noise
15 duckdb:duckdb +11.0% +7.7% +3.1% +10.5% ➖ noise
15 duckdb:vortex-compact -2.9% +7.7% -9.9% +10.6% ✅ faster
15 duckdb:vortex-file-compressed +7.6% +7.7% -0.1% +11.6% ➖ noise
16 datafusion:vortex-compact -2.1% +2.1% -4.1% +10.5% ➖ noise
16 datafusion:vortex-file-compressed +16.2% +2.1% +13.8% +10.5% 🚨 regression
16 duckdb:duckdb +8.0% +2.1% +5.8% +11.2% ➖ noise
16 duckdb:vortex-compact +7.0% +2.1% +4.9% +10.5% ➖ noise
16 duckdb:vortex-file-compressed +8.8% +2.1% +6.6% +10.5% ➖ noise
17 datafusion:vortex-compact -2.8% +1.6% -4.3% +10.5% ➖ noise
17 datafusion:vortex-file-compressed +8.8% +1.6% +7.1% +10.5% ➖ noise
17 duckdb:duckdb -1.3% +1.6% -2.8% +10.5% ➖ noise
17 duckdb:vortex-compact -0.9% +1.6% -2.4% +10.5% ➖ noise
17 duckdb:vortex-file-compressed +11.7% +1.6% +10.0% +11.7% ➖ noise
18 datafusion:vortex-compact -3.4% +6.1% -9.0% +10.5% ➖ noise
18 datafusion:vortex-file-compressed +8.9% +6.1% +2.7% +10.5% ➖ noise
18 duckdb:duckdb +5.3% +6.1% -0.8% +11.0% ➖ noise
18 duckdb:vortex-compact +2.2% +6.1% -3.7% +10.5% ➖ noise
18 duckdb:vortex-file-compressed +12.8% +6.1% +6.4% +10.5% ➖ noise
19 datafusion:vortex-compact -4.0% +5.8% -9.3% +10.5% ➖ noise
19 datafusion:vortex-file-compressed +12.0% +5.8% +5.9% +10.5% ➖ noise
19 duckdb:duckdb +11.2% +5.8% +5.0% +10.5% ➖ noise
19 duckdb:vortex-compact +3.3% +5.8% -2.4% +10.5% ➖ noise
19 duckdb:vortex-file-compressed +5.4% +5.8% -0.4% +10.5% ➖ noise
20 datafusion:vortex-compact -4.4% +6.8% -10.5% +10.5% ✅ faster
20 datafusion:vortex-file-compressed +18.3% +6.8% +10.7% +10.5% 🚨 regression
20 duckdb:duckdb +8.0% +6.8% +1.2% +10.5% ➖ noise
20 duckdb:vortex-compact +4.8% +6.8% -1.9% +24.4% ➖ noise
20 duckdb:vortex-file-compressed +12.7% +6.8% +5.5% +10.5% ➖ noise
21 datafusion:vortex-compact -8.3% +8.3% -15.4% +10.5% ✅ faster
21 datafusion:vortex-file-compressed +12.9% +8.3% +4.2% +10.8% ➖ noise
21 duckdb:duckdb +12.0% +8.3% +3.4% +18.8% ➖ noise
21 duckdb:vortex-compact -2.9% +8.3% -10.4% +18.0% ➖ noise
21 duckdb:vortex-file-compressed +8.2% +8.3% -0.1% +11.7% ➖ noise
22 datafusion:vortex-compact +3.3% +10.7% -6.7% +13.2% ➖ noise
22 datafusion:vortex-file-compressed +23.7% +10.7% +11.8% +26.9% ➖ noise
22 duckdb:duckdb +6.6% +10.7% -3.7% +10.5% ➖ noise
22 duckdb:vortex-compact +13.9% +10.7% +2.9% +10.7% ➖ noise
22 duckdb:vortex-file-compressed +17.5% +10.7% +6.1% +13.9% ➖ noise
23 datafusion:vortex-compact +0.8% +9.2% -7.7% +10.5% ➖ noise
23 datafusion:vortex-file-compressed +14.2% +9.2% +4.5% +10.5% ➖ noise
23 duckdb:duckdb +2.6% +9.2% -6.0% +11.1% ➖ noise
23 duckdb:vortex-compact -3.1% +9.2% -11.3% +13.7% ➖ noise
23 duckdb:vortex-file-compressed +1.4% +9.2% -7.1% +10.5% ➖ noise
24 datafusion:vortex-compact -1.1% +7.2% -7.7% +12.0% ➖ noise
24 datafusion:vortex-file-compressed +17.0% +7.2% +9.2% +10.5% ➖ noise
24 duckdb:duckdb +9.5% +7.2% +2.2% +10.5% ➖ noise
24 duckdb:vortex-compact +4.2% +7.2% -2.8% +10.5% ➖ noise
24 duckdb:vortex-file-compressed +7.9% +7.2% +0.7% +10.5% ➖ noise
25 datafusion:vortex-compact -1.0% +7.5% -7.9% +10.5% ➖ noise
25 datafusion:vortex-file-compressed +6.9% +7.5% -0.6% +10.5% ➖ noise
25 duckdb:duckdb +9.1% +7.5% +1.5% +10.5% ➖ noise
25 duckdb:vortex-compact -0.3% +7.5% -7.3% +12.2% ➖ noise
25 duckdb:vortex-file-compressed +1.9% +7.5% -5.2% +12.7% ➖ noise
26 datafusion:vortex-compact +6.9% +7.3% -0.3% +10.5% ➖ noise
26 datafusion:vortex-file-compressed +13.6% +7.3% +5.9% +16.9% ➖ noise
26 duckdb:duckdb +8.0% +7.3% +0.7% +10.5% ➖ noise
26 duckdb:vortex-compact +1.6% +7.3% -5.2% +11.1% ➖ noise
26 duckdb:vortex-file-compressed +7.7% +7.3% +0.4% +21.4% ➖ noise
27 datafusion:vortex-compact +11.6% +8.8% +2.6% +11.1% ➖ noise
27 datafusion:vortex-file-compressed +16.9% +8.8% +7.4% +12.3% ➖ noise
27 duckdb:duckdb +6.8% +8.8% -1.9% +10.5% ➖ noise
27 duckdb:vortex-compact +5.6% +8.8% -3.0% +10.5% ➖ noise
27 duckdb:vortex-file-compressed +12.6% +8.8% +3.4% +21.4% ➖ noise
28 datafusion:vortex-compact +3.4% +4.4% -1.0% +10.5% ➖ noise
28 datafusion:vortex-file-compressed +5.4% +4.4% +0.9% +10.5% ➖ noise
28 duckdb:duckdb -2.3% +4.4% -6.4% +10.5% ➖ noise
28 duckdb:vortex-compact +1.5% +4.4% -2.8% +26.3% ➖ noise
28 duckdb:vortex-file-compressed -0.5% +4.4% -4.7% +12.1% ➖ noise
29 datafusion:vortex-compact +6.7% +0.8% +5.8% +10.5% ➖ noise
29 datafusion:vortex-file-compressed +12.0% +0.8% +11.0% +12.4% ➖ noise
29 duckdb:duckdb +5.1% +0.8% +4.3% +10.5% ➖ noise
29 duckdb:vortex-compact +8.6% +0.8% +7.7% +10.5% ➖ noise
29 duckdb:vortex-file-compressed +6.6% +0.8% +5.8% +15.5% ➖ noise
30 datafusion:vortex-compact +6.4% +7.5% -1.0% +10.5% ➖ noise
30 datafusion:vortex-file-compressed +17.0% +7.5% +8.8% +10.5% ➖ noise
30 duckdb:duckdb +6.2% +7.5% -1.2% +16.3% ➖ noise
30 duckdb:vortex-compact +7.0% +7.5% -0.5% +10.5% ➖ noise
30 duckdb:vortex-file-compressed +7.9% +7.5% +0.3% +18.2% ➖ noise
31 datafusion:vortex-compact +4.3% +4.0% +0.3% +10.5% ➖ noise
31 datafusion:vortex-file-compressed +10.5% +4.0% +6.3% +10.5% ➖ noise
31 duckdb:duckdb +9.7% +4.0% +5.5% +10.5% ➖ noise
31 duckdb:vortex-compact +9.0% +4.0% +4.8% +21.5% ➖ noise
31 duckdb:vortex-file-compressed +11.6% +4.0% +7.4% +13.0% ➖ noise
32 datafusion:vortex-compact +2.1% +9.5% -6.8% +10.5% ➖ noise
32 datafusion:vortex-file-compressed +15.5% +9.5% +5.5% +10.5% ➖ noise
32 duckdb:duckdb +14.3% +9.5% +4.4% +10.5% ➖ noise
32 duckdb:vortex-compact +10.5% +9.5% +1.0% +10.5% ➖ noise
32 duckdb:vortex-file-compressed +13.9% +9.5% +4.1% +10.5% ➖ noise
33 datafusion:vortex-compact +3.8% +3.4% +0.4% +10.5% ➖ noise
33 datafusion:vortex-file-compressed +10.4% +3.4% +6.8% +11.2% ➖ noise
33 duckdb:duckdb -0.4% +3.4% -3.7% +10.5% ➖ noise
33 duckdb:vortex-compact +13.9% +3.4% +10.2% +10.5% ➖ noise
33 duckdb:vortex-file-compressed +5.9% +3.4% +2.4% +10.5% ➖ noise
34 datafusion:vortex-compact +4.4% +7.6% -3.0% +10.8% ➖ noise
34 datafusion:vortex-file-compressed +11.6% +7.6% +3.7% +14.7% ➖ noise
34 duckdb:duckdb +1.9% +7.6% -5.3% +10.5% ➖ noise
34 duckdb:vortex-compact +6.0% +7.6% -1.5% +10.5% ➖ noise
34 duckdb:vortex-file-compressed +3.0% +7.6% -4.3% +10.5% ➖ noise
35 datafusion:vortex-compact +5.9% +8.6% -2.5% +10.5% ➖ noise
35 datafusion:vortex-file-compressed +8.4% +8.6% -0.2% +10.5% ➖ noise
35 duckdb:duckdb +7.8% +8.6% -0.7% +10.5% ➖ noise
35 duckdb:vortex-compact +7.7% +8.6% -0.9% +10.5% ➖ noise
35 duckdb:vortex-file-compressed +8.6% +8.6% -0.0% +10.5% ➖ noise
36 datafusion:vortex-compact -1.6% +4.3% -5.6% +10.5% ➖ noise
36 datafusion:vortex-file-compressed +12.5% +4.3% +7.8% +10.5% ➖ noise
36 duckdb:duckdb +12.6% +4.3% +8.0% +10.5% ➖ noise
36 duckdb:vortex-compact +3.7% +4.3% -0.6% +10.5% ➖ noise
36 duckdb:vortex-file-compressed +4.5% +4.3% +0.2% +11.4% ➖ noise
37 datafusion:vortex-compact +4.6% +12.6% -7.1% +10.6% ➖ noise
37 datafusion:vortex-file-compressed +22.7% +12.6% +9.0% +11.7% ➖ noise
37 duckdb:duckdb +11.1% +12.6% -1.3% +10.5% ➖ noise
37 duckdb:vortex-compact +13.9% +12.6% +1.2% +10.5% ➖ noise
37 duckdb:vortex-file-compressed +11.1% +12.6% -1.3% +10.5% ➖ noise
38 datafusion:vortex-compact +6.9% +6.1% +0.8% +10.5% ➖ noise
38 datafusion:vortex-file-compressed +15.2% +6.1% +8.6% +10.5% ➖ noise
38 duckdb:duckdb +6.2% +6.1% +0.1% +10.5% ➖ noise
38 duckdb:vortex-compact +13.1% +6.1% +6.6% +10.5% ➖ noise
38 duckdb:vortex-file-compressed +6.8% +6.1% +0.7% +10.5% ➖ noise
39 datafusion:vortex-compact +5.3% +8.0% -2.4% +12.9% ➖ noise
39 datafusion:vortex-file-compressed +10.3% +8.0% +2.1% +10.5% ➖ noise
39 duckdb:duckdb +14.3% +8.0% +5.9% +27.1% ➖ noise
39 duckdb:vortex-compact +1.5% +8.0% -6.0% +10.5% ➖ noise
39 duckdb:vortex-file-compressed +4.0% +8.0% -3.7% +18.0% ➖ noise
40 datafusion:vortex-compact -7.9% +15.1% -20.0% +13.2% ✅ faster
40 datafusion:vortex-file-compressed +11.3% +15.1% -3.3% +10.5% ➖ noise
40 duckdb:duckdb +12.9% +15.1% -1.9% +10.5% ➖ noise
40 duckdb:vortex-compact +12.3% +15.1% -2.4% +10.5% ➖ noise
40 duckdb:vortex-file-compressed +21.8% +15.1% +5.8% +10.5% ➖ noise
41 datafusion:vortex-compact +2.1% +12.5% -9.2% +10.5% ➖ noise
41 datafusion:vortex-file-compressed +17.9% +12.5% +4.8% +21.5% ➖ noise
41 duckdb:duckdb +19.5% +12.5% +6.2% +10.5% ➖ noise
41 duckdb:vortex-compact +8.7% +12.5% -3.4% +10.5% ➖ noise
41 duckdb:vortex-file-compressed +14.6% +12.5% +1.9% +10.5% ➖ noise
42 datafusion:vortex-compact +5.6% +6.5% -0.9% +13.9% ➖ noise
42 datafusion:vortex-file-compressed +18.7% +6.5% +11.4% +10.5% 🚨 regression
42 duckdb:duckdb +34.0% +6.5% +25.7% +14.2% 🚨 regression
42 duckdb:vortex-compact +6.9% +6.5% +0.3% +17.8% ➖ noise
42 duckdb:vortex-file-compressed +11.1% +6.5% +4.3% +10.5% ➖ noise
43 datafusion:vortex-compact -0.3% +10.5% -9.8% +16.9% ➖ noise
43 datafusion:vortex-file-compressed +9.6% +10.5% -0.9% +10.6% ➖ noise
43 duckdb:duckdb -4.7% +10.5% -13.8% +12.6% ✅ faster
43 duckdb:vortex-compact +13.6% +10.5% +2.7% +15.8% ➖ noise
43 duckdb:vortex-file-compressed +3.9% +10.5% -6.0% +20.4% ➖ noise
44 datafusion:vortex-compact +0.9% +6.8% -5.5% +10.5% ➖ noise
44 datafusion:vortex-file-compressed +2.9% +6.8% -3.7% +10.5% ➖ noise
44 duckdb:duckdb +1.5% +6.8% -4.9% +10.5% ➖ noise
44 duckdb:vortex-compact +5.0% +6.8% -1.7% +11.5% ➖ noise
44 duckdb:vortex-file-compressed +9.1% +6.8% +2.2% +12.8% ➖ noise
45 datafusion:vortex-compact -5.1% +7.1% -11.4% +10.5% ✅ faster
45 datafusion:vortex-file-compressed +8.2% +7.1% +1.0% +10.5% ➖ noise
45 duckdb:duckdb +12.3% +7.1% +4.9% +10.5% ➖ noise
45 duckdb:vortex-compact +15.7% +7.1% +8.0% +16.1% ➖ noise
45 duckdb:vortex-file-compressed +12.4% +7.1% +4.9% +10.5% ➖ noise
46 datafusion:vortex-compact -2.1% +9.2% -10.4% +10.5% ✅ faster
46 datafusion:vortex-file-compressed +12.8% +9.2% +3.2% +10.5% ➖ noise
46 duckdb:duckdb +10.5% +9.2% +1.2% +10.5% ➖ noise
46 duckdb:vortex-compact +7.9% +9.2% -1.2% +10.5% ➖ noise
46 duckdb:vortex-file-compressed +6.8% +9.2% -2.2% +10.5% ➖ noise
47 datafusion:vortex-compact -3.6% +8.6% -11.3% +10.5% ✅ faster
47 datafusion:vortex-file-compressed +12.1% +8.6% +3.2% +10.5% ➖ noise
47 duckdb:duckdb +8.7% +8.6% +0.1% +10.5% ➖ noise
47 duckdb:vortex-compact +7.7% +8.6% -0.9% +11.0% ➖ noise
47 duckdb:vortex-file-compressed -6.9% +8.6% -14.3% +10.5% ✅ faster
48 datafusion:vortex-compact +0.4% +4.7% -4.1% +20.2% ➖ noise
48 datafusion:vortex-file-compressed +9.3% +4.7% +4.3% +10.5% ➖ noise
48 duckdb:duckdb +5.1% +4.7% +0.3% +11.3% ➖ noise
48 duckdb:vortex-compact +10.2% +4.7% +5.2% +12.4% ➖ noise
48 duckdb:vortex-file-compressed +0.0% +4.7% -4.5% +12.4% ➖ noise
49 datafusion:vortex-compact -1.9% +4.1% -5.8% +10.5% ➖ noise
49 datafusion:vortex-file-compressed +15.1% +4.1% +10.5% +10.5% 🚨 regression
49 duckdb:duckdb -0.2% +4.1% -4.2% +11.8% ➖ noise
49 duckdb:vortex-compact +9.0% +4.1% +4.7% +10.6% ➖ noise
49 duckdb:vortex-file-compressed -6.0% +4.1% -9.8% +12.2% ➖ noise
50 datafusion:vortex-compact -3.7% +7.9% -10.8% +10.5% ✅ faster
50 datafusion:vortex-file-compressed +11.3% +7.9% +3.1% +10.5% ➖ noise
50 duckdb:duckdb +9.3% +7.9% +1.3% +10.5% ➖ noise
50 duckdb:vortex-compact +3.6% +7.9% -4.0% +14.2% ➖ noise
50 duckdb:vortex-file-compressed -6.7% +7.9% -13.5% +10.5% ✅ faster
51 datafusion:vortex-compact -3.1% +9.9% -11.8% +11.5% ✅ faster
51 datafusion:vortex-file-compressed +9.7% +9.9% -0.2% +12.0% ➖ noise
51 duckdb:duckdb +4.8% +9.9% -4.6% +11.3% ➖ noise
51 duckdb:vortex-compact +6.0% +9.9% -3.5% +17.0% ➖ noise
51 duckdb:vortex-file-compressed +1.0% +9.9% -8.1% +11.8% ➖ noise
52 datafusion:vortex-compact -8.6% +8.6% -15.8% +14.6% ✅ faster
52 datafusion:vortex-file-compressed +15.3% +8.6% +6.2% +11.0% ➖ noise
52 duckdb:duckdb +7.9% +8.6% -0.6% +13.0% ➖ noise
52 duckdb:vortex-compact -3.3% +8.6% -10.9% +28.2% ➖ noise
52 duckdb:vortex-file-compressed -7.1% +8.6% -14.4% +10.5% ✅ faster
53 datafusion:vortex-compact -2.0% +4.1% -5.8% +10.5% ➖ noise
53 datafusion:vortex-file-compressed +10.4% +4.1% +6.1% +10.5% ➖ noise
53 duckdb:duckdb +5.6% +4.1% +1.5% +10.5% ➖ noise
53 duckdb:vortex-compact +4.7% +4.1% +0.6% +10.5% ➖ noise
53 duckdb:vortex-file-compressed +1.6% +4.1% -2.3% +10.5% ➖ noise
54 datafusion:vortex-compact +0.8% +7.6% -6.3% +10.5% ➖ noise
54 datafusion:vortex-file-compressed +16.1% +7.6% +7.9% +16.9% ➖ noise
54 duckdb:duckdb +5.2% +7.6% -2.2% +10.5% ➖ noise
54 duckdb:vortex-compact +14.3% +7.6% +6.2% +10.5% ➖ noise
54 duckdb:vortex-file-compressed -1.7% +7.6% -8.6% +12.6% ➖ noise
55 datafusion:vortex-compact -2.4% +5.9% -7.9% +10.5% ➖ noise
55 datafusion:vortex-file-compressed +15.5% +5.9% +9.0% +17.4% ➖ noise
55 duckdb:duckdb +3.4% +5.9% -2.4% +14.1% ➖ noise
55 duckdb:vortex-compact +7.5% +5.9% +1.4% +10.5% ➖ noise
55 duckdb:vortex-file-compressed -7.2% +5.9% -12.4% +10.5% ✅ faster
56 datafusion:vortex-compact -2.2% +5.7% -7.5% +11.3% ➖ noise
56 datafusion:vortex-file-compressed +10.1% +5.7% +4.1% +10.5% ➖ noise
56 duckdb:duckdb -0.7% +5.7% -6.1% +10.5% ➖ noise
56 duckdb:vortex-compact +5.1% +5.7% -0.6% +10.5% ➖ noise
56 duckdb:vortex-file-compressed -2.9% +5.7% -8.2% +10.5% ➖ noise
57 datafusion:vortex-compact +1.8% +3.9% -2.0% +10.5% ➖ noise
57 datafusion:vortex-file-compressed +5.4% +3.9% +1.4% +10.5% ➖ noise
57 duckdb:duckdb +6.0% +3.9% +2.1% +10.5% ➖ noise
57 duckdb:vortex-compact +7.6% +3.9% +3.5% +10.5% ➖ noise
57 duckdb:vortex-file-compressed -2.4% +3.9% -6.1% +10.5% ➖ noise
58 datafusion:vortex-compact -2.0% +10.7% -11.4% +10.5% ✅ faster
58 datafusion:vortex-file-compressed +6.5% +10.7% -3.8% +10.5% ➖ noise
58 duckdb:duckdb -2.2% +10.7% -11.6% +10.5% ✅ faster
58 duckdb:vortex-compact +12.3% +10.7% +1.5% +18.3% ➖ noise
58 duckdb:vortex-file-compressed -0.5% +10.7% -10.1% +15.7% ➖ noise
59 datafusion:vortex-compact -3.3% +4.1% -7.1% +10.5% ➖ noise
59 datafusion:vortex-file-compressed +7.3% +4.1% +3.1% +10.5% ➖ noise
59 duckdb:duckdb +5.9% +4.1% +1.7% +10.5% ➖ noise
59 duckdb:vortex-compact -1.1% +4.1% -4.9% +10.5% ➖ noise
59 duckdb:vortex-file-compressed -3.3% +4.1% -7.1% +18.9% ➖ noise
60 datafusion:vortex-compact -4.3% +4.6% -8.5% +10.5% ➖ noise
60 datafusion:vortex-file-compressed +11.9% +4.6% +7.0% +10.5% ➖ noise
60 duckdb:duckdb +3.6% +4.6% -0.9% +10.6% ➖ noise
60 duckdb:vortex-compact +8.7% +4.6% +3.9% +10.5% ➖ noise
60 duckdb:vortex-file-compressed -4.0% +4.6% -8.2% +10.5% ➖ noise
61 datafusion:vortex-compact -3.5% +5.0% -8.0% +10.5% ➖ noise
61 datafusion:vortex-file-compressed +9.1% +5.0% +4.0% +13.0% ➖ noise
61 duckdb:duckdb +7.8% +5.0% +2.7% +10.5% ➖ noise
61 duckdb:vortex-compact +6.4% +5.0% +1.3% +10.5% ➖ noise
61 duckdb:vortex-file-compressed -0.8% +5.0% -5.5% +18.5% ➖ noise
62 datafusion:vortex-compact +6.4% +8.0% -1.5% +22.6% ➖ noise
62 datafusion:vortex-file-compressed +3.1% +8.0% -4.5% +24.6% ➖ noise
62 duckdb:duckdb +7.7% +8.0% -0.2% +14.7% ➖ noise
62 duckdb:vortex-compact +9.0% +8.0% +0.9% +16.3% ➖ noise
62 duckdb:vortex-file-compressed -2.3% +8.0% -9.5% +15.8% ➖ noise
63 datafusion:vortex-compact +6.9% +6.1% +0.8% +10.7% ➖ noise
63 datafusion:vortex-file-compressed +9.6% +6.1% +3.3% +10.5% ➖ noise
63 duckdb:duckdb +4.0% +6.1% -2.0% +10.5% ➖ noise
63 duckdb:vortex-compact +5.7% +6.1% -0.4% +14.3% ➖ noise
63 duckdb:vortex-file-compressed +0.7% +6.1% -5.1% +10.5% ➖ noise
64 datafusion:vortex-compact -7.8% +6.0% -13.0% +10.5% ✅ faster
64 datafusion:vortex-file-compressed +9.3% +6.0% +3.1% +10.5% ➖ noise
64 duckdb:duckdb +4.6% +6.0% -1.3% +10.5% ➖ noise
64 duckdb:vortex-compact +4.3% +6.0% -1.6% +10.5% ➖ noise
64 duckdb:vortex-file-compressed -4.4% +6.0% -9.8% +10.5% ✅ faster
65 datafusion:vortex-compact -7.0% +3.4% -10.0% +10.5% ✅ faster
65 datafusion:vortex-file-compressed +9.3% +3.4% +5.7% +10.5% ➖ noise
65 duckdb:duckdb +8.6% +3.4% +5.0% +10.5% ➖ noise
65 duckdb:vortex-compact +5.3% +3.4% +1.9% +17.5% ➖ noise
65 duckdb:vortex-file-compressed -3.2% +3.4% -6.3% +10.5% ➖ noise
66 datafusion:vortex-compact -3.8% +14.7% -16.2% +14.8% ✅ faster
66 datafusion:vortex-file-compressed +8.3% +14.7% -5.6% +15.0% ➖ noise
66 duckdb:duckdb +8.0% +14.7% -5.9% +13.1% ➖ noise
66 duckdb:vortex-compact +5.4% +14.7% -8.1% +17.9% ➖ noise
66 duckdb:vortex-file-compressed -3.5% +14.7% -15.9% +19.3% ➖ noise
67 datafusion:vortex-compact -4.9% +9.5% -13.2% +10.5% ✅ faster
67 datafusion:vortex-file-compressed +8.2% +9.5% -1.2% +12.0% ➖ noise
67 duckdb:duckdb +5.3% +9.5% -3.8% +10.5% ➖ noise
67 duckdb:vortex-compact +6.4% +9.5% -2.9% +10.5% ➖ noise
67 duckdb:vortex-file-compressed -9.6% +9.5% -17.4% +10.5% ✅ faster
68 datafusion:vortex-compact -2.5% +6.2% -8.1% +10.8% ➖ noise
68 datafusion:vortex-file-compressed +3.7% +6.2% -2.3% +18.7% ➖ noise
68 duckdb:duckdb -0.8% +6.2% -6.6% +10.5% ➖ noise
68 duckdb:vortex-compact +1.4% +6.2% -4.5% +10.5% ➖ noise
68 duckdb:vortex-file-compressed -9.1% +6.2% -14.3% +10.5% ✅ faster
69 datafusion:vortex-compact +4.0% +1.6% +2.4% +10.5% ➖ noise
69 datafusion:vortex-file-compressed +9.4% +1.6% +7.7% +10.5% ➖ noise
69 duckdb:duckdb +2.1% +1.6% +0.6% +10.5% ➖ noise
69 duckdb:vortex-compact +7.4% +1.6% +5.8% +11.2% ➖ noise
69 duckdb:vortex-file-compressed -13.6% +1.6% -15.0% +10.8% ✅ faster
70 datafusion:vortex-compact +4.3% +1.4% +2.9% +10.5% ➖ noise
70 datafusion:vortex-file-compressed +12.9% +1.4% +11.4% +10.5% 🚨 regression
70 duckdb:duckdb -1.6% +1.4% -2.9% +10.5% ➖ noise
70 duckdb:vortex-compact +5.6% +1.4% +4.1% +12.3% ➖ noise
70 duckdb:vortex-file-compressed +2.8% +1.4% +1.4% +10.5% ➖ noise
71 datafusion:vortex-compact +10.9% -1.6% +12.7% +10.5% 🚨 regression
71 datafusion:vortex-file-compressed +14.9% -1.6% +16.8% +13.8% 🚨 regression
71 duckdb:duckdb +6.1% -1.6% +7.8% +10.5% ➖ noise
71 duckdb:vortex-compact +2.8% -1.6% +4.4% +10.5% ➖ noise
71 duckdb:vortex-file-compressed -2.7% -1.6% -1.1% +10.5% ➖ noise
72 datafusion:vortex-compact +12.5% -2.5% +15.3% +10.5% 🚨 regression
72 datafusion:vortex-file-compressed +11.4% -2.5% +14.2% +10.5% 🚨 regression
72 duckdb:duckdb +2.9% -2.5% +5.5% +10.5% ➖ noise
72 duckdb:vortex-compact +6.9% -2.5% +9.6% +10.5% ➖ noise
72 duckdb:vortex-file-compressed -3.1% -2.5% -0.6% +10.5% ➖ noise
73 datafusion:vortex-compact +4.2% -1.3% +5.6% +17.1% ➖ noise
73 datafusion:vortex-file-compressed +9.7% -1.3% +11.1% +10.5% 🚨 regression
73 duckdb:duckdb -0.4% -1.3% +0.9% +11.0% ➖ noise
73 duckdb:vortex-compact +10.8% -1.3% +12.3% +17.6% ➖ noise
73 duckdb:vortex-file-compressed -11.9% -1.3% -10.7% +14.1% ➖ noise
74 datafusion:vortex-compact +16.8% +0.5% +16.2% +10.5% 🚨 regression
74 datafusion:vortex-file-compressed +2.3% +0.5% +1.8% +16.1% ➖ noise
74 duckdb:duckdb +2.3% +0.5% +1.7% +10.5% ➖ noise
74 duckdb:vortex-compact +2.2% +0.5% +1.7% +13.7% ➖ noise
74 duckdb:vortex-file-compressed -2.5% +0.5% -3.0% +12.2% ➖ noise
75 datafusion:vortex-compact +6.5% +2.9% +3.5% +10.5% ➖ noise
75 datafusion:vortex-file-compressed +9.3% +2.9% +6.2% +12.1% ➖ noise
75 duckdb:duckdb +11.2% +2.9% +8.1% +10.5% ➖ noise
75 duckdb:vortex-compact +11.4% +2.9% +8.3% +12.3% ➖ noise
75 duckdb:vortex-file-compressed +3.5% +2.9% +0.5% +10.5% ➖ noise
76 datafusion:vortex-compact +11.8% +0.6% +11.1% +10.5% 🚨 regression
76 datafusion:vortex-file-compressed +4.8% +0.6% +4.1% +11.0% ➖ noise
76 duckdb:duckdb +6.7% +0.6% +6.0% +10.5% ➖ noise
76 duckdb:vortex-compact +10.3% +0.6% +9.6% +10.5% ➖ noise
76 duckdb:vortex-file-compressed -9.8% +0.6% -10.4% +12.9% ➖ noise
77 datafusion:vortex-compact +16.2% +0.4% +15.8% +11.7% 🚨 regression
77 datafusion:vortex-file-compressed +6.7% +0.4% +6.3% +15.4% ➖ noise
77 duckdb:duckdb +3.6% +0.4% +3.2% +11.1% ➖ noise
77 duckdb:vortex-compact -0.7% +0.4% -1.1% +16.9% ➖ noise
77 duckdb:vortex-file-compressed -5.4% +0.4% -5.8% +12.6% ➖ noise
78 datafusion:vortex-compact +9.8% +1.1% +8.5% +10.6% ➖ noise
78 datafusion:vortex-file-compressed +8.0% +1.1% +6.8% +14.6% ➖ noise
78 duckdb:duckdb +10.8% +1.1% +9.5% +11.0% ➖ noise
78 duckdb:vortex-compact +4.5% +1.1% +3.3% +12.1% ➖ noise
78 duckdb:vortex-file-compressed -3.7% +1.1% -4.8% +10.6% ➖ noise
79 datafusion:vortex-compact +7.2% -1.4% +8.8% +10.5% ➖ noise
79 datafusion:vortex-file-compressed +3.8% -1.4% +5.3% +10.5% ➖ noise
79 duckdb:duckdb +5.3% -1.4% +6.9% +10.5% ➖ noise
79 duckdb:vortex-compact +5.9% -1.4% +7.4% +13.6% ➖ noise
79 duckdb:vortex-file-compressed -6.7% -1.4% -5.3% +18.7% ➖ noise
80 datafusion:vortex-compact +6.4% -1.3% +7.8% +10.5% ➖ noise
80 datafusion:vortex-file-compressed +10.2% -1.3% +11.7% +10.7% 🚨 regression
80 duckdb:duckdb +7.7% -1.3% +9.1% +10.5% ➖ noise
80 duckdb:vortex-compact +5.8% -1.3% +7.3% +10.5% ➖ noise
80 duckdb:vortex-file-compressed +1.1% -1.3% +2.4% +14.5% ➖ noise
81 datafusion:vortex-compact +8.3% +2.0% +6.2% +10.5% ➖ noise
81 datafusion:vortex-file-compressed +6.8% +2.0% +4.7% +10.5% ➖ noise
81 duckdb:duckdb +3.6% +2.0% +1.5% +10.5% ➖ noise
81 duckdb:vortex-compact +14.8% +2.0% +12.5% +10.5% 🚨 regression
81 duckdb:vortex-file-compressed +6.0% +2.0% +3.9% +10.5% ➖ noise
82 datafusion:vortex-compact +7.6% -3.7% +11.8% +15.7% ➖ noise
82 datafusion:vortex-file-compressed +2.9% -3.7% +6.9% +12.0% ➖ noise
82 duckdb:duckdb +11.3% -3.7% +15.6% +12.7% 🚨 regression
82 duckdb:vortex-compact +9.0% -3.7% +13.2% +10.5% 🚨 regression
82 duckdb:vortex-file-compressed +3.4% -3.7% +7.4% +10.5% ➖ noise
83 datafusion:vortex-compact +9.4% +1.3% +8.0% +10.5% ➖ noise
83 datafusion:vortex-file-compressed +8.9% +1.3% +7.6% +10.5% ➖ noise
83 duckdb:duckdb +6.8% +1.3% +5.5% +10.5% ➖ noise
83 duckdb:vortex-compact +16.9% +1.3% +15.4% +20.6% ➖ noise
83 duckdb:vortex-file-compressed +3.9% +1.3% +2.6% +10.5% ➖ noise
84 datafusion:vortex-compact +3.4% +4.5% -1.0% +11.9% ➖ noise
84 datafusion:vortex-file-compressed +14.3% +4.5% +9.4% +10.5% ➖ noise
84 duckdb:duckdb +7.1% +4.5% +2.4% +10.5% ➖ noise
84 duckdb:vortex-compact +7.3% +4.5% +2.7% +10.5% ➖ noise
84 duckdb:vortex-file-compressed -1.3% +4.5% -5.6% +18.3% ➖ noise
85 datafusion:vortex-compact +3.8% +1.9% +1.9% +17.6% ➖ noise
85 datafusion:vortex-file-compressed +11.2% +1.9% +9.1% +11.6% ➖ noise
85 duckdb:duckdb +9.7% +1.9% +7.6% +10.5% ➖ noise
85 duckdb:vortex-compact +13.5% +1.9% +11.3% +11.7% ➖ noise
85 duckdb:vortex-file-compressed +4.8% +1.9% +2.8% +10.5% ➖ noise
86 datafusion:vortex-compact -0.0% +0.7% -0.8% +17.0% ➖ noise
86 datafusion:vortex-file-compressed +0.0% +0.7% -0.7% +11.7% ➖ noise
86 duckdb:duckdb +4.2% +0.7% +3.4% +12.4% ➖ noise
86 duckdb:vortex-compact +4.8% +0.7% +4.0% +16.9% ➖ noise
86 duckdb:vortex-file-compressed +6.8% +0.7% +6.0% +16.5% ➖ noise
87 datafusion:vortex-compact +14.3% +6.0% +7.8% +10.5% ➖ noise
87 datafusion:vortex-file-compressed +9.3% +6.0% +3.1% +10.5% ➖ noise
87 duckdb:duckdb +0.2% +6.0% -5.5% +10.7% ➖ noise
87 duckdb:vortex-compact +6.8% +6.0% +0.8% +10.8% ➖ noise
87 duckdb:vortex-file-compressed +9.1% +6.0% +2.9% +15.0% ➖ noise
88 datafusion:vortex-compact +9.9% +1.3% +8.4% +10.5% ➖ noise
88 datafusion:vortex-file-compressed +12.3% +1.3% +10.8% +10.5% 🚨 regression
88 duckdb:duckdb -2.4% +1.3% -3.6% +10.5% ➖ noise
88 duckdb:vortex-compact +5.5% +1.3% +4.1% +10.5% ➖ noise
88 duckdb:vortex-file-compressed +10.3% +1.3% +8.9% +10.5% ➖ noise
89 datafusion:vortex-compact +12.5% +0.3% +12.2% +10.5% 🚨 regression
89 datafusion:vortex-file-compressed +5.0% +0.3% +4.7% +16.5% ➖ noise
89 duckdb:duckdb +1.5% +0.3% +1.2% +10.5% ➖ noise
89 duckdb:vortex-compact +9.6% +0.3% +9.3% +24.4% ➖ noise
89 duckdb:vortex-file-compressed +7.7% +0.3% +7.4% +10.5% ➖ noise
90 datafusion:vortex-compact +18.0% +8.1% +9.2% +10.5% ➖ noise
90 datafusion:vortex-file-compressed +15.2% +8.1% +6.6% +31.2% ➖ noise
90 duckdb:duckdb +6.6% +8.1% -1.3% +10.5% ➖ noise
90 duckdb:vortex-compact +12.8% +8.1% +4.4% +10.5% ➖ noise
90 duckdb:vortex-file-compressed -1.4% +8.1% -8.7% +10.5% ➖ noise
91 datafusion:vortex-compact +9.0% +9.0% +0.0% +10.5% ➖ noise
91 datafusion:vortex-file-compressed +15.0% +9.0% +5.5% +10.5% ➖ noise
91 duckdb:duckdb +7.9% +9.0% -1.0% +10.5% ➖ noise
91 duckdb:vortex-compact +9.0% +9.0% -0.1% +10.5% ➖ noise
91 duckdb:vortex-file-compressed -5.2% +9.0% -13.0% +19.0% ➖ noise
92 datafusion:vortex-compact +12.7% +14.0% -1.1% +10.5% ➖ noise
92 datafusion:vortex-file-compressed +11.4% +14.0% -2.2% +10.5% ➖ noise
92 duckdb:duckdb +1.3% +14.0% -11.1% +10.5% ✅ faster
92 duckdb:vortex-compact +3.4% +14.0% -9.3% +15.8% ➖ noise
92 duckdb:vortex-file-compressed -9.9% +14.0% -20.9% +16.3% ✅ faster
93 datafusion:vortex-compact +10.7% +9.3% +1.3% +10.5% ➖ noise
93 datafusion:vortex-file-compressed +16.6% +9.3% +6.7% +10.5% ➖ noise
93 duckdb:duckdb +8.5% +9.3% -0.7% +10.5% ➖ noise
93 duckdb:vortex-compact +17.8% +9.3% +7.8% +11.8% ➖ noise
93 duckdb:vortex-file-compressed +1.8% +9.3% -6.9% +10.5% ➖ noise
94 datafusion:vortex-compact +21.7% +8.9% +11.7% +23.7% ➖ noise
94 datafusion:vortex-file-compressed +6.4% +8.9% -2.3% +10.5% ➖ noise
94 duckdb:duckdb +5.2% +8.9% -3.4% +12.3% ➖ noise
94 duckdb:vortex-compact +11.9% +8.9% +2.7% +10.5% ➖ noise
94 duckdb:vortex-file-compressed +0.1% +8.9% -8.1% +10.5% ➖ noise
95 datafusion:vortex-compact +9.2% +13.2% -3.6% +10.5% ➖ noise
95 datafusion:vortex-file-compressed +8.4% +13.2% -4.3% +10.5% ➖ noise
95 duckdb:duckdb -1.0% +13.2% -12.6% +19.3% ➖ noise
95 duckdb:vortex-compact +13.0% +13.2% -0.2% +15.6% ➖ noise
95 duckdb:vortex-file-compressed -7.0% +13.2% -17.9% +20.4% ✅ faster
96 datafusion:vortex-compact +5.9% +10.4% -4.0% +10.5% ➖ noise
96 datafusion:vortex-file-compressed +7.1% +10.4% -2.9% +21.3% ➖ noise
96 duckdb:duckdb +2.5% +10.4% -7.1% +12.2% ➖ noise
96 duckdb:vortex-compact +9.1% +10.4% -1.1% +12.3% ➖ noise
96 duckdb:vortex-file-compressed -0.1% +10.4% -9.4% +15.8% ➖ noise
97 datafusion:vortex-compact +16.0% +9.9% +5.6% +10.5% ➖ noise
97 datafusion:vortex-file-compressed +20.0% +9.9% +9.1% +11.2% ➖ noise
97 duckdb:duckdb +5.9% +9.9% -3.6% +10.5% ➖ noise
97 duckdb:vortex-compact +10.6% +9.9% +0.6% +10.5% ➖ noise
97 duckdb:vortex-file-compressed -4.7% +9.9% -13.2% +11.3% ✅ faster
98 datafusion:vortex-compact +9.3% +7.0% +2.1% +10.5% ➖ noise
98 datafusion:vortex-file-compressed +5.3% +7.0% -1.6% +10.5% ➖ noise
98 duckdb:duckdb +3.0% +7.0% -3.8% +10.5% ➖ noise
98 duckdb:vortex-compact +13.0% +7.0% +5.6% +10.5% ➖ noise
98 duckdb:vortex-file-compressed +3.5% +7.0% -3.3% +10.5% ➖ noise
99 datafusion:vortex-compact +6.5% +18.0% -9.7% +18.1% ➖ noise
99 datafusion:vortex-file-compressed +18.6% +18.0% +0.5% +19.7% ➖ noise
99 duckdb:duckdb +4.6% +18.0% -11.4% +16.3% ➖ noise
99 duckdb:vortex-compact +3.6% +18.0% -12.2% +23.2% ➖ noise
99 duckdb:vortex-file-compressed +0.2% +18.0% -15.1% +18.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.6%
Vortex (geomean): 1.127x ❌
Parquet (geomean): 1.088x ➖
Shifts: Parquet (control) +8.8% · Median polish +10.6%


datafusion / vortex-file-compressed (1.172x ❌, 0↑ 21↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 57814132 51078491 1.13
tpch_q02/datafusion:vortex-file-compressed 🚨 26074639 22228064 1.17
tpch_q03/datafusion:vortex-file-compressed 🚨 33125560 28797972 1.15
tpch_q04/datafusion:vortex-file-compressed 🚨 24283972 20116322 1.21
tpch_q05/datafusion:vortex-file-compressed 🚨 58904585 49020055 1.20
tpch_q06/datafusion:vortex-file-compressed 🚨 12351234 10561289 1.17
tpch_q07/datafusion:vortex-file-compressed 🚨 65395615 55128858 1.19
tpch_q08/datafusion:vortex-file-compressed 🚨 45743538 39023567 1.17
tpch_q09/datafusion:vortex-file-compressed 🚨 62412477 52755621 1.18
tpch_q10/datafusion:vortex-file-compressed 🚨 46465896 39512467 1.18
tpch_q11/datafusion:vortex-file-compressed 🚨 18747956 15831705 1.18
tpch_q12/datafusion:vortex-file-compressed 🚨 29123768 24555864 1.19
tpch_q13/datafusion:vortex-file-compressed 🚨 29586632 25517639 1.16
tpch_q14/datafusion:vortex-file-compressed 🚨 18578157 16159635 1.15
tpch_q15/datafusion:vortex-file-compressed 🚨 28758690 24667577 1.17
tpch_q16/datafusion:vortex-file-compressed 22193592 20236338 1.10
tpch_q17/datafusion:vortex-file-compressed 🚨 83012182 66876020 1.24
tpch_q18/datafusion:vortex-file-compressed 🚨 99383671 83171047 1.19
tpch_q19/datafusion:vortex-file-compressed 🚨 23121509 20308818 1.14
tpch_q20/datafusion:vortex-file-compressed 🚨 34103581 29233869 1.17
tpch_q21/datafusion:vortex-file-compressed 🚨 87628762 72421481 1.21
tpch_q22/datafusion:vortex-file-compressed 🚨 14208752 12379699 1.15
datafusion / vortex-compact (1.151x ❌, 0↑ 20↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 66317580 58166863 1.14
tpch_q02/datafusion:vortex-compact 🚨 29959023 25741703 1.16
tpch_q03/datafusion:vortex-compact 🚨 34184047 29686596 1.15
tpch_q04/datafusion:vortex-compact 🚨 26959933 22260852 1.21
tpch_q05/datafusion:vortex-compact 🚨 60886197 50339847 1.21
tpch_q06/datafusion:vortex-compact 🚨 14253363 12574302 1.13
tpch_q07/datafusion:vortex-compact 🚨 69946899 59008560 1.19
tpch_q08/datafusion:vortex-compact 🚨 49908459 43631261 1.14
tpch_q09/datafusion:vortex-compact 🚨 65939769 56018490 1.18
tpch_q10/datafusion:vortex-compact 🚨 53605200 45912333 1.17
tpch_q11/datafusion:vortex-compact 🚨 19450479 16792093 1.16
tpch_q12/datafusion:vortex-compact 🚨 35837267 31656897 1.13
tpch_q13/datafusion:vortex-compact 🚨 36366921 31897561 1.14
tpch_q14/datafusion:vortex-compact 🚨 21402461 19200062 1.11
tpch_q15/datafusion:vortex-compact 🚨 35334066 31854268 1.11
tpch_q16/datafusion:vortex-compact 🚨 27965193 24099243 1.16
tpch_q17/datafusion:vortex-compact 🚨 85586811 72207533 1.19
tpch_q18/datafusion:vortex-compact 🚨 103475817 84063536 1.23
tpch_q19/datafusion:vortex-compact 33339519 30969637 1.08
tpch_q20/datafusion:vortex-compact 🚨 39615589 34903750 1.13
tpch_q21/datafusion:vortex-compact 🚨 89805092 77848061 1.15
tpch_q22/datafusion:vortex-compact 13981530 13111889 1.07
datafusion / parquet (1.113x ❌, 0↑ 13↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 139625930 126437669 1.10
tpch_q02/datafusion:parquet 🚨 69548169 60250060 1.15
tpch_q03/datafusion:parquet 78369218 72327287 1.08
tpch_q04/datafusion:parquet 47043402 43826680 1.07
tpch_q05/datafusion:parquet 🚨 103043016 93198056 1.11
tpch_q06/datafusion:parquet 40539502 42197701 0.96
tpch_q07/datafusion:parquet 🚨 122052934 105350087 1.16
tpch_q08/datafusion:parquet 🚨 106966476 94932257 1.13
tpch_q09/datafusion:parquet 145127046 132336963 1.10
tpch_q10/datafusion:parquet 🚨 124839806 111651631 1.12
tpch_q11/datafusion:parquet 45097633 41623279 1.08
tpch_q12/datafusion:parquet 🚨 91436957 82793269 1.10
tpch_q13/datafusion:parquet 225256012 204841579 1.10
tpch_q14/datafusion:parquet 47360288 46340237 1.02
tpch_q15/datafusion:parquet 🚨 66184523 59328278 1.12
tpch_q16/datafusion:parquet 🚨 47570016 40580046 1.17
tpch_q17/datafusion:parquet 🚨 173166551 124580928 1.39
tpch_q18/datafusion:parquet 🚨 193200089 164005334 1.18
tpch_q19/datafusion:parquet 79242182 81752269 0.97
tpch_q20/datafusion:parquet 🚨 78659860 64925210 1.21
tpch_q21/datafusion:parquet 🚨 149959700 133918048 1.12
tpch_q22/datafusion:parquet 33949472 30945109 1.10
datafusion / arrow (1.264x ❌, 0↑ 20↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 71640588 58952159 1.22
tpch_q02/datafusion:arrow 21211119 19655351 1.08
tpch_q03/datafusion:arrow 🚨 40725687 31046828 1.31
tpch_q04/datafusion:arrow 🚨 37229377 25781586 1.44
tpch_q05/datafusion:arrow 🚨 99917141 75014530 1.33
tpch_q06/datafusion:arrow 🚨 28315007 19872624 1.42
tpch_q07/datafusion:arrow 🚨 125081996 102119357 1.22
tpch_q08/datafusion:arrow 🚨 62226808 41345788 1.51
tpch_q09/datafusion:arrow 🚨 86699022 68090323 1.27
tpch_q10/datafusion:arrow 🚨 62049986 51738033 1.20
tpch_q11/datafusion:arrow 10810464 10699588 1.01
tpch_q12/datafusion:arrow 🚨 68811130 52807665 1.30
tpch_q13/datafusion:arrow 🚨 52850012 47837021 1.10
tpch_q14/datafusion:arrow 🚨 31102734 22211289 1.40
tpch_q15/datafusion:arrow 🚨 59205720 45339482 1.31
tpch_q16/datafusion:arrow 🚨 21748679 18969878 1.15
tpch_q17/datafusion:arrow 🚨 89522207 68771234 1.30
tpch_q18/datafusion:arrow 🚨 174466220 138899983 1.26
tpch_q19/datafusion:arrow 🚨 51299845 35436639 1.45
tpch_q20/datafusion:arrow 🚨 45435814 34975490 1.30
tpch_q21/datafusion:arrow 🚨 183571709 152926433 1.20
tpch_q22/datafusion:arrow 🚨 20470229 17723189 1.15
duckdb / vortex-file-compressed (1.105x ❌, 0↑ 14↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 34523767 32083774 1.08
tpch_q02/duckdb:vortex-file-compressed 🚨 27851619 25273794 1.10
tpch_q03/duckdb:vortex-file-compressed 🚨 36845747 32918305 1.12
tpch_q04/duckdb:vortex-file-compressed 31802108 29288343 1.09
tpch_q05/duckdb:vortex-file-compressed 🚨 43114675 37988183 1.13
tpch_q06/duckdb:vortex-file-compressed 🚨 9903964 8540760 1.16
tpch_q07/duckdb:vortex-file-compressed 🚨 40305384 36093671 1.12
tpch_q08/duckdb:vortex-file-compressed 40109849 36891430 1.09
tpch_q09/duckdb:vortex-file-compressed 🚨 65589115 59262375 1.11
tpch_q10/duckdb:vortex-file-compressed 🚨 46273574 41357274 1.12
tpch_q11/duckdb:vortex-file-compressed 16971779 15666710 1.08
tpch_q12/duckdb:vortex-file-compressed 24163107 22859873 1.06
tpch_q13/duckdb:vortex-file-compressed 🚨 42446629 37947083 1.12
tpch_q14/duckdb:vortex-file-compressed 24342981 23419970 1.04
tpch_q15/duckdb:vortex-file-compressed 🚨 19066676 17282078 1.10
tpch_q16/duckdb:vortex-file-compressed 32761575 30060293 1.09
tpch_q17/duckdb:vortex-file-compressed 🚨 27701103 24682167 1.12
tpch_q18/duckdb:vortex-file-compressed 57433382 54040195 1.06
tpch_q19/duckdb:vortex-file-compressed 🚨 34427804 29329387 1.17
tpch_q20/duckdb:vortex-file-compressed 🚨 37722859 34077379 1.11
tpch_q21/duckdb:vortex-file-compressed 🚨 116615503 101413231 1.15
tpch_q22/duckdb:vortex-file-compressed 🚨 19589638 17682748 1.11
duckdb / vortex-compact (1.080x ➖, 0↑ 4↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39671727 38628449 1.03
tpch_q02/duckdb:vortex-compact 35482219 32935320 1.08
tpch_q03/duckdb:vortex-compact 38111407 35494116 1.07
tpch_q04/duckdb:vortex-compact 33817092 31778658 1.06
tpch_q05/duckdb:vortex-compact 45441802 41775484 1.09
tpch_q06/duckdb:vortex-compact 11819145 10799254 1.09
tpch_q07/duckdb:vortex-compact 44333745 41653785 1.06
tpch_q08/duckdb:vortex-compact 43895917 42560250 1.03
tpch_q09/duckdb:vortex-compact 72679727 68927239 1.05
tpch_q10/duckdb:vortex-compact 49828399 46404910 1.07
tpch_q11/duckdb:vortex-compact 20107321 18807638 1.07
tpch_q12/duckdb:vortex-compact 32393074 30239424 1.07
tpch_q13/duckdb:vortex-compact 48081029 45003004 1.07
tpch_q14/duckdb:vortex-compact 🚨 29404844 26344789 1.12
tpch_q15/duckdb:vortex-compact 21965326 20881357 1.05
tpch_q16/duckdb:vortex-compact 35200838 32049489 1.10
tpch_q17/duckdb:vortex-compact 🚨 31984382 28971138 1.10
tpch_q18/duckdb:vortex-compact 57875682 52643120 1.10
tpch_q19/duckdb:vortex-compact 🚨 38521555 34046024 1.13
tpch_q20/duckdb:vortex-compact 43994966 41114626 1.07
tpch_q21/duckdb:vortex-compact 🚨 119648929 104153919 1.15
tpch_q22/duckdb:vortex-compact 20764099 18900603 1.10
duckdb / parquet (1.063x ➖, 0↑ 4↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 80278863 80036628 1.00
tpch_q02/duckdb:parquet 42744090 39713191 1.08
tpch_q03/duckdb:parquet 75439994 70816913 1.07
tpch_q04/duckdb:parquet 53688542 59227173 0.91
tpch_q05/duckdb:parquet 73644091 68734832 1.07
tpch_q06/duckdb:parquet 24019128 22473824 1.07
tpch_q07/duckdb:parquet 84890663 84190417 1.01
tpch_q08/duckdb:parquet 88111287 91394129 0.96
tpch_q09/duckdb:parquet 🚨 170103964 149742557 1.14
tpch_q10/duckdb:parquet 138398897 127913193 1.08
tpch_q11/duckdb:parquet 24667441 22492936 1.10
tpch_q12/duckdb:parquet 🚨 56981411 47985880 1.19
tpch_q13/duckdb:parquet 🚨 295849750 251903631 1.17
tpch_q14/duckdb:parquet 54995163 50934502 1.08
tpch_q15/duckdb:parquet 27650396 25807303 1.07
tpch_q16/duckdb:parquet 63060048 58246499 1.08
tpch_q17/duckdb:parquet 58332571 58449051 1.00
tpch_q18/duckdb:parquet 126111907 119363423 1.06
tpch_q19/duckdb:parquet 87982293 87309614 1.01
tpch_q20/duckdb:parquet 69285022 65364885 1.06
tpch_q21/duckdb:parquet 🚨 208276996 179993443 1.16
tpch_q22/duckdb:parquet 57281221 53181676 1.08
duckdb / duckdb (1.065x ➖, 0↑ 1↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 18458272 17787194 1.04
tpch_q02/duckdb:duckdb 🚨 16206694 14678994 1.10
tpch_q03/duckdb:duckdb 24212542 22906738 1.06
tpch_q04/duckdb:duckdb 22891793 21322600 1.07
tpch_q05/duckdb:duckdb 24922226 23413919 1.06
tpch_q06/duckdb:duckdb 7442736 7129206 1.04
tpch_q07/duckdb:duckdb 27757190 26077577 1.06
tpch_q08/duckdb:duckdb 26315789 24586987 1.07
tpch_q09/duckdb:duckdb 64986916 59310405 1.10
tpch_q10/duckdb:duckdb 53655977 51860127 1.03
tpch_q11/duckdb:duckdb 7938965 7384569 1.08
tpch_q12/duckdb:duckdb 19566319 18091439 1.08
tpch_q13/duckdb:duckdb 42766908 39701668 1.08
tpch_q14/duckdb:duckdb 23143644 21769412 1.06
tpch_q15/duckdb:duckdb 14280586 13582432 1.05
tpch_q16/duckdb:duckdb 27967909 26783062 1.04
tpch_q17/duckdb:duckdb 17435153 16258606 1.07
tpch_q18/duckdb:duckdb 43340725 41320821 1.05
tpch_q19/duckdb:duckdb 33668438 31022914 1.09
tpch_q20/duckdb:duckdb 26804585 25573459 1.05
tpch_q21/duckdb:duckdb 66781063 61734801 1.08
tpch_q22/duckdb:duckdb 26948440 25494478 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +21.5% +5.2% +15.5% +18.3% ➖ noise
1 datafusion:vortex-compact +14.0% +5.2% +8.3% +16.5% ➖ noise
1 datafusion:vortex-file-compressed +13.2% +5.2% +7.5% +18.7% ➖ noise
1 duckdb:duckdb +3.8% +5.2% -1.4% +15.2% ➖ noise
1 duckdb:vortex-compact +2.7% +5.2% -2.4% +14.9% ➖ noise
1 duckdb:vortex-file-compressed +7.6% +5.2% +2.2% +18.8% ➖ noise
2 datafusion:arrow +7.9% +11.5% -3.2% +12.8% ➖ noise
2 datafusion:vortex-compact +16.4% +11.5% +4.4% +12.8% ➖ noise
2 datafusion:vortex-file-compressed +17.3% +11.5% +5.2% +12.8% ➖ noise
2 duckdb:duckdb +10.4% +11.5% -0.9% +12.8% ➖ noise
2 duckdb:vortex-compact +7.7% +11.5% -3.3% +12.8% ➖ noise
2 duckdb:vortex-file-compressed +10.2% +11.5% -1.1% +12.8% ➖ noise
3 datafusion:arrow +31.2% +7.4% +22.1% +12.8% 🚨 regression
3 datafusion:vortex-compact +15.1% +7.4% +7.2% +12.8% ➖ noise
3 datafusion:vortex-file-compressed +15.0% +7.4% +7.1% +12.8% ➖ noise
3 duckdb:duckdb +5.7% +7.4% -1.6% +12.8% ➖ noise
3 duckdb:vortex-compact +7.4% +7.4% -0.1% +12.8% ➖ noise
3 duckdb:vortex-file-compressed +11.9% +7.4% +4.2% +12.8% ➖ noise
4 datafusion:arrow +44.4% -1.4% +46.4% +12.8% 🚨 regression
4 datafusion:vortex-compact +21.1% -1.4% +22.8% +12.8% 🚨 regression
4 datafusion:vortex-file-compressed +20.7% -1.4% +22.4% +12.8% 🚨 regression
4 duckdb:duckdb +7.4% -1.4% +8.8% +12.8% ➖ noise
4 duckdb:vortex-compact +6.4% -1.4% +7.9% +12.8% ➖ noise
4 duckdb:vortex-file-compressed +8.6% -1.4% +10.1% +12.8% ➖ noise
5 datafusion:arrow +33.2% +8.8% +22.4% +12.8% 🚨 regression
5 datafusion:vortex-compact +21.0% +8.8% +11.1% +12.8% ➖ noise
5 datafusion:vortex-file-compressed +20.2% +8.8% +10.4% +12.8% ➖ noise
5 duckdb:duckdb +6.4% +8.8% -2.2% +12.8% ➖ noise
5 duckdb:vortex-compact +8.8% +8.8% -0.1% +12.8% ➖ noise
5 duckdb:vortex-file-compressed +13.5% +8.8% +4.3% +12.8% ➖ noise
6 datafusion:arrow +42.5% +1.3% +40.6% +12.8% 🚨 regression
6 datafusion:vortex-compact +13.4% +1.3% +11.9% +12.8% ➖ noise
6 datafusion:vortex-file-compressed +16.9% +1.3% +15.4% +14.0% 🚨 regression
6 duckdb:duckdb +4.4% +1.3% +3.0% +12.8% ➖ noise
6 duckdb:vortex-compact +9.4% +1.3% +8.0% +14.5% ➖ noise
6 duckdb:vortex-file-compressed +16.0% +1.3% +14.4% +13.5% 🚨 regression
7 datafusion:arrow +22.5% +8.1% +13.3% +12.8% 🚨 regression
7 datafusion:vortex-compact +18.5% +8.1% +9.7% +12.8% ➖ noise
7 datafusion:vortex-file-compressed +18.6% +8.1% +9.8% +12.8% ➖ noise
7 duckdb:duckdb +6.4% +8.1% -1.5% +12.8% ➖ noise
7 duckdb:vortex-compact +6.4% +8.1% -1.5% +12.8% ➖ noise
7 duckdb:vortex-file-compressed +11.7% +8.1% +3.3% +12.8% ➖ noise
8 datafusion:arrow +50.5% +4.2% +44.4% +12.8% 🚨 regression
8 datafusion:vortex-compact +14.4% +4.2% +9.7% +12.8% ➖ noise
8 datafusion:vortex-file-compressed +17.2% +4.2% +12.5% +12.8% ➖ noise
8 duckdb:duckdb +7.0% +4.2% +2.7% +12.8% ➖ noise
8 duckdb:vortex-compact +3.1% +4.2% -1.0% +12.8% ➖ noise
8 duckdb:vortex-file-compressed +8.7% +4.2% +4.3% +12.8% ➖ noise
9 datafusion:arrow +27.3% +11.6% +14.1% +12.8% 🚨 regression
9 datafusion:vortex-compact +17.7% +11.6% +5.5% +12.8% ➖ noise
9 datafusion:vortex-file-compressed +18.3% +11.6% +6.0% +12.8% ➖ noise
9 duckdb:duckdb +9.6% +11.6% -1.8% +12.8% ➖ noise
9 duckdb:vortex-compact +5.4% +11.6% -5.5% +12.8% ➖ noise
9 duckdb:vortex-file-compressed +10.7% +11.6% -0.8% +12.8% ➖ noise
10 datafusion:arrow +19.9% +10.0% +9.0% +12.8% ➖ noise
10 datafusion:vortex-compact +16.8% +10.0% +6.2% +12.8% ➖ noise
10 datafusion:vortex-file-compressed +17.6% +10.0% +6.9% +12.8% ➖ noise
10 duckdb:duckdb +3.5% +10.0% -5.9% +12.8% ➖ noise
10 duckdb:vortex-compact +7.4% +10.0% -2.4% +12.8% ➖ noise
10 duckdb:vortex-file-compressed +11.9% +10.0% +1.7% +12.8% ➖ noise
11 datafusion:arrow +1.0% +9.0% -7.3% +12.8% ➖ noise
11 datafusion:vortex-compact +15.8% +9.0% +6.3% +12.8% ➖ noise
11 datafusion:vortex-file-compressed +18.4% +9.0% +8.6% +12.8% ➖ noise
11 duckdb:duckdb +7.5% +9.0% -1.4% +12.8% ➖ noise
11 duckdb:vortex-compact +6.9% +9.0% -1.9% +12.8% ➖ noise
11 duckdb:vortex-file-compressed +8.3% +9.0% -0.6% +12.8% ➖ noise
12 datafusion:arrow +30.3% +14.5% +13.8% +18.5% ➖ noise
12 datafusion:vortex-compact +13.2% +14.5% -1.1% +12.8% ➖ noise
12 datafusion:vortex-file-compressed +18.6% +14.5% +3.6% +12.8% ➖ noise
12 duckdb:duckdb +8.2% +14.5% -5.6% +12.8% ➖ noise
12 duckdb:vortex-compact +7.1% +14.5% -6.5% +14.6% ➖ noise
12 duckdb:vortex-file-compressed +5.7% +14.5% -7.7% +13.4% ➖ noise
13 datafusion:arrow +10.5% +13.6% -2.8% +12.8% ➖ noise
13 datafusion:vortex-compact +14.0% +13.6% +0.3% +12.8% ➖ noise
13 datafusion:vortex-file-compressed +15.9% +13.6% +2.0% +12.8% ➖ noise
13 duckdb:duckdb +7.7% +13.6% -5.2% +12.8% ➖ noise
13 duckdb:vortex-compact +6.8% +13.6% -6.0% +12.8% ➖ noise
13 duckdb:vortex-file-compressed +11.9% +13.6% -1.6% +12.8% ➖ noise
14 datafusion:arrow +40.0% +5.0% +33.3% +12.8% 🚨 regression
14 datafusion:vortex-compact +11.5% +5.0% +6.1% +12.8% ➖ noise
14 datafusion:vortex-file-compressed +15.0% +5.0% +9.4% +12.8% ➖ noise
14 duckdb:duckdb +6.3% +5.0% +1.2% +12.8% ➖ noise
14 duckdb:vortex-compact +11.6% +5.0% +6.3% +12.8% ➖ noise
14 duckdb:vortex-file-compressed +3.9% +5.0% -1.1% +12.8% ➖ noise
15 datafusion:arrow +30.6% +9.3% +19.4% +12.8% 🚨 regression
15 datafusion:vortex-compact +10.9% +9.3% +1.5% +12.8% ➖ noise
15 datafusion:vortex-file-compressed +16.6% +9.3% +6.6% +12.8% ➖ noise
15 duckdb:duckdb +5.1% +9.3% -3.8% +12.8% ➖ noise
15 duckdb:vortex-compact +5.2% +9.3% -3.8% +12.8% ➖ noise
15 duckdb:vortex-file-compressed +10.3% +9.3% +0.9% +12.8% ➖ noise
16 datafusion:arrow +14.6% +12.7% +1.8% +12.8% ➖ noise
16 datafusion:vortex-compact +16.0% +12.7% +3.0% +12.8% ➖ noise
16 datafusion:vortex-file-compressed +9.7% +12.7% -2.6% +12.8% ➖ noise
16 duckdb:duckdb +4.4% +12.7% -7.3% +12.8% ➖ noise
16 duckdb:vortex-compact +9.8% +12.7% -2.5% +12.8% ➖ noise
16 duckdb:vortex-file-compressed +9.0% +12.7% -3.3% +12.8% ➖ noise
17 datafusion:arrow +30.2% +17.8% +10.5% +12.8% ➖ noise
17 datafusion:vortex-compact +18.5% +17.8% +0.6% +12.8% ➖ noise
17 datafusion:vortex-file-compressed +24.1% +17.8% +5.4% +12.8% ➖ noise
17 duckdb:duckdb +7.2% +17.8% -9.0% +12.8% ➖ noise
17 duckdb:vortex-compact +10.4% +17.8% -6.3% +12.8% ➖ noise
17 duckdb:vortex-file-compressed +12.2% +17.8% -4.7% +13.1% ➖ noise
18 datafusion:arrow +25.6% +11.6% +12.6% +12.8% ➖ noise
18 datafusion:vortex-compact +23.1% +11.6% +10.3% +12.8% ➖ noise
18 datafusion:vortex-file-compressed +19.5% +11.6% +7.1% +12.8% ➖ noise
18 duckdb:duckdb +4.9% +11.6% -6.0% +12.8% ➖ noise
18 duckdb:vortex-compact +9.9% +11.6% -1.5% +12.8% ➖ noise
18 duckdb:vortex-file-compressed +6.3% +11.6% -4.7% +12.8% ➖ noise
19 datafusion:arrow +44.8% -1.2% +46.5% +12.8% 🚨 regression
19 datafusion:vortex-compact +7.7% -1.2% +8.9% +13.0% ➖ noise
19 datafusion:vortex-file-compressed +13.8% -1.2% +15.2% +14.4% 🚨 regression
19 duckdb:duckdb +8.5% -1.2% +9.8% +12.8% ➖ noise
19 duckdb:vortex-compact +13.1% -1.2% +14.5% +12.8% 🚨 regression
19 duckdb:vortex-file-compressed +17.4% -1.2% +18.8% +12.8% 🚨 regression
20 datafusion:arrow +29.9% +13.3% +14.6% +12.8% 🚨 regression
20 datafusion:vortex-compact +13.5% +13.3% +0.2% +12.8% ➖ noise
20 datafusion:vortex-file-compressed +16.7% +13.3% +2.9% +12.8% ➖ noise
20 duckdb:duckdb +4.8% +13.3% -7.5% +12.8% ➖ noise
20 duckdb:vortex-compact +7.0% +13.3% -5.6% +12.8% ➖ noise
20 duckdb:vortex-file-compressed +10.7% +13.3% -2.3% +12.8% ➖ noise
21 datafusion:arrow +20.0% +13.8% +5.5% +12.8% ➖ noise
21 datafusion:vortex-compact +15.4% +13.8% +1.3% +12.8% ➖ noise
21 datafusion:vortex-file-compressed +21.0% +13.8% +6.3% +12.8% ➖ noise
21 duckdb:duckdb +8.2% +13.8% -5.0% +12.8% ➖ noise
21 duckdb:vortex-compact +14.9% +13.8% +0.9% +12.8% ➖ noise
21 duckdb:vortex-file-compressed +15.0% +13.8% +1.0% +12.8% ➖ noise
22 datafusion:arrow +15.5% +8.7% +6.3% +12.8% ➖ noise
22 datafusion:vortex-compact +6.6% +8.7% -1.9% +12.8% ➖ noise
22 datafusion:vortex-file-compressed +14.8% +8.7% +5.6% +12.8% ➖ noise
22 duckdb:duckdb +5.7% +8.7% -2.8% +12.8% ➖ noise
22 duckdb:vortex-compact +9.9% +8.7% +1.1% +12.8% ➖ noise
22 duckdb:vortex-file-compressed +10.8% +8.7% +1.9% +12.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.0%
Vortex (geomean): 0.956x ➖
Parquet (geomean): 0.986x ➖
Shifts: Parquet (control) -1.4% · Median polish +0.3%


datafusion / vortex-file-compressed (0.954x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 38030683 34910627 1.09
fineweb_q01/datafusion:vortex-file-compressed 603737284 823808200 0.73
fineweb_q02/datafusion:vortex-file-compressed 846744416 694761821 1.22
fineweb_q03/datafusion:vortex-file-compressed 1373217426 1581209431 0.87
fineweb_q04/datafusion:vortex-file-compressed 1350701503 1666084598 0.81
fineweb_q05/datafusion:vortex-file-compressed 1359129477 1615600553 0.84
fineweb_q06/datafusion:vortex-file-compressed 2067557330 1998028490 1.03
fineweb_q07/datafusion:vortex-file-compressed 1470389374 1484765446 0.99
fineweb_q08/datafusion:vortex-file-compressed 580809848 524387099 1.11
datafusion / vortex-compact (0.961x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 34992264 34996644 1.00
fineweb_q01/datafusion:vortex-compact 464005689 593332445 0.78
fineweb_q02/datafusion:vortex-compact 597367407 586448555 1.02
fineweb_q03/datafusion:vortex-compact 1311490868 1356323703 0.97
fineweb_q04/datafusion:vortex-compact 1581668324 1593041769 0.99
fineweb_q05/datafusion:vortex-compact 1387605833 1390836201 1.00
fineweb_q06/datafusion:vortex-compact 1362611038 1455203849 0.94
fineweb_q07/datafusion:vortex-compact 1273574436 1179549885 1.08
fineweb_q08/datafusion:vortex-compact 375377548 414518955 0.91
datafusion / parquet (0.992x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1265173990 1093154025 1.16
fineweb_q01/datafusion:parquet 2176675575 2093982175 1.04
fineweb_q02/datafusion:parquet 2227903657 2055290789 1.08
fineweb_q03/datafusion:parquet 2042059041 1950131470 1.05
fineweb_q04/datafusion:parquet 1994665179 2029287308 0.98
fineweb_q05/datafusion:parquet 1983824276 2472998207 0.80
fineweb_q06/datafusion:parquet 1892533173 2064942684 0.92
fineweb_q07/datafusion:parquet 2090545428 2297764969 0.91
fineweb_q08/datafusion:parquet 2006828240 1941957460 1.03
duckdb / vortex-file-compressed (0.951x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 107906878 141620144 0.76
fineweb_q01/duckdb:vortex-file-compressed 666200828 699769785 0.95
fineweb_q02/duckdb:vortex-file-compressed 470608769 604007169 0.78
fineweb_q03/duckdb:vortex-file-compressed 1501022108 1452303848 1.03
fineweb_q04/duckdb:vortex-file-compressed 1600168461 1575408762 1.02
fineweb_q05/duckdb:vortex-file-compressed 1660717281 1488617811 1.12
fineweb_q06/duckdb:vortex-file-compressed 1767352894 1789954385 0.99
fineweb_q07/duckdb:vortex-file-compressed 1462411925 1565014896 0.93
fineweb_q08/duckdb:vortex-file-compressed 623421690 601105084 1.04
duckdb / vortex-compact (0.959x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 84706077 89123232 0.95
fineweb_q01/duckdb:vortex-compact 584961799 605779299 0.97
fineweb_q02/duckdb:vortex-compact 679456834 616786114 1.10
fineweb_q03/duckdb:vortex-compact 1691825472 1675010241 1.01
fineweb_q04/duckdb:vortex-compact 1811286004 1771467496 1.02
fineweb_q05/duckdb:vortex-compact 1664221314 1630036604 1.02
fineweb_q06/duckdb:vortex-compact 1547887842 1577392451 0.98
fineweb_q07/duckdb:vortex-compact 1432070820 1684736289 0.85
fineweb_q08/duckdb:vortex-compact 446075789 578621282 0.77
duckdb / parquet (0.980x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1218048005 1194289956 1.02
fineweb_q01/duckdb:parquet 1390339703 1450955635 0.96
fineweb_q02/duckdb:parquet 1447392960 1597308312 0.91
fineweb_q03/duckdb:parquet 3845585872 4031057040 0.95
fineweb_q04/duckdb:parquet 2310004665 2201375761 1.05
fineweb_q05/duckdb:parquet 2246037613 2140073505 1.05
fineweb_q06/duckdb:parquet 4646308758 4584744140 1.01
fineweb_q07/duckdb:parquet 2898845885 3100414280 0.93
fineweb_q08/duckdb:parquet 1117236952 1180910691 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -0.0% +8.6% -8.0% +229.1% ➖ noise
0 datafusion:vortex-file-compressed +8.9% +8.6% +0.3% +195.6% ➖ noise
0 duckdb:vortex-compact -5.0% +8.6% -12.5% +66.6% ➖ noise
0 duckdb:vortex-file-compressed -23.8% +8.6% -29.9% +58.6% ➖ noise
1 datafusion:vortex-compact -21.8% -0.2% -21.6% +74.0% ➖ noise
1 datafusion:vortex-file-compressed -26.7% -0.2% -26.6% +55.2% ➖ noise
1 duckdb:vortex-compact -3.4% -0.2% -3.2% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -4.8% -0.2% -4.6% +37.9% ➖ noise
2 datafusion:vortex-compact +1.9% -0.9% +2.8% +49.1% ➖ noise
2 datafusion:vortex-file-compressed +21.9% -0.9% +23.0% +78.3% ➖ noise
2 duckdb:vortex-compact +10.2% -0.9% +11.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -22.1% -0.9% -21.4% +32.9% ➖ noise
3 datafusion:vortex-compact -3.3% -0.1% -3.3% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -13.2% -0.1% -13.1% +30.0% ➖ noise
3 duckdb:vortex-compact +1.0% -0.1% +1.1% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +3.4% -0.1% +3.4% +30.0% ➖ noise
4 datafusion:vortex-compact -0.7% +1.6% -2.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -18.9% +1.6% -20.2% +30.0% ➖ noise
4 duckdb:vortex-compact +2.2% +1.6% +0.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +1.6% +1.6% +0.0% +30.0% ➖ noise
5 datafusion:vortex-compact -0.2% -8.2% +8.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -15.9% -8.2% -8.3% +30.0% ➖ noise
5 duckdb:vortex-compact +2.1% -8.2% +11.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +11.6% -8.2% +21.6% +30.0% ➖ noise
6 datafusion:vortex-compact -6.4% -3.6% -2.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +3.5% -3.6% +7.4% +36.4% ➖ noise
6 duckdb:vortex-compact -1.9% -3.6% +1.8% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -1.3% -3.6% +2.5% +30.0% ➖ noise
7 datafusion:vortex-compact +8.0% -7.8% +17.1% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -1.0% -7.8% +7.4% +30.0% ➖ noise
7 duckdb:vortex-compact -15.0% -7.8% -7.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -6.6% -7.8% +1.3% +30.0% ➖ noise
8 datafusion:vortex-compact -9.4% -1.1% -8.4% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +10.8% -1.1% +12.0% +30.0% ➖ noise
8 duckdb:vortex-compact -22.9% -1.1% -22.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +3.7% -1.1% +4.9% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 0.976x ➖
Parquet (geomean): 0.983x ➖
Shifts: Parquet (control) -1.7% · Median polish -1.2%


duckdb / vortex-file-compressed (0.993x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12037679 12339454 0.98
statpopgen_q01/duckdb:vortex-file-compressed 27949988 28131692 0.99
statpopgen_q02/duckdb:vortex-file-compressed 524185181 561785263 0.93
statpopgen_q03/duckdb:vortex-file-compressed 1037827342 1069550399 0.97
statpopgen_q04/duckdb:vortex-file-compressed 1085094836 1056909178 1.03
statpopgen_q05/duckdb:vortex-file-compressed 502033941 486166497 1.03
statpopgen_q06/duckdb:vortex-file-compressed 1559658281 1532930911 1.02
statpopgen_q07/duckdb:vortex-file-compressed 204517072 206958509 0.99
statpopgen_q08/duckdb:vortex-file-compressed 237137497 238902259 0.99
statpopgen_q09/duckdb:vortex-file-compressed 838819579 846251353 0.99
statpopgen_q10/duckdb:vortex-file-compressed 2557671336 2556639042 1.00
duckdb / vortex-compact (0.960x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11622683 11659457 1.00
statpopgen_q01/duckdb:vortex-compact 212478568 213581254 0.99
statpopgen_q02/duckdb:vortex-compact 541409931 565296698 0.96
statpopgen_q03/duckdb:vortex-compact 1154320186 1165336806 0.99
statpopgen_q04/duckdb:vortex-compact 1157426389 1234771954 0.94
statpopgen_q05/duckdb:vortex-compact 572788574 589164689 0.97
statpopgen_q06/duckdb:vortex-compact 1515375557 1577209481 0.96
statpopgen_q07/duckdb:vortex-compact 877387718 915163694 0.96
statpopgen_q08/duckdb:vortex-compact 905408564 946346933 0.96
statpopgen_q09/duckdb:vortex-compact 917126318 1000631389 0.92
statpopgen_q10/duckdb:vortex-compact 2579629957 2804233887 0.92
duckdb / parquet (0.983x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 295042792 307015130 0.96
statpopgen_q01/duckdb:parquet 380906705 382756387 1.00
statpopgen_q02/duckdb:parquet 757055633 767971751 0.99
statpopgen_q03/duckdb:parquet 1179399255 1206169427 0.98
statpopgen_q04/duckdb:parquet 1188475022 1196236558 0.99
statpopgen_q05/duckdb:parquet 792730040 816374407 0.97
statpopgen_q06/duckdb:parquet 1424652289 1426875387 1.00
statpopgen_q07/duckdb:parquet 839251520 849072910 0.99
statpopgen_q08/duckdb:parquet 851243111 850404760 1.00
statpopgen_q09/duckdb:parquet 994918160 1034920410 0.96
statpopgen_q10/duckdb:parquet 2187932673 2241858120 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -0.3% -3.9% +3.7% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -2.4% -3.9% +1.5% +10.0% ➖ noise
1 duckdb:vortex-compact -0.5% -0.5% -0.0% +40.8% ➖ noise
1 duckdb:vortex-file-compressed -0.6% -0.5% -0.2% +217.0% ➖ noise
2 duckdb:vortex-compact -4.2% -1.4% -2.8% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -6.7% -1.4% -5.3% +10.0% ➖ noise
3 duckdb:vortex-compact -0.9% -2.2% +1.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -3.0% -2.2% -0.8% +10.0% ➖ noise
4 duckdb:vortex-compact -6.3% -0.6% -5.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.7% -0.6% +3.3% +10.0% ➖ noise
5 duckdb:vortex-compact -2.8% -2.9% +0.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.3% -2.9% +6.3% +10.0% ➖ noise
6 duckdb:vortex-compact -3.9% -0.2% -3.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.7% -0.2% +1.9% +10.0% ➖ noise
7 duckdb:vortex-compact -4.1% -1.2% -3.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.2% -1.2% -0.0% +10.0% ➖ noise
8 duckdb:vortex-compact -4.3% +0.1% -4.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.7% +0.1% -0.8% +10.0% ➖ noise
9 duckdb:vortex-compact -8.3% -3.9% -4.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.9% -3.9% +3.1% +10.0% ➖ noise
10 duckdb:vortex-compact -8.0% -2.4% -5.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.0% -2.4% +2.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.887x ✅
Parquet (geomean): 0.952x ➖


unknown / unknown (0.935x ➖, 9↑ 0↓)
name PR 024dacb (ns) base 971aa1c (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 388805 384969 1.01
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1018468 1045444 0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8240944539 8639578833 0.95
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8198238541 8499025250 0.96
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7859764 7884931 1.00
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7123048 7900221 0.90
random-access/feature-vectors/uniform/lance-tokio-local-disk 1202830 1230746 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1856383 1905171 0.97
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8214397167 8427756064 0.97
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8257314880 8539270904 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12974965 13928494 0.93
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12876193 13733080 0.94
random-access/lance-tokio-local-disk 640362 663413 0.97
random-access/lance-tokio-local-disk-footer 1294837 1328273 0.97
random-access/nested-lists/correlated/lance-tokio-local-disk 232786 240358 0.97
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 574050 594013 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk 125077838 133898873 0.93
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 124813939 133697300 0.93
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 566485 700025 0.81
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 583479 686664 0.85
random-access/nested-lists/uniform/lance-tokio-local-disk 1016685 1042246 0.98
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1370844 1412236 0.97
random-access/nested-lists/uniform/parquet-tokio-local-disk 125319004 133946903 0.94
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 124892193 130978583 0.95
random-access/nested-lists/uniform/vortex-tokio-local-disk 2103608 2253733 0.93
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2080225 2244599 0.93
random-access/nested-structs/correlated/lance-tokio-local-disk 367976 379901 0.97
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 547509 565449 0.97
random-access/nested-structs/correlated/parquet-tokio-local-disk 22561074 24260303 0.93
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 22472072 24399304 0.92
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 688788 813699 0.85
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 722671 831417 0.87
random-access/nested-structs/uniform/lance-tokio-local-disk 2557692 2635700 0.97
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2754459 2860874 0.96
random-access/nested-structs/uniform/parquet-tokio-local-disk 22217622 24247777 0.92
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 22081687 23818758 0.93
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚀 1522364 1753856 0.87
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1627570 1727094 0.94
random-access/parquet-tokio-local-disk 164189001 171422564 0.96
random-access/parquet-tokio-local-disk-footer 166865819 170888825 0.98
random-access/taxi/correlated/lance-tokio-local-disk 927369 971043 0.96
random-access/taxi/correlated/lance-tokio-local-disk-footer 1814644 1923625 0.94
random-access/taxi/correlated/parquet-tokio-local-disk 250640437 256723869 0.98
random-access/taxi/correlated/parquet-tokio-local-disk-footer 250530530 256935866 0.98
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1528062 1959317 0.78
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1681181 1979862 0.85
random-access/taxi/uniform/lance-tokio-local-disk 9447581 9780625 0.97
random-access/taxi/uniform/lance-tokio-local-disk-footer 10002471 10558741 0.95
random-access/taxi/uniform/parquet-tokio-local-disk 265306216 272830671 0.97
random-access/taxi/uniform/parquet-tokio-local-disk-footer 263874772 273260006 0.97
random-access/taxi/uniform/vortex-tokio-local-disk 4430733 4896607 0.90
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4408485 4862154 0.91
random-access/vortex-tokio-local-disk 🚀 1171474 1336811 0.88
random-access/vortex-tokio-local-disk-footer 🚀 1179430 1374371 0.86

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.4%
Vortex (geomean): 0.934x ➖
Parquet (geomean): 0.955x ➖
Shifts: Parquet (control) -4.5% · Median polish -6.4%


datafusion / vortex-file-compressed (0.912x ➖, 7↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 388838492 417651941 0.93
tpch_q02/datafusion:vortex-file-compressed 103843977 114502330 0.91
tpch_q03/datafusion:vortex-file-compressed 213421188 235000102 0.91
tpch_q04/datafusion:vortex-file-compressed 110443512 120575203 0.92
tpch_q05/datafusion:vortex-file-compressed 🚀 362933344 404717704 0.90
tpch_q06/datafusion:vortex-file-compressed 36467259 38306021 0.95
tpch_q07/datafusion:vortex-file-compressed 🚀 492520467 551327407 0.89
tpch_q08/datafusion:vortex-file-compressed 348065129 386443180 0.90
tpch_q09/datafusion:vortex-file-compressed 🚀 618157291 688910635 0.90
tpch_q10/datafusion:vortex-file-compressed 223261632 246261554 0.91
tpch_q11/datafusion:vortex-file-compressed 79962398 87259896 0.92
tpch_q12/datafusion:vortex-file-compressed 115359410 126497270 0.91
tpch_q13/datafusion:vortex-file-compressed 212790460 228697426 0.93
tpch_q14/datafusion:vortex-file-compressed 51991614 55088215 0.94
tpch_q15/datafusion:vortex-file-compressed 95363141 104906069 0.91
tpch_q16/datafusion:vortex-file-compressed 74976181 82144025 0.91
tpch_q17/datafusion:vortex-file-compressed 🚀 618222489 694413374 0.89
tpch_q18/datafusion:vortex-file-compressed 🚀 821496831 929904241 0.88
tpch_q19/datafusion:vortex-file-compressed 68240415 72269234 0.94
tpch_q20/datafusion:vortex-file-compressed 🚀 160403766 180649646 0.89
tpch_q21/datafusion:vortex-file-compressed 🚀 646968646 730628057 0.89
tpch_q22/datafusion:vortex-file-compressed 63501475 66527757 0.95
datafusion / vortex-compact (0.922x ➖, 5↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 428465965 459356114 0.93
tpch_q02/datafusion:vortex-compact 107116407 118807622 0.90
tpch_q03/datafusion:vortex-compact 🚀 212745412 246056631 0.86
tpch_q04/datafusion:vortex-compact 118649148 131659824 0.90
tpch_q05/datafusion:vortex-compact 🚀 368661311 427417805 0.86
tpch_q06/datafusion:vortex-compact 57829932 63651991 0.91
tpch_q07/datafusion:vortex-compact 🚀 510062766 577308528 0.88
tpch_q08/datafusion:vortex-compact 🚀 350443521 399099671 0.88
tpch_q09/datafusion:vortex-compact 🚀 621584097 704389696 0.88
tpch_q10/datafusion:vortex-compact 241629498 259159659 0.93
tpch_q11/datafusion:vortex-compact 80405632 87710013 0.92
tpch_q12/datafusion:vortex-compact 157670434 162235545 0.97
tpch_q13/datafusion:vortex-compact 260011221 272619335 0.95
tpch_q14/datafusion:vortex-compact 68459893 72501948 0.94
tpch_q15/datafusion:vortex-compact 152054363 158369261 0.96
tpch_q16/datafusion:vortex-compact 77125450 82114267 0.94
tpch_q17/datafusion:vortex-compact 627114522 676660705 0.93
tpch_q18/datafusion:vortex-compact 825442136 884647423 0.93
tpch_q19/datafusion:vortex-compact 123641180 123319657 1.00
tpch_q20/datafusion:vortex-compact 183192508 198384678 0.92
tpch_q21/datafusion:vortex-compact 648774425 694624532 0.93
tpch_q22/datafusion:vortex-compact 70160054 73481063 0.95
datafusion / parquet (0.933x ➖, 1↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 441317965 485584481 0.91
tpch_q02/datafusion:parquet 169296820 182973737 0.93
tpch_q03/datafusion:parquet 276099071 296483495 0.93
tpch_q04/datafusion:parquet 126532418 134618584 0.94
tpch_q05/datafusion:parquet 429494484 468809629 0.92
tpch_q06/datafusion:parquet 121186322 124521939 0.97
tpch_q07/datafusion:parquet 594629372 653902524 0.91
tpch_q08/datafusion:parquet 451994744 493224025 0.92
tpch_q09/datafusion:parquet 720227558 798154006 0.90
tpch_q10/datafusion:parquet 490495208 525424806 0.93
tpch_q11/datafusion:parquet 114433283 123052082 0.93
tpch_q12/datafusion:parquet 197579066 198607862 0.99
tpch_q13/datafusion:parquet 323993832 344238337 0.94
tpch_q14/datafusion:parquet 154452784 163050106 0.95
tpch_q15/datafusion:parquet 241519567 260347682 0.93
tpch_q16/datafusion:parquet 123171027 132138582 0.93
tpch_q17/datafusion:parquet 🚀 665269885 743260961 0.90
tpch_q18/datafusion:parquet 863800839 938898569 0.92
tpch_q19/datafusion:parquet 255243328 264158485 0.97
tpch_q20/datafusion:parquet 288719746 304379103 0.95
tpch_q21/datafusion:parquet 682158224 744567684 0.92
tpch_q22/datafusion:parquet 212836946 221067293 0.96
datafusion / arrow (0.886x ✅, 14↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 588798882 648494283 0.91
tpch_q02/datafusion:arrow 162769608 174837840 0.93
tpch_q03/datafusion:arrow 🚀 451585159 526516370 0.86
tpch_q04/datafusion:arrow 🚀 337810940 382806236 0.88
tpch_q05/datafusion:arrow 921033837 1021984926 0.90
tpch_q06/datafusion:arrow 🚀 277086130 314917132 0.88
tpch_q07/datafusion:arrow 🚀 1114109760 1272988698 0.88
tpch_q08/datafusion:arrow 🚀 1093206436 1244484314 0.88
tpch_q09/datafusion:arrow 🚀 1300290104 1450524906 0.90
tpch_q10/datafusion:arrow 🚀 560407849 660525395 0.85
tpch_q11/datafusion:arrow 137910299 147742445 0.93
tpch_q12/datafusion:arrow 🚀 669516708 816213153 0.82
tpch_q13/datafusion:arrow 504973045 518488457 0.97
tpch_q14/datafusion:arrow 🚀 307909353 365487889 0.84
tpch_q15/datafusion:arrow 🚀 670950841 799126954 0.84
tpch_q16/datafusion:arrow 103597985 111864938 0.93
tpch_q17/datafusion:arrow 🚀 1291621960 1476891841 0.87
tpch_q18/datafusion:arrow 🚀 1827352534 2087063357 0.88
tpch_q19/datafusion:arrow 🚀 470694545 543942448 0.87
tpch_q20/datafusion:arrow 🚀 475420106 549861671 0.86
tpch_q21/datafusion:arrow 2961806617 3207757830 0.92
tpch_q22/datafusion:arrow 131437495 143298512 0.92
duckdb / vortex-file-compressed (0.948x ➖, 1↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 172377558 174497732 0.99
tpch_q02/duckdb:vortex-file-compressed 52972744 55283956 0.96
tpch_q03/duckdb:vortex-file-compressed 122905206 133374977 0.92
tpch_q04/duckdb:vortex-file-compressed 160691963 170922495 0.94
tpch_q05/duckdb:vortex-file-compressed 138361174 144814287 0.96
tpch_q06/duckdb:vortex-file-compressed 🚀 32405580 38280452 0.85
tpch_q07/duckdb:vortex-file-compressed 134225865 142145940 0.94
tpch_q08/duckdb:vortex-file-compressed 168673866 178839871 0.94
tpch_q09/duckdb:vortex-file-compressed 390596894 401838532 0.97
tpch_q10/duckdb:vortex-file-compressed 188936578 198284045 0.95
tpch_q11/duckdb:vortex-file-compressed 32459119 34175990 0.95
tpch_q12/duckdb:vortex-file-compressed 99385455 103831776 0.96
tpch_q13/duckdb:vortex-file-compressed 229138476 239303860 0.96
tpch_q14/duckdb:vortex-file-compressed 55023773 57044498 0.96
tpch_q15/duckdb:vortex-file-compressed 89818697 96144906 0.93
tpch_q16/duckdb:vortex-file-compressed 76463670 82729465 0.92
tpch_q17/duckdb:vortex-file-compressed 94613467 96764670 0.98
tpch_q18/duckdb:vortex-file-compressed 283296432 297554233 0.95
tpch_q19/duckdb:vortex-file-compressed 78592925 80672776 0.97
tpch_q20/duckdb:vortex-file-compressed 150523372 160685624 0.94
tpch_q21/duckdb:vortex-file-compressed 483222073 512128358 0.94
tpch_q22/duckdb:vortex-file-compressed 65130752 66528387 0.98
duckdb / vortex-compact (0.954x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 227802526 229540960 0.99
tpch_q02/duckdb:vortex-compact 57261995 60408683 0.95
tpch_q03/duckdb:vortex-compact 137535292 145847271 0.94
tpch_q04/duckdb:vortex-compact 171090683 183780226 0.93
tpch_q05/duckdb:vortex-compact 163621455 171049256 0.96
tpch_q06/duckdb:vortex-compact 53955542 56253987 0.96
tpch_q07/duckdb:vortex-compact 171600659 179121454 0.96
tpch_q08/duckdb:vortex-compact 185145940 196669588 0.94
tpch_q09/duckdb:vortex-compact 426447142 445574969 0.96
tpch_q10/duckdb:vortex-compact 218861048 227504139 0.96
tpch_q11/duckdb:vortex-compact 38528019 40689455 0.95
tpch_q12/duckdb:vortex-compact 162152062 167574612 0.97
tpch_q13/duckdb:vortex-compact 274785241 289985397 0.95
tpch_q14/duckdb:vortex-compact 74748571 75986245 0.98
tpch_q15/duckdb:vortex-compact 114885114 120430933 0.95
tpch_q16/duckdb:vortex-compact 79514941 82756874 0.96
tpch_q17/duckdb:vortex-compact 108167715 115222301 0.94
tpch_q18/duckdb:vortex-compact 286660624 302378781 0.95
tpch_q19/duckdb:vortex-compact 95643197 99447522 0.96
tpch_q20/duckdb:vortex-compact 183859883 195762568 0.94
tpch_q21/duckdb:vortex-compact 515885560 557533009 0.93
tpch_q22/duckdb:vortex-compact 71213522 74235454 0.96
duckdb / parquet (0.976x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 265892859 270354898 0.98
tpch_q02/duckdb:parquet 100357362 102726354 0.98
tpch_q03/duckdb:parquet 210014476 214197350 0.98
tpch_q04/duckdb:parquet 132234835 136120465 0.97
tpch_q05/duckdb:parquet 224583361 231040944 0.97
tpch_q06/duckdb:parquet 74460790 75755237 0.98
tpch_q07/duckdb:parquet 186749836 191230859 0.98
tpch_q08/duckdb:parquet 262709458 268410103 0.98
tpch_q09/duckdb:parquet 471733708 492733093 0.96
tpch_q10/duckdb:parquet 619319221 647592390 0.96
tpch_q11/duckdb:parquet 64308808 65939511 0.98
tpch_q12/duckdb:parquet 131085727 135612458 0.97
tpch_q13/duckdb:parquet 441561800 432354404 1.02
tpch_q14/duckdb:parquet 177265970 181520687 0.98
tpch_q15/duckdb:parquet 102831125 106369712 0.97
tpch_q16/duckdb:parquet 160997415 169843707 0.95
tpch_q17/duckdb:parquet 181575453 184088102 0.99
tpch_q18/duckdb:parquet 360353161 367312047 0.98
tpch_q19/duckdb:parquet 286067876 291955579 0.98
tpch_q20/duckdb:parquet 230597176 234171635 0.98
tpch_q21/duckdb:parquet 565448090 580693640 0.97
tpch_q22/duckdb:parquet 292483620 297475919 0.98
duckdb / duckdb (0.970x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120002786 121127520 0.99
tpch_q02/duckdb:duckdb 48985707 50776477 0.96
tpch_q03/duckdb:duckdb 103609389 107009337 0.97
tpch_q04/duckdb:duckdb 139446283 144240577 0.97
tpch_q05/duckdb:duckdb 118815856 123261986 0.96
tpch_q06/duckdb:duckdb 44520924 45257323 0.98
tpch_q07/duckdb:duckdb 91218113 93374177 0.98
tpch_q08/duckdb:duckdb 117349365 122251602 0.96
tpch_q09/duckdb:duckdb 279498959 289727370 0.96
tpch_q10/duckdb:duckdb 213345643 221794217 0.96
tpch_q11/duckdb:duckdb 18968831 19481314 0.97
tpch_q12/duckdb:duckdb 90087742 91245584 0.99
tpch_q13/duckdb:duckdb 227180116 244415497 0.93
tpch_q14/duckdb:duckdb 77382561 80229558 0.96
tpch_q15/duckdb:duckdb 81268310 83394514 0.97
tpch_q16/duckdb:duckdb 75463916 78986475 0.96
tpch_q17/duckdb:duckdb 87704636 88687476 0.99
tpch_q18/duckdb:duckdb 231286678 247016735 0.94
tpch_q19/duckdb:duckdb 123445064 126545643 0.98
tpch_q20/duckdb:duckdb 117107869 119548274 0.98
tpch_q21/duckdb:duckdb 299326008 309689284 0.97
tpch_q22/duckdb:duckdb 72692262 72380134 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -9.2% -5.5% -4.0% +10.0% ➖ noise
1 datafusion:vortex-compact -6.7% -5.5% -1.3% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -6.9% -5.5% -1.5% +10.0% ➖ noise
1 duckdb:duckdb -0.9% -5.5% +4.8% +10.0% ➖ noise
1 duckdb:vortex-compact -0.8% -5.5% +5.0% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -1.2% -5.5% +4.5% +10.0% ➖ noise
2 datafusion:arrow -6.9% -4.9% -2.1% +10.0% ➖ noise
2 datafusion:vortex-compact -9.8% -4.9% -5.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -9.3% -4.9% -4.6% +10.0% ➖ noise
2 duckdb:duckdb -3.5% -4.9% +1.5% +10.0% ➖ noise
2 duckdb:vortex-compact -5.2% -4.9% -0.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -4.2% -4.9% +0.8% +10.0% ➖ noise
3 datafusion:arrow -14.2% -4.4% -10.2% +10.0% ✅ faster
3 datafusion:vortex-compact -13.5% -4.4% -9.5% +10.0% ✅ faster
3 datafusion:vortex-file-compressed -9.2% -4.4% -5.0% +10.0% ➖ noise
3 duckdb:duckdb -3.2% -4.4% +1.3% +10.0% ➖ noise
3 duckdb:vortex-compact -5.7% -4.4% -1.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -7.8% -4.4% -3.6% +10.0% ➖ noise
4 datafusion:arrow -11.8% -4.4% -7.7% +10.0% ➖ noise
4 datafusion:vortex-compact -9.9% -4.4% -5.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -8.4% -4.4% -4.1% +10.0% ➖ noise
4 duckdb:duckdb -3.3% -4.4% +1.2% +10.0% ➖ noise
4 duckdb:vortex-compact -6.9% -4.4% -2.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -6.0% -4.4% -1.6% +10.0% ➖ noise
5 datafusion:arrow -9.9% -5.6% -4.5% +10.0% ➖ noise
5 datafusion:vortex-compact -13.7% -5.6% -8.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -10.3% -5.6% -5.0% +10.0% ➖ noise
5 duckdb:duckdb -3.6% -5.6% +2.1% +10.0% ➖ noise
5 duckdb:vortex-compact -4.3% -5.6% +1.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.5% -5.6% +1.2% +10.0% ➖ noise
6 datafusion:arrow -12.0% -2.2% -10.0% +10.0% ✅ faster
6 datafusion:vortex-compact -9.1% -2.2% -7.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.8% -2.2% -2.7% +10.0% ➖ noise
6 duckdb:duckdb -1.6% -2.2% +0.6% +10.0% ➖ noise
6 duckdb:vortex-compact -4.1% -2.2% -1.9% +10.1% ➖ noise
6 duckdb:vortex-file-compressed -15.3% -2.2% -13.4% +11.6% ✅ faster
7 datafusion:arrow -12.5% -5.8% -7.1% +10.0% ➖ noise
7 datafusion:vortex-compact -11.6% -5.8% -6.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -10.7% -5.8% -5.2% +10.0% ➖ noise
7 duckdb:duckdb -2.3% -5.8% +3.7% +10.0% ➖ noise
7 duckdb:vortex-compact -4.2% -5.8% +1.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.6% -5.8% +0.2% +10.0% ➖ noise
8 datafusion:arrow -12.2% -5.3% -7.2% +10.0% ➖ noise
8 datafusion:vortex-compact -12.2% -5.3% -7.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -9.9% -5.3% -4.9% +10.0% ➖ noise
8 duckdb:duckdb -4.0% -5.3% +1.4% +10.0% ➖ noise
8 duckdb:vortex-compact -5.9% -5.3% -0.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -5.7% -5.3% -0.4% +10.0% ➖ noise
9 datafusion:arrow -10.4% -7.1% -3.6% +10.0% ➖ noise
9 datafusion:vortex-compact -11.8% -7.1% -5.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -10.3% -7.1% -3.5% +10.0% ➖ noise
9 duckdb:duckdb -3.5% -7.1% +3.8% +10.0% ➖ noise
9 duckdb:vortex-compact -4.3% -7.1% +3.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.8% -7.1% +4.6% +10.0% ➖ noise
10 datafusion:arrow -15.2% -5.5% -10.2% +10.0% ✅ faster
10 datafusion:vortex-compact -6.8% -5.5% -1.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -9.3% -5.5% -4.0% +10.0% ➖ noise
10 duckdb:duckdb -3.8% -5.5% +1.8% +10.0% ➖ noise
10 duckdb:vortex-compact -3.8% -5.5% +1.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -4.7% -5.5% +0.8% +10.0% ➖ noise
11 datafusion:arrow -6.7% -4.8% -2.0% +10.0% ➖ noise
11 datafusion:vortex-compact -8.3% -4.8% -3.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -8.4% -4.8% -3.8% +10.0% ➖ noise
11 duckdb:duckdb -2.6% -4.8% +2.2% +10.0% ➖ noise
11 duckdb:vortex-compact -5.3% -4.8% -0.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -5.0% -4.8% -0.3% +13.2% ➖ noise
12 datafusion:arrow -18.0% -1.9% -16.4% +44.3% ➖ noise
12 datafusion:vortex-compact -2.8% -1.9% -0.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -8.8% -1.9% -7.0% +10.0% ➖ noise
12 duckdb:duckdb -1.3% -1.9% +0.7% +10.0% ➖ noise
12 duckdb:vortex-compact -3.2% -1.9% -1.3% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -4.3% -1.9% -2.4% +10.0% ➖ noise
13 datafusion:arrow -2.6% -2.0% -0.7% +10.0% ➖ noise
13 datafusion:vortex-compact -4.6% -2.0% -2.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -7.0% -2.0% -5.1% +10.0% ➖ noise
13 duckdb:duckdb -7.1% -2.0% -5.2% +10.0% ➖ noise
13 duckdb:vortex-compact -5.2% -2.0% -3.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -4.2% -2.0% -2.3% +10.0% ➖ noise
14 datafusion:arrow -15.8% -3.8% -12.4% +10.0% ✅ faster
14 datafusion:vortex-compact -5.6% -3.8% -1.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -5.6% -3.8% -1.9% +10.0% ➖ noise
14 duckdb:duckdb -3.5% -3.8% +0.3% +10.0% ➖ noise
14 duckdb:vortex-compact -1.6% -3.8% +2.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -3.5% -3.8% +0.3% +10.0% ➖ noise
15 datafusion:arrow -16.0% -5.3% -11.3% +10.0% ✅ faster
15 datafusion:vortex-compact -4.0% -5.3% +1.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -9.1% -5.3% -4.0% +10.0% ➖ noise
15 duckdb:duckdb -2.5% -5.3% +2.9% +10.0% ➖ noise
15 duckdb:vortex-compact -4.6% -5.3% +0.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -6.6% -5.3% -1.4% +10.0% ➖ noise
16 datafusion:arrow -7.4% -6.0% -1.5% +10.0% ➖ noise
16 datafusion:vortex-compact -6.1% -6.0% -0.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -8.7% -6.0% -2.9% +10.0% ➖ noise
16 duckdb:duckdb -4.5% -6.0% +1.6% +10.0% ➖ noise
16 duckdb:vortex-compact -3.9% -6.0% +2.2% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -7.6% -6.0% -1.7% +10.0% ➖ noise
17 datafusion:arrow -12.5% -6.0% -6.9% +10.0% ➖ noise
17 datafusion:vortex-compact -7.3% -6.0% -1.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -11.0% -6.0% -5.2% +10.0% ➖ noise
17 duckdb:duckdb -1.1% -6.0% +5.2% +10.0% ➖ noise
17 duckdb:vortex-compact -6.1% -6.0% -0.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -2.2% -6.0% +4.1% +10.0% ➖ noise
18 datafusion:arrow -12.4% -5.0% -7.8% +10.0% ➖ noise
18 datafusion:vortex-compact -6.7% -5.0% -1.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -11.7% -5.0% -7.0% +10.0% ➖ noise
18 duckdb:duckdb -6.4% -5.0% -1.4% +10.0% ➖ noise
18 duckdb:vortex-compact -5.2% -5.0% -0.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -4.8% -5.0% +0.2% +10.0% ➖ noise
19 datafusion:arrow -13.5% -2.7% -11.1% +10.0% ✅ faster
19 datafusion:vortex-compact +0.3% -2.7% +3.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -5.6% -2.7% -3.0% +10.0% ➖ noise
19 duckdb:duckdb -2.5% -2.7% +0.3% +10.0% ➖ noise
19 duckdb:vortex-compact -3.8% -2.7% -1.2% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -2.6% -2.7% +0.1% +10.0% ➖ noise
20 datafusion:arrow -13.5% -3.4% -10.5% +10.0% ✅ faster
20 datafusion:vortex-compact -7.7% -3.4% -4.5% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -11.2% -3.4% -8.1% +10.0% ➖ noise
20 duckdb:duckdb -2.0% -3.4% +1.4% +10.0% ➖ noise
20 duckdb:vortex-compact -6.1% -3.4% -2.8% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -6.3% -3.4% -3.1% +10.0% ➖ noise
21 datafusion:arrow -7.7% -5.5% -2.2% +10.0% ➖ noise
21 datafusion:vortex-compact -6.6% -5.5% -1.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -11.5% -5.5% -6.2% +10.0% ➖ noise
21 duckdb:duckdb -3.3% -5.5% +2.3% +10.0% ➖ noise
21 duckdb:vortex-compact -7.5% -5.5% -2.0% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -5.6% -5.5% -0.1% +10.0% ➖ noise
22 datafusion:arrow -8.3% -2.7% -5.7% +10.0% ➖ noise
22 datafusion:vortex-compact -4.5% -2.7% -1.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -4.5% -2.7% -1.9% +10.0% ➖ noise
22 duckdb:duckdb +0.4% -2.7% +3.2% +10.0% ➖ noise
22 duckdb:vortex-compact -4.1% -2.7% -1.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -2.1% -2.7% +0.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.5%
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish +1.4%


datafusion / vortex-file-compressed (0.991x ➖, 7↑ 2↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1700017 1621496 1.05
clickbench_q01/datafusion:vortex-file-compressed 19859276 18359622 1.08
clickbench_q02/datafusion:vortex-file-compressed 40408329 38565984 1.05
clickbench_q03/datafusion:vortex-file-compressed 43324964 41867916 1.03
clickbench_q04/datafusion:vortex-file-compressed 287563113 283614393 1.01
clickbench_q05/datafusion:vortex-file-compressed 310476201 302957278 1.02
clickbench_q06/datafusion:vortex-file-compressed 1613767 1673948 0.96
clickbench_q07/datafusion:vortex-file-compressed 22702626 22064397 1.03
clickbench_q08/datafusion:vortex-file-compressed 369150327 354604522 1.04
clickbench_q09/datafusion:vortex-file-compressed 544547906 547143442 1.00
clickbench_q10/datafusion:vortex-file-compressed 77401097 76494101 1.01
clickbench_q11/datafusion:vortex-file-compressed 86387264 84860205 1.02
clickbench_q12/datafusion:vortex-file-compressed 270841433 269418816 1.01
clickbench_q13/datafusion:vortex-file-compressed 422884164 406634094 1.04
clickbench_q14/datafusion:vortex-file-compressed 256850601 248029845 1.04
clickbench_q15/datafusion:vortex-file-compressed 337474877 321844749 1.05
clickbench_q16/datafusion:vortex-file-compressed 656843394 637407471 1.03
clickbench_q17/datafusion:vortex-file-compressed 645968208 638827369 1.01
clickbench_q18/datafusion:vortex-file-compressed 1305637644 1273381764 1.03
clickbench_q19/datafusion:vortex-file-compressed 🚨 34877154 30709996 1.14
clickbench_q20/datafusion:vortex-file-compressed 350040272 343938407 1.02
clickbench_q21/datafusion:vortex-file-compressed 377206821 369275909 1.02
clickbench_q22/datafusion:vortex-file-compressed 453435997 449074289 1.01
clickbench_q23/datafusion:vortex-file-compressed 🚨 679025801 609933266 1.11
clickbench_q24/datafusion:vortex-file-compressed 45758026 43887562 1.04
clickbench_q25/datafusion:vortex-file-compressed 72656073 75232353 0.97
clickbench_q26/datafusion:vortex-file-compressed 47130896 44690487 1.05
clickbench_q27/datafusion:vortex-file-compressed 736798689 718548268 1.03
clickbench_q28/datafusion:vortex-file-compressed 6637190023 6611386107 1.00
clickbench_q29/datafusion:vortex-file-compressed 239586880 245739867 0.97
clickbench_q30/datafusion:vortex-file-compressed 🚀 222730983 251963427 0.88
clickbench_q31/datafusion:vortex-file-compressed 🚀 259298978 292373563 0.89
clickbench_q32/datafusion:vortex-file-compressed 🚀 1135694871 1332396325 0.85
clickbench_q33/datafusion:vortex-file-compressed 🚀 1313953535 1492602054 0.88
clickbench_q34/datafusion:vortex-file-compressed 🚀 1318522248 1504413826 0.88
clickbench_q35/datafusion:vortex-file-compressed 463087856 509236055 0.91
clickbench_q36/datafusion:vortex-file-compressed 🚀 72043322 80682161 0.89
clickbench_q37/datafusion:vortex-file-compressed 35529602 37274049 0.95
clickbench_q38/datafusion:vortex-file-compressed 19577077 19953456 0.98
clickbench_q39/datafusion:vortex-file-compressed 135713257 144189628 0.94
clickbench_q40/datafusion:vortex-file-compressed 🚀 15984289 17874011 0.89
clickbench_q41/datafusion:vortex-file-compressed 15011873 16067508 0.93
clickbench_q42/datafusion:vortex-file-compressed 17590603 18189817 0.97
datafusion / parquet (1.028x ➖, 0↑ 1↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1540223 1637078 0.94
clickbench_q01/datafusion:parquet 18781628 19662048 0.96
clickbench_q02/datafusion:parquet 47231906 47672431 0.99
clickbench_q03/datafusion:parquet 39290636 38217072 1.03
clickbench_q04/datafusion:parquet 301541738 293974902 1.03
clickbench_q05/datafusion:parquet 362851436 344749018 1.05
clickbench_q06/datafusion:parquet 🚨 2167037 1578711 1.37
clickbench_q07/datafusion:parquet 23513561 22547674 1.04
clickbench_q08/datafusion:parquet 373272828 363555778 1.03
clickbench_q09/datafusion:parquet 622362221 602196321 1.03
clickbench_q10/datafusion:parquet 106672112 103196686 1.03
clickbench_q11/datafusion:parquet 130931441 126719621 1.03
clickbench_q12/datafusion:parquet 352630537 345196184 1.02
clickbench_q13/datafusion:parquet 498240163 505268116 0.99
clickbench_q14/datafusion:parquet 345403999 334440900 1.03
clickbench_q15/datafusion:parquet 346925922 332433818 1.04
clickbench_q16/datafusion:parquet 668926004 660323539 1.01
clickbench_q17/datafusion:parquet 669235845 655004671 1.02
clickbench_q18/datafusion:parquet 1351910637 1349402494 1.00
clickbench_q19/datafusion:parquet 30384322 30712784 0.99
clickbench_q20/datafusion:parquet 608142156 596307858 1.02
clickbench_q21/datafusion:parquet 666541805 663883934 1.00
clickbench_q22/datafusion:parquet 979973183 972524816 1.01
clickbench_q23/datafusion:parquet 3791993390 3601921966 1.05
clickbench_q24/datafusion:parquet 84655034 76969337 1.10
clickbench_q25/datafusion:parquet 133287660 130252418 1.02
clickbench_q26/datafusion:parquet 83929565 85191416 0.99
clickbench_q27/datafusion:parquet 1073351142 1022751434 1.05
clickbench_q28/datafusion:parquet 6719900201 6553014238 1.03
clickbench_q29/datafusion:parquet 234932927 241213419 0.97
clickbench_q30/datafusion:parquet 326868499 320826989 1.02
clickbench_q31/datafusion:parquet 372541751 359061343 1.04
clickbench_q32/datafusion:parquet 1248886954 1153437234 1.08
clickbench_q33/datafusion:parquet 1510489018 1466147363 1.03
clickbench_q34/datafusion:parquet 1533269330 1459465088 1.05
clickbench_q35/datafusion:parquet 467758644 459373404 1.02
clickbench_q36/datafusion:parquet 145091868 140782259 1.03
clickbench_q37/datafusion:parquet 57342830 56490017 1.02
clickbench_q38/datafusion:parquet 83855369 81705774 1.03
clickbench_q39/datafusion:parquet 261889292 256354198 1.02
clickbench_q40/datafusion:parquet 30110176 29682843 1.01
clickbench_q41/datafusion:parquet 28600404 27556069 1.04
clickbench_q42/datafusion:parquet 29737306 29250707 1.02
duckdb / vortex-file-compressed (1.012x ➖, 1↑ 2↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 7039553 7009411 1.00
clickbench_q01/duckdb:vortex-file-compressed 11972903 11996200 1.00
clickbench_q02/duckdb:vortex-file-compressed 🚨 28244489 24416071 1.16
clickbench_q03/duckdb:vortex-file-compressed 31178252 30741284 1.01
clickbench_q04/duckdb:vortex-file-compressed 189961379 187507891 1.01
clickbench_q05/duckdb:vortex-file-compressed 177029355 171706898 1.03
clickbench_q06/duckdb:vortex-file-compressed 21085717 20042896 1.05
clickbench_q07/duckdb:vortex-file-compressed 16779736 15486823 1.08
clickbench_q08/duckdb:vortex-file-compressed 266997223 265913206 1.00
clickbench_q09/duckdb:vortex-file-compressed 354514058 341669342 1.04
clickbench_q10/duckdb:vortex-file-compressed 68926249 68481151 1.01
clickbench_q11/duckdb:vortex-file-compressed 81684264 76944416 1.06
clickbench_q12/duckdb:vortex-file-compressed 201664583 192809405 1.05
clickbench_q13/duckdb:vortex-file-compressed 406290048 406133918 1.00
clickbench_q14/duckdb:vortex-file-compressed 234031277 227843640 1.03
clickbench_q15/duckdb:vortex-file-compressed 242616576 242345464 1.00
clickbench_q16/duckdb:vortex-file-compressed 531711416 520860821 1.02
clickbench_q17/duckdb:vortex-file-compressed 425080440 420464675 1.01
clickbench_q18/duckdb:vortex-file-compressed 955563736 933457401 1.02
clickbench_q19/duckdb:vortex-file-compressed 21767771 21031584 1.04
clickbench_q20/duckdb:vortex-file-compressed 334511621 330231413 1.01
clickbench_q21/duckdb:vortex-file-compressed 371227801 360958251 1.03
clickbench_q22/duckdb:vortex-file-compressed 🚀 512138059 573316181 0.89
clickbench_q23/duckdb:vortex-file-compressed 191722689 198986871 0.96
clickbench_q24/duckdb:vortex-file-compressed 🚨 39556368 33898990 1.17
clickbench_q25/duckdb:vortex-file-compressed 75202253 70419226 1.07
clickbench_q26/duckdb:vortex-file-compressed 39366546 39216738 1.00
clickbench_q27/duckdb:vortex-file-compressed 483801661 471726177 1.03
clickbench_q28/duckdb:vortex-file-compressed 3032130012 2989248247 1.01
clickbench_q29/duckdb:vortex-file-compressed 28289522 27893311 1.01
clickbench_q30/duckdb:vortex-file-compressed 195987138 189537047 1.03
clickbench_q31/duckdb:vortex-file-compressed 281284896 283473561 0.99
clickbench_q32/duckdb:vortex-file-compressed 1120892663 1101054201 1.02
clickbench_q33/duckdb:vortex-file-compressed 1059087549 1061904032 1.00
clickbench_q34/duckdb:vortex-file-compressed 1168351416 1151975415 1.01
clickbench_q35/duckdb:vortex-file-compressed 379973618 378938811 1.00
clickbench_q36/duckdb:vortex-file-compressed 27210155 26966191 1.01
clickbench_q37/duckdb:vortex-file-compressed 20952706 19315380 1.08
clickbench_q38/duckdb:vortex-file-compressed 19605062 20231143 0.97
clickbench_q39/duckdb:vortex-file-compressed 40487131 44863244 0.90
clickbench_q40/duckdb:vortex-file-compressed 18660760 20515240 0.91
clickbench_q41/duckdb:vortex-file-compressed 17607886 19331254 0.91
clickbench_q42/duckdb:vortex-file-compressed 19652404 21498392 0.91
duckdb / parquet (0.954x ➖, 2↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 22646992 23068802 0.98
clickbench_q01/duckdb:parquet 29615855 30492473 0.97
clickbench_q02/duckdb:parquet 48903682 52961872 0.92
clickbench_q03/duckdb:parquet 39812290 42159098 0.94
clickbench_q04/duckdb:parquet 202024484 219022756 0.92
clickbench_q05/duckdb:parquet 257082659 280495528 0.92
clickbench_q06/duckdb:parquet 46955380 48739330 0.96
clickbench_q07/duckdb:parquet 31069002 31769329 0.98
clickbench_q08/duckdb:parquet 274224771 297070787 0.92
clickbench_q09/duckdb:parquet 404552801 438040309 0.92
clickbench_q10/duckdb:parquet 83472341 89108984 0.94
clickbench_q11/duckdb:parquet 100671344 108898739 0.92
clickbench_q12/duckdb:parquet 280319327 306811075 0.91
clickbench_q13/duckdb:parquet 478654033 523129712 0.91
clickbench_q14/duckdb:parquet 316452031 346458731 0.91
clickbench_q15/duckdb:parquet 🚀 257050145 287412163 0.89
clickbench_q16/duckdb:parquet 600710581 665697177 0.90
clickbench_q17/duckdb:parquet 503983073 556702280 0.91
clickbench_q18/duckdb:parquet 1048514895 1150327748 0.91
clickbench_q19/duckdb:parquet 27693262 29696019 0.93
clickbench_q20/duckdb:parquet 419402127 462206528 0.91
clickbench_q21/duckdb:parquet 535782351 585841131 0.91
clickbench_q22/duckdb:parquet 911562770 989001393 0.92
clickbench_q23/duckdb:parquet 268845581 281467078 0.96
clickbench_q24/duckdb:parquet 68652909 73195977 0.94
clickbench_q25/duckdb:parquet 163342559 171980366 0.95
clickbench_q26/duckdb:parquet 54755909 57611308 0.95
clickbench_q27/duckdb:parquet 646321158 680914648 0.95
clickbench_q28/duckdb:parquet 4906714478 4875219396 1.01
clickbench_q29/duckdb:parquet 42450241 42281313 1.00
clickbench_q30/duckdb:parquet 311444619 311396756 1.00
clickbench_q31/duckdb:parquet 376283988 375431707 1.00
clickbench_q32/duckdb:parquet 1116541185 1107624417 1.01
clickbench_q33/duckdb:parquet 1117346194 1100481490 1.02
clickbench_q34/duckdb:parquet 1162346479 1143427097 1.02
clickbench_q35/duckdb:parquet 370161150 380584860 0.97
clickbench_q36/duckdb:parquet 🚀 45654441 51040427 0.89
clickbench_q37/duckdb:parquet 34080126 33779160 1.01
clickbench_q38/duckdb:parquet 34865094 35386313 0.99
clickbench_q39/duckdb:parquet 76242199 78076742 0.98
clickbench_q40/duckdb:parquet 20326900 19867702 1.02
clickbench_q41/duckdb:parquet 20459941 20101770 1.02
clickbench_q42/duckdb:parquet 22926045 21675246 1.06
duckdb / duckdb (1.044x ➖, 0↑ 10↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚨 20901954 17078497 1.22
clickbench_q01/duckdb:duckdb 37520928 34326300 1.09
clickbench_q02/duckdb:duckdb 54373245 51843871 1.05
clickbench_q03/duckdb:duckdb 58899973 55881705 1.05
clickbench_q04/duckdb:duckdb 212595014 210591713 1.01
clickbench_q05/duckdb:duckdb 288684790 283269299 1.02
clickbench_q06/duckdb:duckdb 🚨 37961948 33408997 1.14
clickbench_q07/duckdb:duckdb 🚨 38731602 35206844 1.10
clickbench_q08/duckdb:duckdb 278001768 274064208 1.01
clickbench_q09/duckdb:duckdb 397665547 393751779 1.01
clickbench_q10/duckdb:duckdb 120706877 117353149 1.03
clickbench_q11/duckdb:duckdb 128133782 126459402 1.01
clickbench_q12/duckdb:duckdb 264781748 258267766 1.03
clickbench_q13/duckdb:duckdb 448637989 444678476 1.01
clickbench_q14/duckdb:duckdb 289819646 286447663 1.01
clickbench_q15/duckdb:duckdb 245628886 245831174 1.00
clickbench_q16/duckdb:duckdb 565020324 566090488 1.00
clickbench_q17/duckdb:duckdb 476828355 473031952 1.01
clickbench_q18/duckdb:duckdb 1024478881 1013333029 1.01
clickbench_q19/duckdb:duckdb 🚨 39268198 35152081 1.12
clickbench_q20/duckdb:duckdb 477429566 494766069 0.96
clickbench_q21/duckdb:duckdb 465984393 478654973 0.97
clickbench_q22/duckdb:duckdb 535374157 545126313 0.98
clickbench_q23/duckdb:duckdb 258611705 253558172 1.02
clickbench_q24/duckdb:duckdb 65958395 61588400 1.07
clickbench_q25/duckdb:duckdb 153040221 148528529 1.03
clickbench_q26/duckdb:duckdb 65335025 63425621 1.03
clickbench_q27/duckdb:duckdb 553087236 551130379 1.00
clickbench_q28/duckdb:duckdb 4514798094 4494283221 1.00
clickbench_q29/duckdb:duckdb 54259099 50332612 1.08
clickbench_q30/duckdb:duckdb 283670344 279489195 1.01
clickbench_q31/duckdb:duckdb 369805708 366936733 1.01
clickbench_q32/duckdb:duckdb 1127680675 1123687041 1.00
clickbench_q33/duckdb:duckdb 1139055673 1116587522 1.02
clickbench_q34/duckdb:duckdb 1204234328 1197337413 1.01
clickbench_q35/duckdb:duckdb 302694549 304007432 1.00
clickbench_q36/duckdb:duckdb 54355496 54616221 1.00
clickbench_q37/duckdb:duckdb 🚨 32350280 28964508 1.12
clickbench_q38/duckdb:duckdb 🚨 37911266 33207349 1.14
clickbench_q39/duckdb:duckdb 🚨 91160587 78990989 1.15
clickbench_q40/duckdb:duckdb 🚨 31418195 28073795 1.12
clickbench_q41/duckdb:duckdb 🚨 30951154 27111167 1.14
clickbench_q42/duckdb:duckdb 🚨 34201672 29094209 1.18
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +4.8% -3.9% +9.1% +754.4% ➖ noise
0 duckdb:duckdb +22.4% -3.9% +27.3% +275.0% ➖ noise
0 duckdb:vortex-file-compressed +0.4% -3.9% +4.5% +439.7% ➖ noise
1 datafusion:vortex-file-compressed +8.2% -3.7% +12.3% +27.4% ➖ noise
1 duckdb:duckdb +9.3% -3.7% +13.5% +53.6% ➖ noise
1 duckdb:vortex-file-compressed -0.2% -3.7% +3.6% +30.8% ➖ noise
2 datafusion:vortex-file-compressed +4.8% -4.4% +9.5% +10.7% ➖ noise
2 duckdb:duckdb +4.9% -4.4% +9.7% +26.1% ➖ noise
2 duckdb:vortex-file-compressed +15.7% -4.4% +20.9% +15.5% 🚨 regression
3 datafusion:vortex-file-compressed +3.5% -1.5% +5.0% +141.5% ➖ noise
3 duckdb:duckdb +5.4% -1.5% +7.0% +47.2% ➖ noise
3 duckdb:vortex-file-compressed +1.4% -1.5% +2.9% +73.9% ➖ noise
4 datafusion:vortex-file-compressed +1.4% -2.7% +4.2% +10.0% ➖ noise
4 duckdb:duckdb +1.0% -2.7% +3.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.3% -2.7% +4.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.5% -1.8% +4.3% +10.0% ➖ noise
5 duckdb:duckdb +1.9% -1.8% +3.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.1% -1.8% +5.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.6% +15.0% -16.2% +48.6% ➖ noise
6 duckdb:duckdb +13.6% +15.0% -1.2% +20.2% ➖ noise
6 duckdb:vortex-file-compressed +5.2% +15.0% -8.5% +24.2% ➖ noise
7 datafusion:vortex-file-compressed +2.9% +1.0% +1.9% +14.1% ➖ noise
7 duckdb:duckdb +10.0% +1.0% +8.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +8.3% +1.0% +7.3% +12.3% ➖ noise
8 datafusion:vortex-file-compressed +4.1% -2.6% +6.9% +10.0% ➖ noise
8 duckdb:duckdb +1.4% -2.6% +4.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.4% -2.6% +3.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.5% -2.3% +1.9% +10.0% ➖ noise
9 duckdb:duckdb +1.0% -2.3% +3.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +3.8% -2.3% +6.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.2% -1.6% +2.8% +10.0% ➖ noise
10 duckdb:duckdb +2.9% -1.6% +4.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.6% -1.6% +2.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.8% -2.3% +4.2% +10.0% ➖ noise
11 duckdb:duckdb +1.3% -2.3% +3.7% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +6.2% -2.3% +8.6% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.5% -3.4% +4.1% +10.0% ➖ noise
12 duckdb:duckdb +2.5% -3.4% +6.1% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +4.6% -3.4% +8.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +4.0% -5.0% +9.5% +10.0% ➖ noise
13 duckdb:duckdb +0.9% -5.0% +6.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.0% -5.0% +5.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +3.6% -2.9% +6.6% +10.0% ➖ noise
14 duckdb:duckdb +1.2% -2.9% +4.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.7% -2.9% +5.8% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +4.9% -3.4% +8.5% +10.0% ➖ noise
15 duckdb:duckdb -0.1% -3.4% +3.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.1% -3.4% +3.6% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +3.0% -4.4% +7.8% +10.0% ➖ noise
16 duckdb:duckdb -0.2% -4.4% +4.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.1% -4.4% +6.8% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +1.1% -3.8% +5.1% +10.0% ➖ noise
17 duckdb:duckdb +0.8% -3.8% +4.8% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.1% -3.8% +5.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +2.5% -4.4% +7.3% +10.0% ➖ noise
18 duckdb:duckdb +1.1% -4.4% +5.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.4% -4.4% +7.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +13.6% -3.9% +18.2% +34.6% ➖ noise
19 duckdb:duckdb +11.7% -3.9% +16.3% +18.1% ➖ noise
19 duckdb:vortex-file-compressed +3.5% -3.9% +7.8% +20.0% ➖ noise
20 datafusion:vortex-file-compressed +1.8% -3.8% +5.8% +204.4% ➖ noise
20 duckdb:duckdb -3.5% -3.8% +0.3% +83.4% ➖ noise
20 duckdb:vortex-file-compressed +1.3% -3.8% +5.3% +72.7% ➖ noise
21 datafusion:vortex-file-compressed +2.1% -4.2% +6.6% +10.0% ➖ noise
21 duckdb:duckdb -2.6% -4.2% +1.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +2.8% -4.2% +7.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +1.0% -3.6% +4.8% +14.9% ➖ noise
22 duckdb:duckdb -1.8% -3.6% +1.9% +42.4% ➖ noise
22 duckdb:vortex-file-compressed -10.7% -3.6% -7.3% +21.4% ➖ noise
23 datafusion:vortex-file-compressed +11.3% +0.3% +11.0% +48.2% ➖ noise
23 duckdb:duckdb +2.0% +0.3% +1.7% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -3.7% +0.3% -3.9% +17.0% ➖ noise
24 datafusion:vortex-file-compressed +4.3% +1.6% +2.7% +11.2% ➖ noise
24 duckdb:duckdb +7.1% +1.6% +5.4% +32.2% ➖ noise
24 duckdb:vortex-file-compressed +16.7% +1.6% +14.9% +19.1% ➖ noise
25 datafusion:vortex-file-compressed -3.4% -1.4% -2.0% +10.0% ➖ noise
25 duckdb:duckdb +3.0% -1.4% +4.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +6.8% -1.4% +8.3% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +5.5% -3.2% +9.0% +12.2% ➖ noise
26 duckdb:duckdb +3.0% -3.2% +6.5% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +0.4% -3.2% +3.7% +23.3% ➖ noise
27 datafusion:vortex-file-compressed +2.5% -0.2% +2.7% +10.0% ➖ noise
27 duckdb:duckdb +0.4% -0.2% +0.5% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +2.6% -0.2% +2.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.4% +1.6% -1.2% +10.0% ➖ noise
28 duckdb:duckdb +0.5% +1.6% -1.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +1.4% +1.6% -0.2% +10.5% ➖ noise
29 datafusion:vortex-file-compressed -2.5% -1.1% -1.4% +10.0% ➖ noise
29 duckdb:duckdb +7.8% -1.1% +9.0% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +1.4% -1.1% +2.6% +16.1% ➖ noise
30 datafusion:vortex-file-compressed -11.6% +0.9% -12.4% +10.0% ✅ faster
30 duckdb:duckdb +1.5% +0.9% +0.5% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +3.4% +0.9% +2.4% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -11.3% +2.0% -13.0% +10.0% ✅ faster
31 duckdb:duckdb +0.8% +2.0% -1.2% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -0.8% +2.0% -2.7% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -14.8% +4.5% -18.4% +10.0% ✅ faster
32 duckdb:duckdb +0.4% +4.5% -3.9% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +1.8% +4.5% -2.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -12.0% +2.3% -13.9% +10.0% ✅ faster
33 duckdb:duckdb +2.0% +2.3% -0.3% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -0.3% +2.3% -2.5% +21.8% ➖ noise
34 datafusion:vortex-file-compressed -12.4% +3.3% -15.2% +10.0% ✅ faster
34 duckdb:duckdb +0.6% +3.3% -2.7% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +1.4% +3.3% -1.9% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -9.1% -0.5% -8.6% +10.0% ➖ noise
35 duckdb:duckdb -0.4% -0.5% +0.1% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.3% -0.5% +0.8% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -10.7% -4.0% -7.0% +10.0% ➖ noise
36 duckdb:duckdb -0.5% -4.0% +3.7% +16.8% ➖ noise
36 duckdb:vortex-file-compressed +0.9% -4.0% +5.1% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -4.7% +1.2% -5.8% +10.0% ➖ noise
37 duckdb:duckdb +11.7% +1.2% +10.4% +10.0% 🚨 regression
37 duckdb:vortex-file-compressed +8.5% +1.2% +7.2% +11.6% ➖ noise
38 datafusion:vortex-file-compressed -1.9% +0.6% -2.4% +11.1% ➖ noise
38 duckdb:duckdb +14.2% +0.6% +13.5% +14.6% ➖ noise
38 duckdb:vortex-file-compressed -3.1% +0.6% -3.6% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -5.9% -0.1% -5.8% +10.0% ➖ noise
39 duckdb:duckdb +15.4% -0.1% +15.5% +20.2% ➖ noise
39 duckdb:vortex-file-compressed -9.8% -0.1% -9.6% +10.0% ✅ faster
40 datafusion:vortex-file-compressed -10.6% +1.9% -12.2% +10.0% ✅ faster
40 duckdb:duckdb +11.9% +1.9% +9.9% +20.8% ➖ noise
40 duckdb:vortex-file-compressed -9.0% +1.9% -10.7% +16.0% ➖ noise
41 datafusion:vortex-file-compressed -6.6% +2.8% -9.1% +10.0% ✅ faster
41 duckdb:duckdb +14.2% +2.8% +11.1% +10.0% 🚨 regression
41 duckdb:vortex-file-compressed -8.9% +2.8% -11.4% +10.7% ✅ faster
42 datafusion:vortex-file-compressed -3.3% +3.7% -6.7% +10.0% ➖ noise
42 duckdb:duckdb +17.6% +3.7% +13.4% +10.0% 🚨 regression
42 duckdb:vortex-file-compressed -8.6% +3.7% -11.8% +19.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -11.0%
Vortex (geomean): 0.980x ➖
Parquet (geomean): 1.101x ➖
Shifts: Parquet (control) +10.1% · Median polish +1.1%


datafusion / vortex-file-compressed (0.955x ➖, 2↑ 3↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 288582319 259495809 1.11
tpch_q02/datafusion:vortex-file-compressed 472694307 624995760 0.76
tpch_q03/datafusion:vortex-file-compressed 483072471 574848569 0.84
tpch_q04/datafusion:vortex-file-compressed 255496781 277965653 0.92
tpch_q05/datafusion:vortex-file-compressed 514892217 426093354 1.21
tpch_q06/datafusion:vortex-file-compressed 332881693 324313559 1.03
tpch_q07/datafusion:vortex-file-compressed 467725423 431736015 1.08
tpch_q08/datafusion:vortex-file-compressed 832005362 679089809 1.23
tpch_q09/datafusion:vortex-file-compressed 🚨 731656048 506686103 1.44
tpch_q10/datafusion:vortex-file-compressed 🚨 812157907 609162708 1.33
tpch_q11/datafusion:vortex-file-compressed 🚨 417303795 289761169 1.44
tpch_q12/datafusion:vortex-file-compressed 497139098 559974799 0.89
tpch_q13/datafusion:vortex-file-compressed 223190008 296012102 0.75
tpch_q14/datafusion:vortex-file-compressed 353944810 432873030 0.82
tpch_q15/datafusion:vortex-file-compressed 545508057 606932906 0.90
tpch_q16/datafusion:vortex-file-compressed 280437700 340708094 0.82
tpch_q17/datafusion:vortex-file-compressed 460572466 448577250 1.03
tpch_q18/datafusion:vortex-file-compressed 393525267 448231753 0.88
tpch_q19/datafusion:vortex-file-compressed 511228437 642940233 0.80
tpch_q20/datafusion:vortex-file-compressed 422791714 471071448 0.90
tpch_q21/datafusion:vortex-file-compressed 🚀 595416278 875948194 0.68
tpch_q22/datafusion:vortex-file-compressed 🚀 137810790 198701141 0.69
datafusion / vortex-compact (1.006x ➖, 0↑ 2↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 267342490 286163965 0.93
tpch_q02/datafusion:vortex-compact 439210248 476846564 0.92
tpch_q03/datafusion:vortex-compact 415541311 444877984 0.93
tpch_q04/datafusion:vortex-compact 258225629 306930698 0.84
tpch_q05/datafusion:vortex-compact 417951267 438210294 0.95
tpch_q06/datafusion:vortex-compact 408971032 400548846 1.02
tpch_q07/datafusion:vortex-compact 648898167 501081943 1.29
tpch_q08/datafusion:vortex-compact 773294109 615432598 1.26
tpch_q09/datafusion:vortex-compact 514996423 494609482 1.04
tpch_q10/datafusion:vortex-compact 543740134 460535973 1.18
tpch_q11/datafusion:vortex-compact 283893648 320837314 0.88
tpch_q12/datafusion:vortex-compact 388561794 464868129 0.84
tpch_q13/datafusion:vortex-compact 159671239 198988442 0.80
tpch_q14/datafusion:vortex-compact 275874138 263600525 1.05
tpch_q15/datafusion:vortex-compact 394227952 408148277 0.97
tpch_q16/datafusion:vortex-compact 231877839 211459436 1.10
tpch_q17/datafusion:vortex-compact 🚨 576182391 434730371 1.33
tpch_q18/datafusion:vortex-compact 🚨 477280694 366932489 1.30
tpch_q19/datafusion:vortex-compact 665260375 545261819 1.22
tpch_q20/datafusion:vortex-compact 447662560 437227413 1.02
tpch_q21/datafusion:vortex-compact 556544307 765720664 0.73
tpch_q22/datafusion:vortex-compact 130940025 156407569 0.84
datafusion / parquet (1.177x ➖, 0↑ 3↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 237698647 237674474 1.00
tpch_q02/datafusion:parquet 470833009 596475473 0.79
tpch_q03/datafusion:parquet 322550696 395296389 0.82
tpch_q04/datafusion:parquet 230672123 295351563 0.78
tpch_q05/datafusion:parquet 656033153 533169139 1.23
tpch_q06/datafusion:parquet 259638724 245281329 1.06
tpch_q07/datafusion:parquet 537405333 508406791 1.06
tpch_q08/datafusion:parquet 737155263 763040653 0.97
tpch_q09/datafusion:parquet 538266841 499825476 1.08
tpch_q10/datafusion:parquet 793771587 640001034 1.24
tpch_q11/datafusion:parquet 399796847 334333296 1.20
tpch_q12/datafusion:parquet 🚨 360004700 250853365 1.44
tpch_q13/datafusion:parquet 493540176 465848294 1.06
tpch_q14/datafusion:parquet 217833497 212713009 1.02
tpch_q15/datafusion:parquet 374379950 320654505 1.17
tpch_q16/datafusion:parquet 201121235 222965246 0.90
tpch_q17/datafusion:parquet 516446614 454300902 1.14
tpch_q18/datafusion:parquet 564923123 443995539 1.27
tpch_q19/datafusion:parquet 456513664 364467488 1.25
tpch_q20/datafusion:parquet 468708013 389447957 1.20
tpch_q21/datafusion:parquet 🚨 1451391806 571554120 2.54
tpch_q22/datafusion:parquet 🚨 525599776 142243492 3.70
duckdb / vortex-file-compressed (0.953x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 261741066 369180632 0.71
tpch_q02/duckdb:vortex-file-compressed 968808801 1013410389 0.96
tpch_q03/duckdb:vortex-file-compressed 735026949 860795255 0.85
tpch_q04/duckdb:vortex-file-compressed 423756698 421841882 1.00
tpch_q05/duckdb:vortex-file-compressed 878000492 904788893 0.97
tpch_q06/duckdb:vortex-file-compressed 325604717 421854884 0.77
tpch_q07/duckdb:vortex-file-compressed 1048183983 944386149 1.11
tpch_q08/duckdb:vortex-file-compressed 1168177674 1009107691 1.16
tpch_q09/duckdb:vortex-file-compressed 999885250 1041103140 0.96
tpch_q10/duckdb:vortex-file-compressed 711166592 893056678 0.80
tpch_q11/duckdb:vortex-file-compressed 495265485 521331974 0.95
tpch_q12/duckdb:vortex-file-compressed 664864959 614613427 1.08
tpch_q13/duckdb:vortex-file-compressed 463360616 521383723 0.89
tpch_q14/duckdb:vortex-file-compressed 429257392 489507167 0.88
tpch_q15/duckdb:vortex-file-compressed 343861657 309834647 1.11
tpch_q16/duckdb:vortex-file-compressed 380631329 349912197 1.09
tpch_q17/duckdb:vortex-file-compressed 731059833 814313798 0.90
tpch_q18/duckdb:vortex-file-compressed 642565367 651746670 0.99
tpch_q19/duckdb:vortex-file-compressed 535594546 522715125 1.02
tpch_q20/duckdb:vortex-file-compressed 875864514 855828808 1.02
tpch_q21/duckdb:vortex-file-compressed 1035408685 1302429911 0.79
tpch_q22/duckdb:vortex-file-compressed 340106139 300265437 1.13
duckdb / vortex-compact (1.009x ➖, 0↑ 1↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 321515809 338973637 0.95
tpch_q02/duckdb:vortex-compact 984448056 979529481 1.01
tpch_q03/duckdb:vortex-compact 713918242 672344980 1.06
tpch_q04/duckdb:vortex-compact 492695816 420376049 1.17
tpch_q05/duckdb:vortex-compact 805905300 856514133 0.94
tpch_q06/duckdb:vortex-compact 377622073 422202050 0.89
tpch_q07/duckdb:vortex-compact 937301416 881013643 1.06
tpch_q08/duckdb:vortex-compact 1083805290 1031483966 1.05
tpch_q09/duckdb:vortex-compact 1103174850 977092387 1.13
tpch_q10/duckdb:vortex-compact 🚨 940455989 701163309 1.34
tpch_q11/duckdb:vortex-compact 509583396 525279887 0.97
tpch_q12/duckdb:vortex-compact 706658325 692625215 1.02
tpch_q13/duckdb:vortex-compact 526411922 455679377 1.16
tpch_q14/duckdb:vortex-compact 440046337 475782243 0.92
tpch_q15/duckdb:vortex-compact 353534843 350015553 1.01
tpch_q16/duckdb:vortex-compact 352834906 386363587 0.91
tpch_q17/duckdb:vortex-compact 694354818 833307486 0.83
tpch_q18/duckdb:vortex-compact 507881297 593620259 0.86
tpch_q19/duckdb:vortex-compact 510065415 539516547 0.95
tpch_q20/duckdb:vortex-compact 781440200 830719350 0.94
tpch_q21/duckdb:vortex-compact 1259073184 1076907995 1.17
tpch_q22/duckdb:vortex-compact 310025530 309810710 1.00
duckdb / parquet (1.031x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 522229559 485066397 1.08
tpch_q02/duckdb:parquet 1280440935 1156992866 1.11
tpch_q03/duckdb:parquet 1049653616 1163732009 0.90
tpch_q04/duckdb:parquet 747601981 654896701 1.14
tpch_q05/duckdb:parquet 1368753806 1249365865 1.10
tpch_q06/duckdb:parquet 467470358 527446288 0.89
tpch_q07/duckdb:parquet 1326879938 1417377191 0.94
tpch_q08/duckdb:parquet 1636933028 1484796530 1.10
tpch_q09/duckdb:parquet 1501868663 1495549693 1.00
tpch_q10/duckdb:parquet 1409672744 1468167036 0.96
tpch_q11/duckdb:parquet 824923441 711456774 1.16
tpch_q12/duckdb:parquet 828213409 734277306 1.13
tpch_q13/duckdb:parquet 1014930357 985204950 1.03
tpch_q14/duckdb:parquet 723250495 768633685 0.94
tpch_q15/duckdb:parquet 602906691 578149625 1.04
tpch_q16/duckdb:parquet 699102763 680436884 1.03
tpch_q17/duckdb:parquet 891562582 850426450 1.05
tpch_q18/duckdb:parquet 977191623 911736831 1.07
tpch_q19/duckdb:parquet 952385175 798056176 1.19
tpch_q20/duckdb:parquet 1108801944 1210135237 0.92
tpch_q21/duckdb:parquet 1191153222 1284128052 0.93
tpch_q22/duckdb:parquet 621166203 583392441 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -6.6% +3.8% -10.0% +66.2% ➖ noise
1 datafusion:vortex-file-compressed +11.2% +3.8% +7.2% +65.0% ➖ noise
1 duckdb:vortex-compact -5.2% +3.8% -8.6% +59.3% ➖ noise
1 duckdb:vortex-file-compressed -29.1% +3.8% -31.7% +59.3% ➖ noise
2 datafusion:vortex-compact -7.9% -6.5% -1.5% +59.3% ➖ noise
2 datafusion:vortex-file-compressed -24.4% -6.5% -19.1% +59.3% ➖ noise
2 duckdb:vortex-compact +0.5% -6.5% +7.5% +59.3% ➖ noise
2 duckdb:vortex-file-compressed -4.4% -6.5% +2.3% +59.3% ➖ noise
3 datafusion:vortex-compact -6.6% -14.2% +8.9% +59.3% ➖ noise
3 datafusion:vortex-file-compressed -16.0% -14.2% -2.0% +59.3% ➖ noise
3 duckdb:vortex-compact +6.2% -14.2% +23.8% +59.3% ➖ noise
3 duckdb:vortex-file-compressed -14.6% -14.2% -0.5% +59.3% ➖ noise
4 datafusion:vortex-compact -15.9% -5.6% -10.9% +66.4% ➖ noise
4 datafusion:vortex-file-compressed -8.1% -5.6% -2.7% +59.3% ➖ noise
4 duckdb:vortex-compact +17.2% -5.6% +24.1% +59.3% ➖ noise
4 duckdb:vortex-file-compressed +0.5% -5.6% +6.4% +59.3% ➖ noise
5 datafusion:vortex-compact -4.6% +16.1% -17.9% +59.3% ➖ noise
5 datafusion:vortex-file-compressed +20.8% +16.1% +4.1% +59.3% ➖ noise
5 duckdb:vortex-compact -5.9% +16.1% -19.0% +59.3% ➖ noise
5 duckdb:vortex-file-compressed -3.0% +16.1% -16.4% +59.3% ➖ noise
6 datafusion:vortex-compact +2.1% -3.1% +5.4% +59.3% ➖ noise
6 datafusion:vortex-file-compressed +2.6% -3.1% +6.0% +59.3% ➖ noise
6 duckdb:vortex-compact -10.6% -3.1% -7.7% +59.3% ➖ noise
6 duckdb:vortex-file-compressed -22.8% -3.1% -20.3% +59.3% ➖ noise
7 datafusion:vortex-compact +29.5% -0.5% +30.2% +59.3% ➖ noise
7 datafusion:vortex-file-compressed +8.3% -0.5% +8.9% +59.3% ➖ noise
7 duckdb:vortex-compact +6.4% -0.5% +6.9% +59.3% ➖ noise
7 duckdb:vortex-file-compressed +11.0% -0.5% +11.6% +59.3% ➖ noise
8 datafusion:vortex-compact +25.7% +3.2% +21.8% +59.3% ➖ noise
8 datafusion:vortex-file-compressed +22.5% +3.2% +18.7% +59.3% ➖ noise
8 duckdb:vortex-compact +5.1% +3.2% +1.8% +59.3% ➖ noise
8 duckdb:vortex-file-compressed +15.8% +3.2% +12.2% +59.3% ➖ noise
9 datafusion:vortex-compact +4.1% +4.0% +0.1% +59.3% ➖ noise
9 datafusion:vortex-file-compressed +44.4% +4.0% +38.9% +59.3% ➖ noise
9 duckdb:vortex-compact +12.9% +4.0% +8.6% +59.3% ➖ noise
9 duckdb:vortex-file-compressed -4.0% +4.0% -7.6% +59.3% ➖ noise
10 datafusion:vortex-compact +18.1% +9.1% +8.2% +59.3% ➖ noise
10 datafusion:vortex-file-compressed +33.3% +9.1% +22.2% +59.3% ➖ noise
10 duckdb:vortex-compact +34.1% +9.1% +22.9% +59.3% ➖ noise
10 duckdb:vortex-file-compressed -20.4% +9.1% -27.0% +59.3% ➖ noise
11 datafusion:vortex-compact -11.5% +17.8% -24.9% +59.3% ➖ noise
11 datafusion:vortex-file-compressed +44.0% +17.8% +22.3% +59.3% ➖ noise
11 duckdb:vortex-compact -3.0% +17.8% -17.6% +59.3% ➖ noise
11 duckdb:vortex-file-compressed -5.0% +17.8% -19.3% +59.3% ➖ noise
12 datafusion:vortex-compact -16.4% +27.2% -34.3% +59.3% ➖ noise
12 datafusion:vortex-file-compressed -11.2% +27.2% -30.2% +59.3% ➖ noise
12 duckdb:vortex-compact +2.0% +27.2% -19.8% +59.3% ➖ noise
12 duckdb:vortex-file-compressed +8.2% +27.2% -15.0% +59.3% ➖ noise
13 datafusion:vortex-compact -19.8% +4.5% -23.2% +164.7% ➖ noise
13 datafusion:vortex-file-compressed -24.6% +4.5% -27.8% +59.3% ➖ noise
13 duckdb:vortex-compact +15.5% +4.5% +10.6% +59.3% ➖ noise
13 duckdb:vortex-file-compressed -11.1% +4.5% -14.9% +59.3% ➖ noise
14 datafusion:vortex-compact +4.7% -1.8% +6.6% +59.3% ➖ noise
14 datafusion:vortex-file-compressed -18.2% -1.8% -16.7% +59.3% ➖ noise
14 duckdb:vortex-compact -7.5% -1.8% -5.8% +59.3% ➖ noise
14 duckdb:vortex-file-compressed -12.3% -1.8% -10.7% +59.3% ➖ noise
15 datafusion:vortex-compact -3.4% +10.3% -12.5% +59.3% ➖ noise
15 datafusion:vortex-file-compressed -10.1% +10.3% -18.5% +59.3% ➖ noise
15 duckdb:vortex-compact +1.0% +10.3% -8.5% +59.3% ➖ noise
15 duckdb:vortex-file-compressed +11.0% +10.3% +0.6% +59.3% ➖ noise
16 datafusion:vortex-compact +9.7% -3.7% +13.9% +59.3% ➖ noise
16 datafusion:vortex-file-compressed -17.7% -3.7% -14.5% +59.3% ➖ noise
16 duckdb:vortex-compact -8.7% -3.7% -5.1% +59.3% ➖ noise
16 duckdb:vortex-file-compressed +8.8% -3.7% +13.0% +59.3% ➖ noise
17 datafusion:vortex-compact +32.5% +9.2% +21.4% +59.3% ➖ noise
17 datafusion:vortex-file-compressed +2.7% +9.2% -5.9% +59.3% ➖ noise
17 duckdb:vortex-compact -16.7% +9.2% -23.7% +59.3% ➖ noise
17 duckdb:vortex-file-compressed -10.2% +9.2% -17.8% +59.3% ➖ noise
18 datafusion:vortex-compact +30.1% +16.8% +11.4% +59.3% ➖ noise
18 datafusion:vortex-file-compressed -12.2% +16.8% -24.8% +59.3% ➖ noise
18 duckdb:vortex-compact -14.4% +16.8% -26.7% +59.3% ➖ noise
18 duckdb:vortex-file-compressed -1.4% +16.8% -15.6% +59.3% ➖ noise
19 datafusion:vortex-compact +22.0% +22.3% -0.2% +59.3% ➖ noise
19 datafusion:vortex-file-compressed -20.5% +22.3% -35.0% +59.3% ➖ noise
19 duckdb:vortex-compact -5.5% +22.3% -22.7% +59.3% ➖ noise
19 duckdb:vortex-file-compressed +2.5% +22.3% -16.2% +59.3% ➖ noise
20 datafusion:vortex-compact +2.4% +5.0% -2.5% +59.3% ➖ noise
20 datafusion:vortex-file-compressed -10.2% +5.0% -14.5% +59.3% ➖ noise
20 duckdb:vortex-compact -5.9% +5.0% -10.4% +59.3% ➖ noise
20 duckdb:vortex-file-compressed +2.3% +5.0% -2.5% +59.3% ➖ noise
21 datafusion:vortex-compact -27.3% +53.5% -52.6% +59.3% ✅ faster
21 datafusion:vortex-file-compressed -32.0% +53.5% -55.7% +59.3% ✅ faster
21 duckdb:vortex-compact +16.9% +53.5% -23.8% +59.3% ➖ noise
21 duckdb:vortex-file-compressed -20.5% +53.5% -48.2% +59.3% ✅ faster
22 datafusion:vortex-compact -16.3% +98.4% -57.8% +59.3% ✅ faster
22 datafusion:vortex-file-compressed -30.6% +98.4% -65.0% +59.3% ✅ faster
22 duckdb:vortex-compact +0.1% +98.4% -49.5% +59.3% ✅ faster
22 duckdb:vortex-file-compressed +13.3% +98.4% -42.9% +59.3% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.006x ➖
Parquet (geomean): 1.004x ➖


unknown / unknown (1.006x ➖, 1↑ 5↓)
name PR 024dacb (ns) base 971aa1c (ns) ratio (PR/base)
compress time/Arade 1165976323 1162821278 1.00
compress time/Bimbo 6972041096 6895724093 1.01
compress time/CMSprovider 2880088334 2898198173 0.99
compress time/Euro2016 441589382 416995364 1.06
compress time/Food 371722478 377685043 0.98
compress time/HashTags 822809222 817941406 1.01
compress time/TPC-H l_comment canonical 1332963643 1283595794 1.04
compress time/TPC-H l_comment chunked 1331096693 1287050295 1.03
compress time/taxi 743798536 720926048 1.03
compress time/wide table cols=100 chunks=1 rows=1000 11330946 11344388 1.00
compress time/wide table cols=100 chunks=50 rows=1000 12536548 12785248 0.98
compress time/wide table cols=1000 chunks=1 rows=1000 130002009 121938876 1.07
compress time/wide table cols=1000 chunks=50 rows=1000 124131679 135602082 0.92
compress time/wide table cols=10000 chunks=1 rows=1000 1457062076 1435139745 1.02
compress time/wide table cols=10000 chunks=50 rows=1000 1460199500 1442915843 1.01
decompress time/Arade 27832847 28021802 0.99
decompress time/Bimbo 84227667 77217274 1.09
decompress time/CMSprovider 77572457 75472403 1.03
decompress time/Euro2016 17825172 18237923 0.98
decompress time/Food 🚨 8413499 7531220 1.12
decompress time/HashTags 72676577 71767288 1.01
decompress time/TPC-H l_comment canonical 40614203 40306082 1.01
decompress time/TPC-H l_comment chunked 40972245 40495127 1.01
decompress time/taxi 14699859 14924201 0.98
decompress time/wide table cols=100 chunks=1 rows=1000 🚨 2575061 2326063 1.11
decompress time/wide table cols=100 chunks=50 rows=1000 2585429 2807596 0.92
decompress time/wide table cols=1000 chunks=1 rows=1000 23058458 22163453 1.04
decompress time/wide table cols=1000 chunks=50 rows=1000 23794654 25635956 0.93
decompress time/wide table cols=10000 chunks=1 rows=1000 253758036 257333479 0.99
decompress time/wide table cols=10000 chunks=50 rows=1000 259432188 248984374 1.04
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2608108751 2855987992 0.91
parquet_rs-zstd compress time/Bimbo 12731207658 12738026541 1.00
parquet_rs-zstd compress time/CMSprovider 6945753489 6851632192 1.01
parquet_rs-zstd compress time/Euro2016 1303391666 1298548893 1.00
parquet_rs-zstd compress time/Food 797427036 791308640 1.01
parquet_rs-zstd compress time/HashTags 2182008548 2135336502 1.02
parquet_rs-zstd compress time/TPC-H l_comment canonical 3221775972 3162643295 1.02
parquet_rs-zstd compress time/TPC-H l_comment chunked 3195854747 3158530554 1.01
parquet_rs-zstd compress time/taxi 1202351905 1201406915 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6223604 5980792 1.04
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 6377699 7400686 0.86
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 77373310 73051627 1.06
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 77271391 77843175 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 787023925 781229939 1.01
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 783223144 831283099 0.94
parquet_rs-zstd decompress time/Arade 614259384 626223956 0.98
parquet_rs-zstd decompress time/Bimbo 1689163562 1689727767 1.00
parquet_rs-zstd decompress time/CMSprovider 1713709139 1703565955 1.01
parquet_rs-zstd decompress time/Euro2016 374898546 372990825 1.01
parquet_rs-zstd decompress time/Food 197232079 196856480 1.00
parquet_rs-zstd decompress time/HashTags 659545481 621151910 1.06
parquet_rs-zstd decompress time/TPC-H l_comment canonical 598127441 586206745 1.02
parquet_rs-zstd decompress time/TPC-H l_comment chunked 597949815 587858497 1.02
parquet_rs-zstd decompress time/taxi 246304632 242921425 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2878688 2747707 1.05
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2952971 3113350 0.95
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 34958501 31692315 1.10
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 34682323 34879509 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 354166124 345572669 1.02
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 357341247 361727633 0.99
vortex-file-compressed size/Arade 145405284 145363796 1.00
vortex-file-compressed size/Bimbo 468878868 468763332 1.00
vortex-file-compressed size/CMSprovider 417967972 417907812 1.00
vortex-file-compressed size/Euro2016 163411084 163394924 1.00
vortex-file-compressed size/Food 41933072 41926936 1.00
vortex-file-compressed size/HashTags 195689844 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179128440 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179128440 179087360 1.00
vortex-file-compressed size/taxi 52386580 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 935624 930848 1.01
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 935624 930848 1.01
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9341624 9293648 1.01
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9341624 9293648 1.01
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93437624 92957648 1.01
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93437624 92957648 1.01
vortex:parquet-zstd ratio compress time/Arade 0 0 1.10
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.98
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.06
vortex:parquet-zstd ratio compress time/Food 0 0 0.98
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.98
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio compress time/taxi 0 0 1.03
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.96
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚨 1 1 1.14
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.92
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.07
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.01
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.09
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.97
vortex:parquet-zstd ratio decompress time/Food 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.95
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.99
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.94
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.05
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1 0 1.01
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1 0 1.01
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 1 0 1.01
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 1 0 1.01
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 1 0 1.01
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 1 0 1.01

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.2%
Vortex (geomean): 0.980x ➖
Parquet (geomean): 0.959x ➖
Shifts: Parquet (control) -4.1% · Median polish -3.7%


datafusion / vortex-file-compressed (0.947x ➖, 0↑ 1↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 676914668 802088693 0.84
tpch_q02/datafusion:vortex-file-compressed 883243299 1167635077 0.76
tpch_q03/datafusion:vortex-file-compressed 886961542 1065009998 0.83
tpch_q04/datafusion:vortex-file-compressed 700653014 630625506 1.11
tpch_q05/datafusion:vortex-file-compressed 1127367306 1065655473 1.06
tpch_q06/datafusion:vortex-file-compressed 688567716 615599881 1.12
tpch_q07/datafusion:vortex-file-compressed 1322685159 1194168733 1.11
tpch_q08/datafusion:vortex-file-compressed 1352349381 1563737489 0.86
tpch_q09/datafusion:vortex-file-compressed 1332410204 1729928757 0.77
tpch_q10/datafusion:vortex-file-compressed 928493044 1167227750 0.80
tpch_q11/datafusion:vortex-file-compressed 495933861 596746146 0.83
tpch_q12/datafusion:vortex-file-compressed 826322959 872706293 0.95
tpch_q13/datafusion:vortex-file-compressed 455982664 455585409 1.00
tpch_q14/datafusion:vortex-file-compressed 529474164 578106369 0.92
tpch_q15/datafusion:vortex-file-compressed 931832287 1038603163 0.90
tpch_q16/datafusion:vortex-file-compressed 450153185 480801412 0.94
tpch_q17/datafusion:vortex-file-compressed 1149996168 1222660048 0.94
tpch_q18/datafusion:vortex-file-compressed 1262583602 1318682835 0.96
tpch_q19/datafusion:vortex-file-compressed 908612815 915210011 0.99
tpch_q20/datafusion:vortex-file-compressed 862078056 970044998 0.89
tpch_q21/datafusion:vortex-file-compressed 1796153667 1636351065 1.10
tpch_q22/datafusion:vortex-file-compressed 🚨 815531613 581119412 1.40
datafusion / vortex-compact (1.062x ➖, 0↑ 2↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 677807153 728966770 0.93
tpch_q02/datafusion:vortex-compact 🚨 885874731 650149861 1.36
tpch_q03/datafusion:vortex-compact 731368291 786559542 0.93
tpch_q04/datafusion:vortex-compact 575190736 510635311 1.13
tpch_q05/datafusion:vortex-compact 1074270186 900974173 1.19
tpch_q06/datafusion:vortex-compact 634958613 570174722 1.11
tpch_q07/datafusion:vortex-compact 🚨 1452709185 1062280630 1.37
tpch_q08/datafusion:vortex-compact 1463496363 1191421137 1.23
tpch_q09/datafusion:vortex-compact 1363146914 1388983387 0.98
tpch_q10/datafusion:vortex-compact 976492937 1002085738 0.97
tpch_q11/datafusion:vortex-compact 490483128 536677009 0.91
tpch_q12/datafusion:vortex-compact 1023885051 808604858 1.27
tpch_q13/datafusion:vortex-compact 423725880 452884222 0.94
tpch_q14/datafusion:vortex-compact 833557507 700600540 1.19
tpch_q15/datafusion:vortex-compact 982044633 1074286468 0.91
tpch_q16/datafusion:vortex-compact 356248335 352103926 1.01
tpch_q17/datafusion:vortex-compact 1173221327 1215636172 0.97
tpch_q18/datafusion:vortex-compact 1265159601 1089707941 1.16
tpch_q19/datafusion:vortex-compact 845647385 819058677 1.03
tpch_q20/datafusion:vortex-compact 906100892 814773240 1.11
tpch_q21/datafusion:vortex-compact 1595829478 1580882373 1.01
tpch_q22/datafusion:vortex-compact 408103037 471848194 0.86
datafusion / parquet (0.966x ➖, 2↑ 1↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 908833133 887707491 1.02
tpch_q02/datafusion:parquet 1256776120 1031290799 1.22
tpch_q03/datafusion:parquet 1294874007 1608415199 0.81
tpch_q04/datafusion:parquet 651549179 509692466 1.28
tpch_q05/datafusion:parquet 1344191043 1295490183 1.04
tpch_q06/datafusion:parquet 563360274 551172254 1.02
tpch_q07/datafusion:parquet 1376400022 1388553484 0.99
tpch_q08/datafusion:parquet 1906602341 1986285622 0.96
tpch_q09/datafusion:parquet 1865602962 1797089119 1.04
tpch_q10/datafusion:parquet 2558376814 2783172322 0.92
tpch_q11/datafusion:parquet 🚀 615587796 1008131667 0.61
tpch_q12/datafusion:parquet 772076805 765994008 1.01
tpch_q13/datafusion:parquet 705042430 766180379 0.92
tpch_q14/datafusion:parquet 790445555 768411822 1.03
tpch_q15/datafusion:parquet 1329689815 1349647557 0.99
tpch_q16/datafusion:parquet 452704305 440646888 1.03
tpch_q17/datafusion:parquet 🚨 2015825889 1520496579 1.33
tpch_q18/datafusion:parquet 2052029430 1755300656 1.17
tpch_q19/datafusion:parquet 1237903337 1254284506 0.99
tpch_q20/datafusion:parquet 1481610050 2059969235 0.72
tpch_q21/datafusion:parquet 1760037306 1926869838 0.91
tpch_q22/datafusion:parquet 🚀 789430854 1251174405 0.63
duckdb / vortex-file-compressed (0.949x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 626027738 597454905 1.05
tpch_q02/duckdb:vortex-file-compressed 1200809877 1259950064 0.95
tpch_q03/duckdb:vortex-file-compressed 998159043 946821311 1.05
tpch_q04/duckdb:vortex-file-compressed 742469272 794538877 0.93
tpch_q05/duckdb:vortex-file-compressed 1197163274 1248537504 0.96
tpch_q06/duckdb:vortex-file-compressed 625026790 600810078 1.04
tpch_q07/duckdb:vortex-file-compressed 1312802006 1361006118 0.96
tpch_q08/duckdb:vortex-file-compressed 1441168145 1643194393 0.88
tpch_q09/duckdb:vortex-file-compressed 1740345416 1840778769 0.95
tpch_q10/duckdb:vortex-file-compressed 1243390545 1281592228 0.97
tpch_q11/duckdb:vortex-file-compressed 712577606 874906703 0.81
tpch_q12/duckdb:vortex-file-compressed 1362987642 1396709782 0.98
tpch_q13/duckdb:vortex-file-compressed 988274446 1106071152 0.89
tpch_q14/duckdb:vortex-file-compressed 693903830 686502170 1.01
tpch_q15/duckdb:vortex-file-compressed 585117076 568873976 1.03
tpch_q16/duckdb:vortex-file-compressed 475400478 525489281 0.90
tpch_q17/duckdb:vortex-file-compressed 956982184 1046061172 0.91
tpch_q18/duckdb:vortex-file-compressed 971576030 1114873116 0.87
tpch_q19/duckdb:vortex-file-compressed 873148700 800588684 1.09
tpch_q20/duckdb:vortex-file-compressed 1176188013 1190983818 0.99
tpch_q21/duckdb:vortex-file-compressed 1952729354 2006416543 0.97
tpch_q22/duckdb:vortex-file-compressed 443147274 600025013 0.74
duckdb / vortex-compact (0.967x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 588841736 613302464 0.96
tpch_q02/duckdb:vortex-compact 1177574434 1081169439 1.09
tpch_q03/duckdb:vortex-compact 828089086 921455955 0.90
tpch_q04/duckdb:vortex-compact 671411228 590893301 1.14
tpch_q05/duckdb:vortex-compact 1109680859 1240345548 0.89
tpch_q06/duckdb:vortex-compact 515138629 570259737 0.90
tpch_q07/duckdb:vortex-compact 1299711721 1273797203 1.02
tpch_q08/duckdb:vortex-compact 1394544653 1583728124 0.88
tpch_q09/duckdb:vortex-compact 1591080951 1643759682 0.97
tpch_q10/duckdb:vortex-compact 1263026525 1156450252 1.09
tpch_q11/duckdb:vortex-compact 667989404 829682981 0.81
tpch_q12/duckdb:vortex-compact 1058869397 1139948932 0.93
tpch_q13/duckdb:vortex-compact 890749725 857548772 1.04
tpch_q14/duckdb:vortex-compact 617341596 659757473 0.94
tpch_q15/duckdb:vortex-compact 555146816 570488368 0.97
tpch_q16/duckdb:vortex-compact 414070939 447701294 0.92
tpch_q17/duckdb:vortex-compact 931344024 921779902 1.01
tpch_q18/duckdb:vortex-compact 801860073 880479288 0.91
tpch_q19/duckdb:vortex-compact 820823199 730404261 1.12
tpch_q20/duckdb:vortex-compact 1295545373 1359623339 0.95
tpch_q21/duckdb:vortex-compact 1737011287 1829194981 0.95
tpch_q22/duckdb:vortex-compact 469501721 494095764 0.95
duckdb / parquet (0.952x ➖, 0↑ 0↓)
name PR 5ebeb8b (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 847128353 955126078 0.89
tpch_q02/duckdb:parquet 1414090039 1567557222 0.90
tpch_q03/duckdb:parquet 1694065261 2168441766 0.78
tpch_q04/duckdb:parquet 1196084965 1255316499 0.95
tpch_q05/duckdb:parquet 2127891744 1900564966 1.12
tpch_q06/duckdb:parquet 885373938 1023179895 0.87
tpch_q07/duckdb:parquet 2005130469 2224210921 0.90
tpch_q08/duckdb:parquet 2783583958 2792549772 1.00
tpch_q09/duckdb:parquet 2799092287 3034564509 0.92
tpch_q10/duckdb:parquet 3355414672 3410610694 0.98
tpch_q11/duckdb:parquet 1087477731 1098153555 0.99
tpch_q12/duckdb:parquet 1346434754 1427622071 0.94
tpch_q13/duckdb:parquet 1353644102 1529464021 0.89
tpch_q14/duckdb:parquet 1543644397 1339188513 1.15
tpch_q15/duckdb:parquet 980912216 975773955 1.01
tpch_q16/duckdb:parquet 1016518978 1036440175 0.98
tpch_q17/duckdb:parquet 1232630027 1476077325 0.84
tpch_q18/duckdb:parquet 1550820212 1675199948 0.93
tpch_q19/duckdb:parquet 1659939018 1705803014 0.97
tpch_q20/duckdb:parquet 2279191437 2017698474 1.13
tpch_q21/duckdb:parquet 1955495449 2015520176 0.97
tpch_q22/duckdb:parquet 1177437867 1270433044 0.93
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.0% -4.7% -2.4% +39.2% ➖ noise
1 datafusion:vortex-file-compressed -15.6% -4.7% -11.4% +43.7% ➖ noise
1 duckdb:vortex-compact -4.0% -4.7% +0.8% +30.6% ➖ noise
1 duckdb:vortex-file-compressed +4.8% -4.7% +10.0% +32.3% ➖ noise
2 datafusion:vortex-compact +36.3% +4.8% +30.0% +32.1% ➖ noise
2 datafusion:vortex-file-compressed -24.4% +4.8% -27.9% +34.9% ✅ faster
2 duckdb:vortex-compact +8.9% +4.8% +3.9% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -4.7% +4.8% -9.1% +30.0% ➖ noise
3 datafusion:vortex-compact -7.0% -20.7% +17.2% +47.7% ➖ noise
3 datafusion:vortex-file-compressed -16.7% -20.7% +5.0% +47.1% ➖ noise
3 duckdb:vortex-compact -10.1% -20.7% +13.3% +34.5% ➖ noise
3 duckdb:vortex-file-compressed +5.4% -20.7% +32.9% +43.1% ➖ noise
4 datafusion:vortex-compact +12.6% +10.4% +2.1% +34.8% ➖ noise
4 datafusion:vortex-file-compressed +11.1% +10.4% +0.7% +67.3% ➖ noise
4 duckdb:vortex-compact +13.6% +10.4% +3.0% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -6.6% +10.4% -15.3% +30.0% ➖ noise
5 datafusion:vortex-compact +19.2% +7.8% +10.6% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +5.8% +7.8% -1.8% +30.0% ➖ noise
5 duckdb:vortex-compact -10.5% +7.8% -17.0% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -4.1% +7.8% -11.0% +30.0% ➖ noise
6 datafusion:vortex-compact +11.4% -6.0% +18.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +11.9% -6.0% +18.9% +30.0% ➖ noise
6 duckdb:vortex-compact -9.7% -6.0% -3.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +4.0% -6.0% +10.6% +30.0% ➖ noise
7 datafusion:vortex-compact +36.8% -5.5% +44.7% +30.0% 🚨 regression
7 datafusion:vortex-file-compressed +10.8% -5.5% +17.2% +30.0% ➖ noise
7 duckdb:vortex-compact +2.0% -5.5% +7.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -3.5% -5.5% +2.0% +30.0% ➖ noise
8 datafusion:vortex-compact +22.8% -2.2% +25.6% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -13.5% -2.2% -11.6% +30.0% ➖ noise
8 duckdb:vortex-compact -11.9% -2.2% -10.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -12.3% -2.2% -10.3% +30.0% ➖ noise
9 datafusion:vortex-compact -1.9% -2.1% +0.3% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -23.0% -2.1% -21.3% +30.0% ➖ noise
9 duckdb:vortex-compact -3.2% -2.1% -1.1% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -5.5% -2.1% -3.4% +30.0% ➖ noise
10 datafusion:vortex-compact -2.6% -4.9% +2.5% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -20.5% -4.9% -16.4% +30.0% ➖ noise
10 duckdb:vortex-compact +9.2% -4.9% +14.8% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -3.0% -4.9% +2.0% +33.7% ➖ noise
11 datafusion:vortex-compact -8.6% -22.2% +17.5% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -16.9% -22.2% +6.9% +30.0% ➖ noise
11 duckdb:vortex-compact -19.5% -22.2% +3.5% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -18.6% -22.2% +4.7% +30.0% ➖ noise
12 datafusion:vortex-compact +26.6% -2.5% +29.9% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -5.3% -2.5% -2.9% +30.0% ➖ noise
12 duckdb:vortex-compact -7.1% -2.5% -4.7% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -2.4% -2.5% +0.1% +30.0% ➖ noise
13 datafusion:vortex-compact -6.4% -9.8% +3.7% +56.3% ➖ noise
13 datafusion:vortex-file-compressed +0.1% -9.8% +10.9% +30.0% ➖ noise
13 duckdb:vortex-compact +3.9% -9.8% +15.1% +33.5% ➖ noise
13 duckdb:vortex-file-compressed -10.7% -9.8% -1.0% +37.6% ➖ noise
14 datafusion:vortex-compact +19.0% +8.9% +9.3% +30.7% ➖ noise
14 datafusion:vortex-file-compressed -8.4% +8.9% -15.9% +30.0% ➖ noise
14 duckdb:vortex-compact -6.4% +8.9% -14.1% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +1.1% +8.9% -7.2% +30.0% ➖ noise
15 datafusion:vortex-compact -8.6% -0.5% -8.1% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -10.3% -0.5% -9.8% +30.0% ➖ noise
15 duckdb:vortex-compact -2.7% -0.5% -2.2% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +2.9% -0.5% +3.4% +30.0% ➖ noise
16 datafusion:vortex-compact +1.2% +0.4% +0.8% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -6.4% +0.4% -6.7% +34.8% ➖ noise
16 duckdb:vortex-compact -7.5% +0.4% -7.9% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -9.5% +0.4% -9.9% +35.5% ➖ noise
17 datafusion:vortex-compact -3.5% +5.2% -8.3% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -5.9% +5.2% -10.6% +30.0% ➖ noise
17 duckdb:vortex-compact +1.0% +5.2% -4.0% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -8.5% +5.2% -13.1% +30.0% ➖ noise
18 datafusion:vortex-compact +16.1% +4.0% +11.6% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -4.3% +4.0% -8.0% +30.0% ➖ noise
18 duckdb:vortex-compact -8.9% +4.0% -12.5% +30.8% ➖ noise
18 duckdb:vortex-file-compressed -12.9% +4.0% -16.2% +32.6% ➖ noise
19 datafusion:vortex-compact +3.2% -2.0% +5.4% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -0.7% -2.0% +1.3% +30.0% ➖ noise
19 duckdb:vortex-compact +12.4% -2.0% +14.7% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +9.1% -2.0% +11.3% +30.0% ➖ noise
20 datafusion:vortex-compact +11.2% -9.9% +23.4% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -11.1% -9.9% -1.4% +30.0% ➖ noise
20 duckdb:vortex-compact -4.7% -9.9% +5.7% +32.3% ➖ noise
20 duckdb:vortex-file-compressed -1.2% -9.9% +9.6% +30.0% ➖ noise
21 datafusion:vortex-compact +0.9% -5.9% +7.2% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +9.8% -5.9% +16.6% +30.0% ➖ noise
21 duckdb:vortex-compact -5.0% -5.9% +0.9% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -2.7% -5.9% +3.4% +30.0% ➖ noise
22 datafusion:vortex-compact -13.5% -23.5% +13.1% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +40.3% -23.5% +83.5% +32.8% 🚨 regression
22 duckdb:vortex-compact -5.0% -23.5% +24.3% +30.9% ➖ noise
22 duckdb:vortex-file-compressed -26.1% -23.5% -3.4% +30.0% ➖ noise

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 20, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants