Skip to content

Introduce basic binary compressor schemes and refactor some other bits#8153

Merged
AdamGS merged 2 commits into
developfrom
adamg/binary-compressor
May 29, 2026
Merged

Introduce basic binary compressor schemes and refactor some other bits#8153
AdamGS merged 2 commits into
developfrom
adamg/binary-compressor

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented May 29, 2026

Summary

The important piece of this PR is the new BinaryDictScheme and BinaryConstantScheme, it also includes a bunch of simplifications in the compressor, including moving types into the file that actually includes their functionality, and removes some unnecessary utility functions.

@AdamGS AdamGS requested review from connortsui20 and robert3005 May 29, 2026 12:55
@AdamGS AdamGS added changelog/feature A new feature action/benchmark Trigger full benchmarks to run on this PR labels May 29, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 29, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done f105d74 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done f7b2b1c 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.013x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.013x ➖, 1↑ 2↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚀 99346342 117261095 0.85
polarsignals_q01/datafusion:vortex-file-compressed 246083219 260138883 0.95
polarsignals_q02/datafusion:vortex-file-compressed 22329072 22413827 1.00
polarsignals_q03/datafusion:vortex-file-compressed 262050842 265372053 0.99
polarsignals_q04/datafusion:vortex-file-compressed 11952113 10905279 1.10
polarsignals_q05/datafusion:vortex-file-compressed 🚨 16548908 14587863 1.13
polarsignals_q06/datafusion:vortex-file-compressed 🚨 19376091 17353035 1.12
polarsignals_q07/datafusion:vortex-file-compressed 13582792 12945793 1.05
polarsignals_q08/datafusion:vortex-file-compressed 394403963 412210640 0.96
polarsignals_q09/datafusion:vortex-file-compressed 10690258 10284793 1.04

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.9%
Engines: DataFusion No clear signal (+4.0%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): 0.973x ➖
Parquet (geomean): 0.955x ➖
Shifts: Parquet (control) -4.5% · Median polish -2.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.000x ➖, 0↑ 1↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5660105 5594762 1.01
fineweb_q01/datafusion:vortex-file-compressed 20574392 21706421 0.95
fineweb_q02/datafusion:vortex-file-compressed 🚨 24370276 21823359 1.12
fineweb_q03/datafusion:vortex-file-compressed 78446537 86684873 0.90
fineweb_q04/datafusion:vortex-file-compressed 232674137 230991371 1.01
fineweb_q05/datafusion:vortex-file-compressed 219094790 217628451 1.01
fineweb_q06/datafusion:vortex-file-compressed 50844482 54683301 0.93
fineweb_q07/datafusion:vortex-file-compressed 59709487 56594265 1.06
fineweb_q08/datafusion:vortex-file-compressed 22839353 22026259 1.04
datafusion / vortex-compact (0.991x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 6146874 6165598 1.00
fineweb_q01/datafusion:vortex-compact 97535864 90069334 1.08
fineweb_q02/datafusion:vortex-compact 104627377 102255180 1.02
fineweb_q03/datafusion:vortex-compact 860635414 890319959 0.97
fineweb_q04/datafusion:vortex-compact 922760344 943530477 0.98
fineweb_q05/datafusion:vortex-compact 825306481 857452580 0.96
fineweb_q06/datafusion:vortex-compact 462413732 472659782 0.98
fineweb_q07/datafusion:vortex-compact 480542899 494341348 0.97
fineweb_q08/datafusion:vortex-compact 19611857 20387346 0.96
datafusion / parquet (0.957x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6537174 7031949 0.93
fineweb_q01/datafusion:parquet 293039795 300878349 0.97
fineweb_q02/datafusion:parquet 305222301 302656378 1.01
fineweb_q03/datafusion:parquet 287773777 303204460 0.95
fineweb_q04/datafusion:parquet 301003551 310816969 0.97
fineweb_q05/datafusion:parquet 290979262 314126985 0.93
fineweb_q06/datafusion:parquet 286878417 302816952 0.95
fineweb_q07/datafusion:parquet 278434621 291274092 0.96
fineweb_q08/datafusion:parquet 274300604 286964013 0.96
duckdb / vortex-file-compressed (0.937x ➖, 2↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3334346 3780040 0.88
fineweb_q01/duckdb:vortex-file-compressed 22693963 24573782 0.92
fineweb_q02/duckdb:vortex-file-compressed 23894239 24174486 0.99
fineweb_q03/duckdb:vortex-file-compressed 🚀 126351796 157871210 0.80
fineweb_q04/duckdb:vortex-file-compressed 224210492 223694325 1.00
fineweb_q05/duckdb:vortex-file-compressed 217401997 212974263 1.02
fineweb_q06/duckdb:vortex-file-compressed 52452187 54055299 0.97
fineweb_q07/duckdb:vortex-file-compressed 54978540 57929842 0.95
fineweb_q08/duckdb:vortex-file-compressed 21775683 23753402 0.92
duckdb / vortex-compact (0.967x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4305722 4614123 0.93
fineweb_q01/duckdb:vortex-compact 110076236 102654957 1.07
fineweb_q02/duckdb:vortex-compact 110170833 119931043 0.92
fineweb_q03/duckdb:vortex-compact 855728950 877614438 0.98
fineweb_q04/duckdb:vortex-compact 895593335 932378320 0.96
fineweb_q05/duckdb:vortex-compact 804844399 815685497 0.99
fineweb_q06/duckdb:vortex-compact 460351550 473799033 0.97
fineweb_q07/duckdb:vortex-compact 478056885 489429610 0.98
fineweb_q08/duckdb:vortex-compact 20112088 21985087 0.91
duckdb / parquet (0.953x ➖, 1↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 32363536 32996663 0.98
fineweb_q01/duckdb:parquet 84759024 88418734 0.96
fineweb_q02/duckdb:parquet 85261354 89733526 0.95
fineweb_q03/duckdb:parquet 316639136 323916669 0.98
fineweb_q04/duckdb:parquet 443257722 454131469 0.98
fineweb_q05/duckdb:parquet 414238127 423806799 0.98
fineweb_q06/duckdb:parquet 201917855 211054977 0.96
fineweb_q07/duckdb:parquet 215284414 222971250 0.97
fineweb_q08/duckdb:parquet 🚀 32510928 38536320 0.84

No file size changes detected.

Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -0.3% -4.5% +4.4% +45.3% ➖ noise
0 datafusion:vortex-file-compressed +1.2% -4.5% +5.9% +49.1% ➖ noise
0 duckdb:vortex-compact -6.7% -4.5% -2.3% +96.9% ➖ noise
0 duckdb:vortex-file-compressed -11.8% -4.5% -7.6% +80.2% ➖ noise
1 datafusion:vortex-compact +8.3% -3.4% +12.1% +14.8% ➖ noise
1 datafusion:vortex-file-compressed -5.2% -3.4% -1.9% +15.9% ➖ noise
1 duckdb:vortex-compact +7.2% -3.4% +11.0% +23.8% ➖ noise
1 duckdb:vortex-file-compressed -7.6% -3.4% -4.4% +63.9% ➖ noise
2 datafusion:vortex-compact +2.3% -2.1% +4.5% +10.7% ➖ noise
2 datafusion:vortex-file-compressed +11.7% -2.1% +14.1% +25.1% ➖ noise
2 duckdb:vortex-compact -8.1% -2.1% -6.2% +10.7% ➖ noise
2 duckdb:vortex-file-compressed -1.2% -2.1% +1.0% +11.4% ➖ noise
3 datafusion:vortex-compact -3.3% -3.7% +0.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -9.5% -3.7% -6.0% +23.7% ➖ noise
3 duckdb:vortex-compact -2.5% -3.7% +1.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -20.0% -3.7% -16.9% +25.9% ➖ noise
4 datafusion:vortex-compact -2.2% -2.8% +0.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.7% -2.8% +3.6% +10.0% ➖ noise
4 duckdb:vortex-compact -3.9% -2.8% -1.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.2% -2.8% +3.1% +10.0% ➖ noise
5 datafusion:vortex-compact -3.7% -4.8% +1.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.7% -4.8% +5.8% +10.0% ➖ noise
5 duckdb:vortex-compact -1.3% -4.8% +3.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.1% -4.8% +7.3% +10.0% ➖ noise
6 datafusion:vortex-compact -2.2% -4.8% +2.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -7.0% -4.8% -2.3% +10.2% ➖ noise
6 duckdb:vortex-compact -2.8% -4.8% +2.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.0% -4.8% +1.9% +10.0% ➖ noise
7 datafusion:vortex-compact -2.8% -3.9% +1.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +5.5% -3.9% +9.8% +12.6% ➖ noise
7 duckdb:vortex-compact -2.3% -3.9% +1.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.1% -3.9% -1.2% +15.3% ➖ noise
8 datafusion:vortex-compact -3.8% -10.2% +7.1% +18.0% ➖ noise
8 datafusion:vortex-file-compressed +3.7% -10.2% +15.5% +19.7% ➖ noise
8 duckdb:vortex-compact -8.5% -10.2% +1.9% +21.9% ➖ noise
8 duckdb:vortex-file-compressed -8.3% -10.2% +2.1% +36.0% ➖ noise

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 29, 2026

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 1 improved benchmark
❌ 5 regressed benchmarks
✅ 1260 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_varbinview_canonical_into[(100, 100)] 273.1 µs 307.8 µs -11.27%
Simulation chunked_varbinview_opt_canonical_into[(1000, 10)] 225.4 µs 188.1 µs +19.84%
Simulation encode_varbin[(1000, 32)] 147.3 µs 164.8 µs -10.63%
Simulation encode_varbin[(1000, 2)] 140.5 µs 157 µs -10.51%
Simulation encode_varbin[(1000, 4)] 141.5 µs 158.4 µs -10.71%
Simulation encode_varbin[(1000, 8)] 142.3 µs 158.6 µs -10.3%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing adamg/binary-compressor (f105d74) with develop (7e8f23a)

Open in CodSpeed

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (+0.6%, environment too noisy confidence) · DuckDB No clear signal (-3.2%, environment too noisy confidence)
Vortex (geomean): 1.002x ➖
Parquet (geomean): 1.016x ➖
Shifts: Parquet (control) +1.6% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.002x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51210000 49574568 1.03
tpch_q02/datafusion:vortex-file-compressed 22978948 22677413 1.01
tpch_q03/datafusion:vortex-file-compressed 27715672 27529014 1.01
tpch_q04/datafusion:vortex-file-compressed 20557856 20286106 1.01
tpch_q05/datafusion:vortex-file-compressed 48171604 48323165 1.00
tpch_q06/datafusion:vortex-file-compressed 10815098 10685866 1.01
tpch_q07/datafusion:vortex-file-compressed 55139631 54622900 1.01
tpch_q08/datafusion:vortex-file-compressed 39617830 39285173 1.01
tpch_q09/datafusion:vortex-file-compressed 51837924 52824805 0.98
tpch_q10/datafusion:vortex-file-compressed 39028956 39818882 0.98
tpch_q11/datafusion:vortex-file-compressed 16402782 16636318 0.99
tpch_q12/datafusion:vortex-file-compressed 24779757 24446467 1.01
tpch_q13/datafusion:vortex-file-compressed 25324427 25141946 1.01
tpch_q14/datafusion:vortex-file-compressed 15746222 16086376 0.98
tpch_q15/datafusion:vortex-file-compressed 25122391 24462085 1.03
tpch_q16/datafusion:vortex-file-compressed 19747635 20560581 0.96
tpch_q17/datafusion:vortex-file-compressed 67870472 68688861 0.99
tpch_q18/datafusion:vortex-file-compressed 80672635 81821488 0.99
tpch_q19/datafusion:vortex-file-compressed 20982035 20285836 1.03
tpch_q20/datafusion:vortex-file-compressed 30721219 29721313 1.03
tpch_q21/datafusion:vortex-file-compressed 70882397 72569707 0.98
tpch_q22/datafusion:vortex-file-compressed 12406192 12305143 1.01
datafusion / vortex-compact (1.012x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 56110631 56299917 1.00
tpch_q02/datafusion:vortex-compact 26309714 25627093 1.03
tpch_q03/datafusion:vortex-compact 28582290 29107371 0.98
tpch_q04/datafusion:vortex-compact 22581170 22350996 1.01
tpch_q05/datafusion:vortex-compact 51103034 50579720 1.01
tpch_q06/datafusion:vortex-compact 12790887 12454037 1.03
tpch_q07/datafusion:vortex-compact 58382429 58154652 1.00
tpch_q08/datafusion:vortex-compact 43962575 42783799 1.03
tpch_q09/datafusion:vortex-compact 55478860 55469942 1.00
tpch_q10/datafusion:vortex-compact 46314230 45237681 1.02
tpch_q11/datafusion:vortex-compact 16884818 17212848 0.98
tpch_q12/datafusion:vortex-compact 30831805 30323499 1.02
tpch_q13/datafusion:vortex-compact 32153473 31716168 1.01
tpch_q14/datafusion:vortex-compact 19171072 19160994 1.00
tpch_q15/datafusion:vortex-compact 30772993 31039284 0.99
tpch_q16/datafusion:vortex-compact 24472920 24161619 1.01
tpch_q17/datafusion:vortex-compact 70233900 70168111 1.00
tpch_q18/datafusion:vortex-compact 85146687 83801894 1.02
tpch_q19/datafusion:vortex-compact 31491668 31240440 1.01
tpch_q20/datafusion:vortex-compact 34881783 33518545 1.04
tpch_q21/datafusion:vortex-compact 77778914 74926439 1.04
tpch_q22/datafusion:vortex-compact 12763686 12379154 1.03
datafusion / parquet (1.000x ➖, 2↑ 2↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 116878001 102416711 1.14
tpch_q02/datafusion:parquet 62006973 62482692 0.99
tpch_q03/datafusion:parquet 🚨 74050948 66058722 1.12
tpch_q04/datafusion:parquet 43682990 43841669 1.00
tpch_q05/datafusion:parquet 94430577 92929925 1.02
tpch_q06/datafusion:parquet 🚀 32061133 39661357 0.81
tpch_q07/datafusion:parquet 106958243 107069662 1.00
tpch_q08/datafusion:parquet 90287544 96640581 0.93
tpch_q09/datafusion:parquet 128457735 126660884 1.01
tpch_q10/datafusion:parquet 112901747 113813261 0.99
tpch_q11/datafusion:parquet 41188110 40416876 1.02
tpch_q12/datafusion:parquet 🚀 73884502 86331239 0.86
tpch_q13/datafusion:parquet 201782629 198772273 1.02
tpch_q14/datafusion:parquet 47513456 43397758 1.09
tpch_q15/datafusion:parquet 61246955 56397117 1.09
tpch_q16/datafusion:parquet 41295566 41001753 1.01
tpch_q17/datafusion:parquet 133887983 131480335 1.02
tpch_q18/datafusion:parquet 159887374 167346485 0.96
tpch_q19/datafusion:parquet 74045139 76756312 0.96
tpch_q20/datafusion:parquet 69672985 70641356 0.99
tpch_q21/datafusion:parquet 136742333 133119569 1.03
tpch_q22/datafusion:parquet 31619403 31206176 1.01
datafusion / arrow (1.003x ➖, 1↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 56100517 56064734 1.00
tpch_q02/datafusion:arrow 19484907 19112544 1.02
tpch_q03/datafusion:arrow 29330242 29994346 0.98
tpch_q04/datafusion:arrow 25981538 25258229 1.03
tpch_q05/datafusion:arrow 78940908 73191795 1.08
tpch_q06/datafusion:arrow 19563976 19329627 1.01
tpch_q07/datafusion:arrow 104079489 100845543 1.03
tpch_q08/datafusion:arrow 43959162 42319276 1.04
tpch_q09/datafusion:arrow 🚀 62193932 69294530 0.90
tpch_q10/datafusion:arrow 45527537 47216557 0.96
tpch_q11/datafusion:arrow 9092912 9033820 1.01
tpch_q12/datafusion:arrow 51709093 51015314 1.01
tpch_q13/datafusion:arrow 47159074 47545918 0.99
tpch_q14/datafusion:arrow 21093573 21406985 0.99
tpch_q15/datafusion:arrow 41191525 41758810 0.99
tpch_q16/datafusion:arrow 19155967 18697104 1.02
tpch_q17/datafusion:arrow 66923606 66974881 1.00
tpch_q18/datafusion:arrow 132645745 132070398 1.00
tpch_q19/datafusion:arrow 34431498 33832345 1.02
tpch_q20/datafusion:arrow 33902325 33115523 1.02
tpch_q21/datafusion:arrow 149291775 152730399 0.98
tpch_q22/datafusion:arrow 17470180 17590995 0.99
duckdb / vortex-file-compressed (0.989x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31225317 31328116 1.00
tpch_q02/duckdb:vortex-file-compressed 25495660 25330044 1.01
tpch_q03/duckdb:vortex-file-compressed 32635030 33533592 0.97
tpch_q04/duckdb:vortex-file-compressed 28762853 29693659 0.97
tpch_q05/duckdb:vortex-file-compressed 37141902 39095468 0.95
tpch_q06/duckdb:vortex-file-compressed 8167400 8239833 0.99
tpch_q07/duckdb:vortex-file-compressed 34583275 35811277 0.97
tpch_q08/duckdb:vortex-file-compressed 36970601 37477438 0.99
tpch_q09/duckdb:vortex-file-compressed 57563318 57848381 1.00
tpch_q10/duckdb:vortex-file-compressed 41100396 41854868 0.98
tpch_q11/duckdb:vortex-file-compressed 14510358 15046094 0.96
tpch_q12/duckdb:vortex-file-compressed 22058402 23034252 0.96
tpch_q13/duckdb:vortex-file-compressed 41176647 41102342 1.00
tpch_q14/duckdb:vortex-file-compressed 21678024 21656949 1.00
tpch_q15/duckdb:vortex-file-compressed 16878544 16609979 1.02
tpch_q16/duckdb:vortex-file-compressed 29978094 29986241 1.00
tpch_q17/duckdb:vortex-file-compressed 24152877 23892007 1.01
tpch_q18/duckdb:vortex-file-compressed 52803789 52511424 1.01
tpch_q19/duckdb:vortex-file-compressed 29718433 29127129 1.02
tpch_q20/duckdb:vortex-file-compressed 32589066 33282042 0.98
tpch_q21/duckdb:vortex-file-compressed 101056115 101152514 1.00
tpch_q22/duckdb:vortex-file-compressed 17088922 17195066 0.99
duckdb / vortex-compact (1.006x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38559352 38133771 1.01
tpch_q02/duckdb:vortex-compact 33624336 32842063 1.02
tpch_q03/duckdb:vortex-compact 34308214 34142077 1.00
tpch_q04/duckdb:vortex-compact 31872929 30524264 1.04
tpch_q05/duckdb:vortex-compact 41273786 40652374 1.02
tpch_q06/duckdb:vortex-compact 11205748 10350676 1.08
tpch_q07/duckdb:vortex-compact 41020211 40384780 1.02
tpch_q08/duckdb:vortex-compact 41766808 41719158 1.00
tpch_q09/duckdb:vortex-compact 67502429 65576584 1.03
tpch_q10/duckdb:vortex-compact 46329090 44786972 1.03
tpch_q11/duckdb:vortex-compact 17996852 18489454 0.97
tpch_q12/duckdb:vortex-compact 29390640 30340844 0.97
tpch_q13/duckdb:vortex-compact 46930193 48333944 0.97
tpch_q14/duckdb:vortex-compact 26420175 26258210 1.01
tpch_q15/duckdb:vortex-compact 20026183 19786475 1.01
tpch_q16/duckdb:vortex-compact 33306828 32931113 1.01
tpch_q17/duckdb:vortex-compact 29040478 29642291 0.98
tpch_q18/duckdb:vortex-compact 53769676 54072629 0.99
tpch_q19/duckdb:vortex-compact 33041290 33195845 1.00
tpch_q20/duckdb:vortex-compact 39861220 39523200 1.01
tpch_q21/duckdb:vortex-compact 101695050 102644459 0.99
tpch_q22/duckdb:vortex-compact 18094284 18732637 0.97
duckdb / parquet (1.032x ➖, 0↑ 4↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77193272 79058731 0.98
tpch_q02/duckdb:parquet 39011667 39367781 0.99
tpch_q03/duckdb:parquet 70895988 70731070 1.00
tpch_q04/duckdb:parquet 🚨 56705515 49788946 1.14
tpch_q05/duckdb:parquet 67705309 67798960 1.00
tpch_q06/duckdb:parquet 22266237 22213081 1.00
tpch_q07/duckdb:parquet 72794117 69027793 1.05
tpch_q08/duckdb:parquet 🚨 97281192 82187463 1.18
tpch_q09/duckdb:parquet 156547974 144810623 1.08
tpch_q10/duckdb:parquet 135340717 130803405 1.03
tpch_q11/duckdb:parquet 22067574 22498551 0.98
tpch_q12/duckdb:parquet 47049037 46845545 1.00
tpch_q13/duckdb:parquet 253179181 252553038 1.00
tpch_q14/duckdb:parquet 51360736 50886804 1.01
tpch_q15/duckdb:parquet 🚨 28732700 25967692 1.11
tpch_q16/duckdb:parquet 57882564 57814121 1.00
tpch_q17/duckdb:parquet 60811383 60741973 1.00
tpch_q18/duckdb:parquet 120539687 118938910 1.01
tpch_q19/duckdb:parquet 🚨 79703261 69423105 1.15
tpch_q20/duckdb:parquet 65484656 65311042 1.00
tpch_q21/duckdb:parquet 174180854 175204371 0.99
tpch_q22/duckdb:parquet 53988019 53726670 1.00
duckdb / duckdb (1.001x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17816366 17681339 1.01
tpch_q02/duckdb:duckdb 14303031 14160925 1.01
tpch_q03/duckdb:duckdb 22269815 22048985 1.01
tpch_q04/duckdb:duckdb 22573580 22590524 1.00
tpch_q05/duckdb:duckdb 22463622 23358610 0.96
tpch_q06/duckdb:duckdb 7066308 7000524 1.01
tpch_q07/duckdb:duckdb 25614321 25274378 1.01
tpch_q08/duckdb:duckdb 24250410 24589048 0.99
tpch_q09/duckdb:duckdb 57338152 56951960 1.01
tpch_q10/duckdb:duckdb 50224027 52039827 0.97
tpch_q11/duckdb:duckdb 7172206 7104165 1.01
tpch_q12/duckdb:duckdb 18326647 18299953 1.00
tpch_q13/duckdb:duckdb 39293992 38968305 1.01
tpch_q14/duckdb:duckdb 21403502 21074255 1.02
tpch_q15/duckdb:duckdb 13774920 13690561 1.01
tpch_q16/duckdb:duckdb 26053470 26084141 1.00
tpch_q17/duckdb:duckdb 16108520 16204336 0.99
tpch_q18/duckdb:duckdb 40973628 40629191 1.01
tpch_q19/duckdb:duckdb 30776023 30695924 1.00
tpch_q20/duckdb:duckdb 25095231 25268869 0.99
tpch_q21/duckdb:duckdb 61502345 61199374 1.00
tpch_q22/duckdb:duckdb 25479016 25101304 1.02

No file size changes detected.

Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.1% +5.6% -5.2% +20.5% ➖ noise
1 datafusion:vortex-compact -0.3% +5.6% -5.6% +18.3% ➖ noise
1 datafusion:vortex-file-compressed +3.3% +5.6% -2.1% +18.7% ➖ noise
1 duckdb:duckdb +0.8% +5.6% -4.5% +17.8% ➖ noise
1 duckdb:vortex-compact +1.1% +5.6% -4.2% +16.7% ➖ noise
1 duckdb:vortex-file-compressed -0.3% +5.6% -5.6% +19.0% ➖ noise
2 datafusion:arrow +1.9% -0.8% +2.8% +12.1% ➖ noise
2 datafusion:vortex-compact +2.7% -0.8% +3.5% +12.1% ➖ noise
2 datafusion:vortex-file-compressed +1.3% -0.8% +2.2% +12.5% ➖ noise
2 duckdb:duckdb +1.0% -0.8% +1.9% +12.1% ➖ noise
2 duckdb:vortex-compact +2.4% -0.8% +3.2% +12.1% ➖ noise
2 duckdb:vortex-file-compressed +0.7% -0.8% +1.5% +12.1% ➖ noise
3 datafusion:arrow -2.2% +6.0% -7.7% +12.1% ➖ noise
3 datafusion:vortex-compact -1.8% +6.0% -7.4% +13.5% ➖ noise
3 datafusion:vortex-file-compressed +0.7% +6.0% -5.0% +12.1% ➖ noise
3 duckdb:duckdb +1.0% +6.0% -4.7% +12.1% ➖ noise
3 duckdb:vortex-compact +0.5% +6.0% -5.2% +12.1% ➖ noise
3 duckdb:vortex-file-compressed -2.7% +6.0% -8.2% +12.1% ➖ noise
4 datafusion:arrow +2.9% +6.5% -3.4% +12.1% ➖ noise
4 datafusion:vortex-compact +1.0% +6.5% -5.2% +12.1% ➖ noise
4 datafusion:vortex-file-compressed +1.3% +6.5% -4.9% +15.2% ➖ noise
4 duckdb:duckdb -0.1% +6.5% -6.2% +12.1% ➖ noise
4 duckdb:vortex-compact +4.4% +6.5% -2.0% +12.1% ➖ noise
4 duckdb:vortex-file-compressed -3.1% +6.5% -9.1% +12.1% ➖ noise
5 datafusion:arrow +7.9% +0.7% +7.1% +12.1% ➖ noise
5 datafusion:vortex-compact +1.0% +0.7% +0.3% +12.1% ➖ noise
5 datafusion:vortex-file-compressed -0.3% +0.7% -1.0% +12.1% ➖ noise
5 duckdb:duckdb -3.8% +0.7% -4.5% +12.1% ➖ noise
5 duckdb:vortex-compact +1.5% +0.7% +0.8% +12.1% ➖ noise
5 duckdb:vortex-file-compressed -5.0% +0.7% -5.7% +12.1% ➖ noise
6 datafusion:arrow +1.2% -10.0% +12.4% +12.7% ➖ noise
6 datafusion:vortex-compact +2.7% -10.0% +14.1% +14.9% ➖ noise
6 datafusion:vortex-file-compressed +1.2% -10.0% +12.4% +17.0% ➖ noise
6 duckdb:duckdb +0.9% -10.0% +12.1% +12.7% ➖ noise
6 duckdb:vortex-compact +8.3% -10.0% +20.3% +19.4% 🚨 regression
6 duckdb:vortex-file-compressed -0.9% -10.0% +10.1% +14.3% ➖ noise
7 datafusion:arrow +3.2% +2.6% +0.6% +12.1% ➖ noise
7 datafusion:vortex-compact +0.4% +2.6% -2.2% +12.1% ➖ noise
7 datafusion:vortex-file-compressed +0.9% +2.6% -1.6% +12.1% ➖ noise
7 duckdb:duckdb +1.3% +2.6% -1.3% +12.1% ➖ noise
7 duckdb:vortex-compact +1.6% +2.6% -1.0% +12.1% ➖ noise
7 duckdb:vortex-file-compressed -3.4% +2.6% -5.9% +12.1% ➖ noise
8 datafusion:arrow +3.9% +5.2% -1.2% +12.1% ➖ noise
8 datafusion:vortex-compact +2.8% +5.2% -2.3% +12.1% ➖ noise
8 datafusion:vortex-file-compressed +0.8% +5.2% -4.1% +12.6% ➖ noise
8 duckdb:duckdb -1.4% +5.2% -6.2% +12.1% ➖ noise
8 duckdb:vortex-compact +0.1% +5.2% -4.8% +12.1% ➖ noise
8 duckdb:vortex-file-compressed -1.4% +5.2% -6.2% +16.1% ➖ noise
9 datafusion:arrow -10.2% +4.7% -14.3% +12.1% ✅ faster
9 datafusion:vortex-compact +0.0% +4.7% -4.5% +12.1% ➖ noise
9 datafusion:vortex-file-compressed -1.9% +4.7% -6.3% +12.1% ➖ noise
9 duckdb:duckdb +0.7% +4.7% -3.8% +12.1% ➖ noise
9 duckdb:vortex-compact +2.9% +4.7% -1.7% +12.1% ➖ noise
9 duckdb:vortex-file-compressed -0.5% +4.7% -5.0% +12.1% ➖ noise
10 datafusion:arrow -3.6% +1.3% -4.8% +12.1% ➖ noise
10 datafusion:vortex-compact +2.4% +1.3% +1.1% +12.1% ➖ noise
10 datafusion:vortex-file-compressed -2.0% +1.3% -3.3% +12.1% ➖ noise
10 duckdb:duckdb -3.5% +1.3% -4.7% +12.1% ➖ noise
10 duckdb:vortex-compact +3.4% +1.3% +2.1% +12.1% ➖ noise
10 duckdb:vortex-file-compressed -1.8% +1.3% -3.1% +12.1% ➖ noise
11 datafusion:arrow +0.7% -0.0% +0.7% +12.1% ➖ noise
11 datafusion:vortex-compact -1.9% -0.0% -1.9% +12.1% ➖ noise
11 datafusion:vortex-file-compressed -1.4% -0.0% -1.4% +12.1% ➖ noise
11 duckdb:duckdb +1.0% -0.0% +1.0% +12.1% ➖ noise
11 duckdb:vortex-compact -2.7% -0.0% -2.6% +14.9% ➖ noise
11 duckdb:vortex-file-compressed -3.6% -0.0% -3.5% +25.9% ➖ noise
12 datafusion:arrow +1.4% -7.3% +9.3% +18.5% ➖ noise
12 datafusion:vortex-compact +1.7% -7.3% +9.7% +15.8% ➖ noise
12 datafusion:vortex-file-compressed +1.4% -7.3% +9.3% +15.2% ➖ noise
12 duckdb:duckdb +0.1% -7.3% +8.0% +12.1% ➖ noise
12 duckdb:vortex-compact -3.1% -7.3% +4.5% +12.1% ➖ noise
12 duckdb:vortex-file-compressed -4.2% -7.3% +3.3% +12.1% ➖ noise
13 datafusion:arrow -0.8% +0.9% -1.7% +12.1% ➖ noise
13 datafusion:vortex-compact +1.4% +0.9% +0.5% +12.1% ➖ noise
13 datafusion:vortex-file-compressed +0.7% +0.9% -0.2% +12.1% ➖ noise
13 duckdb:duckdb +0.8% +0.9% -0.0% +12.1% ➖ noise
13 duckdb:vortex-compact -2.9% +0.9% -3.8% +12.1% ➖ noise
13 duckdb:vortex-file-compressed +0.2% +0.9% -0.7% +12.1% ➖ noise
14 datafusion:arrow -1.5% +5.1% -6.3% +13.7% ➖ noise
14 datafusion:vortex-compact +0.1% +5.1% -4.8% +12.1% ➖ noise
14 datafusion:vortex-file-compressed -2.1% +5.1% -6.9% +17.3% ➖ noise
14 duckdb:duckdb +1.6% +5.1% -3.4% +12.1% ➖ noise
14 duckdb:vortex-compact +0.6% +5.1% -4.3% +12.1% ➖ noise
14 duckdb:vortex-file-compressed +0.1% +5.1% -4.8% +12.1% ➖ noise
15 datafusion:arrow -1.4% +9.6% -10.0% +12.1% ➖ noise
15 datafusion:vortex-compact -0.9% +9.6% -9.6% +14.9% ➖ noise
15 datafusion:vortex-file-compressed +2.7% +9.6% -6.3% +12.6% ➖ noise
15 duckdb:duckdb +0.6% +9.6% -8.2% +12.1% ➖ noise
15 duckdb:vortex-compact +1.2% +9.6% -7.7% +12.1% ➖ noise
15 duckdb:vortex-file-compressed +1.6% +9.6% -7.3% +12.2% ➖ noise
16 datafusion:arrow +2.5% +0.4% +2.0% +12.1% ➖ noise
16 datafusion:vortex-compact +1.3% +0.4% +0.9% +12.1% ➖ noise
16 datafusion:vortex-file-compressed -4.0% +0.4% -4.4% +13.2% ➖ noise
16 duckdb:duckdb -0.1% +0.4% -0.5% +12.1% ➖ noise
16 duckdb:vortex-compact +1.1% +0.4% +0.7% +12.1% ➖ noise
16 duckdb:vortex-file-compressed -0.0% +0.4% -0.4% +12.1% ➖ noise
17 datafusion:arrow -0.1% +1.0% -1.0% +12.1% ➖ noise
17 datafusion:vortex-compact +0.1% +1.0% -0.9% +12.2% ➖ noise
17 datafusion:vortex-file-compressed -1.2% +1.0% -2.1% +13.5% ➖ noise
17 duckdb:duckdb -0.6% +1.0% -1.5% +12.1% ➖ noise
17 duckdb:vortex-compact -2.0% +1.0% -3.0% +12.1% ➖ noise
17 duckdb:vortex-file-compressed +1.1% +1.0% +0.1% +12.5% ➖ noise
18 datafusion:arrow +0.4% -1.6% +2.1% +12.1% ➖ noise
18 datafusion:vortex-compact +1.6% -1.6% +3.3% +12.1% ➖ noise
18 datafusion:vortex-file-compressed -1.4% -1.6% +0.2% +12.1% ➖ noise
18 duckdb:duckdb +0.8% -1.6% +2.5% +12.1% ➖ noise
18 duckdb:vortex-compact -0.6% -1.6% +1.1% +12.1% ➖ noise
18 duckdb:vortex-file-compressed +0.6% -1.6% +2.2% +12.1% ➖ noise
19 datafusion:arrow +1.8% +5.2% -3.3% +23.4% ➖ noise
19 datafusion:vortex-compact +0.8% +5.2% -4.2% +15.9% ➖ noise
19 datafusion:vortex-file-compressed +3.4% +5.2% -1.7% +17.7% ➖ noise
19 duckdb:duckdb +0.3% +5.2% -4.7% +12.2% ➖ noise
19 duckdb:vortex-compact -0.5% +5.2% -5.4% +12.9% ➖ noise
19 duckdb:vortex-file-compressed +2.0% +5.2% -3.0% +12.7% ➖ noise
20 datafusion:arrow +2.4% -0.6% +2.9% +12.1% ➖ noise
20 datafusion:vortex-compact +4.1% -0.6% +4.6% +12.1% ➖ noise
20 datafusion:vortex-file-compressed +3.4% -0.6% +3.9% +12.1% ➖ noise
20 duckdb:duckdb -0.7% -0.6% -0.1% +12.1% ➖ noise
20 duckdb:vortex-compact +0.9% -0.6% +1.4% +12.1% ➖ noise
20 duckdb:vortex-file-compressed -2.1% -0.6% -1.5% +12.1% ➖ noise
21 datafusion:arrow -2.3% +1.1% -3.3% +12.1% ➖ noise
21 datafusion:vortex-compact +3.8% +1.1% +2.7% +12.1% ➖ noise
21 datafusion:vortex-file-compressed -2.3% +1.1% -3.3% +12.1% ➖ noise
21 duckdb:duckdb +0.5% +1.1% -0.6% +12.1% ➖ noise
21 duckdb:vortex-compact -0.9% +1.1% -2.0% +12.1% ➖ noise
21 duckdb:vortex-file-compressed -0.1% +1.1% -1.1% +12.1% ➖ noise
22 datafusion:arrow -0.7% +0.9% -1.6% +12.1% ➖ noise
22 datafusion:vortex-compact +3.1% +0.9% +2.2% +12.1% ➖ noise
22 datafusion:vortex-file-compressed +0.8% +0.9% -0.1% +15.0% ➖ noise
22 duckdb:duckdb +1.5% +0.9% +0.6% +12.1% ➖ noise
22 duckdb:vortex-compact -3.4% +0.9% -4.3% +13.8% ➖ noise
22 duckdb:vortex-file-compressed -0.6% +0.9% -1.5% +12.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+1.6%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): 1.001x ➖
Parquet (geomean): 0.995x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.005x ➖, 1↑ 3↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 25339169 25562987 0.99
tpcds_q02/datafusion:vortex-file-compressed 48378993 48929613 0.99
tpcds_q03/datafusion:vortex-file-compressed 15575299 15511136 1.00
tpcds_q04/datafusion:vortex-file-compressed 259268214 256970684 1.01
tpcds_q05/datafusion:vortex-file-compressed 44304231 44668580 0.99
tpcds_q06/datafusion:vortex-file-compressed 59864976 62262260 0.96
tpcds_q07/datafusion:vortex-file-compressed 42585864 42058686 1.01
tpcds_q08/datafusion:vortex-file-compressed 29679605 29969310 0.99
tpcds_q09/datafusion:vortex-file-compressed 40146075 39725043 1.01
tpcds_q10/datafusion:vortex-file-compressed 39706861 37906964 1.05
tpcds_q11/datafusion:vortex-file-compressed 128737032 138128504 0.93
tpcds_q12/datafusion:vortex-file-compressed 20440717 20777419 0.98
tpcds_q13/datafusion:vortex-file-compressed 47719806 47416974 1.01
tpcds_q14/datafusion:vortex-file-compressed 170296246 172210137 0.99
tpcds_q15/datafusion:vortex-file-compressed 28191716 27819237 1.01
tpcds_q16/datafusion:vortex-file-compressed 29037303 29250335 0.99
tpcds_q17/datafusion:vortex-file-compressed 64432839 64842871 0.99
tpcds_q18/datafusion:vortex-file-compressed 69673570 71440417 0.98
tpcds_q19/datafusion:vortex-file-compressed 23393023 21943778 1.07
tpcds_q20/datafusion:vortex-file-compressed 22680330 22390458 1.01
tpcds_q21/datafusion:vortex-file-compressed 35865509 33694214 1.06
tpcds_q22/datafusion:vortex-file-compressed 🚨 143457475 113760086 1.26
tpcds_q23/datafusion:vortex-file-compressed 156237712 151705367 1.03
tpcds_q24/datafusion:vortex-file-compressed 84631061 83778061 1.01
tpcds_q25/datafusion:vortex-file-compressed 68961341 68997714 1.00
tpcds_q26/datafusion:vortex-file-compressed 34207340 33480185 1.02
tpcds_q27/datafusion:vortex-file-compressed 106340469 107801967 0.99
tpcds_q28/datafusion:vortex-file-compressed 34338450 33153861 1.04
tpcds_q29/datafusion:vortex-file-compressed 63687564 63626397 1.00
tpcds_q30/datafusion:vortex-file-compressed 23120312 23424810 0.99
tpcds_q31/datafusion:vortex-file-compressed 75197260 74688035 1.01
tpcds_q32/datafusion:vortex-file-compressed 20455922 20388363 1.00
tpcds_q33/datafusion:vortex-file-compressed 29317897 30346001 0.97
tpcds_q34/datafusion:vortex-file-compressed 26039463 25123608 1.04
tpcds_q35/datafusion:vortex-file-compressed 48180000 45840273 1.05
tpcds_q36/datafusion:vortex-file-compressed 58232090 57005430 1.02
tpcds_q37/datafusion:vortex-file-compressed 24919757 24434605 1.02
tpcds_q38/datafusion:vortex-file-compressed 45227651 43604015 1.04
tpcds_q39/datafusion:vortex-file-compressed 104582030 104940918 1.00
tpcds_q40/datafusion:vortex-file-compressed 33383727 33418734 1.00
tpcds_q41/datafusion:vortex-file-compressed 15635175 16855672 0.93
tpcds_q42/datafusion:vortex-file-compressed 14169760 14474040 0.98
tpcds_q43/datafusion:vortex-file-compressed 18724449 19910555 0.94
tpcds_q44/datafusion:vortex-file-compressed 32297840 33686180 0.96
tpcds_q45/datafusion:vortex-file-compressed 28019398 27696260 1.01
tpcds_q46/datafusion:vortex-file-compressed 35999933 34333761 1.05
tpcds_q47/datafusion:vortex-file-compressed 132715861 135790148 0.98
tpcds_q48/datafusion:vortex-file-compressed 39021494 36025487 1.08
tpcds_q49/datafusion:vortex-file-compressed 58820638 59489020 0.99
tpcds_q50/datafusion:vortex-file-compressed 40468402 40085010 1.01
tpcds_q51/datafusion:vortex-file-compressed 92173225 89881419 1.03
tpcds_q52/datafusion:vortex-file-compressed 14894153 14631699 1.02
tpcds_q53/datafusion:vortex-file-compressed 21754599 21563710 1.01
tpcds_q54/datafusion:vortex-file-compressed 35041896 38213623 0.92
tpcds_q55/datafusion:vortex-file-compressed 14345636 14623246 0.98
tpcds_q56/datafusion:vortex-file-compressed 30370799 29930409 1.01
tpcds_q57/datafusion:vortex-file-compressed 106450241 114776545 0.93
tpcds_q58/datafusion:vortex-file-compressed 52015138 54978199 0.95
tpcds_q59/datafusion:vortex-file-compressed 58500313 56737412 1.03
tpcds_q60/datafusion:vortex-file-compressed 30002124 29559456 1.01
tpcds_q61/datafusion:vortex-file-compressed 40882178 41075854 1.00
tpcds_q62/datafusion:vortex-file-compressed 🚀 24150702 27437857 0.88
tpcds_q63/datafusion:vortex-file-compressed 21632766 22453876 0.96
tpcds_q64/datafusion:vortex-file-compressed 420502735 429087172 0.98
tpcds_q65/datafusion:vortex-file-compressed 40103627 40054958 1.00
tpcds_q66/datafusion:vortex-file-compressed 75207077 74890031 1.00
tpcds_q67/datafusion:vortex-file-compressed 148832294 145987602 1.02
tpcds_q68/datafusion:vortex-file-compressed 32365242 32642030 0.99
tpcds_q69/datafusion:vortex-file-compressed 36332080 36137341 1.01
tpcds_q70/datafusion:vortex-file-compressed 83218260 87171391 0.95
tpcds_q71/datafusion:vortex-file-compressed 23486676 22701821 1.03
tpcds_q72/datafusion:vortex-file-compressed 2198815703 2223641041 0.99
tpcds_q73/datafusion:vortex-file-compressed 23493358 23742763 0.99
tpcds_q74/datafusion:vortex-file-compressed 82754988 85114264 0.97
tpcds_q75/datafusion:vortex-file-compressed 110309521 109614015 1.01
tpcds_q76/datafusion:vortex-file-compressed 31998299 31807965 1.01
tpcds_q77/datafusion:vortex-file-compressed 40662491 41472666 0.98
tpcds_q78/datafusion:vortex-file-compressed 127902503 125558003 1.02
tpcds_q79/datafusion:vortex-file-compressed 30063893 30286165 0.99
tpcds_q80/datafusion:vortex-file-compressed 97438215 94783654 1.03
tpcds_q81/datafusion:vortex-file-compressed 24201771 24439467 0.99
tpcds_q82/datafusion:vortex-file-compressed 24865159 24056909 1.03
tpcds_q83/datafusion:vortex-file-compressed 35022983 34489066 1.02
tpcds_q84/datafusion:vortex-file-compressed 13410337 13382843 1.00
tpcds_q85/datafusion:vortex-file-compressed 91659989 93558338 0.98
tpcds_q86/datafusion:vortex-file-compressed 17042154 16718649 1.02
tpcds_q87/datafusion:vortex-file-compressed 44558094 44227278 1.01
tpcds_q88/datafusion:vortex-file-compressed 58490133 56353912 1.04
tpcds_q89/datafusion:vortex-file-compressed 25206064 25001383 1.01
tpcds_q90/datafusion:vortex-file-compressed 🚨 16055258 14455244 1.11
tpcds_q91/datafusion:vortex-file-compressed 18946627 18938710 1.00
tpcds_q92/datafusion:vortex-file-compressed 19778448 18317610 1.08
tpcds_q93/datafusion:vortex-file-compressed 35024587 34007439 1.03
tpcds_q94/datafusion:vortex-file-compressed 23705567 23756868 1.00
tpcds_q95/datafusion:vortex-file-compressed 64569616 64668859 1.00
tpcds_q96/datafusion:vortex-file-compressed 14068741 14382925 0.98
tpcds_q97/datafusion:vortex-file-compressed 33149902 33314873 1.00
tpcds_q98/datafusion:vortex-file-compressed 24882547 24159729 1.03
tpcds_q99/datafusion:vortex-file-compressed 🚨 32701247 28599422 1.14
datafusion / vortex-compact (1.005x ➖, 0↑ 3↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25399082 25157626 1.01
tpcds_q02/datafusion:vortex-compact 54777335 54509044 1.00
tpcds_q03/datafusion:vortex-compact 19624722 20204252 0.97
tpcds_q04/datafusion:vortex-compact 308246115 296876383 1.04
tpcds_q05/datafusion:vortex-compact 51312106 48153910 1.07
tpcds_q06/datafusion:vortex-compact 63786344 61829198 1.03
tpcds_q07/datafusion:vortex-compact 55215229 55141138 1.00
tpcds_q08/datafusion:vortex-compact 36236847 36580970 0.99
tpcds_q09/datafusion:vortex-compact 53721887 53354046 1.01
tpcds_q10/datafusion:vortex-compact 50589873 50389153 1.00
tpcds_q11/datafusion:vortex-compact 154999211 149527424 1.04
tpcds_q12/datafusion:vortex-compact 24825792 26277090 0.94
tpcds_q13/datafusion:vortex-compact 🚨 154977670 124550678 1.24
tpcds_q14/datafusion:vortex-compact 202835117 199989892 1.01
tpcds_q15/datafusion:vortex-compact 30895589 31220038 0.99
tpcds_q16/datafusion:vortex-compact 32860592 32691224 1.01
tpcds_q17/datafusion:vortex-compact 74899407 75699367 0.99
tpcds_q18/datafusion:vortex-compact 80097645 83571985 0.96
tpcds_q19/datafusion:vortex-compact 30314660 30543990 0.99
tpcds_q20/datafusion:vortex-compact 26620870 26313405 1.01
tpcds_q21/datafusion:vortex-compact 40365150 39030789 1.03
tpcds_q22/datafusion:vortex-compact 🚨 146112407 118547810 1.23
tpcds_q23/datafusion:vortex-compact 169633352 162998558 1.04
tpcds_q24/datafusion:vortex-compact 97870556 101904397 0.96
tpcds_q25/datafusion:vortex-compact 79241785 78444678 1.01
tpcds_q26/datafusion:vortex-compact 44624200 48458965 0.92
tpcds_q27/datafusion:vortex-compact 130703381 125270709 1.04
tpcds_q28/datafusion:vortex-compact 96647353 101171607 0.96
tpcds_q29/datafusion:vortex-compact 74099848 75447156 0.98
tpcds_q30/datafusion:vortex-compact 28299042 27427046 1.03
tpcds_q31/datafusion:vortex-compact 101166484 100538197 1.01
tpcds_q32/datafusion:vortex-compact 25421035 25481240 1.00
tpcds_q33/datafusion:vortex-compact 37716261 37746413 1.00
tpcds_q34/datafusion:vortex-compact 34796369 32838411 1.06
tpcds_q35/datafusion:vortex-compact 52184708 54371871 0.96
tpcds_q36/datafusion:vortex-compact 77874516 77871944 1.00
tpcds_q37/datafusion:vortex-compact 34072170 34425318 0.99
tpcds_q38/datafusion:vortex-compact 52275607 53252410 0.98
tpcds_q39/datafusion:vortex-compact 116286823 117283773 0.99
tpcds_q40/datafusion:vortex-compact 38232887 36187693 1.06
tpcds_q41/datafusion:vortex-compact 17487779 18301043 0.96
tpcds_q42/datafusion:vortex-compact 18701248 20483315 0.91
tpcds_q43/datafusion:vortex-compact 25205431 24891240 1.01
tpcds_q44/datafusion:vortex-compact 48256349 49670073 0.97
tpcds_q45/datafusion:vortex-compact 31690203 31382164 1.01
tpcds_q46/datafusion:vortex-compact 45590648 45090176 1.01
tpcds_q47/datafusion:vortex-compact 152425280 158959736 0.96
tpcds_q48/datafusion:vortex-compact 88125302 83833911 1.05
tpcds_q49/datafusion:vortex-compact 71046454 70223919 1.01
tpcds_q50/datafusion:vortex-compact 47525244 47580863 1.00
tpcds_q51/datafusion:vortex-compact 100620185 97111731 1.04
tpcds_q52/datafusion:vortex-compact 18946519 19045549 0.99
tpcds_q53/datafusion:vortex-compact 29014439 28863834 1.01
tpcds_q54/datafusion:vortex-compact 41772867 44078560 0.95
tpcds_q55/datafusion:vortex-compact 18349802 18157216 1.01
tpcds_q56/datafusion:vortex-compact 36162014 37048019 0.98
tpcds_q57/datafusion:vortex-compact 122468467 116421345 1.05
tpcds_q58/datafusion:vortex-compact 65795878 65175898 1.01
tpcds_q59/datafusion:vortex-compact 70411874 75125841 0.94
tpcds_q60/datafusion:vortex-compact 36149624 37409979 0.97
tpcds_q61/datafusion:vortex-compact 55668646 55187693 1.01
tpcds_q62/datafusion:vortex-compact 🚨 31654561 27338888 1.16
tpcds_q63/datafusion:vortex-compact 28939933 28682690 1.01
tpcds_q64/datafusion:vortex-compact 466861588 466002252 1.00
tpcds_q65/datafusion:vortex-compact 53604943 53592631 1.00
tpcds_q66/datafusion:vortex-compact 82322512 79595061 1.03
tpcds_q67/datafusion:vortex-compact 153732011 151410183 1.02
tpcds_q68/datafusion:vortex-compact 45636246 44524545 1.02
tpcds_q69/datafusion:vortex-compact 47591118 47625622 1.00
tpcds_q70/datafusion:vortex-compact 94571628 99781787 0.95
tpcds_q71/datafusion:vortex-compact 30606728 30803389 0.99
tpcds_q72/datafusion:vortex-compact 2234924121 2226011265 1.00
tpcds_q73/datafusion:vortex-compact 31050096 34395357 0.90
tpcds_q74/datafusion:vortex-compact 93593980 94204951 0.99
tpcds_q75/datafusion:vortex-compact 137082369 129495751 1.06
tpcds_q76/datafusion:vortex-compact 32506372 32608454 1.00
tpcds_q77/datafusion:vortex-compact 53836402 53662383 1.00
tpcds_q78/datafusion:vortex-compact 142120449 140037227 1.01
tpcds_q79/datafusion:vortex-compact 38226230 38574825 0.99
tpcds_q80/datafusion:vortex-compact 108846514 107411059 1.01
tpcds_q81/datafusion:vortex-compact 27587324 28546291 0.97
tpcds_q82/datafusion:vortex-compact 34019204 35347553 0.96
tpcds_q83/datafusion:vortex-compact 33916389 33523993 1.01
tpcds_q84/datafusion:vortex-compact 15408495 14717931 1.05
tpcds_q85/datafusion:vortex-compact 156176678 157054082 0.99
tpcds_q86/datafusion:vortex-compact 18417793 18122233 1.02
tpcds_q87/datafusion:vortex-compact 52306470 51583750 1.01
tpcds_q88/datafusion:vortex-compact 77916998 77260670 1.01
tpcds_q89/datafusion:vortex-compact 31365317 31445128 1.00
tpcds_q90/datafusion:vortex-compact 15297549 15226228 1.00
tpcds_q91/datafusion:vortex-compact 32492561 33209234 0.98
tpcds_q92/datafusion:vortex-compact 25693029 24245245 1.06
tpcds_q93/datafusion:vortex-compact 38970396 39297960 0.99
tpcds_q94/datafusion:vortex-compact 28982590 27713830 1.05
tpcds_q95/datafusion:vortex-compact 66727228 67913312 0.98
tpcds_q96/datafusion:vortex-compact 17854497 17672819 1.01
tpcds_q97/datafusion:vortex-compact 35447193 36327401 0.98
tpcds_q98/datafusion:vortex-compact 30944673 31161097 0.99
tpcds_q99/datafusion:vortex-compact 35507669 35287729 1.01
datafusion / parquet (0.989x ➖, 2↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30960344 31593533 0.98
tpcds_q02/datafusion:parquet 41516240 43643233 0.95
tpcds_q03/datafusion:parquet 13515977 14375049 0.94
tpcds_q04/datafusion:parquet 273416821 272183677 1.00
tpcds_q05/datafusion:parquet 41423919 43030688 0.96
tpcds_q06/datafusion:parquet 61759341 62456242 0.99
tpcds_q07/datafusion:parquet 78650877 75741669 1.04
tpcds_q08/datafusion:parquet 26711617 26481303 1.01
tpcds_q09/datafusion:parquet 45333100 43887661 1.03
tpcds_q10/datafusion:parquet 68723633 69962996 0.98
tpcds_q11/datafusion:parquet 149367366 151462250 0.99
tpcds_q12/datafusion:parquet 18158819 17898436 1.01
tpcds_q13/datafusion:parquet 75117412 75279775 1.00
tpcds_q14/datafusion:parquet 167309157 167700413 1.00
tpcds_q15/datafusion:parquet 20899851 22063030 0.95
tpcds_q16/datafusion:parquet 23276905 24728038 0.94
tpcds_q17/datafusion:parquet 62825466 67443981 0.93
tpcds_q18/datafusion:parquet 114132709 116257646 0.98
tpcds_q19/datafusion:parquet 22719820 23101663 0.98
tpcds_q20/datafusion:parquet 16326416 16610482 0.98
tpcds_q21/datafusion:parquet 18660826 18356853 1.02
tpcds_q22/datafusion:parquet 148494676 145433419 1.02
tpcds_q23/datafusion:parquet 145655216 147251607 0.99
tpcds_q24/datafusion:parquet 92913068 90856037 1.02
tpcds_q25/datafusion:parquet 64694538 64585368 1.00
tpcds_q26/datafusion:parquet 64612121 64370152 1.00
tpcds_q27/datafusion:parquet 146882822 148476827 0.99
tpcds_q28/datafusion:parquet 45539135 45095223 1.01
tpcds_q29/datafusion:parquet 66577895 66156969 1.01
tpcds_q30/datafusion:parquet 33964885 35792805 0.95
tpcds_q31/datafusion:parquet 65110374 64522753 1.01
tpcds_q32/datafusion:parquet 18756408 18183105 1.03
tpcds_q33/datafusion:parquet 27336583 28411610 0.96
tpcds_q34/datafusion:parquet 21116818 22799938 0.93
tpcds_q35/datafusion:parquet 69720192 69508529 1.00
tpcds_q36/datafusion:parquet 57226083 56996152 1.00
tpcds_q37/datafusion:parquet 20125030 18547822 1.09
tpcds_q38/datafusion:parquet 44089995 43113161 1.02
tpcds_q39/datafusion:parquet 74765251 74626389 1.00
tpcds_q40/datafusion:parquet 24282580 23541352 1.03
tpcds_q41/datafusion:parquet 13396081 13193710 1.02
tpcds_q42/datafusion:parquet 11663954 11868157 0.98
tpcds_q43/datafusion:parquet 17251658 17862962 0.97
tpcds_q44/datafusion:parquet 🚀 32387156 36410878 0.89
tpcds_q45/datafusion:parquet 28906172 28145313 1.03
tpcds_q46/datafusion:parquet 32624092 32458702 1.01
tpcds_q47/datafusion:parquet 128921211 125113141 1.03
tpcds_q48/datafusion:parquet 69099383 68985600 1.00
tpcds_q49/datafusion:parquet 55676126 57329847 0.97
tpcds_q50/datafusion:parquet 44442751 44735116 0.99
tpcds_q51/datafusion:parquet 85106989 87326168 0.97
tpcds_q52/datafusion:parquet 11775505 12740819 0.92
tpcds_q53/datafusion:parquet 17933598 18164952 0.99
tpcds_q54/datafusion:parquet 34772368 34429945 1.01
tpcds_q55/datafusion:parquet 11469362 11453682 1.00
tpcds_q56/datafusion:parquet 28147862 27428841 1.03
tpcds_q57/datafusion:parquet 97377483 95804273 1.02
tpcds_q58/datafusion:parquet 51889889 50002652 1.04
tpcds_q59/datafusion:parquet 57819309 58997288 0.98
tpcds_q60/datafusion:parquet 27500052 28657485 0.96
tpcds_q61/datafusion:parquet 43339180 44016928 0.98
tpcds_q62/datafusion:parquet 25112182 25211980 1.00
tpcds_q63/datafusion:parquet 18154199 18019882 1.01
tpcds_q64/datafusion:parquet 513182075 513009550 1.00
tpcds_q65/datafusion:parquet 37251625 38983219 0.96
tpcds_q66/datafusion:parquet 69319250 71636871 0.97
tpcds_q67/datafusion:parquet 143846139 144703240 0.99
tpcds_q68/datafusion:parquet 31256076 33059059 0.95
tpcds_q69/datafusion:parquet 68217151 67042752 1.02
tpcds_q70/datafusion:parquet 83293244 86415268 0.96
tpcds_q71/datafusion:parquet 23097803 22245732 1.04
tpcds_q72/datafusion:parquet 625654016 616438006 1.01
tpcds_q73/datafusion:parquet 22234875 20895204 1.06
tpcds_q74/datafusion:parquet 86870104 91951340 0.94
tpcds_q75/datafusion:parquet 99114334 99940173 0.99
tpcds_q76/datafusion:parquet 30744127 30986337 0.99
tpcds_q77/datafusion:parquet 38602389 41124569 0.94
tpcds_q78/datafusion:parquet 115695106 116221486 1.00
tpcds_q79/datafusion:parquet 26721218 26901162 0.99
tpcds_q80/datafusion:parquet 81491101 79657478 1.02
tpcds_q81/datafusion:parquet 31789523 32578217 0.98
tpcds_q82/datafusion:parquet 19714253 19950980 0.99
tpcds_q83/datafusion:parquet 36501477 37456389 0.97
tpcds_q84/datafusion:parquet 39194963 40371819 0.97
tpcds_q85/datafusion:parquet 150577012 150780501 1.00
tpcds_q86/datafusion:parquet 17215229 17564118 0.98
tpcds_q87/datafusion:parquet 42487886 41942843 1.01
tpcds_q88/datafusion:parquet 60234362 60054141 1.00
tpcds_q89/datafusion:parquet 21881517 21716783 1.01
tpcds_q90/datafusion:parquet 14553109 14869036 0.98
tpcds_q91/datafusion:parquet 60049343 60614302 0.99
tpcds_q92/datafusion:parquet 19250847 18773625 1.03
tpcds_q93/datafusion:parquet 33077652 33730352 0.98
tpcds_q94/datafusion:parquet 20641913 21146534 0.98
tpcds_q95/datafusion:parquet 58957431 59429859 0.99
tpcds_q96/datafusion:parquet 12810907 12449530 1.03
tpcds_q97/datafusion:parquet 31099719 33337953 0.93
tpcds_q98/datafusion:parquet 21502731 22161224 0.97
tpcds_q99/datafusion:parquet 🚀 26376961 31409003 0.84
duckdb / vortex-file-compressed (0.996x ➖, 1↑ 4↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 23988791 24501782 0.98
tpcds_q02/duckdb:vortex-file-compressed 33598782 36400320 0.92
tpcds_q03/duckdb:vortex-file-compressed 22276152 22254269 1.00
tpcds_q04/duckdb:vortex-file-compressed 92113432 95296180 0.97
tpcds_q05/duckdb:vortex-file-compressed 33247420 35252781 0.94
tpcds_q06/duckdb:vortex-file-compressed 32993604 33445089 0.99
tpcds_q07/duckdb:vortex-file-compressed 21531463 21970187 0.98
tpcds_q08/duckdb:vortex-file-compressed 27008953 27564853 0.98
tpcds_q09/duckdb:vortex-file-compressed 15426131 15707064 0.98
tpcds_q10/duckdb:vortex-file-compressed 37242148 37409807 1.00
tpcds_q11/duckdb:vortex-file-compressed 67045440 63950417 1.05
tpcds_q12/duckdb:vortex-file-compressed 16008245 16346072 0.98
tpcds_q13/duckdb:vortex-file-compressed 33620957 32337860 1.04
tpcds_q14/duckdb:vortex-file-compressed 96448697 99026042 0.97
tpcds_q15/duckdb:vortex-file-compressed 26597119 26901748 0.99
tpcds_q16/duckdb:vortex-file-compressed 26203192 27389369 0.96
tpcds_q17/duckdb:vortex-file-compressed 44559957 44074341 1.01
tpcds_q18/duckdb:vortex-file-compressed 37134991 36588514 1.01
tpcds_q19/duckdb:vortex-file-compressed 31895437 31344598 1.02
tpcds_q20/duckdb:vortex-file-compressed 18006014 16980790 1.06
tpcds_q21/duckdb:vortex-file-compressed 16292113 16630107 0.98
tpcds_q22/duckdb:vortex-file-compressed 78707200 79939817 0.98
tpcds_q23/duckdb:vortex-file-compressed 96827569 97706454 0.99
tpcds_q24/duckdb:vortex-file-compressed 47502925 47975814 0.99
tpcds_q25/duckdb:vortex-file-compressed 40845833 41908542 0.97
tpcds_q26/duckdb:vortex-file-compressed 🚨 22791692 19203985 1.19
tpcds_q27/duckdb:vortex-file-compressed 24662535 23126696 1.07
tpcds_q28/duckdb:vortex-file-compressed 12631790 12333275 1.02
tpcds_q29/duckdb:vortex-file-compressed 40152791 40037132 1.00
tpcds_q30/duckdb:vortex-file-compressed 24821361 25366557 0.98
tpcds_q31/duckdb:vortex-file-compressed 29183425 29125610 1.00
tpcds_q32/duckdb:vortex-file-compressed 13341215 13494128 0.99
tpcds_q33/duckdb:vortex-file-compressed 23170662 24246754 0.96
tpcds_q34/duckdb:vortex-file-compressed 24437912 25708927 0.95
tpcds_q35/duckdb:vortex-file-compressed 64180805 64850040 0.99
tpcds_q36/duckdb:vortex-file-compressed 24792910 24324484 1.02
tpcds_q37/duckdb:vortex-file-compressed 19562449 19514437 1.00
tpcds_q38/duckdb:vortex-file-compressed 36929925 36998888 1.00
tpcds_q39/duckdb:vortex-file-compressed 35858792 37012231 0.97
tpcds_q40/duckdb:vortex-file-compressed 20534545 20875717 0.98
tpcds_q41/duckdb:vortex-file-compressed 10333215 10584418 0.98
tpcds_q42/duckdb:vortex-file-compressed 13384036 14115567 0.95
tpcds_q43/duckdb:vortex-file-compressed 🚨 22506130 17818926 1.26
tpcds_q44/duckdb:vortex-file-compressed 20829533 21097029 0.99
tpcds_q45/duckdb:vortex-file-compressed 30475952 29916884 1.02
tpcds_q46/duckdb:vortex-file-compressed 30559112 29830697 1.02
tpcds_q47/duckdb:vortex-file-compressed 52127241 52938415 0.98
tpcds_q48/duckdb:vortex-file-compressed 28600538 31105378 0.92
tpcds_q49/duckdb:vortex-file-compressed 35380405 33678280 1.05
tpcds_q50/duckdb:vortex-file-compressed 25700336 25459927 1.01
tpcds_q51/duckdb:vortex-file-compressed 104334696 104821803 1.00
tpcds_q52/duckdb:vortex-file-compressed 13594269 13662213 1.00
tpcds_q53/duckdb:vortex-file-compressed 22739282 22570889 1.01
tpcds_q54/duckdb:vortex-file-compressed 28578099 28242800 1.01
tpcds_q55/duckdb:vortex-file-compressed 12553450 12564348 1.00
tpcds_q56/duckdb:vortex-file-compressed 24903738 26002058 0.96
tpcds_q57/duckdb:vortex-file-compressed 41491658 41961849 0.99
tpcds_q58/duckdb:vortex-file-compressed 30044229 30258262 0.99
tpcds_q59/duckdb:vortex-file-compressed 57254767 56445436 1.01
tpcds_q60/duckdb:vortex-file-compressed 25738248 27842531 0.92
tpcds_q61/duckdb:vortex-file-compressed 30918627 30966504 1.00
tpcds_q62/duckdb:vortex-file-compressed 15719777 16163580 0.97
tpcds_q63/duckdb:vortex-file-compressed 20297675 20543647 0.99
tpcds_q64/duckdb:vortex-file-compressed 94827648 98162740 0.97
tpcds_q65/duckdb:vortex-file-compressed 22110004 22873307 0.97
tpcds_q66/duckdb:vortex-file-compressed 30063667 30091172 1.00
tpcds_q67/duckdb:vortex-file-compressed 140659377 140918178 1.00
tpcds_q68/duckdb:vortex-file-compressed 29265316 30097548 0.97
tpcds_q69/duckdb:vortex-file-compressed 40614883 41437667 0.98
tpcds_q70/duckdb:vortex-file-compressed 38016801 37856386 1.00
tpcds_q71/duckdb:vortex-file-compressed 20287558 21526046 0.94
tpcds_q72/duckdb:vortex-file-compressed 170938327 169531451 1.01
tpcds_q73/duckdb:vortex-file-compressed 24418464 24062226 1.01
tpcds_q74/duckdb:vortex-file-compressed 42534350 41896468 1.02
tpcds_q75/duckdb:vortex-file-compressed 🚨 55738580 50075299 1.11
tpcds_q76/duckdb:vortex-file-compressed 22432339 20796683 1.08
tpcds_q77/duckdb:vortex-file-compressed 24367080 23746361 1.03
tpcds_q78/duckdb:vortex-file-compressed 80446644 81363697 0.99
tpcds_q79/duckdb:vortex-file-compressed 25273091 24535122 1.03
tpcds_q80/duckdb:vortex-file-compressed 45257529 48658686 0.93
tpcds_q81/duckdb:vortex-file-compressed 29090407 30085646 0.97
tpcds_q82/duckdb:vortex-file-compressed 46033678 45549064 1.01
tpcds_q83/duckdb:vortex-file-compressed 26759489 25424704 1.05
tpcds_q84/duckdb:vortex-file-compressed 17101357 17406753 0.98
tpcds_q85/duckdb:vortex-file-compressed 39592407 42221106 0.94
tpcds_q86/duckdb:vortex-file-compressed 16889577 17145881 0.99
tpcds_q87/duckdb:vortex-file-compressed 40713784 39136524 1.04
tpcds_q88/duckdb:vortex-file-compressed 51477056 50659793 1.02
tpcds_q89/duckdb:vortex-file-compressed 21446233 23387331 0.92
tpcds_q90/duckdb:vortex-file-compressed 10885050 10817304 1.01
tpcds_q91/duckdb:vortex-file-compressed 22739272 22518073 1.01
tpcds_q92/duckdb:vortex-file-compressed 19195599 19587402 0.98
tpcds_q93/duckdb:vortex-file-compressed 29034163 29354074 0.99
tpcds_q94/duckdb:vortex-file-compressed 21649681 21367428 1.01
tpcds_q95/duckdb:vortex-file-compressed 🚀 136154700 159842952 0.85
tpcds_q96/duckdb:vortex-file-compressed 12702952 13109789 0.97
tpcds_q97/duckdb:vortex-file-compressed 38203609 38442368 0.99
tpcds_q98/duckdb:vortex-file-compressed 🚨 21680851 19513694 1.11
tpcds_q99/duckdb:vortex-file-compressed 22979787 22903018 1.00
duckdb / vortex-compact (0.996x ➖, 2↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 24982230 25923277 0.96
tpcds_q02/duckdb:vortex-compact 🚀 38889606 43535008 0.89
tpcds_q03/duckdb:vortex-compact 49507200 49126415 1.01
tpcds_q04/duckdb:vortex-compact 102770793 105245164 0.98
tpcds_q05/duckdb:vortex-compact 43014746 43087388 1.00
tpcds_q06/duckdb:vortex-compact 38481487 38218807 1.01
tpcds_q07/duckdb:vortex-compact 34558766 35251504 0.98
tpcds_q08/duckdb:vortex-compact 39977399 41770742 0.96
tpcds_q09/duckdb:vortex-compact 20862823 19939576 1.05
tpcds_q10/duckdb:vortex-compact 51941790 51687835 1.00
tpcds_q11/duckdb:vortex-compact 73025248 76259142 0.96
tpcds_q12/duckdb:vortex-compact 22644436 22841673 0.99
tpcds_q13/duckdb:vortex-compact 52939586 52422105 1.01
tpcds_q14/duckdb:vortex-compact 117837492 119344707 0.99
tpcds_q15/duckdb:vortex-compact 29854624 30607045 0.98
tpcds_q16/duckdb:vortex-compact 27283039 27530555 0.99
tpcds_q17/duckdb:vortex-compact 54670988 56219916 0.97
tpcds_q18/duckdb:vortex-compact 52012570 49822558 1.04
tpcds_q19/duckdb:vortex-compact 43257915 43972198 0.98
tpcds_q20/duckdb:vortex-compact 21405937 21363904 1.00
tpcds_q21/duckdb:vortex-compact 18778760 18196424 1.03
tpcds_q22/duckdb:vortex-compact 80411061 75609984 1.06
tpcds_q23/duckdb:vortex-compact 107311168 100686542 1.07
tpcds_q24/duckdb:vortex-compact 58118162 58534856 0.99
tpcds_q25/duckdb:vortex-compact 53803941 57535757 0.94
tpcds_q26/duckdb:vortex-compact 32168854 31132557 1.03
tpcds_q27/duckdb:vortex-compact 36608650 37234871 0.98
tpcds_q28/duckdb:vortex-compact 33893943 35680514 0.95
tpcds_q29/duckdb:vortex-compact 53874830 55132801 0.98
tpcds_q30/duckdb:vortex-compact 30844904 28476079 1.08
tpcds_q31/duckdb:vortex-compact 36281470 35261205 1.03
tpcds_q32/duckdb:vortex-compact 21559049 22382444 0.96
tpcds_q33/duckdb:vortex-compact 32606816 34353064 0.95
tpcds_q34/duckdb:vortex-compact 31111853 30789637 1.01
tpcds_q35/duckdb:vortex-compact 74246989 76675704 0.97
tpcds_q36/duckdb:vortex-compact 36147889 36857450 0.98
tpcds_q37/duckdb:vortex-compact 23939707 24119820 0.99
tpcds_q38/duckdb:vortex-compact 42660544 41373243 1.03
tpcds_q39/duckdb:vortex-compact 37915664 38711240 0.98
tpcds_q40/duckdb:vortex-compact 24195623 24423325 0.99
tpcds_q41/duckdb:vortex-compact 11961475 11771223 1.02
tpcds_q42/duckdb:vortex-compact 20074942 19319294 1.04
tpcds_q43/duckdb:vortex-compact 31477445 30736135 1.02
tpcds_q44/duckdb:vortex-compact 28155686 29773771 0.95
tpcds_q45/duckdb:vortex-compact 37839597 35930823 1.05
tpcds_q46/duckdb:vortex-compact 44262487 45862213 0.97
tpcds_q47/duckdb:vortex-compact 64050516 62304533 1.03
tpcds_q48/duckdb:vortex-compact 46542084 46137739 1.01
tpcds_q49/duckdb:vortex-compact 49974753 46828590 1.07
tpcds_q50/duckdb:vortex-compact 38680720 39427804 0.98
tpcds_q51/duckdb:vortex-compact 113555915 113575231 1.00
tpcds_q52/duckdb:vortex-compact 18818511 19839392 0.95
tpcds_q53/duckdb:vortex-compact 32575886 33275646 0.98
tpcds_q54/duckdb:vortex-compact 38942310 36115013 1.08
tpcds_q55/duckdb:vortex-compact 18396759 19130902 0.96
tpcds_q56/duckdb:vortex-compact 33106884 33705440 0.98
tpcds_q57/duckdb:vortex-compact 45420878 45650506 0.99
tpcds_q58/duckdb:vortex-compact 37785676 38161383 0.99
tpcds_q59/duckdb:vortex-compact 67341287 67336324 1.00
tpcds_q60/duckdb:vortex-compact 34557620 35872491 0.96
tpcds_q61/duckdb:vortex-compact 52941230 54122098 0.98
tpcds_q62/duckdb:vortex-compact 🚀 19497398 22432893 0.87
tpcds_q63/duckdb:vortex-compact 31473494 31866594 0.99
tpcds_q64/duckdb:vortex-compact 128243551 125410029 1.02
tpcds_q65/duckdb:vortex-compact 30641287 31257508 0.98
tpcds_q66/duckdb:vortex-compact 34438077 36670940 0.94
tpcds_q67/duckdb:vortex-compact 150460495 153254307 0.98
tpcds_q68/duckdb:vortex-compact 47135097 47850255 0.99
tpcds_q69/duckdb:vortex-compact 55692229 55052275 1.01
tpcds_q70/duckdb:vortex-compact 58418410 59005773 0.99
tpcds_q71/duckdb:vortex-compact 30157520 30566393 0.99
tpcds_q72/duckdb:vortex-compact 183242666 185275259 0.99
tpcds_q73/duckdb:vortex-compact 28238289 29022924 0.97
tpcds_q74/duckdb:vortex-compact 49354291 50375196 0.98
tpcds_q75/duckdb:vortex-compact 65012182 60808669 1.07
tpcds_q76/duckdb:vortex-compact 29613972 29028332 1.02
tpcds_q77/duckdb:vortex-compact 38416001 36482684 1.05
tpcds_q78/duckdb:vortex-compact 87530480 86701299 1.01
tpcds_q79/duckdb:vortex-compact 41506502 39106022 1.06
tpcds_q80/duckdb:vortex-compact 69896281 74664416 0.94
tpcds_q81/duckdb:vortex-compact 33782596 33821569 1.00
tpcds_q82/duckdb:vortex-compact 50145895 49928578 1.00
tpcds_q83/duckdb:vortex-compact 34341438 36712815 0.94
tpcds_q84/duckdb:vortex-compact 22472057 21104715 1.06
tpcds_q85/duckdb:vortex-compact 54695998 52527572 1.04
tpcds_q86/duckdb:vortex-compact 23077563 21640519 1.07
tpcds_q87/duckdb:vortex-compact 45419717 45557172 1.00
tpcds_q88/duckdb:vortex-compact 75992902 76053508 1.00
tpcds_q89/duckdb:vortex-compact 32386090 32750443 0.99
tpcds_q90/duckdb:vortex-compact 11613874 10811852 1.07
tpcds_q91/duckdb:vortex-compact 42516479 40846109 1.04
tpcds_q92/duckdb:vortex-compact 46064730 42819664 1.08
tpcds_q93/duckdb:vortex-compact 32485294 32999454 0.98
tpcds_q94/duckdb:vortex-compact 28181080 28753642 0.98
tpcds_q95/duckdb:vortex-compact 146596104 151604959 0.97
tpcds_q96/duckdb:vortex-compact 15708477 16631223 0.94
tpcds_q97/duckdb:vortex-compact 42427772 42998363 0.99
tpcds_q98/duckdb:vortex-compact 26993267 27105953 1.00
tpcds_q99/duckdb:vortex-compact 25933246 26963427 0.96
duckdb / parquet (1.000x ➖, 2↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 🚀 28869551 32341060 0.89
tpcds_q02/duckdb:parquet 24325023 24271491 1.00
tpcds_q03/duckdb:parquet 13368063 12485832 1.07
tpcds_q04/duckdb:parquet 171845220 165724510 1.04
tpcds_q05/duckdb:parquet 32010012 32204127 0.99
tpcds_q06/duckdb:parquet 33861678 33615862 1.01
tpcds_q07/duckdb:parquet 24092421 24465182 0.98
tpcds_q08/duckdb:parquet 29756333 29142681 1.02
tpcds_q09/duckdb:parquet 45350721 44513685 1.02
tpcds_q10/duckdb:parquet 38121291 37933068 1.00
tpcds_q11/duckdb:parquet 93141652 88641785 1.05
tpcds_q12/duckdb:parquet 17398141 17447254 1.00
tpcds_q13/duckdb:parquet 35117703 35387856 0.99
tpcds_q14/duckdb:parquet 106890981 103874499 1.03
tpcds_q15/duckdb:parquet 31382794 30842724 1.02
tpcds_q16/duckdb:parquet 22906574 22805582 1.00
tpcds_q17/duckdb:parquet 38793252 38635484 1.00
tpcds_q18/duckdb:parquet 49032015 49014147 1.00
tpcds_q19/duckdb:parquet 32618549 32236104 1.01
tpcds_q20/duckdb:parquet 18982273 18822824 1.01
tpcds_q21/duckdb:parquet 11658930 12409612 0.94
tpcds_q22/duckdb:parquet 72366214 70258126 1.03
tpcds_q23/duckdb:parquet 79812213 81646251 0.98
tpcds_q24/duckdb:parquet 47169735 47009973 1.00
tpcds_q25/duckdb:parquet 36043725 35951040 1.00
tpcds_q26/duckdb:parquet 39271887 39579716 0.99
tpcds_q27/duckdb:parquet 52643039 53343946 0.99
tpcds_q28/duckdb:parquet 43014596 42643910 1.01
tpcds_q29/duckdb:parquet 38838432 36694445 1.06
tpcds_q30/duckdb:parquet 37572218 37746613 1.00
tpcds_q31/duckdb:parquet 27397314 28260878 0.97
tpcds_q32/duckdb:parquet 12772618 12805496 1.00
tpcds_q33/duckdb:parquet 23470726 24351278 0.96
tpcds_q34/duckdb:parquet 24139318 23108884 1.04
tpcds_q35/duckdb:parquet 61001423 61001359 1.00
tpcds_q36/duckdb:parquet 22937968 22172952 1.03
tpcds_q37/duckdb:parquet 14940702 14385938 1.04
tpcds_q38/duckdb:parquet 36729407 36690749 1.00
tpcds_q39/duckdb:parquet 🚀 32369550 36246962 0.89
tpcds_q40/duckdb:parquet 19401353 19712408 0.98
tpcds_q41/duckdb:parquet 8888706 8961952 0.99
tpcds_q42/duckdb:parquet 13091440 12545938 1.04
tpcds_q43/duckdb:parquet 18558641 18166915 1.02
tpcds_q44/duckdb:parquet 25909194 26779930 0.97
tpcds_q45/duckdb:parquet 28853099 28919653 1.00
tpcds_q46/duckdb:parquet 47968284 47438956 1.01
tpcds_q47/duckdb:parquet 50251711 51800155 0.97
tpcds_q48/duckdb:parquet 32329219 32455583 1.00
tpcds_q49/duckdb:parquet 28087869 29476956 0.95
tpcds_q50/duckdb:parquet 26525360 26209706 1.01
tpcds_q51/duckdb:parquet 103368879 104060694 0.99
tpcds_q52/duckdb:parquet 13306758 13352577 1.00
tpcds_q53/duckdb:parquet 19225928 18519835 1.04
tpcds_q54/duckdb:parquet 29486486 28231601 1.04
tpcds_q55/duckdb:parquet 12835655 13037080 0.98
tpcds_q56/duckdb:parquet 24110740 24466064 0.99
tpcds_q57/duckdb:parquet 38528717 38643885 1.00
tpcds_q58/duckdb:parquet 25915993 26790664 0.97
tpcds_q59/duckdb:parquet 36381067 36335298 1.00
tpcds_q60/duckdb:parquet 25019212 25527449 0.98
tpcds_q61/duckdb:parquet 34123788 35029172 0.97
tpcds_q62/duckdb:parquet 12762168 12887628 0.99
tpcds_q63/duckdb:parquet 17952779 17677035 1.02
tpcds_q64/duckdb:parquet 77226353 74700218 1.03
tpcds_q65/duckdb:parquet 23216306 24293984 0.96
tpcds_q66/duckdb:parquet 32661446 32833558 0.99
tpcds_q67/duckdb:parquet 137788166 138208916 1.00
tpcds_q68/duckdb:parquet 38177223 39464581 0.97
tpcds_q69/duckdb:parquet 39178957 38046570 1.03
tpcds_q70/duckdb:parquet 22878814 22645888 1.01
tpcds_q71/duckdb:parquet 24289476 22646715 1.07
tpcds_q72/duckdb:parquet 167790649 169635151 0.99
tpcds_q73/duckdb:parquet 20308050 20319028 1.00
tpcds_q74/duckdb:parquet 128187261 131649922 0.97
tpcds_q75/duckdb:parquet 57926128 58270503 0.99
tpcds_q76/duckdb:parquet 22124358 22412251 0.99
tpcds_q77/duckdb:parquet 25263151 24943106 1.01
tpcds_q78/duckdb:parquet 77159320 77383828 1.00
tpcds_q79/duckdb:parquet 29649369 30174222 0.98
tpcds_q80/duckdb:parquet 43331214 43792031 0.99
tpcds_q81/duckdb:parquet 34710432 35321586 0.98
tpcds_q82/duckdb:parquet 17686174 16353565 1.08
tpcds_q83/duckdb:parquet 18338376 18572332 0.99
tpcds_q84/duckdb:parquet 21776995 21617688 1.01
tpcds_q85/duckdb:parquet 41080354 41522901 0.99
tpcds_q86/duckdb:parquet 13879972 13828768 1.00
tpcds_q87/duckdb:parquet 39896584 39430496 1.01
tpcds_q88/duckdb:parquet 53294885 53692393 0.99
tpcds_q89/duckdb:parquet 22193570 22284149 1.00
tpcds_q90/duckdb:parquet 8568796 8414177 1.02
tpcds_q91/duckdb:parquet 26122753 26262646 0.99
tpcds_q92/duckdb:parquet 13287920 13163304 1.01
tpcds_q93/duckdb:parquet 31921005 32118408 0.99
tpcds_q94/duckdb:parquet 18189183 18088416 1.01
tpcds_q95/duckdb:parquet 121668804 127240134 0.96
tpcds_q96/duckdb:parquet 11198877 10625648 1.05
tpcds_q97/duckdb:parquet 38015332 37545640 1.01
tpcds_q98/duckdb:parquet 25052775 24513826 1.02
tpcds_q99/duckdb:parquet 20222480 20524524 0.99
duckdb / duckdb (0.993x ➖, 1↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 21458464 22035397 0.97
tpcds_q02/duckdb:duckdb 19303819 19001238 1.02
tpcds_q03/duckdb:duckdb 10720794 10576632 1.01
tpcds_q04/duckdb:duckdb 178600730 183503883 0.97
tpcds_q05/duckdb:duckdb 21358018 22736673 0.94
tpcds_q06/duckdb:duckdb 28756465 28447261 1.01
tpcds_q07/duckdb:duckdb 40254075 41055802 0.98
tpcds_q08/duckdb:duckdb 120006683 121195201 0.99
tpcds_q09/duckdb:duckdb 20663256 20823257 0.99
tpcds_q10/duckdb:duckdb 27228338 28008907 0.97
tpcds_q11/duckdb:duckdb 94434550 91842937 1.03
tpcds_q12/duckdb:duckdb 13936342 13968153 1.00
tpcds_q13/duckdb:duckdb 26185039 26806497 0.98
tpcds_q14/duckdb:duckdb 93548144 94945066 0.99
tpcds_q15/duckdb:duckdb 24843153 24975005 0.99
tpcds_q16/duckdb:duckdb 19673341 19435890 1.01
tpcds_q17/duckdb:duckdb 25146326 26013286 0.97
tpcds_q18/duckdb:duckdb 47364577 49025491 0.97
tpcds_q19/duckdb:duckdb 19163439 19386890 0.99
tpcds_q20/duckdb:duckdb 14497776 14655609 0.99
tpcds_q21/duckdb:duckdb 7516435 8281408 0.91
tpcds_q22/duckdb:duckdb 64092103 61120841 1.05
tpcds_q23/duckdb:duckdb 83248415 79336616 1.05
tpcds_q24/duckdb:duckdb 25459933 25857583 0.98
tpcds_q25/duckdb:duckdb 19345333 19572736 0.99
tpcds_q26/duckdb:duckdb 28245049 29080337 0.97
tpcds_q27/duckdb:duckdb 41228434 41165058 1.00
tpcds_q28/duckdb:duckdb 26531438 26290800 1.01
tpcds_q29/duckdb:duckdb 23743890 23536893 1.01
tpcds_q30/duckdb:duckdb 31306235 31296088 1.00
tpcds_q31/duckdb:duckdb 50798778 52848769 0.96
tpcds_q32/duckdb:duckdb 8359510 8906712 0.94
tpcds_q33/duckdb:duckdb 16110948 16124940 1.00
tpcds_q34/duckdb:duckdb 18790029 18788081 1.00
tpcds_q35/duckdb:duckdb 37683164 37753088 1.00
tpcds_q36/duckdb:duckdb 71947497 72903871 0.99
tpcds_q37/duckdb:duckdb 8780693 9381433 0.94
tpcds_q38/duckdb:duckdb 33230661 33639559 0.99
tpcds_q39/duckdb:duckdb 28243947 28378706 1.00
tpcds_q40/duckdb:duckdb 14799512 14891410 0.99
tpcds_q41/duckdb:duckdb 9593047 9689685 0.99
tpcds_q42/duckdb:duckdb 🚀 9325749 10613211 0.88
tpcds_q43/duckdb:duckdb 14985333 14939947 1.00
tpcds_q44/duckdb:duckdb 15851306 15199189 1.04
tpcds_q45/duckdb:duckdb 18886348 18906091 1.00
tpcds_q46/duckdb:duckdb 38721309 39781462 0.97
tpcds_q47/duckdb:duckdb 46613998 46739231 1.00
tpcds_q48/duckdb:duckdb 25107533 25518913 0.98
tpcds_q49/duckdb:duckdb 21642506 21218753 1.02
tpcds_q50/duckdb:duckdb 16329228 16262915 1.00
tpcds_q51/duckdb:duckdb 101330674 98621613 1.03
tpcds_q52/duckdb:duckdb 9046410 9794941 0.92
tpcds_q53/duckdb:duckdb 18017778 18230204 0.99
tpcds_q54/duckdb:duckdb 18923336 18878947 1.00
tpcds_q55/duckdb:duckdb 9357688 10385567 0.90
tpcds_q56/duckdb:duckdb 16861093 17023358 0.99
tpcds_q57/duckdb:duckdb 37161359 36795886 1.01
tpcds_q58/duckdb:duckdb 16900099 17394090 0.97
tpcds_q59/duckdb:duckdb 37472425 37033184 1.01
tpcds_q60/duckdb:duckdb 18679665 19026764 0.98
tpcds_q61/duckdb:duckdb 17511446 16603500 1.05
tpcds_q62/duckdb:duckdb 10045449 10092976 1.00
tpcds_q63/duckdb:duckdb 16084131 16304892 0.99
tpcds_q64/duckdb:duckdb 57569935 59174906 0.97
tpcds_q65/duckdb:duckdb 36395968 35873434 1.01
tpcds_q66/duckdb:duckdb 28503505 26332163 1.08
tpcds_q67/duckdb:duckdb 136986641 136272442 1.01
tpcds_q68/duckdb:duckdb 28434736 26441251 1.08
tpcds_q69/duckdb:duckdb 28697969 27943329 1.03
tpcds_q70/duckdb:duckdb 16804455 16874216 1.00
tpcds_q71/duckdb:duckdb 16417054 16956542 0.97
tpcds_q72/duckdb:duckdb 45941500 48691824 0.94
tpcds_q73/duckdb:duckdb 14345733 14100024 1.02
tpcds_q74/duckdb:duckdb 144191684 145312039 0.99
tpcds_q75/duckdb:duckdb 46513758 46337489 1.00
tpcds_q76/duckdb:duckdb 15107964 14950735 1.01
tpcds_q77/duckdb:duckdb 15269919 16813562 0.91
tpcds_q78/duckdb:duckdb 65493034 65527413 1.00
tpcds_q79/duckdb:duckdb 19999869 20075936 1.00
tpcds_q80/duckdb:duckdb 32462650 30657874 1.06
tpcds_q81/duckdb:duckdb 39849792 40936007 0.97
tpcds_q82/duckdb:duckdb 10417039 10394216 1.00
tpcds_q83/duckdb:duckdb 11174053 11359615 0.98
tpcds_q84/duckdb:duckdb 15004708 14930444 1.00
tpcds_q85/duckdb:duckdb 26247614 26993211 0.97
tpcds_q86/duckdb:duckdb 12407797 12397991 1.00
tpcds_q87/duckdb:duckdb 36432663 35777347 1.02
tpcds_q88/duckdb:duckdb 30214687 30587417 0.99
tpcds_q89/duckdb:duckdb 21872449 22083953 0.99
tpcds_q90/duckdb:duckdb 6455341 6244345 1.03
tpcds_q91/duckdb:duckdb 14593473 15398262 0.95
tpcds_q92/duckdb:duckdb 10171747 9987536 1.02
tpcds_q93/duckdb:duckdb 23912911 23901115 1.00
tpcds_q94/duckdb:duckdb 14708076 14954365 0.98
tpcds_q95/duckdb:duckdb 112005435 112787153 0.99
tpcds_q96/duckdb:duckdb 6302619 5752262 1.10
tpcds_q97/duckdb:duckdb 32611732 32409822 1.01
tpcds_q98/duckdb:duckdb 20424556 20346744 1.00
tpcds_q99/duckdb:duckdb 17055024 16942675 1.01

No file size changes detected.

Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.0% -6.5% +7.9% +17.2% ➖ noise
1 datafusion:vortex-file-compressed -0.9% -6.5% +6.0% +17.5% ➖ noise
1 duckdb:duckdb -2.6% -6.5% +4.1% +17.0% ➖ noise
1 duckdb:vortex-compact -3.6% -6.5% +3.0% +17.9% ➖ noise
1 duckdb:vortex-file-compressed -2.1% -6.5% +4.7% +29.8% ➖ noise
2 datafusion:vortex-compact +0.5% -2.4% +2.9% +12.2% ➖ noise
2 datafusion:vortex-file-compressed -1.1% -2.4% +1.3% +10.0% ➖ noise
2 duckdb:duckdb +1.6% -2.4% +4.0% +10.0% ➖ noise
2 duckdb:vortex-compact -10.7% -2.4% -8.5% +30.3% ➖ noise
2 duckdb:vortex-file-compressed -7.7% -2.4% -5.5% +27.5% ➖ noise
3 datafusion:vortex-compact -2.9% +0.3% -3.2% +15.9% ➖ noise
3 datafusion:vortex-file-compressed +0.4% +0.3% +0.1% +12.4% ➖ noise
3 duckdb:duckdb +1.4% +0.3% +1.0% +13.0% ➖ noise
3 duckdb:vortex-compact +0.8% +0.3% +0.4% +12.8% ➖ noise
3 duckdb:vortex-file-compressed +0.1% +0.3% -0.2% +13.3% ➖ noise
4 datafusion:vortex-compact +3.8% +2.1% +1.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.9% +2.1% -1.1% +10.0% ➖ noise
4 duckdb:duckdb -2.7% +2.1% -4.6% +10.0% ➖ noise
4 duckdb:vortex-compact -2.4% +2.1% -4.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -3.3% +2.1% -5.3% +13.1% ➖ noise
5 datafusion:vortex-compact +6.6% -2.2% +8.9% +26.4% ➖ noise
5 datafusion:vortex-file-compressed -0.8% -2.2% +1.4% +15.5% ➖ noise
5 duckdb:duckdb -6.1% -2.2% -4.0% +14.5% ➖ noise
5 duckdb:vortex-compact -0.2% -2.2% +2.1% +15.2% ➖ noise
5 duckdb:vortex-file-compressed -5.7% -2.2% -3.6% +11.8% ➖ noise
6 datafusion:vortex-compact +3.2% -0.2% +3.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.9% -0.2% -3.7% +11.5% ➖ noise
6 duckdb:duckdb +1.1% -0.2% +1.3% +10.0% ➖ noise
6 duckdb:vortex-compact +0.7% -0.2% +0.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.3% -0.2% -1.2% +10.0% ➖ noise
7 datafusion:vortex-compact +0.1% +1.1% -1.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +1.3% +1.1% +0.1% +10.0% ➖ noise
7 duckdb:duckdb -2.0% +1.1% -3.0% +10.0% ➖ noise
7 duckdb:vortex-compact -2.0% +1.1% -3.1% +18.9% ➖ noise
7 duckdb:vortex-file-compressed -2.0% +1.1% -3.1% +10.0% ➖ noise
8 datafusion:vortex-compact -0.9% +1.5% -2.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.0% +1.5% -2.4% +10.0% ➖ noise
8 duckdb:duckdb -1.0% +1.5% -2.4% +10.0% ➖ noise
8 duckdb:vortex-compact -4.3% +1.5% -5.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.0% +1.5% -3.5% +26.2% ➖ noise
9 datafusion:vortex-compact +0.7% +2.6% -1.8% +15.1% ➖ noise
9 datafusion:vortex-file-compressed +1.1% +2.6% -1.5% +10.0% ➖ noise
9 duckdb:duckdb -0.8% +2.6% -3.3% +10.0% ➖ noise
9 duckdb:vortex-compact +4.6% +2.6% +2.0% +14.1% ➖ noise
9 duckdb:vortex-file-compressed -1.8% +2.6% -4.3% +13.0% ➖ noise
10 datafusion:vortex-compact +0.4% -0.6% +1.0% +11.0% ➖ noise
10 datafusion:vortex-file-compressed +4.7% -0.6% +5.4% +10.0% ➖ noise
10 duckdb:duckdb -2.8% -0.6% -2.2% +11.0% ➖ noise
10 duckdb:vortex-compact +0.5% -0.6% +1.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.4% -0.6% +0.2% +14.7% ➖ noise
11 datafusion:vortex-compact +3.7% +1.8% +1.8% +14.3% ➖ noise
11 datafusion:vortex-file-compressed -6.8% +1.8% -8.4% +10.2% ➖ noise
11 duckdb:duckdb +2.8% +1.8% +1.0% +10.0% ➖ noise
11 duckdb:vortex-compact -4.2% +1.8% -5.9% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +4.8% +1.8% +3.0% +10.0% ➖ noise
12 datafusion:vortex-compact -5.5% +0.6% -6.1% +12.8% ➖ noise
12 datafusion:vortex-file-compressed -1.6% +0.6% -2.2% +12.9% ➖ noise
12 duckdb:duckdb -0.2% +0.6% -0.8% +11.9% ➖ noise
12 duckdb:vortex-compact -0.9% +0.6% -1.4% +26.3% ➖ noise
12 duckdb:vortex-file-compressed -2.1% +0.6% -2.6% +27.8% ➖ noise
13 datafusion:vortex-compact +24.4% -0.5% +25.0% +18.8% 🚨 regression
13 datafusion:vortex-file-compressed +0.6% -0.5% +1.1% +11.9% ➖ noise
13 duckdb:duckdb -2.3% -0.5% -1.8% +10.0% ➖ noise
13 duckdb:vortex-compact +1.0% -0.5% +1.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +4.0% -0.5% +4.5% +13.7% ➖ noise
14 datafusion:vortex-compact +1.4% +1.3% +0.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.1% +1.3% -2.4% +10.0% ➖ noise
14 duckdb:duckdb -1.5% +1.3% -2.8% +10.0% ➖ noise
14 duckdb:vortex-compact -1.3% +1.3% -2.6% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.6% +1.3% -3.9% +10.0% ➖ noise
15 datafusion:vortex-compact -1.0% -1.8% +0.8% +22.4% ➖ noise
15 datafusion:vortex-file-compressed +1.3% -1.8% +3.2% +10.0% ➖ noise
15 duckdb:duckdb -0.5% -1.8% +1.3% +10.0% ➖ noise
15 duckdb:vortex-compact -2.5% -1.8% -0.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.1% -1.8% +0.7% +10.8% ➖ noise
16 datafusion:vortex-compact +0.5% -2.8% +3.4% +20.0% ➖ noise
16 datafusion:vortex-file-compressed -0.7% -2.8% +2.1% +30.7% ➖ noise
16 duckdb:duckdb +1.2% -2.8% +4.1% +14.7% ➖ noise
16 duckdb:vortex-compact -0.9% -2.8% +1.9% +22.8% ➖ noise
16 duckdb:vortex-file-compressed -4.3% -2.8% -1.6% +24.3% ➖ noise
17 datafusion:vortex-compact -1.1% -3.3% +2.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.6% -3.3% +2.7% +10.4% ➖ noise
17 duckdb:duckdb -3.3% -3.3% -0.0% +10.0% ➖ noise
17 duckdb:vortex-compact -2.8% -3.3% +0.6% +13.7% ➖ noise
17 duckdb:vortex-file-compressed +1.1% -3.3% +4.5% +10.0% ➖ noise
18 datafusion:vortex-compact -4.2% -0.9% -3.3% +11.9% ➖ noise
18 datafusion:vortex-file-compressed -2.5% -0.9% -1.6% +10.0% ➖ noise
18 duckdb:duckdb -3.4% -0.9% -2.5% +10.0% ➖ noise
18 duckdb:vortex-compact +4.4% -0.9% +5.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.5% -0.9% +2.4% +10.0% ➖ noise
19 datafusion:vortex-compact -0.8% -0.2% -0.5% +17.0% ➖ noise
19 datafusion:vortex-file-compressed +6.6% -0.2% +6.9% +22.1% ➖ noise
19 duckdb:duckdb -1.2% -0.2% -0.9% +10.0% ➖ noise
19 duckdb:vortex-compact -1.6% -0.2% -1.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.8% -0.2% +2.0% +13.2% ➖ noise
20 datafusion:vortex-compact +1.2% -0.4% +1.6% +12.4% ➖ noise
20 datafusion:vortex-file-compressed +1.3% -0.4% +1.7% +22.0% ➖ noise
20 duckdb:duckdb -1.1% -0.4% -0.6% +10.0% ➖ noise
20 duckdb:vortex-compact +0.2% -0.4% +0.6% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +6.0% -0.4% +6.5% +15.2% ➖ noise
21 datafusion:vortex-compact +3.4% -2.3% +5.8% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +6.4% -2.3% +8.9% +10.2% ➖ noise
21 duckdb:duckdb -9.2% -2.3% -7.1% +12.0% ➖ noise
21 duckdb:vortex-compact +3.2% -2.3% +5.6% +28.2% ➖ noise
21 duckdb:vortex-file-compressed -2.0% -2.3% +0.2% +13.8% ➖ noise
22 datafusion:vortex-compact +23.3% +2.6% +20.2% +19.8% 🚨 regression
22 datafusion:vortex-file-compressed +26.1% +2.6% +23.0% +21.7% 🚨 regression
22 duckdb:duckdb +4.9% +2.6% +2.3% +12.7% ➖ noise
22 duckdb:vortex-compact +6.3% +2.6% +3.7% +13.3% ➖ noise
22 duckdb:vortex-file-compressed -1.5% +2.6% -4.0% +14.0% ➖ noise
23 datafusion:vortex-compact +4.1% -1.7% +5.8% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +3.0% -1.7% +4.7% +11.1% ➖ noise
23 duckdb:duckdb +4.9% -1.7% +6.7% +12.3% ➖ noise
23 duckdb:vortex-compact +6.6% -1.7% +8.4% +19.0% ➖ noise
23 duckdb:vortex-file-compressed -0.9% -1.7% +0.8% +10.0% ➖ noise
24 datafusion:vortex-compact -4.0% +1.3% -5.2% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +1.0% +1.3% -0.3% +12.7% ➖ noise
24 duckdb:duckdb -1.5% +1.3% -2.8% +10.0% ➖ noise
24 duckdb:vortex-compact -0.7% +1.3% -2.0% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -1.0% +1.3% -2.3% +14.7% ➖ noise
25 datafusion:vortex-compact +1.0% +0.2% +0.8% +15.0% ➖ noise
25 datafusion:vortex-file-compressed -0.1% +0.2% -0.3% +10.0% ➖ noise
25 duckdb:duckdb -1.2% +0.2% -1.4% +10.0% ➖ noise
25 duckdb:vortex-compact -6.5% +0.2% -6.7% +20.4% ➖ noise
25 duckdb:vortex-file-compressed -2.5% +0.2% -2.7% +14.5% ➖ noise
26 datafusion:vortex-compact -7.9% -0.2% -7.7% +15.5% ➖ noise
26 datafusion:vortex-file-compressed +2.2% -0.2% +2.4% +10.0% ➖ noise
26 duckdb:duckdb -2.9% -0.2% -2.7% +10.0% ➖ noise
26 duckdb:vortex-compact +3.3% -0.2% +3.5% +13.6% ➖ noise
26 duckdb:vortex-file-compressed +18.7% -0.2% +18.9% +21.6% ➖ noise
27 datafusion:vortex-compact +4.3% -1.2% +5.6% +11.6% ➖ noise
27 datafusion:vortex-file-compressed -1.4% -1.2% -0.2% +10.6% ➖ noise
27 duckdb:duckdb +0.2% -1.2% +1.4% +10.0% ➖ noise
27 duckdb:vortex-compact -1.7% -1.2% -0.5% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +6.6% -1.2% +7.9% +10.0% ➖ noise
28 datafusion:vortex-compact -4.5% +0.9% -5.3% +14.1% ➖ noise
28 datafusion:vortex-file-compressed +3.6% +0.9% +2.6% +14.2% ➖ noise
28 duckdb:duckdb +0.9% +0.9% -0.0% +10.0% ➖ noise
28 duckdb:vortex-compact -5.0% +0.9% -5.9% +21.4% ➖ noise
28 duckdb:vortex-file-compressed +2.4% +0.9% +1.5% +11.7% ➖ noise
29 datafusion:vortex-compact -1.8% +3.2% -4.8% +18.7% ➖ noise
29 datafusion:vortex-file-compressed +0.1% +3.2% -3.0% +11.6% ➖ noise
29 duckdb:duckdb +0.9% +3.2% -2.3% +10.0% ➖ noise
29 duckdb:vortex-compact -2.3% +3.2% -5.3% +14.9% ➖ noise
29 duckdb:vortex-file-compressed +0.3% +3.2% -2.8% +10.0% ➖ noise
30 datafusion:vortex-compact +3.2% -2.8% +6.2% +11.6% ➖ noise
30 datafusion:vortex-file-compressed -1.3% -2.8% +1.6% +10.0% ➖ noise
30 duckdb:duckdb +0.0% -2.8% +2.9% +16.7% ➖ noise
30 duckdb:vortex-compact +8.3% -2.8% +11.5% +10.0% 🚨 regression
30 duckdb:vortex-file-compressed -2.1% -2.8% +0.7% +24.8% ➖ noise
31 datafusion:vortex-compact +0.6% -1.1% +1.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.7% -1.1% +1.8% +16.1% ➖ noise
31 duckdb:duckdb -3.9% -1.1% -2.8% +10.0% ➖ noise
31 duckdb:vortex-compact +2.9% -1.1% +4.0% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.2% -1.1% +1.3% +21.3% ➖ noise
32 datafusion:vortex-compact -0.2% +1.4% -1.6% +10.1% ➖ noise
32 datafusion:vortex-file-compressed +0.3% +1.4% -1.1% +10.9% ➖ noise
32 duckdb:duckdb -6.1% +1.4% -7.5% +12.7% ➖ noise
32 duckdb:vortex-compact -3.7% +1.4% -5.0% +10.5% ➖ noise
32 duckdb:vortex-file-compressed -1.1% +1.4% -2.5% +10.0% ➖ noise
33 datafusion:vortex-compact -0.1% -3.7% +3.8% +25.1% ➖ noise
33 datafusion:vortex-file-compressed -3.4% -3.7% +0.3% +15.9% ➖ noise
33 duckdb:duckdb -0.1% -3.7% +3.8% +10.0% ➖ noise
33 duckdb:vortex-compact -5.1% -3.7% -1.4% +18.3% ➖ noise
33 duckdb:vortex-file-compressed -4.4% -3.7% -0.8% +10.0% ➖ noise
34 datafusion:vortex-compact +6.0% -1.6% +7.7% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +3.6% -1.6% +5.4% +10.0% ➖ noise
34 duckdb:duckdb +0.0% -1.6% +1.7% +10.0% ➖ noise
34 duckdb:vortex-compact +1.0% -1.6% +2.7% +12.8% ➖ noise
34 duckdb:vortex-file-compressed -4.9% -1.6% -3.4% +11.1% ➖ noise
35 datafusion:vortex-compact -4.0% +0.2% -4.2% +12.6% ➖ noise
35 datafusion:vortex-file-compressed +5.1% +0.2% +4.9% +10.0% ➖ noise
35 duckdb:duckdb -0.2% +0.2% -0.3% +10.8% ➖ noise
35 duckdb:vortex-compact -3.2% +0.2% -3.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.0% +0.2% -1.2% +13.5% ➖ noise
36 datafusion:vortex-compact +0.0% +1.9% -1.9% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +2.2% +1.9% +0.2% +14.0% ➖ noise
36 duckdb:duckdb -1.3% +1.9% -3.2% +10.0% ➖ noise
36 duckdb:vortex-compact -1.9% +1.9% -3.8% +17.5% ➖ noise
36 duckdb:vortex-file-compressed +1.9% +1.9% +0.0% +10.0% ➖ noise
37 datafusion:vortex-compact -1.0% +6.2% -6.8% +22.5% ➖ noise
37 datafusion:vortex-file-compressed +2.0% +6.2% -3.9% +11.4% ➖ noise
37 duckdb:duckdb -6.4% +6.2% -11.8% +10.0% ✅ faster
37 duckdb:vortex-compact -0.7% +6.2% -6.5% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +0.2% +6.2% -5.6% +27.9% ➖ noise
38 datafusion:vortex-compact -1.8% +1.2% -3.0% +17.0% ➖ noise
38 datafusion:vortex-file-compressed +3.7% +1.2% +2.5% +13.2% ➖ noise
38 duckdb:duckdb -1.2% +1.2% -2.4% +11.3% ➖ noise
38 duckdb:vortex-compact +3.1% +1.2% +1.9% +10.7% ➖ noise
38 duckdb:vortex-file-compressed -0.2% +1.2% -1.4% +10.0% ➖ noise
39 datafusion:vortex-compact -0.9% -5.4% +4.8% +14.7% ➖ noise
39 datafusion:vortex-file-compressed -0.3% -5.4% +5.4% +13.4% ➖ noise
39 duckdb:duckdb -0.5% -5.4% +5.2% +16.4% ➖ noise
39 duckdb:vortex-compact -2.1% -5.4% +3.5% +12.9% ➖ noise
39 duckdb:vortex-file-compressed -3.1% -5.4% +2.4% +17.2% ➖ noise
40 datafusion:vortex-compact +5.7% +0.8% +4.9% +12.4% ➖ noise
40 datafusion:vortex-file-compressed -0.1% +0.8% -0.9% +24.9% ➖ noise
40 duckdb:duckdb -0.6% +0.8% -1.4% +10.0% ➖ noise
40 duckdb:vortex-compact -0.9% +0.8% -1.7% +11.5% ➖ noise
40 duckdb:vortex-file-compressed -1.6% +0.8% -2.4% +10.0% ➖ noise
41 datafusion:vortex-compact -4.4% +0.4% -4.8% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -7.2% +0.4% -7.6% +10.2% ➖ noise
41 duckdb:duckdb -1.0% +0.4% -1.3% +10.0% ➖ noise
41 duckdb:vortex-compact +1.6% +0.4% +1.3% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -2.4% +0.4% -2.7% +10.0% ➖ noise
42 datafusion:vortex-compact -8.7% +1.3% -9.8% +26.7% ➖ noise
42 datafusion:vortex-file-compressed -2.1% +1.3% -3.3% +25.0% ➖ noise
42 duckdb:duckdb -12.1% +1.3% -13.2% +17.2% ➖ noise
42 duckdb:vortex-compact +3.9% +1.3% +2.6% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -5.2% +1.3% -6.4% +10.0% ➖ noise
43 datafusion:vortex-compact +1.3% -0.7% +1.9% +12.8% ➖ noise
43 datafusion:vortex-file-compressed -6.0% -0.7% -5.3% +12.8% ➖ noise
43 duckdb:duckdb +0.3% -0.7% +1.0% +10.0% ➖ noise
43 duckdb:vortex-compact +2.4% -0.7% +3.1% +17.9% ➖ noise
43 duckdb:vortex-file-compressed +26.3% -0.7% +27.2% +21.9% 🚨 regression
44 datafusion:vortex-compact -2.8% -7.2% +4.7% +12.2% ➖ noise
44 datafusion:vortex-file-compressed -4.1% -7.2% +3.4% +11.4% ➖ noise
44 duckdb:duckdb +4.3% -7.2% +12.4% +10.0% 🚨 regression
44 duckdb:vortex-compact -5.4% -7.2% +1.9% +16.3% ➖ noise
44 duckdb:vortex-file-compressed -1.3% -7.2% +6.4% +14.0% ➖ noise
45 datafusion:vortex-compact +1.0% +1.2% -0.2% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +1.2% +1.2% -0.1% +10.0% ➖ noise
45 duckdb:duckdb -0.1% +1.2% -1.3% +10.0% ➖ noise
45 duckdb:vortex-compact +5.3% +1.2% +4.0% +10.0% ➖ noise
45 duckdb:vortex-file-compressed +1.9% +1.2% +0.6% +17.5% ➖ noise
46 datafusion:vortex-compact +1.1% +0.8% +0.3% +12.7% ➖ noise
46 datafusion:vortex-file-compressed +4.9% +0.8% +4.0% +10.0% ➖ noise
46 duckdb:duckdb -2.7% +0.8% -3.4% +10.0% ➖ noise
46 duckdb:vortex-compact -3.5% +0.8% -4.3% +10.7% ➖ noise
46 duckdb:vortex-file-compressed +2.4% +0.8% +1.6% +18.2% ➖ noise
47 datafusion:vortex-compact -4.1% -0.0% -4.1% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -2.3% -0.0% -2.2% +10.0% ➖ noise
47 duckdb:duckdb -0.3% -0.0% -0.2% +10.0% ➖ noise
47 duckdb:vortex-compact +2.8% -0.0% +2.8% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -1.5% -0.0% -1.5% +10.0% ➖ noise
48 datafusion:vortex-compact +5.1% -0.1% +5.2% +24.1% ➖ noise
48 datafusion:vortex-file-compressed +8.3% -0.1% +8.4% +10.2% ➖ noise
48 duckdb:duckdb -1.6% -0.1% -1.5% +10.0% ➖ noise
48 duckdb:vortex-compact +0.9% -0.1% +1.0% +10.5% ➖ noise
48 duckdb:vortex-file-compressed -8.1% -0.1% -7.9% +26.7% ➖ noise
49 datafusion:vortex-compact +1.2% -3.8% +5.2% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -1.1% -3.8% +2.8% +10.0% ➖ noise
49 duckdb:duckdb +2.0% -3.8% +6.0% +18.0% ➖ noise
49 duckdb:vortex-compact +6.7% -3.8% +10.9% +12.0% ➖ noise
49 duckdb:vortex-file-compressed +5.1% -3.8% +9.2% +17.6% ➖ noise
50 datafusion:vortex-compact -0.1% +0.3% -0.4% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +1.0% +0.3% +0.7% +23.0% ➖ noise
50 duckdb:duckdb +0.4% +0.3% +0.1% +10.0% ➖ noise
50 duckdb:vortex-compact -1.9% +0.3% -2.2% +20.5% ➖ noise
50 duckdb:vortex-file-compressed +0.9% +0.3% +0.7% +12.4% ➖ noise
51 datafusion:vortex-compact +3.6% -1.6% +5.3% +10.4% ➖ noise
51 datafusion:vortex-file-compressed +2.5% -1.6% +4.2% +10.0% ➖ noise
51 duckdb:duckdb +2.7% -1.6% +4.4% +15.3% ➖ noise
51 duckdb:vortex-compact -0.0% -1.6% +1.6% +19.2% ➖ noise
51 duckdb:vortex-file-compressed -0.5% -1.6% +1.2% +16.6% ➖ noise
52 datafusion:vortex-compact -0.5% -4.0% +3.7% +19.8% ➖ noise
52 datafusion:vortex-file-compressed +1.8% -4.0% +6.1% +10.0% ➖ noise
52 duckdb:duckdb -7.6% -4.0% -3.8% +17.5% ➖ noise
52 duckdb:vortex-compact -5.1% -4.0% -1.2% +14.6% ➖ noise
52 duckdb:vortex-file-compressed -0.5% -4.0% +3.7% +16.0% ➖ noise
53 datafusion:vortex-compact +0.5% +1.2% -0.7% +10.0% ➖ noise
53 datafusion:vortex-file-compressed +0.9% +1.2% -0.3% +10.0% ➖ noise
53 duckdb:duckdb -1.2% +1.2% -2.4% +10.0% ➖ noise
53 duckdb:vortex-compact -2.1% +1.2% -3.3% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +0.7% +1.2% -0.5% +10.0% ➖ noise
54 datafusion:vortex-compact -5.2% +2.7% -7.7% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -8.3% +2.7% -10.7% +10.5% ✅ faster
54 duckdb:duckdb +0.2% +2.7% -2.4% +10.0% ➖ noise
54 duckdb:vortex-compact +7.8% +2.7% +5.0% +12.0% ➖ noise
54 duckdb:vortex-file-compressed +1.2% +2.7% -1.5% +10.0% ➖ noise
55 datafusion:vortex-compact +1.1% -0.7% +1.8% +13.0% ➖ noise
55 datafusion:vortex-file-compressed -1.9% -0.7% -1.2% +10.0% ➖ noise
55 duckdb:duckdb -9.9% -0.7% -9.3% +16.7% ➖ noise
55 duckdb:vortex-compact -3.8% -0.7% -3.2% +12.1% ➖ noise
55 duckdb:vortex-file-compressed -0.1% -0.7% +0.6% +10.7% ➖ noise
56 datafusion:vortex-compact -2.4% +0.6% -2.9% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +1.5% +0.6% +0.9% +10.6% ➖ noise
56 duckdb:duckdb -1.0% +0.6% -1.5% +10.0% ➖ noise
56 duckdb:vortex-compact -1.8% +0.6% -2.3% +24.3% ➖ noise
56 duckdb:vortex-file-compressed -4.2% +0.6% -4.8% +15.1% ➖ noise
57 datafusion:vortex-compact +5.2% +0.7% +4.5% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -7.3% +0.7% -7.9% +10.0% ➖ noise
57 duckdb:duckdb +1.0% +0.7% +0.3% +15.7% ➖ noise
57 duckdb:vortex-compact -0.5% +0.7% -1.2% +13.7% ➖ noise
57 duckdb:vortex-file-compressed -1.1% +0.7% -1.8% +14.3% ➖ noise
58 datafusion:vortex-compact +1.0% +0.2% +0.8% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -5.4% +0.2% -5.6% +10.0% ➖ noise
58 duckdb:duckdb -2.8% +0.2% -3.0% +10.0% ➖ noise
58 duckdb:vortex-compact -1.0% +0.2% -1.2% +10.0% ➖ noise
58 duckdb:vortex-file-compressed -0.7% +0.2% -0.9% +10.0% ➖ noise
59 datafusion:vortex-compact -6.3% -0.9% -5.4% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +3.1% -0.9% +4.1% +10.0% ➖ noise
59 duckdb:duckdb +1.2% -0.9% +2.1% +10.0% ➖ noise
59 duckdb:vortex-compact +0.0% -0.9% +1.0% +23.0% ➖ noise
59 duckdb:vortex-file-compressed +1.4% -0.9% +2.4% +18.8% ➖ noise
60 datafusion:vortex-compact -3.4% -3.0% -0.4% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +1.5% -3.0% +4.7% +14.1% ➖ noise
60 duckdb:duckdb -1.8% -3.0% +1.2% +11.3% ➖ noise
60 duckdb:vortex-compact -3.7% -3.0% -0.7% +13.9% ➖ noise
60 duckdb:vortex-file-compressed -7.6% -3.0% -4.7% +37.0% ➖ noise
61 datafusion:vortex-compact +0.9% -2.1% +3.0% +12.9% ➖ noise
61 datafusion:vortex-file-compressed -0.5% -2.1% +1.6% +13.2% ➖ noise
61 duckdb:duckdb +5.5% -2.1% +7.7% +10.0% ➖ noise
61 duckdb:vortex-compact -2.2% -2.1% -0.1% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -0.2% -2.1% +1.9% +10.0% ➖ noise
62 datafusion:vortex-compact +15.8% -0.7% +16.6% +27.1% ➖ noise
62 datafusion:vortex-file-compressed -12.0% -0.7% -11.4% +21.3% ➖ noise
62 duckdb:duckdb -0.5% -0.7% +0.2% +17.7% ➖ noise
62 duckdb:vortex-compact -13.1% -0.7% -12.5% +24.4% ➖ noise
62 duckdb:vortex-file-compressed -2.7% -0.7% -2.1% +21.8% ➖ noise
63 datafusion:vortex-compact +0.9% +1.2% -0.3% +27.2% ➖ noise
63 datafusion:vortex-file-compressed -3.7% +1.2% -4.8% +10.0% ➖ noise
63 duckdb:duckdb -1.4% +1.2% -2.5% +10.0% ➖ noise
63 duckdb:vortex-compact -1.2% +1.2% -2.4% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -1.2% +1.2% -2.3% +10.0% ➖ noise
64 datafusion:vortex-compact +0.2% +1.7% -1.5% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -2.0% +1.7% -3.6% +10.0% ➖ noise
64 duckdb:duckdb -2.7% +1.7% -4.3% +10.0% ➖ noise
64 duckdb:vortex-compact +2.3% +1.7% +0.6% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -3.4% +1.7% -5.0% +10.2% ➖ noise
65 datafusion:vortex-compact +0.0% -4.4% +4.7% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +0.1% -4.4% +4.8% +16.2% ➖ noise
65 duckdb:duckdb +1.5% -4.4% +6.2% +10.0% ➖ noise
65 duckdb:vortex-compact -2.0% -4.4% +2.6% +10.1% ➖ noise
65 duckdb:vortex-file-compressed -3.3% -4.4% +1.2% +11.7% ➖ noise
66 datafusion:vortex-compact +3.4% -1.9% +5.4% +21.6% ➖ noise
66 datafusion:vortex-file-compressed +0.4% -1.9% +2.4% +16.2% ➖ noise
66 duckdb:duckdb +8.2% -1.9% +10.3% +11.4% ➖ noise
66 duckdb:vortex-compact -6.1% -1.9% -4.3% +23.2% ➖ noise
66 duckdb:vortex-file-compressed -0.1% -1.9% +1.8% +14.7% ➖ noise
67 datafusion:vortex-compact +1.5% -0.4% +2.0% +13.8% ➖ noise
67 datafusion:vortex-file-compressed +1.9% -0.4% +2.4% +10.0% ➖ noise
67 duckdb:duckdb +0.5% -0.4% +1.0% +10.0% ➖ noise
67 duckdb:vortex-compact -1.8% -0.4% -1.4% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -0.2% -0.4% +0.3% +10.0% ➖ noise
68 datafusion:vortex-compact +2.5% -4.4% +7.2% +29.2% ➖ noise
68 datafusion:vortex-file-compressed -0.8% -4.4% +3.7% +27.7% ➖ noise
68 duckdb:duckdb +7.5% -4.4% +12.4% +15.4% ➖ noise
68 duckdb:vortex-compact -1.5% -4.4% +3.0% +14.0% ➖ noise
68 duckdb:vortex-file-compressed -2.8% -4.4% +1.7% +11.8% ➖ noise
69 datafusion:vortex-compact -0.1% +2.4% -2.4% +13.2% ➖ noise
69 datafusion:vortex-file-compressed +0.5% +2.4% -1.8% +23.8% ➖ noise
69 duckdb:duckdb +2.7% +2.4% +0.3% +10.0% ➖ noise
69 duckdb:vortex-compact +1.2% +2.4% -1.2% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -2.0% +2.4% -4.2% +11.4% ➖ noise
70 datafusion:vortex-compact -5.2% -1.3% -4.0% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -4.5% -1.3% -3.3% +10.0% ➖ noise
70 duckdb:duckdb -0.4% -1.3% +0.9% +10.0% ➖ noise
70 duckdb:vortex-compact -1.0% -1.3% +0.3% +11.7% ➖ noise
70 duckdb:vortex-file-compressed +0.4% -1.3% +1.8% +10.0% ➖ noise
71 datafusion:vortex-compact -0.6% +5.5% -5.8% +14.9% ➖ noise
71 datafusion:vortex-file-compressed +3.5% +5.5% -2.0% +10.0% ➖ noise
71 duckdb:duckdb -3.2% +5.5% -8.3% +10.0% ➖ noise
71 duckdb:vortex-compact -1.3% +5.5% -6.5% +10.0% ➖ noise
71 duckdb:vortex-file-compressed -5.8% +5.5% -10.7% +10.0% ✅ faster
72 datafusion:vortex-compact +0.4% +0.2% +0.2% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -1.1% +0.2% -1.3% +10.0% ➖ noise
72 duckdb:duckdb -5.6% +0.2% -5.8% +10.0% ➖ noise
72 duckdb:vortex-compact -1.1% +0.2% -1.3% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.8% +0.2% +0.6% +10.0% ➖ noise
73 datafusion:vortex-compact -9.7% +3.1% -12.5% +23.2% ➖ noise
73 datafusion:vortex-file-compressed -1.1% +3.1% -4.1% +14.7% ➖ noise
73 duckdb:duckdb +1.7% +3.1% -1.3% +15.7% ➖ noise
73 duckdb:vortex-compact -2.7% +3.1% -5.7% +14.6% ➖ noise
73 duckdb:vortex-file-compressed +1.5% +3.1% -1.6% +15.3% ➖ noise
74 datafusion:vortex-compact -0.6% -4.1% +3.6% +10.8% ➖ noise
74 datafusion:vortex-file-compressed -2.8% -4.1% +1.4% +21.7% ➖ noise
74 duckdb:duckdb -0.8% -4.1% +3.5% +10.0% ➖ noise
74 duckdb:vortex-compact -2.0% -4.1% +2.2% +15.1% ➖ noise
74 duckdb:vortex-file-compressed +1.5% -4.1% +5.9% +10.1% ➖ noise
75 datafusion:vortex-compact +5.9% -0.7% +6.6% +13.6% ➖ noise
75 datafusion:vortex-file-compressed +0.6% -0.7% +1.4% +10.0% ➖ noise
75 duckdb:duckdb +0.4% -0.7% +1.1% +10.0% ➖ noise
75 duckdb:vortex-compact +6.9% -0.7% +7.7% +12.6% ➖ noise
75 duckdb:vortex-file-compressed +11.3% -0.7% +12.1% +16.8% ➖ noise
76 datafusion:vortex-compact -0.3% -1.0% +0.7% +13.2% ➖ noise
76 datafusion:vortex-file-compressed +0.6% -1.0% +1.6% +45.1% ➖ noise
76 duckdb:duckdb +1.1% -1.0% +2.1% +14.0% ➖ noise
76 duckdb:vortex-compact +2.0% -1.0% +3.1% +18.7% ➖ noise
76 duckdb:vortex-file-compressed +7.9% -1.0% +9.0% +15.7% ➖ noise
77 datafusion:vortex-compact +0.3% -2.5% +2.9% +15.5% ➖ noise
77 datafusion:vortex-file-compressed -2.0% -2.5% +0.6% +10.4% ➖ noise
77 duckdb:duckdb -9.2% -2.5% -6.9% +10.0% ➖ noise
77 duckdb:vortex-compact +5.3% -2.5% +8.0% +22.0% ➖ noise
77 duckdb:vortex-file-compressed +2.6% -2.5% +5.2% +12.2% ➖ noise
78 datafusion:vortex-compact +1.5% -0.4% +1.9% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +1.9% -0.4% +2.2% +10.0% ➖ noise
78 duckdb:duckdb -0.1% -0.4% +0.3% +10.0% ➖ noise
78 duckdb:vortex-compact +1.0% -0.4% +1.3% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -1.1% -0.4% -0.8% +17.5% ➖ noise
79 datafusion:vortex-compact -0.9% -1.2% +0.3% +21.2% ➖ noise
79 datafusion:vortex-file-compressed -0.7% -1.2% +0.5% +43.8% ➖ noise
79 duckdb:duckdb -0.4% -1.2% +0.8% +10.0% ➖ noise
79 duckdb:vortex-compact +6.1% -1.2% +7.4% +10.0% ➖ noise
79 duckdb:vortex-file-compressed +3.0% -1.2% +4.3% +10.0% ➖ noise
80 datafusion:vortex-compact +1.3% +0.6% +0.7% +17.5% ➖ noise
80 datafusion:vortex-file-compressed +2.8% +0.6% +2.2% +10.0% ➖ noise
80 duckdb:duckdb +5.9% +0.6% +5.2% +11.7% ➖ noise
80 duckdb:vortex-compact -6.4% +0.6% -7.0% +17.3% ➖ noise
80 duckdb:vortex-file-compressed -7.0% +0.6% -7.6% +10.0% ➖ noise
81 datafusion:vortex-compact -3.4% -2.1% -1.3% +10.0% ➖ noise
81 datafusion:vortex-file-compressed -1.0% -2.1% +1.1% +10.0% ➖ noise
81 duckdb:duckdb -2.7% -2.1% -0.6% +10.0% ➖ noise
81 duckdb:vortex-compact -0.1% -2.1% +2.0% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -3.3% -2.1% -1.3% +14.8% ➖ noise
82 datafusion:vortex-compact -3.8% +3.4% -6.9% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +3.4% +3.4% -0.0% +10.0% ➖ noise
82 duckdb:duckdb +0.2% +3.4% -3.1% +10.8% ➖ noise
82 duckdb:vortex-compact +0.4% +3.4% -2.8% +10.0% ➖ noise
82 duckdb:vortex-file-compressed +1.1% +3.4% -2.2% +10.0% ➖ noise
83 datafusion:vortex-compact +1.2% -1.9% +3.1% +17.1% ➖ noise
83 datafusion:vortex-file-compressed +1.5% -1.9% +3.5% +18.2% ➖ noise
83 duckdb:duckdb -1.6% -1.9% +0.3% +10.0% ➖ noise
83 duckdb:vortex-compact -6.5% -1.9% -4.6% +14.7% ➖ noise
83 duckdb:vortex-file-compressed +5.2% -1.9% +7.3% +10.0% ➖ noise
84 datafusion:vortex-compact +4.7% -1.1% +5.9% +20.9% ➖ noise
84 datafusion:vortex-file-compressed +0.2% -1.1% +1.3% +10.0% ➖ noise
84 duckdb:duckdb +0.5% -1.1% +1.6% +10.0% ➖ noise
84 duckdb:vortex-compact +6.5% -1.1% +7.7% +14.5% ➖ noise
84 duckdb:vortex-file-compressed -1.8% -1.1% -0.7% +13.5% ➖ noise
85 datafusion:vortex-compact -0.6% -0.6% +0.0% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -2.0% -0.6% -1.4% +10.0% ➖ noise
85 duckdb:duckdb -2.8% -0.6% -2.2% +10.0% ➖ noise
85 duckdb:vortex-compact +4.1% -0.6% +4.8% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -6.2% -0.6% -5.7% +10.0% ➖ noise
86 datafusion:vortex-compact +1.6% -0.8% +2.5% +27.1% ➖ noise
86 datafusion:vortex-file-compressed +1.9% -0.8% +2.8% +12.6% ➖ noise
86 duckdb:duckdb +0.1% -0.8% +0.9% +10.0% ➖ noise
86 duckdb:vortex-compact +6.6% -0.8% +7.5% +12.2% ➖ noise
86 duckdb:vortex-file-compressed -1.5% -0.8% -0.7% +21.9% ➖ noise
87 datafusion:vortex-compact +1.4% +1.2% +0.2% +17.1% ➖ noise
87 datafusion:vortex-file-compressed +0.7% +1.2% -0.5% +10.0% ➖ noise
87 duckdb:duckdb +1.8% +1.2% +0.6% +11.6% ➖ noise
87 duckdb:vortex-compact -0.3% +1.2% -1.5% +15.2% ➖ noise
87 duckdb:vortex-file-compressed +4.0% +1.2% +2.8% +10.0% ➖ noise
88 datafusion:vortex-compact +0.8% -0.2% +1.1% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +3.8% -0.2% +4.0% +14.0% ➖ noise
88 duckdb:duckdb -1.2% -0.2% -1.0% +10.0% ➖ noise
88 duckdb:vortex-compact -0.1% -0.2% +0.1% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +1.6% -0.2% +1.8% +10.0% ➖ noise
89 datafusion:vortex-compact -0.3% +0.2% -0.4% +11.2% ➖ noise
89 datafusion:vortex-file-compressed +0.8% +0.2% +0.6% +16.2% ➖ noise
89 duckdb:duckdb -1.0% +0.2% -1.1% +13.0% ➖ noise
89 duckdb:vortex-compact -1.1% +0.2% -1.3% +19.8% ➖ noise
89 duckdb:vortex-file-compressed -8.3% +0.2% -8.5% +13.7% ➖ noise
90 datafusion:vortex-compact +0.5% -0.2% +0.6% +12.1% ➖ noise
90 datafusion:vortex-file-compressed +11.1% -0.2% +11.3% +19.0% ➖ noise
90 duckdb:duckdb +3.4% -0.2% +3.5% +14.0% ➖ noise
90 duckdb:vortex-compact +7.4% -0.2% +7.6% +14.5% ➖ noise
90 duckdb:vortex-file-compressed +0.6% -0.2% +0.8% +13.0% ➖ noise
91 datafusion:vortex-compact -2.2% -0.7% -1.4% +17.9% ➖ noise
91 datafusion:vortex-file-compressed +0.0% -0.7% +0.8% +10.8% ➖ noise
91 duckdb:duckdb -5.2% -0.7% -4.5% +10.0% ➖ noise
91 duckdb:vortex-compact +4.1% -0.7% +4.9% +10.6% ➖ noise
91 duckdb:vortex-file-compressed +1.0% -0.7% +1.7% +10.0% ➖ noise
92 datafusion:vortex-compact +6.0% +1.7% +4.2% +17.1% ➖ noise
92 datafusion:vortex-file-compressed +8.0% +1.7% +6.1% +20.1% ➖ noise
92 duckdb:duckdb +1.8% +1.7% +0.1% +10.0% ➖ noise
92 duckdb:vortex-compact +7.6% +1.7% +5.7% +13.5% ➖ noise
92 duckdb:vortex-file-compressed -2.0% +1.7% -3.7% +11.7% ➖ noise
93 datafusion:vortex-compact -0.8% -1.3% +0.4% +13.5% ➖ noise
93 datafusion:vortex-file-compressed +3.0% -1.3% +4.3% +10.0% ➖ noise
93 duckdb:duckdb +0.0% -1.3% +1.3% +10.0% ➖ noise
93 duckdb:vortex-compact -1.6% -1.3% -0.3% +10.0% ➖ noise
93 duckdb:vortex-file-compressed -1.1% -1.3% +0.2% +10.0% ➖ noise
94 datafusion:vortex-compact +4.6% -0.9% +5.6% +14.9% ➖ noise
94 datafusion:vortex-file-compressed -0.2% -0.9% +0.7% +12.5% ➖ noise
94 duckdb:duckdb -1.6% -0.9% -0.7% +13.8% ➖ noise
94 duckdb:vortex-compact -2.0% -0.9% -1.1% +24.5% ➖ noise
94 duckdb:vortex-file-compressed +1.3% -0.9% +2.3% +10.8% ➖ noise
95 datafusion:vortex-compact -1.7% -2.6% +0.9% +10.1% ➖ noise
95 datafusion:vortex-file-compressed -0.2% -2.6% +2.5% +10.1% ➖ noise
95 duckdb:duckdb -0.7% -2.6% +2.0% +13.3% ➖ noise
95 duckdb:vortex-compact -3.3% -2.6% -0.7% +19.4% ➖ noise
95 duckdb:vortex-file-compressed -14.8% -2.6% -12.5% +16.6% ➖ noise
96 datafusion:vortex-compact +1.0% +4.1% -3.0% +16.8% ➖ noise
96 datafusion:vortex-file-compressed -2.2% +4.1% -6.1% +18.6% ➖ noise
96 duckdb:duckdb +9.6% +4.1% +5.2% +23.0% ➖ noise
96 duckdb:vortex-compact -5.5% +4.1% -9.3% +21.1% ➖ noise
96 duckdb:vortex-file-compressed -3.1% +4.1% -7.0% +16.3% ➖ noise
97 datafusion:vortex-compact -2.4% -2.8% +0.4% +19.4% ➖ noise
97 datafusion:vortex-file-compressed -0.5% -2.8% +2.4% +11.6% ➖ noise
97 duckdb:duckdb +0.6% -2.8% +3.5% +11.4% ➖ noise
97 duckdb:vortex-compact -1.3% -2.8% +1.5% +12.4% ➖ noise
97 duckdb:vortex-file-compressed -0.6% -2.8% +2.3% +11.9% ➖ noise
98 datafusion:vortex-compact -0.7% -0.4% -0.3% +14.6% ➖ noise
98 datafusion:vortex-file-compressed +3.0% -0.4% +3.4% +10.0% ➖ noise
98 duckdb:duckdb +0.4% -0.4% +0.8% +13.2% ➖ noise
98 duckdb:vortex-compact -0.4% -0.4% +0.0% +10.0% ➖ noise
98 duckdb:vortex-file-compressed +11.1% -0.4% +11.6% +24.3% ➖ noise
99 datafusion:vortex-compact +0.6% -9.0% +10.6% +20.9% ➖ noise
99 datafusion:vortex-file-compressed +14.3% -9.0% +25.7% +22.9% 🚨 regression
99 duckdb:duckdb +0.7% -9.0% +10.7% +14.6% ➖ noise
99 duckdb:vortex-compact -3.8% -9.0% +5.7% +20.7% ➖ noise
99 duckdb:vortex-file-compressed +0.3% -9.0% +10.3% +15.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.9%
Engines: DataFusion No clear signal (-1.7%, environment too noisy confidence) · DuckDB No clear signal (-4.1%, environment too noisy confidence)
Vortex (geomean): 0.919x ➖
Parquet (geomean): 0.946x ➖
Shifts: Parquet (control) -5.4% · Median polish -6.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.837x ➖, 2↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 33536705 45934759 0.73
fineweb_q01/datafusion:vortex-file-compressed 🚀 640309354 1117678195 0.57
fineweb_q02/datafusion:vortex-file-compressed 🚀 592031945 956397251 0.62
fineweb_q03/datafusion:vortex-file-compressed 1370080625 1721090738 0.80
fineweb_q04/datafusion:vortex-file-compressed 1364462599 1516041286 0.90
fineweb_q05/datafusion:vortex-file-compressed 1373116602 1337582247 1.03
fineweb_q06/datafusion:vortex-file-compressed 1559608646 1516022944 1.03
fineweb_q07/datafusion:vortex-file-compressed 1340474986 1323385411 1.01
fineweb_q08/datafusion:vortex-file-compressed 516198470 510790933 1.01
datafusion / vortex-compact (0.962x ➖, 1↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 35908539 30023376 1.20
fineweb_q01/datafusion:vortex-compact 🚀 506722801 757740752 0.67
fineweb_q02/datafusion:vortex-compact 617571477 531554150 1.16
fineweb_q03/datafusion:vortex-compact 1459740169 1600054960 0.91
fineweb_q04/datafusion:vortex-compact 1618249792 1668186701 0.97
fineweb_q05/datafusion:vortex-compact 1398298372 1440125170 0.97
fineweb_q06/datafusion:vortex-compact 1299364919 1373981838 0.95
fineweb_q07/datafusion:vortex-compact 1200316093 1215392226 0.99
fineweb_q08/datafusion:vortex-compact 375263858 397454642 0.94
datafusion / parquet (0.912x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1147669702 1224600521 0.94
fineweb_q01/datafusion:parquet 1934007112 2066280726 0.94
fineweb_q02/datafusion:parquet 1739302199 1959446491 0.89
fineweb_q03/datafusion:parquet 1921439234 2158089260 0.89
fineweb_q04/datafusion:parquet 1824591779 2198242190 0.83
fineweb_q05/datafusion:parquet 1978794224 2133252031 0.93
fineweb_q06/datafusion:parquet 2092917866 2284047251 0.92
fineweb_q07/datafusion:parquet 1944456669 2174089222 0.89
fineweb_q08/datafusion:parquet 1961547708 1958048997 1.00
duckdb / vortex-file-compressed (0.910x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 78562099 94240246 0.83
fineweb_q01/duckdb:vortex-file-compressed 611111116 719401755 0.85
fineweb_q02/duckdb:vortex-file-compressed 480592128 538481245 0.89
fineweb_q03/duckdb:vortex-file-compressed 1537974935 1656078158 0.93
fineweb_q04/duckdb:vortex-file-compressed 1682949956 1842161843 0.91
fineweb_q05/duckdb:vortex-file-compressed 1681607618 1638891139 1.03
fineweb_q06/duckdb:vortex-file-compressed 1861740282 1827840513 1.02
fineweb_q07/duckdb:vortex-file-compressed 1576198218 1820189557 0.87
fineweb_q08/duckdb:vortex-file-compressed 697977384 792356243 0.88
duckdb / vortex-compact (0.973x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 88193358 87738757 1.01
fineweb_q01/duckdb:vortex-compact 680580157 587654804 1.16
fineweb_q02/duckdb:vortex-compact 661786867 641615062 1.03
fineweb_q03/duckdb:vortex-compact 1742546087 1858733133 0.94
fineweb_q04/duckdb:vortex-compact 1962949508 2027594362 0.97
fineweb_q05/duckdb:vortex-compact 1787825966 1863134083 0.96
fineweb_q06/duckdb:vortex-compact 1563445134 1650082833 0.95
fineweb_q07/duckdb:vortex-compact 1399261447 1572435196 0.89
fineweb_q08/duckdb:vortex-compact 470935054 532367901 0.88
duckdb / parquet (0.982x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1126204940 1103724185 1.02
fineweb_q01/duckdb:parquet 1293239203 1441791630 0.90
fineweb_q02/duckdb:parquet 1406469721 1356887142 1.04
fineweb_q03/duckdb:parquet 3776166046 3874016406 0.97
fineweb_q04/duckdb:parquet 2026786979 1961617730 1.03
fineweb_q05/duckdb:parquet 2205027794 2316577210 0.95
fineweb_q06/duckdb:parquet 4535324602 4575534494 0.99
fineweb_q07/duckdb:parquet 2666509997 2623065751 1.02
fineweb_q08/duckdb:parquet 1123749978 1218129768 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +19.6% -2.2% +22.3% +168.3% ➖ noise
0 datafusion:vortex-file-compressed -27.0% -2.2% -25.3% +176.2% ➖ noise
0 duckdb:vortex-compact +0.5% -2.2% +2.8% +46.8% ➖ noise
0 duckdb:vortex-file-compressed -16.6% -2.2% -14.8% +76.0% ➖ noise
1 datafusion:vortex-compact -33.1% -8.4% -27.0% +43.1% ➖ noise
1 datafusion:vortex-file-compressed -42.7% -8.4% -37.5% +51.7% ✅ faster
1 duckdb:vortex-compact +15.8% -8.4% +26.4% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -15.1% -8.4% -7.3% +89.4% ➖ noise
2 datafusion:vortex-compact +16.2% -4.1% +21.1% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -38.1% -4.1% -35.5% +47.9% ✅ faster
2 duckdb:vortex-compact +3.1% -4.1% +7.5% +58.8% ➖ noise
2 duckdb:vortex-file-compressed -10.8% -4.1% -7.0% +30.0% ➖ noise
3 datafusion:vortex-compact -8.8% -6.8% -2.1% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -20.4% -6.8% -14.5% +30.0% ➖ noise
3 duckdb:vortex-compact -6.3% -6.8% +0.6% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -7.1% -6.8% -0.3% +30.0% ➖ noise
4 datafusion:vortex-compact -3.0% -7.4% +4.8% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -10.0% -7.4% -2.8% +30.0% ➖ noise
4 duckdb:vortex-compact -3.2% -7.4% +4.5% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -8.6% -7.4% -1.3% +30.0% ➖ noise
5 datafusion:vortex-compact -2.9% -6.0% +3.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +2.7% -6.0% +9.3% +30.0% ➖ noise
5 duckdb:vortex-compact -4.0% -6.0% +2.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +2.6% -6.0% +9.2% +30.0% ➖ noise
6 datafusion:vortex-compact -5.4% -4.7% -0.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +2.9% -4.7% +7.9% +30.0% ➖ noise
6 duckdb:vortex-compact -5.3% -4.7% -0.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +1.9% -4.7% +6.9% +30.0% ➖ noise
7 datafusion:vortex-compact -1.2% -4.6% +3.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +1.3% -4.6% +6.2% +30.0% ➖ noise
7 duckdb:vortex-compact -11.0% -4.6% -6.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -13.4% -4.6% -9.2% +30.0% ➖ noise
8 datafusion:vortex-compact -5.6% -3.9% -1.8% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +1.1% -3.9% +5.1% +30.0% ➖ noise
8 duckdb:vortex-compact -11.5% -3.9% -8.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -11.9% -3.9% -8.4% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): 0.998x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11802894 12291408 0.96
statpopgen_q01/duckdb:vortex-file-compressed 26601555 26069320 1.02
statpopgen_q02/duckdb:vortex-file-compressed 540422909 560642418 0.96
statpopgen_q03/duckdb:vortex-file-compressed 1059866304 1045328011 1.01
statpopgen_q04/duckdb:vortex-file-compressed 1065532558 1061948021 1.00
statpopgen_q05/duckdb:vortex-file-compressed 498688984 498554076 1.00
statpopgen_q06/duckdb:vortex-file-compressed 1555912782 1533009719 1.01
statpopgen_q07/duckdb:vortex-file-compressed 206223935 205652684 1.00
statpopgen_q08/duckdb:vortex-file-compressed 234656914 243184744 0.96
statpopgen_q09/duckdb:vortex-file-compressed 836610809 835272228 1.00
statpopgen_q10/duckdb:vortex-file-compressed 2561565535 2573509263 1.00
duckdb / vortex-compact (1.001x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11450694 11595389 0.99
statpopgen_q01/duckdb:vortex-compact 217151976 215846620 1.01
statpopgen_q02/duckdb:vortex-compact 561786342 556111280 1.01
statpopgen_q03/duckdb:vortex-compact 1149363903 1145358821 1.00
statpopgen_q04/duckdb:vortex-compact 1139704142 1149849787 0.99
statpopgen_q05/duckdb:vortex-compact 585236397 566330249 1.03
statpopgen_q06/duckdb:vortex-compact 1483048574 1503684471 0.99
statpopgen_q07/duckdb:vortex-compact 887700593 885215222 1.00
statpopgen_q08/duckdb:vortex-compact 914861233 916770623 1.00
statpopgen_q09/duckdb:vortex-compact 929146513 933390000 1.00
statpopgen_q10/duckdb:vortex-compact 2589378427 2603280882 0.99
duckdb / parquet (0.990x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 299264957 301570317 0.99
statpopgen_q01/duckdb:parquet 378296710 376225210 1.01
statpopgen_q02/duckdb:parquet 759746194 764008863 0.99
statpopgen_q03/duckdb:parquet 1173331595 1202377360 0.98
statpopgen_q04/duckdb:parquet 1166112412 1202263393 0.97
statpopgen_q05/duckdb:parquet 807566566 814267497 0.99
statpopgen_q06/duckdb:parquet 1409047453 1408119326 1.00
statpopgen_q07/duckdb:parquet 842213417 854149048 0.99
statpopgen_q08/duckdb:parquet 853927449 860183805 0.99
statpopgen_q09/duckdb:parquet 1003237521 1023982108 0.98
statpopgen_q10/duckdb:parquet 2209642347 2217802182 1.00

No file size changes detected.

Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -1.2% -0.8% -0.5% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -4.0% -0.8% -3.2% +10.0% ➖ noise
1 duckdb:vortex-compact +0.6% +0.6% +0.1% +16.8% ➖ noise
1 duckdb:vortex-file-compressed +2.0% +0.6% +1.5% +220.6% ➖ noise
2 duckdb:vortex-compact +1.0% -0.6% +1.6% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -3.6% -0.6% -3.1% +10.0% ➖ noise
3 duckdb:vortex-compact +0.3% -2.4% +2.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.4% -2.4% +3.9% +10.0% ➖ noise
4 duckdb:vortex-compact -0.9% -3.0% +2.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.3% -3.0% +3.4% +10.0% ➖ noise
5 duckdb:vortex-compact +3.3% -0.8% +4.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.0% -0.8% +0.9% +10.0% ➖ noise
6 duckdb:vortex-compact -1.4% +0.1% -1.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.5% +0.1% +1.4% +10.0% ➖ noise
7 duckdb:vortex-compact +0.3% -1.4% +1.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.3% -1.4% +1.7% +10.0% ➖ noise
8 duckdb:vortex-compact -0.2% -0.7% +0.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.5% -0.7% -2.8% +10.0% ➖ noise
9 duckdb:vortex-compact -0.5% -2.0% +1.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.2% -2.0% +2.2% +10.0% ➖ noise
10 duckdb:vortex-compact -0.5% -0.4% -0.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.5% -0.4% -0.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: Random Access

Vortex (geomean): 0.937x ➖
Parquet (geomean): 0.963x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (0.999x ➖, 4↑ 1↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 1866558 390811 4.78
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1087049 1045240 1.04
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8422603653 8550612613 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8336332978 8502111688 0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk 4533605 4305057 1.05
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 3597772 3907488 0.92
random-access/feature-vectors/uniform/lance-tokio-local-disk 1252218 1189489 1.05
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1938796 1871602 1.04
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8338470622 8481028655 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8282009371 8499044079 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk 7179394 7328193 0.98
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 7011990 7058766 0.99
random-access/lance-tokio-local-disk 653878 645598 1.01
random-access/lance-tokio-local-disk-footer 1323624 1326630 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk 241800 248362 0.97
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 587488 606726 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk 131487377 131661391 1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 131431614 131547477 1.00
random-access/nested-lists/correlated/vortex-tokio-local-disk 643466 662701 0.97
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 656775 674330 0.97
random-access/nested-lists/uniform/lance-tokio-local-disk 1043993 1015693 1.03
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1403156 1386079 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk 132354829 131649790 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 132244143 131582015 1.01
random-access/nested-lists/uniform/vortex-tokio-local-disk 2129829 2192779 0.97
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2094604 2179301 0.96
random-access/nested-structs/correlated/lance-tokio-local-disk 374042 379504 0.99
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 557358 566079 0.98
random-access/nested-structs/correlated/parquet-tokio-local-disk 22351558 24051348 0.93
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 22521521 23655589 0.95
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 728421 831467 0.88
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 736984 826695 0.89
random-access/nested-structs/uniform/lance-tokio-local-disk 2749182 2652244 1.04
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2889723 2815645 1.03
random-access/nested-structs/uniform/parquet-tokio-local-disk 22196353 23779122 0.93
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 22165582 23459385 0.94
random-access/nested-structs/uniform/vortex-tokio-local-disk 1577899 1688645 0.93
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1596632 1739350 0.92
random-access/parquet-tokio-local-disk 163749729 174798631 0.94
random-access/parquet-tokio-local-disk-footer 164647548 175378795 0.94
random-access/taxi/correlated/lance-tokio-local-disk 959323 962465 1.00
random-access/taxi/correlated/lance-tokio-local-disk-footer 1868267 1879979 0.99
random-access/taxi/correlated/parquet-tokio-local-disk 246937587 260680009 0.95
random-access/taxi/correlated/parquet-tokio-local-disk-footer 247075268 263147355 0.94
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1553777 1867935 0.83
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1764368 1896724 0.93
random-access/taxi/uniform/lance-tokio-local-disk 9729657 9330211 1.04
random-access/taxi/uniform/lance-tokio-local-disk-footer 10382876 9956380 1.04
random-access/taxi/uniform/parquet-tokio-local-disk 262178580 279004883 0.94
random-access/taxi/uniform/parquet-tokio-local-disk-footer 265519177 278773941 0.95
random-access/taxi/uniform/vortex-tokio-local-disk 4615033 4891677 0.94
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4593481 4877589 0.94
random-access/vortex-tokio-local-disk 1181077 1295715 0.91
random-access/vortex-tokio-local-disk-footer 🚀 1189935 1332646 0.89

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 399576660 390643876 1.02
tpch_q02/datafusion:vortex-file-compressed 109831628 115183243 0.95
tpch_q03/datafusion:vortex-file-compressed 215235094 217072358 0.99
tpch_q04/datafusion:vortex-file-compressed 115370411 117277314 0.98
tpch_q05/datafusion:vortex-file-compressed 381313311 383875984 0.99
tpch_q06/datafusion:vortex-file-compressed 37659977 38287804 0.98
tpch_q07/datafusion:vortex-file-compressed 509531724 518282080 0.98
tpch_q08/datafusion:vortex-file-compressed 374847557 374212044 1.00
tpch_q09/datafusion:vortex-file-compressed 652170621 654642247 1.00
tpch_q10/datafusion:vortex-file-compressed 231230617 232113778 1.00
tpch_q11/datafusion:vortex-file-compressed 85927964 86071698 1.00
tpch_q12/datafusion:vortex-file-compressed 118446102 119410934 0.99
tpch_q13/datafusion:vortex-file-compressed 219876212 220517876 1.00
tpch_q14/datafusion:vortex-file-compressed 52149407 54175178 0.96
tpch_q15/datafusion:vortex-file-compressed 102200026 102455439 1.00
tpch_q16/datafusion:vortex-file-compressed 79274533 77534756 1.02
tpch_q17/datafusion:vortex-file-compressed 648323434 642816891 1.01
tpch_q18/datafusion:vortex-file-compressed 872055370 890025165 0.98
tpch_q19/datafusion:vortex-file-compressed 78052741 72760750 1.07
tpch_q20/datafusion:vortex-file-compressed 166308855 166705851 1.00
tpch_q21/datafusion:vortex-file-compressed 679101878 676674938 1.00
tpch_q22/datafusion:vortex-file-compressed 68577706 68400386 1.00
datafusion / vortex-compact (0.996x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 445306460 442937296 1.01
tpch_q02/datafusion:vortex-compact 114938015 115714585 0.99
tpch_q03/datafusion:vortex-compact 215528992 214609837 1.00
tpch_q04/datafusion:vortex-compact 121461663 120363711 1.01
tpch_q05/datafusion:vortex-compact 389702044 393416336 0.99
tpch_q06/datafusion:vortex-compact 60223348 60513216 1.00
tpch_q07/datafusion:vortex-compact 523525097 537732602 0.97
tpch_q08/datafusion:vortex-compact 378097796 378551638 1.00
tpch_q09/datafusion:vortex-compact 652770918 667232115 0.98
tpch_q10/datafusion:vortex-compact 251631474 252613547 1.00
tpch_q11/datafusion:vortex-compact 88921339 88154415 1.01
tpch_q12/datafusion:vortex-compact 161415361 162400036 0.99
tpch_q13/datafusion:vortex-compact 266544051 267492397 1.00
tpch_q14/datafusion:vortex-compact 71416372 71685706 1.00
tpch_q15/datafusion:vortex-compact 157073570 158454283 0.99
tpch_q16/datafusion:vortex-compact 82120500 81214523 1.01
tpch_q17/datafusion:vortex-compact 654460771 654219152 1.00
tpch_q18/datafusion:vortex-compact 873774462 885736339 0.99
tpch_q19/datafusion:vortex-compact 127014393 129010729 0.98
tpch_q20/datafusion:vortex-compact 188766614 188237830 1.00
tpch_q21/datafusion:vortex-compact 676480495 687044888 0.98
tpch_q22/datafusion:vortex-compact 76192247 74972908 1.02
datafusion / parquet (0.993x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 448572029 439302060 1.02
tpch_q02/datafusion:parquet 175340081 176681827 0.99
tpch_q03/datafusion:parquet 285798553 290519367 0.98
tpch_q04/datafusion:parquet 129663055 129733685 1.00
tpch_q05/datafusion:parquet 439512692 447739746 0.98
tpch_q06/datafusion:parquet 122038345 127706075 0.96
tpch_q07/datafusion:parquet 618012142 625227204 0.99
tpch_q08/datafusion:parquet 469628468 473575842 0.99
tpch_q09/datafusion:parquet 759057833 765333709 0.99
tpch_q10/datafusion:parquet 509206157 516747472 0.99
tpch_q11/datafusion:parquet 116829530 117561821 0.99
tpch_q12/datafusion:parquet 195026153 203264185 0.96
tpch_q13/datafusion:parquet 333709047 332486576 1.00
tpch_q14/datafusion:parquet 164734266 162466799 1.01
tpch_q15/datafusion:parquet 257494180 248221403 1.04
tpch_q16/datafusion:parquet 121058654 127765860 0.95
tpch_q17/datafusion:parquet 694248047 694175597 1.00
tpch_q18/datafusion:parquet 903757778 928301279 0.97
tpch_q19/datafusion:parquet 270004130 257006265 1.05
tpch_q20/datafusion:parquet 298458753 303060689 0.98
tpch_q21/datafusion:parquet 709696194 704223000 1.01
tpch_q22/datafusion:parquet 216689141 218248252 0.99
datafusion / arrow (0.987x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 591697595 605555746 0.98
tpch_q02/datafusion:arrow 168682103 167483164 1.01
tpch_q03/datafusion:arrow 466983477 470317914 0.99
tpch_q04/datafusion:arrow 339769135 344022584 0.99
tpch_q05/datafusion:arrow 946062635 956474808 0.99
tpch_q06/datafusion:arrow 277806157 284466328 0.98
tpch_q07/datafusion:arrow 1174652201 1175188646 1.00
tpch_q08/datafusion:arrow 1149049364 1148296605 1.00
tpch_q09/datafusion:arrow 1338681375 1372426413 0.98
tpch_q10/datafusion:arrow 584995404 607433576 0.96
tpch_q11/datafusion:arrow 140120023 138841521 1.01
tpch_q12/datafusion:arrow 757091910 751652557 1.01
tpch_q13/datafusion:arrow 499303036 508161141 0.98
tpch_q14/datafusion:arrow 314497771 326378157 0.96
tpch_q15/datafusion:arrow 685112163 701107187 0.98
tpch_q16/datafusion:arrow 106292382 107138604 0.99
tpch_q17/datafusion:arrow 1333136892 1353359553 0.99
tpch_q18/datafusion:arrow 1933461205 1978554305 0.98
tpch_q19/datafusion:arrow 485452813 493369104 0.98
tpch_q20/datafusion:arrow 491952858 498578041 0.99
tpch_q21/datafusion:arrow 2990944349 3031589704 0.99
tpch_q22/datafusion:arrow 132876564 134012644 0.99
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169486163 170884253 0.99
tpch_q02/duckdb:vortex-file-compressed 52027991 51899282 1.00
tpch_q03/duckdb:vortex-file-compressed 121816792 123180468 0.99
tpch_q04/duckdb:vortex-file-compressed 159141325 159518890 1.00
tpch_q05/duckdb:vortex-file-compressed 137981180 136707045 1.01
tpch_q06/duckdb:vortex-file-compressed 34995658 34145582 1.02
tpch_q07/duckdb:vortex-file-compressed 132279058 132863671 1.00
tpch_q08/duckdb:vortex-file-compressed 170731586 172264212 0.99
tpch_q09/duckdb:vortex-file-compressed 391564209 393977870 0.99
tpch_q10/duckdb:vortex-file-compressed 189020228 188839311 1.00
tpch_q11/duckdb:vortex-file-compressed 32142589 32744203 0.98
tpch_q12/duckdb:vortex-file-compressed 101275889 102507823 0.99
tpch_q13/duckdb:vortex-file-compressed 269213943 270579636 0.99
tpch_q14/duckdb:vortex-file-compressed 53015682 54293518 0.98
tpch_q15/duckdb:vortex-file-compressed 89089589 90021671 0.99
tpch_q16/duckdb:vortex-file-compressed 76628892 77651286 0.99
tpch_q17/duckdb:vortex-file-compressed 93990968 95127902 0.99
tpch_q18/duckdb:vortex-file-compressed 284769188 288390931 0.99
tpch_q19/duckdb:vortex-file-compressed 79372832 80021360 0.99
tpch_q20/duckdb:vortex-file-compressed 140455632 141448110 0.99
tpch_q21/duckdb:vortex-file-compressed 491442090 494214203 0.99
tpch_q22/duckdb:vortex-file-compressed 64115554 64315989 1.00
duckdb / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 230561108 229369350 1.01
tpch_q02/duckdb:vortex-compact 56685659 57818466 0.98
tpch_q03/duckdb:vortex-compact 136714536 135670231 1.01
tpch_q04/duckdb:vortex-compact 170376629 171999323 0.99
tpch_q05/duckdb:vortex-compact 165462992 165331712 1.00
tpch_q06/duckdb:vortex-compact 58431095 60271982 0.97
tpch_q07/duckdb:vortex-compact 173176719 173194305 1.00
tpch_q08/duckdb:vortex-compact 187274195 190029464 0.99
tpch_q09/duckdb:vortex-compact 425830787 436323748 0.98
tpch_q10/duckdb:vortex-compact 220313062 219877197 1.00
tpch_q11/duckdb:vortex-compact 38610225 39255637 0.98
tpch_q12/duckdb:vortex-compact 164290072 162542744 1.01
tpch_q13/duckdb:vortex-compact 325494079 326665947 1.00
tpch_q14/duckdb:vortex-compact 71203630 72359494 0.98
tpch_q15/duckdb:vortex-compact 114614803 116297588 0.99
tpch_q16/duckdb:vortex-compact 81430463 81348601 1.00
tpch_q17/duckdb:vortex-compact 108229685 108652592 1.00
tpch_q18/duckdb:vortex-compact 289603477 290502380 1.00
tpch_q19/duckdb:vortex-compact 96570637 96898209 1.00
tpch_q20/duckdb:vortex-compact 177202411 178904361 0.99
tpch_q21/duckdb:vortex-compact 515061458 523112580 0.98
tpch_q22/duckdb:vortex-compact 72562271 71985724 1.01
duckdb / parquet (1.002x ➖, 0↑ 1↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 265092185 260323713 1.02
tpch_q02/duckdb:parquet 104579843 105256453 0.99
tpch_q03/duckdb:parquet 212854484 211714823 1.01
tpch_q04/duckdb:parquet 131476823 140243924 0.94
tpch_q05/duckdb:parquet 223356441 226274826 0.99
tpch_q06/duckdb:parquet 75056208 75459742 0.99
tpch_q07/duckdb:parquet 186599484 186227360 1.00
tpch_q08/duckdb:parquet 262988663 266804885 0.99
tpch_q09/duckdb:parquet 476248474 471025409 1.01
tpch_q10/duckdb:parquet 619714433 624440961 0.99
tpch_q11/duckdb:parquet 🚨 70411658 62550088 1.13
tpch_q12/duckdb:parquet 132665597 131152458 1.01
tpch_q13/duckdb:parquet 441932399 437695077 1.01
tpch_q14/duckdb:parquet 182047567 182565271 1.00
tpch_q15/duckdb:parquet 103441511 103400958 1.00
tpch_q16/duckdb:parquet 165214511 163957199 1.01
tpch_q17/duckdb:parquet 182440517 182564952 1.00
tpch_q18/duckdb:parquet 367494932 364613551 1.01
tpch_q19/duckdb:parquet 290399910 286335979 1.01
tpch_q20/duckdb:parquet 226736569 223575761 1.01
tpch_q21/duckdb:parquet 551328460 573252789 0.96
tpch_q22/duckdb:parquet 290680823 296481431 0.98
duckdb / duckdb (0.991x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120289473 120985675 0.99
tpch_q02/duckdb:duckdb 49164659 49763892 0.99
tpch_q03/duckdb:duckdb 104033135 103733507 1.00
tpch_q04/duckdb:duckdb 138295959 140470789 0.98
tpch_q05/duckdb:duckdb 120765025 120626032 1.00
tpch_q06/duckdb:duckdb 44608207 45066321 0.99
tpch_q07/duckdb:duckdb 90594660 91947990 0.99
tpch_q08/duckdb:duckdb 118889037 118684888 1.00
tpch_q09/duckdb:duckdb 282197781 282215600 1.00
tpch_q10/duckdb:duckdb 208336317 215335202 0.97
tpch_q11/duckdb:duckdb 18963961 19074022 0.99
tpch_q12/duckdb:duckdb 89950549 91058836 0.99
tpch_q13/duckdb:duckdb 232363034 233121194 1.00
tpch_q14/duckdb:duckdb 78135162 78179304 1.00
tpch_q15/duckdb:duckdb 81810232 81975096 1.00
tpch_q16/duckdb:duckdb 76391114 78164982 0.98
tpch_q17/duckdb:duckdb 88244629 88307064 1.00
tpch_q18/duckdb:duckdb 233519057 233648378 1.00
tpch_q19/duckdb:duckdb 124119811 125052024 0.99
tpch_q20/duckdb:duckdb 117674945 119101169 0.99
tpch_q21/duckdb:duckdb 301226799 307897577 0.98
tpch_q22/duckdb:duckdb 67002509 69128807 0.97

No file size changes detected.

Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -2.3% +2.0% -4.2% +10.0% ➖ noise
1 datafusion:vortex-compact +0.5% +2.0% -1.4% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +2.3% +2.0% +0.3% +10.0% ➖ noise
1 duckdb:duckdb -0.6% +2.0% -2.5% +10.0% ➖ noise
1 duckdb:vortex-compact +0.5% +2.0% -1.4% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.8% +2.0% -2.7% +10.0% ➖ noise
2 datafusion:arrow +0.7% -0.7% +1.4% +10.0% ➖ noise
2 datafusion:vortex-compact -0.7% -0.7% +0.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -4.6% -0.7% -4.0% +10.0% ➖ noise
2 duckdb:duckdb -1.2% -0.7% -0.5% +10.0% ➖ noise
2 duckdb:vortex-compact -2.0% -0.7% -1.3% +12.3% ➖ noise
2 duckdb:vortex-file-compressed +0.2% -0.7% +1.0% +13.2% ➖ noise
3 datafusion:arrow -0.7% -0.5% -0.2% +10.0% ➖ noise
3 datafusion:vortex-compact +0.4% -0.5% +1.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -0.8% -0.5% -0.3% +10.0% ➖ noise
3 duckdb:duckdb +0.3% -0.5% +0.8% +10.0% ➖ noise
3 duckdb:vortex-compact +0.8% -0.5% +1.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.1% -0.5% -0.6% +10.0% ➖ noise
4 datafusion:arrow -1.2% -3.2% +2.0% +10.0% ➖ noise
4 datafusion:vortex-compact +0.9% -3.2% +4.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.6% -3.2% +1.6% +10.0% ➖ noise
4 duckdb:duckdb -1.5% -3.2% +1.7% +10.0% ➖ noise
4 duckdb:vortex-compact -0.9% -3.2% +2.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.2% -3.2% +3.1% +10.0% ➖ noise
5 datafusion:arrow -1.1% -1.6% +0.5% +10.0% ➖ noise
5 datafusion:vortex-compact -0.9% -1.6% +0.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -0.7% -1.6% +0.9% +10.0% ➖ noise
5 duckdb:duckdb +0.1% -1.6% +1.7% +10.0% ➖ noise
5 duckdb:vortex-compact +0.1% -1.6% +1.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.9% -1.6% +2.5% +10.0% ➖ noise
6 datafusion:arrow -2.3% -2.5% +0.2% +10.0% ➖ noise
6 datafusion:vortex-compact -0.5% -2.5% +2.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.6% -2.5% +0.9% +10.0% ➖ noise
6 duckdb:duckdb -1.0% -2.5% +1.5% +10.0% ➖ noise
6 duckdb:vortex-compact -3.1% -2.5% -0.6% +10.2% ➖ noise
6 duckdb:vortex-file-compressed +2.5% -2.5% +5.1% +10.0% ➖ noise
7 datafusion:arrow -0.0% -0.5% +0.4% +10.0% ➖ noise
7 datafusion:vortex-compact -2.6% -0.5% -2.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.7% -0.5% -1.2% +10.0% ➖ noise
7 duckdb:duckdb -1.5% -0.5% -1.0% +10.0% ➖ noise
7 duckdb:vortex-compact -0.0% -0.5% +0.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.4% -0.5% +0.0% +10.0% ➖ noise
8 datafusion:arrow +0.1% -1.1% +1.2% +10.0% ➖ noise
8 datafusion:vortex-compact -0.1% -1.1% +1.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.2% -1.1% +1.3% +10.0% ➖ noise
8 duckdb:duckdb +0.2% -1.1% +1.3% +10.0% ➖ noise
8 duckdb:vortex-compact -1.4% -1.1% -0.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.9% -1.1% +0.2% +10.0% ➖ noise
9 datafusion:arrow -2.5% +0.1% -2.6% +10.0% ➖ noise
9 datafusion:vortex-compact -2.2% +0.1% -2.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.4% +0.1% -0.5% +10.0% ➖ noise
9 duckdb:duckdb -0.0% +0.1% -0.1% +10.0% ➖ noise
9 duckdb:vortex-compact -2.4% +0.1% -2.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.6% +0.1% -0.8% +10.0% ➖ noise
10 datafusion:arrow -3.7% -1.1% -2.6% +10.0% ➖ noise
10 datafusion:vortex-compact -0.4% -1.1% +0.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.4% -1.1% +0.7% +10.0% ➖ noise
10 duckdb:duckdb -3.3% -1.1% -2.2% +10.0% ➖ noise
10 duckdb:vortex-compact +0.2% -1.1% +1.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.1% -1.1% +1.2% +10.0% ➖ noise
11 datafusion:arrow +0.9% +5.8% -4.6% +12.1% ➖ noise
11 datafusion:vortex-compact +0.9% +5.8% -4.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.2% +5.8% -5.6% +10.9% ➖ noise
11 duckdb:duckdb -0.6% +5.8% -6.0% +10.0% ➖ noise
11 duckdb:vortex-compact -1.6% +5.8% -7.0% +11.5% ➖ noise
11 duckdb:vortex-file-compressed -1.8% +5.8% -7.2% +18.3% ➖ noise
12 datafusion:arrow +0.7% -1.5% +2.2% +36.5% ➖ noise
12 datafusion:vortex-compact -0.6% -1.5% +0.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.8% -1.5% +0.7% +10.0% ➖ noise
12 duckdb:duckdb -1.2% -1.5% +0.3% +10.0% ➖ noise
12 duckdb:vortex-compact +1.1% -1.5% +2.6% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -1.2% -1.5% +0.3% +10.0% ➖ noise
13 datafusion:arrow -1.7% +0.7% -2.4% +10.0% ➖ noise
13 datafusion:vortex-compact -0.4% +0.7% -1.0% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.3% +0.7% -1.0% +10.0% ➖ noise
13 duckdb:duckdb -0.3% +0.7% -1.0% +10.0% ➖ noise
13 duckdb:vortex-compact -0.4% +0.7% -1.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.5% +0.7% -1.2% +10.0% ➖ noise
14 datafusion:arrow -3.6% +0.6% -4.2% +10.0% ➖ noise
14 datafusion:vortex-compact -0.4% +0.6% -0.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -3.7% +0.6% -4.3% +10.0% ➖ noise
14 duckdb:duckdb -0.1% +0.6% -0.6% +10.0% ➖ noise
14 duckdb:vortex-compact -1.6% +0.6% -2.1% +11.1% ➖ noise
14 duckdb:vortex-file-compressed -2.4% +0.6% -2.9% +10.4% ➖ noise
15 datafusion:arrow -2.3% +1.9% -4.1% +10.0% ➖ noise
15 datafusion:vortex-compact -0.9% +1.9% -2.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.2% +1.9% -2.1% +10.0% ➖ noise
15 duckdb:duckdb -0.2% +1.9% -2.0% +10.0% ➖ noise
15 duckdb:vortex-compact -1.4% +1.9% -3.3% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.0% +1.9% -2.9% +10.0% ➖ noise
16 datafusion:arrow -0.8% -2.3% +1.5% +10.0% ➖ noise
16 datafusion:vortex-compact +1.1% -2.3% +3.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +2.2% -2.3% +4.6% +10.0% ➖ noise
16 duckdb:duckdb -2.3% -2.3% +0.0% +10.0% ➖ noise
16 duckdb:vortex-compact +0.1% -2.3% +2.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -1.3% -2.3% +1.0% +10.0% ➖ noise
17 datafusion:arrow -1.5% -0.0% -1.5% +10.0% ➖ noise
17 datafusion:vortex-compact +0.0% -0.0% +0.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.9% -0.0% +0.9% +10.0% ➖ noise
17 duckdb:duckdb -0.1% -0.0% -0.0% +10.0% ➖ noise
17 duckdb:vortex-compact -0.4% -0.0% -0.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -1.2% -0.0% -1.2% +10.0% ➖ noise
18 datafusion:arrow -2.3% -0.9% -1.4% +10.0% ➖ noise
18 datafusion:vortex-compact -1.4% -0.9% -0.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.0% -0.9% -1.1% +10.0% ➖ noise
18 duckdb:duckdb -0.1% -0.9% +0.9% +10.0% ➖ noise
18 duckdb:vortex-compact -0.3% -0.9% +0.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.3% -0.9% -0.3% +10.0% ➖ noise
19 datafusion:arrow -1.6% +3.2% -4.7% +10.0% ➖ noise
19 datafusion:vortex-compact -1.5% +3.2% -4.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +7.3% +3.2% +3.9% +10.0% ➖ noise
19 duckdb:duckdb -0.7% +3.2% -3.8% +10.0% ➖ noise
19 duckdb:vortex-compact -0.3% +3.2% -3.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.8% +3.2% -3.9% +10.0% ➖ noise
20 datafusion:arrow -1.3% -0.1% -1.3% +10.0% ➖ noise
20 datafusion:vortex-compact +0.3% -0.1% +0.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -0.2% -0.1% -0.2% +10.0% ➖ noise
20 duckdb:duckdb -1.2% -0.1% -1.1% +10.0% ➖ noise
20 duckdb:vortex-compact -1.0% -0.1% -0.9% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.7% -0.1% -0.6% +10.0% ➖ noise
21 datafusion:arrow -1.3% -1.6% +0.2% +10.0% ➖ noise
21 datafusion:vortex-compact -1.5% -1.6% +0.0% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +0.4% -1.6% +1.9% +10.0% ➖ noise
21 duckdb:duckdb -2.2% -1.6% -0.6% +10.0% ➖ noise
21 duckdb:vortex-compact -1.5% -1.6% +0.0% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -0.6% -1.6% +1.0% +10.0% ➖ noise
22 datafusion:arrow -0.8% -1.3% +0.5% +10.0% ➖ noise
22 datafusion:vortex-compact +1.6% -1.3% +3.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.3% -1.3% +1.6% +10.0% ➖ noise
22 duckdb:duckdb -3.1% -1.3% -1.8% +10.0% ➖ noise
22 duckdb:vortex-compact +0.8% -1.3% +2.2% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.3% -1.3% +1.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): 1.075x ➖
Parquet (geomean): 1.046x ➖
Shifts: Parquet (control) +4.6% · Median polish +5.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.066x ➖, 1↑ 11↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚀 1686269 1904692 0.89
clickbench_q01/datafusion:vortex-file-compressed 19419168 18269326 1.06
clickbench_q02/datafusion:vortex-file-compressed 🚨 42772660 36983519 1.16
clickbench_q03/datafusion:vortex-file-compressed 45940679 42527956 1.08
clickbench_q04/datafusion:vortex-file-compressed 311673649 285010158 1.09
clickbench_q05/datafusion:vortex-file-compressed 341412487 314044117 1.09
clickbench_q06/datafusion:vortex-file-compressed 🚨 1904943 1671029 1.14
clickbench_q07/datafusion:vortex-file-compressed 22247366 23407074 0.95
clickbench_q08/datafusion:vortex-file-compressed 393564041 362114003 1.09
clickbench_q09/datafusion:vortex-file-compressed 🚨 619998321 554264729 1.12
clickbench_q10/datafusion:vortex-file-compressed 82514870 75758130 1.09
clickbench_q11/datafusion:vortex-file-compressed 🚨 97480494 86769281 1.12
clickbench_q12/datafusion:vortex-file-compressed 290552834 270623312 1.07
clickbench_q13/datafusion:vortex-file-compressed 454409963 425016072 1.07
clickbench_q14/datafusion:vortex-file-compressed 277919528 260053101 1.07
clickbench_q15/datafusion:vortex-file-compressed 355018553 332813279 1.07
clickbench_q16/datafusion:vortex-file-compressed 711126433 671995019 1.06
clickbench_q17/datafusion:vortex-file-compressed 706283481 662730665 1.07
clickbench_q18/datafusion:vortex-file-compressed 1490465676 1359575715 1.10
clickbench_q19/datafusion:vortex-file-compressed 🚨 40101690 31324202 1.28
clickbench_q20/datafusion:vortex-file-compressed 364055659 354750522 1.03
clickbench_q21/datafusion:vortex-file-compressed 400131917 386245635 1.04
clickbench_q22/datafusion:vortex-file-compressed 498114217 462211236 1.08
clickbench_q23/datafusion:vortex-file-compressed 705881063 709983607 0.99
clickbench_q24/datafusion:vortex-file-compressed 🚨 50610859 45551913 1.11
clickbench_q25/datafusion:vortex-file-compressed 77695584 78833451 0.99
clickbench_q26/datafusion:vortex-file-compressed 47867922 47706453 1.00
clickbench_q27/datafusion:vortex-file-compressed 796352892 763301117 1.04
clickbench_q28/datafusion:vortex-file-compressed 6853784737 6819771086 1.00
clickbench_q29/datafusion:vortex-file-compressed 234820886 244888362 0.96
clickbench_q30/datafusion:vortex-file-compressed 240529048 233218254 1.03
clickbench_q31/datafusion:vortex-file-compressed 282627940 267596639 1.06
clickbench_q32/datafusion:vortex-file-compressed 🚨 1242993114 1119767216 1.11
clickbench_q33/datafusion:vortex-file-compressed 1449774766 1340906123 1.08
clickbench_q34/datafusion:vortex-file-compressed 1449123703 1386980044 1.04
clickbench_q35/datafusion:vortex-file-compressed 508369388 471490022 1.08
clickbench_q36/datafusion:vortex-file-compressed 🚨 79499211 70602722 1.13
clickbench_q37/datafusion:vortex-file-compressed 36533070 35592341 1.03
clickbench_q38/datafusion:vortex-file-compressed 20191346 18543953 1.09
clickbench_q39/datafusion:vortex-file-compressed 🚨 152684593 135298071 1.13
clickbench_q40/datafusion:vortex-file-compressed 16820943 16205566 1.04
clickbench_q41/datafusion:vortex-file-compressed 🚨 16001824 14471318 1.11
clickbench_q42/datafusion:vortex-file-compressed 🚨 18246248 16443740 1.11
datafusion / parquet (1.062x ➖, 0↑ 7↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1600931 1553420 1.03
clickbench_q01/datafusion:parquet 19244137 19279381 1.00
clickbench_q02/datafusion:parquet 47911077 46865955 1.02
clickbench_q03/datafusion:parquet 39261104 37510899 1.05
clickbench_q04/datafusion:parquet 🚨 334976164 302554840 1.11
clickbench_q05/datafusion:parquet 376262155 348677580 1.08
clickbench_q06/datafusion:parquet 1609101 1598831 1.01
clickbench_q07/datafusion:parquet 23855853 21804174 1.09
clickbench_q08/datafusion:parquet 🚨 404516511 366574165 1.10
clickbench_q09/datafusion:parquet 🚨 696834627 627320417 1.11
clickbench_q10/datafusion:parquet 🚨 114729077 103535692 1.11
clickbench_q11/datafusion:parquet 138226809 127505540 1.08
clickbench_q12/datafusion:parquet 371908472 346607728 1.07
clickbench_q13/datafusion:parquet 536319676 508189475 1.06
clickbench_q14/datafusion:parquet 363614176 337731211 1.08
clickbench_q15/datafusion:parquet 361896484 343943133 1.05
clickbench_q16/datafusion:parquet 🚨 748570164 654694031 1.14
clickbench_q17/datafusion:parquet 706273973 660275049 1.07
clickbench_q18/datafusion:parquet 1463218526 1399431006 1.05
clickbench_q19/datafusion:parquet 31168369 31558446 0.99
clickbench_q20/datafusion:parquet 639800490 601508174 1.06
clickbench_q21/datafusion:parquet 704891579 663981971 1.06
clickbench_q22/datafusion:parquet 1036302770 949027945 1.09
clickbench_q23/datafusion:parquet 3972061250 3643244952 1.09
clickbench_q24/datafusion:parquet 84015743 86170928 0.97
clickbench_q25/datafusion:parquet 142584180 135372588 1.05
clickbench_q26/datafusion:parquet 86521693 89340391 0.97
clickbench_q27/datafusion:parquet 1099953755 1069985374 1.03
clickbench_q28/datafusion:parquet 6784199986 6623574251 1.02
clickbench_q29/datafusion:parquet 249117136 239713586 1.04
clickbench_q30/datafusion:parquet 357221111 330629913 1.08
clickbench_q31/datafusion:parquet 390343979 371589213 1.05
clickbench_q32/datafusion:parquet 🚨 1332292182 1172262245 1.14
clickbench_q33/datafusion:parquet 1645674584 1504284120 1.09
clickbench_q34/datafusion:parquet 1648279232 1511021842 1.09
clickbench_q35/datafusion:parquet 507785718 467792762 1.09
clickbench_q36/datafusion:parquet 🚨 161638741 143132302 1.13
clickbench_q37/datafusion:parquet 59994757 57688825 1.04
clickbench_q38/datafusion:parquet 90448889 83877200 1.08
clickbench_q39/datafusion:parquet 288856322 266154692 1.09
clickbench_q40/datafusion:parquet 33309345 32375856 1.03
clickbench_q41/datafusion:parquet 28664957 26817517 1.07
clickbench_q42/datafusion:parquet 32531263 30678006 1.06
duckdb / vortex-file-compressed (1.083x ➖, 1↑ 11↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 7039145 6433210 1.09
clickbench_q01/duckdb:vortex-file-compressed 11785079 11000729 1.07
clickbench_q02/duckdb:vortex-file-compressed 🚨 26981615 24453466 1.10
clickbench_q03/duckdb:vortex-file-compressed 32310039 30721066 1.05
clickbench_q04/duckdb:vortex-file-compressed 199877110 186358858 1.07
clickbench_q05/duckdb:vortex-file-compressed 188005942 175490351 1.07
clickbench_q06/duckdb:vortex-file-compressed 22062682 20688256 1.07
clickbench_q07/duckdb:vortex-file-compressed 15288631 14483512 1.06
clickbench_q08/duckdb:vortex-file-compressed 278778170 265909622 1.05
clickbench_q09/duckdb:vortex-file-compressed 363125574 339023306 1.07
clickbench_q10/duckdb:vortex-file-compressed 70074353 68176203 1.03
clickbench_q11/duckdb:vortex-file-compressed 83491490 78642122 1.06
clickbench_q12/duckdb:vortex-file-compressed 215875352 196806266 1.10
clickbench_q13/duckdb:vortex-file-compressed 432376831 405852655 1.07
clickbench_q14/duckdb:vortex-file-compressed 243064115 229846985 1.06
clickbench_q15/duckdb:vortex-file-compressed 255861452 242005552 1.06
clickbench_q16/duckdb:vortex-file-compressed 567243092 521844397 1.09
clickbench_q17/duckdb:vortex-file-compressed 451196409 416926471 1.08
clickbench_q18/duckdb:vortex-file-compressed 1006528980 944996768 1.07
clickbench_q19/duckdb:vortex-file-compressed 21956858 21470969 1.02
clickbench_q20/duckdb:vortex-file-compressed 337043247 342235427 0.98
clickbench_q21/duckdb:vortex-file-compressed 399419757 365542078 1.09
clickbench_q22/duckdb:vortex-file-compressed 🚀 532105596 607347475 0.88
clickbench_q23/duckdb:vortex-file-compressed 🚨 186210957 158243569 1.18
clickbench_q24/duckdb:vortex-file-compressed 🚨 40350390 33985958 1.19
clickbench_q25/duckdb:vortex-file-compressed 73948920 72294666 1.02
clickbench_q26/duckdb:vortex-file-compressed 🚨 50266547 42173882 1.19
clickbench_q27/duckdb:vortex-file-compressed 509315695 521071997 0.98
clickbench_q28/duckdb:vortex-file-compressed 3123831829 3017869060 1.04
clickbench_q29/duckdb:vortex-file-compressed 30054304 27800243 1.08
clickbench_q30/duckdb:vortex-file-compressed 201580552 196850617 1.02
clickbench_q31/duckdb:vortex-file-compressed 305665509 295316273 1.04
clickbench_q32/duckdb:vortex-file-compressed 1180775272 1111744919 1.06
clickbench_q33/duckdb:vortex-file-compressed 1147791244 1066403692 1.08
clickbench_q34/duckdb:vortex-file-compressed 1246371294 1174268084 1.06
clickbench_q35/duckdb:vortex-file-compressed 387947863 373008015 1.04
clickbench_q36/duckdb:vortex-file-compressed 🚨 27652641 23388452 1.18
clickbench_q37/duckdb:vortex-file-compressed 🚨 20883745 15909676 1.31
clickbench_q38/duckdb:vortex-file-compressed 🚨 21050472 18147829 1.16
clickbench_q39/duckdb:vortex-file-compressed 🚨 43111562 38457785 1.12
clickbench_q40/duckdb:vortex-file-compressed 🚨 18985246 15908010 1.19
clickbench_q41/duckdb:vortex-file-compressed 🚨 19343542 15880108 1.22
clickbench_q42/duckdb:vortex-file-compressed 🚨 19869362 15725990 1.26
duckdb / parquet (1.031x ➖, 0↑ 1↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 22228025 21982345 1.01
clickbench_q01/duckdb:parquet 28636254 28630565 1.00
clickbench_q02/duckdb:parquet 49885004 50707803 0.98
clickbench_q03/duckdb:parquet 40424485 40628854 0.99
clickbench_q04/duckdb:parquet 213937136 203183439 1.05
clickbench_q05/duckdb:parquet 268069227 254695218 1.05
clickbench_q06/duckdb:parquet 46802366 47767972 0.98
clickbench_q07/duckdb:parquet 31294470 31447324 1.00
clickbench_q08/duckdb:parquet 282210458 269074609 1.05
clickbench_q09/duckdb:parquet 410883551 400194136 1.03
clickbench_q10/duckdb:parquet 84650853 81161493 1.04
clickbench_q11/duckdb:parquet 103895607 100978090 1.03
clickbench_q12/duckdb:parquet 287535500 280455464 1.03
clickbench_q13/duckdb:parquet 495196087 468795953 1.06
clickbench_q14/duckdb:parquet 325323631 314977728 1.03
clickbench_q15/duckdb:parquet 263045812 256213465 1.03
clickbench_q16/duckdb:parquet 623225375 592527207 1.05
clickbench_q17/duckdb:parquet 519310156 494868839 1.05
clickbench_q18/duckdb:parquet 1084131164 1034342951 1.05
clickbench_q19/duckdb:parquet 29076449 27784333 1.05
clickbench_q20/duckdb:parquet 425616502 413238043 1.03
clickbench_q21/duckdb:parquet 543784126 529907054 1.03
clickbench_q22/duckdb:parquet 954739415 921850425 1.04
clickbench_q23/duckdb:parquet 272808664 273822114 1.00
clickbench_q24/duckdb:parquet 70673030 71477047 0.99
clickbench_q25/duckdb:parquet 167493309 162151721 1.03
clickbench_q26/duckdb:parquet 54203651 53370499 1.02
clickbench_q27/duckdb:parquet 667901658 646321764 1.03
clickbench_q28/duckdb:parquet 5022475366 4888069259 1.03
clickbench_q29/duckdb:parquet 42415015 42459709 1.00
clickbench_q30/duckdb:parquet 318101245 312950509 1.02
clickbench_q31/duckdb:parquet 388234830 377025301 1.03
clickbench_q32/duckdb:parquet 1173234010 1109266195 1.06
clickbench_q33/duckdb:parquet 1172612580 1103117532 1.06
clickbench_q34/duckdb:parquet 1218741513 1152801478 1.06
clickbench_q35/duckdb:parquet 382761864 367190806 1.04
clickbench_q36/duckdb:parquet 🚨 52707250 44426290 1.19
clickbench_q37/duckdb:parquet 34185271 34478855 0.99
clickbench_q38/duckdb:parquet 37837594 35976994 1.05
clickbench_q39/duckdb:parquet 81960169 85153094 0.96
clickbench_q40/duckdb:parquet 21204678 20115995 1.05
clickbench_q41/duckdb:parquet 21927562 20522224 1.07
clickbench_q42/duckdb:parquet 22751100 22188008 1.03
duckdb / duckdb (0.997x ➖, 2↑ 1↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚀 18192778 20581900 0.88
clickbench_q01/duckdb:duckdb 35407008 37445154 0.95
clickbench_q02/duckdb:duckdb 53651070 55130722 0.97
clickbench_q03/duckdb:duckdb 56591609 58724259 0.96
clickbench_q04/duckdb:duckdb 218519001 212770834 1.03
clickbench_q05/duckdb:duckdb 295460675 286297764 1.03
clickbench_q06/duckdb:duckdb 35604585 36667207 0.97
clickbench_q07/duckdb:duckdb 36268299 38585327 0.94
clickbench_q08/duckdb:duckdb 285109275 275616396 1.03
clickbench_q09/duckdb:duckdb 401746947 398465953 1.01
clickbench_q10/duckdb:duckdb 118147229 120861081 0.98
clickbench_q11/duckdb:duckdb 128906636 129082306 1.00
clickbench_q12/duckdb:duckdb 268603707 261804326 1.03
clickbench_q13/duckdb:duckdb 467517221 445669870 1.05
clickbench_q14/duckdb:duckdb 295002458 288559437 1.02
clickbench_q15/duckdb:duckdb 248974113 244921947 1.02
clickbench_q16/duckdb:duckdb 586544723 562521050 1.04
clickbench_q17/duckdb:duckdb 484794556 473953082 1.02
clickbench_q18/duckdb:duckdb 1038099168 996368539 1.04
clickbench_q19/duckdb:duckdb 🚀 34910018 39022780 0.89
clickbench_q20/duckdb:duckdb 510955949 498947533 1.02
clickbench_q21/duckdb:duckdb 492100189 496841372 0.99
clickbench_q22/duckdb:duckdb 571600822 529858000 1.08
clickbench_q23/duckdb:duckdb 255579444 253645138 1.01
clickbench_q24/duckdb:duckdb 62863365 65229195 0.96
clickbench_q25/duckdb:duckdb 152712709 152819832 1.00
clickbench_q26/duckdb:duckdb 64187704 64601280 0.99
clickbench_q27/duckdb:duckdb 577456181 561248258 1.03
clickbench_q28/duckdb:duckdb 4644119516 4522156727 1.03
clickbench_q29/duckdb:duckdb 51509889 54466060 0.95
clickbench_q30/duckdb:duckdb 289486457 283986775 1.02
clickbench_q31/duckdb:duckdb 373779126 365946666 1.02
clickbench_q32/duckdb:duckdb 1156071309 1114477777 1.04
clickbench_q33/duckdb:duckdb 1208106186 1120938406 1.08
clickbench_q34/duckdb:duckdb 1281474577 1187279230 1.08
clickbench_q35/duckdb:duckdb 304895624 303893620 1.00
clickbench_q36/duckdb:duckdb 🚨 60237022 52003876 1.16
clickbench_q37/duckdb:duckdb 29272313 32309707 0.91
clickbench_q38/duckdb:duckdb 34511241 36811304 0.94
clickbench_q39/duckdb:duckdb 92899903 93069382 1.00
clickbench_q40/duckdb:duckdb 28419130 30948537 0.92
clickbench_q41/duckdb:duckdb 28145952 30520817 0.92
clickbench_q42/duckdb:duckdb 29922918 32697879 0.92

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -11.5% +2.1% -13.3% +748.3% ➖ noise
0 duckdb:duckdb -11.6% +2.1% -13.4% +272.5% ➖ noise
0 duckdb:vortex-file-compressed +9.4% +2.1% +7.2% +441.8% ➖ noise
1 datafusion:vortex-file-compressed +6.3% -0.1% +6.4% +23.8% ➖ noise
1 duckdb:duckdb -5.4% -0.1% -5.4% +52.6% ➖ noise
1 duckdb:vortex-file-compressed +7.1% -0.1% +7.2% +36.8% ➖ noise
2 datafusion:vortex-file-compressed +15.7% +0.3% +15.3% +13.0% 🚨 regression
2 duckdb:duckdb -2.7% +0.3% -3.0% +28.4% ➖ noise
2 duckdb:vortex-file-compressed +10.3% +0.3% +10.0% +15.0% ➖ noise
3 datafusion:vortex-file-compressed +8.0% +2.0% +5.9% +156.4% ➖ noise
3 duckdb:duckdb -3.6% +2.0% -5.6% +74.9% ➖ noise
3 duckdb:vortex-file-compressed +5.2% +2.0% +3.1% +102.9% ➖ noise
4 datafusion:vortex-file-compressed +9.4% +8.0% +1.3% +10.0% ➖ noise
4 duckdb:duckdb +2.7% +8.0% -4.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +7.3% +8.0% -0.7% +10.1% ➖ noise
5 datafusion:vortex-file-compressed +8.7% +6.6% +2.0% +10.0% ➖ noise
5 duckdb:duckdb +3.2% +6.6% -3.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +7.1% +6.6% +0.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +14.0% -0.7% +14.8% +110.0% ➖ noise
6 duckdb:duckdb -2.9% -0.7% -2.2% +21.6% ➖ noise
6 duckdb:vortex-file-compressed +6.6% -0.7% +7.4% +25.1% ➖ noise
7 datafusion:vortex-file-compressed -5.0% +4.3% -8.9% +27.0% ➖ noise
7 duckdb:duckdb -6.0% +4.3% -9.9% +10.0% ✅ faster
7 duckdb:vortex-file-compressed +5.6% +4.3% +1.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +8.7% +7.6% +1.0% +10.0% ➖ noise
8 duckdb:duckdb +3.4% +7.6% -3.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +4.8% +7.6% -2.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +11.9% +6.8% +4.7% +10.0% ➖ noise
9 duckdb:duckdb +0.8% +6.8% -5.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +7.1% +6.8% +0.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +8.9% +7.5% +1.3% +10.0% ➖ noise
10 duckdb:duckdb -2.2% +7.5% -9.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.8% +7.5% -4.4% +12.5% ➖ noise
11 datafusion:vortex-file-compressed +12.3% +5.6% +6.4% +12.7% ➖ noise
11 duckdb:duckdb -0.1% +5.6% -5.4% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +6.2% +5.6% +0.5% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +7.4% +4.9% +2.4% +10.0% ➖ noise
12 duckdb:duckdb +2.6% +4.9% -2.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +9.7% +4.9% +4.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +6.9% +5.6% +1.3% +10.0% ➖ noise
13 duckdb:duckdb +4.9% +5.6% -0.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +6.5% +5.6% +0.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +6.9% +5.5% +1.3% +10.0% ➖ noise
14 duckdb:duckdb +2.2% +5.5% -3.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +5.8% +5.5% +0.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +6.7% +3.9% +2.6% +10.0% ➖ noise
15 duckdb:duckdb +1.7% +3.9% -2.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +5.7% +3.9% +1.7% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +5.8% +9.7% -3.5% +10.0% ➖ noise
16 duckdb:duckdb +4.3% +9.7% -4.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +8.7% +9.7% -0.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +6.6% +5.9% +0.6% +10.0% ➖ noise
17 duckdb:duckdb +2.3% +5.9% -3.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +8.2% +5.9% +2.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +9.6% +4.7% +4.7% +10.0% ➖ noise
18 duckdb:duckdb +4.2% +4.7% -0.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +6.5% +4.7% +1.7% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +28.0% +1.7% +25.9% +36.5% ➖ noise
19 duckdb:duckdb -10.5% +1.7% -12.0% +17.6% ➖ noise
19 duckdb:vortex-file-compressed +2.3% +1.7% +0.6% +26.3% ➖ noise
20 datafusion:vortex-file-compressed +2.6% +4.7% -2.0% +197.2% ➖ noise
20 duckdb:duckdb +2.4% +4.7% -2.2% +84.7% ➖ noise
20 duckdb:vortex-file-compressed -1.5% +4.7% -5.9% +75.6% ➖ noise
21 datafusion:vortex-file-compressed +3.6% +4.4% -0.7% +10.0% ➖ noise
21 duckdb:duckdb -1.0% +4.4% -5.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +9.3% +4.4% +4.7% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +7.8% +6.3% +1.3% +11.3% ➖ noise
22 duckdb:duckdb +7.9% +6.3% +1.4% +45.2% ➖ noise
22 duckdb:vortex-file-compressed -12.4% +6.3% -17.6% +10.0% ✅ faster
23 datafusion:vortex-file-compressed -0.6% +4.2% -4.6% +44.1% ➖ noise
23 duckdb:duckdb +0.8% +4.2% -3.3% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +17.7% +4.2% +12.9% +23.0% ➖ noise
24 datafusion:vortex-file-compressed +11.1% -1.8% +13.2% +19.7% ➖ noise
24 duckdb:duckdb -3.6% -1.8% -1.8% +33.8% ➖ noise
24 duckdb:vortex-file-compressed +18.7% -1.8% +20.9% +21.7% ➖ noise
25 datafusion:vortex-file-compressed -1.4% +4.3% -5.5% +12.2% ➖ noise
25 duckdb:duckdb -0.1% +4.3% -4.2% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +2.3% +4.3% -1.9% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +0.3% -0.8% +1.2% +10.5% ➖ noise
26 duckdb:duckdb -0.6% -0.8% +0.2% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +19.2% -0.8% +20.2% +11.0% 🚨 regression
27 datafusion:vortex-file-compressed +4.3% +3.1% +1.2% +10.0% ➖ noise
27 duckdb:duckdb +2.9% +3.1% -0.2% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -2.3% +3.1% -5.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.5% +2.6% -2.0% +10.0% ➖ noise
28 duckdb:duckdb +2.7% +2.6% +0.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +3.5% +2.6% +0.9% +11.8% ➖ noise
29 datafusion:vortex-file-compressed -4.1% +1.9% -5.9% +10.0% ➖ noise
29 duckdb:duckdb -5.4% +1.9% -7.2% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +8.1% +1.9% +6.1% +28.8% ➖ noise
30 datafusion:vortex-file-compressed +3.1% +4.8% -1.6% +10.9% ➖ noise
30 duckdb:duckdb +1.9% +4.8% -2.7% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +2.4% +4.8% -2.3% +11.2% ➖ noise
31 datafusion:vortex-file-compressed +5.6% +4.0% +1.6% +10.0% ➖ noise
31 duckdb:duckdb +2.1% +4.0% -1.8% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +3.5% +4.0% -0.5% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +11.0% +9.6% +1.2% +10.0% ➖ noise
32 duckdb:duckdb +3.7% +9.6% -5.4% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +6.2% +9.6% -3.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +8.1% +7.8% +0.3% +10.0% ➖ noise
33 duckdb:duckdb +7.8% +7.8% -0.1% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +7.6% +7.8% -0.2% +26.1% ➖ noise
34 datafusion:vortex-file-compressed +4.5% +7.4% -2.7% +10.0% ➖ noise
34 duckdb:duckdb +7.9% +7.4% +0.5% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +6.1% +7.4% -1.2% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +7.8% +6.4% +1.4% +10.0% ➖ noise
35 duckdb:duckdb +0.3% +6.4% -5.7% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +4.0% +6.4% -2.2% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +12.6% +15.7% -2.7% +11.7% ➖ noise
36 duckdb:duckdb +15.8% +15.7% +0.1% +19.5% ➖ noise
36 duckdb:vortex-file-compressed +18.2% +15.7% +2.1% +10.8% ➖ noise
37 datafusion:vortex-file-compressed +2.6% +1.5% +1.1% +14.2% ➖ noise
37 duckdb:duckdb -9.4% +1.5% -10.8% +12.4% ➖ noise
37 duckdb:vortex-file-compressed +31.3% +1.5% +29.3% +20.8% 🚨 regression
38 datafusion:vortex-file-compressed +8.9% +6.5% +2.2% +18.4% ➖ noise
38 duckdb:duckdb -6.2% +6.5% -12.0% +10.2% ✅ faster
38 duckdb:vortex-file-compressed +16.0% +6.5% +8.9% +12.1% ➖ noise
39 datafusion:vortex-file-compressed +12.9% +2.2% +10.4% +10.0% 🚨 regression
39 duckdb:duckdb -0.2% +2.2% -2.3% +20.4% ➖ noise
39 duckdb:vortex-file-compressed +12.1% +2.2% +9.7% +16.1% ➖ noise
40 datafusion:vortex-file-compressed +3.8% +4.1% -0.3% +18.7% ➖ noise
40 duckdb:duckdb -8.2% +4.1% -11.8% +10.0% ✅ faster
40 duckdb:vortex-file-compressed +19.3% +4.1% +14.6% +12.9% 🚨 regression
41 datafusion:vortex-file-compressed +10.6% +6.9% +3.5% +10.5% ➖ noise
41 duckdb:duckdb -7.8% +6.9% -13.7% +10.0% ✅ faster
41 duckdb:vortex-file-compressed +21.8% +6.9% +14.0% +10.0% 🚨 regression
42 datafusion:vortex-file-compressed +11.0% +4.3% +6.4% +12.1% ➖ noise
42 duckdb:duckdb -8.5% +4.3% -12.2% +10.0% ✅ faster
42 duckdb:vortex-file-compressed +26.3% +4.3% +21.2% +12.7% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.995x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 127052988 131718544 0.96
appian_q02/datafusion:vortex-file-compressed 661425682 663922838 1.00
appian_q03/datafusion:vortex-file-compressed 361627115 363969639 0.99
appian_q04/datafusion:vortex-file-compressed 27907111523 27914892421 1.00
appian_q05/datafusion:vortex-file-compressed 271861875 266419546 1.02
appian_q06/datafusion:vortex-file-compressed 418962286 420677364 1.00
appian_q07/datafusion:vortex-file-compressed 455484670 453174173 1.01
appian_q08/datafusion:vortex-file-compressed 1844604861 1848906301 1.00
datafusion / parquet (0.987x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
appian_q01/datafusion:parquet 128923996 134490335 0.96
appian_q02/datafusion:parquet 668663971 676056731 0.99
appian_q03/datafusion:parquet 353907270 359570647 0.98
appian_q04/datafusion:parquet 27806404308 27715605304 1.00
appian_q05/datafusion:parquet 290118685 296265997 0.98
appian_q06/datafusion:parquet 432142013 433034774 1.00
appian_q07/datafusion:parquet 453403762 460902302 0.98
appian_q08/datafusion:parquet 1845191917 1838630653 1.00
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 191238555 192728689 0.99
appian_q02/duckdb:vortex-file-compressed 616832307 609311274 1.01
appian_q03/duckdb:vortex-file-compressed 263288271 262490681 1.00
appian_q04/duckdb:vortex-file-compressed 1313837576 1323660522 0.99
appian_q05/duckdb:vortex-file-compressed 294951262 295375458 1.00
appian_q06/duckdb:vortex-file-compressed 791508746 803387461 0.99
appian_q07/duckdb:vortex-file-compressed 331593465 340246791 0.97
appian_q08/duckdb:vortex-file-compressed 1272236125 1279302856 0.99
duckdb / parquet (1.002x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
appian_q01/duckdb:parquet 200642817 200143803 1.00
appian_q02/duckdb:parquet 601144138 604897514 0.99
appian_q03/duckdb:parquet 289208541 286721680 1.01
appian_q04/duckdb:parquet 1328710016 1319886397 1.01
appian_q05/duckdb:parquet 313933006 309824213 1.01
appian_q06/duckdb:parquet 788127502 790494803 1.00
appian_q07/duckdb:parquet 363035165 364594589 1.00
appian_q08/duckdb:parquet 1265533658 1268501870 1.00
duckdb / duckdb (0.992x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 171881845 171558906 1.00
appian_q02/duckdb:duckdb 545115982 546610520 1.00
appian_q03/duckdb:duckdb 380300795 397423212 0.96
appian_q04/duckdb:duckdb 1287801433 1313547739 0.98
appian_q05/duckdb:duckdb 283703799 278544534 1.02
appian_q06/duckdb:duckdb 780792137 789681486 0.99
appian_q07/duckdb:duckdb 325655718 327264400 1.00
appian_q08/duckdb:duckdb 1220782417 1218192160 1.00

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 273.47 MB → 273.21 MB (-0.1%)
  • vortex-file-compressed: 529.70 MB → 529.70 MB (0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-file-compressed -3.5% -2.0% -1.6% +10.6% ➖ noise
1 duckdb:duckdb +0.2% -2.0% +2.2% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.8% -2.0% +1.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.4% -0.9% +0.5% +10.0% ➖ noise
2 duckdb:duckdb -0.3% -0.9% +0.6% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.2% -0.9% +2.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -0.6% -0.4% -0.3% +10.0% ➖ noise
3 duckdb:duckdb -4.3% -0.4% -4.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.3% -0.4% +0.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.0% +0.5% -0.5% +10.0% ➖ noise
4 duckdb:duckdb -2.0% +0.5% -2.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.7% +0.5% -1.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.0% -0.4% +2.4% +10.0% ➖ noise
5 duckdb:duckdb +1.9% -0.4% +2.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.1% -0.4% +0.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.4% -0.3% -0.2% +10.0% ➖ noise
6 duckdb:duckdb -1.1% -0.3% -0.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.5% -0.3% -1.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.5% -1.0% +1.6% +10.0% ➖ noise
7 duckdb:duckdb -0.5% -1.0% +0.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -2.5% -1.0% -1.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.2% +0.1% -0.3% +10.0% ➖ noise
8 duckdb:duckdb +0.2% +0.1% +0.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.6% +0.1% -0.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (-1.0%, environment too noisy confidence) · DuckDB No clear signal (-0.4%, environment too noisy confidence)
Vortex (geomean): 0.911x ➖
Parquet (geomean): 0.918x ➖
Shifts: Parquet (control) -8.2% · Median polish -11.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.802x ➖, 7↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 281000297 266481523 1.05
tpch_q02/datafusion:vortex-file-compressed 486483652 585294714 0.83
tpch_q03/datafusion:vortex-file-compressed 507244255 501341559 1.01
tpch_q04/datafusion:vortex-file-compressed 271221377 289173431 0.94
tpch_q05/datafusion:vortex-file-compressed 507230485 531989677 0.95
tpch_q06/datafusion:vortex-file-compressed 329137393 365124301 0.90
tpch_q07/datafusion:vortex-file-compressed 458365631 582078006 0.79
tpch_q08/datafusion:vortex-file-compressed 🚀 626189214 1045640075 0.60
tpch_q09/datafusion:vortex-file-compressed 🚀 451574976 706951748 0.64
tpch_q10/datafusion:vortex-file-compressed 🚀 487712647 787427584 0.62
tpch_q11/datafusion:vortex-file-compressed 297316923 366622190 0.81
tpch_q12/datafusion:vortex-file-compressed 🚀 429178097 727486390 0.59
tpch_q13/datafusion:vortex-file-compressed 🚀 163956748 276037986 0.59
tpch_q14/datafusion:vortex-file-compressed 🚀 227125170 381516076 0.60
tpch_q15/datafusion:vortex-file-compressed 🚀 416216259 628984639 0.66
tpch_q16/datafusion:vortex-file-compressed 201838594 254068374 0.79
tpch_q17/datafusion:vortex-file-compressed 443331503 497453648 0.89
tpch_q18/datafusion:vortex-file-compressed 444100884 483585544 0.92
tpch_q19/datafusion:vortex-file-compressed 499640245 570281041 0.88
tpch_q20/datafusion:vortex-file-compressed 461416192 491185100 0.94
tpch_q21/datafusion:vortex-file-compressed 631361071 603035126 1.05
tpch_q22/datafusion:vortex-file-compressed 124021549 134285465 0.92
datafusion / vortex-compact (0.846x ➖, 2↑ 1↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 293600093 308880393 0.95
tpch_q02/datafusion:vortex-compact 482124422 656374190 0.73
tpch_q03/datafusion:vortex-compact 424550964 509517988 0.83
tpch_q04/datafusion:vortex-compact 227665638 256020347 0.89
tpch_q05/datafusion:vortex-compact 448556765 587569734 0.76
tpch_q06/datafusion:vortex-compact 337104895 446315835 0.76
tpch_q07/datafusion:vortex-compact 🚀 428367205 658728555 0.65
tpch_q08/datafusion:vortex-compact 645175118 756123886 0.85
tpch_q09/datafusion:vortex-compact 548981179 596292540 0.92
tpch_q10/datafusion:vortex-compact 527603474 630998562 0.84
tpch_q11/datafusion:vortex-compact 289950726 332857953 0.87
tpch_q12/datafusion:vortex-compact 410673544 450895792 0.91
tpch_q13/datafusion:vortex-compact 🚀 123372772 194305855 0.63
tpch_q14/datafusion:vortex-compact 242236240 322519199 0.75
tpch_q15/datafusion:vortex-compact 424762623 564140178 0.75
tpch_q16/datafusion:vortex-compact 200290083 225604322 0.89
tpch_q17/datafusion:vortex-compact 380249894 488408075 0.78
tpch_q18/datafusion:vortex-compact 297462791 326779473 0.91
tpch_q19/datafusion:vortex-compact 488421539 549663524 0.89
tpch_q20/datafusion:vortex-compact 405736917 453524574 0.89
tpch_q21/datafusion:vortex-compact 591513866 581001172 1.02
tpch_q22/datafusion:vortex-compact 🚨 172685020 126057953 1.37
datafusion / parquet (0.832x ➖, 4↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 225450681 254252012 0.89
tpch_q02/datafusion:parquet 406644439 554041925 0.73
tpch_q03/datafusion:parquet 🚀 310488430 445854772 0.70
tpch_q04/datafusion:parquet 🚀 201392234 305289907 0.66
tpch_q05/datafusion:parquet 514866803 506679030 1.02
tpch_q06/datafusion:parquet 🚀 146300566 209961411 0.70
tpch_q07/datafusion:parquet 450032414 559798444 0.80
tpch_q08/datafusion:parquet 569743393 771589207 0.74
tpch_q09/datafusion:parquet 544855906 652491081 0.84
tpch_q10/datafusion:parquet 610672116 596127004 1.02
tpch_q11/datafusion:parquet 334430594 328769305 1.02
tpch_q12/datafusion:parquet 257645501 289659859 0.89
tpch_q13/datafusion:parquet 425291208 458414359 0.93
tpch_q14/datafusion:parquet 249133504 279195118 0.89
tpch_q15/datafusion:parquet 361603410 359580848 1.01
tpch_q16/datafusion:parquet 194034315 203347533 0.95
tpch_q17/datafusion:parquet 441138014 474289171 0.93
tpch_q18/datafusion:parquet 458828071 510540459 0.90
tpch_q19/datafusion:parquet 🚀 331618236 521688872 0.64
tpch_q20/datafusion:parquet 321045270 430501347 0.75
tpch_q21/datafusion:parquet 493399584 651090121 0.76
tpch_q22/datafusion:parquet 159864996 211966376 0.75
duckdb / vortex-file-compressed (1.048x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 252989018 277649293 0.91
tpch_q02/duckdb:vortex-file-compressed 986519780 1037180428 0.95
tpch_q03/duckdb:vortex-file-compressed 720211212 643485282 1.12
tpch_q04/duckdb:vortex-file-compressed 424382542 349568193 1.21
tpch_q05/duckdb:vortex-file-compressed 855831215 887632753 0.96
tpch_q06/duckdb:vortex-file-compressed 374708990 333692989 1.12
tpch_q07/duckdb:vortex-file-compressed 968130689 970709014 1.00
tpch_q08/duckdb:vortex-file-compressed 1124633156 1034011393 1.09
tpch_q09/duckdb:vortex-file-compressed 1006365156 932359849 1.08
tpch_q10/duckdb:vortex-file-compressed 801900605 749891557 1.07
tpch_q11/duckdb:vortex-file-compressed 493877813 500298130 0.99
tpch_q12/duckdb:vortex-file-compressed 691929932 726147060 0.95
tpch_q13/duckdb:vortex-file-compressed 437458062 409150601 1.07
tpch_q14/duckdb:vortex-file-compressed 402761769 401321600 1.00
tpch_q15/duckdb:vortex-file-compressed 346661751 267737668 1.29
tpch_q16/duckdb:vortex-file-compressed 385678543 351878411 1.10
tpch_q17/duckdb:vortex-file-compressed 794008383 620450828 1.28
tpch_q18/duckdb:vortex-file-compressed 589239706 649027347 0.91
tpch_q19/duckdb:vortex-file-compressed 521906159 617346141 0.85
tpch_q20/duckdb:vortex-file-compressed 768870936 784968128 0.98
tpch_q21/duckdb:vortex-file-compressed 1181052416 1137236010 1.04
tpch_q22/duckdb:vortex-file-compressed 313235224 257509966 1.22
duckdb / vortex-compact (0.970x ➖, 0↑ 1↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 320977033 372996608 0.86
tpch_q02/duckdb:vortex-compact 975898635 1039638026 0.94
tpch_q03/duckdb:vortex-compact 661226959 612295516 1.08
tpch_q04/duckdb:vortex-compact 374302317 435445291 0.86
tpch_q05/duckdb:vortex-compact 774980845 776693383 1.00
tpch_q06/duckdb:vortex-compact 353574595 424570050 0.83
tpch_q07/duckdb:vortex-compact 912643293 896365452 1.02
tpch_q08/duckdb:vortex-compact 1041909036 972823590 1.07
tpch_q09/duckdb:vortex-compact 988296222 1083260615 0.91
tpch_q10/duckdb:vortex-compact 642726595 758493796 0.85
tpch_q11/duckdb:vortex-compact 478280974 477508956 1.00
tpch_q12/duckdb:vortex-compact 651260040 715386467 0.91
tpch_q13/duckdb:vortex-compact 380075856 436991284 0.87
tpch_q14/duckdb:vortex-compact 455735853 444705786 1.02
tpch_q15/duckdb:vortex-compact 292611092 321580284 0.91
tpch_q16/duckdb:vortex-compact 309307057 325530398 0.95
tpch_q17/duckdb:vortex-compact 716234764 643240630 1.11
tpch_q18/duckdb:vortex-compact 467302793 557674164 0.84
tpch_q19/duckdb:vortex-compact 530811839 485254821 1.09
tpch_q20/duckdb:vortex-compact 🚨 1068965633 782088576 1.37
tpch_q21/duckdb:vortex-compact 910993034 1035093550 0.88
tpch_q22/duckdb:vortex-compact 318718389 281724306 1.13
duckdb / parquet (1.012x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 444026271 461728436 0.96
tpch_q02/duckdb:parquet 1182714335 1025746348 1.15
tpch_q03/duckdb:parquet 944796503 1054158750 0.90
tpch_q04/duckdb:parquet 658733803 695474353 0.95
tpch_q05/duckdb:parquet 1297548748 1206055677 1.08
tpch_q06/duckdb:parquet 501517258 410740769 1.22
tpch_q07/duckdb:parquet 1205802442 1149314774 1.05
tpch_q08/duckdb:parquet 1489371652 1717064791 0.87
tpch_q09/duckdb:parquet 1400002435 1417889044 0.99
tpch_q10/duckdb:parquet 1335256753 1296015069 1.03
tpch_q11/duckdb:parquet 723161860 666614891 1.08
tpch_q12/duckdb:parquet 726752716 711894670 1.02
tpch_q13/duckdb:parquet 939721453 917475738 1.02
tpch_q14/duckdb:parquet 699317094 662558216 1.06
tpch_q15/duckdb:parquet 536878915 506800704 1.06
tpch_q16/duckdb:parquet 678440709 677141334 1.00
tpch_q17/duckdb:parquet 855392546 858231563 1.00
tpch_q18/duckdb:parquet 910709644 927010216 0.98
tpch_q19/duckdb:parquet 861942449 875202435 0.98
tpch_q20/duckdb:parquet 1214255958 1215334678 1.00
tpch_q21/duckdb:parquet 1162319344 1175228365 0.99
tpch_q22/duckdb:parquet 579125632 617139935 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -4.9% -7.7% +2.9% +72.4% ➖ noise
1 datafusion:vortex-file-compressed +5.4% -7.7% +14.2% +60.2% ➖ noise
1 duckdb:vortex-compact -13.9% -7.7% -6.8% +42.0% ➖ noise
1 duckdb:vortex-file-compressed -8.9% -7.7% -1.3% +46.4% ➖ noise
2 datafusion:vortex-compact -26.5% -8.0% -20.2% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -16.9% -8.0% -9.6% +31.6% ➖ noise
2 duckdb:vortex-compact -6.1% -8.0% +2.0% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -4.9% -8.0% +3.4% +30.0% ➖ noise
3 datafusion:vortex-compact -16.7% -21.0% +5.5% +48.1% ➖ noise
3 datafusion:vortex-file-compressed +1.2% -21.0% +28.1% +52.9% ➖ noise
3 duckdb:vortex-compact +8.0% -21.0% +36.7% +32.2% 🚨 regression
3 duckdb:vortex-file-compressed +11.9% -21.0% +41.7% +32.0% 🚨 regression
4 datafusion:vortex-compact -11.1% -21.0% +12.5% +46.0% ➖ noise
4 datafusion:vortex-file-compressed -6.2% -21.0% +18.7% +34.9% ➖ noise
4 duckdb:vortex-compact -14.0% -21.0% +8.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +21.4% -21.0% +53.6% +31.4% 🚨 regression
5 datafusion:vortex-compact -23.7% +4.6% -27.0% +30.0% ✅ faster
5 datafusion:vortex-file-compressed -4.7% +4.6% -8.8% +30.0% ➖ noise
5 duckdb:vortex-compact -0.2% +4.6% -4.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -3.6% +4.6% -7.8% +30.0% ➖ noise
6 datafusion:vortex-compact -24.5% -7.8% -18.1% +35.2% ➖ noise
6 datafusion:vortex-file-compressed -9.9% -7.8% -2.3% +30.0% ➖ noise
6 duckdb:vortex-compact -16.7% -7.8% -9.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +12.3% -7.8% +21.7% +30.0% ➖ noise
7 datafusion:vortex-compact -35.0% -8.2% -29.2% +34.6% ✅ faster
7 datafusion:vortex-file-compressed -21.3% -8.2% -14.3% +30.0% ➖ noise
7 duckdb:vortex-compact +1.8% -8.2% +10.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -0.3% -8.2% +8.6% +30.0% ➖ noise
8 datafusion:vortex-compact -14.7% -20.0% +6.6% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -40.1% -20.0% -25.2% +40.2% ➖ noise
8 duckdb:vortex-compact +7.1% -20.0% +33.8% +30.0% 🚨 regression
8 duckdb:vortex-file-compressed +8.8% -20.0% +35.9% +30.0% 🚨 regression
9 datafusion:vortex-compact -7.9% -9.2% +1.4% +42.1% ➖ noise
9 datafusion:vortex-file-compressed -36.1% -9.2% -29.7% +30.0% ✅ faster
9 duckdb:vortex-compact -8.8% -9.2% +0.5% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +7.9% -9.2% +18.9% +30.0% ➖ noise
10 datafusion:vortex-compact -16.4% +2.7% -18.6% +30.5% ➖ noise
10 datafusion:vortex-file-compressed -38.1% +2.7% -39.7% +30.0% ✅ faster
10 duckdb:vortex-compact -15.3% +2.7% -17.5% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +6.9% +2.7% +4.1% +30.0% ➖ noise
11 datafusion:vortex-compact -12.9% +5.0% -17.1% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -18.9% +5.0% -22.8% +30.0% ➖ noise
11 duckdb:vortex-compact +0.2% +5.0% -4.7% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -1.3% +5.0% -6.0% +30.0% ➖ noise
12 datafusion:vortex-compact -8.9% -4.7% -4.4% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -41.0% -4.7% -38.1% +30.0% ✅ faster
12 duckdb:vortex-compact -9.0% -4.7% -4.5% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -4.7% -4.7% -0.0% +30.0% ➖ noise
13 datafusion:vortex-compact -36.5% -2.5% -34.9% +38.0% ✅ faster
13 datafusion:vortex-file-compressed -40.6% -2.5% -39.1% +33.3% ✅ faster
13 duckdb:vortex-compact -13.0% -2.5% -10.8% +32.8% ➖ noise
13 duckdb:vortex-file-compressed +6.9% -2.5% +9.7% +31.5% ➖ noise
14 datafusion:vortex-compact -24.9% -3.0% -22.6% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -40.5% -3.0% -38.7% +30.0% ✅ faster
14 duckdb:vortex-compact +2.5% -3.0% +5.6% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +0.4% -3.0% +3.4% +30.0% ➖ noise
15 datafusion:vortex-compact -24.7% +3.2% -27.1% +30.0% ✅ faster
15 datafusion:vortex-file-compressed -33.8% +3.2% -35.9% +30.0% ✅ faster
15 duckdb:vortex-compact -9.0% +3.2% -11.8% +36.9% ➖ noise
15 duckdb:vortex-file-compressed +29.5% +3.2% +25.4% +30.0% ➖ noise
16 datafusion:vortex-compact -11.2% -2.2% -9.2% +34.7% ➖ noise
16 datafusion:vortex-file-compressed -20.6% -2.2% -18.8% +35.5% ➖ noise
16 duckdb:vortex-compact -5.0% -2.2% -2.8% +41.0% ➖ noise
16 duckdb:vortex-file-compressed +9.6% -2.2% +12.1% +30.0% ➖ noise
17 datafusion:vortex-compact -22.1% -3.7% -19.1% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -10.9% -3.7% -7.4% +30.0% ➖ noise
17 duckdb:vortex-compact +11.3% -3.7% +15.6% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +28.0% -3.7% +32.9% +30.0% 🚨 regression
18 datafusion:vortex-compact -9.0% -6.0% -3.1% +34.1% ➖ noise
18 datafusion:vortex-file-compressed -8.2% -6.0% -2.3% +30.0% ➖ noise
18 duckdb:vortex-compact -16.2% -6.0% -10.8% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -9.2% -6.0% -3.4% +30.0% ➖ noise
19 datafusion:vortex-compact -11.1% -20.9% +12.3% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -12.4% -20.9% +10.7% +30.0% ➖ noise
19 duckdb:vortex-compact +9.4% -20.9% +38.3% +30.0% 🚨 regression
19 duckdb:vortex-file-compressed -15.5% -20.9% +6.8% +30.0% ➖ noise
20 datafusion:vortex-compact -10.5% -13.7% +3.6% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -6.1% -13.7% +8.8% +30.0% ➖ noise
20 duckdb:vortex-compact +36.7% -13.7% +58.3% +30.0% 🚨 regression
20 duckdb:vortex-file-compressed -2.1% -13.7% +13.5% +30.0% ➖ noise
21 datafusion:vortex-compact +1.8% -13.4% +17.6% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +4.7% -13.4% +20.9% +30.0% ➖ noise
21 duckdb:vortex-compact -12.0% -13.4% +1.7% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +3.9% -13.4% +20.0% +30.0% ➖ noise
22 datafusion:vortex-compact +37.0% -15.9% +62.8% +40.4% 🚨 regression
22 datafusion:vortex-file-compressed -7.6% -15.9% +9.8% +39.2% ➖ noise
22 duckdb:vortex-compact +13.1% -15.9% +34.5% +30.0% 🚨 regression
22 duckdb:vortex-file-compressed +21.6% -15.9% +44.6% +30.0% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: Compression

Vortex (geomean): 0.996x ➖
Parquet (geomean): 0.996x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (0.994x ➖, 0↑ 0↓)
name PR f105d74 (ns) base d44240e (ns) ratio (PR/base)
compress time/Arade 1091278167 1113590212 0.98
compress time/Bimbo 5622218145 5773016984 0.97
compress time/CMSprovider 2763056314 2766266746 1.00
compress time/Euro2016 410557507 424531893 0.97
compress time/Food 358650100 365984195 0.98
compress time/HashTags 789437980 782374439 1.01
compress time/TPC-H l_comment canonical 1216803749 1191985704 1.02
compress time/TPC-H l_comment chunked 1190726898 1214199784 0.98
compress time/taxi 665783365 679872195 0.98
compress time/wide table cols=100 chunks=1 rows=1000 11249560 11163814 1.01
compress time/wide table cols=100 chunks=50 rows=1000 11130473 11850026 0.94
compress time/wide table cols=1000 chunks=1 rows=1000 123598294 126044098 0.98
compress time/wide table cols=1000 chunks=50 rows=1000 128892481 132367978 0.97
compress time/wide table cols=10000 chunks=1 rows=1000 1444706907 1455005312 0.99
compress time/wide table cols=10000 chunks=50 rows=1000 1442518190 1465840362 0.98
decompress time/Arade 28439484 26701675 1.07
decompress time/Bimbo 77955750 78580367 0.99
decompress time/CMSprovider 79194511 76874968 1.03
decompress time/Euro2016 19170781 19026994 1.01
decompress time/Food 8099421 8386147 0.97
decompress time/HashTags 89676257 87846332 1.02
decompress time/TPC-H l_comment canonical 38978289 39490405 0.99
decompress time/TPC-H l_comment chunked 39112124 40036118 0.98
decompress time/taxi 14195914 15132901 0.94
decompress time/wide table cols=100 chunks=1 rows=1000 2558413 2514249 1.02
decompress time/wide table cols=100 chunks=50 rows=1000 2454278 2661395 0.92
decompress time/wide table cols=1000 chunks=1 rows=1000 23221666 22493176 1.03
decompress time/wide table cols=1000 chunks=50 rows=1000 23053198 24017031 0.96
decompress time/wide table cols=10000 chunks=1 rows=1000 247519828 251843906 0.98
decompress time/wide table cols=10000 chunks=50 rows=1000 244579989 254339089 0.96
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2610821901 2583677197 1.01
parquet_rs-zstd compress time/Bimbo 12515399143 12585207171 0.99
parquet_rs-zstd compress time/CMSprovider 6919695889 6863464132 1.01
parquet_rs-zstd compress time/Euro2016 1296348917 1316990257 0.98
parquet_rs-zstd compress time/Food 788890366 804735036 0.98
parquet_rs-zstd compress time/HashTags 2157273663 2159977514 1.00
parquet_rs-zstd compress time/TPC-H l_comment canonical 3152583061 3217261650 0.98
parquet_rs-zstd compress time/TPC-H l_comment chunked 3178644476 3211141909 0.99
parquet_rs-zstd compress time/taxi 1197250620 1184275974 1.01
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6130682 6089905 1.01
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6076430 6057781 1.00
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 74326858 73354321 1.01
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 73200728 75176436 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 769890017 787996783 0.98
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 765181560 781988230 0.98
parquet_rs-zstd decompress time/Arade 620435796 625435631 0.99
parquet_rs-zstd decompress time/Bimbo 1676366314 1700262832 0.99
parquet_rs-zstd decompress time/CMSprovider 1683350442 1692497143 0.99
parquet_rs-zstd decompress time/Euro2016 371521388 373479991 0.99
parquet_rs-zstd decompress time/Food 193935213 195777897 0.99
parquet_rs-zstd decompress time/HashTags 630976613 632996470 1.00
parquet_rs-zstd decompress time/TPC-H l_comment canonical 583238339 582523909 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked 588912212 590071350 1.00
parquet_rs-zstd decompress time/taxi 243910254 242703894 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2837033 2831432 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2847595 2811844 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32280854 31651471 1.02
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32344633 33426912 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 348012714 347412934 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 347895489 348790348 1.00
vortex-file-compressed size/Arade 145363828 145363828 1.00
vortex-file-compressed size/Bimbo 468763364 468763364 1.00
vortex-file-compressed size/CMSprovider 417907844 417907844 1.00
vortex-file-compressed size/Euro2016 163395324 163395324 1.00
vortex-file-compressed size/Food 41926968 41926968 1.00
vortex-file-compressed size/HashTags 195647860 195647860 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087392 179087392 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087392 179087392 1.00
vortex-file-compressed size/taxi 52363980 52363980 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957680 92957680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957680 92957680 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.97
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.98
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.99
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio compress time/Food 0 0 1.00
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.04
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.99
vortex:parquet-zstd ratio compress time/taxi 0 0 0.97
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.94
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.07
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.04
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio decompress time/Food 0 0 0.97
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.02
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.96
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 29, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.7%
Engines: DataFusion No clear signal (+10.2%, environment too noisy confidence) · DuckDB No clear signal (-2.5%, environment too noisy confidence)
Vortex (geomean): 1.042x ➖
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.060x ➖, 0↑ 1↓)
name PR f105d74 (ns) base 7e8f23a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 669944355 704369109 0.95
tpch_q02/datafusion:vortex-file-compressed 772262062 856085817 0.90
tpch_q03/datafusion:vortex-file-compressed 865176487 816312519 1.06
tpch_q04/datafusion:vortex-file-compressed 599169857 600293976 1.00
tpch_q05/datafusion:vortex-file-compressed 1006263993 976902332 1.03
tpch_q06/datafusion:vortex-file-compressed 573039565 583244577 0.98
tpch_q07/datafusion:vortex-file-compressed 1197389611 1185381554 1.01
tpch_q08/datafusion:vortex-file-compressed 1320498248 1198049653 1.10
tpch_q09/datafusion:vortex-file-compressed 1363005679 1475743604 0.92
tpch_q10/datafusion:vortex-file-compressed 998118054 1045290216 0.95
tpch_q11/datafusion:vortex-file-compressed 592542557 545144715 1.09
tpch_q12/datafusion:vortex-file-compressed 1266844302 1008847465 1.26
tpch_q13/datafusion:vortex-file-compressed 506274226 453688980 1.12
tpch_q14/datafusion:vortex-file-compressed 613257047 526660260 1.16
tpch_q15/datafusion:vortex-file-compressed 1065117862 978606658 1.09
tpch_q16/datafusion:vortex-file-compressed 435415841 365812308 1.19
tpch_q17/datafusion:vortex-file-compressed 1187755019 1177841538 1.01
tpch_q18/datafusion:vortex-file-compressed 1338119965 1308630947 1.02
tpch_q19/datafusion:vortex-file-compressed 992565467 790990307 1.25
tpch_q20/datafusion:vortex-file-compressed 🚨 1317805377 882076887 1.49
tpch_q21/datafusion:vortex-file-compressed 1756749620 1640158789 1.07
tpch_q22/datafusion:vortex-file-compressed 407392465 484177476 0.84
datafusion / vortex-compact (1.114x ➖, 0↑ 4↓)
name PR f105d74 (ns) base 7e8f23a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 695343755 671926614 1.03
tpch_q02/datafusion:vortex-compact 763649660 626603395 1.22
tpch_q03/datafusion:vortex-compact 765095946 723388535 1.06
tpch_q04/datafusion:vortex-compact 553182508 520297292 1.06
tpch_q05/datafusion:vortex-compact 1065347930 870583984 1.22
tpch_q06/datafusion:vortex-compact 622135747 573023030 1.09
tpch_q07/datafusion:vortex-compact 967326431 1017226532 0.95
tpch_q08/datafusion:vortex-compact 1117538227 1149086553 0.97
tpch_q09/datafusion:vortex-compact 1461370285 1199741917 1.22
tpch_q10/datafusion:vortex-compact 🚨 1227297351 881156948 1.39
tpch_q11/datafusion:vortex-compact 386722087 392027989 0.99
tpch_q12/datafusion:vortex-compact 871231825 737585589 1.18
tpch_q13/datafusion:vortex-compact 419659932 409845019 1.02
tpch_q14/datafusion:vortex-compact 533388653 499443152 1.07
tpch_q15/datafusion:vortex-compact 1015906009 924727529 1.10
tpch_q16/datafusion:vortex-compact 🚨 487633136 350141857 1.39
tpch_q17/datafusion:vortex-compact 1174000367 1292967485 0.91
tpch_q18/datafusion:vortex-compact 1141132975 1365258288 0.84
tpch_q19/datafusion:vortex-compact 849016546 798736738 1.06
tpch_q20/datafusion:vortex-compact 🚨 1027389627 777973804 1.32
tpch_q21/datafusion:vortex-compact 1582314746 1428708442 1.11
tpch_q22/datafusion:vortex-compact 🚨 563063486 358675844 1.57
datafusion / parquet (0.986x ➖, 0↑ 1↓)
name PR f105d74 (ns) base 7e8f23a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 817566580 850876373 0.96
tpch_q02/datafusion:parquet 793765214 845727359 0.94
tpch_q03/datafusion:parquet 883450150 979271604 0.90
tpch_q04/datafusion:parquet 457692122 482047518 0.95
tpch_q05/datafusion:parquet 1064791950 1141043020 0.93
tpch_q06/datafusion:parquet 500802245 536887383 0.93
tpch_q07/datafusion:parquet 1271568685 1461456758 0.87
tpch_q08/datafusion:parquet 1708997303 1521450142 1.12
tpch_q09/datafusion:parquet 1830073649 1789701462 1.02
tpch_q10/datafusion:parquet 1989970901 1970508664 1.01
tpch_q11/datafusion:parquet 🚨 759236115 567062874 1.34
tpch_q12/datafusion:parquet 603671729 596318182 1.01
tpch_q13/datafusion:parquet 703251114 717152963 0.98
tpch_q14/datafusion:parquet 760011814 872626573 0.87
tpch_q15/datafusion:parquet 1223060411 1374164215 0.89
tpch_q16/datafusion:parquet 428875972 362288120 1.18
tpch_q17/datafusion:parquet 1350822507 1458963443 0.93
tpch_q18/datafusion:parquet 1655742303 1679304413 0.99
tpch_q19/datafusion:parquet 967609516 928912492 1.04
tpch_q20/datafusion:parquet 1257282854 1164197461 1.08
tpch_q21/datafusion:parquet 1852961319 1852222903 1.00
tpch_q22/datafusion:parquet 927645324 1079948153 0.86
duckdb / vortex-file-compressed (0.996x ➖, 0↑ 0↓)
name PR f105d74 (ns) base 7e8f23a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 621093243 643900483 0.96
tpch_q02/duckdb:vortex-file-compressed 1197309463 1244891200 0.96
tpch_q03/duckdb:vortex-file-compressed 887339411 1076195499 0.82
tpch_q04/duckdb:vortex-file-compressed 831551944 822546312 1.01
tpch_q05/duckdb:vortex-file-compressed 1200389940 1280067040 0.94
tpch_q06/duckdb:vortex-file-compressed 552600394 612580456 0.90
tpch_q07/duckdb:vortex-file-compressed 1345895674 1333889803 1.01
tpch_q08/duckdb:vortex-file-compressed 1772190233 1552105645 1.14
tpch_q09/duckdb:vortex-file-compressed 1733764885 1981445237 0.88
tpch_q10/duckdb:vortex-file-compressed 1345312742 1285640878 1.05
tpch_q11/duckdb:vortex-file-compressed 753578336 646390609 1.17
tpch_q12/duckdb:vortex-file-compressed 1440351014 1348803387 1.07
tpch_q13/duckdb:vortex-file-compressed 957825422 946326103 1.01
tpch_q14/duckdb:vortex-file-compressed 637236736 731049048 0.87
tpch_q15/duckdb:vortex-file-compressed 596260713 624443061 0.95
tpch_q16/duckdb:vortex-file-compressed 613146963 585219005 1.05
tpch_q17/duckdb:vortex-file-compressed 1105436671 1039148369 1.06
tpch_q18/duckdb:vortex-file-compressed 970000380 984633965 0.99
tpch_q19/duckdb:vortex-file-compressed 866250086 873572159 0.99
tpch_q20/duckdb:vortex-file-compressed 1460732628 1390718737 1.05
tpch_q21/duckdb:vortex-file-compressed 2197760610 2170789011 1.01
tpch_q22/duckdb:vortex-file-compressed 512225808 468039721 1.09
duckdb / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR f105d74 (ns) base 7e8f23a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 609618952 641969960 0.95
tpch_q02/duckdb:vortex-compact 1121289938 1248884719 0.90
tpch_q03/duckdb:vortex-compact 961579370 894618619 1.07
tpch_q04/duckdb:vortex-compact 609382305 610546005 1.00
tpch_q05/duckdb:vortex-compact 1190071512 1232564007 0.97
tpch_q06/duckdb:vortex-compact 602088146 544761919 1.11
tpch_q07/duckdb:vortex-compact 1094646486 1213235294 0.90
tpch_q08/duckdb:vortex-compact 1420490291 1494044324 0.95
tpch_q09/duckdb:vortex-compact 1601739929 1586433680 1.01
tpch_q10/duckdb:vortex-compact 1201276897 1238401602 0.97
tpch_q11/duckdb:vortex-compact 789933988 760917981 1.04
tpch_q12/duckdb:vortex-compact 1145764888 1143431705 1.00
tpch_q13/duckdb:vortex-compact 848039537 892129801 0.95
tpch_q14/duckdb:vortex-compact 623394001 658774795 0.95
tpch_q15/duckdb:vortex-compact 563592845 557088633 1.01
tpch_q16/duckdb:vortex-compact 451900078 479560998 0.94
tpch_q17/duckdb:vortex-compact 987182495 934998470 1.06
tpch_q18/duckdb:vortex-compact 827056138 858141642 0.96
tpch_q19/duckdb:vortex-compact 768089211 771716370 1.00
tpch_q20/duckdb:vortex-compact 1377302488 1146722793 1.20
tpch_q21/duckdb:vortex-compact 1808877463 1848848215 0.98
tpch_q22/duckdb:vortex-compact 464885901 379414875 1.23
duckdb / parquet (1.025x ➖, 0↑ 1↓)
name PR f105d74 (ns) base 7e8f23a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 986508700 803118851 1.23
tpch_q02/duckdb:parquet 1348160546 1216964079 1.11
tpch_q03/duckdb:parquet 2014174858 1773558436 1.14
tpch_q04/duckdb:parquet 🚨 1331692238 1011875835 1.32
tpch_q05/duckdb:parquet 2029117207 2110236755 0.96
tpch_q06/duckdb:parquet 897971549 1053977392 0.85
tpch_q07/duckdb:parquet 1898034810 2005213419 0.95
tpch_q08/duckdb:parquet 2443657104 2583746954 0.95
tpch_q09/duckdb:parquet 2760647137 2505776178 1.10
tpch_q10/duckdb:parquet 3380476258 3118647772 1.08
tpch_q11/duckdb:parquet 946087778 1002920682 0.94
tpch_q12/duckdb:parquet 1484801262 1336952867 1.11
tpch_q13/duckdb:parquet 1417170350 1526876825 0.93
tpch_q14/duckdb:parquet 1355436958 1504757544 0.90
tpch_q15/duckdb:parquet 930085734 933383284 1.00
tpch_q16/duckdb:parquet 1060238720 880991224 1.20
tpch_q17/duckdb:parquet 1580893903 1369881681 1.15
tpch_q18/duckdb:parquet 1704807782 1755096027 0.97
tpch_q19/duckdb:parquet 1566762346 1703629029 0.92
tpch_q20/duckdb:parquet 2042038509 2080764534 0.98
tpch_q21/duckdb:parquet 1964609368 1965056478 1.00
tpch_q22/duckdb:parquet 1064917002 1176922558 0.90
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +3.5% +8.6% -4.7% +40.9% ➖ noise
1 datafusion:vortex-file-compressed -4.9% +8.6% -12.5% +40.7% ➖ noise
1 duckdb:vortex-compact -5.0% +8.6% -12.6% +32.0% ➖ noise
1 duckdb:vortex-file-compressed -3.5% +8.6% -11.2% +30.5% ➖ noise
2 datafusion:vortex-compact +21.9% +2.0% +19.5% +40.9% ➖ noise
2 datafusion:vortex-file-compressed -9.8% +2.0% -11.5% +39.0% ➖ noise
2 duckdb:vortex-compact -10.2% +2.0% -11.9% +38.4% ➖ noise
2 duckdb:vortex-file-compressed -3.8% +2.0% -5.7% +36.3% ➖ noise
3 datafusion:vortex-compact +5.8% +1.2% +4.5% +41.8% ➖ noise
3 datafusion:vortex-file-compressed +6.0% +1.2% +4.7% +43.9% ➖ noise
3 duckdb:vortex-compact +7.5% +1.2% +6.2% +34.2% ➖ noise
3 duckdb:vortex-file-compressed -17.5% +1.2% -18.5% +44.4% ➖ noise
4 datafusion:vortex-compact +6.3% +11.8% -4.9% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.2% +11.8% -10.7% +30.0% ➖ noise
4 duckdb:vortex-compact -0.2% +11.8% -10.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +1.1% +11.8% -9.6% +30.0% ➖ noise
5 datafusion:vortex-compact +22.4% -5.3% +29.2% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +3.0% -5.3% +8.7% +30.0% ➖ noise
5 duckdb:vortex-compact -3.4% -5.3% +1.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -6.2% -5.3% -1.0% +30.0% ➖ noise
6 datafusion:vortex-compact +8.6% -10.9% +21.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -1.7% -10.9% +10.2% +30.0% ➖ noise
6 duckdb:vortex-compact +10.5% -10.9% +24.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -9.8% -10.9% +1.2% +30.0% ➖ noise
7 datafusion:vortex-compact -4.9% -9.2% +4.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +1.0% -9.2% +11.3% +30.0% ➖ noise
7 duckdb:vortex-compact -9.8% -9.2% -0.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +0.9% -9.2% +11.2% +30.0% ➖ noise
8 datafusion:vortex-compact -2.7% +3.1% -5.6% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +10.2% +3.1% +6.9% +30.0% ➖ noise
8 duckdb:vortex-compact -4.9% +3.1% -7.8% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +14.2% +3.1% +10.8% +30.0% ➖ noise
9 datafusion:vortex-compact +21.8% +6.1% +14.8% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -7.6% +6.1% -13.0% +30.0% ➖ noise
9 duckdb:vortex-compact +1.0% +6.1% -4.9% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -12.5% +6.1% -17.6% +30.0% ➖ noise
10 datafusion:vortex-compact +39.3% +4.6% +33.1% +30.0% 🚨 regression
10 datafusion:vortex-file-compressed -4.5% +4.6% -8.7% +30.0% ➖ noise
10 duckdb:vortex-compact -3.0% +4.6% -7.3% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +4.6% +4.6% +0.0% +30.0% ➖ noise
11 datafusion:vortex-compact -1.4% +12.4% -12.2% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +8.7% +12.4% -3.3% +34.8% ➖ noise
11 duckdb:vortex-compact +3.8% +12.4% -7.6% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +16.6% +12.4% +3.7% +30.0% ➖ noise
12 datafusion:vortex-compact +18.1% +6.0% +11.4% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +25.6% +6.0% +18.4% +30.0% ➖ noise
12 duckdb:vortex-compact +0.2% +6.0% -5.5% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +6.8% +6.0% +0.7% +30.0% ➖ noise
13 datafusion:vortex-compact +2.4% -4.6% +7.3% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +11.6% -4.6% +17.0% +30.0% ➖ noise
13 duckdb:vortex-compact -4.9% -4.6% -0.4% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +1.2% -4.6% +6.1% +30.0% ➖ noise
14 datafusion:vortex-compact +6.8% -11.4% +20.6% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +16.4% -11.4% +31.5% +30.0% 🚨 regression
14 duckdb:vortex-compact -5.4% -11.4% +6.8% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -12.8% -11.4% -1.6% +30.0% ➖ noise
15 datafusion:vortex-compact +9.9% -5.8% +16.7% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +8.8% -5.8% +15.6% +30.0% ➖ noise
15 duckdb:vortex-compact +1.2% -5.8% +7.4% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -4.5% -5.8% +1.4% +30.0% ➖ noise
16 datafusion:vortex-compact +39.3% +19.4% +16.7% +34.4% ➖ noise
16 datafusion:vortex-file-compressed +19.0% +19.4% -0.3% +30.0% ➖ noise
16 duckdb:vortex-compact -5.8% +19.4% -21.1% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +4.8% +19.4% -12.2% +30.0% ➖ noise
17 datafusion:vortex-compact -9.2% +3.4% -12.2% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +0.8% +3.4% -2.4% +30.0% ➖ noise
17 duckdb:vortex-compact +5.6% +3.4% +2.1% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +6.4% +3.4% +2.9% +30.0% ➖ noise
18 datafusion:vortex-compact -16.4% -2.1% -14.6% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +2.3% -2.1% +4.5% +30.0% ➖ noise
18 duckdb:vortex-compact -3.6% -2.1% -1.5% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -1.5% -2.1% +0.7% +30.0% ➖ noise
19 datafusion:vortex-compact +6.3% -2.1% +8.6% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +25.5% -2.1% +28.2% +30.0% ➖ noise
19 duckdb:vortex-compact -0.5% -2.1% +1.7% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -0.8% -2.1% +1.3% +30.0% ➖ noise
20 datafusion:vortex-compact +32.1% +2.9% +28.3% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +49.4% +2.9% +45.1% +30.0% 🚨 regression
20 duckdb:vortex-compact +20.1% +2.9% +16.7% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +5.0% +2.9% +2.0% +30.0% ➖ noise
21 datafusion:vortex-compact +10.8% +0.0% +10.7% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +7.1% +0.0% +7.1% +30.0% ➖ noise
21 duckdb:vortex-compact -2.2% +0.0% -2.2% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +1.2% +0.0% +1.2% +30.0% ➖ noise
22 datafusion:vortex-compact +57.0% -11.8% +78.1% +30.7% 🚨 regression
22 datafusion:vortex-file-compressed -15.9% -11.8% -4.6% +30.0% ➖ noise
22 duckdb:vortex-compact +22.5% -11.8% +39.0% +30.0% 🚨 regression
22 duckdb:vortex-file-compressed +9.4% -11.8% +24.1% +30.0% ➖ noise

Comment thread vortex-compressor/src/stats/cache.rs Outdated
Comment thread vortex-compressor/src/stats/varbinview.rs
Copy link
Copy Markdown
Contributor

@connortsui20 connortsui20 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice

AdamGS added 2 commits May 29, 2026 14:49
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/binary-compressor branch from f7b2b1c to f105d74 Compare May 29, 2026 13:50
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label May 29, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 29, 2026
@AdamGS AdamGS merged commit 084f327 into develop May 29, 2026
79 of 80 checks passed
@AdamGS AdamGS deleted the adamg/binary-compressor branch May 29, 2026 14:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants