Skip to content

Refactor: Split monolithic scheme files into modular submodules#8207

Merged
joseph-isaacs merged 3 commits into
developfrom
claude/btrblocks-scheme-modules-QoTPX
Jun 2, 2026
Merged

Refactor: Split monolithic scheme files into modular submodules#8207
joseph-isaacs merged 3 commits into
developfrom
claude/btrblocks-scheme-modules-QoTPX

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs commented Jun 2, 2026

Summary

This PR refactors the compression scheme implementations in vortex-btrblocks by splitting large monolithic files into smaller, focused modules organized by data type and encoding strategy.

The integer, float, and string scheme files each contained many distinct
Scheme implementations in a single module. Promote each to a directory
module with one submodule per scheme, re-exporting the scheme types from
the parent module so the public paths (e.g. schemes::integer::FoRScheme)
are unchanged.

- integer/: bitpacking, frame_of_reference, rle, runend, sequence, sparse,
  zigzag, pco
- float/: alp, alprd, rle, sparse, pco
- string/: fsst, sparse, zstd, zstd_buffers, onpair

Shared helpers (rle_compress, try_compress_delta) and RUN_LENGTH_THRESHOLD
move into the integer rle submodule and are re-exported at the integer
module root. Tests move alongside their module into tests.rs and
scheme_selection_tests.rs files.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the changelog/chore A trivial change label Jun 2, 2026 — with Claude
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
Sort the re-export blocks in the new integer/float/string scheme module
files according to the repo's nightly rustfmt config (single alphabetical
group), fixing the `fmt` lint check.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 70e94ca 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.052x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.052x ➖, 0↑ 2↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 119425681 116991861 1.02
polarsignals_q01/datafusion:vortex-file-compressed 262685641 271944334 0.97
polarsignals_q02/datafusion:vortex-file-compressed 22657089 22188321 1.02
polarsignals_q03/datafusion:vortex-file-compressed 257167969 250419376 1.03
polarsignals_q04/datafusion:vortex-file-compressed 🚨 12283724 10592981 1.16
polarsignals_q05/datafusion:vortex-file-compressed 14715689 14031463 1.05
polarsignals_q06/datafusion:vortex-file-compressed 18440094 17985779 1.03
polarsignals_q07/datafusion:vortex-file-compressed 14363562 13492427 1.06
polarsignals_q08/datafusion:vortex-file-compressed 403825135 387971711 1.04
polarsignals_q09/datafusion:vortex-file-compressed 🚨 11506020 9921794 1.16

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+0.6%, environment too noisy confidence) · DuckDB No clear signal (+0.8%, environment too noisy confidence)
Vortex (geomean): 0.998x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.005x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51176153 52058967 0.98
tpch_q02/datafusion:vortex-file-compressed 23031988 22879890 1.01
tpch_q03/datafusion:vortex-file-compressed 28505289 27782254 1.03
tpch_q04/datafusion:vortex-file-compressed 20903003 20603276 1.01
tpch_q05/datafusion:vortex-file-compressed 51798546 49854977 1.04
tpch_q06/datafusion:vortex-file-compressed 10726335 10510029 1.02
tpch_q07/datafusion:vortex-file-compressed 56780467 57934589 0.98
tpch_q08/datafusion:vortex-file-compressed 41483627 40721001 1.02
tpch_q09/datafusion:vortex-file-compressed 53215883 53480738 1.00
tpch_q10/datafusion:vortex-file-compressed 45464684 44595262 1.02
tpch_q11/datafusion:vortex-file-compressed 17021919 16799361 1.01
tpch_q12/datafusion:vortex-file-compressed 25035680 25723300 0.97
tpch_q13/datafusion:vortex-file-compressed 27446692 27241748 1.01
tpch_q14/datafusion:vortex-file-compressed 16425793 15757573 1.04
tpch_q15/datafusion:vortex-file-compressed 25593465 24455326 1.05
tpch_q16/datafusion:vortex-file-compressed 20738490 20693639 1.00
tpch_q17/datafusion:vortex-file-compressed 67082551 66308262 1.01
tpch_q18/datafusion:vortex-file-compressed 84103322 85805188 0.98
tpch_q19/datafusion:vortex-file-compressed 20756249 21302569 0.97
tpch_q20/datafusion:vortex-file-compressed 29668817 31197316 0.95
tpch_q21/datafusion:vortex-file-compressed 73228578 72546240 1.01
tpch_q22/datafusion:vortex-file-compressed 11862369 11743244 1.01
datafusion / vortex-compact (0.991x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 60138038 57189750 1.05
tpch_q02/datafusion:vortex-compact 25855545 26198542 0.99
tpch_q03/datafusion:vortex-compact 29272284 29896840 0.98
tpch_q04/datafusion:vortex-compact 22266179 23659071 0.94
tpch_q05/datafusion:vortex-compact 51086447 51056486 1.00
tpch_q06/datafusion:vortex-compact 12599171 13017625 0.97
tpch_q07/datafusion:vortex-compact 60386234 60053905 1.01
tpch_q08/datafusion:vortex-compact 43840371 45499610 0.96
tpch_q09/datafusion:vortex-compact 55950013 56022286 1.00
tpch_q10/datafusion:vortex-compact 46740804 47013665 0.99
tpch_q11/datafusion:vortex-compact 17248890 17798022 0.97
tpch_q12/datafusion:vortex-compact 30621036 30981415 0.99
tpch_q13/datafusion:vortex-compact 32556079 34772604 0.94
tpch_q14/datafusion:vortex-compact 19264534 19358562 1.00
tpch_q15/datafusion:vortex-compact 31320318 31521767 0.99
tpch_q16/datafusion:vortex-compact 25448474 25199580 1.01
tpch_q17/datafusion:vortex-compact 70952405 69994090 1.01
tpch_q18/datafusion:vortex-compact 87510592 84796022 1.03
tpch_q19/datafusion:vortex-compact 30438237 30618913 0.99
tpch_q20/datafusion:vortex-compact 33780571 35547421 0.95
tpch_q21/datafusion:vortex-compact 77397256 77445093 1.00
tpch_q22/datafusion:vortex-compact 13377406 12913245 1.04
datafusion / parquet (0.994x ➖, 0↑ 2↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 135467969 127650596 1.06
tpch_q02/datafusion:parquet 62383586 62733171 0.99
tpch_q03/datafusion:parquet 69340554 75195804 0.92
tpch_q04/datafusion:parquet 43962712 44189165 0.99
tpch_q05/datafusion:parquet 95437264 95635204 1.00
tpch_q06/datafusion:parquet 38406730 42403455 0.91
tpch_q07/datafusion:parquet 106066168 106967434 0.99
tpch_q08/datafusion:parquet 97439474 101404920 0.96
tpch_q09/datafusion:parquet 131340238 132255788 0.99
tpch_q10/datafusion:parquet 112990948 113725813 0.99
tpch_q11/datafusion:parquet 42436687 43174398 0.98
tpch_q12/datafusion:parquet 78111518 83315664 0.94
tpch_q13/datafusion:parquet 204992367 210605091 0.97
tpch_q14/datafusion:parquet 🚨 49140283 42959039 1.14
tpch_q15/datafusion:parquet 59100355 61282504 0.96
tpch_q16/datafusion:parquet 41749475 42149668 0.99
tpch_q17/datafusion:parquet 🚨 144965505 130520421 1.11
tpch_q18/datafusion:parquet 168551989 164724858 1.02
tpch_q19/datafusion:parquet 75062534 76446921 0.98
tpch_q20/datafusion:parquet 70438396 71949703 0.98
tpch_q21/datafusion:parquet 135222320 135935965 0.99
tpch_q22/datafusion:parquet 31227637 31087258 1.00
datafusion / arrow (1.004x ➖, 0↑ 2↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 53852263 57827797 0.93
tpch_q02/datafusion:arrow 19142483 19652920 0.97
tpch_q03/datafusion:arrow 30265249 30671112 0.99
tpch_q04/datafusion:arrow 25023177 26229986 0.95
tpch_q05/datafusion:arrow 🚨 82627688 75029153 1.10
tpch_q06/datafusion:arrow 🚨 22621485 19393939 1.17
tpch_q07/datafusion:arrow 106031032 103301953 1.03
tpch_q08/datafusion:arrow 42927491 41562034 1.03
tpch_q09/datafusion:arrow 64712105 69423009 0.93
tpch_q10/datafusion:arrow 47698254 51095287 0.93
tpch_q11/datafusion:arrow 9529298 9418009 1.01
tpch_q12/datafusion:arrow 51645120 51319378 1.01
tpch_q13/datafusion:arrow 47106148 47039038 1.00
tpch_q14/datafusion:arrow 21599374 21944151 0.98
tpch_q15/datafusion:arrow 44041957 43320818 1.02
tpch_q16/datafusion:arrow 19369749 19305399 1.00
tpch_q17/datafusion:arrow 69449606 69011530 1.01
tpch_q18/datafusion:arrow 144792588 137488048 1.05
tpch_q19/datafusion:arrow 34915104 35387673 0.99
tpch_q20/datafusion:arrow 34855827 35028284 1.00
tpch_q21/datafusion:arrow 151631494 153605095 0.99
tpch_q22/datafusion:arrow 18592075 18186772 1.02
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31573876 31519073 1.00
tpch_q02/duckdb:vortex-file-compressed 25672892 25239842 1.02
tpch_q03/duckdb:vortex-file-compressed 33116692 33818079 0.98
tpch_q04/duckdb:vortex-file-compressed 29255785 29202457 1.00
tpch_q05/duckdb:vortex-file-compressed 37654495 38168085 0.99
tpch_q06/duckdb:vortex-file-compressed 8784658 8642357 1.02
tpch_q07/duckdb:vortex-file-compressed 34990639 36425107 0.96
tpch_q08/duckdb:vortex-file-compressed 38095004 37778753 1.01
tpch_q09/duckdb:vortex-file-compressed 58017149 58810318 0.99
tpch_q10/duckdb:vortex-file-compressed 41214208 42343446 0.97
tpch_q11/duckdb:vortex-file-compressed 15518838 15515398 1.00
tpch_q12/duckdb:vortex-file-compressed 23643032 22992174 1.03
tpch_q13/duckdb:vortex-file-compressed 41791102 42004840 0.99
tpch_q14/duckdb:vortex-file-compressed 22066664 21792877 1.01
tpch_q15/duckdb:vortex-file-compressed 17334587 17621741 0.98
tpch_q16/duckdb:vortex-file-compressed 29758323 30337938 0.98
tpch_q17/duckdb:vortex-file-compressed 24339535 24212387 1.01
tpch_q18/duckdb:vortex-file-compressed 52683424 53775932 0.98
tpch_q19/duckdb:vortex-file-compressed 29497572 29464604 1.00
tpch_q20/duckdb:vortex-file-compressed 33130259 33371554 0.99
tpch_q21/duckdb:vortex-file-compressed 100122147 101212308 0.99
tpch_q22/duckdb:vortex-file-compressed 17023971 17537961 0.97
duckdb / vortex-compact (1.004x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38547597 38785149 0.99
tpch_q02/duckdb:vortex-compact 34735992 34021132 1.02
tpch_q03/duckdb:vortex-compact 34353185 34994947 0.98
tpch_q04/duckdb:vortex-compact 31149498 30921353 1.01
tpch_q05/duckdb:vortex-compact 40612573 42092375 0.96
tpch_q06/duckdb:vortex-compact 11689298 10836452 1.08
tpch_q07/duckdb:vortex-compact 41305099 41480459 1.00
tpch_q08/duckdb:vortex-compact 42906944 42250973 1.02
tpch_q09/duckdb:vortex-compact 66365724 66107566 1.00
tpch_q10/duckdb:vortex-compact 45412943 45570847 1.00
tpch_q11/duckdb:vortex-compact 18961116 18163087 1.04
tpch_q12/duckdb:vortex-compact 29842412 29448273 1.01
tpch_q13/duckdb:vortex-compact 47389861 47304407 1.00
tpch_q14/duckdb:vortex-compact 26456731 26279100 1.01
tpch_q15/duckdb:vortex-compact 20515167 20347062 1.01
tpch_q16/duckdb:vortex-compact 33429026 32681828 1.02
tpch_q17/duckdb:vortex-compact 28869251 30379952 0.95
tpch_q18/duckdb:vortex-compact 53782706 53506094 1.01
tpch_q19/duckdb:vortex-compact 33963713 34328389 0.99
tpch_q20/duckdb:vortex-compact 39978557 40171147 1.00
tpch_q21/duckdb:vortex-compact 105514222 104160745 1.01
tpch_q22/duckdb:vortex-compact 18896772 19325478 0.98
duckdb / parquet (0.994x ➖, 2↑ 1↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 76360006 79634158 0.96
tpch_q02/duckdb:parquet 39910886 40019276 1.00
tpch_q03/duckdb:parquet 71453806 71376561 1.00
tpch_q04/duckdb:parquet 🚀 49904641 56771739 0.88
tpch_q05/duckdb:parquet 69144325 68066075 1.02
tpch_q06/duckdb:parquet 22408634 22870810 0.98
tpch_q07/duckdb:parquet 76971572 73971323 1.04
tpch_q08/duckdb:parquet 🚨 91868303 83012003 1.11
tpch_q09/duckdb:parquet 137089613 146099386 0.94
tpch_q10/duckdb:parquet 129780617 126503575 1.03
tpch_q11/duckdb:parquet 22813134 22650087 1.01
tpch_q12/duckdb:parquet 🚀 46824296 54387166 0.86
tpch_q13/duckdb:parquet 253254845 254698327 0.99
tpch_q14/duckdb:parquet 52794298 50882376 1.04
tpch_q15/duckdb:parquet 26932745 26252403 1.03
tpch_q16/duckdb:parquet 58199253 58640738 0.99
tpch_q17/duckdb:parquet 58202906 58889898 0.99
tpch_q18/duckdb:parquet 119257699 120214929 0.99
tpch_q19/duckdb:parquet 85878174 82246226 1.04
tpch_q20/duckdb:parquet 66088809 65564820 1.01
tpch_q21/duckdb:parquet 171538036 173099137 0.99
tpch_q22/duckdb:parquet 54726091 53819687 1.02
duckdb / duckdb (1.010x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17735369 17617209 1.01
tpch_q02/duckdb:duckdb 14845186 14299792 1.04
tpch_q03/duckdb:duckdb 23315322 22882966 1.02
tpch_q04/duckdb:duckdb 22998039 21856241 1.05
tpch_q05/duckdb:duckdb 23781667 23340449 1.02
tpch_q06/duckdb:duckdb 7016140 7083525 0.99
tpch_q07/duckdb:duckdb 25650203 25642732 1.00
tpch_q08/duckdb:duckdb 24570154 24332783 1.01
tpch_q09/duckdb:duckdb 58607357 58262733 1.01
tpch_q10/duckdb:duckdb 51398211 52852344 0.97
tpch_q11/duckdb:duckdb 7392523 7217189 1.02
tpch_q12/duckdb:duckdb 18442125 17866124 1.03
tpch_q13/duckdb:duckdb 39298189 39608053 0.99
tpch_q14/duckdb:duckdb 22125265 21487974 1.03
tpch_q15/duckdb:duckdb 13942583 13812543 1.01
tpch_q16/duckdb:duckdb 26263564 26305681 1.00
tpch_q17/duckdb:duckdb 16371053 16062838 1.02
tpch_q18/duckdb:duckdb 41240749 40869949 1.01
tpch_q19/duckdb:duckdb 32177070 31442128 1.02
tpch_q20/duckdb:duckdb 25336213 25357398 1.00
tpch_q21/duckdb:duckdb 61629351 62163501 0.99
tpch_q22/duckdb:duckdb 25170283 25566720 0.98

File Size Changes (9 files changed, -0.1% overall, 5↑ 4↓)
File Scale Format Base HEAD Change %
part_0.vortex 1.0 vortex-file-compressed 5.02 MB 5.05 MB +35.08 KB +0.7%
supplier_0.vortex 1.0 vortex-file-compressed 612.64 KB 616.02 KB +3.38 KB +0.6%
orders_0.vortex 1.0 vortex-file-compressed 38.28 MB 38.35 MB +62.88 KB +0.2%
customer_0.vortex 1.0 vortex-file-compressed 8.88 MB 8.89 MB +11.80 KB +0.1%
partsupp_0.vortex 1.0 vortex-file-compressed 23.78 MB 23.81 MB +26.46 KB +0.1%
lineitem_1.vortex 1.0 vortex-file-compressed 84.64 MB 84.63 MB 6.87 KB -0.0%
lineitem_0.vortex 1.0 vortex-file-compressed 85.18 MB 85.09 MB 86.67 KB -0.1%
part_0.vortex 1.0 vortex-compact 3.41 MB 3.37 MB 41.42 KB -1.2%
partsupp_0.vortex 1.0 vortex-compact 20.81 MB 20.49 MB 324.31 KB -1.5%

Totals:

  • vortex-compact: 190.64 MB → 190.29 MB (-0.2%)
  • vortex-file-compressed: 246.66 MB → 246.70 MB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -6.9% +0.9% -7.7% +19.0% ➖ noise
1 datafusion:vortex-compact +5.2% +0.9% +4.2% +18.6% ➖ noise
1 datafusion:vortex-file-compressed -1.7% +0.9% -2.5% +19.0% ➖ noise
1 duckdb:duckdb +0.7% +0.9% -0.2% +16.7% ➖ noise
1 duckdb:vortex-compact -0.6% +0.9% -1.5% +17.1% ➖ noise
1 duckdb:vortex-file-compressed +0.2% +0.9% -0.7% +19.5% ➖ noise
2 datafusion:arrow -2.6% -0.4% -2.2% +10.8% ➖ noise
2 datafusion:vortex-compact -1.3% -0.4% -0.9% +10.8% ➖ noise
2 datafusion:vortex-file-compressed +0.7% -0.4% +1.1% +10.8% ➖ noise
2 duckdb:duckdb +3.8% -0.4% +4.2% +10.8% ➖ noise
2 duckdb:vortex-compact +2.1% -0.4% +2.5% +10.8% ➖ noise
2 duckdb:vortex-file-compressed +1.7% -0.4% +2.1% +10.8% ➖ noise
3 datafusion:arrow -1.3% -3.9% +2.7% +10.8% ➖ noise
3 datafusion:vortex-compact -2.1% -3.9% +1.9% +11.6% ➖ noise
3 datafusion:vortex-file-compressed +2.6% -3.9% +6.8% +12.3% ➖ noise
3 duckdb:duckdb +1.9% -3.9% +6.0% +10.8% ➖ noise
3 duckdb:vortex-compact -1.8% -3.9% +2.2% +10.8% ➖ noise
3 duckdb:vortex-file-compressed -2.1% -3.9% +1.9% +12.8% ➖ noise
4 datafusion:arrow -4.6% -6.5% +2.0% +10.8% ➖ noise
4 datafusion:vortex-compact -5.9% -6.5% +0.6% +10.8% ➖ noise
4 datafusion:vortex-file-compressed +1.5% -6.5% +8.5% +11.9% ➖ noise
4 duckdb:duckdb +5.2% -6.5% +12.5% +10.8% 🚨 regression
4 duckdb:vortex-compact +0.7% -6.5% +7.7% +10.8% ➖ noise
4 duckdb:vortex-file-compressed +0.2% -6.5% +7.1% +10.8% ➖ noise
5 datafusion:arrow +10.1% +0.7% +9.4% +10.8% ➖ noise
5 datafusion:vortex-compact +0.1% +0.7% -0.6% +10.8% ➖ noise
5 datafusion:vortex-file-compressed +3.9% +0.7% +3.2% +10.8% ➖ noise
5 duckdb:duckdb +1.9% +0.7% +1.2% +10.8% ➖ noise
5 duckdb:vortex-compact -3.5% +0.7% -4.2% +10.8% ➖ noise
5 duckdb:vortex-file-compressed -1.3% +0.7% -2.0% +10.8% ➖ noise
6 datafusion:arrow +16.6% -5.8% +23.8% +15.0% 🚨 regression
6 datafusion:vortex-compact -3.2% -5.8% +2.7% +20.2% ➖ noise
6 datafusion:vortex-file-compressed +2.1% -5.8% +8.3% +23.1% ➖ noise
6 duckdb:duckdb -1.0% -5.8% +5.1% +14.4% ➖ noise
6 duckdb:vortex-compact +7.9% -5.8% +14.5% +18.9% ➖ noise
6 duckdb:vortex-file-compressed +1.6% -5.8% +7.9% +15.6% ➖ noise
7 datafusion:arrow +2.6% +1.6% +1.0% +10.8% ➖ noise
7 datafusion:vortex-compact +0.6% +1.6% -1.0% +10.8% ➖ noise
7 datafusion:vortex-file-compressed -2.0% +1.6% -3.5% +10.8% ➖ noise
7 duckdb:duckdb +0.0% +1.6% -1.5% +10.8% ➖ noise
7 duckdb:vortex-compact -0.4% +1.6% -2.0% +10.8% ➖ noise
7 duckdb:vortex-file-compressed -3.9% +1.6% -5.4% +10.8% ➖ noise
8 datafusion:arrow +3.3% +3.1% +0.2% +10.8% ➖ noise
8 datafusion:vortex-compact -3.6% +3.1% -6.6% +10.8% ➖ noise
8 datafusion:vortex-file-compressed +1.9% +3.1% -1.2% +10.8% ➖ noise
8 duckdb:duckdb +1.0% +3.1% -2.1% +10.8% ➖ noise
8 duckdb:vortex-compact +1.6% +3.1% -1.5% +13.4% ➖ noise
8 duckdb:vortex-file-compressed +0.8% +3.1% -2.2% +10.8% ➖ noise
9 datafusion:arrow -6.8% -3.5% -3.4% +10.8% ➖ noise
9 datafusion:vortex-compact -0.1% -3.5% +3.5% +10.8% ➖ noise
9 datafusion:vortex-file-compressed -0.5% -3.5% +3.1% +10.8% ➖ noise
9 duckdb:duckdb +0.6% -3.5% +4.2% +10.8% ➖ noise
9 duckdb:vortex-compact +0.4% -3.5% +4.0% +10.8% ➖ noise
9 duckdb:vortex-file-compressed -1.3% -3.5% +2.2% +10.8% ➖ noise
10 datafusion:arrow -6.6% +1.0% -7.5% +10.8% ➖ noise
10 datafusion:vortex-compact -0.6% +1.0% -1.5% +10.8% ➖ noise
10 datafusion:vortex-file-compressed +1.9% +1.0% +1.0% +10.8% ➖ noise
10 duckdb:duckdb -2.8% +1.0% -3.7% +10.8% ➖ noise
10 duckdb:vortex-compact -0.3% +1.0% -1.3% +10.8% ➖ noise
10 duckdb:vortex-file-compressed -2.7% +1.0% -3.6% +10.8% ➖ noise
11 datafusion:arrow +1.2% -0.5% +1.7% +10.8% ➖ noise
11 datafusion:vortex-compact -3.1% -0.5% -2.6% +10.8% ➖ noise
11 datafusion:vortex-file-compressed +1.3% -0.5% +1.8% +10.8% ➖ noise
11 duckdb:duckdb +2.4% -0.5% +2.9% +10.8% ➖ noise
11 duckdb:vortex-compact +4.4% -0.5% +4.9% +16.5% ➖ noise
11 duckdb:vortex-file-compressed +0.0% -0.5% +0.5% +10.8% ➖ noise
12 datafusion:arrow +0.6% -10.2% +12.0% +19.2% ➖ noise
12 datafusion:vortex-compact -1.2% -10.2% +10.0% +14.2% ➖ noise
12 datafusion:vortex-file-compressed -2.7% -10.2% +8.3% +13.3% ➖ noise
12 duckdb:duckdb +3.2% -10.2% +14.9% +11.2% 🚨 regression
12 duckdb:vortex-compact +1.3% -10.2% +12.8% +11.3% 🚨 regression
12 duckdb:vortex-file-compressed +2.8% -10.2% +14.5% +12.0% 🚨 regression
13 datafusion:arrow +0.1% -1.6% +1.8% +15.8% ➖ noise
13 datafusion:vortex-compact -6.4% -1.6% -4.8% +10.8% ➖ noise
13 datafusion:vortex-file-compressed +0.8% -1.6% +2.4% +10.8% ➖ noise
13 duckdb:duckdb -0.8% -1.6% +0.9% +10.8% ➖ noise
13 duckdb:vortex-compact +0.2% -1.6% +1.8% +10.8% ➖ noise
13 duckdb:vortex-file-compressed -0.5% -1.6% +1.1% +10.8% ➖ noise
14 datafusion:arrow -1.6% +8.9% -9.7% +13.4% ➖ noise
14 datafusion:vortex-compact -0.5% +8.9% -8.7% +14.6% ➖ noise
14 datafusion:vortex-file-compressed +4.2% +8.9% -4.3% +12.8% ➖ noise
14 duckdb:duckdb +3.0% +8.9% -5.5% +10.8% ➖ noise
14 duckdb:vortex-compact +0.7% +8.9% -7.6% +10.8% ➖ noise
14 duckdb:vortex-file-compressed +1.3% +8.9% -7.1% +10.8% ➖ noise
15 datafusion:arrow +1.7% -0.5% +2.2% +11.6% ➖ noise
15 datafusion:vortex-compact -0.6% -0.5% -0.1% +12.0% ➖ noise
15 datafusion:vortex-file-compressed +4.7% -0.5% +5.2% +13.0% ➖ noise
15 duckdb:duckdb +0.9% -0.5% +1.5% +11.1% ➖ noise
15 duckdb:vortex-compact +0.8% -0.5% +1.4% +13.9% ➖ noise
15 duckdb:vortex-file-compressed -1.6% -0.5% -1.1% +12.4% ➖ noise
16 datafusion:arrow +0.3% -0.9% +1.2% +10.8% ➖ noise
16 datafusion:vortex-compact +1.0% -0.9% +1.9% +10.8% ➖ noise
16 datafusion:vortex-file-compressed +0.2% -0.9% +1.1% +10.8% ➖ noise
16 duckdb:duckdb -0.2% -0.9% +0.7% +10.8% ➖ noise
16 duckdb:vortex-compact +2.3% -0.9% +3.2% +10.8% ➖ noise
16 duckdb:vortex-file-compressed -1.9% -0.9% -1.1% +10.8% ➖ noise
17 datafusion:arrow +0.6% +4.8% -3.9% +10.8% ➖ noise
17 datafusion:vortex-compact +1.4% +4.8% -3.2% +10.8% ➖ noise
17 datafusion:vortex-file-compressed +1.2% +4.8% -3.4% +10.9% ➖ noise
17 duckdb:duckdb +1.9% +4.8% -2.7% +10.8% ➖ noise
17 duckdb:vortex-compact -5.0% +4.8% -9.3% +10.8% ➖ noise
17 duckdb:vortex-file-compressed +0.5% +4.8% -4.1% +10.9% ➖ noise
18 datafusion:arrow +5.3% +0.8% +4.5% +10.8% ➖ noise
18 datafusion:vortex-compact +3.2% +0.8% +2.4% +10.8% ➖ noise
18 datafusion:vortex-file-compressed -2.0% +0.8% -2.7% +10.8% ➖ noise
18 duckdb:duckdb +0.9% +0.8% +0.2% +10.8% ➖ noise
18 duckdb:vortex-compact +0.5% +0.8% -0.2% +10.8% ➖ noise
18 duckdb:vortex-file-compressed -2.0% +0.8% -2.8% +10.8% ➖ noise
19 datafusion:arrow -1.3% +1.3% -2.6% +12.2% ➖ noise
19 datafusion:vortex-compact -0.6% +1.3% -1.8% +15.5% ➖ noise
19 datafusion:vortex-file-compressed -2.6% +1.3% -3.8% +15.0% ➖ noise
19 duckdb:duckdb +2.3% +1.3% +1.1% +12.4% ➖ noise
19 duckdb:vortex-compact -1.1% +1.3% -2.3% +14.0% ➖ noise
19 duckdb:vortex-file-compressed +0.1% +1.3% -1.1% +13.2% ➖ noise
20 datafusion:arrow -0.5% -0.7% +0.2% +13.4% ➖ noise
20 datafusion:vortex-compact -5.0% -0.7% -4.3% +10.8% ➖ noise
20 datafusion:vortex-file-compressed -4.9% -0.7% -4.3% +11.2% ➖ noise
20 duckdb:duckdb -0.1% -0.7% +0.6% +10.8% ➖ noise
20 duckdb:vortex-compact -0.5% -0.7% +0.2% +10.8% ➖ noise
20 duckdb:vortex-file-compressed -0.7% -0.7% -0.1% +13.0% ➖ noise
21 datafusion:arrow -1.3% -0.7% -0.6% +10.8% ➖ noise
21 datafusion:vortex-compact -0.1% -0.7% +0.7% +10.8% ➖ noise
21 datafusion:vortex-file-compressed +0.9% -0.7% +1.7% +10.8% ➖ noise
21 duckdb:duckdb -0.9% -0.7% -0.1% +10.8% ➖ noise
21 duckdb:vortex-compact +1.3% -0.7% +2.0% +10.8% ➖ noise
21 duckdb:vortex-file-compressed -1.1% -0.7% -0.4% +10.8% ➖ noise
22 datafusion:arrow +2.2% +1.1% +1.2% +11.1% ➖ noise
22 datafusion:vortex-compact +3.6% +1.1% +2.5% +15.0% ➖ noise
22 datafusion:vortex-file-compressed +1.0% +1.1% -0.1% +10.8% ➖ noise
22 duckdb:duckdb -1.6% +1.1% -2.6% +10.8% ➖ noise
22 duckdb:vortex-compact -2.2% +1.1% -3.2% +11.5% ➖ noise
22 duckdb:vortex-file-compressed -2.9% +1.1% -4.0% +10.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.4%
Engines: DataFusion No clear signal (-1.0%, low confidence) · DuckDB No clear signal (+3.7%, low confidence)
Vortex (geomean): 1.194x ❌
Parquet (geomean): 1.178x ❌
Shifts: Parquet (control) +17.8% · Median polish +18.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.163x ❌, 0↑ 7↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 6699650 5606652 1.19
fineweb_q01/datafusion:vortex-file-compressed 🚨 38165297 32551231 1.17
fineweb_q02/datafusion:vortex-file-compressed 🚨 42079495 37720191 1.12
fineweb_q03/datafusion:vortex-file-compressed 69482599 69037770 1.01
fineweb_q04/datafusion:vortex-file-compressed 🚨 335093202 276753690 1.21
fineweb_q05/datafusion:vortex-file-compressed 🚨 262804057 216106073 1.22
fineweb_q06/datafusion:vortex-file-compressed 🚨 61157375 48728031 1.26
fineweb_q07/datafusion:vortex-file-compressed 60281176 55619899 1.08
fineweb_q08/datafusion:vortex-file-compressed 🚨 23717577 19188505 1.24
datafusion / vortex-compact (1.191x ❌, 0↑ 9↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 6653830 5424677 1.23
fineweb_q01/datafusion:vortex-compact 🚨 119470321 94651081 1.26
fineweb_q02/datafusion:vortex-compact 🚨 119985011 104767014 1.15
fineweb_q03/datafusion:vortex-compact 🚨 1010596298 869665585 1.16
fineweb_q04/datafusion:vortex-compact 🚨 1067525597 918002423 1.16
fineweb_q05/datafusion:vortex-compact 🚨 967469677 817308427 1.18
fineweb_q06/datafusion:vortex-compact 🚨 544659363 464652670 1.17
fineweb_q07/datafusion:vortex-compact 🚨 571386467 479351035 1.19
fineweb_q08/datafusion:vortex-compact 🚨 21987489 18070115 1.22
datafusion / parquet (1.188x ❌, 0↑ 9↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 8323998 6685587 1.25
fineweb_q01/datafusion:parquet 🚨 347426999 302050862 1.15
fineweb_q02/datafusion:parquet 🚨 353590365 297060993 1.19
fineweb_q03/datafusion:parquet 🚨 346736169 278796162 1.24
fineweb_q04/datafusion:parquet 🚨 357879125 301654607 1.19
fineweb_q05/datafusion:parquet 🚨 348898615 303128807 1.15
fineweb_q06/datafusion:parquet 🚨 339058246 290474114 1.17
fineweb_q07/datafusion:parquet 🚨 332468677 278445239 1.19
fineweb_q08/datafusion:parquet 🚨 327482335 279763478 1.17
duckdb / vortex-file-compressed (1.224x ❌, 0↑ 9↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 4115920 3442878 1.20
fineweb_q01/duckdb:vortex-file-compressed 🚨 39637191 33200811 1.19
fineweb_q02/duckdb:vortex-file-compressed 🚨 48031263 40539015 1.18
fineweb_q03/duckdb:vortex-file-compressed 🚨 153360496 112991047 1.36
fineweb_q04/duckdb:vortex-file-compressed 🚨 320282458 267754832 1.20
fineweb_q05/duckdb:vortex-file-compressed 🚨 259221716 214877604 1.21
fineweb_q06/duckdb:vortex-file-compressed 🚨 63692499 52207614 1.22
fineweb_q07/duckdb:vortex-file-compressed 🚨 63893458 54733260 1.17
fineweb_q08/duckdb:vortex-file-compressed 🚨 27531672 20999890 1.31
duckdb / vortex-compact (1.199x ❌, 0↑ 9↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 4852628 4123020 1.18
fineweb_q01/duckdb:vortex-compact 🚨 125615307 102498923 1.23
fineweb_q02/duckdb:vortex-compact 🚨 132286029 109715072 1.21
fineweb_q03/duckdb:vortex-compact 🚨 1015768075 862001945 1.18
fineweb_q04/duckdb:vortex-compact 🚨 1076465008 905497359 1.19
fineweb_q05/duckdb:vortex-compact 🚨 962092592 808164100 1.19
fineweb_q06/duckdb:vortex-compact 🚨 548270016 466880409 1.17
fineweb_q07/duckdb:vortex-compact 🚨 567913039 483953110 1.17
fineweb_q08/duckdb:vortex-compact 🚨 24367618 18968778 1.28
duckdb / parquet (1.168x ❌, 0↑ 9↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 35733584 31399239 1.14
fineweb_q01/duckdb:parquet 🚨 98711854 84054912 1.17
fineweb_q02/duckdb:parquet 🚨 100356112 84910145 1.18
fineweb_q03/duckdb:parquet 🚨 369846007 315419076 1.17
fineweb_q04/duckdb:parquet 🚨 517330225 447528019 1.16
fineweb_q05/duckdb:parquet 🚨 479960447 415488860 1.16
fineweb_q06/duckdb:parquet 🚨 239034987 203462113 1.17
fineweb_q07/duckdb:parquet 🚨 248366113 215982288 1.15
fineweb_q08/duckdb:parquet 🚨 40288322 33245300 1.21

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +76.35 KB +0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +22.7% +19.0% +3.0% +45.1% ➖ noise
0 datafusion:vortex-file-compressed +19.5% +19.0% +0.4% +43.9% ➖ noise
0 duckdb:vortex-compact +17.7% +19.0% -1.1% +122.3% ➖ noise
0 duckdb:vortex-file-compressed +19.5% +19.0% +0.4% +74.1% ➖ noise
1 datafusion:vortex-compact +26.2% +16.2% +8.6% +15.0% ➖ noise
1 datafusion:vortex-file-compressed +17.2% +16.2% +0.9% +20.9% ➖ noise
1 duckdb:vortex-compact +22.6% +16.2% +5.4% +13.8% ➖ noise
1 duckdb:vortex-file-compressed +19.4% +16.2% +2.7% +43.9% ➖ noise
2 datafusion:vortex-compact +14.5% +18.6% -3.4% +10.9% ➖ noise
2 datafusion:vortex-file-compressed +11.6% +18.6% -5.9% +11.8% ➖ noise
2 duckdb:vortex-compact +20.6% +18.6% +1.7% +13.3% ➖ noise
2 duckdb:vortex-file-compressed +18.5% +18.6% -0.1% +10.0% ➖ noise
3 datafusion:vortex-compact +16.2% +20.8% -3.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.6% +20.8% -16.7% +24.0% ➖ noise
3 duckdb:vortex-compact +17.8% +20.8% -2.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +35.7% +20.8% +12.4% +39.9% ➖ noise
4 datafusion:vortex-compact +16.3% +17.1% -0.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +21.1% +17.1% +3.4% +10.0% ➖ noise
4 duckdb:vortex-compact +18.9% +17.1% +1.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +19.6% +17.1% +2.1% +10.0% ➖ noise
5 datafusion:vortex-compact +18.4% +15.3% +2.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +21.6% +15.3% +5.5% +10.0% ➖ noise
5 duckdb:vortex-compact +19.0% +15.3% +3.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +20.6% +15.3% +4.6% +10.0% ➖ noise
6 datafusion:vortex-compact +17.2% +17.1% +0.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +25.5% +17.1% +7.2% +16.9% ➖ noise
6 duckdb:vortex-compact +17.4% +17.1% +0.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +22.0% +17.1% +4.2% +20.6% ➖ noise
7 datafusion:vortex-compact +19.2% +17.2% +1.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +8.4% +17.2% -7.5% +10.1% ➖ noise
7 duckdb:vortex-compact +17.3% +17.2% +0.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +16.7% +17.2% -0.4% +21.6% ➖ noise
8 datafusion:vortex-compact +21.7% +19.1% +2.2% +22.6% ➖ noise
8 datafusion:vortex-file-compressed +23.6% +19.1% +3.8% +20.1% ➖ noise
8 duckdb:vortex-compact +28.5% +19.1% +7.9% +47.0% ➖ noise
8 duckdb:vortex-file-compressed +31.1% +19.1% +10.1% +18.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (-2.0%, low confidence)
Vortex (geomean): 0.938x ➖
Parquet (geomean): 0.947x ➖
Shifts: Parquet (control) -5.3% · Median polish -5.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.929x ➖, 16↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 26921081 27523013 0.98
tpcds_q02/datafusion:vortex-file-compressed 46612410 51388663 0.91
tpcds_q03/datafusion:vortex-file-compressed 15433573 16143246 0.96
tpcds_q04/datafusion:vortex-file-compressed 252575333 279399272 0.90
tpcds_q05/datafusion:vortex-file-compressed 🚀 40649918 47428958 0.86
tpcds_q06/datafusion:vortex-file-compressed 60516560 60152011 1.01
tpcds_q07/datafusion:vortex-file-compressed 42245559 45234869 0.93
tpcds_q08/datafusion:vortex-file-compressed 28214644 31277868 0.90
tpcds_q09/datafusion:vortex-file-compressed 38151167 40806116 0.93
tpcds_q10/datafusion:vortex-file-compressed 38505404 41578455 0.93
tpcds_q11/datafusion:vortex-file-compressed 131346283 140980197 0.93
tpcds_q12/datafusion:vortex-file-compressed 20524349 22199922 0.92
tpcds_q13/datafusion:vortex-file-compressed 49417575 50368697 0.98
tpcds_q14/datafusion:vortex-file-compressed 173141915 186979301 0.93
tpcds_q15/datafusion:vortex-file-compressed 28929340 30803274 0.94
tpcds_q16/datafusion:vortex-file-compressed 🚀 28243590 32568637 0.87
tpcds_q17/datafusion:vortex-file-compressed 63652601 68793005 0.93
tpcds_q18/datafusion:vortex-file-compressed 68027441 73788607 0.92
tpcds_q19/datafusion:vortex-file-compressed 24028079 23658819 1.02
tpcds_q20/datafusion:vortex-file-compressed 21829403 22880007 0.95
tpcds_q21/datafusion:vortex-file-compressed 35722500 38636872 0.92
tpcds_q22/datafusion:vortex-file-compressed 115191049 121489676 0.95
tpcds_q23/datafusion:vortex-file-compressed 🚀 149558767 167933776 0.89
tpcds_q24/datafusion:vortex-file-compressed 83223277 92164106 0.90
tpcds_q25/datafusion:vortex-file-compressed 66143810 73467237 0.90
tpcds_q26/datafusion:vortex-file-compressed 33355230 35770400 0.93
tpcds_q27/datafusion:vortex-file-compressed 🚀 106054745 118305266 0.90
tpcds_q28/datafusion:vortex-file-compressed 32979629 34753257 0.95
tpcds_q29/datafusion:vortex-file-compressed 60565476 66252775 0.91
tpcds_q30/datafusion:vortex-file-compressed 22680997 24828886 0.91
tpcds_q31/datafusion:vortex-file-compressed 72854337 79771375 0.91
tpcds_q32/datafusion:vortex-file-compressed 19943933 21298236 0.94
tpcds_q33/datafusion:vortex-file-compressed 30218473 30875766 0.98
tpcds_q34/datafusion:vortex-file-compressed 23893230 25753040 0.93
tpcds_q35/datafusion:vortex-file-compressed 45033874 49028561 0.92
tpcds_q36/datafusion:vortex-file-compressed 62274894 60269366 1.03
tpcds_q37/datafusion:vortex-file-compressed 23763480 25936305 0.92
tpcds_q38/datafusion:vortex-file-compressed 42002374 46122649 0.91
tpcds_q39/datafusion:vortex-file-compressed 104147323 112184984 0.93
tpcds_q40/datafusion:vortex-file-compressed 32684534 34596952 0.94
tpcds_q41/datafusion:vortex-file-compressed 15741161 17332056 0.91
tpcds_q42/datafusion:vortex-file-compressed 14175376 14950948 0.95
tpcds_q43/datafusion:vortex-file-compressed 18549774 19745050 0.94
tpcds_q44/datafusion:vortex-file-compressed 31126178 33351479 0.93
tpcds_q45/datafusion:vortex-file-compressed 27532538 29911857 0.92
tpcds_q46/datafusion:vortex-file-compressed 34751252 37122668 0.94
tpcds_q47/datafusion:vortex-file-compressed 131374728 142258562 0.92
tpcds_q48/datafusion:vortex-file-compressed 35693976 37859346 0.94
tpcds_q49/datafusion:vortex-file-compressed 57695844 62636607 0.92
tpcds_q50/datafusion:vortex-file-compressed 38409571 41841604 0.92
tpcds_q51/datafusion:vortex-file-compressed 87149401 92619735 0.94
tpcds_q52/datafusion:vortex-file-compressed 14526407 15292880 0.95
tpcds_q53/datafusion:vortex-file-compressed 🚀 21507210 24746498 0.87
tpcds_q54/datafusion:vortex-file-compressed 35414091 37812764 0.94
tpcds_q55/datafusion:vortex-file-compressed 14397206 14404877 1.00
tpcds_q56/datafusion:vortex-file-compressed 🚀 29164572 32689348 0.89
tpcds_q57/datafusion:vortex-file-compressed 103846953 112326967 0.92
tpcds_q58/datafusion:vortex-file-compressed 54192948 54669002 0.99
tpcds_q59/datafusion:vortex-file-compressed 56877845 58938382 0.97
tpcds_q60/datafusion:vortex-file-compressed 29679405 31703121 0.94
tpcds_q61/datafusion:vortex-file-compressed 41007901 42223472 0.97
tpcds_q62/datafusion:vortex-file-compressed 🚀 21420333 27976360 0.77
tpcds_q63/datafusion:vortex-file-compressed 22331942 23098496 0.97
tpcds_q64/datafusion:vortex-file-compressed 418366213 441898027 0.95
tpcds_q65/datafusion:vortex-file-compressed 39885714 42873544 0.93
tpcds_q66/datafusion:vortex-file-compressed 70652340 77911565 0.91
tpcds_q67/datafusion:vortex-file-compressed 151475065 152397274 0.99
tpcds_q68/datafusion:vortex-file-compressed 31992517 34726759 0.92
tpcds_q69/datafusion:vortex-file-compressed 🚀 35131536 39055924 0.90
tpcds_q70/datafusion:vortex-file-compressed 90056813 92639529 0.97
tpcds_q71/datafusion:vortex-file-compressed 23074320 25628683 0.90
tpcds_q72/datafusion:vortex-file-compressed 2175283885 2380867753 0.91
tpcds_q73/datafusion:vortex-file-compressed 22654232 24794423 0.91
tpcds_q74/datafusion:vortex-file-compressed 🚀 79073941 88065183 0.90
tpcds_q75/datafusion:vortex-file-compressed 108068639 113931803 0.95
tpcds_q76/datafusion:vortex-file-compressed 30993578 33963553 0.91
tpcds_q77/datafusion:vortex-file-compressed 38874310 40859239 0.95
tpcds_q78/datafusion:vortex-file-compressed 127797665 132308809 0.97
tpcds_q79/datafusion:vortex-file-compressed 29138009 29783289 0.98
tpcds_q80/datafusion:vortex-file-compressed 92396289 97910754 0.94
tpcds_q81/datafusion:vortex-file-compressed 26009317 25898728 1.00
tpcds_q82/datafusion:vortex-file-compressed 26042857 26442632 0.98
tpcds_q83/datafusion:vortex-file-compressed 33958807 36413433 0.93
tpcds_q84/datafusion:vortex-file-compressed 🚀 12386947 14171430 0.87
tpcds_q85/datafusion:vortex-file-compressed 🚀 91140043 101613370 0.90
tpcds_q86/datafusion:vortex-file-compressed 17232106 18101766 0.95
tpcds_q87/datafusion:vortex-file-compressed 44498389 45929613 0.97
tpcds_q88/datafusion:vortex-file-compressed 56597891 59010541 0.96
tpcds_q89/datafusion:vortex-file-compressed 24586582 26533096 0.93
tpcds_q90/datafusion:vortex-file-compressed 🚀 14094423 16259391 0.87
tpcds_q91/datafusion:vortex-file-compressed 🚀 18032811 21405063 0.84
tpcds_q92/datafusion:vortex-file-compressed 🚀 17867823 20248960 0.88
tpcds_q93/datafusion:vortex-file-compressed 33326417 35960201 0.93
tpcds_q94/datafusion:vortex-file-compressed 23781487 25030567 0.95
tpcds_q95/datafusion:vortex-file-compressed 60900920 66129968 0.92
tpcds_q96/datafusion:vortex-file-compressed 13231940 14325048 0.92
tpcds_q97/datafusion:vortex-file-compressed 🚀 31226044 35196332 0.89
tpcds_q98/datafusion:vortex-file-compressed 🚀 23934911 26989144 0.89
tpcds_q99/datafusion:vortex-file-compressed 28222274 30375445 0.93
datafusion / vortex-compact (0.944x ➖, 8↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25360879 27432227 0.92
tpcds_q02/datafusion:vortex-compact 53091867 55392594 0.96
tpcds_q03/datafusion:vortex-compact 19664624 20895985 0.94
tpcds_q04/datafusion:vortex-compact 296583885 309662830 0.96
tpcds_q05/datafusion:vortex-compact 🚀 47447736 52938984 0.90
tpcds_q06/datafusion:vortex-compact 62227277 66831346 0.93
tpcds_q07/datafusion:vortex-compact 53693626 55764915 0.96
tpcds_q08/datafusion:vortex-compact 36013078 36707542 0.98
tpcds_q09/datafusion:vortex-compact 52158156 52580271 0.99
tpcds_q10/datafusion:vortex-compact 47837482 53092745 0.90
tpcds_q11/datafusion:vortex-compact 158001529 165896884 0.95
tpcds_q12/datafusion:vortex-compact 22716025 23625174 0.96
tpcds_q13/datafusion:vortex-compact 127807746 136690810 0.94
tpcds_q14/datafusion:vortex-compact 197064759 214093843 0.92
tpcds_q15/datafusion:vortex-compact 30998282 32458916 0.96
tpcds_q16/datafusion:vortex-compact 🚀 31234912 35175603 0.89
tpcds_q17/datafusion:vortex-compact 75277157 78380689 0.96
tpcds_q18/datafusion:vortex-compact 78449391 85413923 0.92
tpcds_q19/datafusion:vortex-compact 29284949 31481055 0.93
tpcds_q20/datafusion:vortex-compact 26420614 27808509 0.95
tpcds_q21/datafusion:vortex-compact 39672571 41825991 0.95
tpcds_q22/datafusion:vortex-compact 🚀 114985299 137386035 0.84
tpcds_q23/datafusion:vortex-compact 167339934 176600337 0.95
tpcds_q24/datafusion:vortex-compact 96120888 102707846 0.94
tpcds_q25/datafusion:vortex-compact 82234337 84089928 0.98
tpcds_q26/datafusion:vortex-compact 42761135 46079450 0.93
tpcds_q27/datafusion:vortex-compact 129090374 139456569 0.93
tpcds_q28/datafusion:vortex-compact 94480071 100940142 0.94
tpcds_q29/datafusion:vortex-compact 71945334 77323575 0.93
tpcds_q30/datafusion:vortex-compact 🚀 27092188 30181920 0.90
tpcds_q31/datafusion:vortex-compact 96264115 103544713 0.93
tpcds_q32/datafusion:vortex-compact 25901470 28176096 0.92
tpcds_q33/datafusion:vortex-compact 38106732 39418764 0.97
tpcds_q34/datafusion:vortex-compact 34268484 35919060 0.95
tpcds_q35/datafusion:vortex-compact 50405254 54379889 0.93
tpcds_q36/datafusion:vortex-compact 76534501 78614053 0.97
tpcds_q37/datafusion:vortex-compact 35002182 34974183 1.00
tpcds_q38/datafusion:vortex-compact 50735684 52034507 0.98
tpcds_q39/datafusion:vortex-compact 113365597 122036225 0.93
tpcds_q40/datafusion:vortex-compact 37895090 38880008 0.97
tpcds_q41/datafusion:vortex-compact 17837213 19123818 0.93
tpcds_q42/datafusion:vortex-compact 18009089 18932279 0.95
tpcds_q43/datafusion:vortex-compact 24193777 25633795 0.94
tpcds_q44/datafusion:vortex-compact 47283588 50080265 0.94
tpcds_q45/datafusion:vortex-compact 31394132 33349833 0.94
tpcds_q46/datafusion:vortex-compact 44560103 45704188 0.97
tpcds_q47/datafusion:vortex-compact 149668988 158947507 0.94
tpcds_q48/datafusion:vortex-compact 82516096 85131662 0.97
tpcds_q49/datafusion:vortex-compact 71374187 74454155 0.96
tpcds_q50/datafusion:vortex-compact 48513267 50681454 0.96
tpcds_q51/datafusion:vortex-compact 101926738 101696354 1.00
tpcds_q52/datafusion:vortex-compact 18263702 19073617 0.96
tpcds_q53/datafusion:vortex-compact 28898900 30015952 0.96
tpcds_q54/datafusion:vortex-compact 41904683 44178464 0.95
tpcds_q55/datafusion:vortex-compact 17664117 18825235 0.94
tpcds_q56/datafusion:vortex-compact 37313552 36908828 1.01
tpcds_q57/datafusion:vortex-compact 🚀 117529501 133405732 0.88
tpcds_q58/datafusion:vortex-compact 65106335 63974066 1.02
tpcds_q59/datafusion:vortex-compact 68071391 71809293 0.95
tpcds_q60/datafusion:vortex-compact 35932575 37695839 0.95
tpcds_q61/datafusion:vortex-compact 54611285 56428724 0.97
tpcds_q62/datafusion:vortex-compact 26991034 28456808 0.95
tpcds_q63/datafusion:vortex-compact 29381147 29665920 0.99
tpcds_q64/datafusion:vortex-compact 461895510 480242197 0.96
tpcds_q65/datafusion:vortex-compact 52005112 55746277 0.93
tpcds_q66/datafusion:vortex-compact 79547159 81600322 0.97
tpcds_q67/datafusion:vortex-compact 🚀 148815793 165657338 0.90
tpcds_q68/datafusion:vortex-compact 46235707 47585058 0.97
tpcds_q69/datafusion:vortex-compact 46453153 51102125 0.91
tpcds_q70/datafusion:vortex-compact 94403161 102075594 0.92
tpcds_q71/datafusion:vortex-compact 30322438 31703835 0.96
tpcds_q72/datafusion:vortex-compact 2210365008 2375697062 0.93
tpcds_q73/datafusion:vortex-compact 32723208 34595228 0.95
tpcds_q74/datafusion:vortex-compact 94167849 99115891 0.95
tpcds_q75/datafusion:vortex-compact 130007641 141832349 0.92
tpcds_q76/datafusion:vortex-compact 31148835 34225158 0.91
tpcds_q77/datafusion:vortex-compact 50130250 54009670 0.93
tpcds_q78/datafusion:vortex-compact 137380827 150568434 0.91
tpcds_q79/datafusion:vortex-compact 37976100 39186228 0.97
tpcds_q80/datafusion:vortex-compact 112237961 114682980 0.98
tpcds_q81/datafusion:vortex-compact 28150193 29714740 0.95
tpcds_q82/datafusion:vortex-compact 33420388 36956259 0.90
tpcds_q83/datafusion:vortex-compact 33125243 36018558 0.92
tpcds_q84/datafusion:vortex-compact 15284007 16768050 0.91
tpcds_q85/datafusion:vortex-compact 166803017 165641912 1.01
tpcds_q86/datafusion:vortex-compact 🚀 18212668 20569588 0.89
tpcds_q87/datafusion:vortex-compact 52632241 56535541 0.93
tpcds_q88/datafusion:vortex-compact 75993227 81087340 0.94
tpcds_q89/datafusion:vortex-compact 30497399 32577555 0.94
tpcds_q90/datafusion:vortex-compact 14965253 15890598 0.94
tpcds_q91/datafusion:vortex-compact 32630350 35037948 0.93
tpcds_q92/datafusion:vortex-compact 23836276 26363713 0.90
tpcds_q93/datafusion:vortex-compact 39496056 40522304 0.97
tpcds_q94/datafusion:vortex-compact 🚀 25349634 28550314 0.89
tpcds_q95/datafusion:vortex-compact 63839939 70399436 0.91
tpcds_q96/datafusion:vortex-compact 17523281 17763646 0.99
tpcds_q97/datafusion:vortex-compact 35580280 38145512 0.93
tpcds_q98/datafusion:vortex-compact 30156751 32093260 0.94
tpcds_q99/datafusion:vortex-compact 36939526 34152768 1.08
datafusion / parquet (0.930x ➖, 18↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚀 29970459 33973978 0.88
tpcds_q02/datafusion:parquet 41051523 43595802 0.94
tpcds_q03/datafusion:parquet 13018393 14109504 0.92
tpcds_q04/datafusion:parquet 🚀 257037904 287818660 0.89
tpcds_q05/datafusion:parquet 40910440 45328967 0.90
tpcds_q06/datafusion:parquet 57614319 57647423 1.00
tpcds_q07/datafusion:parquet 76796473 79749654 0.96
tpcds_q08/datafusion:parquet 26423370 26972517 0.98
tpcds_q09/datafusion:parquet 44886447 46834942 0.96
tpcds_q10/datafusion:parquet 70967116 72679389 0.98
tpcds_q11/datafusion:parquet 🚀 143511031 161672528 0.89
tpcds_q12/datafusion:parquet 18117300 18426334 0.98
tpcds_q13/datafusion:parquet 74629367 77085653 0.97
tpcds_q14/datafusion:parquet 159179371 173063405 0.92
tpcds_q15/datafusion:parquet 🚀 20739481 25127388 0.83
tpcds_q16/datafusion:parquet 22795274 24996798 0.91
tpcds_q17/datafusion:parquet 66225799 67045253 0.99
tpcds_q18/datafusion:parquet 113539738 118641261 0.96
tpcds_q19/datafusion:parquet 22224012 23607066 0.94
tpcds_q20/datafusion:parquet 🚀 15913856 17866563 0.89
tpcds_q21/datafusion:parquet 18515686 19800945 0.94
tpcds_q22/datafusion:parquet 151824682 164039899 0.93
tpcds_q23/datafusion:parquet 🚀 144109686 165171859 0.87
tpcds_q24/datafusion:parquet 88352259 97365195 0.91
tpcds_q25/datafusion:parquet 64356691 67828166 0.95
tpcds_q26/datafusion:parquet 63927344 67453248 0.95
tpcds_q27/datafusion:parquet 141000070 156038697 0.90
tpcds_q28/datafusion:parquet 44711390 46045517 0.97
tpcds_q29/datafusion:parquet 65383525 69015551 0.95
tpcds_q30/datafusion:parquet 34149919 35978071 0.95
tpcds_q31/datafusion:parquet 🚀 61808615 70401360 0.88
tpcds_q32/datafusion:parquet 🚀 17616127 20574379 0.86
tpcds_q33/datafusion:parquet 26092788 28530544 0.91
tpcds_q34/datafusion:parquet 🚀 20999801 24209284 0.87
tpcds_q35/datafusion:parquet 69033817 74816805 0.92
tpcds_q36/datafusion:parquet 57647420 61121565 0.94
tpcds_q37/datafusion:parquet 🚀 18327337 20619943 0.89
tpcds_q38/datafusion:parquet 40846187 41900997 0.97
tpcds_q39/datafusion:parquet 73871847 81638313 0.90
tpcds_q40/datafusion:parquet 22768503 25077505 0.91
tpcds_q41/datafusion:parquet 13094141 14079983 0.93
tpcds_q42/datafusion:parquet 11385801 12187246 0.93
tpcds_q43/datafusion:parquet 18009525 17949621 1.00
tpcds_q44/datafusion:parquet 32513377 34027270 0.96
tpcds_q45/datafusion:parquet 28477183 29368046 0.97
tpcds_q46/datafusion:parquet 32760725 36135686 0.91
tpcds_q47/datafusion:parquet 124238872 132911340 0.93
tpcds_q48/datafusion:parquet 68065207 72485885 0.94
tpcds_q49/datafusion:parquet 56469531 59437895 0.95
tpcds_q50/datafusion:parquet 44400991 46576450 0.95
tpcds_q51/datafusion:parquet 🚀 84969074 94778274 0.90
tpcds_q52/datafusion:parquet 12070425 12341231 0.98
tpcds_q53/datafusion:parquet 🚀 17158803 19172705 0.89
tpcds_q54/datafusion:parquet 33169612 35909581 0.92
tpcds_q55/datafusion:parquet 11082290 12145170 0.91
tpcds_q56/datafusion:parquet 27297677 27885560 0.98
tpcds_q57/datafusion:parquet 99256263 100597934 0.99
tpcds_q58/datafusion:parquet 50213204 54707862 0.92
tpcds_q59/datafusion:parquet 🚀 56800883 63182640 0.90
tpcds_q60/datafusion:parquet 26848859 29028589 0.92
tpcds_q61/datafusion:parquet 42345204 44888276 0.94
tpcds_q62/datafusion:parquet 24056862 25483511 0.94
tpcds_q63/datafusion:parquet 17907120 18524546 0.97
tpcds_q64/datafusion:parquet 502427639 539580246 0.93
tpcds_q65/datafusion:parquet 39953064 41478889 0.96
tpcds_q66/datafusion:parquet 🚀 66056664 74158251 0.89
tpcds_q67/datafusion:parquet 145269522 157943612 0.92
tpcds_q68/datafusion:parquet 31291467 32671192 0.96
tpcds_q69/datafusion:parquet 63779949 70511514 0.90
tpcds_q70/datafusion:parquet 87343993 92840227 0.94
tpcds_q71/datafusion:parquet 22587474 23395948 0.97
tpcds_q72/datafusion:parquet 603142602 663747883 0.91
tpcds_q73/datafusion:parquet 20160373 21748371 0.93
tpcds_q74/datafusion:parquet 82796715 88220905 0.94
tpcds_q75/datafusion:parquet 95443802 102712825 0.93
tpcds_q76/datafusion:parquet 29193557 32270785 0.90
tpcds_q77/datafusion:parquet 40125462 41316806 0.97
tpcds_q78/datafusion:parquet 113713523 121898722 0.93
tpcds_q79/datafusion:parquet 🚀 24813826 28137549 0.88
tpcds_q80/datafusion:parquet 78551354 86217822 0.91
tpcds_q81/datafusion:parquet 32355215 34086028 0.95
tpcds_q82/datafusion:parquet 19244772 19891289 0.97
tpcds_q83/datafusion:parquet 37490707 38730200 0.97
tpcds_q84/datafusion:parquet 38370914 40695689 0.94
tpcds_q85/datafusion:parquet 148359386 158173153 0.94
tpcds_q86/datafusion:parquet 15297335 16669911 0.92
tpcds_q87/datafusion:parquet 42490728 45419226 0.94
tpcds_q88/datafusion:parquet 58822864 60709589 0.97
tpcds_q89/datafusion:parquet 22172190 24077565 0.92
tpcds_q90/datafusion:parquet 🚀 13944026 15537711 0.90
tpcds_q91/datafusion:parquet 57946612 61422875 0.94
tpcds_q92/datafusion:parquet 17564897 19450672 0.90
tpcds_q93/datafusion:parquet 31757782 34453935 0.92
tpcds_q94/datafusion:parquet 🚀 17710392 20897718 0.85
tpcds_q95/datafusion:parquet 57996297 62601777 0.93
tpcds_q96/datafusion:parquet 🚀 11661216 13026777 0.90
tpcds_q97/datafusion:parquet 29657322 31547463 0.94
tpcds_q98/datafusion:parquet 20638009 22599109 0.91
tpcds_q99/datafusion:parquet 26039855 27610355 0.94
duckdb / vortex-file-compressed (0.938x ➖, 18↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24085659 24266683 0.99
tpcds_q02/duckdb:vortex-file-compressed 33556427 33288744 1.01
tpcds_q03/duckdb:vortex-file-compressed 21805262 23305772 0.94
tpcds_q04/duckdb:vortex-file-compressed 90627892 98057067 0.92
tpcds_q05/duckdb:vortex-file-compressed 32910015 33880951 0.97
tpcds_q06/duckdb:vortex-file-compressed 32182299 35115669 0.92
tpcds_q07/duckdb:vortex-file-compressed 21342089 22629966 0.94
tpcds_q08/duckdb:vortex-file-compressed 26569745 29458147 0.90
tpcds_q09/duckdb:vortex-file-compressed 15737829 16674061 0.94
tpcds_q10/duckdb:vortex-file-compressed 36694057 39407352 0.93
tpcds_q11/duckdb:vortex-file-compressed 63854370 68274833 0.94
tpcds_q12/duckdb:vortex-file-compressed 15986282 17449616 0.92
tpcds_q13/duckdb:vortex-file-compressed 31636079 34089803 0.93
tpcds_q14/duckdb:vortex-file-compressed 95055268 100324784 0.95
tpcds_q15/duckdb:vortex-file-compressed 26459016 28046969 0.94
tpcds_q16/duckdb:vortex-file-compressed 25865931 26451547 0.98
tpcds_q17/duckdb:vortex-file-compressed 42452990 44344059 0.96
tpcds_q18/duckdb:vortex-file-compressed 36192000 39235878 0.92
tpcds_q19/duckdb:vortex-file-compressed 31241909 34188881 0.91
tpcds_q20/duckdb:vortex-file-compressed 17197495 18155755 0.95
tpcds_q21/duckdb:vortex-file-compressed 17791775 17204487 1.03
tpcds_q22/duckdb:vortex-file-compressed 74012366 79416426 0.93
tpcds_q23/duckdb:vortex-file-compressed 96218157 100008768 0.96
tpcds_q24/duckdb:vortex-file-compressed 46555441 49359259 0.94
tpcds_q25/duckdb:vortex-file-compressed 40176662 43679924 0.92
tpcds_q26/duckdb:vortex-file-compressed 20039595 18640413 1.08
tpcds_q27/duckdb:vortex-file-compressed 23534983 23997878 0.98
tpcds_q28/duckdb:vortex-file-compressed 12404203 12583983 0.99
tpcds_q29/duckdb:vortex-file-compressed 39640914 42610941 0.93
tpcds_q30/duckdb:vortex-file-compressed 24330869 26255973 0.93
tpcds_q31/duckdb:vortex-file-compressed 27741269 29649825 0.94
tpcds_q32/duckdb:vortex-file-compressed 🚀 13617084 15145740 0.90
tpcds_q33/duckdb:vortex-file-compressed 23730406 24251748 0.98
tpcds_q34/duckdb:vortex-file-compressed 🚀 24207436 28514293 0.85
tpcds_q35/duckdb:vortex-file-compressed 62891707 66773823 0.94
tpcds_q36/duckdb:vortex-file-compressed 24317051 25169751 0.97
tpcds_q37/duckdb:vortex-file-compressed 🚀 18955260 21703652 0.87
tpcds_q38/duckdb:vortex-file-compressed 36719400 38881488 0.94
tpcds_q39/duckdb:vortex-file-compressed 35008692 36921597 0.95
tpcds_q40/duckdb:vortex-file-compressed 20125305 21103396 0.95
tpcds_q41/duckdb:vortex-file-compressed 10171879 11159004 0.91
tpcds_q42/duckdb:vortex-file-compressed 13265813 13586816 0.98
tpcds_q43/duckdb:vortex-file-compressed 🚀 20234380 23082277 0.88
tpcds_q44/duckdb:vortex-file-compressed 20473430 22660964 0.90
tpcds_q45/duckdb:vortex-file-compressed 29517501 30917066 0.95
tpcds_q46/duckdb:vortex-file-compressed 30692180 31131259 0.99
tpcds_q47/duckdb:vortex-file-compressed 🚀 50900558 59274711 0.86
tpcds_q48/duckdb:vortex-file-compressed 🚀 28152129 31350220 0.90
tpcds_q49/duckdb:vortex-file-compressed 33833735 33632334 1.01
tpcds_q50/duckdb:vortex-file-compressed 27461577 26236326 1.05
tpcds_q51/duckdb:vortex-file-compressed 102172477 107216712 0.95
tpcds_q52/duckdb:vortex-file-compressed 12425479 13417141 0.93
tpcds_q53/duckdb:vortex-file-compressed 23005278 24560659 0.94
tpcds_q54/duckdb:vortex-file-compressed 🚀 28326610 31579149 0.90
tpcds_q55/duckdb:vortex-file-compressed 12384297 13361767 0.93
tpcds_q56/duckdb:vortex-file-compressed 24351407 26516507 0.92
tpcds_q57/duckdb:vortex-file-compressed 41614542 43787472 0.95
tpcds_q58/duckdb:vortex-file-compressed 30624596 31526053 0.97
tpcds_q59/duckdb:vortex-file-compressed 56177272 57639562 0.97
tpcds_q60/duckdb:vortex-file-compressed 25461954 26206375 0.97
tpcds_q61/duckdb:vortex-file-compressed 🚀 29196179 33232223 0.88
tpcds_q62/duckdb:vortex-file-compressed 🚀 14917360 16597425 0.90
tpcds_q63/duckdb:vortex-file-compressed 21414834 21830224 0.98
tpcds_q64/duckdb:vortex-file-compressed 92679221 98581819 0.94
tpcds_q65/duckdb:vortex-file-compressed 22729253 23430049 0.97
tpcds_q66/duckdb:vortex-file-compressed 29849127 31709080 0.94
tpcds_q67/duckdb:vortex-file-compressed 139470583 148743544 0.94
tpcds_q68/duckdb:vortex-file-compressed 30472018 31999664 0.95
tpcds_q69/duckdb:vortex-file-compressed 39128086 41962591 0.93
tpcds_q70/duckdb:vortex-file-compressed 🚀 36556241 41039815 0.89
tpcds_q71/duckdb:vortex-file-compressed 21258445 22302616 0.95
tpcds_q72/duckdb:vortex-file-compressed 169281731 175234510 0.97
tpcds_q73/duckdb:vortex-file-compressed 24688021 25860411 0.95
tpcds_q74/duckdb:vortex-file-compressed 41848387 44348906 0.94
tpcds_q75/duckdb:vortex-file-compressed 🚀 46573501 58916594 0.79
tpcds_q76/duckdb:vortex-file-compressed 19819669 21562826 0.92
tpcds_q77/duckdb:vortex-file-compressed 24604954 24975779 0.99
tpcds_q78/duckdb:vortex-file-compressed 79959613 80934559 0.99
tpcds_q79/duckdb:vortex-file-compressed 23902902 26155351 0.91
tpcds_q80/duckdb:vortex-file-compressed 51819970 49672136 1.04
tpcds_q81/duckdb:vortex-file-compressed 28743836 31407134 0.92
tpcds_q82/duckdb:vortex-file-compressed 44782030 46890644 0.96
tpcds_q83/duckdb:vortex-file-compressed 25414579 27082063 0.94
tpcds_q84/duckdb:vortex-file-compressed 17755537 18009010 0.99
tpcds_q85/duckdb:vortex-file-compressed 🚀 39136348 45522936 0.86
tpcds_q86/duckdb:vortex-file-compressed 🚀 15810686 17605212 0.90
tpcds_q87/duckdb:vortex-file-compressed 🚀 38641347 44220228 0.87
tpcds_q88/duckdb:vortex-file-compressed 55193053 52962443 1.04
tpcds_q89/duckdb:vortex-file-compressed 21856190 23957445 0.91
tpcds_q90/duckdb:vortex-file-compressed 🚀 9977283 11115760 0.90
tpcds_q91/duckdb:vortex-file-compressed 🚀 21178139 23886957 0.89
tpcds_q92/duckdb:vortex-file-compressed 17833862 19316828 0.92
tpcds_q93/duckdb:vortex-file-compressed 28344680 30533200 0.93
tpcds_q94/duckdb:vortex-file-compressed 🚀 20977629 23798449 0.88
tpcds_q95/duckdb:vortex-file-compressed 155696348 167569393 0.93
tpcds_q96/duckdb:vortex-file-compressed 🚀 12472829 14214744 0.88
tpcds_q97/duckdb:vortex-file-compressed 37748824 39658365 0.95
tpcds_q98/duckdb:vortex-file-compressed 18929486 20661373 0.92
tpcds_q99/duckdb:vortex-file-compressed 21719132 23643948 0.92
duckdb / vortex-compact (0.941x ➖, 12↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 26103435 28589038 0.91
tpcds_q02/duckdb:vortex-compact 39562816 38944302 1.02
tpcds_q03/duckdb:vortex-compact 49035487 50589822 0.97
tpcds_q04/duckdb:vortex-compact 101181396 109165894 0.93
tpcds_q05/duckdb:vortex-compact 40792098 39724933 1.03
tpcds_q06/duckdb:vortex-compact 37425860 40914649 0.91
tpcds_q07/duckdb:vortex-compact 34452396 37511210 0.92
tpcds_q08/duckdb:vortex-compact 41629639 42821795 0.97
tpcds_q09/duckdb:vortex-compact 19246566 21337449 0.90
tpcds_q10/duckdb:vortex-compact 50312764 55190160 0.91
tpcds_q11/duckdb:vortex-compact 74733515 76714021 0.97
tpcds_q12/duckdb:vortex-compact 21470237 23026652 0.93
tpcds_q13/duckdb:vortex-compact 51548629 54011759 0.95
tpcds_q14/duckdb:vortex-compact 121602206 118373557 1.03
tpcds_q15/duckdb:vortex-compact 29475896 31990397 0.92
tpcds_q16/duckdb:vortex-compact 27035846 29801901 0.91
tpcds_q17/duckdb:vortex-compact 55044602 58793181 0.94
tpcds_q18/duckdb:vortex-compact 48012044 50555780 0.95
tpcds_q19/duckdb:vortex-compact 42914078 46352119 0.93
tpcds_q20/duckdb:vortex-compact 21112968 23320530 0.91
tpcds_q21/duckdb:vortex-compact 17358223 18877638 0.92
tpcds_q22/duckdb:vortex-compact 80352329 80484697 1.00
tpcds_q23/duckdb:vortex-compact 107038303 108671898 0.98
tpcds_q24/duckdb:vortex-compact 57061438 59812846 0.95
tpcds_q25/duckdb:vortex-compact 53912603 57324857 0.94
tpcds_q26/duckdb:vortex-compact 🚀 30034903 34399984 0.87
tpcds_q27/duckdb:vortex-compact 35632634 38022855 0.94
tpcds_q28/duckdb:vortex-compact 33521755 35036198 0.96
tpcds_q29/duckdb:vortex-compact 51946426 55429637 0.94
tpcds_q30/duckdb:vortex-compact 28357545 31485263 0.90
tpcds_q31/duckdb:vortex-compact 35533875 39184847 0.91
tpcds_q32/duckdb:vortex-compact 21365462 22240982 0.96
tpcds_q33/duckdb:vortex-compact 32898158 32976206 1.00
tpcds_q34/duckdb:vortex-compact 29827939 32747884 0.91
tpcds_q35/duckdb:vortex-compact 75943972 76816033 0.99
tpcds_q36/duckdb:vortex-compact 36281776 37185055 0.98
tpcds_q37/duckdb:vortex-compact 23564402 25684902 0.92
tpcds_q38/duckdb:vortex-compact 🚀 38596431 43819720 0.88
tpcds_q39/duckdb:vortex-compact 37401076 39434543 0.95
tpcds_q40/duckdb:vortex-compact 🚀 23715155 26772802 0.89
tpcds_q41/duckdb:vortex-compact 11696786 12766064 0.92
tpcds_q42/duckdb:vortex-compact 19077795 20095909 0.95
tpcds_q43/duckdb:vortex-compact 🚀 29481009 33278625 0.89
tpcds_q44/duckdb:vortex-compact 29832336 30426808 0.98
tpcds_q45/duckdb:vortex-compact 🚀 36293273 40736610 0.89
tpcds_q46/duckdb:vortex-compact 🚀 43279867 48864652 0.89
tpcds_q47/duckdb:vortex-compact 62834809 65082225 0.97
tpcds_q48/duckdb:vortex-compact 44368078 48768870 0.91
tpcds_q49/duckdb:vortex-compact 48646536 50786385 0.96
tpcds_q50/duckdb:vortex-compact 38096006 38987138 0.98
tpcds_q51/duckdb:vortex-compact 🚀 109493777 123007025 0.89
tpcds_q52/duckdb:vortex-compact 18890556 19938436 0.95
tpcds_q53/duckdb:vortex-compact 31884334 35019876 0.91
tpcds_q54/duckdb:vortex-compact 36653790 39629827 0.92
tpcds_q55/duckdb:vortex-compact 18552142 19246228 0.96
tpcds_q56/duckdb:vortex-compact 33025941 33521812 0.99
tpcds_q57/duckdb:vortex-compact 45390577 47458530 0.96
tpcds_q58/duckdb:vortex-compact 🚀 37546009 41867057 0.90
tpcds_q59/duckdb:vortex-compact 67365535 68407647 0.98
tpcds_q60/duckdb:vortex-compact 35755400 36577398 0.98
tpcds_q61/duckdb:vortex-compact 54471728 53897574 1.01
tpcds_q62/duckdb:vortex-compact 20379952 22225945 0.92
tpcds_q63/duckdb:vortex-compact 31059535 33049997 0.94
tpcds_q64/duckdb:vortex-compact 126165611 132389200 0.95
tpcds_q65/duckdb:vortex-compact 30018971 31437531 0.95
tpcds_q66/duckdb:vortex-compact 🚀 34434660 38607084 0.89
tpcds_q67/duckdb:vortex-compact 146940938 161228080 0.91
tpcds_q68/duckdb:vortex-compact 47143553 46374555 1.02
tpcds_q69/duckdb:vortex-compact 54207939 57907587 0.94
tpcds_q70/duckdb:vortex-compact 57814427 60304069 0.96
tpcds_q71/duckdb:vortex-compact 28607546 30323593 0.94
tpcds_q72/duckdb:vortex-compact 181210494 186925738 0.97
tpcds_q73/duckdb:vortex-compact 28344185 29030576 0.98
tpcds_q74/duckdb:vortex-compact 47319874 50957109 0.93
tpcds_q75/duckdb:vortex-compact 59752218 63316444 0.94
tpcds_q76/duckdb:vortex-compact 29602012 28771392 1.03
tpcds_q77/duckdb:vortex-compact 35633573 38196025 0.93
tpcds_q78/duckdb:vortex-compact 88240514 89667197 0.98
tpcds_q79/duckdb:vortex-compact 38555804 40337281 0.96
tpcds_q80/duckdb:vortex-compact 69046825 73820106 0.94
tpcds_q81/duckdb:vortex-compact 33588834 35444216 0.95
tpcds_q82/duckdb:vortex-compact 49141991 52189335 0.94
tpcds_q83/duckdb:vortex-compact 34883538 37899735 0.92
tpcds_q84/duckdb:vortex-compact 20603145 22780057 0.90
tpcds_q85/duckdb:vortex-compact 51156324 55668795 0.92
tpcds_q86/duckdb:vortex-compact 21773547 22373095 0.97
tpcds_q87/duckdb:vortex-compact 43601973 47358498 0.92
tpcds_q88/duckdb:vortex-compact 77617953 77901599 1.00
tpcds_q89/duckdb:vortex-compact 31373521 32870243 0.95
tpcds_q90/duckdb:vortex-compact 🚀 10526509 11840154 0.89
tpcds_q91/duckdb:vortex-compact 40295130 42621418 0.95
tpcds_q92/duckdb:vortex-compact 46839552 46633709 1.00
tpcds_q93/duckdb:vortex-compact 🚀 32148665 36730347 0.88
tpcds_q94/duckdb:vortex-compact 27242733 29126070 0.94
tpcds_q95/duckdb:vortex-compact 161383047 178179976 0.91
tpcds_q96/duckdb:vortex-compact 16076160 16880901 0.95
tpcds_q97/duckdb:vortex-compact 🚀 41172754 47894015 0.86
tpcds_q98/duckdb:vortex-compact 27732439 28757505 0.96
tpcds_q99/duckdb:vortex-compact 25564381 27080878 0.94
duckdb / parquet (0.965x ➖, 4↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29105485 29518647 0.99
tpcds_q02/duckdb:parquet 24092791 24983615 0.96
tpcds_q03/duckdb:parquet 13075433 13173032 0.99
tpcds_q04/duckdb:parquet 169253058 175188497 0.97
tpcds_q05/duckdb:parquet 31675017 32035410 0.99
tpcds_q06/duckdb:parquet 33205765 34121328 0.97
tpcds_q07/duckdb:parquet 24005013 24798764 0.97
tpcds_q08/duckdb:parquet 30068561 30340232 0.99
tpcds_q09/duckdb:parquet 44241111 45821689 0.97
tpcds_q10/duckdb:parquet 37500333 39854893 0.94
tpcds_q11/duckdb:parquet 90786888 96882395 0.94
tpcds_q12/duckdb:parquet 17227601 17877594 0.96
tpcds_q13/duckdb:parquet 34760479 35734144 0.97
tpcds_q14/duckdb:parquet 101932227 107116153 0.95
tpcds_q15/duckdb:parquet 30006117 32017299 0.94
tpcds_q16/duckdb:parquet 22590141 23633624 0.96
tpcds_q17/duckdb:parquet 40899660 40482047 1.01
tpcds_q18/duckdb:parquet 48114768 49224543 0.98
tpcds_q19/duckdb:parquet 31618756 32406368 0.98
tpcds_q20/duckdb:parquet 18336545 19345842 0.95
tpcds_q21/duckdb:parquet 11847024 12189806 0.97
tpcds_q22/duckdb:parquet 🚀 70076346 79241481 0.88
tpcds_q23/duckdb:parquet 81827578 83012792 0.99
tpcds_q24/duckdb:parquet 46667103 48925983 0.95
tpcds_q25/duckdb:parquet 35577777 36526471 0.97
tpcds_q26/duckdb:parquet 38022085 41534899 0.92
tpcds_q27/duckdb:parquet 52364789 55398223 0.95
tpcds_q28/duckdb:parquet 42748016 43111870 0.99
tpcds_q29/duckdb:parquet 38292537 39528064 0.97
tpcds_q30/duckdb:parquet 37122199 38605089 0.96
tpcds_q31/duckdb:parquet 27716828 29860469 0.93
tpcds_q32/duckdb:parquet 12324242 12991942 0.95
tpcds_q33/duckdb:parquet 24486943 24255550 1.01
tpcds_q34/duckdb:parquet 22751888 23140834 0.98
tpcds_q35/duckdb:parquet 61661004 64862724 0.95
tpcds_q36/duckdb:parquet 22521489 22904641 0.98
tpcds_q37/duckdb:parquet 🚀 13925617 15795849 0.88
tpcds_q38/duckdb:parquet 36748552 37858061 0.97
tpcds_q39/duckdb:parquet 31626523 33384634 0.95
tpcds_q40/duckdb:parquet 19640525 20754862 0.95
tpcds_q41/duckdb:parquet 8692785 9558689 0.91
tpcds_q42/duckdb:parquet 13637128 12726526 1.07
tpcds_q43/duckdb:parquet 🚀 17736996 19964377 0.89
tpcds_q44/duckdb:parquet 26570950 26628713 1.00
tpcds_q45/duckdb:parquet 28178879 30621792 0.92
tpcds_q46/duckdb:parquet 47640337 49993164 0.95
tpcds_q47/duckdb:parquet 49429920 51943794 0.95
tpcds_q48/duckdb:parquet 31782575 32987839 0.96
tpcds_q49/duckdb:parquet 28681143 29150653 0.98
tpcds_q50/duckdb:parquet 26187629 27117279 0.97
tpcds_q51/duckdb:parquet 104362246 109595523 0.95
tpcds_q52/duckdb:parquet 13276462 13245585 1.00
tpcds_q53/duckdb:parquet 19249351 20053065 0.96
tpcds_q54/duckdb:parquet 28394826 29443743 0.96
tpcds_q55/duckdb:parquet 13050611 14048443 0.93
tpcds_q56/duckdb:parquet 24690538 25198416 0.98
tpcds_q57/duckdb:parquet 38168999 39334728 0.97
tpcds_q58/duckdb:parquet 26005332 27260007 0.95
tpcds_q59/duckdb:parquet 36095392 37102047 0.97
tpcds_q60/duckdb:parquet 25765357 26638715 0.97
tpcds_q61/duckdb:parquet 33562584 34301047 0.98
tpcds_q62/duckdb:parquet 12589063 13107488 0.96
tpcds_q63/duckdb:parquet 17666652 17486075 1.01
tpcds_q64/duckdb:parquet 77801543 78550791 0.99
tpcds_q65/duckdb:parquet 22599314 23043279 0.98
tpcds_q66/duckdb:parquet 32618531 30050499 1.09
tpcds_q67/duckdb:parquet 137745662 140100246 0.98
tpcds_q68/duckdb:parquet 38661419 39623035 0.98
tpcds_q69/duckdb:parquet 38796720 39212727 0.99
tpcds_q70/duckdb:parquet 22900376 23248840 0.99
tpcds_q71/duckdb:parquet 22347391 23655415 0.94
tpcds_q72/duckdb:parquet 165600477 168501971 0.98
tpcds_q73/duckdb:parquet 20599984 20357973 1.01
tpcds_q74/duckdb:parquet 124705902 129624376 0.96
tpcds_q75/duckdb:parquet 57872753 59460452 0.97
tpcds_q76/duckdb:parquet 22644281 22542766 1.00
tpcds_q77/duckdb:parquet 24752847 26164071 0.95
tpcds_q78/duckdb:parquet 77482048 80418136 0.96
tpcds_q79/duckdb:parquet 30964766 29879777 1.04
tpcds_q80/duckdb:parquet 45926927 45214400 1.02
tpcds_q81/duckdb:parquet 34813980 34686234 1.00
tpcds_q82/duckdb:parquet 16451564 17778798 0.93
tpcds_q83/duckdb:parquet 18442895 19169046 0.96
tpcds_q84/duckdb:parquet 20548948 22309499 0.92
tpcds_q85/duckdb:parquet 42301720 44932309 0.94
tpcds_q86/duckdb:parquet 13681609 14188190 0.96
tpcds_q87/duckdb:parquet 38807142 40618821 0.96
tpcds_q88/duckdb:parquet 53528829 55172836 0.97
tpcds_q89/duckdb:parquet 21820236 23124433 0.94
tpcds_q90/duckdb:parquet 8395272 8760996 0.96
tpcds_q91/duckdb:parquet 25506859 26018758 0.98
tpcds_q92/duckdb:parquet 12954389 13840203 0.94
tpcds_q93/duckdb:parquet 31584728 33655085 0.94
tpcds_q94/duckdb:parquet 17789783 18968095 0.94
tpcds_q95/duckdb:parquet 123247725 128023035 0.96
tpcds_q96/duckdb:parquet 10511135 10628306 0.99
tpcds_q97/duckdb:parquet 🚀 37020274 41384202 0.89
tpcds_q98/duckdb:parquet 22713709 25214325 0.90
tpcds_q99/duckdb:parquet 20210748 20702882 0.98
duckdb / duckdb (0.957x ➖, 3↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 21082789 23229812 0.91
tpcds_q02/duckdb:duckdb 19144503 19639218 0.97
tpcds_q03/duckdb:duckdb 10344406 10373297 1.00
tpcds_q04/duckdb:duckdb 176072228 181359787 0.97
tpcds_q05/duckdb:duckdb 21295256 22714319 0.94
tpcds_q06/duckdb:duckdb 28195774 29000767 0.97
tpcds_q07/duckdb:duckdb 39993987 42449906 0.94
tpcds_q08/duckdb:duckdb 119852515 122329835 0.98
tpcds_q09/duckdb:duckdb 20674818 21294196 0.97
tpcds_q10/duckdb:duckdb 27855594 28350960 0.98
tpcds_q11/duckdb:duckdb 94650497 99740626 0.95
tpcds_q12/duckdb:duckdb 13836153 14496632 0.95
tpcds_q13/duckdb:duckdb 25970513 27595571 0.94
tpcds_q14/duckdb:duckdb 94535023 97105657 0.97
tpcds_q15/duckdb:duckdb 24680501 26590090 0.93
tpcds_q16/duckdb:duckdb 19045859 19845244 0.96
tpcds_q17/duckdb:duckdb 24795251 25972793 0.95
tpcds_q18/duckdb:duckdb 46401752 48868212 0.95
tpcds_q19/duckdb:duckdb 19022525 20124119 0.95
tpcds_q20/duckdb:duckdb 14162141 15031050 0.94
tpcds_q21/duckdb:duckdb 8901374 8349894 1.07
tpcds_q22/duckdb:duckdb 61206688 66431412 0.92
tpcds_q23/duckdb:duckdb 79651396 83247349 0.96
tpcds_q24/duckdb:duckdb 25426985 26613654 0.96
tpcds_q25/duckdb:duckdb 19020809 19705148 0.97
tpcds_q26/duckdb:duckdb 28297194 29997059 0.94
tpcds_q27/duckdb:duckdb 40520104 44256621 0.92
tpcds_q28/duckdb:duckdb 26288700 26845220 0.98
tpcds_q29/duckdb:duckdb 23106618 24198356 0.95
tpcds_q30/duckdb:duckdb 30802619 32082012 0.96
tpcds_q31/duckdb:duckdb 51447168 54401745 0.95
tpcds_q32/duckdb:duckdb 8337537 9214184 0.90
tpcds_q33/duckdb:duckdb 16135987 16514156 0.98
tpcds_q34/duckdb:duckdb 18653209 19481280 0.96
tpcds_q35/duckdb:duckdb 37044157 37646498 0.98
tpcds_q36/duckdb:duckdb 68850982 75680027 0.91
tpcds_q37/duckdb:duckdb 9070359 9635665 0.94
tpcds_q38/duckdb:duckdb 33375748 34261194 0.97
tpcds_q39/duckdb:duckdb 28371703 28792473 0.99
tpcds_q40/duckdb:duckdb 14605296 15685632 0.93
tpcds_q41/duckdb:duckdb 9417705 9744606 0.97
tpcds_q42/duckdb:duckdb 8948645 9415282 0.95
tpcds_q43/duckdb:duckdb 14811237 15310377 0.97
tpcds_q44/duckdb:duckdb 15808577 15618328 1.01
tpcds_q45/duckdb:duckdb 18627920 19764407 0.94
tpcds_q46/duckdb:duckdb 38173652 40564546 0.94
tpcds_q47/duckdb:duckdb 45739062 48582925 0.94
tpcds_q48/duckdb:duckdb 24905339 25959565 0.96
tpcds_q49/duckdb:duckdb 21034642 21423885 0.98
tpcds_q50/duckdb:duckdb 15729625 16677272 0.94
tpcds_q51/duckdb:duckdb 97592896 103173159 0.95
tpcds_q52/duckdb:duckdb 9352727 9847382 0.95
tpcds_q53/duckdb:duckdb 17339364 18416847 0.94
tpcds_q54/duckdb:duckdb 19207524 19881382 0.97
tpcds_q55/duckdb:duckdb 10265025 9347500 1.10
tpcds_q56/duckdb:duckdb 15971209 17375543 0.92
tpcds_q57/duckdb:duckdb 36476547 37723967 0.97
tpcds_q58/duckdb:duckdb 17097304 16715265 1.02
tpcds_q59/duckdb:duckdb 37507070 37343447 1.00
tpcds_q60/duckdb:duckdb 18611023 19012537 0.98
tpcds_q61/duckdb:duckdb 17224667 16821987 1.02
tpcds_q62/duckdb:duckdb 9917286 10691265 0.93
tpcds_q63/duckdb:duckdb 16047084 16570885 0.97
tpcds_q64/duckdb:duckdb 57601978 60262063 0.96
tpcds_q65/duckdb:duckdb 36531276 37508987 0.97
tpcds_q66/duckdb:duckdb 26372502 28328106 0.93
tpcds_q67/duckdb:duckdb 131720183 138598363 0.95
tpcds_q68/duckdb:duckdb 26812104 27254331 0.98
tpcds_q69/duckdb:duckdb 28453247 28828434 0.99
tpcds_q70/duckdb:duckdb 17135351 16751580 1.02
tpcds_q71/duckdb:duckdb 16837388 16031021 1.05
tpcds_q72/duckdb:duckdb 45220238 47656800 0.95
tpcds_q73/duckdb:duckdb 13862912 14667014 0.95
tpcds_q74/duckdb:duckdb 144162788 149603404 0.96
tpcds_q75/duckdb:duckdb 45370984 48307153 0.94
tpcds_q76/duckdb:duckdb 14956579 14677397 1.02
tpcds_q77/duckdb:duckdb 15750175 16884443 0.93
tpcds_q78/duckdb:duckdb 64928160 67328434 0.96
tpcds_q79/duckdb:duckdb 19966545 20941926 0.95
tpcds_q80/duckdb:duckdb 31054859 32396737 0.96
tpcds_q81/duckdb:duckdb 39808093 41945765 0.95
tpcds_q82/duckdb:duckdb 10309447 11263002 0.92
tpcds_q83/duckdb:duckdb 10742941 11767731 0.91
tpcds_q84/duckdb:duckdb 14723703 15879459 0.93
tpcds_q85/duckdb:duckdb 🚀 24928593 28024264 0.89
tpcds_q86/duckdb:duckdb 12084055 12834461 0.94
tpcds_q87/duckdb:duckdb 35649726 37162452 0.96
tpcds_q88/duckdb:duckdb 29993325 31976081 0.94
tpcds_q89/duckdb:duckdb 21772285 22657425 0.96
tpcds_q90/duckdb:duckdb 🚀 6083068 6769326 0.90
tpcds_q91/duckdb:duckdb 15154588 15150700 1.00
tpcds_q92/duckdb:duckdb 9733029 10583825 0.92
tpcds_q93/duckdb:duckdb 23471057 25179910 0.93
tpcds_q94/duckdb:duckdb 14590438 15447292 0.94
tpcds_q95/duckdb:duckdb 106466589 116283003 0.92
tpcds_q96/duckdb:duckdb 🚀 5895746 6642174 0.89
tpcds_q97/duckdb:duckdb 31423087 33820304 0.93
tpcds_q98/duckdb:duckdb 20387422 20732154 0.98
tpcds_q99/duckdb:duckdb 16678976 17471081 0.95

File Size Changes (7 files changed, -0.0% overall, 4↑ 3↓)
File Scale Format Base HEAD Change %
date_dim.vortex 1.0 vortex-file-compressed 1.02 MB 1.03 MB +13.98 KB +1.3%
customer_address.vortex 1.0 vortex-file-compressed 827.23 KB 829.57 KB +2.34 KB +0.3%
item.vortex 1.0 vortex-compact 994.34 KB 994.61 KB +272 B +0.0%
catalog_page.vortex 1.0 vortex-file-compressed 572.16 KB 572.17 KB +16 B +0.0%
time_dim.vortex 1.0 vortex-file-compressed 380.41 KB 379.95 KB 480 B -0.1%
item.vortex 1.0 vortex-file-compressed 1.67 MB 1.66 MB 3.81 KB -0.2%
customer.vortex 1.0 vortex-file-compressed 4.27 MB 4.18 MB 90.38 KB -2.1%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (+0.0%)
  • vortex-file-compressed: 271.84 MB → 271.76 MB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.6% -6.7% -0.9% +19.5% ➖ noise
1 datafusion:vortex-file-compressed -2.2% -6.7% +4.9% +19.8% ➖ noise
1 duckdb:duckdb -9.2% -6.7% -2.7% +19.1% ➖ noise
1 duckdb:vortex-compact -8.7% -6.7% -2.1% +30.9% ➖ noise
1 duckdb:vortex-file-compressed -0.7% -6.7% +6.4% +31.9% ➖ noise
2 datafusion:vortex-compact -4.2% -4.7% +0.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -9.3% -4.7% -4.8% +10.0% ➖ noise
2 duckdb:duckdb -2.5% -4.7% +2.3% +10.0% ➖ noise
2 duckdb:vortex-compact +1.6% -4.7% +6.6% +27.6% ➖ noise
2 duckdb:vortex-file-compressed +0.8% -4.7% +5.8% +21.8% ➖ noise
3 datafusion:vortex-compact -5.9% -4.3% -1.7% +34.9% ➖ noise
3 datafusion:vortex-file-compressed -4.4% -4.3% -0.1% +11.8% ➖ noise
3 duckdb:duckdb -0.3% -4.3% +4.2% +10.0% ➖ noise
3 duckdb:vortex-compact -3.1% -4.3% +1.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -6.4% -4.3% -2.2% +10.0% ➖ noise
4 datafusion:vortex-compact -4.2% -7.1% +3.1% +11.2% ➖ noise
4 datafusion:vortex-file-compressed -9.6% -7.1% -2.7% +11.8% ➖ noise
4 duckdb:duckdb -2.9% -7.1% +4.5% +10.0% ➖ noise
4 duckdb:vortex-compact -7.3% -7.1% -0.2% +11.8% ➖ noise
4 duckdb:vortex-file-compressed -7.6% -7.1% -0.5% +10.0% ➖ noise
5 datafusion:vortex-compact -10.4% -5.5% -5.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -14.3% -5.5% -9.3% +10.0% ✅ faster
5 duckdb:duckdb -6.2% -5.5% -0.8% +12.3% ➖ noise
5 duckdb:vortex-compact +2.7% -5.5% +8.7% +10.6% ➖ noise
5 duckdb:vortex-file-compressed -2.9% -5.5% +2.8% +11.6% ➖ noise
6 datafusion:vortex-compact -6.9% -1.4% -5.6% +14.8% ➖ noise
6 datafusion:vortex-file-compressed +0.6% -1.4% +2.0% +13.9% ➖ noise
6 duckdb:duckdb -2.8% -1.4% -1.4% +10.0% ➖ noise
6 duckdb:vortex-compact -8.5% -1.4% -7.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -8.4% -1.4% -7.1% +10.0% ➖ noise
7 datafusion:vortex-compact -3.7% -3.5% -0.3% +20.2% ➖ noise
7 datafusion:vortex-file-compressed -6.6% -3.5% -3.3% +10.0% ➖ noise
7 duckdb:duckdb -5.8% -3.5% -2.4% +13.9% ➖ noise
7 duckdb:vortex-compact -8.2% -3.5% -4.9% +21.4% ➖ noise
7 duckdb:vortex-file-compressed -5.7% -3.5% -2.3% +10.0% ➖ noise
8 datafusion:vortex-compact -1.9% -1.5% -0.4% +19.9% ➖ noise
8 datafusion:vortex-file-compressed -9.8% -1.5% -8.5% +25.9% ➖ noise
8 duckdb:duckdb -2.0% -1.5% -0.6% +10.0% ➖ noise
8 duckdb:vortex-compact -2.8% -1.5% -1.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -9.8% -1.5% -8.5% +25.8% ➖ noise
9 datafusion:vortex-compact -0.8% -3.8% +3.1% +11.1% ➖ noise
9 datafusion:vortex-file-compressed -6.5% -3.8% -2.8% +10.0% ➖ noise
9 duckdb:duckdb -2.9% -3.8% +0.9% +10.0% ➖ noise
9 duckdb:vortex-compact -9.8% -3.8% -6.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -5.6% -3.8% -1.9% +13.9% ➖ noise
10 datafusion:vortex-compact -9.9% -4.1% -6.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -7.4% -4.1% -3.4% +12.7% ➖ noise
10 duckdb:duckdb -1.7% -4.1% +2.5% +12.8% ➖ noise
10 duckdb:vortex-compact -8.8% -4.1% -4.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -6.9% -4.1% -2.9% +10.0% ➖ noise
11 datafusion:vortex-compact -4.8% -8.8% +4.4% +13.2% ➖ noise
11 datafusion:vortex-file-compressed -6.8% -8.8% +2.2% +11.5% ➖ noise
11 duckdb:duckdb -5.1% -8.8% +4.0% +13.1% ➖ noise
11 duckdb:vortex-compact -2.6% -8.8% +6.8% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -6.5% -8.8% +2.5% +10.0% ➖ noise
12 datafusion:vortex-compact -3.8% -2.7% -1.2% +16.1% ➖ noise
12 datafusion:vortex-file-compressed -7.5% -2.7% -5.0% +11.9% ➖ noise
12 duckdb:duckdb -4.6% -2.7% -1.9% +10.0% ➖ noise
12 duckdb:vortex-compact -6.8% -2.7% -4.2% +11.2% ➖ noise
12 duckdb:vortex-file-compressed -8.4% -2.7% -5.9% +10.0% ➖ noise
13 datafusion:vortex-compact -6.5% -3.0% -3.7% +24.1% ➖ noise
13 datafusion:vortex-file-compressed -1.9% -3.0% +1.1% +10.0% ➖ noise
13 duckdb:duckdb -5.9% -3.0% -3.0% +10.0% ➖ noise
13 duckdb:vortex-compact -4.6% -3.0% -1.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -7.2% -3.0% -4.4% +12.8% ➖ noise
14 datafusion:vortex-compact -8.0% -6.4% -1.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -7.4% -6.4% -1.0% +10.0% ➖ noise
14 duckdb:duckdb -2.6% -6.4% +4.1% +10.0% ➖ noise
14 duckdb:vortex-compact +2.7% -6.4% +9.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -5.3% -6.4% +1.3% +10.0% ➖ noise
15 datafusion:vortex-compact -4.5% -12.0% +8.6% +16.0% ➖ noise
15 datafusion:vortex-file-compressed -6.1% -12.0% +6.8% +23.6% ➖ noise
15 duckdb:duckdb -7.2% -12.0% +5.5% +10.0% ➖ noise
15 duckdb:vortex-compact -7.9% -12.0% +4.8% +17.6% ➖ noise
15 duckdb:vortex-file-compressed -5.7% -12.0% +7.3% +10.0% ➖ noise
16 datafusion:vortex-compact -11.2% -6.6% -4.9% +15.1% ➖ noise
16 datafusion:vortex-file-compressed -13.3% -6.6% -7.1% +14.5% ➖ noise
16 duckdb:duckdb -4.0% -6.6% +2.8% +16.3% ➖ noise
16 duckdb:vortex-compact -9.3% -6.6% -2.8% +16.8% ➖ noise
16 duckdb:vortex-file-compressed -2.2% -6.6% +4.7% +26.3% ➖ noise
17 datafusion:vortex-compact -4.0% -0.1% -3.9% +10.2% ➖ noise
17 datafusion:vortex-file-compressed -7.5% -0.1% -7.4% +11.5% ➖ noise
17 duckdb:duckdb -4.5% -0.1% -4.4% +11.7% ➖ noise
17 duckdb:vortex-compact -6.4% -0.1% -6.3% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -4.3% -0.1% -4.2% +11.5% ➖ noise
18 datafusion:vortex-compact -8.2% -3.3% -5.0% +13.4% ➖ noise
18 datafusion:vortex-file-compressed -7.8% -3.3% -4.7% +10.0% ➖ noise
18 duckdb:duckdb -5.0% -3.3% -1.8% +10.0% ➖ noise
18 duckdb:vortex-compact -5.0% -3.3% -1.8% +13.8% ➖ noise
18 duckdb:vortex-file-compressed -7.8% -3.3% -4.6% +10.0% ➖ noise
19 datafusion:vortex-compact -7.0% -4.2% -2.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +1.6% -4.2% +6.0% +13.4% ➖ noise
19 duckdb:duckdb -5.5% -4.2% -1.4% +10.0% ➖ noise
19 duckdb:vortex-compact -7.4% -4.2% -3.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -8.6% -4.2% -4.7% +10.0% ➖ noise
20 datafusion:vortex-compact -5.0% -8.1% +3.4% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -4.6% -8.1% +3.8% +10.0% ➖ noise
20 duckdb:duckdb -5.8% -8.1% +2.5% +10.0% ➖ noise
20 duckdb:vortex-compact -9.5% -8.1% -1.5% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -5.3% -8.1% +3.1% +10.5% ➖ noise
21 datafusion:vortex-compact -5.1% -4.7% -0.5% +10.6% ➖ noise
21 datafusion:vortex-file-compressed -7.5% -4.7% -3.0% +20.8% ➖ noise
21 duckdb:duckdb +6.6% -4.7% +11.8% +17.9% ➖ noise
21 duckdb:vortex-compact -8.0% -4.7% -3.5% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +3.4% -4.7% +8.5% +10.3% ➖ noise
22 datafusion:vortex-compact -16.3% -9.5% -7.5% +27.6% ➖ noise
22 datafusion:vortex-file-compressed -5.2% -9.5% +4.8% +24.5% ➖ noise
22 duckdb:duckdb -7.9% -9.5% +1.8% +14.1% ➖ noise
22 duckdb:vortex-compact -0.2% -9.5% +10.4% +16.9% ➖ noise
22 duckdb:vortex-file-compressed -6.8% -9.5% +3.0% +13.3% ➖ noise
23 datafusion:vortex-compact -5.2% -7.3% +2.2% +12.6% ➖ noise
23 datafusion:vortex-file-compressed -10.9% -7.3% -4.0% +10.0% ➖ noise
23 duckdb:duckdb -4.3% -7.3% +3.2% +10.0% ➖ noise
23 duckdb:vortex-compact -1.5% -7.3% +6.2% +17.0% ➖ noise
23 duckdb:vortex-file-compressed -3.8% -7.3% +3.7% +14.9% ➖ noise
24 datafusion:vortex-compact -6.4% -7.0% +0.6% +11.1% ➖ noise
24 datafusion:vortex-file-compressed -9.7% -7.0% -2.9% +14.2% ➖ noise
24 duckdb:duckdb -4.5% -7.0% +2.7% +10.0% ➖ noise
24 duckdb:vortex-compact -4.6% -7.0% +2.5% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -5.7% -7.0% +1.4% +19.3% ➖ noise
25 datafusion:vortex-compact -2.2% -3.9% +1.7% +13.0% ➖ noise
25 datafusion:vortex-file-compressed -10.0% -3.9% -6.3% +10.0% ➖ noise
25 duckdb:duckdb -3.5% -3.9% +0.4% +10.0% ➖ noise
25 duckdb:vortex-compact -6.0% -3.9% -2.2% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -8.0% -3.9% -4.3% +10.0% ➖ noise
26 datafusion:vortex-compact -7.2% -6.9% -0.4% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -6.8% -6.9% +0.1% +10.0% ➖ noise
26 duckdb:duckdb -5.7% -6.9% +1.3% +10.0% ➖ noise
26 duckdb:vortex-compact -12.7% -6.9% -6.3% +10.2% ➖ noise
26 duckdb:vortex-file-compressed +7.5% -6.9% +15.4% +18.7% ➖ noise
27 datafusion:vortex-compact -7.4% -7.6% +0.2% +12.9% ➖ noise
27 datafusion:vortex-file-compressed -10.4% -7.6% -3.0% +10.2% ➖ noise
27 duckdb:duckdb -8.4% -7.6% -0.9% +10.0% ➖ noise
27 duckdb:vortex-compact -6.3% -7.6% +1.4% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -1.9% -7.6% +6.1% +10.0% ➖ noise
28 datafusion:vortex-compact -6.4% -1.9% -4.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -5.1% -1.9% -3.3% +10.0% ➖ noise
28 duckdb:duckdb -2.1% -1.9% -0.2% +10.0% ➖ noise
28 duckdb:vortex-compact -4.3% -1.9% -2.5% +20.0% ➖ noise
28 duckdb:vortex-file-compressed -1.4% -1.9% +0.5% +13.1% ➖ noise
29 datafusion:vortex-compact -7.0% -4.2% -2.9% +23.6% ➖ noise
29 datafusion:vortex-file-compressed -8.6% -4.2% -4.6% +10.0% ➖ noise
29 duckdb:duckdb -4.5% -4.2% -0.3% +10.0% ➖ noise
29 duckdb:vortex-compact -6.3% -4.2% -2.2% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -7.0% -4.2% -2.9% +10.3% ➖ noise
30 datafusion:vortex-compact -10.2% -4.5% -6.0% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -8.7% -4.5% -4.4% +10.0% ➖ noise
30 duckdb:duckdb -4.0% -4.5% +0.5% +10.0% ➖ noise
30 duckdb:vortex-compact -9.9% -4.5% -5.7% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -7.3% -4.5% -3.0% +10.0% ➖ noise
31 datafusion:vortex-compact -7.0% -9.7% +3.0% +10.7% ➖ noise
31 datafusion:vortex-file-compressed -8.7% -9.7% +1.2% +10.2% ➖ noise
31 duckdb:duckdb -5.4% -9.7% +4.8% +10.0% ➖ noise
31 duckdb:vortex-compact -9.3% -9.7% +0.5% +10.1% ➖ noise
31 duckdb:vortex-file-compressed -6.4% -9.7% +3.6% +15.5% ➖ noise
32 datafusion:vortex-compact -8.1% -9.9% +2.0% +14.0% ➖ noise
32 datafusion:vortex-file-compressed -6.4% -9.9% +3.9% +17.7% ➖ noise
32 duckdb:duckdb -9.5% -9.9% +0.4% +15.5% ➖ noise
32 duckdb:vortex-compact -3.9% -9.9% +6.6% +23.8% ➖ noise
32 duckdb:vortex-file-compressed -10.1% -9.9% -0.2% +11.5% ➖ noise
33 datafusion:vortex-compact -3.3% -3.9% +0.6% +12.7% ➖ noise
33 datafusion:vortex-file-compressed -2.1% -3.9% +1.9% +10.0% ➖ noise
33 duckdb:duckdb -2.3% -3.9% +1.7% +10.0% ➖ noise
33 duckdb:vortex-compact -0.2% -3.9% +3.8% +25.5% ➖ noise
33 duckdb:vortex-file-compressed -2.1% -3.9% +1.8% +10.0% ➖ noise
34 datafusion:vortex-compact -4.6% -7.7% +3.3% +11.4% ➖ noise
34 datafusion:vortex-file-compressed -7.2% -7.7% +0.5% +10.0% ➖ noise
34 duckdb:duckdb -4.3% -7.7% +3.7% +10.0% ➖ noise
34 duckdb:vortex-compact -8.9% -7.7% -1.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -15.1% -7.7% -8.1% +10.2% ➖ noise
35 datafusion:vortex-compact -7.3% -6.3% -1.0% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -8.1% -6.3% -1.9% +15.9% ➖ noise
35 duckdb:duckdb -1.6% -6.3% +5.1% +10.0% ➖ noise
35 duckdb:vortex-compact -1.1% -6.3% +5.6% +10.4% ➖ noise
35 duckdb:vortex-file-compressed -5.8% -6.3% +0.6% +10.0% ➖ noise
36 datafusion:vortex-compact -2.6% -3.7% +1.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +3.3% -3.7% +7.3% +10.7% ➖ noise
36 duckdb:duckdb -9.0% -3.7% -5.5% +10.0% ➖ noise
36 duckdb:vortex-compact -2.4% -3.7% +1.3% +13.7% ➖ noise
36 duckdb:vortex-file-compressed -3.4% -3.7% +0.3% +10.0% ➖ noise
37 datafusion:vortex-compact +0.1% -11.5% +13.1% +16.3% ➖ noise
37 datafusion:vortex-file-compressed -8.4% -11.5% +3.5% +15.0% ➖ noise
37 duckdb:duckdb -5.9% -11.5% +6.3% +10.0% ➖ noise
37 duckdb:vortex-compact -8.3% -11.5% +3.6% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -12.7% -11.5% -1.3% +25.5% ➖ noise
38 datafusion:vortex-compact -2.5% -2.7% +0.2% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -8.9% -2.7% -6.4% +10.0% ➖ noise
38 duckdb:duckdb -2.6% -2.7% +0.1% +10.0% ➖ noise
38 duckdb:vortex-compact -11.9% -2.7% -9.5% +10.0% ✅ faster
38 duckdb:vortex-file-compressed -5.6% -2.7% -2.9% +10.1% ➖ noise
39 datafusion:vortex-compact -7.1% -7.4% +0.3% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -7.2% -7.4% +0.3% +11.5% ➖ noise
39 duckdb:duckdb -1.5% -7.4% +6.4% +17.2% ➖ noise
39 duckdb:vortex-compact -5.2% -7.4% +2.4% +17.9% ➖ noise
39 duckdb:vortex-file-compressed -5.2% -7.4% +2.4% +12.9% ➖ noise
40 datafusion:vortex-compact -2.5% -7.3% +5.2% +17.0% ➖ noise
40 datafusion:vortex-file-compressed -5.5% -7.3% +1.9% +13.3% ➖ noise
40 duckdb:duckdb -6.9% -7.3% +0.5% +10.0% ➖ noise
40 duckdb:vortex-compact -11.4% -7.3% -4.4% +12.6% ➖ noise
40 duckdb:vortex-file-compressed -4.6% -7.3% +2.9% +26.0% ➖ noise
41 datafusion:vortex-compact -6.7% -8.0% +1.4% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -9.2% -8.0% -1.2% +10.0% ➖ noise
41 duckdb:duckdb -3.4% -8.0% +5.1% +10.0% ➖ noise
41 duckdb:vortex-compact -8.4% -8.0% -0.4% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -8.8% -8.0% -0.9% +14.0% ➖ noise
42 datafusion:vortex-compact -4.9% +0.1% -4.9% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -5.2% +0.1% -5.2% +12.9% ➖ noise
42 duckdb:duckdb -5.0% +0.1% -5.0% +17.8% ➖ noise
42 duckdb:vortex-compact -5.1% +0.1% -5.1% +10.8% ➖ noise
42 duckdb:vortex-file-compressed -2.4% +0.1% -2.4% +31.4% ➖ noise
43 datafusion:vortex-compact -5.6% -5.6% -0.0% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -6.1% -5.6% -0.5% +10.0% ➖ noise
43 duckdb:duckdb -3.3% -5.6% +2.5% +11.2% ➖ noise
43 duckdb:vortex-compact -11.4% -5.6% -6.2% +21.5% ➖ noise
43 duckdb:vortex-file-compressed -12.3% -5.6% -7.2% +18.1% ➖ noise
44 datafusion:vortex-compact -5.6% -2.4% -3.3% +11.2% ➖ noise
44 datafusion:vortex-file-compressed -6.7% -2.4% -4.4% +10.0% ➖ noise
44 duckdb:duckdb +1.2% -2.4% +3.7% +11.2% ➖ noise
44 duckdb:vortex-compact -2.0% -2.4% +0.4% +19.0% ➖ noise
44 duckdb:vortex-file-compressed -9.7% -2.4% -7.5% +10.0% ➖ noise
45 datafusion:vortex-compact -5.9% -5.5% -0.3% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -8.0% -5.5% -2.6% +16.3% ➖ noise
45 duckdb:duckdb -5.8% -5.5% -0.2% +10.0% ➖ noise
45 duckdb:vortex-compact -10.9% -5.5% -5.7% +13.9% ➖ noise
45 duckdb:vortex-file-compressed -4.5% -5.5% +1.1% +10.0% ➖ noise
46 datafusion:vortex-compact -2.5% -7.1% +4.9% +18.5% ➖ noise
46 datafusion:vortex-file-compressed -6.4% -7.1% +0.7% +12.9% ➖ noise
46 duckdb:duckdb -5.9% -7.1% +1.2% +10.0% ➖ noise
46 duckdb:vortex-compact -11.4% -7.1% -4.7% +14.0% ➖ noise
46 duckdb:vortex-file-compressed -1.4% -7.1% +6.1% +18.6% ➖ noise
47 datafusion:vortex-compact -5.8% -5.7% -0.2% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -7.7% -5.7% -2.1% +10.0% ➖ noise
47 duckdb:duckdb -5.9% -5.7% -0.2% +10.0% ➖ noise
47 duckdb:vortex-compact -3.5% -5.7% +2.4% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -14.1% -5.7% -9.0% +11.0% ➖ noise
48 datafusion:vortex-compact -3.1% -4.9% +1.9% +15.1% ➖ noise
48 datafusion:vortex-file-compressed -5.7% -4.9% -0.9% +10.0% ➖ noise
48 duckdb:duckdb -4.1% -4.9% +0.9% +10.0% ➖ noise
48 duckdb:vortex-compact -9.0% -4.9% -4.4% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -10.2% -4.9% -5.6% +10.0% ➖ noise
49 datafusion:vortex-compact -4.1% -3.3% -0.8% +13.5% ➖ noise
49 datafusion:vortex-file-compressed -7.9% -3.3% -4.7% +10.3% ➖ noise
49 duckdb:duckdb -1.8% -3.3% +1.6% +10.0% ➖ noise
49 duckdb:vortex-compact -4.2% -3.3% -0.9% +11.8% ➖ noise
49 duckdb:vortex-file-compressed +0.6% -3.3% +4.1% +18.6% ➖ noise
50 datafusion:vortex-compact -4.3% -4.1% -0.2% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -8.2% -4.1% -4.3% +10.0% ➖ noise
50 duckdb:duckdb -5.7% -4.1% -1.7% +10.0% ➖ noise
50 duckdb:vortex-compact -2.3% -4.1% +1.8% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +4.7% -4.1% +9.1% +30.2% ➖ noise
51 datafusion:vortex-compact +0.2% -7.6% +8.5% +14.1% ➖ noise
51 datafusion:vortex-file-compressed -5.9% -7.6% +1.8% +13.7% ➖ noise
51 duckdb:duckdb -5.4% -7.6% +2.4% +11.1% ➖ noise
51 duckdb:vortex-compact -11.0% -7.6% -3.7% +17.6% ➖ noise
51 duckdb:vortex-file-compressed -4.7% -7.6% +3.1% +19.9% ➖ noise
52 datafusion:vortex-compact -4.2% -1.0% -3.3% +28.3% ➖ noise
52 datafusion:vortex-file-compressed -5.0% -1.0% -4.1% +10.0% ➖ noise
52 duckdb:duckdb -5.0% -1.0% -4.1% +17.3% ➖ noise
52 duckdb:vortex-compact -5.3% -1.0% -4.3% +10.0% ➖ noise
52 duckdb:vortex-file-compressed -7.4% -1.0% -6.5% +10.0% ➖ noise
53 datafusion:vortex-compact -3.7% -7.3% +3.9% +10.3% ➖ noise
53 datafusion:vortex-file-compressed -13.1% -7.3% -6.2% +20.6% ➖ noise
53 duckdb:duckdb -5.9% -7.3% +1.6% +11.1% ➖ noise
53 duckdb:vortex-compact -9.0% -7.3% -1.8% +19.1% ➖ noise
53 duckdb:vortex-file-compressed -6.3% -7.3% +1.1% +28.5% ➖ noise
54 datafusion:vortex-compact -5.1% -5.6% +0.5% +11.2% ➖ noise
54 datafusion:vortex-file-compressed -6.3% -5.6% -0.8% +13.8% ➖ noise
54 duckdb:duckdb -3.4% -5.6% +2.4% +10.0% ➖ noise
54 duckdb:vortex-compact -7.5% -5.6% -2.0% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -10.3% -5.6% -5.0% +10.2% ➖ noise
55 datafusion:vortex-compact -6.2% -7.9% +1.9% +10.0% ➖ noise
55 datafusion:vortex-file-compressed -0.1% -7.9% +8.6% +10.0% ➖ noise
55 duckdb:duckdb +9.8% -7.9% +19.3% +10.7% 🚨 regression
55 duckdb:vortex-compact -3.6% -7.9% +4.7% +12.8% ➖ noise
55 duckdb:vortex-file-compressed -7.3% -7.9% +0.7% +10.0% ➖ noise
56 datafusion:vortex-compact +1.1% -2.1% +3.2% +12.9% ➖ noise
56 datafusion:vortex-file-compressed -10.8% -2.1% -8.9% +11.0% ➖ noise
56 duckdb:duckdb -8.1% -2.1% -6.1% +10.0% ➖ noise
56 duckdb:vortex-compact -1.5% -2.1% +0.6% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -8.2% -2.1% -6.2% +11.0% ➖ noise
57 datafusion:vortex-compact -11.9% -2.2% -10.0% +11.2% ➖ noise
57 datafusion:vortex-file-compressed -7.5% -2.2% -5.5% +10.0% ➖ noise
57 duckdb:duckdb -3.3% -2.2% -1.2% +11.7% ➖ noise
57 duckdb:vortex-compact -4.4% -2.2% -2.3% +10.8% ➖ noise
57 duckdb:vortex-file-compressed -5.0% -2.2% -2.9% +10.7% ➖ noise
58 datafusion:vortex-compact +1.8% -6.4% +8.8% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -0.9% -6.4% +5.9% +10.0% ➖ noise
58 duckdb:duckdb +2.3% -6.4% +9.3% +10.0% ➖ noise
58 duckdb:vortex-compact -10.3% -6.4% -4.2% +16.6% ➖ noise
58 duckdb:vortex-file-compressed -2.9% -6.4% +3.8% +12.3% ➖ noise
59 datafusion:vortex-compact -5.2% -6.5% +1.4% +13.5% ➖ noise
59 datafusion:vortex-file-compressed -3.5% -6.5% +3.2% +15.1% ➖ noise
59 duckdb:duckdb +0.4% -6.5% +7.4% +11.4% ➖ noise
59 duckdb:vortex-compact -1.5% -6.5% +5.3% +11.9% ➖ noise
59 duckdb:vortex-file-compressed -2.5% -6.5% +4.2% +10.0% ➖ noise
60 datafusion:vortex-compact -4.7% -5.4% +0.8% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -6.4% -5.4% -1.0% +10.0% ➖ noise
60 duckdb:duckdb -2.1% -5.4% +3.5% +10.0% ➖ noise
60 duckdb:vortex-compact -2.2% -5.4% +3.4% +20.8% ➖ noise
60 duckdb:vortex-file-compressed -2.8% -5.4% +2.7% +10.0% ➖ noise
61 datafusion:vortex-compact -3.2% -3.9% +0.7% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -2.9% -3.9% +1.1% +10.0% ➖ noise
61 duckdb:duckdb +2.4% -3.9% +6.6% +10.0% ➖ noise
61 duckdb:vortex-compact +1.1% -3.9% +5.2% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -12.1% -3.9% -8.6% +33.1% ➖ noise
62 datafusion:vortex-compact -5.2% -4.8% -0.4% +24.5% ➖ noise
62 datafusion:vortex-file-compressed -23.4% -4.8% -19.6% +32.9% ➖ noise
62 duckdb:duckdb -7.2% -4.8% -2.6% +22.4% ➖ noise
62 duckdb:vortex-compact -8.3% -4.8% -3.7% +22.2% ➖ noise
62 duckdb:vortex-file-compressed -10.1% -4.8% -5.6% +20.2% ➖ noise
63 datafusion:vortex-compact -1.0% -1.2% +0.2% +24.5% ➖ noise
63 datafusion:vortex-file-compressed -3.3% -1.2% -2.2% +10.0% ➖ noise
63 duckdb:duckdb -3.2% -1.2% -2.0% +10.0% ➖ noise
63 duckdb:vortex-compact -6.0% -1.2% -4.9% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -1.9% -1.2% -0.7% +10.0% ➖ noise
64 datafusion:vortex-compact -3.8% -4.0% +0.2% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -5.3% -4.0% -1.4% +10.0% ➖ noise
64 duckdb:duckdb -4.4% -4.0% -0.5% +10.0% ➖ noise
64 duckdb:vortex-compact -4.7% -4.0% -0.8% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -6.0% -4.0% -2.1% +10.0% ➖ noise
65 datafusion:vortex-compact -6.7% -2.8% -4.0% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -7.0% -2.8% -4.3% +10.0% ➖ noise
65 duckdb:duckdb -2.6% -2.8% +0.2% +10.0% ➖ noise
65 duckdb:vortex-compact -4.5% -2.8% -1.8% +10.1% ➖ noise
65 duckdb:vortex-file-compressed -3.0% -2.8% -0.2% +12.9% ➖ noise
66 datafusion:vortex-compact -2.5% -1.7% -0.9% +19.2% ➖ noise
66 datafusion:vortex-file-compressed -9.3% -1.7% -7.8% +10.2% ➖ noise
66 duckdb:duckdb -6.9% -1.7% -5.3% +11.8% ➖ noise
66 duckdb:vortex-compact -10.8% -1.7% -9.3% +18.8% ➖ noise
66 duckdb:vortex-file-compressed -5.9% -1.7% -4.3% +10.0% ➖ noise
67 datafusion:vortex-compact -10.2% -4.9% -5.5% +10.6% ➖ noise
67 datafusion:vortex-file-compressed -0.6% -4.9% +4.5% +10.0% ➖ noise
67 duckdb:duckdb -5.0% -4.9% -0.1% +10.0% ➖ noise
67 duckdb:vortex-compact -8.9% -4.9% -4.2% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -6.2% -4.9% -1.4% +10.0% ➖ noise
68 datafusion:vortex-compact -2.8% -3.3% +0.5% +32.2% ➖ noise
68 datafusion:vortex-file-compressed -7.9% -3.3% -4.7% +10.0% ➖ noise
68 duckdb:duckdb -1.6% -3.3% +1.8% +10.0% ➖ noise
68 duckdb:vortex-compact +1.7% -3.3% +5.2% +10.5% ➖ noise
68 duckdb:vortex-file-compressed -4.8% -3.3% -1.5% +10.0% ➖ noise
69 datafusion:vortex-compact -9.1% -5.4% -3.9% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -10.0% -5.4% -4.9% +11.0% ➖ noise
69 duckdb:duckdb -1.3% -5.4% +4.3% +10.0% ➖ noise
69 duckdb:vortex-compact -6.4% -5.4% -1.0% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -6.8% -5.4% -1.4% +10.0% ➖ noise
70 datafusion:vortex-compact -7.5% -3.7% -3.9% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -2.8% -3.7% +1.0% +17.8% ➖ noise
70 duckdb:duckdb +2.3% -3.7% +6.3% +10.5% ➖ noise
70 duckdb:vortex-compact -4.1% -3.7% -0.4% +10.0% ➖ noise
70 duckdb:vortex-file-compressed -10.9% -3.7% -7.5% +20.6% ➖ noise
71 datafusion:vortex-compact -4.4% -4.5% +0.1% +22.1% ➖ noise
71 datafusion:vortex-file-compressed -10.0% -4.5% -5.7% +10.0% ➖ noise
71 duckdb:duckdb +5.0% -4.5% +10.0% +12.5% ➖ noise
71 duckdb:vortex-compact -5.7% -4.5% -1.2% +10.8% ➖ noise
71 duckdb:vortex-file-compressed -4.7% -4.5% -0.2% +11.8% ➖ noise
72 datafusion:vortex-compact -7.0% -5.5% -1.5% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -8.6% -5.5% -3.3% +10.0% ➖ noise
72 duckdb:duckdb -5.1% -5.5% +0.4% +10.0% ➖ noise
72 duckdb:vortex-compact -3.1% -5.5% +2.6% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -3.4% -5.5% +2.2% +10.0% ➖ noise
73 datafusion:vortex-compact -5.4% -3.1% -2.3% +26.3% ➖ noise
73 datafusion:vortex-file-compressed -8.6% -3.1% -5.7% +10.0% ➖ noise
73 duckdb:duckdb -5.5% -3.1% -2.4% +10.0% ➖ noise
73 duckdb:vortex-compact -2.4% -3.1% +0.8% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -4.5% -3.1% -1.4% +10.0% ➖ noise
74 datafusion:vortex-compact -5.0% -5.0% -0.0% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -10.2% -5.0% -5.5% +10.0% ➖ noise
74 duckdb:duckdb -3.6% -5.0% +1.4% +13.6% ➖ noise
74 duckdb:vortex-compact -7.1% -5.0% -2.3% +14.0% ➖ noise
74 duckdb:vortex-file-compressed -5.6% -5.0% -0.7% +10.0% ➖ noise
75 datafusion:vortex-compact -8.3% -4.9% -3.6% +15.8% ➖ noise
75 datafusion:vortex-file-compressed -5.1% -4.9% -0.3% +18.2% ➖ noise
75 duckdb:duckdb -6.1% -4.9% -1.2% +10.0% ➖ noise
75 duckdb:vortex-compact -5.6% -4.9% -0.8% +15.5% ➖ noise
75 duckdb:vortex-file-compressed -21.0% -4.9% -16.9% +13.7% ✅ faster
76 datafusion:vortex-compact -9.0% -4.7% -4.5% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -8.7% -4.7% -4.3% +10.0% ➖ noise
76 duckdb:duckdb +1.9% -4.7% +6.9% +10.0% ➖ noise
76 duckdb:vortex-compact +2.9% -4.7% +7.9% +18.4% ➖ noise
76 duckdb:vortex-file-compressed -8.1% -4.7% -3.6% +34.9% ➖ noise
77 datafusion:vortex-compact -7.2% -4.1% -3.2% +14.0% ➖ noise
77 datafusion:vortex-file-compressed -4.9% -4.1% -0.7% +11.0% ➖ noise
77 duckdb:duckdb -6.7% -4.1% -2.7% +15.5% ➖ noise
77 duckdb:vortex-compact -6.7% -4.1% -2.7% +14.9% ➖ noise
77 duckdb:vortex-file-compressed -1.5% -4.1% +2.8% +15.7% ➖ noise
78 datafusion:vortex-compact -8.8% -5.2% -3.8% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -3.4% -5.2% +1.9% +10.0% ➖ noise
78 duckdb:duckdb -3.6% -5.2% +1.7% +10.0% ➖ noise
78 duckdb:vortex-compact -1.6% -5.2% +3.8% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -1.2% -5.2% +4.2% +10.0% ➖ noise
79 datafusion:vortex-compact -3.1% -4.4% +1.4% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -2.2% -4.4% +2.3% +12.2% ➖ noise
79 duckdb:duckdb -4.7% -4.4% -0.3% +10.0% ➖ noise
79 duckdb:vortex-compact -4.4% -4.4% -0.0% +15.4% ➖ noise
79 duckdb:vortex-file-compressed -8.6% -4.4% -4.4% +10.0% ➖ noise
80 datafusion:vortex-compact -2.1% -3.8% +1.7% +14.5% ➖ noise
80 datafusion:vortex-file-compressed -5.6% -3.8% -1.9% +15.4% ➖ noise
80 duckdb:duckdb -4.1% -3.8% -0.4% +15.1% ➖ noise
80 duckdb:vortex-compact -6.5% -3.8% -2.8% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +4.3% -3.8% +8.4% +10.9% ➖ noise
81 datafusion:vortex-compact -5.3% -2.4% -2.9% +10.0% ➖ noise
81 datafusion:vortex-file-compressed +0.4% -2.4% +2.9% +29.1% ➖ noise
81 duckdb:duckdb -5.1% -2.4% -2.8% +10.0% ➖ noise
81 duckdb:vortex-compact -5.2% -2.4% -2.9% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -8.5% -2.4% -6.2% +21.6% ➖ noise
82 datafusion:vortex-compact -9.6% -5.4% -4.4% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -1.5% -5.4% +4.1% +17.0% ➖ noise
82 duckdb:duckdb -8.5% -5.4% -3.3% +12.1% ➖ noise
82 duckdb:vortex-compact -5.8% -5.4% -0.5% +10.8% ➖ noise
82 duckdb:vortex-file-compressed -4.5% -5.4% +0.9% +10.0% ➖ noise
83 datafusion:vortex-compact -8.0% -3.5% -4.7% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -6.7% -3.5% -3.4% +10.0% ➖ noise
83 duckdb:duckdb -8.7% -3.5% -5.4% +10.0% ➖ noise
83 duckdb:vortex-compact -8.0% -3.5% -4.6% +14.1% ➖ noise
83 duckdb:vortex-file-compressed -6.2% -3.5% -2.8% +10.3% ➖ noise
84 datafusion:vortex-compact -8.9% -6.8% -2.2% +29.4% ➖ noise
84 datafusion:vortex-file-compressed -12.6% -6.8% -6.2% +10.0% ➖ noise
84 duckdb:duckdb -7.3% -6.8% -0.5% +10.0% ➖ noise
84 duckdb:vortex-compact -9.6% -6.8% -2.9% +28.9% ➖ noise
84 duckdb:vortex-file-compressed -1.4% -6.8% +5.8% +10.0% ➖ noise
85 datafusion:vortex-compact +0.7% -6.0% +7.2% +14.3% ➖ noise
85 datafusion:vortex-file-compressed -10.3% -6.0% -4.6% +10.0% ➖ noise
85 duckdb:duckdb -11.0% -6.0% -5.3% +10.0% ➖ noise
85 duckdb:vortex-compact -8.1% -6.0% -2.2% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -14.0% -6.0% -8.5% +14.7% ➖ noise
86 datafusion:vortex-compact -11.5% -5.9% -5.9% +13.7% ➖ noise
86 datafusion:vortex-file-compressed -4.8% -5.9% +1.2% +13.8% ➖ noise
86 duckdb:duckdb -5.8% -5.9% +0.1% +10.0% ➖ noise
86 duckdb:vortex-compact -2.7% -5.9% +3.5% +13.3% ➖ noise
86 duckdb:vortex-file-compressed -10.2% -5.9% -4.5% +11.2% ➖ noise
87 datafusion:vortex-compact -6.9% -5.5% -1.5% +13.9% ➖ noise
87 datafusion:vortex-file-compressed -3.1% -5.5% +2.5% +12.4% ➖ noise
87 duckdb:duckdb -4.1% -5.5% +1.5% +11.0% ➖ noise
87 duckdb:vortex-compact -7.9% -5.5% -2.6% +10.0% ➖ noise
87 duckdb:vortex-file-compressed -12.6% -5.5% -7.6% +10.0% ➖ noise
88 datafusion:vortex-compact -6.3% -3.0% -3.3% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -4.1% -3.0% -1.1% +10.0% ➖ noise
88 duckdb:duckdb -6.2% -3.0% -3.3% +14.5% ➖ noise
88 duckdb:vortex-compact -0.4% -3.0% +2.8% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +4.2% -3.0% +7.5% +10.0% ➖ noise
89 datafusion:vortex-compact -6.4% -6.8% +0.4% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -7.3% -6.8% -0.6% +33.7% ➖ noise
89 duckdb:duckdb -3.9% -6.8% +3.1% +10.0% ➖ noise
89 duckdb:vortex-compact -4.6% -6.8% +2.4% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -8.8% -6.8% -2.1% +11.4% ➖ noise
90 datafusion:vortex-compact -5.8% -7.3% +1.6% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -13.3% -7.3% -6.5% +10.0% ➖ noise
90 duckdb:duckdb -10.1% -7.3% -3.1% +10.0% ➖ noise
90 duckdb:vortex-compact -11.1% -7.3% -4.1% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -10.2% -7.3% -3.2% +10.0% ➖ noise
91 datafusion:vortex-compact -6.9% -3.8% -3.2% +18.0% ➖ noise
91 datafusion:vortex-file-compressed -15.8% -3.8% -12.4% +10.0% ✅ faster
91 duckdb:duckdb +0.0% -3.8% +4.0% +10.3% ➖ noise
91 duckdb:vortex-compact -5.5% -3.8% -1.7% +15.7% ➖ noise
91 duckdb:vortex-file-compressed -11.3% -3.8% -7.8% +10.0% ➖ noise
92 datafusion:vortex-compact -9.6% -8.1% -1.7% +13.1% ➖ noise
92 datafusion:vortex-file-compressed -11.8% -8.1% -4.0% +21.9% ➖ noise
92 duckdb:duckdb -8.0% -8.1% +0.0% +11.1% ➖ noise
92 duckdb:vortex-compact +0.4% -8.1% +9.2% +22.8% ➖ noise
92 duckdb:vortex-file-compressed -7.7% -8.1% +0.4% +10.0% ➖ noise
93 datafusion:vortex-compact -2.5% -7.0% +4.8% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -7.3% -7.0% -0.4% +13.2% ➖ noise
93 duckdb:duckdb -6.8% -7.0% +0.2% +10.0% ➖ noise
93 duckdb:vortex-compact -12.5% -7.0% -5.9% +11.3% ➖ noise
93 duckdb:vortex-file-compressed -7.2% -7.0% -0.2% +12.2% ➖ noise
94 datafusion:vortex-compact -11.2% -10.8% -0.4% +15.0% ➖ noise
94 datafusion:vortex-file-compressed -5.0% -10.8% +6.6% +11.6% ➖ noise
94 duckdb:duckdb -5.5% -10.8% +5.9% +10.0% ➖ noise
94 duckdb:vortex-compact -6.5% -10.8% +4.9% +10.0% ➖ noise
94 duckdb:vortex-file-compressed -11.9% -10.8% -1.1% +11.5% ➖ noise
95 datafusion:vortex-compact -9.3% -5.6% -4.0% +10.9% ➖ noise
95 datafusion:vortex-file-compressed -7.9% -5.6% -2.5% +10.1% ➖ noise
95 duckdb:duckdb -8.4% -5.6% -3.1% +19.0% ➖ noise
95 duckdb:vortex-compact -9.4% -5.6% -4.1% +23.4% ➖ noise
95 duckdb:vortex-file-compressed -7.1% -5.6% -1.6% +18.3% ➖ noise
96 datafusion:vortex-compact -1.4% -5.9% +4.8% +17.3% ➖ noise
96 datafusion:vortex-file-compressed -7.6% -5.9% -1.8% +28.0% ➖ noise
96 duckdb:duckdb -11.2% -5.9% -5.7% +10.0% ➖ noise
96 duckdb:vortex-compact -4.8% -5.9% +1.2% +10.0% ➖ noise
96 duckdb:vortex-file-compressed -12.3% -5.9% -6.7% +10.1% ➖ noise
97 datafusion:vortex-compact -6.7% -8.3% +1.7% +13.0% ➖ noise
97 datafusion:vortex-file-compressed -11.3% -8.3% -3.3% +10.0% ➖ noise
97 duckdb:duckdb -7.1% -8.3% +1.3% +10.0% ➖ noise
97 duckdb:vortex-compact -14.0% -8.3% -6.3% +13.3% ➖ noise
97 duckdb:vortex-file-compressed -4.8% -8.3% +3.8% +10.0% ➖ noise
98 datafusion:vortex-compact -6.0% -9.3% +3.6% +16.9% ➖ noise
98 datafusion:vortex-file-compressed -11.3% -9.3% -2.2% +21.0% ➖ noise
98 duckdb:duckdb -1.7% -9.3% +8.4% +10.0% ➖ noise
98 duckdb:vortex-compact -3.6% -9.3% +6.3% +10.0% ➖ noise
98 duckdb:vortex-file-compressed -8.4% -9.3% +1.0% +10.0% ➖ noise
99 datafusion:vortex-compact +8.2% -4.0% +12.7% +14.5% ➖ noise
99 datafusion:vortex-file-compressed -7.1% -4.0% -3.2% +21.3% ➖ noise
99 duckdb:duckdb -4.5% -4.0% -0.5% +28.1% ➖ noise
99 duckdb:vortex-compact -5.6% -4.0% -1.6% +21.3% ➖ noise
99 duckdb:vortex-file-compressed -8.1% -4.0% -4.3% +17.5% ➖ noise

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Jun 2, 2026

Merging this PR will degrade performance by 18.2%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

❌ 1 regressed benchmark
✅ 1274 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_varbinview_canonical_into[(1000, 10)] 162.1 µs 198.2 µs -18.2%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing claude/btrblocks-scheme-modules-QoTPX (422b9fd) with develop (35212ef)

Open in CodSpeed

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.1%
Engines: DataFusion No clear signal (-2.6%, environment too noisy confidence) · DuckDB No clear signal (-1.6%, environment too noisy confidence)
Vortex (geomean): 0.923x ➖
Parquet (geomean): 0.942x ➖
Shifts: Parquet (control) -5.8% · Median polish -5.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.872x ➖, 1↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 36443145 62866621 0.58
fineweb_q01/datafusion:vortex-file-compressed 429207949 522966848 0.82
fineweb_q02/datafusion:vortex-file-compressed 464897224 521314382 0.89
fineweb_q03/datafusion:vortex-file-compressed 1092253205 1275351783 0.86
fineweb_q04/datafusion:vortex-file-compressed 1158789475 1193804937 0.97
fineweb_q05/datafusion:vortex-file-compressed 1081732335 1089591145 0.99
fineweb_q06/datafusion:vortex-file-compressed 1247299125 1324723189 0.94
fineweb_q07/datafusion:vortex-file-compressed 1066182994 1129627668 0.94
fineweb_q08/datafusion:vortex-file-compressed 430271936 459087847 0.94
datafusion / vortex-compact (0.941x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 32099406 28801841 1.11
fineweb_q01/datafusion:vortex-compact 548217694 725425182 0.76
fineweb_q02/datafusion:vortex-compact 540838925 542979790 1.00
fineweb_q03/datafusion:vortex-compact 1378794475 1449768064 0.95
fineweb_q04/datafusion:vortex-compact 1577423339 1555471642 1.01
fineweb_q05/datafusion:vortex-compact 1385358098 1349522963 1.03
fineweb_q06/datafusion:vortex-compact 1279829873 1413683521 0.91
fineweb_q07/datafusion:vortex-compact 1151721107 1118925485 1.03
fineweb_q08/datafusion:vortex-compact 383082713 511681585 0.75
datafusion / parquet (0.930x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1265810020 1240874430 1.02
fineweb_q01/datafusion:parquet 1819841980 2159263787 0.84
fineweb_q02/datafusion:parquet 1842261335 1911422449 0.96
fineweb_q03/datafusion:parquet 1852948295 2215389692 0.84
fineweb_q04/datafusion:parquet 1887418502 2058401323 0.92
fineweb_q05/datafusion:parquet 1945502116 1913999820 1.02
fineweb_q06/datafusion:parquet 1997868749 2008205735 0.99
fineweb_q07/datafusion:parquet 1938858857 2041234871 0.95
fineweb_q08/datafusion:parquet 1799021632 2105747710 0.85
duckdb / vortex-file-compressed (0.943x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 82154839 96480027 0.85
fineweb_q01/duckdb:vortex-file-compressed 553030126 618888224 0.89
fineweb_q02/duckdb:vortex-file-compressed 464963146 566910761 0.82
fineweb_q03/duckdb:vortex-file-compressed 1314511563 1276401477 1.03
fineweb_q04/duckdb:vortex-file-compressed 1459827083 1403336566 1.04
fineweb_q05/duckdb:vortex-file-compressed 1278267468 1346982151 0.95
fineweb_q06/duckdb:vortex-file-compressed 1460347014 1498677908 0.97
fineweb_q07/duckdb:vortex-file-compressed 1422032853 1350829789 1.05
fineweb_q08/duckdb:vortex-file-compressed 586852426 644675522 0.91
duckdb / vortex-compact (0.936x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 82265131 111760713 0.74
fineweb_q01/duckdb:vortex-compact 549121249 688262739 0.80
fineweb_q02/duckdb:vortex-compact 592719466 681982456 0.87
fineweb_q03/duckdb:vortex-compact 1728948097 1687668791 1.02
fineweb_q04/duckdb:vortex-compact 1861227729 1819007309 1.02
fineweb_q05/duckdb:vortex-compact 1649450469 1608347108 1.03
fineweb_q06/duckdb:vortex-compact 1573315687 1583167658 0.99
fineweb_q07/duckdb:vortex-compact 1390822517 1373708159 1.01
fineweb_q08/duckdb:vortex-compact 478263596 480805369 0.99
duckdb / parquet (0.955x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1078596955 1235576754 0.87
fineweb_q01/duckdb:parquet 1325533651 1475648752 0.90
fineweb_q02/duckdb:parquet 1369749504 1484310927 0.92
fineweb_q03/duckdb:parquet 3718270468 3970413345 0.94
fineweb_q04/duckdb:parquet 2039631043 1970775682 1.03
fineweb_q05/duckdb:parquet 2121838181 2149899724 0.99
fineweb_q06/duckdb:parquet 4272702415 4414288654 0.97
fineweb_q07/duckdb:parquet 2899898783 2605924408 1.11
fineweb_q08/duckdb:parquet 1054011224 1194118794 0.88
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +11.4% -5.6% +18.1% +168.3% ➖ noise
0 datafusion:vortex-file-compressed -42.0% -5.6% -38.6% +143.6% ➖ noise
0 duckdb:vortex-compact -26.4% -5.6% -22.0% +55.3% ➖ noise
0 duckdb:vortex-file-compressed -14.8% -5.6% -9.8% +59.1% ➖ noise
1 datafusion:vortex-compact -24.4% -13.0% -13.1% +76.2% ➖ noise
1 datafusion:vortex-file-compressed -17.9% -13.0% -5.7% +85.7% ➖ noise
1 duckdb:vortex-compact -20.2% -13.0% -8.3% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -10.6% -13.0% +2.7% +39.4% ➖ noise
2 datafusion:vortex-compact -0.4% -5.7% +5.6% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -10.8% -5.7% -5.4% +36.4% ➖ noise
2 duckdb:vortex-compact -13.1% -5.7% -7.8% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -18.0% -5.7% -13.0% +30.0% ➖ noise
3 datafusion:vortex-compact -4.9% -11.5% +7.5% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -14.4% -11.5% -3.2% +30.6% ➖ noise
3 duckdb:vortex-compact +2.4% -11.5% +15.8% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +3.0% -11.5% +16.4% +30.0% ➖ noise
4 datafusion:vortex-compact +1.4% -2.6% +4.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -2.9% -2.6% -0.4% +30.0% ➖ noise
4 duckdb:vortex-compact +2.3% -2.6% +5.0% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +4.0% -2.6% +6.8% +30.0% ➖ noise
5 datafusion:vortex-compact +2.7% +0.2% +2.5% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -0.7% +0.2% -0.9% +30.0% ➖ noise
5 duckdb:vortex-compact +2.6% +0.2% +2.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -5.1% +0.2% -5.3% +30.0% ➖ noise
6 datafusion:vortex-compact -9.5% -1.9% -7.7% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -5.8% -1.9% -4.0% +30.0% ➖ noise
6 duckdb:vortex-compact -0.6% -1.9% +1.3% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -2.6% -1.9% -0.7% +30.0% ➖ noise
7 datafusion:vortex-compact +2.9% +2.8% +0.1% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -5.6% +2.8% -8.2% +30.0% ➖ noise
7 duckdb:vortex-compact +1.2% +2.8% -1.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +5.3% +2.8% +2.4% +30.5% ➖ noise
8 datafusion:vortex-compact -25.1% -13.2% -13.8% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -6.3% -13.2% +7.9% +30.0% ➖ noise
8 duckdb:vortex-compact -0.5% -13.2% +14.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -9.0% -13.2% +4.8% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.9%
Engines: DuckDB No clear signal (-1.9%, low confidence)
Vortex (geomean): 1.015x ➖
Parquet (geomean): 1.035x ➖
Shifts: Parquet (control) +3.5% · Median polish +1.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed (1.013x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12297463 11870098 1.04
statpopgen_q01/duckdb:vortex-file-compressed 26797461 26610985 1.01
statpopgen_q02/duckdb:vortex-file-compressed 539237964 535652373 1.01
statpopgen_q03/duckdb:vortex-file-compressed 1044969302 1073329536 0.97
statpopgen_q04/duckdb:vortex-file-compressed 1080491785 1091548463 0.99
statpopgen_q05/duckdb:vortex-file-compressed 505071844 490913505 1.03
statpopgen_q06/duckdb:vortex-file-compressed 1566299678 1547785160 1.01
statpopgen_q07/duckdb:vortex-file-compressed 206183320 200880756 1.03
statpopgen_q08/duckdb:vortex-file-compressed 243947934 233482214 1.04
statpopgen_q09/duckdb:vortex-file-compressed 854472518 847212039 1.01
statpopgen_q10/duckdb:vortex-file-compressed 2606414568 2582281562 1.01
duckdb / vortex-compact (1.017x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 12176486 11689341 1.04
statpopgen_q01/duckdb:vortex-compact 216583813 214484998 1.01
statpopgen_q02/duckdb:vortex-compact 576641552 569130580 1.01
statpopgen_q03/duckdb:vortex-compact 1171342514 1146497005 1.02
statpopgen_q04/duckdb:vortex-compact 1155170608 1152546696 1.00
statpopgen_q05/duckdb:vortex-compact 572916447 566080426 1.01
statpopgen_q06/duckdb:vortex-compact 1513882158 1498767133 1.01
statpopgen_q07/duckdb:vortex-compact 893154925 880248198 1.01
statpopgen_q08/duckdb:vortex-compact 934181236 910566370 1.03
statpopgen_q09/duckdb:vortex-compact 942150604 914867234 1.03
statpopgen_q10/duckdb:vortex-compact 2627259574 2612183848 1.01
duckdb / parquet (1.035x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 308087949 305897321 1.01
statpopgen_q01/duckdb:parquet 388365256 380989411 1.02
statpopgen_q02/duckdb:parquet 792041660 776027948 1.02
statpopgen_q03/duckdb:parquet 1237762770 1173792910 1.05
statpopgen_q04/duckdb:parquet 1250298816 1173966143 1.07
statpopgen_q05/duckdb:parquet 833010624 811821909 1.03
statpopgen_q06/duckdb:parquet 1479461001 1431121552 1.03
statpopgen_q07/duckdb:parquet 882597254 854750313 1.03
statpopgen_q08/duckdb:parquet 888944365 864734972 1.03
statpopgen_q09/duckdb:parquet 1056777674 1016376711 1.04
statpopgen_q10/duckdb:parquet 2331561013 2209421368 1.06

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB +39.43 KB +0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +4.2% +0.7% +3.4% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +3.6% +0.7% +2.9% +11.9% ➖ noise
1 duckdb:vortex-compact +1.0% +1.9% -0.9% +12.3% ➖ noise
1 duckdb:vortex-file-compressed +0.7% +1.9% -1.2% +180.6% ➖ noise
2 duckdb:vortex-compact +1.3% +2.1% -0.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.7% +2.1% -1.4% +10.0% ➖ noise
3 duckdb:vortex-compact +2.2% +5.4% -3.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.6% +5.4% -7.7% +10.0% ➖ noise
4 duckdb:vortex-compact +0.2% +6.5% -5.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.0% +6.5% -7.1% +10.0% ➖ noise
5 duckdb:vortex-compact +1.2% +2.6% -1.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.9% +2.6% +0.3% +10.0% ➖ noise
6 duckdb:vortex-compact +1.0% +3.4% -2.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.2% +3.4% -2.1% +10.0% ➖ noise
7 duckdb:vortex-compact +1.5% +3.3% -1.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +2.6% +3.3% -0.6% +10.0% ➖ noise
8 duckdb:vortex-compact +2.6% +2.8% -0.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +4.5% +2.8% +1.6% +10.0% ➖ noise
9 duckdb:vortex-compact +3.0% +4.0% -1.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.9% +4.0% -3.0% +10.0% ➖ noise
10 duckdb:vortex-compact +0.6% +5.5% -4.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.9% +5.5% -4.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-1.8%, low confidence)
Vortex (geomean): 0.947x ➖
Parquet (geomean): 0.957x ➖
Shifts: Parquet (control) -4.3% · Median polish -5.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.926x ➖, 1↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 393815196 424382180 0.93
tpch_q02/datafusion:vortex-file-compressed 110467350 121563897 0.91
tpch_q03/datafusion:vortex-file-compressed 211943658 228671477 0.93
tpch_q04/datafusion:vortex-file-compressed 113453074 122980190 0.92
tpch_q05/datafusion:vortex-file-compressed 379417626 409635459 0.93
tpch_q06/datafusion:vortex-file-compressed 🚀 36378508 40963199 0.89
tpch_q07/datafusion:vortex-file-compressed 506136821 544481152 0.93
tpch_q08/datafusion:vortex-file-compressed 371145580 397431510 0.93
tpch_q09/datafusion:vortex-file-compressed 655889289 701665526 0.93
tpch_q10/datafusion:vortex-file-compressed 230679683 248037469 0.93
tpch_q11/datafusion:vortex-file-compressed 86600884 93543838 0.93
tpch_q12/datafusion:vortex-file-compressed 116793878 127132012 0.92
tpch_q13/datafusion:vortex-file-compressed 223028816 240374589 0.93
tpch_q14/datafusion:vortex-file-compressed 53476371 55720278 0.96
tpch_q15/datafusion:vortex-file-compressed 98909981 105741343 0.94
tpch_q16/datafusion:vortex-file-compressed 76651782 84949758 0.90
tpch_q17/datafusion:vortex-file-compressed 647252610 697504271 0.93
tpch_q18/datafusion:vortex-file-compressed 874898836 941357728 0.93
tpch_q19/datafusion:vortex-file-compressed 75205659 82449604 0.91
tpch_q20/datafusion:vortex-file-compressed 168480300 177263410 0.95
tpch_q21/datafusion:vortex-file-compressed 669523042 726696302 0.92
tpch_q22/datafusion:vortex-file-compressed 65620744 71014044 0.92
datafusion / vortex-compact (0.943x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 441947308 455021330 0.97
tpch_q02/datafusion:vortex-compact 119138003 124151784 0.96
tpch_q03/datafusion:vortex-compact 213175204 232565620 0.92
tpch_q04/datafusion:vortex-compact 121820752 126504890 0.96
tpch_q05/datafusion:vortex-compact 385000174 415263354 0.93
tpch_q06/datafusion:vortex-compact 60291619 64634607 0.93
tpch_q07/datafusion:vortex-compact 524733734 563723360 0.93
tpch_q08/datafusion:vortex-compact 377010505 401948808 0.94
tpch_q09/datafusion:vortex-compact 659888585 713853246 0.92
tpch_q10/datafusion:vortex-compact 248872454 264679128 0.94
tpch_q11/datafusion:vortex-compact 85760678 91566891 0.94
tpch_q12/datafusion:vortex-compact 164250341 167215721 0.98
tpch_q13/datafusion:vortex-compact 265896576 282937171 0.94
tpch_q14/datafusion:vortex-compact 71010240 73939918 0.96
tpch_q15/datafusion:vortex-compact 155865617 164405311 0.95
tpch_q16/datafusion:vortex-compact 82021530 88096825 0.93
tpch_q17/datafusion:vortex-compact 647926420 700471400 0.92
tpch_q18/datafusion:vortex-compact 871901961 939349816 0.93
tpch_q19/datafusion:vortex-compact 125630411 128982266 0.97
tpch_q20/datafusion:vortex-compact 185018988 199242915 0.93
tpch_q21/datafusion:vortex-compact 673272984 721585491 0.93
tpch_q22/datafusion:vortex-compact 77497906 79917567 0.97
datafusion / parquet (0.934x ➖, 3↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 440792683 506055866 0.87
tpch_q02/datafusion:parquet 175930622 189981189 0.93
tpch_q03/datafusion:parquet 287336406 302012082 0.95
tpch_q04/datafusion:parquet 129598265 134549000 0.96
tpch_q05/datafusion:parquet 436238174 471453584 0.93
tpch_q06/datafusion:parquet 122938378 134624354 0.91
tpch_q07/datafusion:parquet 607327704 652321755 0.93
tpch_q08/datafusion:parquet 471489493 506547024 0.93
tpch_q09/datafusion:parquet 754265909 811338540 0.93
tpch_q10/datafusion:parquet 499114286 542039240 0.92
tpch_q11/datafusion:parquet 118694325 128618799 0.92
tpch_q12/datafusion:parquet 201033264 199983946 1.01
tpch_q13/datafusion:parquet 329456709 345274667 0.95
tpch_q14/datafusion:parquet 🚀 157835354 176136446 0.90
tpch_q15/datafusion:parquet 250702790 270098893 0.93
tpch_q16/datafusion:parquet 🚀 126051264 140274170 0.90
tpch_q17/datafusion:parquet 687519201 749204356 0.92
tpch_q18/datafusion:parquet 913962585 976388620 0.94
tpch_q19/datafusion:parquet 263962815 270476209 0.98
tpch_q20/datafusion:parquet 294651150 312311212 0.94
tpch_q21/datafusion:parquet 700996950 752332334 0.93
tpch_q22/datafusion:parquet 220603343 224424598 0.98
datafusion / arrow (0.925x ➖, 1↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 598531459 641414594 0.93
tpch_q02/datafusion:arrow 163674295 172984413 0.95
tpch_q03/datafusion:arrow 458534003 509327689 0.90
tpch_q04/datafusion:arrow 335402467 368866111 0.91
tpch_q05/datafusion:arrow 931506950 1013253537 0.92
tpch_q06/datafusion:arrow 277191642 305055192 0.91
tpch_q07/datafusion:arrow 1170999962 1268793506 0.92
tpch_q08/datafusion:arrow 1117304827 1221318222 0.91
tpch_q09/datafusion:arrow 1333633452 1440226127 0.93
tpch_q10/datafusion:arrow 582734413 638997560 0.91
tpch_q11/datafusion:arrow 138630953 144138759 0.96
tpch_q12/datafusion:arrow 812671455 831759775 0.98
tpch_q13/datafusion:arrow 505653493 530285094 0.95
tpch_q14/datafusion:arrow 316007891 350903026 0.90
tpch_q15/datafusion:arrow 696667787 770895259 0.90
tpch_q16/datafusion:arrow 104894994 111782451 0.94
tpch_q17/datafusion:arrow 1327183761 1435414215 0.92
tpch_q18/datafusion:arrow 1917872350 2063920634 0.93
tpch_q19/datafusion:arrow 481563184 519512261 0.93
tpch_q20/datafusion:arrow 🚀 477909922 535379768 0.89
tpch_q21/datafusion:arrow 2989196764 3152210438 0.95
tpch_q22/datafusion:arrow 128819871 140629090 0.92
duckdb / vortex-file-compressed (0.958x ➖, 1↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 171322884 169931637 1.01
tpch_q02/duckdb:vortex-file-compressed 52251896 53635446 0.97
tpch_q03/duckdb:vortex-file-compressed 122569305 129769501 0.94
tpch_q04/duckdb:vortex-file-compressed 160973579 168813862 0.95
tpch_q05/duckdb:vortex-file-compressed 140534904 142373768 0.99
tpch_q06/duckdb:vortex-file-compressed 🚀 32831294 37102890 0.88
tpch_q07/duckdb:vortex-file-compressed 132356068 138367983 0.96
tpch_q08/duckdb:vortex-file-compressed 167744248 180752488 0.93
tpch_q09/duckdb:vortex-file-compressed 388752029 415978852 0.93
tpch_q10/duckdb:vortex-file-compressed 189785102 200241551 0.95
tpch_q11/duckdb:vortex-file-compressed 32409449 33313980 0.97
tpch_q12/duckdb:vortex-file-compressed 102958606 105535819 0.98
tpch_q13/duckdb:vortex-file-compressed 273838696 283374051 0.97
tpch_q14/duckdb:vortex-file-compressed 53986058 54623773 0.99
tpch_q15/duckdb:vortex-file-compressed 89728000 94773296 0.95
tpch_q16/duckdb:vortex-file-compressed 75199269 79935000 0.94
tpch_q17/duckdb:vortex-file-compressed 94002356 99090521 0.95
tpch_q18/duckdb:vortex-file-compressed 288268757 296579951 0.97
tpch_q19/duckdb:vortex-file-compressed 80175771 82087902 0.98
tpch_q20/duckdb:vortex-file-compressed 142827324 147886902 0.97
tpch_q21/duckdb:vortex-file-compressed 494203190 516530393 0.96
tpch_q22/duckdb:vortex-file-compressed 64192463 67118470 0.96
duckdb / vortex-compact (0.960x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229428800 233653392 0.98
tpch_q02/duckdb:vortex-compact 58283572 58815008 0.99
tpch_q03/duckdb:vortex-compact 136779839 144225236 0.95
tpch_q04/duckdb:vortex-compact 170803948 178315587 0.96
tpch_q05/duckdb:vortex-compact 166207780 173697400 0.96
tpch_q06/duckdb:vortex-compact 54568564 56908563 0.96
tpch_q07/duckdb:vortex-compact 172924182 180372400 0.96
tpch_q08/duckdb:vortex-compact 186724881 198001671 0.94
tpch_q09/duckdb:vortex-compact 426139412 440102927 0.97
tpch_q10/duckdb:vortex-compact 218543941 229680380 0.95
tpch_q11/duckdb:vortex-compact 38999784 40506790 0.96
tpch_q12/duckdb:vortex-compact 165959086 169983469 0.98
tpch_q13/duckdb:vortex-compact 323187008 335981398 0.96
tpch_q14/duckdb:vortex-compact 71552397 75391893 0.95
tpch_q15/duckdb:vortex-compact 113636167 118968212 0.96
tpch_q16/duckdb:vortex-compact 78858977 84185109 0.94
tpch_q17/duckdb:vortex-compact 107055555 111959491 0.96
tpch_q18/duckdb:vortex-compact 289751585 300268338 0.96
tpch_q19/duckdb:vortex-compact 97050520 100600447 0.96
tpch_q20/duckdb:vortex-compact 176708672 183840518 0.96
tpch_q21/duckdb:vortex-compact 520496501 547596354 0.95
tpch_q22/duckdb:vortex-compact 72010217 74710448 0.96
duckdb / parquet (0.982x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 267005122 267027618 1.00
tpch_q02/duckdb:parquet 101949705 100927927 1.01
tpch_q03/duckdb:parquet 207842591 214991007 0.97
tpch_q04/duckdb:parquet 136407505 140143319 0.97
tpch_q05/duckdb:parquet 221902310 232048596 0.96
tpch_q06/duckdb:parquet 75397273 75125658 1.00
tpch_q07/duckdb:parquet 186291831 191481572 0.97
tpch_q08/duckdb:parquet 261936950 269357505 0.97
tpch_q09/duckdb:parquet 464248659 486485089 0.95
tpch_q10/duckdb:parquet 618930461 633428869 0.98
tpch_q11/duckdb:parquet 66174746 65377497 1.01
tpch_q12/duckdb:parquet 132644848 132915524 1.00
tpch_q13/duckdb:parquet 428764582 422470655 1.01
tpch_q14/duckdb:parquet 180626972 181130646 1.00
tpch_q15/duckdb:parquet 104192215 105888525 0.98
tpch_q16/duckdb:parquet 162393793 167560516 0.97
tpch_q17/duckdb:parquet 180253014 184771355 0.98
tpch_q18/duckdb:parquet 365218886 372105594 0.98
tpch_q19/duckdb:parquet 280849456 289847981 0.97
tpch_q20/duckdb:parquet 229951376 233634236 0.98
tpch_q21/duckdb:parquet 555553532 584278702 0.95
tpch_q22/duckdb:parquet 289753743 297001494 0.98
duckdb / duckdb (0.973x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120645676 121318507 0.99
tpch_q02/duckdb:duckdb 52595694 51574243 1.02
tpch_q03/duckdb:duckdb 103093056 106633070 0.97
tpch_q04/duckdb:duckdb 139638732 145219702 0.96
tpch_q05/duckdb:duckdb 119387356 122399251 0.98
tpch_q06/duckdb:duckdb 44799176 45640918 0.98
tpch_q07/duckdb:duckdb 90327334 93482119 0.97
tpch_q08/duckdb:duckdb 117618605 121732680 0.97
tpch_q09/duckdb:duckdb 278364601 286321681 0.97
tpch_q10/duckdb:duckdb 210193150 221089429 0.95
tpch_q11/duckdb:duckdb 19076052 19485850 0.98
tpch_q12/duckdb:duckdb 90188465 92875599 0.97
tpch_q13/duckdb:duckdb 228863674 237178153 0.96
tpch_q14/duckdb:duckdb 78574930 80720045 0.97
tpch_q15/duckdb:duckdb 81185661 83869720 0.97
tpch_q16/duckdb:duckdb 76302420 79505579 0.96
tpch_q17/duckdb:duckdb 87323918 89219492 0.98
tpch_q18/duckdb:duckdb 234260038 238899606 0.98
tpch_q19/duckdb:duckdb 124285167 126877524 0.98
tpch_q20/duckdb:duckdb 118243150 119629914 0.99
tpch_q21/duckdb:duckdb 299436695 315061970 0.95
tpch_q22/duckdb:duckdb 69807883 73537854 0.95

File Size Changes (27 files changed, -0.0% overall, 16↑ 11↓)
File Scale Format Base HEAD Change %
supplier_0.vortex 10.0 vortex-file-compressed 5.73 MB 5.77 MB +49.40 KB +0.8%
partsupp_1.vortex 10.0 vortex-compact 104.87 MB 105.22 MB +367.99 KB +0.3%
lineitem_8.vortex 10.0 vortex-file-compressed 133.43 MB 133.66 MB +232.48 KB +0.2%
lineitem_7.vortex 10.0 vortex-file-compressed 133.41 MB 133.63 MB +221.26 KB +0.2%
lineitem_9.vortex 10.0 vortex-file-compressed 134.06 MB 134.27 MB +214.85 KB +0.2%
lineitem_4.vortex 10.0 vortex-file-compressed 133.97 MB 134.14 MB +174.09 KB +0.1%
lineitem_11.vortex 10.0 vortex-file-compressed 134.24 MB 134.40 MB +162.80 KB +0.1%
lineitem_1.vortex 10.0 vortex-file-compressed 133.60 MB 133.74 MB +147.10 KB +0.1%
lineitem_0.vortex 10.0 vortex-file-compressed 134.22 MB 134.34 MB +127.99 KB +0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 133.99 MB 134.07 MB +80.61 KB +0.1%
lineitem_6.vortex 10.0 vortex-file-compressed 132.81 MB 132.87 MB +57.80 KB +0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 120.28 MB 120.32 MB +46.59 KB +0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 133.53 MB 133.58 MB +46.20 KB +0.0%
customer_0.vortex 10.0 vortex-compact 74.09 MB 74.12 MB +25.47 KB +0.0%
lineitem_3.vortex 10.0 vortex-file-compressed 133.20 MB 133.22 MB +26.65 KB +0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 120.33 MB 120.34 MB +13.52 KB +0.0%
customer_0.vortex 10.0 vortex-file-compressed 88.53 MB 88.53 MB 3.31 KB -0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 134.15 MB 134.07 MB 76.45 KB -0.1%
lineitem_12.vortex 10.0 vortex-file-compressed 134.06 MB 133.98 MB 80.80 KB -0.1%
partsupp_0.vortex 10.0 vortex-compact 104.91 MB 104.81 MB 104.52 KB -0.1%
orders_1.vortex 10.0 vortex-file-compressed 145.83 MB 145.60 MB 232.70 KB -0.2%
orders_2.vortex 10.0 vortex-file-compressed 146.24 MB 145.95 MB 299.95 KB -0.2%
part_0.vortex 10.0 vortex-file-compressed 24.96 MB 24.89 MB 77.39 KB -0.3%
orders_0.vortex 10.0 vortex-file-compressed 144.67 MB 144.08 MB 603.06 KB -0.4%
part_1.vortex 10.0 vortex-compact 16.90 MB 16.80 MB 103.87 KB -0.6%
part_1.vortex 10.0 vortex-file-compressed 24.84 MB 24.64 MB 197.87 KB -0.8%
part_0.vortex 10.0 vortex-compact 17.14 MB 16.85 MB 291.98 KB -1.7%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (-0.0%)
  • vortex-file-compressed: 2.50 GB → 2.50 GB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -6.7% -6.7% -0.0% +10.0% ➖ noise
1 datafusion:vortex-compact -2.9% -6.7% +4.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -7.2% -6.7% -0.6% +10.0% ➖ noise
1 duckdb:duckdb -0.6% -6.7% +6.6% +10.0% ➖ noise
1 duckdb:vortex-compact -1.8% -6.7% +5.2% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +0.8% -6.7% +8.0% +10.0% ➖ noise
2 datafusion:arrow -5.4% -3.3% -2.2% +10.0% ➖ noise
2 datafusion:vortex-compact -4.0% -3.3% -0.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -9.1% -3.3% -6.0% +10.0% ➖ noise
2 duckdb:duckdb +2.0% -3.3% +5.4% +10.0% ➖ noise
2 duckdb:vortex-compact -0.9% -3.3% +2.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.6% -3.3% +0.7% +10.0% ➖ noise
3 datafusion:arrow -10.0% -4.1% -6.1% +10.0% ➖ noise
3 datafusion:vortex-compact -8.3% -4.1% -4.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -7.3% -4.1% -3.4% +10.0% ➖ noise
3 duckdb:duckdb -3.3% -4.1% +0.8% +10.0% ➖ noise
3 duckdb:vortex-compact -5.2% -4.1% -1.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -5.5% -4.1% -1.5% +10.0% ➖ noise
4 datafusion:arrow -9.1% -3.2% -6.1% +10.0% ➖ noise
4 datafusion:vortex-compact -3.7% -3.2% -0.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -7.7% -3.2% -4.7% +10.0% ➖ noise
4 duckdb:duckdb -3.8% -3.2% -0.7% +10.0% ➖ noise
4 duckdb:vortex-compact -4.2% -3.2% -1.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -4.6% -3.2% -1.5% +10.0% ➖ noise
5 datafusion:arrow -8.1% -5.9% -2.3% +10.0% ➖ noise
5 datafusion:vortex-compact -7.3% -5.9% -1.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -7.4% -5.9% -1.5% +10.0% ➖ noise
5 duckdb:duckdb -2.5% -5.9% +3.7% +10.0% ➖ noise
5 duckdb:vortex-compact -4.3% -5.9% +1.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.3% -5.9% +4.9% +10.0% ➖ noise
6 datafusion:arrow -9.1% -4.3% -5.1% +10.0% ➖ noise
6 datafusion:vortex-compact -6.7% -4.3% -2.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -11.2% -4.3% -7.2% +10.0% ➖ noise
6 duckdb:duckdb -1.8% -4.3% +2.5% +10.0% ➖ noise
6 duckdb:vortex-compact -4.1% -4.3% +0.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -11.5% -4.3% -7.6% +14.0% ➖ noise
7 datafusion:arrow -7.7% -4.8% -3.0% +10.0% ➖ noise
7 datafusion:vortex-compact -6.9% -4.8% -2.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -7.0% -4.8% -2.3% +10.0% ➖ noise
7 duckdb:duckdb -3.4% -4.8% +1.5% +10.0% ➖ noise
7 duckdb:vortex-compact -4.1% -4.8% +0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -4.3% -4.8% +0.5% +10.0% ➖ noise
8 datafusion:arrow -8.5% -4.9% -3.8% +10.0% ➖ noise
8 datafusion:vortex-compact -6.2% -4.9% -1.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -6.6% -4.9% -1.8% +10.0% ➖ noise
8 duckdb:duckdb -3.4% -4.9% +1.6% +10.0% ➖ noise
8 duckdb:vortex-compact -5.7% -4.9% -0.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -7.2% -4.9% -2.5% +10.0% ➖ noise
9 datafusion:arrow -7.4% -5.8% -1.7% +10.0% ➖ noise
9 datafusion:vortex-compact -7.6% -5.8% -1.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -6.5% -5.8% -0.8% +10.0% ➖ noise
9 duckdb:duckdb -2.8% -5.8% +3.2% +10.0% ➖ noise
9 duckdb:vortex-compact -3.2% -5.8% +2.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -6.5% -5.8% -0.8% +10.0% ➖ noise
10 datafusion:arrow -8.8% -5.1% -3.9% +10.0% ➖ noise
10 datafusion:vortex-compact -6.0% -5.1% -0.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -7.0% -5.1% -2.0% +10.0% ➖ noise
10 duckdb:duckdb -4.9% -5.1% +0.2% +10.0% ➖ noise
10 duckdb:vortex-compact -4.8% -5.1% +0.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -5.2% -5.1% -0.1% +10.0% ➖ noise
11 datafusion:arrow -3.8% -3.4% -0.5% +11.7% ➖ noise
11 datafusion:vortex-compact -6.3% -3.4% -3.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -7.4% -3.4% -4.2% +10.1% ➖ noise
11 duckdb:duckdb -2.1% -3.4% +1.3% +10.0% ➖ noise
11 duckdb:vortex-compact -3.7% -3.4% -0.4% +16.6% ➖ noise
11 duckdb:vortex-file-compressed -2.7% -3.4% +0.7% +12.3% ➖ noise
12 datafusion:arrow -2.3% +0.2% -2.5% +32.3% ➖ noise
12 datafusion:vortex-compact -1.8% +0.2% -1.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -8.1% +0.2% -8.3% +10.0% ➖ noise
12 duckdb:duckdb -2.9% +0.2% -3.0% +10.0% ➖ noise
12 duckdb:vortex-compact -2.4% +0.2% -2.5% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -2.4% +0.2% -2.6% +10.0% ➖ noise
13 datafusion:arrow -4.6% -1.6% -3.1% +10.0% ➖ noise
13 datafusion:vortex-compact -6.0% -1.6% -4.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -7.2% -1.6% -5.7% +10.0% ➖ noise
13 duckdb:duckdb -3.5% -1.6% -1.9% +10.0% ➖ noise
13 duckdb:vortex-compact -3.8% -1.6% -2.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -3.4% -1.6% -1.8% +10.0% ➖ noise
14 datafusion:arrow -9.9% -5.5% -4.7% +10.0% ➖ noise
14 datafusion:vortex-compact -4.0% -5.5% +1.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -4.0% -5.5% +1.5% +10.0% ➖ noise
14 duckdb:duckdb -2.7% -5.5% +3.0% +10.0% ➖ noise
14 duckdb:vortex-compact -5.1% -5.5% +0.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.2% -5.5% +4.6% +10.0% ➖ noise
15 datafusion:arrow -9.6% -4.4% -5.4% +10.0% ➖ noise
15 datafusion:vortex-compact -5.2% -4.4% -0.8% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -6.5% -4.4% -2.1% +10.0% ➖ noise
15 duckdb:duckdb -3.2% -4.4% +1.3% +10.0% ➖ noise
15 duckdb:vortex-compact -4.5% -4.4% -0.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -5.3% -4.4% -0.9% +10.0% ➖ noise
16 datafusion:arrow -6.2% -6.7% +0.6% +10.3% ➖ noise
16 datafusion:vortex-compact -6.9% -6.7% -0.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -9.8% -6.7% -3.3% +10.0% ➖ noise
16 duckdb:duckdb -4.0% -6.7% +2.8% +10.0% ➖ noise
16 duckdb:vortex-compact -6.3% -6.7% +0.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -5.9% -6.7% +0.8% +10.0% ➖ noise
17 datafusion:arrow -7.5% -5.4% -2.3% +10.0% ➖ noise
17 datafusion:vortex-compact -7.5% -5.4% -2.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -7.2% -5.4% -1.9% +10.0% ➖ noise
17 duckdb:duckdb -2.1% -5.4% +3.4% +10.0% ➖ noise
17 duckdb:vortex-compact -4.4% -5.4% +1.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -5.1% -5.4% +0.3% +10.0% ➖ noise
18 datafusion:arrow -7.1% -4.1% -3.1% +10.0% ➖ noise
18 datafusion:vortex-compact -7.2% -4.1% -3.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -7.1% -4.1% -3.0% +10.0% ➖ noise
18 duckdb:duckdb -1.9% -4.1% +2.3% +10.0% ➖ noise
18 duckdb:vortex-compact -3.5% -4.1% +0.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -2.8% -4.1% +1.4% +10.0% ➖ noise
19 datafusion:arrow -7.3% -2.8% -4.7% +10.0% ➖ noise
19 datafusion:vortex-compact -2.6% -2.8% +0.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -8.8% -2.8% -6.2% +10.0% ➖ noise
19 duckdb:duckdb -2.0% -2.8% +0.7% +10.0% ➖ noise
19 duckdb:vortex-compact -3.5% -2.8% -0.8% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -2.3% -2.8% +0.4% +10.0% ➖ noise
20 datafusion:arrow -10.7% -3.6% -7.4% +10.0% ➖ noise
20 datafusion:vortex-compact -7.1% -3.6% -3.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -5.0% -3.6% -1.4% +10.0% ➖ noise
20 duckdb:duckdb -1.2% -3.6% +2.6% +10.0% ➖ noise
20 duckdb:vortex-compact -3.9% -3.6% -0.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -3.4% -3.6% +0.2% +10.0% ➖ noise
21 datafusion:arrow -5.2% -5.9% +0.7% +10.0% ➖ noise
21 datafusion:vortex-compact -6.7% -5.9% -0.9% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -7.9% -5.9% -2.1% +10.0% ➖ noise
21 duckdb:duckdb -5.0% -5.9% +1.0% +10.0% ➖ noise
21 duckdb:vortex-compact -4.9% -5.9% +1.0% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -4.3% -5.9% +1.6% +10.0% ➖ noise
22 datafusion:arrow -8.4% -2.1% -6.5% +10.0% ➖ noise
22 datafusion:vortex-compact -3.0% -2.1% -1.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -7.6% -2.1% -5.6% +10.0% ➖ noise
22 duckdb:duckdb -5.1% -2.1% -3.1% +10.0% ➖ noise
22 duckdb:vortex-compact -3.6% -2.1% -1.6% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -4.4% -2.1% -2.3% +10.1% ➖ noise

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.2%
Engines: DataFusion No clear signal (-6.5%, environment too noisy confidence) · DuckDB No clear signal (-1.8%, environment too noisy confidence)
Vortex (geomean): 0.919x ➖
Parquet (geomean): 0.959x ➖
Shifts: Parquet (control) -4.1% · Median polish -5.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.943x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 312858270 264196069 1.18
tpch_q02/datafusion:vortex-file-compressed 560040555 633273352 0.88
tpch_q03/datafusion:vortex-file-compressed 537877620 544392118 0.99
tpch_q04/datafusion:vortex-file-compressed 292666425 345751032 0.85
tpch_q05/datafusion:vortex-file-compressed 430796063 554547665 0.78
tpch_q06/datafusion:vortex-file-compressed 319481898 344213405 0.93
tpch_q07/datafusion:vortex-file-compressed 435988760 465940934 0.94
tpch_q08/datafusion:vortex-file-compressed 661822465 648074707 1.02
tpch_q09/datafusion:vortex-file-compressed 432585207 471351751 0.92
tpch_q10/datafusion:vortex-file-compressed 547493552 583916129 0.94
tpch_q11/datafusion:vortex-file-compressed 304055175 425544719 0.71
tpch_q12/datafusion:vortex-file-compressed 393095695 438118883 0.90
tpch_q13/datafusion:vortex-file-compressed 165993994 154572813 1.07
tpch_q14/datafusion:vortex-file-compressed 249447736 253111705 0.99
tpch_q15/datafusion:vortex-file-compressed 472535273 429348039 1.10
tpch_q16/datafusion:vortex-file-compressed 214648543 244615323 0.88
tpch_q17/datafusion:vortex-file-compressed 452906105 432502005 1.05
tpch_q18/datafusion:vortex-file-compressed 338261343 340694727 0.99
tpch_q19/datafusion:vortex-file-compressed 452193803 544854860 0.83
tpch_q20/datafusion:vortex-file-compressed 421178259 416053298 1.01
tpch_q21/datafusion:vortex-file-compressed 641922336 631809630 1.02
tpch_q22/datafusion:vortex-file-compressed 124040227 135775124 0.91
datafusion / vortex-compact (0.864x ➖, 3↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 281777190 260019819 1.08
tpch_q02/datafusion:vortex-compact 467469443 464974293 1.01
tpch_q03/datafusion:vortex-compact 552138777 455043160 1.21
tpch_q04/datafusion:vortex-compact 219758662 222526660 0.99
tpch_q05/datafusion:vortex-compact 430505778 398956519 1.08
tpch_q06/datafusion:vortex-compact 283802480 331527682 0.86
tpch_q07/datafusion:vortex-compact 406119215 483189561 0.84
tpch_q08/datafusion:vortex-compact 506089068 637886125 0.79
tpch_q09/datafusion:vortex-compact 450190055 635695273 0.71
tpch_q10/datafusion:vortex-compact 474472036 510305418 0.93
tpch_q11/datafusion:vortex-compact 280758310 327214963 0.86
tpch_q12/datafusion:vortex-compact 416281865 453058427 0.92
tpch_q13/datafusion:vortex-compact 146386676 136270193 1.07
tpch_q14/datafusion:vortex-compact 🚀 222962994 342930484 0.65
tpch_q15/datafusion:vortex-compact 🚀 366192241 549463981 0.67
tpch_q16/datafusion:vortex-compact 183032640 239928958 0.76
tpch_q17/datafusion:vortex-compact 379680808 435647448 0.87
tpch_q18/datafusion:vortex-compact 294678181 331364882 0.89
tpch_q19/datafusion:vortex-compact 474032009 613516911 0.77
tpch_q20/datafusion:vortex-compact 409908314 472975469 0.87
tpch_q21/datafusion:vortex-compact 488303202 652190051 0.75
tpch_q22/datafusion:vortex-compact 🚀 99209111 142668576 0.70
datafusion / parquet (0.965x ➖, 2↑ 2↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 229016013 334520204 0.68
tpch_q02/datafusion:parquet 410932636 483011422 0.85
tpch_q03/datafusion:parquet 308211099 322935708 0.95
tpch_q04/datafusion:parquet 189589120 181857455 1.04
tpch_q05/datafusion:parquet 499546041 639693161 0.78
tpch_q06/datafusion:parquet 🚀 139866589 217027467 0.64
tpch_q07/datafusion:parquet 476807245 468048919 1.02
tpch_q08/datafusion:parquet 601210318 706445458 0.85
tpch_q09/datafusion:parquet 523266778 492641200 1.06
tpch_q10/datafusion:parquet 530309986 553847413 0.96
tpch_q11/datafusion:parquet 347314803 349813815 0.99
tpch_q12/datafusion:parquet 259751598 345702328 0.75
tpch_q13/datafusion:parquet 483555422 491958402 0.98
tpch_q14/datafusion:parquet 193015359 236241927 0.82
tpch_q15/datafusion:parquet 327417885 358906598 0.91
tpch_q16/datafusion:parquet 🚨 248962482 175670747 1.42
tpch_q17/datafusion:parquet 478839848 445087092 1.08
tpch_q18/datafusion:parquet 585650254 528184718 1.11
tpch_q19/datafusion:parquet 351534915 337893349 1.04
tpch_q20/datafusion:parquet 🚨 434772882 309288025 1.41
tpch_q21/datafusion:parquet 640884459 510607374 1.26
tpch_q22/datafusion:parquet 140480667 134072718 1.05
duckdb / vortex-file-compressed (0.946x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 284321666 259844960 1.09
tpch_q02/duckdb:vortex-file-compressed 963918144 987474616 0.98
tpch_q03/duckdb:vortex-file-compressed 650177439 723336199 0.90
tpch_q04/duckdb:vortex-file-compressed 428875275 417699340 1.03
tpch_q05/duckdb:vortex-file-compressed 839033872 879452644 0.95
tpch_q06/duckdb:vortex-file-compressed 406888561 355906053 1.14
tpch_q07/duckdb:vortex-file-compressed 976896133 951889785 1.03
tpch_q08/duckdb:vortex-file-compressed 986690365 1081297627 0.91
tpch_q09/duckdb:vortex-file-compressed 897173512 1055130678 0.85
tpch_q10/duckdb:vortex-file-compressed 706658214 812712548 0.87
tpch_q11/duckdb:vortex-file-compressed 513253292 556400997 0.92
tpch_q12/duckdb:vortex-file-compressed 624490521 684850273 0.91
tpch_q13/duckdb:vortex-file-compressed 393290631 424183874 0.93
tpch_q14/duckdb:vortex-file-compressed 386326230 422410822 0.91
tpch_q15/duckdb:vortex-file-compressed 272965667 360578637 0.76
tpch_q16/duckdb:vortex-file-compressed 354929778 364171876 0.97
tpch_q17/duckdb:vortex-file-compressed 716087483 759775976 0.94
tpch_q18/duckdb:vortex-file-compressed 587217866 632628235 0.93
tpch_q19/duckdb:vortex-file-compressed 497523549 487659686 1.02
tpch_q20/duckdb:vortex-file-compressed 829148394 796882590 1.04
tpch_q21/duckdb:vortex-file-compressed 1045047022 1230838204 0.85
tpch_q22/duckdb:vortex-file-compressed 296222065 307010848 0.96
duckdb / vortex-compact (0.925x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 284983081 314568762 0.91
tpch_q02/duckdb:vortex-compact 945341235 1025199202 0.92
tpch_q03/duckdb:vortex-compact 593571417 670242901 0.89
tpch_q04/duckdb:vortex-compact 377288136 472086741 0.80
tpch_q05/duckdb:vortex-compact 772877088 956071565 0.81
tpch_q06/duckdb:vortex-compact 336601957 348707499 0.97
tpch_q07/duckdb:vortex-compact 856115473 875360162 0.98
tpch_q08/duckdb:vortex-compact 958508813 1033573053 0.93
tpch_q09/duckdb:vortex-compact 970634253 1068688034 0.91
tpch_q10/duckdb:vortex-compact 724205752 726598499 1.00
tpch_q11/duckdb:vortex-compact 488022589 505869422 0.96
tpch_q12/duckdb:vortex-compact 633702986 653776184 0.97
tpch_q13/duckdb:vortex-compact 393541016 459253092 0.86
tpch_q14/duckdb:vortex-compact 408607747 416521047 0.98
tpch_q15/duckdb:vortex-compact 304143332 313610700 0.97
tpch_q16/duckdb:vortex-compact 330211550 322933082 1.02
tpch_q17/duckdb:vortex-compact 652457028 740345594 0.88
tpch_q18/duckdb:vortex-compact 506954097 553577242 0.92
tpch_q19/duckdb:vortex-compact 481911770 552502531 0.87
tpch_q20/duckdb:vortex-compact 724136348 811641888 0.89
tpch_q21/duckdb:vortex-compact 980654072 1117229654 0.88
tpch_q22/duckdb:vortex-compact 309578147 281226169 1.10
duckdb / parquet (0.953x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 417583723 448169620 0.93
tpch_q02/duckdb:parquet 1083840511 1205716564 0.90
tpch_q03/duckdb:parquet 1116459554 1132674074 0.99
tpch_q04/duckdb:parquet 659656340 700176994 0.94
tpch_q05/duckdb:parquet 1217858461 1474357416 0.83
tpch_q06/duckdb:parquet 429907424 526930142 0.82
tpch_q07/duckdb:parquet 1230033817 1273393107 0.97
tpch_q08/duckdb:parquet 1561165966 1604960284 0.97
tpch_q09/duckdb:parquet 1513568033 1473531367 1.03
tpch_q10/duckdb:parquet 1295052829 1395099166 0.93
tpch_q11/duckdb:parquet 693475886 727840764 0.95
tpch_q12/duckdb:parquet 756164281 717599873 1.05
tpch_q13/duckdb:parquet 901844905 869833825 1.04
tpch_q14/duckdb:parquet 661239380 726138742 0.91
tpch_q15/duckdb:parquet 513048995 530071991 0.97
tpch_q16/duckdb:parquet 717325944 659566638 1.09
tpch_q17/duckdb:parquet 747499567 898389178 0.83
tpch_q18/duckdb:parquet 868280300 990101784 0.88
tpch_q19/duckdb:parquet 890910239 812628560 1.10
tpch_q20/duckdb:parquet 1075751425 1193438251 0.90
tpch_q21/duckdb:parquet 1105678277 1082209297 1.02
tpch_q22/duckdb:parquet 583278809 580162146 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +8.4% -20.1% +35.7% +72.5% ➖ noise
1 datafusion:vortex-file-compressed +18.4% -20.1% +48.3% +72.2% ➖ noise
1 duckdb:vortex-compact -9.4% -20.1% +13.4% +51.4% ➖ noise
1 duckdb:vortex-file-compressed +9.4% -20.1% +37.0% +42.8% ➖ noise
2 datafusion:vortex-compact +0.5% -12.5% +15.0% +37.5% ➖ noise
2 datafusion:vortex-file-compressed -11.6% -12.5% +1.1% +37.6% ➖ noise
2 duckdb:vortex-compact -7.8% -12.5% +5.4% +37.5% ➖ noise
2 duckdb:vortex-file-compressed -2.4% -12.5% +11.6% +37.5% ➖ noise
3 datafusion:vortex-compact +21.3% -3.0% +25.1% +40.4% ➖ noise
3 datafusion:vortex-file-compressed -1.2% -3.0% +1.9% +64.2% ➖ noise
3 duckdb:vortex-compact -11.4% -3.0% -8.7% +37.5% ➖ noise
3 duckdb:vortex-file-compressed -10.1% -3.0% -7.3% +37.5% ➖ noise
4 datafusion:vortex-compact -1.2% -0.9% -0.4% +37.5% ➖ noise
4 datafusion:vortex-file-compressed -15.4% -0.9% -14.6% +37.5% ➖ noise
4 duckdb:vortex-compact -20.1% -0.9% -19.4% +37.5% ➖ noise
4 duckdb:vortex-file-compressed +2.7% -0.9% +3.6% +37.5% ➖ noise
5 datafusion:vortex-compact +7.9% -19.7% +34.4% +37.5% ➖ noise
5 datafusion:vortex-file-compressed -22.3% -19.7% -3.3% +37.5% ➖ noise
5 duckdb:vortex-compact -19.2% -19.7% +0.7% +37.5% ➖ noise
5 duckdb:vortex-file-compressed -4.6% -19.7% +18.8% +37.5% ➖ noise
6 datafusion:vortex-compact -14.4% -27.5% +18.1% +37.5% ➖ noise
6 datafusion:vortex-file-compressed -7.2% -27.5% +28.0% +37.5% ➖ noise
6 duckdb:vortex-compact -3.5% -27.5% +33.1% +37.5% ➖ noise
6 duckdb:vortex-file-compressed +14.3% -27.5% +57.7% +37.5% 🚨 regression
7 datafusion:vortex-compact -16.0% -0.8% -15.3% +37.5% ➖ noise
7 datafusion:vortex-file-compressed -6.4% -0.8% -5.7% +37.5% ➖ noise
7 duckdb:vortex-compact -2.2% -0.8% -1.4% +37.5% ➖ noise
7 duckdb:vortex-file-compressed +2.6% -0.8% +3.5% +37.5% ➖ noise
8 datafusion:vortex-compact -20.7% -9.0% -12.8% +37.5% ➖ noise
8 datafusion:vortex-file-compressed +2.1% -9.0% +12.2% +37.5% ➖ noise
8 duckdb:vortex-compact -7.3% -9.0% +1.9% +37.5% ➖ noise
8 duckdb:vortex-file-compressed -8.7% -9.0% +0.3% +37.5% ➖ noise
9 datafusion:vortex-compact -29.2% +4.5% -32.2% +37.5% ✅ faster
9 datafusion:vortex-file-compressed -8.2% +4.5% -12.1% +37.5% ➖ noise
9 duckdb:vortex-compact -9.2% +4.5% -13.0% +37.5% ➖ noise
9 duckdb:vortex-file-compressed -15.0% +4.5% -18.6% +37.5% ➖ noise
10 datafusion:vortex-compact -7.0% -5.7% -1.4% +37.5% ➖ noise
10 datafusion:vortex-file-compressed -6.2% -5.7% -0.5% +37.5% ➖ noise
10 duckdb:vortex-compact -0.3% -5.7% +5.7% +37.5% ➖ noise
10 duckdb:vortex-file-compressed -13.0% -5.7% -7.8% +37.5% ➖ noise
11 datafusion:vortex-compact -14.2% -2.7% -11.8% +37.5% ➖ noise
11 datafusion:vortex-file-compressed -28.5% -2.7% -26.5% +37.5% ➖ noise
11 duckdb:vortex-compact -3.5% -2.7% -0.8% +37.5% ➖ noise
11 duckdb:vortex-file-compressed -7.8% -2.7% -5.2% +37.5% ➖ noise
12 datafusion:vortex-compact -8.1% -11.0% +3.3% +37.5% ➖ noise
12 datafusion:vortex-file-compressed -10.3% -11.0% +0.8% +37.5% ➖ noise
12 duckdb:vortex-compact -3.1% -11.0% +8.9% +37.5% ➖ noise
12 duckdb:vortex-file-compressed -8.8% -11.0% +2.5% +37.5% ➖ noise
13 datafusion:vortex-compact +7.4% +1.0% +6.4% +56.5% ➖ noise
13 datafusion:vortex-file-compressed +7.4% +1.0% +6.4% +44.9% ➖ noise
13 duckdb:vortex-compact -14.3% +1.0% -15.1% +37.5% ➖ noise
13 duckdb:vortex-file-compressed -7.3% +1.0% -8.2% +37.5% ➖ noise
14 datafusion:vortex-compact -35.0% -13.7% -24.6% +37.5% ➖ noise
14 datafusion:vortex-file-compressed -1.4% -13.7% +14.3% +37.5% ➖ noise
14 duckdb:vortex-compact -1.9% -13.7% +13.7% +37.5% ➖ noise
14 duckdb:vortex-file-compressed -8.5% -13.7% +6.0% +37.5% ➖ noise
15 datafusion:vortex-compact -33.4% -6.0% -29.1% +37.5% ✅ faster
15 datafusion:vortex-file-compressed +10.1% -6.0% +17.1% +37.5% ➖ noise
15 duckdb:vortex-compact -3.0% -6.0% +3.2% +37.5% ➖ noise
15 duckdb:vortex-file-compressed -24.3% -6.0% -19.4% +37.5% ➖ noise
16 datafusion:vortex-compact -23.7% +24.1% -38.6% +37.5% ✅ faster
16 datafusion:vortex-file-compressed -12.3% +24.1% -29.3% +37.5% ✅ faster
16 duckdb:vortex-compact +2.3% +24.1% -17.6% +37.5% ➖ noise
16 duckdb:vortex-file-compressed -2.5% +24.1% -21.5% +37.5% ➖ noise
17 datafusion:vortex-compact -12.8% -5.4% -7.9% +37.5% ➖ noise
17 datafusion:vortex-file-compressed +4.7% -5.4% +10.7% +37.5% ➖ noise
17 duckdb:vortex-compact -11.9% -5.4% -6.9% +37.5% ➖ noise
17 duckdb:vortex-file-compressed -5.8% -5.4% -0.4% +37.5% ➖ noise
18 datafusion:vortex-compact -11.1% -1.4% -9.8% +37.5% ➖ noise
18 datafusion:vortex-file-compressed -0.7% -1.4% +0.7% +37.5% ➖ noise
18 duckdb:vortex-compact -8.4% -1.4% -7.1% +37.5% ➖ noise
18 duckdb:vortex-file-compressed -7.2% -1.4% -5.9% +37.5% ➖ noise
19 datafusion:vortex-compact -22.7% +6.8% -27.7% +37.5% ✅ faster
19 datafusion:vortex-file-compressed -17.0% +6.8% -22.3% +37.5% ➖ noise
19 duckdb:vortex-compact -12.8% +6.8% -18.3% +37.5% ➖ noise
19 duckdb:vortex-file-compressed +2.0% +6.8% -4.5% +37.5% ➖ noise
20 datafusion:vortex-compact -13.3% +12.6% -23.0% +37.5% ➖ noise
20 datafusion:vortex-file-compressed +1.2% +12.6% -10.1% +37.5% ➖ noise
20 duckdb:vortex-compact -10.8% +12.6% -20.7% +37.5% ➖ noise
20 duckdb:vortex-file-compressed +4.0% +12.6% -7.6% +37.5% ➖ noise
21 datafusion:vortex-compact -25.1% +13.2% -33.9% +37.5% ✅ faster
21 datafusion:vortex-file-compressed +1.6% +13.2% -10.3% +37.5% ➖ noise
21 duckdb:vortex-compact -12.2% +13.2% -22.5% +37.5% ➖ noise
21 duckdb:vortex-file-compressed -15.1% +13.2% -25.0% +37.5% ➖ noise
22 datafusion:vortex-compact -30.5% +2.6% -32.2% +37.5% ✅ faster
22 datafusion:vortex-file-compressed -8.6% +2.6% -11.0% +37.5% ➖ noise
22 duckdb:vortex-compact +10.1% +2.6% +7.3% +37.5% ➖ noise
22 duckdb:vortex-file-compressed -3.5% +2.6% -6.0% +37.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): 1.010x ➖
Parquet (geomean): 1.008x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.015x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 125930659 125254060 1.01
appian_q02/datafusion:vortex-file-compressed 652744168 665158708 0.98
appian_q03/datafusion:vortex-file-compressed 357685362 364741607 0.98
appian_q04/datafusion:vortex-file-compressed 27858714764 26936646960 1.03
appian_q05/datafusion:vortex-file-compressed 279798816 266535997 1.05
appian_q06/datafusion:vortex-file-compressed 430561256 433634878 0.99
appian_q07/datafusion:vortex-file-compressed 473382386 449048391 1.05
appian_q08/datafusion:vortex-file-compressed 1894108638 1845455724 1.03
datafusion / parquet (1.006x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 128007723 130949657 0.98
appian_q02/datafusion:parquet 670365976 674291033 0.99
appian_q03/datafusion:parquet 353079458 355263547 0.99
appian_q04/datafusion:parquet 27727785785 26479277203 1.05
appian_q05/datafusion:parquet 279582402 285434706 0.98
appian_q06/datafusion:parquet 435902907 430005706 1.01
appian_q07/datafusion:parquet 464708973 447358352 1.04
appian_q08/datafusion:parquet 1832577790 1817917990 1.01
duckdb / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 193781524 194883732 0.99
appian_q02/duckdb:vortex-file-compressed 618848541 612632136 1.01
appian_q03/duckdb:vortex-file-compressed 258694830 257748301 1.00
appian_q04/duckdb:vortex-file-compressed 1323087588 1320125415 1.00
appian_q05/duckdb:vortex-file-compressed 292676620 288957300 1.01
appian_q06/duckdb:vortex-file-compressed 801666745 804704009 1.00
appian_q07/duckdb:vortex-file-compressed 345274441 340486512 1.01
appian_q08/duckdb:vortex-file-compressed 1291024351 1290337505 1.00
duckdb / parquet (1.009x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 205969866 199943396 1.03
appian_q02/duckdb:parquet 607302104 605581774 1.00
appian_q03/duckdb:parquet 293971744 288490738 1.02
appian_q04/duckdb:parquet 1323777966 1320177052 1.00
appian_q05/duckdb:parquet 316046569 312264924 1.01
appian_q06/duckdb:parquet 793637265 793739206 1.00
appian_q07/duckdb:parquet 364096791 362235585 1.01
appian_q08/duckdb:parquet 1267092157 1267475060 1.00
duckdb / duckdb (1.001x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 170257277 170721300 1.00
appian_q02/duckdb:duckdb 545513746 545613930 1.00
appian_q03/duckdb:duckdb 405404944 396809394 1.02
appian_q04/duckdb:duckdb 1296988055 1305542071 0.99
appian_q05/duckdb:duckdb 280249667 276549162 1.01
appian_q06/duckdb:duckdb 780784546 790099548 0.99
appian_q07/duckdb:duckdb 322966251 323931515 1.00
appian_q08/duckdb:duckdb 1215787861 1214118918 1.00

File Size Changes (4 files changed, -0.0% overall, 2↑ 2↓)
File Scale Format Base HEAD Change %
creditcardview.vortex 1.0 vortex-file-compressed 60.95 MB 60.99 MB +46.28 KB +0.1%
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB +56 B +0.0%
orderview.vortex 1.0 vortex-file-compressed 81.13 MB 81.13 MB 1.63 KB -0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 513.71 MB → 513.75 MB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-file-compressed +0.5% +0.3% +0.2% +11.0% ➖ noise
1 duckdb:duckdb -0.3% +0.3% -0.6% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.6% +0.3% -0.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.9% -0.1% -1.7% +10.0% ➖ noise
2 duckdb:duckdb -0.0% -0.1% +0.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.0% -0.1% +1.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.9% +0.6% -2.6% +10.0% ➖ noise
3 duckdb:duckdb +2.2% +0.6% +1.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.4% +0.6% -0.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +3.4% +2.5% +0.9% +10.0% ➖ noise
4 duckdb:duckdb -0.7% +2.5% -3.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.2% +2.5% -2.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +5.0% -0.4% +5.4% +12.4% ➖ noise
5 duckdb:duckdb +1.3% -0.4% +1.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.3% -0.4% +1.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.7% +0.7% -1.4% +10.0% ➖ noise
6 duckdb:duckdb -1.2% +0.7% -1.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.4% +0.7% -1.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +5.4% +2.2% +3.2% +10.0% ➖ noise
7 duckdb:duckdb -0.3% +2.2% -2.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.4% +2.2% -0.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +2.6% +0.4% +2.2% +10.0% ➖ noise
8 duckdb:duckdb +0.1% +0.4% -0.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.1% +0.4% -0.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -5.1%
Engines: DataFusion No clear signal (+0.5%, environment too noisy confidence) · DuckDB No clear signal (-7.5%, low confidence)
Vortex (geomean): 1.064x ➖
Parquet (geomean): 1.082x ➖
Shifts: Parquet (control) +8.2% · Median polish +8.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.096x ➖, 1↑ 28↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1689489 1774447 0.95
clickbench_q01/datafusion:vortex-file-compressed 18478916 17025624 1.09
clickbench_q02/datafusion:vortex-file-compressed 🚨 42903573 37724764 1.14
clickbench_q03/datafusion:vortex-file-compressed 🚨 50776970 42075142 1.21
clickbench_q04/datafusion:vortex-file-compressed 🚨 325086712 283838769 1.15
clickbench_q05/datafusion:vortex-file-compressed 🚨 374216615 337284780 1.11
clickbench_q06/datafusion:vortex-file-compressed 🚀 1776136 2278222 0.78
clickbench_q07/datafusion:vortex-file-compressed 🚨 24064923 20638626 1.17
clickbench_q08/datafusion:vortex-file-compressed 🚨 400001559 356646180 1.12
clickbench_q09/datafusion:vortex-file-compressed 🚨 654501271 583359643 1.12
clickbench_q10/datafusion:vortex-file-compressed 🚨 85326916 76030486 1.12
clickbench_q11/datafusion:vortex-file-compressed 🚨 102517321 88605049 1.16
clickbench_q12/datafusion:vortex-file-compressed 🚨 339385361 297391816 1.14
clickbench_q13/datafusion:vortex-file-compressed 🚨 513641317 457955131 1.12
clickbench_q14/datafusion:vortex-file-compressed 314313910 288351317 1.09
clickbench_q15/datafusion:vortex-file-compressed 366337567 333099691 1.10
clickbench_q16/datafusion:vortex-file-compressed 🚨 789284350 687068958 1.15
clickbench_q17/datafusion:vortex-file-compressed 🚨 765767669 685399380 1.12
clickbench_q18/datafusion:vortex-file-compressed 1568652360 1444171860 1.09
clickbench_q19/datafusion:vortex-file-compressed 33545664 33329717 1.01
clickbench_q20/datafusion:vortex-file-compressed 🚨 389282664 336141297 1.16
clickbench_q21/datafusion:vortex-file-compressed 🚨 482532052 423498596 1.14
clickbench_q22/datafusion:vortex-file-compressed 🚨 599258936 527858589 1.14
clickbench_q23/datafusion:vortex-file-compressed 🚨 621890742 553518677 1.12
clickbench_q24/datafusion:vortex-file-compressed 🚨 57853412 49831706 1.16
clickbench_q25/datafusion:vortex-file-compressed 🚨 91890449 78968022 1.16
clickbench_q26/datafusion:vortex-file-compressed 🚨 57246957 48145272 1.19
clickbench_q27/datafusion:vortex-file-compressed 🚨 878120205 783620917 1.12
clickbench_q28/datafusion:vortex-file-compressed 6409330629 5905720358 1.09
clickbench_q29/datafusion:vortex-file-compressed 🚨 246754821 222250820 1.11
clickbench_q30/datafusion:vortex-file-compressed 🚨 293598040 260069548 1.13
clickbench_q31/datafusion:vortex-file-compressed 🚨 333630303 296283434 1.13
clickbench_q32/datafusion:vortex-file-compressed 🚨 1313162208 1172798451 1.12
clickbench_q33/datafusion:vortex-file-compressed 🚨 1585924253 1413157957 1.12
clickbench_q34/datafusion:vortex-file-compressed 🚨 1637963194 1461238927 1.12
clickbench_q35/datafusion:vortex-file-compressed 🚨 523224627 469935701 1.11
clickbench_q36/datafusion:vortex-file-compressed 80939609 77137458 1.05
clickbench_q37/datafusion:vortex-file-compressed 40430709 38648553 1.05
clickbench_q38/datafusion:vortex-file-compressed 21687237 21791706 1.00
clickbench_q39/datafusion:vortex-file-compressed 151529625 144887390 1.05
clickbench_q40/datafusion:vortex-file-compressed 17529967 17376430 1.01
clickbench_q41/datafusion:vortex-file-compressed 16988492 16119918 1.05
clickbench_q42/datafusion:vortex-file-compressed 18196398 18337875 0.99
datafusion / parquet (1.090x ➖, 0↑ 20↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1708568 1626072 1.05
clickbench_q01/datafusion:parquet 21497378 20282014 1.06
clickbench_q02/datafusion:parquet 51503338 47641998 1.08
clickbench_q03/datafusion:parquet 43123628 39968763 1.08
clickbench_q04/datafusion:parquet 🚨 349243041 314419637 1.11
clickbench_q05/datafusion:parquet 🚨 409488153 367416809 1.11
clickbench_q06/datafusion:parquet 1650934 1581494 1.04
clickbench_q07/datafusion:parquet 🚨 25998492 22347758 1.16
clickbench_q08/datafusion:parquet 🚨 441948161 385549884 1.15
clickbench_q09/datafusion:parquet 🚨 721453697 641807925 1.12
clickbench_q10/datafusion:parquet 🚨 124061481 110343634 1.12
clickbench_q11/datafusion:parquet 🚨 152905493 131837981 1.16
clickbench_q12/datafusion:parquet 🚨 401251415 363066280 1.11
clickbench_q13/datafusion:parquet 575973406 537902860 1.07
clickbench_q14/datafusion:parquet 394850410 361644289 1.09
clickbench_q15/datafusion:parquet 🚨 400917543 354505074 1.13
clickbench_q16/datafusion:parquet 🚨 814582286 706810275 1.15
clickbench_q17/datafusion:parquet 🚨 790807876 669929416 1.18
clickbench_q18/datafusion:parquet 🚨 1619803087 1387782823 1.17
clickbench_q19/datafusion:parquet 33738223 32735974 1.03
clickbench_q20/datafusion:parquet 🚨 695628028 607564147 1.14
clickbench_q21/datafusion:parquet 747735127 691050665 1.08
clickbench_q22/datafusion:parquet 🚨 1108913397 984032630 1.13
clickbench_q23/datafusion:parquet 🚨 4250019551 3778390882 1.12
clickbench_q24/datafusion:parquet 92598397 90228501 1.03
clickbench_q25/datafusion:parquet 150812889 138668825 1.09
clickbench_q26/datafusion:parquet 88133215 86234295 1.02
clickbench_q27/datafusion:parquet 1182622687 1086700565 1.09
clickbench_q28/datafusion:parquet 7351494633 6707375192 1.10
clickbench_q29/datafusion:parquet 258650542 244543696 1.06
clickbench_q30/datafusion:parquet 🚨 380620999 337516881 1.13
clickbench_q31/datafusion:parquet 421355249 387124098 1.09
clickbench_q32/datafusion:parquet 🚨 1445835120 1243664604 1.16
clickbench_q33/datafusion:parquet 1705941012 1574889006 1.08
clickbench_q34/datafusion:parquet 🚨 1736730387 1553506083 1.12
clickbench_q35/datafusion:parquet 🚨 555685980 487383763 1.14
clickbench_q36/datafusion:parquet 🚨 170460478 152860156 1.12
clickbench_q37/datafusion:parquet 63851820 59857384 1.07
clickbench_q38/datafusion:parquet 94240555 93009311 1.01
clickbench_q39/datafusion:parquet 288143543 284468468 1.01
clickbench_q40/datafusion:parquet 32133064 32583406 0.99
clickbench_q41/datafusion:parquet 29603844 28079679 1.05
clickbench_q42/datafusion:parquet 30414796 33300933 0.91
duckdb / vortex-file-compressed (1.033x ➖, 3↑ 4↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6490694 6540295 0.99
clickbench_q01/duckdb:vortex-file-compressed 10536221 11308343 0.93
clickbench_q02/duckdb:vortex-file-compressed 26536545 27016040 0.98
clickbench_q03/duckdb:vortex-file-compressed 31777136 30867551 1.03
clickbench_q04/duckdb:vortex-file-compressed 195748769 187990995 1.04
clickbench_q05/duckdb:vortex-file-compressed 188717193 184709939 1.02
clickbench_q06/duckdb:vortex-file-compressed 21006771 21350820 0.98
clickbench_q07/duckdb:vortex-file-compressed 15281407 14796857 1.03
clickbench_q08/duckdb:vortex-file-compressed 282336847 272099609 1.04
clickbench_q09/duckdb:vortex-file-compressed 358811642 349059593 1.03
clickbench_q10/duckdb:vortex-file-compressed 72613047 70673863 1.03
clickbench_q11/duckdb:vortex-file-compressed 84216999 83152539 1.01
clickbench_q12/duckdb:vortex-file-compressed 224121307 204064496 1.10
clickbench_q13/duckdb:vortex-file-compressed 453041857 421253477 1.08
clickbench_q14/duckdb:vortex-file-compressed 261841119 243281976 1.08
clickbench_q15/duckdb:vortex-file-compressed 263047939 245217835 1.07
clickbench_q16/duckdb:vortex-file-compressed 589616342 547766439 1.08
clickbench_q17/duckdb:vortex-file-compressed 473853927 443013996 1.07
clickbench_q18/duckdb:vortex-file-compressed 1031950388 976270146 1.06
clickbench_q19/duckdb:vortex-file-compressed 22222060 22701478 0.98
clickbench_q20/duckdb:vortex-file-compressed 340532805 334133403 1.02
clickbench_q21/duckdb:vortex-file-compressed 455855877 424413601 1.07
clickbench_q22/duckdb:vortex-file-compressed 🚀 641984920 734067090 0.87
clickbench_q23/duckdb:vortex-file-compressed 211225946 231087728 0.91
clickbench_q24/duckdb:vortex-file-compressed 50089469 46335265 1.08
clickbench_q25/duckdb:vortex-file-compressed 88810194 82923312 1.07
clickbench_q26/duckdb:vortex-file-compressed 50016842 46045069 1.09
clickbench_q27/duckdb:vortex-file-compressed 565342967 528007077 1.07
clickbench_q28/duckdb:vortex-file-compressed 3357068660 3080814793 1.09
clickbench_q29/duckdb:vortex-file-compressed 🚀 29825061 42043868 0.71
clickbench_q30/duckdb:vortex-file-compressed 🚨 242543503 219533173 1.10
clickbench_q31/duckdb:vortex-file-compressed 339408233 312474658 1.09
clickbench_q32/duckdb:vortex-file-compressed 1248610967 1138482820 1.10
clickbench_q33/duckdb:vortex-file-compressed 1194051019 1186811563 1.01
clickbench_q34/duckdb:vortex-file-compressed 1337781574 1267982550 1.06
clickbench_q35/duckdb:vortex-file-compressed 405571298 384162563 1.06
clickbench_q36/duckdb:vortex-file-compressed 31168592 29294246 1.06
clickbench_q37/duckdb:vortex-file-compressed 20646635 18916500 1.09
clickbench_q38/duckdb:vortex-file-compressed 🚨 23454260 19891796 1.18
clickbench_q39/duckdb:vortex-file-compressed 47268420 44233996 1.07
clickbench_q40/duckdb:vortex-file-compressed 🚨 19384998 16798887 1.15
clickbench_q41/duckdb:vortex-file-compressed 🚨 19698602 17794372 1.11
clickbench_q42/duckdb:vortex-file-compressed 🚀 20893957 23251730 0.90
duckdb / parquet (1.075x ➖, 0↑ 15↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23967592 23313970 1.03
clickbench_q01/duckdb:parquet 31895551 29605266 1.08
clickbench_q02/duckdb:parquet 52896210 50578452 1.05
clickbench_q03/duckdb:parquet 🚨 45406966 40842420 1.11
clickbench_q04/duckdb:parquet 🚨 234372969 204939829 1.14
clickbench_q05/duckdb:parquet 🚨 292774531 262040071 1.12
clickbench_q06/duckdb:parquet 50466860 47530252 1.06
clickbench_q07/duckdb:parquet 33409587 31344067 1.07
clickbench_q08/duckdb:parquet 🚨 309552477 272952130 1.13
clickbench_q09/duckdb:parquet 🚨 455300628 407113329 1.12
clickbench_q10/duckdb:parquet 🚨 92036876 82275584 1.12
clickbench_q11/duckdb:parquet 🚨 113950495 100256348 1.14
clickbench_q12/duckdb:parquet 🚨 321397571 286141094 1.12
clickbench_q13/duckdb:parquet 🚨 547867334 480613197 1.14
clickbench_q14/duckdb:parquet 🚨 357853055 318304075 1.12
clickbench_q15/duckdb:parquet 🚨 287563248 258513661 1.11
clickbench_q16/duckdb:parquet 🚨 680044511 604372028 1.13
clickbench_q17/duckdb:parquet 🚨 574202246 508509605 1.13
clickbench_q18/duckdb:parquet 🚨 1165881314 1050153126 1.11
clickbench_q19/duckdb:parquet 29612340 29185775 1.01
clickbench_q20/duckdb:parquet 453636725 423436764 1.07
clickbench_q21/duckdb:parquet 583578032 538648616 1.08
clickbench_q22/duckdb:parquet 989720401 929579667 1.06
clickbench_q23/duckdb:parquet 285079644 273462850 1.04
clickbench_q24/duckdb:parquet 73233140 70356267 1.04
clickbench_q25/duckdb:parquet 171129404 162711537 1.05
clickbench_q26/duckdb:parquet 55712192 53856127 1.03
clickbench_q27/duckdb:parquet 682912393 650895924 1.05
clickbench_q28/duckdb:parquet 5247006776 4895040352 1.07
clickbench_q29/duckdb:parquet 42781814 43316759 0.99
clickbench_q30/duckdb:parquet 339723056 314619452 1.08
clickbench_q31/duckdb:parquet 414659528 381623681 1.09
clickbench_q32/duckdb:parquet 1185938841 1132985357 1.05
clickbench_q33/duckdb:parquet 1178966545 1124165836 1.05
clickbench_q34/duckdb:parquet 1245546256 1174625711 1.06
clickbench_q35/duckdb:parquet 399425795 373234181 1.07
clickbench_q36/duckdb:parquet 50048901 46411716 1.08
clickbench_q37/duckdb:parquet 34317388 33953006 1.01
clickbench_q38/duckdb:parquet 35477721 35622237 1.00
clickbench_q39/duckdb:parquet 🚨 93062022 78465149 1.19
clickbench_q40/duckdb:parquet 22435776 20964990 1.07
clickbench_q41/duckdb:parquet 20507428 20567346 1.00
clickbench_q42/duckdb:parquet 22535082 22608765 1.00
duckdb / duckdb (0.957x ➖, 13↑ 0↓)
name PR 70e94ca (ns) base 326b475 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚀 17429163 23256753 0.75
clickbench_q01/duckdb:duckdb 🚀 34499867 40259396 0.86
clickbench_q02/duckdb:duckdb 🚀 51818379 57783527 0.90
clickbench_q03/duckdb:duckdb 57459158 62132348 0.92
clickbench_q04/duckdb:duckdb 217545782 220716492 0.99
clickbench_q05/duckdb:duckdb 297442217 287784751 1.03
clickbench_q06/duckdb:duckdb 🚀 33897317 40723457 0.83
clickbench_q07/duckdb:duckdb 🚀 34967799 41190392 0.85
clickbench_q08/duckdb:duckdb 290390443 282868390 1.03
clickbench_q09/duckdb:duckdb 413446079 400460793 1.03
clickbench_q10/duckdb:duckdb 121396327 121782128 1.00
clickbench_q11/duckdb:duckdb 131132093 132982888 0.99
clickbench_q12/duckdb:duckdb 276012489 267386511 1.03
clickbench_q13/duckdb:duckdb 475440094 461140746 1.03
clickbench_q14/duckdb:duckdb 298451884 294822026 1.01
clickbench_q15/duckdb:duckdb 250642645 249125065 1.01
clickbench_q16/duckdb:duckdb 601989765 575948379 1.05
clickbench_q17/duckdb:duckdb 501565735 477903568 1.05
clickbench_q18/duckdb:duckdb 1075602886 1028911824 1.05
clickbench_q19/duckdb:duckdb 🚀 36056501 41542814 0.87
clickbench_q20/duckdb:duckdb 519717454 473937221 1.10
clickbench_q21/duckdb:duckdb 505594709 478900856 1.06
clickbench_q22/duckdb:duckdb 569321561 536979057 1.06
clickbench_q23/duckdb:duckdb 253469088 262927428 0.96
clickbench_q24/duckdb:duckdb 62891543 67800842 0.93
clickbench_q25/duckdb:duckdb 154018042 154959008 0.99
clickbench_q26/duckdb:duckdb 62094298 68371317 0.91
clickbench_q27/duckdb:duckdb 589229209 555908314 1.06
clickbench_q28/duckdb:duckdb 4665852331 4533651307 1.03
clickbench_q29/duckdb:duckdb 🚀 50605764 57059074 0.89
clickbench_q30/duckdb:duckdb 288709924 289748731 1.00
clickbench_q31/duckdb:duckdb 384315184 375664533 1.02
clickbench_q32/duckdb:duckdb 1169995011 1131370990 1.03
clickbench_q33/duckdb:duckdb 1191803511 1144717499 1.04
clickbench_q34/duckdb:duckdb 1264166637 1221054754 1.04
clickbench_q35/duckdb:duckdb 312582603 308034317 1.01
clickbench_q36/duckdb:duckdb 🚀 48876491 54738866 0.89
clickbench_q37/duckdb:duckdb 🚀 28715546 35153537 0.82
clickbench_q38/duckdb:duckdb 🚀 33598391 39535402 0.85
clickbench_q39/duckdb:duckdb 89087738 97663245 0.91
clickbench_q40/duckdb:duckdb 🚀 27735059 34003855 0.82
clickbench_q41/duckdb:duckdb 🚀 27716852 33243063 0.83
clickbench_q42/duckdb:duckdb 🚀 29412750 36289274 0.81

File Size Changes (106 files changed, +0.0% overall, 53↑ 53↓)
File Scale Format Base HEAD Change %
hits_90.vortex 1.0 vortex-file-compressed 140.12 MB 142.11 MB +1.99 MB +1.4%
hits_55.vortex 1.0 vortex-compact 94.94 MB 96.04 MB +1.09 MB +1.2%
hits_90.vortex 1.0 vortex-compact 81.72 MB 82.52 MB +816.95 KB +1.0%
hits_21.vortex 1.0 vortex-compact 51.53 MB 51.83 MB +308.69 KB +0.6%
hits_53.vortex 1.0 vortex-file-compressed 87.16 MB 87.45 MB +299.77 KB +0.3%
hits_82.vortex 1.0 vortex-file-compressed 99.81 MB 100.10 MB +295.02 KB +0.3%
hits_29.vortex 1.0 vortex-file-compressed 59.78 MB 59.94 MB +163.10 KB +0.3%
hits_31.vortex 1.0 vortex-file-compressed 90.03 MB 90.24 MB +208.73 KB +0.2%
hits_69.vortex 1.0 vortex-file-compressed 123.14 MB 123.42 MB +279.53 KB +0.2%
hits_37.vortex 1.0 vortex-file-compressed 85.82 MB 86.00 MB +182.50 KB +0.2%
hits_18.vortex 1.0 vortex-file-compressed 104.85 MB 105.04 MB +192.69 KB +0.2%
hits_85.vortex 1.0 vortex-file-compressed 91.91 MB 92.05 MB +138.88 KB +0.1%
hits_24.vortex 1.0 vortex-file-compressed 77.43 MB 77.54 MB +112.20 KB +0.1%
hits_73.vortex 1.0 vortex-file-compressed 110.64 MB 110.79 MB +147.96 KB +0.1%
hits_48.vortex 1.0 vortex-file-compressed 28.03 MB 28.07 MB +35.45 KB +0.1%
hits_74.vortex 1.0 vortex-file-compressed 119.86 MB 120.00 MB +144.85 KB +0.1%
hits_79.vortex 1.0 vortex-file-compressed 145.05 MB 145.21 MB +164.59 KB +0.1%
hits_83.vortex 1.0 vortex-file-compressed 89.82 MB 89.91 MB +85.24 KB +0.1%
hits_96.vortex 1.0 vortex-file-compressed 135.64 MB 135.76 MB +121.26 KB +0.1%
hits_46.vortex 1.0 vortex-file-compressed 69.42 MB 69.48 MB +61.80 KB +0.1%
hits_97.vortex 1.0 vortex-compact 68.98 MB 69.04 MB +60.21 KB +0.1%
hits_76.vortex 1.0 vortex-file-compressed 114.37 MB 114.45 MB +90.97 KB +0.1%
hits_65.vortex 1.0 vortex-file-compressed 183.73 MB 183.87 MB +146.01 KB +0.1%
hits_10.vortex 1.0 vortex-file-compressed 69.65 MB 69.70 MB +54.50 KB +0.1%
hits_61.vortex 1.0 vortex-file-compressed 101.26 MB 101.34 MB +76.23 KB +0.1%
hits_42.vortex 1.0 vortex-file-compressed 223.21 MB 223.36 MB +152.21 KB +0.1%
hits_20.vortex 1.0 vortex-file-compressed 62.98 MB 63.03 MB +41.65 KB +0.1%
hits_66.vortex 1.0 vortex-file-compressed 90.22 MB 90.28 MB +57.36 KB +0.1%
hits_16.vortex 1.0 vortex-file-compressed 79.95 MB 79.99 MB +42.75 KB +0.1%
hits_84.vortex 1.0 vortex-file-compressed 117.26 MB 117.32 MB +57.52 KB +0.0%
hits_77.vortex 1.0 vortex-file-compressed 168.53 MB 168.61 MB +75.48 KB +0.0%
hits_3.vortex 1.0 vortex-file-compressed 142.29 MB 142.35 MB +63.62 KB +0.0%
hits_72.vortex 1.0 vortex-file-compressed 84.85 MB 84.89 MB +37.48 KB +0.0%
hits_56.vortex 1.0 vortex-file-compressed 123.60 MB 123.65 MB +51.71 KB +0.0%
hits_34.vortex 1.0 vortex-file-compressed 97.84 MB 97.88 MB +39.77 KB +0.0%
hits_38.vortex 1.0 vortex-file-compressed 99.29 MB 99.33 MB +37.96 KB +0.0%
hits_91.vortex 1.0 vortex-file-compressed 97.22 MB 97.25 MB +36.30 KB +0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.90 MB 119.94 MB +39.91 KB +0.0%
hits_87.vortex 1.0 vortex-file-compressed 172.64 MB 172.70 MB +57.04 KB +0.0%
hits_71.vortex 1.0 vortex-file-compressed 102.11 MB 102.14 MB +31.41 KB +0.0%
hits_94.vortex 1.0 vortex-file-compressed 138.77 MB 138.81 MB +39.49 KB +0.0%
hits_98.vortex 1.0 vortex-file-compressed 118.40 MB 118.43 MB +33.26 KB +0.0%
hits_14.vortex 1.0 vortex-file-compressed 111.37 MB 111.40 MB +31.06 KB +0.0%
hits_80.vortex 1.0 vortex-file-compressed 104.94 MB 104.97 MB +26.40 KB +0.0%
hits_0.vortex 1.0 vortex-file-compressed 89.66 MB 89.68 MB +17.53 KB +0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.28 MB 164.31 MB +30.01 KB +0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.59 MB 277.64 MB +47.77 KB +0.0%
hits_26.vortex 1.0 vortex-file-compressed 110.13 MB 110.14 MB +13.93 KB +0.0%
hits_9.vortex 1.0 vortex-file-compressed 99.24 MB 99.25 MB +12.03 KB +0.0%
hits_19.vortex 1.0 vortex-file-compressed 73.63 MB 73.64 MB +7.03 KB +0.0%
hits_5.vortex 1.0 vortex-file-compressed 93.03 MB 93.04 MB +4.27 KB +0.0%
hits_2.vortex 1.0 vortex-file-compressed 186.49 MB 186.50 MB +7.84 KB +0.0%
hits_67.vortex 1.0 vortex-file-compressed 184.21 MB 184.22 MB +3.83 KB +0.0%
hits_33.vortex 1.0 vortex-file-compressed 57.25 MB 57.25 MB 776 B -0.0%
hits_88.vortex 1.0 vortex-file-compressed 111.51 MB 111.50 MB 3.22 KB -0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.41 MB 221.39 MB 12.66 KB -0.0%
hits_49.vortex 1.0 vortex-file-compressed 75.83 MB 75.82 MB 5.05 KB -0.0%
hits_22.vortex 1.0 vortex-file-compressed 78.61 MB 78.61 MB 5.55 KB -0.0%
hits_43.vortex 1.0 vortex-file-compressed 227.41 MB 227.39 MB 16.84 KB -0.0%
hits_17.vortex 1.0 vortex-file-compressed 87.49 MB 87.48 MB 9.41 KB -0.0%
hits_39.vortex 1.0 vortex-file-compressed 80.35 MB 80.34 MB 12.94 KB -0.0%
hits_70.vortex 1.0 vortex-file-compressed 93.71 MB 93.70 MB 15.51 KB -0.0%
hits_8.vortex 1.0 vortex-file-compressed 93.34 MB 93.33 MB 15.53 KB -0.0%
hits_13.vortex 1.0 vortex-file-compressed 99.34 MB 99.31 MB 22.85 KB -0.0%
hits_97.vortex 1.0 vortex-file-compressed 107.07 MB 107.04 MB 25.09 KB -0.0%
hits_57.vortex 1.0 vortex-file-compressed 128.21 MB 128.18 MB 31.29 KB -0.0%
hits_63.vortex 1.0 vortex-file-compressed 69.35 MB 69.33 MB 17.91 KB -0.0%
hits_75.vortex 1.0 vortex-file-compressed 63.37 MB 63.35 MB 17.66 KB -0.0%
hits_81.vortex 1.0 vortex-file-compressed 100.87 MB 100.84 MB 31.00 KB -0.0%
hits_23.vortex 1.0 vortex-file-compressed 77.95 MB 77.92 MB 30.15 KB -0.0%
hits_1.vortex 1.0 vortex-file-compressed 138.62 MB 138.57 MB 59.57 KB -0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.60 MB 96.56 MB 42.11 KB -0.0%
hits_11.vortex 1.0 vortex-file-compressed 80.02 MB 79.99 MB 36.95 KB -0.0%
hits_64.vortex 1.0 vortex-file-compressed 81.29 MB 81.25 MB 38.08 KB -0.0%
hits_60.vortex 1.0 vortex-file-compressed 103.47 MB 103.42 MB 50.38 KB -0.0%
hits_32.vortex 1.0 vortex-file-compressed 66.81 MB 66.78 MB 32.88 KB -0.0%
hits_68.vortex 1.0 vortex-file-compressed 123.16 MB 123.10 MB 62.05 KB -0.0%
hits_40.vortex 1.0 vortex-file-compressed 117.89 MB 117.83 MB 62.23 KB -0.1%
hits_86.vortex 1.0 vortex-file-compressed 69.40 MB 69.37 MB 36.77 KB -0.1%
hits_59.vortex 1.0 vortex-file-compressed 101.86 MB 101.80 MB 55.04 KB -0.1%
hits_27.vortex 1.0 vortex-file-compressed 122.47 MB 122.41 MB 66.51 KB -0.1%
hits_89.vortex 1.0 vortex-file-compressed 184.83 MB 184.72 MB 105.66 KB -0.1%
hits_12.vortex 1.0 vortex-file-compressed 101.07 MB 101.01 MB 60.73 KB -0.1%
hits_93.vortex 1.0 vortex-file-compressed 90.57 MB 90.51 MB 56.59 KB -0.1%
hits_45.vortex 1.0 vortex-file-compressed 122.15 MB 122.07 MB 76.73 KB -0.1%
hits_50.vortex 1.0 vortex-file-compressed 179.48 MB 179.37 MB 113.40 KB -0.1%
hits_30.vortex 1.0 vortex-file-compressed 87.19 MB 87.13 MB 58.65 KB -0.1%
hits_92.vortex 1.0 vortex-file-compressed 147.00 MB 146.90 MB 106.12 KB -0.1%
hits_35.vortex 1.0 vortex-file-compressed 115.26 MB 115.17 MB 87.85 KB -0.1%
hits_44.vortex 1.0 vortex-file-compressed 186.98 MB 186.84 MB 147.16 KB -0.1%
hits_6.vortex 1.0 vortex-file-compressed 93.37 MB 93.29 MB 74.23 KB -0.1%
hits_7.vortex 1.0 vortex-file-compressed 94.02 MB 93.94 MB 76.91 KB -0.1%
hits_47.vortex 1.0 vortex-file-compressed 41.35 MB 41.32 MB 35.49 KB -0.1%
hits_41.vortex 1.0 vortex-file-compressed 224.23 MB 224.03 MB 207.09 KB -0.1%
hits_58.vortex 1.0 vortex-file-compressed 90.46 MB 90.37 MB 95.27 KB -0.1%
hits_62.vortex 1.0 vortex-file-compressed 117.55 MB 117.41 MB 138.41 KB -0.1%
hits_99.vortex 1.0 vortex-file-compressed 123.19 MB 123.03 MB 162.40 KB -0.1%
hits_36.vortex 1.0 vortex-file-compressed 68.56 MB 68.45 MB 112.65 KB -0.2%
hits_25.vortex 1.0 vortex-file-compressed 114.15 MB 113.92 MB 244.80 KB -0.2%
hits_15.vortex 1.0 vortex-file-compressed 89.44 MB 89.24 MB 195.79 KB -0.2%
hits_65.vortex 1.0 vortex-compact 129.71 MB 129.39 MB 327.21 KB -0.2%
hits_21.vortex 1.0 vortex-file-compressed 94.34 MB 94.10 MB 247.28 KB -0.3%
hits_52.vortex 1.0 vortex-file-compressed 105.39 MB 105.11 MB 279.83 KB -0.3%
hits_4.vortex 1.0 vortex-file-compressed 109.06 MB 108.71 MB 351.92 KB -0.3%
hits_55.vortex 1.0 vortex-file-compressed 169.29 MB 166.61 MB 2.68 MB -1.6%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.04 GB → 7.05 GB (+0.0%)
  • vortex-file-compressed: 11.02 GB → 11.02 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -4.8% +3.9% -8.4% +840.6% ➖ noise
0 duckdb:duckdb -25.1% +3.9% -27.9% +269.5% ➖ noise
0 duckdb:vortex-file-compressed -0.8% +3.9% -4.5% +443.7% ➖ noise
1 datafusion:vortex-file-compressed +8.5% +6.9% +1.6% +25.5% ➖ noise
1 duckdb:duckdb -14.3% +6.9% -19.8% +47.8% ➖ noise
1 duckdb:vortex-file-compressed -6.8% +6.9% -12.8% +27.1% ➖ noise
2 datafusion:vortex-file-compressed +13.7% +6.3% +7.0% +20.8% ➖ noise
2 duckdb:duckdb -10.3% +6.3% -15.7% +24.3% ➖ noise
2 duckdb:vortex-file-compressed -1.8% +6.3% -7.6% +13.5% ➖ noise
3 datafusion:vortex-file-compressed +20.7% +9.5% +10.2% +148.4% ➖ noise
3 duckdb:duckdb -7.5% +9.5% -15.6% +59.1% ➖ noise
3 duckdb:vortex-file-compressed +2.9% +9.5% -6.0% +67.9% ➖ noise
4 datafusion:vortex-file-compressed +14.5% +12.7% +1.6% +11.6% ➖ noise
4 duckdb:duckdb -1.4% +12.7% -12.5% +11.1% ✅ faster
4 duckdb:vortex-file-compressed +4.1% +12.7% -7.6% +11.1% ➖ noise
5 datafusion:vortex-file-compressed +10.9% +11.6% -0.6% +11.1% ➖ noise
5 duckdb:duckdb +3.4% +11.6% -7.4% +11.1% ➖ noise
5 duckdb:vortex-file-compressed +2.2% +11.6% -8.4% +11.1% ➖ noise
6 datafusion:vortex-file-compressed -22.0% +5.3% -25.9% +45.4% ➖ noise
6 duckdb:duckdb -16.8% +5.3% -20.9% +17.8% ✅ faster
6 duckdb:vortex-file-compressed -1.6% +5.3% -6.5% +35.4% ➖ noise
7 datafusion:vortex-file-compressed +16.6% +11.4% +4.7% +11.1% ➖ noise
7 duckdb:duckdb -15.1% +11.4% -23.8% +12.3% ✅ faster
7 duckdb:vortex-file-compressed +3.3% +11.4% -7.3% +11.1% ➖ noise
8 datafusion:vortex-file-compressed +12.2% +14.0% -1.6% +11.1% ➖ noise
8 duckdb:duckdb +2.7% +14.0% -10.0% +11.1% ➖ noise
8 duckdb:vortex-file-compressed +3.8% +14.0% -9.0% +11.1% ➖ noise
9 datafusion:vortex-file-compressed +12.2% +12.1% +0.1% +11.1% ➖ noise
9 duckdb:duckdb +3.2% +12.1% -7.9% +11.1% ➖ noise
9 duckdb:vortex-file-compressed +2.8% +12.1% -8.3% +11.1% ➖ noise
10 datafusion:vortex-file-compressed +12.2% +12.1% +0.1% +11.1% ➖ noise
10 duckdb:duckdb -0.3% +12.1% -11.1% +11.1% ✅ faster
10 duckdb:vortex-file-compressed +2.7% +12.1% -8.4% +11.1% ➖ noise
11 datafusion:vortex-file-compressed +15.7% +14.8% +0.8% +11.1% ➖ noise
11 duckdb:duckdb -1.4% +14.8% -14.1% +11.1% ✅ faster
11 duckdb:vortex-file-compressed +1.3% +14.8% -11.8% +11.1% ✅ faster
12 datafusion:vortex-file-compressed +14.1% +11.4% +2.4% +11.1% ➖ noise
12 duckdb:duckdb +3.2% +11.4% -7.4% +11.1% ➖ noise
12 duckdb:vortex-file-compressed +9.8% +11.4% -1.4% +11.1% ➖ noise
13 datafusion:vortex-file-compressed +12.2% +10.5% +1.5% +11.1% ➖ noise
13 duckdb:duckdb +3.1% +10.5% -6.7% +11.1% ➖ noise
13 duckdb:vortex-file-compressed +7.5% +10.5% -2.7% +11.1% ➖ noise
14 datafusion:vortex-file-compressed +9.0% +10.8% -1.6% +11.1% ➖ noise
14 duckdb:duckdb +1.2% +10.8% -8.6% +11.1% ➖ noise
14 duckdb:vortex-file-compressed +7.6% +10.8% -2.9% +11.1% ➖ noise
15 datafusion:vortex-file-compressed +10.0% +12.2% -1.9% +11.1% ➖ noise
15 duckdb:duckdb +0.6% +12.2% -10.3% +11.1% ✅ faster
15 duckdb:vortex-file-compressed +7.3% +12.2% -4.4% +11.1% ➖ noise
16 datafusion:vortex-file-compressed +14.9% +13.9% +0.9% +11.1% ➖ noise
16 duckdb:duckdb +4.5% +13.9% -8.2% +11.1% ➖ noise
16 duckdb:vortex-file-compressed +7.6% +13.9% -5.5% +11.1% ➖ noise
17 datafusion:vortex-file-compressed +11.7% +15.5% -3.2% +11.1% ➖ noise
17 duckdb:duckdb +5.0% +15.5% -9.1% +11.1% ➖ noise
17 duckdb:vortex-file-compressed +7.0% +15.5% -7.4% +11.1% ➖ noise
18 datafusion:vortex-file-compressed +8.6% +13.8% -4.6% +11.1% ➖ noise
18 duckdb:duckdb +4.5% +13.8% -8.2% +11.1% ➖ noise
18 duckdb:vortex-file-compressed +5.7% +13.8% -7.1% +11.1% ➖ noise
19 datafusion:vortex-file-compressed +0.6% +2.3% -1.6% +44.2% ➖ noise
19 duckdb:duckdb -13.2% +2.3% -15.1% +15.8% ✅ faster
19 duckdb:vortex-file-compressed -2.1% +2.3% -4.3% +21.6% ➖ noise
20 datafusion:vortex-file-compressed +15.8% +10.8% +4.6% +98.7% ➖ noise
20 duckdb:duckdb +9.7% +10.8% -1.0% +67.9% ➖ noise
20 duckdb:vortex-file-compressed +1.9% +10.8% -8.0% +11.1% ➖ noise
21 datafusion:vortex-file-compressed +13.9% +8.3% +5.2% +11.1% ➖ noise
21 duckdb:duckdb +5.6% +8.3% -2.5% +11.1% ➖ noise
21 duckdb:vortex-file-compressed +7.4% +8.3% -0.8% +11.1% ➖ noise
22 datafusion:vortex-file-compressed +13.5% +9.5% +3.6% +11.1% ➖ noise
22 duckdb:duckdb +6.0% +9.5% -3.2% +32.8% ➖ noise
22 duckdb:vortex-file-compressed -12.5% +9.5% -20.2% +14.7% ✅ faster
23 datafusion:vortex-file-compressed +12.4% +8.3% +3.8% +25.9% ➖ noise
23 duckdb:duckdb -3.6% +8.3% -11.0% +11.1% ✅ faster
23 duckdb:vortex-file-compressed -8.6% +8.3% -15.6% +13.4% ✅ faster
24 datafusion:vortex-file-compressed +16.1% +3.4% +12.3% +11.6% 🚨 regression
24 duckdb:duckdb -7.2% +3.4% -10.3% +31.0% ➖ noise
24 duckdb:vortex-file-compressed +8.1% +3.4% +4.6% +19.0% ➖ noise
25 datafusion:vortex-file-compressed +16.4% +7.0% +8.8% +11.1% ➖ noise
25 duckdb:duckdb -0.6% +7.0% -7.1% +11.1% ➖ noise
25 duckdb:vortex-file-compressed +7.1% +7.0% +0.1% +14.8% ➖ noise
26 datafusion:vortex-file-compressed +18.9% +2.8% +15.6% +11.6% 🚨 regression
26 duckdb:duckdb -9.2% +2.8% -11.7% +11.1% ✅ faster
26 duckdb:vortex-file-compressed +8.6% +2.8% +5.6% +30.4% ➖ noise
27 datafusion:vortex-file-compressed +12.1% +6.9% +4.9% +11.1% ➖ noise
27 duckdb:duckdb +6.0% +6.9% -0.8% +11.1% ➖ noise
27 duckdb:vortex-file-compressed +7.1% +6.9% +0.2% +11.1% ➖ noise
28 datafusion:vortex-file-compressed +8.5% +8.4% +0.1% +11.1% ➖ noise
28 duckdb:duckdb +2.9% +8.4% -5.1% +11.1% ➖ noise
28 duckdb:vortex-file-compressed +9.0% +8.4% +0.5% +11.1% ➖ noise
29 datafusion:vortex-file-compressed +11.0% +2.2% +8.6% +13.7% ➖ noise
29 duckdb:duckdb -11.3% +2.2% -13.2% +11.1% ✅ faster
29 duckdb:vortex-file-compressed -29.1% +2.2% -30.6% +29.5% ✅ faster
30 datafusion:vortex-file-compressed +12.9% +10.3% +2.3% +11.1% ➖ noise
30 duckdb:duckdb -0.4% +10.3% -9.7% +11.1% ➖ noise
30 duckdb:vortex-file-compressed +10.5% +10.3% +0.1% +11.1% ➖ noise
31 datafusion:vortex-file-compressed +12.6% +8.7% +3.5% +11.1% ➖ noise
31 duckdb:duckdb +2.3% +8.7% -5.9% +11.1% ➖ noise
31 duckdb:vortex-file-compressed +8.6% +8.7% -0.1% +11.1% ➖ noise
32 datafusion:vortex-file-compressed +12.0% +10.3% +1.5% +13.7% ➖ noise
32 duckdb:duckdb +3.4% +10.3% -6.3% +11.1% ➖ noise
32 duckdb:vortex-file-compressed +9.7% +10.3% -0.6% +11.1% ➖ noise
33 datafusion:vortex-file-compressed +12.2% +6.6% +5.3% +11.1% ➖ noise
33 duckdb:duckdb +4.1% +6.6% -2.3% +11.1% ➖ noise
33 duckdb:vortex-file-compressed +0.6% +6.6% -5.6% +12.3% ➖ noise
34 datafusion:vortex-file-compressed +12.1% +8.9% +3.0% +11.1% ➖ noise
34 duckdb:duckdb +3.5% +8.9% -4.9% +11.1% ➖ noise
34 duckdb:vortex-file-compressed +5.5% +8.9% -3.1% +11.1% ➖ noise
35 datafusion:vortex-file-compressed +11.3% +10.5% +0.8% +11.1% ➖ noise
35 duckdb:duckdb +1.5% +10.5% -8.1% +11.1% ➖ noise
35 duckdb:vortex-file-compressed +5.6% +10.5% -4.4% +11.1% ➖ noise
36 datafusion:vortex-file-compressed +4.9% +9.7% -4.3% +11.3% ➖ noise
36 duckdb:duckdb -10.7% +9.7% -18.6% +16.0% ✅ faster
36 duckdb:vortex-file-compressed +6.4% +9.7% -3.0% +11.1% ➖ noise
37 datafusion:vortex-file-compressed +4.6% +3.8% +0.7% +13.4% ➖ noise
37 duckdb:duckdb -18.3% +3.8% -21.3% +17.7% ✅ faster
37 duckdb:vortex-file-compressed +9.1% +3.8% +5.1% +32.2% ➖ noise
38 datafusion:vortex-file-compressed -0.5% +0.5% -0.9% +17.1% ➖ noise
38 duckdb:duckdb -15.0% +0.5% -15.4% +12.5% ✅ faster
38 duckdb:vortex-file-compressed +17.9% +0.5% +17.4% +11.1% 🚨 regression
39 datafusion:vortex-file-compressed +4.6% +9.6% -4.6% +11.1% ➖ noise
39 duckdb:duckdb -8.8% +9.6% -16.8% +18.8% ✅ faster
39 duckdb:vortex-file-compressed +6.9% +9.6% -2.5% +11.1% ➖ noise
40 datafusion:vortex-file-compressed +0.9% +2.7% -1.8% +15.5% ➖ noise
40 duckdb:duckdb -18.4% +2.7% -20.6% +11.1% ✅ faster
40 duckdb:vortex-file-compressed +15.4% +2.7% +12.3% +18.7% ➖ noise
41 datafusion:vortex-file-compressed +5.4% +2.5% +2.8% +24.9% ➖ noise
41 duckdb:duckdb -16.6% +2.5% -18.7% +11.1% ✅ faster
41 duckdb:vortex-file-compressed +10.7% +2.5% +8.0% +11.1% ➖ noise
42 datafusion:vortex-file-compressed -0.8% -4.6% +4.0% +18.3% ➖ noise
42 duckdb:duckdb -18.9% -4.6% -15.1% +12.5% ✅ faster
42 duckdb:vortex-file-compressed -10.1% -4.6% -5.8% +21.2% ➖ noise

@joseph-isaacs joseph-isaacs enabled auto-merge (squash) June 2, 2026 09:59
@joseph-isaacs joseph-isaacs requested a review from robert3005 June 2, 2026 10:02
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Benchmarks: Random Access

Vortex (geomean): 0.987x ➖
Parquet (geomean): 1.036x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (1.034x ➖, 0↑ 3↓)
name PR 70e94ca (ns) base c11f35a (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 1654383 383978 4.31
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1089084 1067886 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8347762491 8472309156 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8328249990 8264907670 1.01
random-access/feature-vectors/correlated/vortex-tokio-local-disk 3299667 3537082 0.93
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 2975192 3065883 0.97
random-access/feature-vectors/uniform/lance-tokio-local-disk 1213661 1210965 1.00
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1897243 1891727 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8481424485 8333805178 1.02
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8442220830 8327490319 1.01
random-access/feature-vectors/uniform/vortex-tokio-local-disk 6487437 6291439 1.03
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 6244911 6145301 1.02
random-access/lance-tokio-local-disk 640138 633028 1.01
random-access/lance-tokio-local-disk-footer 1309741 1314135 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk 246908 243980 1.01
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 588516 594294 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk 132321089 130158365 1.02
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 132525362 130090391 1.02
random-access/nested-lists/correlated/vortex-tokio-local-disk 605622 607495 1.00
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 625222 634633 0.99
random-access/nested-lists/uniform/lance-tokio-local-disk 1012011 1042469 0.97
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1381559 1409584 0.98
random-access/nested-lists/uniform/parquet-tokio-local-disk 132652925 130339450 1.02
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 132519830 130278141 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk 2185125 2137362 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2181126 2121950 1.03
random-access/nested-structs/correlated/lance-tokio-local-disk 375887 374922 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 564683 559189 1.01
random-access/nested-structs/correlated/parquet-tokio-local-disk 24302062 22256184 1.09
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 23909356 21706256 1.10
random-access/nested-structs/correlated/vortex-tokio-local-disk 746734 759313 0.98
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 753462 758213 0.99
random-access/nested-structs/uniform/lance-tokio-local-disk 2661542 2669569 1.00
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2808305 2806673 1.00
random-access/nested-structs/uniform/parquet-tokio-local-disk 24288503 22222227 1.09
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 24276581 21695867 1.12
random-access/nested-structs/uniform/vortex-tokio-local-disk 1597160 1582936 1.01
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1649478 1629815 1.01
random-access/parquet-tokio-local-disk 169150451 166164091 1.02
random-access/parquet-tokio-local-disk-footer 169956897 165598788 1.03
random-access/taxi/correlated/lance-tokio-local-disk 940045 938488 1.00
random-access/taxi/correlated/lance-tokio-local-disk-footer 1862488 1842249 1.01
random-access/taxi/correlated/parquet-tokio-local-disk 254232753 248884491 1.02
random-access/taxi/correlated/parquet-tokio-local-disk-footer 254771989 248256044 1.03
random-access/taxi/correlated/vortex-tokio-local-disk 1494049 1655785 0.90
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1658093 1668698 0.99
random-access/taxi/uniform/lance-tokio-local-disk 9312833 9660196 0.96
random-access/taxi/uniform/lance-tokio-local-disk-footer 9891717 10293135 0.96
random-access/taxi/uniform/parquet-tokio-local-disk 272744690 263896850 1.03
random-access/taxi/uniform/parquet-tokio-local-disk-footer 271212114 263995385 1.03
random-access/taxi/uniform/vortex-tokio-local-disk 4218127 4222085 1.00
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4189876 4243704 0.99
random-access/vortex-tokio-local-disk 1113495 1163947 0.96
random-access/vortex-tokio-local-disk-footer 1128421 1186682 0.95

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.4%
Engines: DataFusion No clear signal (-0.0%, environment too noisy confidence) · DuckDB No clear signal (+15.4%, environment too noisy confidence)
Vortex (geomean): 0.920x ➖
Parquet (geomean): 0.856x ➖
Shifts: Parquet (control) -14.4% · Median polish -7.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.928x ➖, 1↑ 0↓)
name PR 70e94ca (ns) base c11f35a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 691272169 784601896 0.88
tpch_q02/datafusion:vortex-file-compressed 🚀 790628959 1260020008 0.63
tpch_q03/datafusion:vortex-file-compressed 973965031 998254489 0.98
tpch_q04/datafusion:vortex-file-compressed 722029874 747373367 0.97
tpch_q05/datafusion:vortex-file-compressed 1033184410 1036516679 1.00
tpch_q06/datafusion:vortex-file-compressed 606928835 590767904 1.03
tpch_q07/datafusion:vortex-file-compressed 1081073301 1052850304 1.03
tpch_q08/datafusion:vortex-file-compressed 1434262694 1361675156 1.05
tpch_q09/datafusion:vortex-file-compressed 1585571176 1681518282 0.94
tpch_q10/datafusion:vortex-file-compressed 1041043412 1391461670 0.75
tpch_q11/datafusion:vortex-file-compressed 509752042 550752834 0.93
tpch_q12/datafusion:vortex-file-compressed 834448386 1018070016 0.82
tpch_q13/datafusion:vortex-file-compressed 435667039 443000396 0.98
tpch_q14/datafusion:vortex-file-compressed 524100466 568923699 0.92
tpch_q15/datafusion:vortex-file-compressed 985246040 1075770040 0.92
tpch_q16/datafusion:vortex-file-compressed 514786141 476174615 1.08
tpch_q17/datafusion:vortex-file-compressed 1371225773 1302457176 1.05
tpch_q18/datafusion:vortex-file-compressed 1453867702 1318663164 1.10
tpch_q19/datafusion:vortex-file-compressed 906183336 954473101 0.95
tpch_q20/datafusion:vortex-file-compressed 962894598 983279854 0.98
tpch_q21/datafusion:vortex-file-compressed 1770077908 2067766954 0.86
tpch_q22/datafusion:vortex-file-compressed 679531402 904055091 0.75
datafusion / vortex-compact (0.841x ➖, 1↑ 0↓)
name PR 70e94ca (ns) base c11f35a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 709209599 726717483 0.98
tpch_q02/datafusion:vortex-compact 641438692 685068792 0.94
tpch_q03/datafusion:vortex-compact 814300893 878062609 0.93
tpch_q04/datafusion:vortex-compact 505394352 691930710 0.73
tpch_q05/datafusion:vortex-compact 844921956 1093381601 0.77
tpch_q06/datafusion:vortex-compact 571723959 632999119 0.90
tpch_q07/datafusion:vortex-compact 946466841 1135928283 0.83
tpch_q08/datafusion:vortex-compact 1098028852 1223459286 0.90
tpch_q09/datafusion:vortex-compact 1213468973 1339933259 0.91
tpch_q10/datafusion:vortex-compact 839293547 1005345341 0.83
tpch_q11/datafusion:vortex-compact 🚀 443047935 674879789 0.66
tpch_q12/datafusion:vortex-compact 797228913 912588953 0.87
tpch_q13/datafusion:vortex-compact 400915623 464677281 0.86
tpch_q14/datafusion:vortex-compact 517750072 559944173 0.92
tpch_q15/datafusion:vortex-compact 1013429852 1119449067 0.91
tpch_q16/datafusion:vortex-compact 372586149 492788154 0.76
tpch_q17/datafusion:vortex-compact 1156345658 1373580547 0.84
tpch_q18/datafusion:vortex-compact 1138554191 1347603377 0.84
tpch_q19/datafusion:vortex-compact 704809824 928469607 0.76
tpch_q20/datafusion:vortex-compact 774990481 950956466 0.81
tpch_q21/datafusion:vortex-compact 1496674683 1738848010 0.86
tpch_q22/datafusion:vortex-compact 415592967 542019464 0.77
datafusion / parquet (0.883x ➖, 1↑ 0↓)
name PR 70e94ca (ns) base c11f35a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 819600114 840463437 0.98
tpch_q02/datafusion:parquet 737512180 929576457 0.79
tpch_q03/datafusion:parquet 897424470 1205448555 0.74
tpch_q04/datafusion:parquet 476538558 481239779 0.99
tpch_q05/datafusion:parquet 1132677833 1118748375 1.01
tpch_q06/datafusion:parquet 533475156 504433421 1.06
tpch_q07/datafusion:parquet 1269007710 1326973417 0.96
tpch_q08/datafusion:parquet 1536594500 1752709061 0.88
tpch_q09/datafusion:parquet 1727644187 1797905385 0.96
tpch_q10/datafusion:parquet 1987522202 2217353741 0.90
tpch_q11/datafusion:parquet 570530765 659842348 0.86
tpch_q12/datafusion:parquet 674459065 708198302 0.95
tpch_q13/datafusion:parquet 737385141 785933692 0.94
tpch_q14/datafusion:parquet 785450241 889213634 0.88
tpch_q15/datafusion:parquet 1254598963 1475544240 0.85
tpch_q16/datafusion:parquet 🚀 382867024 602482582 0.64
tpch_q17/datafusion:parquet 1350202704 1425194791 0.95
tpch_q18/datafusion:parquet 1559033445 1670671508 0.93
tpch_q19/datafusion:parquet 911547573 981673560 0.93
tpch_q20/datafusion:parquet 1096806197 1514730148 0.72
tpch_q21/datafusion:parquet 1721886694 1940873677 0.89
tpch_q22/datafusion:parquet 762420100 999217004 0.76
duckdb / vortex-file-compressed (0.936x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base c11f35a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 616640220 634269239 0.97
tpch_q02/duckdb:vortex-file-compressed 1084849268 1492927827 0.73
tpch_q03/duckdb:vortex-file-compressed 920110773 1083284762 0.85
tpch_q04/duckdb:vortex-file-compressed 739600677 855745960 0.86
tpch_q05/duckdb:vortex-file-compressed 1142846751 1412472192 0.81
tpch_q06/duckdb:vortex-file-compressed 580950046 632701495 0.92
tpch_q07/duckdb:vortex-file-compressed 1274827333 1326458957 0.96
tpch_q08/duckdb:vortex-file-compressed 1537094897 1628769653 0.94
tpch_q09/duckdb:vortex-file-compressed 1681478562 1849236829 0.91
tpch_q10/duckdb:vortex-file-compressed 1245575427 1352658169 0.92
tpch_q11/duckdb:vortex-file-compressed 705907850 732049944 0.96
tpch_q12/duckdb:vortex-file-compressed 1428578239 1469838142 0.97
tpch_q13/duckdb:vortex-file-compressed 984602287 950439033 1.04
tpch_q14/duckdb:vortex-file-compressed 742753300 699878540 1.06
tpch_q15/duckdb:vortex-file-compressed 599835167 558423452 1.07
tpch_q16/duckdb:vortex-file-compressed 559102102 544306439 1.03
tpch_q17/duckdb:vortex-file-compressed 1022083707 1066320707 0.96
tpch_q18/duckdb:vortex-file-compressed 950391689 1015796126 0.94
tpch_q19/duckdb:vortex-file-compressed 864132686 870054020 0.99
tpch_q20/duckdb:vortex-file-compressed 1319090222 1447163214 0.91
tpch_q21/duckdb:vortex-file-compressed 2147899490 2181593493 0.98
tpch_q22/duckdb:vortex-file-compressed 465819912 527236486 0.88
duckdb / vortex-compact (0.979x ➖, 0↑ 0↓)
name PR 70e94ca (ns) base c11f35a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 618237497 634644558 0.97
tpch_q02/duckdb:vortex-compact 1053274065 1168629185 0.90
tpch_q03/duckdb:vortex-compact 986044057 986544820 1.00
tpch_q04/duckdb:vortex-compact 630239622 677327449 0.93
tpch_q05/duckdb:vortex-compact 1208444896 1247520241 0.97
tpch_q06/duckdb:vortex-compact 558402638 578897462 0.96
tpch_q07/duckdb:vortex-compact 1191273051 1220756532 0.98
tpch_q08/duckdb:vortex-compact 1576095774 1446771863 1.09
tpch_q09/duckdb:vortex-compact 1637683289 1593304478 1.03
tpch_q10/duckdb:vortex-compact 1247046466 1168738817 1.07
tpch_q11/duckdb:vortex-compact 757870861 722274045 1.05
tpch_q12/duckdb:vortex-compact 1136543135 1106914567 1.03
tpch_q13/duckdb:vortex-compact 873554561 881876731 0.99
tpch_q14/duckdb:vortex-compact 678918978 698936180 0.97
tpch_q15/duckdb:vortex-compact 555497431 555859498 1.00
tpch_q16/duckdb:vortex-compact 413091738 495756941 0.83
tpch_q17/duckdb:vortex-compact 953097310 933579167 1.02
tpch_q18/duckdb:vortex-compact 754102488 778095977 0.97
tpch_q19/duckdb:vortex-compact 795109055 822502742 0.97
tpch_q20/duckdb:vortex-compact 1291189257 1299386202 0.99
tpch_q21/duckdb:vortex-compact 1799506133 1877981693 0.96
tpch_q22/duckdb:vortex-compact 422073021 466257885 0.91
duckdb / parquet (0.830x ➖, 2↑ 0↓)
name PR 70e94ca (ns) base c11f35a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 882496148 962919653 0.92
tpch_q02/duckdb:parquet 1406092706 1524661045 0.92
tpch_q03/duckdb:parquet 1710252443 2013115898 0.85
tpch_q04/duckdb:parquet 🚀 951301908 1359630398 0.70
tpch_q05/duckdb:parquet 1827944340 2339428140 0.78
tpch_q06/duckdb:parquet 744107038 929147507 0.80
tpch_q07/duckdb:parquet 1786961981 2309260174 0.77
tpch_q08/duckdb:parquet 2170038507 2625268684 0.83
tpch_q09/duckdb:parquet 2489289547 3245772538 0.77
tpch_q10/duckdb:parquet 2977224784 3101612271 0.96
tpch_q11/duckdb:parquet 935038162 1220099828 0.77
tpch_q12/duckdb:parquet 1190692783 1296581898 0.92
tpch_q13/duckdb:parquet 1266500717 1367898764 0.93
tpch_q14/duckdb:parquet 1172991541 1362290741 0.86
tpch_q15/duckdb:parquet 873378253 1197188041 0.73
tpch_q16/duckdb:parquet 902927333 1054907283 0.86
tpch_q17/duckdb:parquet 1329263301 1347812305 0.99
tpch_q18/duckdb:parquet 1405832396 1662614589 0.85
tpch_q19/duckdb:parquet 1507204792 1678284090 0.90
tpch_q20/duckdb:parquet 🚀 1793383377 2771150832 0.65
tpch_q21/duckdb:parquet 1693689444 2035736832 0.83
tpch_q22/duckdb:parquet 1049471458 1324688812 0.79
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.4% -5.5% +3.2% +40.8% ➖ noise
1 datafusion:vortex-file-compressed -11.9% -5.5% -6.8% +49.8% ➖ noise
1 duckdb:vortex-compact -2.6% -5.5% +3.0% +30.2% ➖ noise
1 duckdb:vortex-file-compressed -2.8% -5.5% +2.8% +30.0% ➖ noise
2 datafusion:vortex-compact -6.4% -14.5% +9.5% +34.4% ➖ noise
2 datafusion:vortex-file-compressed -37.3% -14.5% -26.6% +32.7% ✅ faster
2 duckdb:vortex-compact -9.9% -14.5% +5.4% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -27.3% -14.5% -15.0% +30.0% ➖ noise
3 datafusion:vortex-compact -7.3% -20.5% +16.6% +46.2% ➖ noise
3 datafusion:vortex-file-compressed -2.4% -20.5% +22.7% +65.7% ➖ noise
3 duckdb:vortex-compact -0.1% -20.5% +25.7% +42.3% ➖ noise
3 duckdb:vortex-file-compressed -15.1% -20.5% +6.8% +47.6% ➖ noise
4 datafusion:vortex-compact -27.0% -16.8% -12.2% +31.5% ➖ noise
4 datafusion:vortex-file-compressed -3.4% -16.8% +16.1% +30.0% ➖ noise
4 duckdb:vortex-compact -7.0% -16.8% +11.8% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -13.6% -16.8% +3.8% +30.0% ➖ noise
5 datafusion:vortex-compact -22.7% -11.1% -13.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -0.3% -11.1% +12.1% +30.0% ➖ noise
5 duckdb:vortex-compact -3.1% -11.1% +8.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -19.1% -11.1% -9.0% +30.0% ➖ noise
6 datafusion:vortex-compact -9.7% -8.0% -1.9% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +2.7% -8.0% +11.6% +30.0% ➖ noise
6 duckdb:vortex-compact -3.5% -8.0% +4.8% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -8.2% -8.0% -0.2% +30.0% ➖ noise
7 datafusion:vortex-compact -16.7% -14.0% -3.1% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +2.7% -14.0% +19.4% +30.0% ➖ noise
7 duckdb:vortex-compact -2.4% -14.0% +13.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -3.9% -14.0% +11.7% +30.0% ➖ noise
8 datafusion:vortex-compact -10.3% -14.9% +5.4% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +5.3% -14.9% +23.7% +30.0% ➖ noise
8 duckdb:vortex-compact +8.9% -14.9% +28.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -5.6% -14.9% +10.9% +30.0% ➖ noise
9 datafusion:vortex-compact -9.4% -14.2% +5.5% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -5.7% -14.2% +9.8% +30.0% ➖ noise
9 duckdb:vortex-compact +2.8% -14.2% +19.7% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -9.1% -14.2% +5.9% +30.0% ➖ noise
10 datafusion:vortex-compact -16.5% -7.2% -10.0% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -25.2% -7.2% -19.3% +33.8% ➖ noise
10 duckdb:vortex-compact +6.7% -7.2% +15.0% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -7.9% -7.2% -0.7% +30.0% ➖ noise
11 datafusion:vortex-compact -34.4% -18.6% -19.4% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -7.4% -18.6% +13.7% +30.0% ➖ noise
11 duckdb:vortex-compact +4.9% -18.6% +28.9% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -3.6% -18.6% +18.5% +30.0% ➖ noise
12 datafusion:vortex-compact -12.6% -6.5% -6.6% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -18.0% -6.5% -12.4% +30.0% ➖ noise
12 duckdb:vortex-compact +2.7% -6.5% +9.8% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -2.8% -6.5% +3.9% +30.0% ➖ noise
13 datafusion:vortex-compact -13.7% -6.8% -7.4% +30.0% ➖ noise
13 datafusion:vortex-file-compressed -1.7% -6.8% +5.5% +30.0% ➖ noise
13 duckdb:vortex-compact -0.9% -6.8% +6.3% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +3.6% -6.8% +11.1% +30.0% ➖ noise
14 datafusion:vortex-compact -7.5% -12.8% +6.0% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -7.9% -12.8% +5.6% +30.0% ➖ noise
14 duckdb:vortex-compact -2.9% -12.8% +11.4% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +6.1% -12.8% +21.7% +30.0% ➖ noise
15 datafusion:vortex-compact -9.5% -21.2% +14.9% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -8.4% -21.2% +16.3% +30.0% ➖ noise
15 duckdb:vortex-compact -0.1% -21.2% +26.9% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +7.4% -21.2% +36.4% +30.0% 🚨 regression
16 datafusion:vortex-compact -24.4% -26.2% +2.5% +30.5% ➖ noise
16 datafusion:vortex-file-compressed +8.1% -26.2% +46.6% +46.4% 🚨 regression
16 duckdb:vortex-compact -16.7% -26.2% +13.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +2.7% -26.2% +39.3% +30.0% 🚨 regression
17 datafusion:vortex-compact -15.8% -3.3% -12.9% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +5.3% -3.3% +8.9% +30.0% ➖ noise
17 duckdb:vortex-compact +2.1% -3.3% +5.6% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -4.1% -3.3% -0.8% +32.1% ➖ noise
18 datafusion:vortex-compact -15.5% -11.2% -4.9% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +10.3% -11.2% +24.1% +30.0% ➖ noise
18 duckdb:vortex-compact -3.1% -11.2% +9.1% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -6.4% -11.2% +5.3% +30.0% ➖ noise
19 datafusion:vortex-compact -24.1% -8.7% -16.9% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -5.1% -8.7% +4.0% +30.0% ➖ noise
19 duckdb:vortex-compact -3.3% -8.7% +5.9% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -0.7% -8.7% +8.8% +30.0% ➖ noise
20 datafusion:vortex-compact -18.5% -31.5% +19.1% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -2.1% -31.5% +43.1% +30.0% 🚨 regression
20 duckdb:vortex-compact -0.6% -31.5% +45.2% +30.0% 🚨 regression
20 duckdb:vortex-file-compressed -8.8% -31.5% +33.2% +30.0% 🚨 regression
21 datafusion:vortex-compact -13.9% -14.1% +0.2% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -14.4% -14.1% -0.4% +30.0% ➖ noise
21 duckdb:vortex-compact -4.2% -14.1% +11.5% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -1.5% -14.1% +14.6% +30.0% ➖ noise
22 datafusion:vortex-compact -23.3% -22.3% -1.4% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -24.8% -22.3% -3.3% +38.1% ➖ noise
22 duckdb:vortex-compact -9.5% -22.3% +16.4% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -11.6% -22.3% +13.6% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Benchmarks: Compression

Vortex (geomean): 0.999x ➖
Parquet (geomean): 1.002x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (1.003x ➖, 0↑ 2↓)
name PR 70e94ca (ns) base c11f35a (ns) ratio (PR/base)
compress time/Arade 1162120223 1155833771 1.01
compress time/Bimbo 5631457291 5882826280 0.96
compress time/CMSprovider 2785484329 2800619857 0.99
compress time/Euro2016 462749727 478671404 0.97
compress time/Food 366636386 386536045 0.95
compress time/HashTags 859103962 857526448 1.00
compress time/TPC-H l_comment canonical 1250094041 1258865341 0.99
compress time/TPC-H l_comment chunked 1268954139 1263629756 1.00
compress time/taxi 683523888 697546956 0.98
compress time/wide table cols=100 chunks=1 rows=1000 11597123 11455125 1.01
compress time/wide table cols=100 chunks=50 rows=1000 12566518 11980980 1.05
compress time/wide table cols=1000 chunks=1 rows=1000 131018411 126238939 1.04
compress time/wide table cols=1000 chunks=50 rows=1000 129118968 130069190 0.99
compress time/wide table cols=10000 chunks=1 rows=1000 1482718780 1479375842 1.00
compress time/wide table cols=10000 chunks=50 rows=1000 1485253494 1461002829 1.02
decompress time/Arade 27885743 28050939 0.99
decompress time/Bimbo 77867797 80185882 0.97
decompress time/CMSprovider 🚨 85892301 76276751 1.13
decompress time/Euro2016 19629402 19624857 1.00
decompress time/Food 7930992 8160947 0.97
decompress time/HashTags 92802474 93225305 1.00
decompress time/TPC-H l_comment canonical 40410879 40224932 1.00
decompress time/TPC-H l_comment chunked 41969879 40602136 1.03
decompress time/taxi 15868704 15311767 1.04
decompress time/wide table cols=100 chunks=1 rows=1000 2721970 2582425 1.05
decompress time/wide table cols=100 chunks=50 rows=1000 2674063 2776104 0.96
decompress time/wide table cols=1000 chunks=1 rows=1000 25006229 23634785 1.06
decompress time/wide table cols=1000 chunks=50 rows=1000 23676869 23928689 0.99
decompress time/wide table cols=10000 chunks=1 rows=1000 273797837 263573956 1.04
decompress time/wide table cols=10000 chunks=50 rows=1000 268723309 263434377 1.02
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2701297755 2612755508 1.03
parquet_rs-zstd compress time/Bimbo 12703293200 12799580242 0.99
parquet_rs-zstd compress time/CMSprovider 7138553573 7010574227 1.02
parquet_rs-zstd compress time/Euro2016 1317807779 1340026797 0.98
parquet_rs-zstd compress time/Food 793363417 799976342 0.99
parquet_rs-zstd compress time/HashTags 2252761773 2229449767 1.01
parquet_rs-zstd compress time/TPC-H l_comment canonical 3246877786 3239360404 1.00
parquet_rs-zstd compress time/TPC-H l_comment chunked 3242407317 3223120585 1.01
parquet_rs-zstd compress time/taxi 1254031113 1194297949 1.05
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6495518 6025387 1.08
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6174702 5988023 1.03
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 77954008 75563494 1.03
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 76592398 75672355 1.01
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 812300449 803875984 1.01
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 774117644 807887582 0.96
parquet_rs-zstd decompress time/Arade 640780502 623672673 1.03
parquet_rs-zstd decompress time/Bimbo 1712346041 1706965986 1.00
parquet_rs-zstd decompress time/CMSprovider 1720523908 1726300263 1.00
parquet_rs-zstd decompress time/Euro2016 377185756 381316564 0.99
parquet_rs-zstd decompress time/Food 199720971 199096146 1.00
parquet_rs-zstd decompress time/HashTags 651108883 647640032 1.01
parquet_rs-zstd decompress time/TPC-H l_comment canonical 594096402 598690377 0.99
parquet_rs-zstd decompress time/TPC-H l_comment chunked 596949969 596163729 1.00
parquet_rs-zstd decompress time/taxi 249855974 243777125 1.02
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2848838 2787707 1.02
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2773278 2764218 1.00
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 33070824 32791444 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33601593 33211472 1.01
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 344811222 345967571 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 347588585 351058176 0.99
vortex-file-compressed size/Arade 145363860 145363860 1.00
vortex-file-compressed size/Bimbo 468763396 468763396 1.00
vortex-file-compressed size/CMSprovider 417904356 417860988 1.00
vortex-file-compressed size/Euro2016 158932180 158572692 1.00
vortex-file-compressed size/Food 41927000 41927000 1.00
vortex-file-compressed size/HashTags 185315700 185231572 1.00
vortex-file-compressed size/TPC-H l_comment canonical 178332808 178615648 1.00
vortex-file-compressed size/TPC-H l_comment chunked 178557496 178313528 1.00
vortex-file-compressed size/taxi 52364012 52364012 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.97
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.96
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.98
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio compress time/Food 0 0 0.96
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio compress time/taxi 0 0 0.93
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.94
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 1.02
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.06
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.97
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.97
vortex:parquet-zstd ratio decompress time/CMSprovider 🚨 0 0 1.13
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio decompress time/Food 0 0 0.97
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.99
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 1 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.03
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@0ax1
Copy link
Copy Markdown
Contributor

0ax1 commented Jun 2, 2026

@claude review

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026

Claude finished @0ax1's task in 5m 18s —— View job


Claude PR Review — Refactor: split monolithic scheme files into submodules

Verdict: LGTM. This is a faithful, mechanical code-movement refactor. I compared every relocated scheme implementation against the deleted monolithic files (float.rs, integer.rs, string.rs at origin/develop) and the logic is byte-for-byte identical. No behavior changes, no dropped tests.

What I verified

  • All scheme bodies unchanged. Every impl Scheme for … (scheme_name, matches, num_children, *_exclusions, expected_compression_ratio, compress) is identical to the original, just relocated. This includes the unsafe { RunEnd::new_unchecked(...) } / RLE::new_unchecked(...) blocks and the use_experimental_patches() branches.
  • Shared helpers preserved. rle_compress and try_compress_delta now live in integer/rle.rs and are re-exported pub(crate) from integer/mod.rs; RUN_LENGTH_THRESHOLD moved to integer/mod.rs (pub(crate) const); RUN_END_THRESHOLD moved into integer/runend.rs. All cross-module references (float/rle.rs, float/sparse.rs, string/sparse.rs, string/onpair.rs) resolve against the re-exported paths.
  • Public paths unchanged. Structs that were pub in schemes::{float,integer,string} are re-exported from each new mod.rs, so crate::schemes::float::ALPScheme, …::integer::SparseScheme, …::string::{FSSTScheme,OnPairScheme}, the vortex_compressor builtin re-exports, and *Stats all keep their existing paths.
  • Feature gating preserved. #[cfg(feature = "pco")], #[cfg(feature = "zstd")], #[cfg(all(feature = "zstd", feature = "unstable_encodings"))], and #[cfg(feature = "unstable_encodings")] moved cleanly onto the mod …;/pub use …; declarations, matching the original per-item gates.
  • Visibility. The private rle_ancestor_exclusions / rle_descendant_exclusions fns in schemes/mod.rs remain reachable — the new files are descendant modules of schemes, and Rust private visibility extends to descendants.
  • Tests fully retained. All tests carried over with identical bodies: float (4 + 4), integer (6 + 8), string (2 + 5, including the unstable_encodings-gated OnPair tests). tests / scheme_selection_tests are now #[cfg(test)] mod files included from each mod.rs.

Minor / non-blocking

  • integer/pco.rs keeps a function-scoped use vortex_array::dtype::PType; inside expected_compression_ratio. This is carried over verbatim from the original, but since the file is being moved anyway it would be a natural moment to hoist it to module scope per the repo's "imports at the top of the module" guidance. Optional.
  • The CodSpeed report flagging chunked_varbinview_canonical_into (in vortex-array/benches/chunk_array_builder.rs) is unrelated to this PR — it touches only vortex-btrblocks scheme files and changes no logic. Treat that signal as benchmark noise.

Checks not run

I could not execute cargo check/clippy in this environment (sandbox blocked the command), so the compile-time confirmation of the feature-gated module graph relies on manual inspection above rather than a build. CI's normal Rust checks should cover this; the import/re-export wiring looked correct under all four feature combinations I traced.


🤖 Generated by the Claude PR review workflow.

@0ax1 0ax1 self-requested a review June 2, 2026 10:57
Copy link
Copy Markdown
Contributor

@0ax1 0ax1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a faithful, mechanical code-movement refactor.

👼 okaj then

@joseph-isaacs joseph-isaacs merged commit a6d5976 into develop Jun 2, 2026
63 of 64 checks passed
@joseph-isaacs joseph-isaacs deleted the claude/btrblocks-scheme-modules-QoTPX branch June 2, 2026 10:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants