Skip to content

ViewedLayoutChildren child layout cache#8234

Merged
myrrc merged 1 commit into
developfrom
myrrc/viewed-layout-children-cache
Jun 3, 2026
Merged

ViewedLayoutChildren child layout cache#8234
myrrc merged 1 commit into
developfrom
myrrc/viewed-layout-children-cache

Conversation

@myrrc
Copy link
Copy Markdown
Contributor

@myrrc myrrc commented Jun 3, 2026

Avoid re-parsing flatbuffers when you re-access the same children

@myrrc myrrc force-pushed the myrrc/viewed-layout-children-cache branch from 6425fa9 to e33f8d3 Compare June 3, 2026 13:24
@myrrc myrrc added changelog/performance A performance improvement action/benchmark Trigger full benchmarks to run on this PR labels Jun 3, 2026
@myrrc myrrc requested a review from joseph-isaacs June 3, 2026 13:24
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 3, 2026
@myrrc myrrc linked an issue Jun 3, 2026 that may be closed by this pull request
@myrrc myrrc enabled auto-merge (squash) June 3, 2026 13:28
Comment thread vortex-layout/src/children.rs Outdated
Comment thread vortex-layout/src/children.rs Outdated
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 64b2473 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done e33f8d3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.960x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.960x ➖, 2↑ 1↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 109957294 113077095 0.97
polarsignals_q01/datafusion:vortex-file-compressed 🚀 243572588 283339070 0.86
polarsignals_q02/datafusion:vortex-file-compressed 🚀 20548422 24714590 0.83
polarsignals_q03/datafusion:vortex-file-compressed 276462024 275285328 1.00
polarsignals_q04/datafusion:vortex-file-compressed 🚨 11606204 10519180 1.10
polarsignals_q05/datafusion:vortex-file-compressed 13153255 14277520 0.92
polarsignals_q06/datafusion:vortex-file-compressed 16777586 17584313 0.95
polarsignals_q07/datafusion:vortex-file-compressed 12756743 12597344 1.01
polarsignals_q08/datafusion:vortex-file-compressed 392790762 381262929 1.03
polarsignals_q09/datafusion:vortex-file-compressed 9918338 10508521 0.94

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (-3.2%, low confidence) · DuckDB No clear signal (+1.4%, low confidence)
Vortex (geomean): 1.069x ➖
Parquet (geomean): 1.079x ➖
Shifts: Parquet (control) +7.9% · Median polish +6.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.076x ➖, 0↑ 3↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5632636 5438740 1.04
fineweb_q01/datafusion:vortex-file-compressed 33038314 31355439 1.05
fineweb_q02/datafusion:vortex-file-compressed 38651431 37878251 1.02
fineweb_q03/datafusion:vortex-file-compressed 🚨 73502257 61563116 1.19
fineweb_q04/datafusion:vortex-file-compressed 🚨 315585471 280075588 1.13
fineweb_q05/datafusion:vortex-file-compressed 244741045 226069218 1.08
fineweb_q06/datafusion:vortex-file-compressed 53351651 49927805 1.07
fineweb_q07/datafusion:vortex-file-compressed 🚨 62045396 53067645 1.17
fineweb_q08/datafusion:vortex-file-compressed 20345862 21327134 0.95
datafusion / vortex-compact (1.032x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5539328 5493755 1.01
fineweb_q01/datafusion:vortex-compact 103336583 96885647 1.07
fineweb_q02/datafusion:vortex-compact 109840743 107165937 1.02
fineweb_q03/datafusion:vortex-compact 939761930 881571514 1.07
fineweb_q04/datafusion:vortex-compact 979278886 927181673 1.06
fineweb_q05/datafusion:vortex-compact 899002486 836250492 1.08
fineweb_q06/datafusion:vortex-compact 494293545 470981638 1.05
fineweb_q07/datafusion:vortex-compact 492426601 484604408 1.02
fineweb_q08/datafusion:vortex-compact 19072058 20519776 0.93
datafusion / parquet (1.088x ➖, 0↑ 2↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6909503 6670669 1.04
fineweb_q01/datafusion:parquet 309414473 292520432 1.06
fineweb_q02/datafusion:parquet 330861738 302990356 1.09
fineweb_q03/datafusion:parquet 306482187 283285292 1.08
fineweb_q04/datafusion:parquet 🚨 342728509 306232609 1.12
fineweb_q05/datafusion:parquet 340957586 312679751 1.09
fineweb_q06/datafusion:parquet 326451010 297322299 1.10
fineweb_q07/datafusion:parquet 🚨 321084990 281741790 1.14
fineweb_q08/datafusion:parquet 306742914 283878127 1.08
duckdb / vortex-file-compressed (1.113x ❌, 0↑ 6↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 4175709 3774005 1.11
fineweb_q01/duckdb:vortex-file-compressed 🚨 37368474 32993901 1.13
fineweb_q02/duckdb:vortex-file-compressed 40223931 40845059 0.98
fineweb_q03/duckdb:vortex-file-compressed 🚨 171430253 118194282 1.45
fineweb_q04/duckdb:vortex-file-compressed 🚨 304659556 273022096 1.12
fineweb_q05/duckdb:vortex-file-compressed 234502042 218271412 1.07
fineweb_q06/duckdb:vortex-file-compressed 🚨 60086449 50840020 1.18
fineweb_q07/duckdb:vortex-file-compressed 🚨 60366160 53607669 1.13
fineweb_q08/duckdb:vortex-file-compressed 22047619 23927714 0.92
duckdb / vortex-compact (1.056x ➖, 0↑ 2↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 4714864 4157739 1.13
fineweb_q01/duckdb:vortex-compact 104932563 104268372 1.01
fineweb_q02/duckdb:vortex-compact 118046023 119416119 0.99
fineweb_q03/duckdb:vortex-compact 944482472 863448121 1.09
fineweb_q04/duckdb:vortex-compact 958073680 912727601 1.05
fineweb_q05/duckdb:vortex-compact 845172705 808439158 1.05
fineweb_q06/duckdb:vortex-compact 475629254 463863800 1.03
fineweb_q07/duckdb:vortex-compact 501969345 473012168 1.06
fineweb_q08/duckdb:vortex-compact 🚨 21035768 19018969 1.11
duckdb / parquet (1.070x ➖, 0↑ 2↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 33722988 31825981 1.06
fineweb_q01/duckdb:parquet 89448756 83747757 1.07
fineweb_q02/duckdb:parquet 🚨 95430804 85785410 1.11
fineweb_q03/duckdb:parquet 335072354 318255508 1.05
fineweb_q04/duckdb:parquet 469473580 448175092 1.05
fineweb_q05/duckdb:parquet 442786891 416344397 1.06
fineweb_q06/duckdb:parquet 218646604 204793702 1.07
fineweb_q07/duckdb:parquet 226591581 216523128 1.05
fineweb_q08/duckdb:parquet 🚨 37417107 33714426 1.11

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +937.64 KB +0.1%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (+0.1%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +0.8% +4.8% -3.8% +52.8% ➖ noise
0 datafusion:vortex-file-compressed +3.6% +4.8% -1.1% +58.1% ➖ noise
0 duckdb:vortex-compact +13.4% +4.8% +8.2% +112.6% ➖ noise
0 duckdb:vortex-file-compressed +10.6% +4.8% +5.6% +69.6% ➖ noise
1 datafusion:vortex-compact +6.7% +6.3% +0.3% +16.7% ➖ noise
1 datafusion:vortex-file-compressed +5.4% +6.3% -0.9% +23.9% ➖ noise
1 duckdb:vortex-compact +0.6% +6.3% -5.3% +13.1% ➖ noise
1 duckdb:vortex-file-compressed +13.3% +6.3% +6.6% +54.6% ➖ noise
2 datafusion:vortex-compact +2.5% +10.2% -7.0% +12.9% ➖ noise
2 datafusion:vortex-file-compressed +2.0% +10.2% -7.4% +10.0% ➖ noise
2 duckdb:vortex-compact -1.1% +10.2% -10.3% +12.5% ➖ noise
2 duckdb:vortex-file-compressed -1.5% +10.2% -10.6% +10.0% ✅ faster
3 datafusion:vortex-compact +6.6% +6.7% -0.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +19.4% +6.7% +11.9% +14.2% ➖ noise
3 duckdb:vortex-compact +9.4% +6.7% +2.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +45.0% +6.7% +35.9% +35.8% 🚨 regression
4 datafusion:vortex-compact +5.6% +8.3% -2.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +12.7% +8.3% +4.1% +10.0% ➖ noise
4 duckdb:vortex-compact +5.0% +8.3% -3.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +11.6% +8.3% +3.1% +10.0% ➖ noise
5 datafusion:vortex-compact +7.5% +7.7% -0.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +8.3% +7.7% +0.5% +10.0% ➖ noise
5 duckdb:vortex-compact +4.5% +7.7% -2.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +7.4% +7.7% -0.2% +10.0% ➖ noise
6 datafusion:vortex-compact +4.9% +8.3% -3.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +6.9% +8.3% -1.3% +10.7% ➖ noise
6 duckdb:vortex-compact +2.5% +8.3% -5.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +18.2% +8.3% +9.2% +23.9% ➖ noise
7 datafusion:vortex-compact +1.6% +9.2% -7.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +16.9% +9.2% +7.1% +14.6% ➖ noise
7 duckdb:vortex-compact +6.1% +9.2% -2.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +12.6% +9.2% +3.1% +18.2% ➖ noise
8 datafusion:vortex-compact -7.1% +9.5% -15.1% +23.1% ➖ noise
8 datafusion:vortex-file-compressed -4.6% +9.5% -12.9% +16.4% ➖ noise
8 duckdb:vortex-compact +10.6% +9.5% +1.0% +10.6% ➖ noise
8 duckdb:vortex-file-compressed -7.9% +9.5% -15.9% +16.3% ✅ faster

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Jun 3, 2026

Merging this PR will improve performance by 30.07%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 3 improved benchmarks
✅ 1272 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_bool_canonical_into[(1000, 10)] 45.4 µs 30.5 µs +49.13%
Simulation chunked_varbinview_canonical_into[(1000, 10)] 197.7 µs 161.4 µs +22.43%
Simulation chunked_varbinview_into_canonical[(1000, 10)] 212.3 µs 176.2 µs +20.54%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.


Comparing myrrc/viewed-layout-children-cache (058a3fb) with develop (66335d4)

Open in CodSpeed

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (-1.5%, environment too noisy confidence) · DuckDB No clear signal (-1.0%, environment too noisy confidence)
Vortex (geomean): 0.968x ➖
Parquet (geomean): 0.987x ➖
Shifts: Parquet (control) -1.3% · Median polish -1.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.942x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 48820532 51178757 0.95
tpch_q02/datafusion:vortex-file-compressed 21480779 23751793 0.90
tpch_q03/datafusion:vortex-file-compressed 26083569 27491261 0.95
tpch_q04/datafusion:vortex-file-compressed 19012970 20370332 0.93
tpch_q05/datafusion:vortex-file-compressed 47355012 52166894 0.91
tpch_q06/datafusion:vortex-file-compressed 9864021 10669052 0.92
tpch_q07/datafusion:vortex-file-compressed 54054086 57643696 0.94
tpch_q08/datafusion:vortex-file-compressed 38967272 40576365 0.96
tpch_q09/datafusion:vortex-file-compressed 50973878 52824283 0.96
tpch_q10/datafusion:vortex-file-compressed 42958752 44527330 0.96
tpch_q11/datafusion:vortex-file-compressed 15255977 16162584 0.94
tpch_q12/datafusion:vortex-file-compressed 23264597 24144039 0.96
tpch_q13/datafusion:vortex-file-compressed 26199625 27502715 0.95
tpch_q14/datafusion:vortex-file-compressed 15258531 16646393 0.92
tpch_q15/datafusion:vortex-file-compressed 22778738 24358153 0.94
tpch_q16/datafusion:vortex-file-compressed 20159592 19973645 1.01
tpch_q17/datafusion:vortex-file-compressed 63306561 70058668 0.90
tpch_q18/datafusion:vortex-file-compressed 78467514 86790019 0.90
tpch_q19/datafusion:vortex-file-compressed 19506126 20636620 0.95
tpch_q20/datafusion:vortex-file-compressed 29052986 29481707 0.99
tpch_q21/datafusion:vortex-file-compressed 69013759 72137646 0.96
tpch_q22/datafusion:vortex-file-compressed 10879441 11800623 0.92
datafusion / vortex-compact (0.959x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 56173561 58395635 0.96
tpch_q02/datafusion:vortex-compact 24970040 26479209 0.94
tpch_q03/datafusion:vortex-compact 27246777 29022287 0.94
tpch_q04/datafusion:vortex-compact 20904462 21829121 0.96
tpch_q05/datafusion:vortex-compact 48435107 50900330 0.95
tpch_q06/datafusion:vortex-compact 12509604 12498738 1.00
tpch_q07/datafusion:vortex-compact 58577893 60338318 0.97
tpch_q08/datafusion:vortex-compact 41237958 42900465 0.96
tpch_q09/datafusion:vortex-compact 53661438 56383331 0.95
tpch_q10/datafusion:vortex-compact 43604631 45787650 0.95
tpch_q11/datafusion:vortex-compact 16282663 17570720 0.93
tpch_q12/datafusion:vortex-compact 29886116 30307618 0.99
tpch_q13/datafusion:vortex-compact 31243146 31641206 0.99
tpch_q14/datafusion:vortex-compact 17846526 19630424 0.91
tpch_q15/datafusion:vortex-compact 29194139 31331228 0.93
tpch_q16/datafusion:vortex-compact 24558434 24674259 1.00
tpch_q17/datafusion:vortex-compact 68708651 70627205 0.97
tpch_q18/datafusion:vortex-compact 81783035 85025423 0.96
tpch_q19/datafusion:vortex-compact 29570192 30963591 0.95
tpch_q20/datafusion:vortex-compact 32286655 32774064 0.99
tpch_q21/datafusion:vortex-compact 72901182 76950984 0.95
tpch_q22/datafusion:vortex-compact 12161704 12687102 0.96
datafusion / parquet (0.977x ➖, 2↑ 0↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 141009838 137754224 1.02
tpch_q02/datafusion:parquet 61212123 63612931 0.96
tpch_q03/datafusion:parquet 🚀 66438785 75292385 0.88
tpch_q04/datafusion:parquet 42794367 43729184 0.98
tpch_q05/datafusion:parquet 92008259 94502718 0.97
tpch_q06/datafusion:parquet 42137206 40902756 1.03
tpch_q07/datafusion:parquet 106614713 107223659 0.99
tpch_q08/datafusion:parquet 93825582 97475341 0.96
tpch_q09/datafusion:parquet 129312419 128324771 1.01
tpch_q10/datafusion:parquet 113796758 112448977 1.01
tpch_q11/datafusion:parquet 40012028 41964884 0.95
tpch_q12/datafusion:parquet 🚀 74303440 86306771 0.86
tpch_q13/datafusion:parquet 196986616 207450018 0.95
tpch_q14/datafusion:parquet 47728663 43568600 1.10
tpch_q15/datafusion:parquet 56491690 59024558 0.96
tpch_q16/datafusion:parquet 40093176 42105180 0.95
tpch_q17/datafusion:parquet 132883506 126783300 1.05
tpch_q18/datafusion:parquet 160678958 167658988 0.96
tpch_q19/datafusion:parquet 74156558 74767715 0.99
tpch_q20/datafusion:parquet 65330929 67000982 0.98
tpch_q21/datafusion:parquet 134884445 139532338 0.97
tpch_q22/datafusion:parquet 31576381 32028758 0.99
datafusion / arrow (0.985x ➖, 1↑ 1↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 50411811 61395446 0.82
tpch_q02/datafusion:arrow 18601367 19301114 0.96
tpch_q03/datafusion:arrow 29665808 30026477 0.99
tpch_q04/datafusion:arrow 26592865 24433394 1.09
tpch_q05/datafusion:arrow 🚨 81813006 72167962 1.13
tpch_q06/datafusion:arrow 20943345 19110162 1.10
tpch_q07/datafusion:arrow 100629101 102651098 0.98
tpch_q08/datafusion:arrow 40600169 42922290 0.95
tpch_q09/datafusion:arrow 62817051 66005758 0.95
tpch_q10/datafusion:arrow 45295225 48712784 0.93
tpch_q11/datafusion:arrow 8901067 9212523 0.97
tpch_q12/datafusion:arrow 50039064 50148924 1.00
tpch_q13/datafusion:arrow 46280192 46845373 0.99
tpch_q14/datafusion:arrow 21129981 21561260 0.98
tpch_q15/datafusion:arrow 41723967 42182203 0.99
tpch_q16/datafusion:arrow 18541013 18878728 0.98
tpch_q17/datafusion:arrow 67472527 67717251 1.00
tpch_q18/datafusion:arrow 133105987 138359542 0.96
tpch_q19/datafusion:arrow 33771518 35010078 0.96
tpch_q20/datafusion:arrow 33435291 33362957 1.00
tpch_q21/datafusion:arrow 147424628 150737714 0.98
tpch_q22/datafusion:arrow 17859656 17847629 1.00
duckdb / vortex-file-compressed (0.986x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31825902 31081823 1.02
tpch_q02/duckdb:vortex-file-compressed 24100441 24992382 0.96
tpch_q03/duckdb:vortex-file-compressed 31927990 32797298 0.97
tpch_q04/duckdb:vortex-file-compressed 29053049 28936953 1.00
tpch_q05/duckdb:vortex-file-compressed 36639114 36984393 0.99
tpch_q06/duckdb:vortex-file-compressed 7788572 8558157 0.91
tpch_q07/duckdb:vortex-file-compressed 34515856 34900378 0.99
tpch_q08/duckdb:vortex-file-compressed 37054297 37338133 0.99
tpch_q09/duckdb:vortex-file-compressed 58586362 59119171 0.99
tpch_q10/duckdb:vortex-file-compressed 40927352 40762842 1.00
tpch_q11/duckdb:vortex-file-compressed 15072227 15130075 1.00
tpch_q12/duckdb:vortex-file-compressed 22625012 22200763 1.02
tpch_q13/duckdb:vortex-file-compressed 41125922 41743506 0.99
tpch_q14/duckdb:vortex-file-compressed 21441210 21689940 0.99
tpch_q15/duckdb:vortex-file-compressed 17068472 17282789 0.99
tpch_q16/duckdb:vortex-file-compressed 29980787 29771740 1.01
tpch_q17/duckdb:vortex-file-compressed 23397784 24148774 0.97
tpch_q18/duckdb:vortex-file-compressed 52852111 53189653 0.99
tpch_q19/duckdb:vortex-file-compressed 28883600 29003221 1.00
tpch_q20/duckdb:vortex-file-compressed 32467396 33707271 0.96
tpch_q21/duckdb:vortex-file-compressed 98921030 98659782 1.00
tpch_q22/duckdb:vortex-file-compressed 16464593 17223317 0.96
duckdb / vortex-compact (0.983x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 37858820 38613621 0.98
tpch_q02/duckdb:vortex-compact 34260685 35227248 0.97
tpch_q03/duckdb:vortex-compact 34242783 34216206 1.00
tpch_q04/duckdb:vortex-compact 31944889 31482882 1.01
tpch_q05/duckdb:vortex-compact 40055772 41738388 0.96
tpch_q06/duckdb:vortex-compact 10903054 11554498 0.94
tpch_q07/duckdb:vortex-compact 40079071 41105218 0.98
tpch_q08/duckdb:vortex-compact 41443568 42596879 0.97
tpch_q09/duckdb:vortex-compact 64864087 65978139 0.98
tpch_q10/duckdb:vortex-compact 44938326 44808995 1.00
tpch_q11/duckdb:vortex-compact 18302126 19166796 0.95
tpch_q12/duckdb:vortex-compact 29562341 30178822 0.98
tpch_q13/duckdb:vortex-compact 46993484 47567387 0.99
tpch_q14/duckdb:vortex-compact 25694519 26420811 0.97
tpch_q15/duckdb:vortex-compact 19422953 20097910 0.97
tpch_q16/duckdb:vortex-compact 32151369 31666642 1.02
tpch_q17/duckdb:vortex-compact 28570545 29443349 0.97
tpch_q18/duckdb:vortex-compact 53397826 53654708 1.00
tpch_q19/duckdb:vortex-compact 33022002 33581036 0.98
tpch_q20/duckdb:vortex-compact 40115804 40179640 1.00
tpch_q21/duckdb:vortex-compact 102180583 100723194 1.01
tpch_q22/duckdb:vortex-compact 18138846 18336650 0.99
duckdb / parquet (0.997x ➖, 0↑ 2↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77491801 79359237 0.98
tpch_q02/duckdb:parquet 38889351 39439370 0.99
tpch_q03/duckdb:parquet 70411346 70258550 1.00
tpch_q04/duckdb:parquet 49450021 49557296 1.00
tpch_q05/duckdb:parquet 67232027 68124676 0.99
tpch_q06/duckdb:parquet 22819014 22517357 1.01
tpch_q07/duckdb:parquet 70275389 70253059 1.00
tpch_q08/duckdb:parquet 🚨 101236665 82540590 1.23
tpch_q09/duckdb:parquet 133443126 136423351 0.98
tpch_q10/duckdb:parquet 126458686 127185135 0.99
tpch_q11/duckdb:parquet 22520788 22397474 1.01
tpch_q12/duckdb:parquet 46946072 50291273 0.93
tpch_q13/duckdb:parquet 250295046 251153864 1.00
tpch_q14/duckdb:parquet 50444550 50804864 0.99
tpch_q15/duckdb:parquet 25943752 26300652 0.99
tpch_q16/duckdb:parquet 58239125 58044785 1.00
tpch_q17/duckdb:parquet 🚨 63401570 57037318 1.11
tpch_q18/duckdb:parquet 118462211 119703518 0.99
tpch_q19/duckdb:parquet 72188948 78742110 0.92
tpch_q20/duckdb:parquet 64968162 70486385 0.92
tpch_q21/duckdb:parquet 171123250 176241626 0.97
tpch_q22/duckdb:parquet 53461878 53853367 0.99
duckdb / duckdb (0.993x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 18039817 17492039 1.03
tpch_q02/duckdb:duckdb 14511224 14514934 1.00
tpch_q03/duckdb:duckdb 22347107 21944293 1.02
tpch_q04/duckdb:duckdb 22300177 23115354 0.96
tpch_q05/duckdb:duckdb 23540318 23477822 1.00
tpch_q06/duckdb:duckdb 7125020 7069351 1.01
tpch_q07/duckdb:duckdb 25001415 25368228 0.99
tpch_q08/duckdb:duckdb 24253992 23828609 1.02
tpch_q09/duckdb:duckdb 56671985 58352811 0.97
tpch_q10/duckdb:duckdb 50153678 52004852 0.96
tpch_q11/duckdb:duckdb 7072343 7337302 0.96
tpch_q12/duckdb:duckdb 17919563 17728638 1.01
tpch_q13/duckdb:duckdb 39675771 39303073 1.01
tpch_q14/duckdb:duckdb 21064034 22057515 0.95
tpch_q15/duckdb:duckdb 13619009 13456674 1.01
tpch_q16/duckdb:duckdb 25744404 26015612 0.99
tpch_q17/duckdb:duckdb 16359100 16224534 1.01
tpch_q18/duckdb:duckdb 40931372 40583078 1.01
tpch_q19/duckdb:duckdb 30822279 31337196 0.98
tpch_q20/duckdb:duckdb 25298382 26041164 0.97
tpch_q21/duckdb:duckdb 60686144 60689320 1.00
tpch_q22/duckdb:duckdb 25258845 25690748 0.98

File Size Changes (10 files changed, +0.1% overall, 5↑ 5↓)
File Scale Format Base HEAD Change %
orders_0.vortex 1.0 vortex-compact 31.73 MB 32.20 MB +482.27 KB +1.5%
part_0.vortex 1.0 vortex-file-compressed 4.94 MB 4.98 MB +40.80 KB +0.8%
part_0.vortex 1.0 vortex-compact 3.41 MB 3.42 MB +15.51 KB +0.4%
partsupp_0.vortex 1.0 vortex-file-compressed 23.77 MB 23.81 MB +41.95 KB +0.2%
lineitem_1.vortex 1.0 vortex-file-compressed 84.56 MB 84.67 MB +111.81 KB +0.1%
customer_0.vortex 1.0 vortex-file-compressed 8.90 MB 8.89 MB 10.12 KB -0.1%
lineitem_0.vortex 1.0 vortex-file-compressed 85.28 MB 85.15 MB 126.68 KB -0.1%
partsupp_0.vortex 1.0 vortex-compact 21.00 MB 20.94 MB 53.85 KB -0.3%
orders_0.vortex 1.0 vortex-file-compressed 38.38 MB 38.18 MB 206.30 KB -0.5%
supplier_0.vortex 1.0 vortex-file-compressed 614.52 KB 601.39 KB 13.12 KB -2.1%

Totals:

  • vortex-compact: 190.36 MB → 190.79 MB (+0.2%)
  • vortex-file-compressed: 246.70 MB → 246.55 MB (-0.1%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -17.9% -0.0% -17.9% +19.7% ✅ faster
1 datafusion:vortex-compact -3.8% -0.0% -3.8% +18.2% ➖ noise
1 datafusion:vortex-file-compressed -4.6% -0.0% -4.6% +18.9% ➖ noise
1 duckdb:duckdb +3.1% -0.0% +3.2% +15.7% ➖ noise
1 duckdb:vortex-compact -2.0% -0.0% -1.9% +16.4% ➖ noise
1 duckdb:vortex-file-compressed +2.4% -0.0% +2.4% +18.1% ➖ noise
2 datafusion:arrow -3.6% -2.6% -1.1% +11.6% ➖ noise
2 datafusion:vortex-compact -5.7% -2.6% -3.2% +11.6% ➖ noise
2 datafusion:vortex-file-compressed -9.6% -2.6% -7.2% +11.6% ➖ noise
2 duckdb:duckdb -0.0% -2.6% +2.6% +11.6% ➖ noise
2 duckdb:vortex-compact -2.7% -2.6% -0.2% +11.6% ➖ noise
2 duckdb:vortex-file-compressed -3.6% -2.6% -1.0% +11.6% ➖ noise
3 datafusion:arrow -1.2% -6.0% +5.1% +11.6% ➖ noise
3 datafusion:vortex-compact -6.1% -6.0% -0.2% +12.9% ➖ noise
3 datafusion:vortex-file-compressed -5.1% -6.0% +0.9% +11.6% ➖ noise
3 duckdb:duckdb +1.8% -6.0% +8.3% +11.6% ➖ noise
3 duckdb:vortex-compact +0.1% -6.0% +6.4% +11.6% ➖ noise
3 duckdb:vortex-file-compressed -2.7% -6.0% +3.5% +11.6% ➖ noise
4 datafusion:arrow +8.8% -1.2% +10.1% +15.7% ➖ noise
4 datafusion:vortex-compact -4.2% -1.2% -3.1% +11.6% ➖ noise
4 datafusion:vortex-file-compressed -6.7% -1.2% -5.5% +11.6% ➖ noise
4 duckdb:duckdb -3.5% -1.2% -2.4% +11.6% ➖ noise
4 duckdb:vortex-compact +1.5% -1.2% +2.7% +11.6% ➖ noise
4 duckdb:vortex-file-compressed +0.4% -1.2% +1.6% +11.6% ➖ noise
5 datafusion:arrow +13.4% -2.0% +15.7% +11.6% 🚨 regression
5 datafusion:vortex-compact -4.8% -2.0% -2.9% +11.6% ➖ noise
5 datafusion:vortex-file-compressed -9.2% -2.0% -7.4% +11.6% ➖ noise
5 duckdb:duckdb +0.3% -2.0% +2.3% +11.6% ➖ noise
5 duckdb:vortex-compact -4.0% -2.0% -2.1% +11.6% ➖ noise
5 duckdb:vortex-file-compressed -0.9% -2.0% +1.1% +11.6% ➖ noise
6 datafusion:arrow +9.6% +2.2% +7.3% +16.5% ➖ noise
6 datafusion:vortex-compact +0.1% +2.2% -2.0% +24.3% ➖ noise
6 datafusion:vortex-file-compressed -7.5% +2.2% -9.5% +20.3% ➖ noise
6 duckdb:duckdb +0.8% +2.2% -1.4% +15.1% ➖ noise
6 duckdb:vortex-compact -5.6% +2.2% -7.6% +19.3% ➖ noise
6 duckdb:vortex-file-compressed -9.0% +2.2% -10.9% +16.1% ➖ noise
7 datafusion:arrow -2.0% -0.3% -1.7% +13.8% ➖ noise
7 datafusion:vortex-compact -2.9% -0.3% -2.7% +11.6% ➖ noise
7 datafusion:vortex-file-compressed -6.2% -0.3% -6.0% +11.6% ➖ noise
7 duckdb:duckdb -1.4% -0.3% -1.2% +11.6% ➖ noise
7 duckdb:vortex-compact -2.5% -0.3% -2.2% +11.6% ➖ noise
7 duckdb:vortex-file-compressed -1.1% -0.3% -0.8% +11.6% ➖ noise
8 datafusion:arrow -5.4% +8.7% -12.9% +11.6% ✅ faster
8 datafusion:vortex-compact -3.9% +8.7% -11.5% +12.4% ✅ faster
8 datafusion:vortex-file-compressed -4.0% +8.7% -11.6% +11.6% ✅ faster
8 duckdb:duckdb +1.8% +8.7% -6.3% +11.6% ➖ noise
8 duckdb:vortex-compact -2.7% +8.7% -10.5% +11.7% ➖ noise
8 duckdb:vortex-file-compressed -0.8% +8.7% -8.7% +15.2% ➖ noise
9 datafusion:arrow -4.8% -0.7% -4.1% +11.6% ➖ noise
9 datafusion:vortex-compact -4.8% -0.7% -4.1% +11.6% ➖ noise
9 datafusion:vortex-file-compressed -3.5% -0.7% -2.8% +11.6% ➖ noise
9 duckdb:duckdb -2.9% -0.7% -2.2% +11.6% ➖ noise
9 duckdb:vortex-compact -1.7% -0.7% -1.0% +11.6% ➖ noise
9 duckdb:vortex-file-compressed -0.9% -0.7% -0.2% +12.3% ➖ noise
10 datafusion:arrow -7.0% +0.3% -7.3% +11.6% ➖ noise
10 datafusion:vortex-compact -4.8% +0.3% -5.1% +11.6% ➖ noise
10 datafusion:vortex-file-compressed -3.5% +0.3% -3.8% +11.6% ➖ noise
10 duckdb:duckdb -3.6% +0.3% -3.9% +11.6% ➖ noise
10 duckdb:vortex-compact +0.3% +0.3% -0.0% +11.6% ➖ noise
10 duckdb:vortex-file-compressed +0.4% +0.3% +0.1% +11.6% ➖ noise
11 datafusion:arrow -3.4% -2.1% -1.3% +11.6% ➖ noise
11 datafusion:vortex-compact -7.3% -2.1% -5.4% +11.6% ➖ noise
11 datafusion:vortex-file-compressed -5.6% -2.1% -3.6% +11.6% ➖ noise
11 duckdb:duckdb -3.6% -2.1% -1.6% +11.6% ➖ noise
11 duckdb:vortex-compact -4.5% -2.1% -2.5% +22.1% ➖ noise
11 duckdb:vortex-file-compressed -0.4% -2.1% +1.7% +25.8% ➖ noise
12 datafusion:arrow -0.2% -10.4% +11.3% +18.6% ➖ noise
12 datafusion:vortex-compact -1.4% -10.4% +10.0% +12.2% ➖ noise
12 datafusion:vortex-file-compressed -3.6% -10.4% +7.5% +14.2% ➖ noise
12 duckdb:duckdb +1.1% -10.4% +12.8% +11.6% 🚨 regression
12 duckdb:vortex-compact -2.0% -10.4% +9.3% +11.6% ➖ noise
12 duckdb:vortex-file-compressed +1.9% -10.4% +13.7% +11.6% 🚨 regression
13 datafusion:arrow -1.2% -2.7% +1.6% +11.6% ➖ noise
13 datafusion:vortex-compact -1.3% -2.7% +1.5% +11.6% ➖ noise
13 datafusion:vortex-file-compressed -4.7% -2.7% -2.1% +11.6% ➖ noise
13 duckdb:duckdb +0.9% -2.7% +3.8% +11.6% ➖ noise
13 duckdb:vortex-compact -1.2% -2.7% +1.6% +11.6% ➖ noise
13 duckdb:vortex-file-compressed -1.5% -2.7% +1.3% +11.6% ➖ noise
14 datafusion:arrow -2.0% +4.3% -6.0% +11.6% ➖ noise
14 datafusion:vortex-compact -9.1% +4.3% -12.8% +15.1% ➖ noise
14 datafusion:vortex-file-compressed -8.3% +4.3% -12.1% +11.6% ✅ faster
14 duckdb:duckdb -4.5% +4.3% -8.4% +11.6% ➖ noise
14 duckdb:vortex-compact -2.7% +4.3% -6.8% +11.6% ➖ noise
14 duckdb:vortex-file-compressed -1.1% +4.3% -5.2% +14.2% ➖ noise
15 datafusion:arrow -1.1% -2.8% +1.8% +11.6% ➖ noise
15 datafusion:vortex-compact -6.8% -2.8% -4.1% +11.6% ➖ noise
15 datafusion:vortex-file-compressed -6.5% -2.8% -3.8% +11.6% ➖ noise
15 duckdb:duckdb +1.2% -2.8% +4.2% +11.6% ➖ noise
15 duckdb:vortex-compact -3.4% -2.8% -0.5% +11.6% ➖ noise
15 duckdb:vortex-file-compressed -1.2% -2.8% +1.6% +11.6% ➖ noise
16 datafusion:arrow -1.8% -2.3% +0.5% +11.6% ➖ noise
16 datafusion:vortex-compact -0.5% -2.3% +1.8% +11.6% ➖ noise
16 datafusion:vortex-file-compressed +0.9% -2.3% +3.3% +11.6% ➖ noise
16 duckdb:duckdb -1.0% -2.3% +1.2% +11.6% ➖ noise
16 duckdb:vortex-compact +1.5% -2.3% +3.9% +11.6% ➖ noise
16 duckdb:vortex-file-compressed +0.7% -2.3% +3.0% +11.6% ➖ noise
17 datafusion:arrow -0.4% +7.9% -7.7% +11.7% ➖ noise
17 datafusion:vortex-compact -2.7% +7.9% -9.9% +13.1% ➖ noise
17 datafusion:vortex-file-compressed -9.6% +7.9% -16.3% +13.4% ✅ faster
17 duckdb:duckdb +0.8% +7.9% -6.6% +11.6% ➖ noise
17 duckdb:vortex-compact -3.0% +7.9% -10.1% +12.4% ➖ noise
17 duckdb:vortex-file-compressed -3.1% +7.9% -10.2% +13.7% ➖ noise
18 datafusion:arrow -3.8% -2.6% -1.2% +11.6% ➖ noise
18 datafusion:vortex-compact -3.8% -2.6% -1.2% +11.6% ➖ noise
18 datafusion:vortex-file-compressed -9.6% -2.6% -7.2% +11.6% ➖ noise
18 duckdb:duckdb +0.9% -2.6% +3.6% +11.6% ➖ noise
18 duckdb:vortex-compact -0.5% -2.6% +2.2% +11.6% ➖ noise
18 duckdb:vortex-file-compressed -0.6% -2.6% +2.0% +11.6% ➖ noise
19 datafusion:arrow -3.5% -4.6% +1.2% +17.6% ➖ noise
19 datafusion:vortex-compact -4.5% -4.6% +0.2% +14.4% ➖ noise
19 datafusion:vortex-file-compressed -5.5% -4.6% -0.9% +12.9% ➖ noise
19 duckdb:duckdb -1.6% -4.6% +3.1% +12.7% ➖ noise
19 duckdb:vortex-compact -1.7% -4.6% +3.1% +17.1% ➖ noise
19 duckdb:vortex-file-compressed -0.4% -4.6% +4.4% +12.0% ➖ noise
20 datafusion:arrow +0.2% -5.2% +5.7% +11.6% ➖ noise
20 datafusion:vortex-compact -1.5% -5.2% +3.9% +11.6% ➖ noise
20 datafusion:vortex-file-compressed -1.5% -5.2% +3.9% +12.3% ➖ noise
20 duckdb:duckdb -2.9% -5.2% +2.5% +11.6% ➖ noise
20 duckdb:vortex-compact -0.2% -5.2% +5.3% +11.6% ➖ noise
20 duckdb:vortex-file-compressed -3.7% -5.2% +1.6% +11.6% ➖ noise
21 datafusion:arrow -2.2% -3.1% +0.9% +11.6% ➖ noise
21 datafusion:vortex-compact -5.3% -3.1% -2.2% +11.6% ➖ noise
21 datafusion:vortex-file-compressed -4.3% -3.1% -1.3% +11.6% ➖ noise
21 duckdb:duckdb -0.0% -3.1% +3.2% +11.6% ➖ noise
21 duckdb:vortex-compact +1.4% -3.1% +4.7% +11.6% ➖ noise
21 duckdb:vortex-file-compressed +0.3% -3.1% +3.5% +11.6% ➖ noise
22 datafusion:arrow +0.1% -1.1% +1.1% +11.6% ➖ noise
22 datafusion:vortex-compact -4.1% -1.1% -3.1% +11.6% ➖ noise
22 datafusion:vortex-file-compressed -7.8% -1.1% -6.8% +18.8% ➖ noise
22 duckdb:duckdb -1.7% -1.1% -0.6% +11.6% ➖ noise
22 duckdb:vortex-compact -1.1% -1.1% -0.0% +11.6% ➖ noise
22 duckdb:vortex-file-compressed -4.4% -1.1% -3.4% +11.6% ➖ noise

@myrrc myrrc force-pushed the myrrc/viewed-layout-children-cache branch from e33f8d3 to 64b2473 Compare June 3, 2026 13:31
@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Jun 3, 2026
@myrrc myrrc requested a review from joseph-isaacs June 3, 2026 13:32
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 3, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): 0.996x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.995x ➖, 0↑ 3↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27256271 26532962 1.03
tpcds_q02/datafusion:vortex-file-compressed 46775841 49155589 0.95
tpcds_q03/datafusion:vortex-file-compressed 14580272 15096495 0.97
tpcds_q04/datafusion:vortex-file-compressed 247933594 258121495 0.96
tpcds_q05/datafusion:vortex-file-compressed 42501045 44082913 0.96
tpcds_q06/datafusion:vortex-file-compressed 59560318 60093581 0.99
tpcds_q07/datafusion:vortex-file-compressed 41492235 41030873 1.01
tpcds_q08/datafusion:vortex-file-compressed 28620089 28214543 1.01
tpcds_q09/datafusion:vortex-file-compressed 37629578 38049986 0.99
tpcds_q10/datafusion:vortex-file-compressed 39033408 37285274 1.05
tpcds_q11/datafusion:vortex-file-compressed 125070153 132371164 0.94
tpcds_q12/datafusion:vortex-file-compressed 19702568 19060523 1.03
tpcds_q13/datafusion:vortex-file-compressed 49589989 47981747 1.03
tpcds_q14/datafusion:vortex-file-compressed 163235316 168265553 0.97
tpcds_q15/datafusion:vortex-file-compressed 27802965 28220488 0.99
tpcds_q16/datafusion:vortex-file-compressed 28534388 28470564 1.00
tpcds_q17/datafusion:vortex-file-compressed 61874793 63348992 0.98
tpcds_q18/datafusion:vortex-file-compressed 67781646 69013496 0.98
tpcds_q19/datafusion:vortex-file-compressed 22226243 21899718 1.01
tpcds_q20/datafusion:vortex-file-compressed 20985876 22106339 0.95
tpcds_q21/datafusion:vortex-file-compressed 35073722 35107400 1.00
tpcds_q22/datafusion:vortex-file-compressed 🚨 145505217 128616862 1.13
tpcds_q23/datafusion:vortex-file-compressed 147278061 154902976 0.95
tpcds_q24/datafusion:vortex-file-compressed 86281026 85459368 1.01
tpcds_q25/datafusion:vortex-file-compressed 67790294 66955388 1.01
tpcds_q26/datafusion:vortex-file-compressed 33634200 34235868 0.98
tpcds_q27/datafusion:vortex-file-compressed 108106953 110007357 0.98
tpcds_q28/datafusion:vortex-file-compressed 30792463 32263197 0.95
tpcds_q29/datafusion:vortex-file-compressed 61450049 60840505 1.01
tpcds_q30/datafusion:vortex-file-compressed 23373991 23117712 1.01
tpcds_q31/datafusion:vortex-file-compressed 69794669 72714558 0.96
tpcds_q32/datafusion:vortex-file-compressed 18981041 19521646 0.97
tpcds_q33/datafusion:vortex-file-compressed 29051255 29265869 0.99
tpcds_q34/datafusion:vortex-file-compressed 24854034 24205858 1.03
tpcds_q35/datafusion:vortex-file-compressed 43766859 45614734 0.96
tpcds_q36/datafusion:vortex-file-compressed 61192172 58312409 1.05
tpcds_q37/datafusion:vortex-file-compressed 24210955 24093579 1.00
tpcds_q38/datafusion:vortex-file-compressed 41753591 42629529 0.98
tpcds_q39/datafusion:vortex-file-compressed 107861463 104186480 1.04
tpcds_q40/datafusion:vortex-file-compressed 32084684 32972479 0.97
tpcds_q41/datafusion:vortex-file-compressed 16379277 15616038 1.05
tpcds_q42/datafusion:vortex-file-compressed 13362879 14362939 0.93
tpcds_q43/datafusion:vortex-file-compressed 18187844 18920571 0.96
tpcds_q44/datafusion:vortex-file-compressed 30808616 30513899 1.01
tpcds_q45/datafusion:vortex-file-compressed 28639069 29866278 0.96
tpcds_q46/datafusion:vortex-file-compressed 34564030 34072808 1.01
tpcds_q47/datafusion:vortex-file-compressed 131159917 131793993 1.00
tpcds_q48/datafusion:vortex-file-compressed 35642669 35490919 1.00
tpcds_q49/datafusion:vortex-file-compressed 57092302 57719203 0.99
tpcds_q50/datafusion:vortex-file-compressed 39249212 39523978 0.99
tpcds_q51/datafusion:vortex-file-compressed 88354763 86931013 1.02
tpcds_q52/datafusion:vortex-file-compressed 13611030 14456251 0.94
tpcds_q53/datafusion:vortex-file-compressed 22853726 21910549 1.04
tpcds_q54/datafusion:vortex-file-compressed 33983870 35656912 0.95
tpcds_q55/datafusion:vortex-file-compressed 13374379 14466137 0.92
tpcds_q56/datafusion:vortex-file-compressed 29535474 29816499 0.99
tpcds_q57/datafusion:vortex-file-compressed 111057516 107310145 1.03
tpcds_q58/datafusion:vortex-file-compressed 53491000 56073831 0.95
tpcds_q59/datafusion:vortex-file-compressed 54732592 56711815 0.97
tpcds_q60/datafusion:vortex-file-compressed 29279523 28838048 1.02
tpcds_q61/datafusion:vortex-file-compressed 40601053 40309217 1.01
tpcds_q62/datafusion:vortex-file-compressed 🚨 24256205 21459948 1.13
tpcds_q63/datafusion:vortex-file-compressed 21173452 23173802 0.91
tpcds_q64/datafusion:vortex-file-compressed 429275789 420323875 1.02
tpcds_q65/datafusion:vortex-file-compressed 38780195 39547278 0.98
tpcds_q66/datafusion:vortex-file-compressed 73872979 69912655 1.06
tpcds_q67/datafusion:vortex-file-compressed 148577801 151228556 0.98
tpcds_q68/datafusion:vortex-file-compressed 32460276 32988830 0.98
tpcds_q69/datafusion:vortex-file-compressed 34368148 34960119 0.98
tpcds_q70/datafusion:vortex-file-compressed 85502745 86471101 0.99
tpcds_q71/datafusion:vortex-file-compressed 23057162 23261828 0.99
tpcds_q72/datafusion:vortex-file-compressed 2174817261 2200129074 0.99
tpcds_q73/datafusion:vortex-file-compressed 22501742 22754796 0.99
tpcds_q74/datafusion:vortex-file-compressed 79927118 82757739 0.97
tpcds_q75/datafusion:vortex-file-compressed 110049393 105961304 1.04
tpcds_q76/datafusion:vortex-file-compressed 30523174 31091132 0.98
tpcds_q77/datafusion:vortex-file-compressed 39800884 39087825 1.02
tpcds_q78/datafusion:vortex-file-compressed 124981829 123781944 1.01
tpcds_q79/datafusion:vortex-file-compressed 27300998 27895307 0.98
tpcds_q80/datafusion:vortex-file-compressed 93497162 96238971 0.97
tpcds_q81/datafusion:vortex-file-compressed 23997040 23950444 1.00
tpcds_q82/datafusion:vortex-file-compressed 24034028 24213963 0.99
tpcds_q83/datafusion:vortex-file-compressed 34104868 34709562 0.98
tpcds_q84/datafusion:vortex-file-compressed 12625564 13213705 0.96
tpcds_q85/datafusion:vortex-file-compressed 94912951 91978844 1.03
tpcds_q86/datafusion:vortex-file-compressed 15530071 16251649 0.96
tpcds_q87/datafusion:vortex-file-compressed 42225737 43805667 0.96
tpcds_q88/datafusion:vortex-file-compressed 55124465 55634351 0.99
tpcds_q89/datafusion:vortex-file-compressed 24431659 24268813 1.01
tpcds_q90/datafusion:vortex-file-compressed 13713617 14840754 0.92
tpcds_q91/datafusion:vortex-file-compressed 19261019 18841921 1.02
tpcds_q92/datafusion:vortex-file-compressed 17875429 17512605 1.02
tpcds_q93/datafusion:vortex-file-compressed 32293705 32768446 0.99
tpcds_q94/datafusion:vortex-file-compressed 23389184 22941529 1.02
tpcds_q95/datafusion:vortex-file-compressed 60677780 61051747 0.99
tpcds_q96/datafusion:vortex-file-compressed 13072342 13284013 0.98
tpcds_q97/datafusion:vortex-file-compressed 34212442 31817180 1.08
tpcds_q98/datafusion:vortex-file-compressed 23830062 23933980 1.00
tpcds_q99/datafusion:vortex-file-compressed 🚨 31706142 27774924 1.14
datafusion / vortex-compact (0.991x ➖, 2↑ 0↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25719055 25018661 1.03
tpcds_q02/datafusion:vortex-compact 53710938 53944086 1.00
tpcds_q03/datafusion:vortex-compact 18822194 20201189 0.93
tpcds_q04/datafusion:vortex-compact 296742012 296617115 1.00
tpcds_q05/datafusion:vortex-compact 47839109 48341860 0.99
tpcds_q06/datafusion:vortex-compact 61586401 60898787 1.01
tpcds_q07/datafusion:vortex-compact 52745127 54342045 0.97
tpcds_q08/datafusion:vortex-compact 34894954 35640768 0.98
tpcds_q09/datafusion:vortex-compact 49638664 50244478 0.99
tpcds_q10/datafusion:vortex-compact 47040844 48650841 0.97
tpcds_q11/datafusion:vortex-compact 157097240 154617517 1.02
tpcds_q12/datafusion:vortex-compact 22770755 23664872 0.96
tpcds_q13/datafusion:vortex-compact 🚀 130719867 159942336 0.82
tpcds_q14/datafusion:vortex-compact 191457720 199051800 0.96
tpcds_q15/datafusion:vortex-compact 🚀 29538728 33931514 0.87
tpcds_q16/datafusion:vortex-compact 32091207 32462704 0.99
tpcds_q17/datafusion:vortex-compact 75839309 73401926 1.03
tpcds_q18/datafusion:vortex-compact 78955885 82082049 0.96
tpcds_q19/datafusion:vortex-compact 29109785 29626294 0.98
tpcds_q20/datafusion:vortex-compact 25264337 26150141 0.97
tpcds_q21/datafusion:vortex-compact 40590299 40117129 1.01
tpcds_q22/datafusion:vortex-compact 115040688 117149767 0.98
tpcds_q23/datafusion:vortex-compact 161703268 166785113 0.97
tpcds_q24/datafusion:vortex-compact 98172344 97349548 1.01
tpcds_q25/datafusion:vortex-compact 80375562 78247689 1.03
tpcds_q26/datafusion:vortex-compact 43861720 44534411 0.98
tpcds_q27/datafusion:vortex-compact 126345530 121608385 1.04
tpcds_q28/datafusion:vortex-compact 98790568 96946105 1.02
tpcds_q29/datafusion:vortex-compact 72679178 72568496 1.00
tpcds_q30/datafusion:vortex-compact 28555474 27499495 1.04
tpcds_q31/datafusion:vortex-compact 94496197 98491039 0.96
tpcds_q32/datafusion:vortex-compact 24639495 25408090 0.97
tpcds_q33/datafusion:vortex-compact 37877261 37308282 1.02
tpcds_q34/datafusion:vortex-compact 32609206 33564624 0.97
tpcds_q35/datafusion:vortex-compact 51164287 52228017 0.98
tpcds_q36/datafusion:vortex-compact 76963052 78114758 0.99
tpcds_q37/datafusion:vortex-compact 33947766 33859659 1.00
tpcds_q38/datafusion:vortex-compact 48859218 52873151 0.92
tpcds_q39/datafusion:vortex-compact 112419267 114380991 0.98
tpcds_q40/datafusion:vortex-compact 36644734 36510694 1.00
tpcds_q41/datafusion:vortex-compact 17779990 17142435 1.04
tpcds_q42/datafusion:vortex-compact 17775075 18255096 0.97
tpcds_q43/datafusion:vortex-compact 24884859 24184383 1.03
tpcds_q44/datafusion:vortex-compact 46841073 46933870 1.00
tpcds_q45/datafusion:vortex-compact 33061490 32175903 1.03
tpcds_q46/datafusion:vortex-compact 43490803 44260958 0.98
tpcds_q47/datafusion:vortex-compact 150010195 151318654 0.99
tpcds_q48/datafusion:vortex-compact 92051208 88851797 1.04
tpcds_q49/datafusion:vortex-compact 69157131 68259180 1.01
tpcds_q50/datafusion:vortex-compact 49319786 47100337 1.05
tpcds_q51/datafusion:vortex-compact 95437232 95949959 0.99
tpcds_q52/datafusion:vortex-compact 18956484 18516867 1.02
tpcds_q53/datafusion:vortex-compact 28003532 28181845 0.99
tpcds_q54/datafusion:vortex-compact 42657332 42431458 1.01
tpcds_q55/datafusion:vortex-compact 18187701 18244714 1.00
tpcds_q56/datafusion:vortex-compact 35398625 36075598 0.98
tpcds_q57/datafusion:vortex-compact 114693644 118750612 0.97
tpcds_q58/datafusion:vortex-compact 60990885 61371288 0.99
tpcds_q59/datafusion:vortex-compact 67113429 69399355 0.97
tpcds_q60/datafusion:vortex-compact 35570186 36204816 0.98
tpcds_q61/datafusion:vortex-compact 54123823 55153737 0.98
tpcds_q62/datafusion:vortex-compact 23914998 24626331 0.97
tpcds_q63/datafusion:vortex-compact 28386900 27976855 1.01
tpcds_q64/datafusion:vortex-compact 464597030 460287695 1.01
tpcds_q65/datafusion:vortex-compact 52744527 54848799 0.96
tpcds_q66/datafusion:vortex-compact 76706955 80011620 0.96
tpcds_q67/datafusion:vortex-compact 155299850 158819170 0.98
tpcds_q68/datafusion:vortex-compact 44570019 44402681 1.00
tpcds_q69/datafusion:vortex-compact 44829414 47126670 0.95
tpcds_q70/datafusion:vortex-compact 96049244 96751300 0.99
tpcds_q71/datafusion:vortex-compact 29858789 29453517 1.01
tpcds_q72/datafusion:vortex-compact 2155762986 2166165971 1.00
tpcds_q73/datafusion:vortex-compact 29785303 30603650 0.97
tpcds_q74/datafusion:vortex-compact 91127054 96112019 0.95
tpcds_q75/datafusion:vortex-compact 128623393 127528594 1.01
tpcds_q76/datafusion:vortex-compact 31709100 32213206 0.98
tpcds_q77/datafusion:vortex-compact 49896071 51456391 0.97
tpcds_q78/datafusion:vortex-compact 140128138 139149944 1.01
tpcds_q79/datafusion:vortex-compact 37583372 38032953 0.99
tpcds_q80/datafusion:vortex-compact 106828670 102823033 1.04
tpcds_q81/datafusion:vortex-compact 28758337 27330008 1.05
tpcds_q82/datafusion:vortex-compact 34002120 33784981 1.01
tpcds_q83/datafusion:vortex-compact 34795958 34579335 1.01
tpcds_q84/datafusion:vortex-compact 14537646 14328029 1.01
tpcds_q85/datafusion:vortex-compact 161131695 160159103 1.01
tpcds_q86/datafusion:vortex-compact 21476147 20502530 1.05
tpcds_q87/datafusion:vortex-compact 50600792 52545353 0.96
tpcds_q88/datafusion:vortex-compact 77969061 77452902 1.01
tpcds_q89/datafusion:vortex-compact 31047028 30678616 1.01
tpcds_q90/datafusion:vortex-compact 15399450 15665989 0.98
tpcds_q91/datafusion:vortex-compact 34116946 33801121 1.01
tpcds_q92/datafusion:vortex-compact 23162886 21789128 1.06
tpcds_q93/datafusion:vortex-compact 38337643 38362979 1.00
tpcds_q94/datafusion:vortex-compact 26102979 28078087 0.93
tpcds_q95/datafusion:vortex-compact 67244575 64937138 1.04
tpcds_q96/datafusion:vortex-compact 16912956 17539949 0.96
tpcds_q97/datafusion:vortex-compact 35752402 36904656 0.97
tpcds_q98/datafusion:vortex-compact 30032867 30328767 0.99
tpcds_q99/datafusion:vortex-compact 34664571 35147576 0.99
datafusion / parquet (1.001x ➖, 1↑ 2↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30716232 30508329 1.01
tpcds_q02/datafusion:parquet 41289553 44972418 0.92
tpcds_q03/datafusion:parquet 12465156 12757412 0.98
tpcds_q04/datafusion:parquet 264422275 268425054 0.99
tpcds_q05/datafusion:parquet 41434278 42617358 0.97
tpcds_q06/datafusion:parquet 60342668 59574323 1.01
tpcds_q07/datafusion:parquet 78048204 75448319 1.03
tpcds_q08/datafusion:parquet 25662295 27044327 0.95
tpcds_q09/datafusion:parquet 46277796 42590994 1.09
tpcds_q10/datafusion:parquet 69754619 67721993 1.03
tpcds_q11/datafusion:parquet 138217648 146564069 0.94
tpcds_q12/datafusion:parquet 17707812 17700916 1.00
tpcds_q13/datafusion:parquet 74038259 74823133 0.99
tpcds_q14/datafusion:parquet 163604678 165027461 0.99
tpcds_q15/datafusion:parquet 21278430 22284724 0.95
tpcds_q16/datafusion:parquet 🚀 22901997 25720667 0.89
tpcds_q17/datafusion:parquet 63880597 65281646 0.98
tpcds_q18/datafusion:parquet 113229192 115619976 0.98
tpcds_q19/datafusion:parquet 22498025 22753914 0.99
tpcds_q20/datafusion:parquet 🚨 17588905 15907834 1.11
tpcds_q21/datafusion:parquet 18202009 18163525 1.00
tpcds_q22/datafusion:parquet 138708243 149718541 0.93
tpcds_q23/datafusion:parquet 144565219 146866226 0.98
tpcds_q24/datafusion:parquet 88560850 89508624 0.99
tpcds_q25/datafusion:parquet 65035003 66013561 0.99
tpcds_q26/datafusion:parquet 64680825 66217634 0.98
tpcds_q27/datafusion:parquet 144488146 142937864 1.01
tpcds_q28/datafusion:parquet 45465642 46507586 0.98
tpcds_q29/datafusion:parquet 65384754 64043639 1.02
tpcds_q30/datafusion:parquet 33915014 34681712 0.98
tpcds_q31/datafusion:parquet 65563675 66020283 0.99
tpcds_q32/datafusion:parquet 17805522 17634714 1.01
tpcds_q33/datafusion:parquet 27180447 26278420 1.03
tpcds_q34/datafusion:parquet 22883059 21772226 1.05
tpcds_q35/datafusion:parquet 68878017 66962264 1.03
tpcds_q36/datafusion:parquet 57401184 57003258 1.01
tpcds_q37/datafusion:parquet 18708789 19327673 0.97
tpcds_q38/datafusion:parquet 40907352 42232672 0.97
tpcds_q39/datafusion:parquet 73470239 74247660 0.99
tpcds_q40/datafusion:parquet 23897632 23507956 1.02
tpcds_q41/datafusion:parquet 13128677 13190225 1.00
tpcds_q42/datafusion:parquet 11506965 11785301 0.98
tpcds_q43/datafusion:parquet 16658529 16955072 0.98
tpcds_q44/datafusion:parquet 31936618 32382430 0.99
tpcds_q45/datafusion:parquet 29848426 28882242 1.03
tpcds_q46/datafusion:parquet 32052957 31583406 1.01
tpcds_q47/datafusion:parquet 125774129 126207134 1.00
tpcds_q48/datafusion:parquet 70078842 67073147 1.04
tpcds_q49/datafusion:parquet 54989685 54940844 1.00
tpcds_q50/datafusion:parquet 44966807 43795936 1.03
tpcds_q51/datafusion:parquet 85333764 84777923 1.01
tpcds_q52/datafusion:parquet 12831275 12737629 1.01
tpcds_q53/datafusion:parquet 17320652 18558216 0.93
tpcds_q54/datafusion:parquet 34045660 33240577 1.02
tpcds_q55/datafusion:parquet 11028983 11293990 0.98
tpcds_q56/datafusion:parquet 27248077 27463775 0.99
tpcds_q57/datafusion:parquet 100597358 100836030 1.00
tpcds_q58/datafusion:parquet 49670446 50019806 0.99
tpcds_q59/datafusion:parquet 56147778 57100099 0.98
tpcds_q60/datafusion:parquet 26902679 27232540 0.99
tpcds_q61/datafusion:parquet 42769025 43113579 0.99
tpcds_q62/datafusion:parquet 24781504 24945170 0.99
tpcds_q63/datafusion:parquet 17748258 17935112 0.99
tpcds_q64/datafusion:parquet 518485903 505454073 1.03
tpcds_q65/datafusion:parquet 37273967 37765689 0.99
tpcds_q66/datafusion:parquet 66891880 65288953 1.02
tpcds_q67/datafusion:parquet 141883757 147125608 0.96
tpcds_q68/datafusion:parquet 32369107 31539051 1.03
tpcds_q69/datafusion:parquet 62932600 63949845 0.98
tpcds_q70/datafusion:parquet 86863921 89725335 0.97
tpcds_q71/datafusion:parquet 21825832 21936917 0.99
tpcds_q72/datafusion:parquet 619170325 608267797 1.02
tpcds_q73/datafusion:parquet 20693896 20303484 1.02
tpcds_q74/datafusion:parquet 88621012 82813021 1.07
tpcds_q75/datafusion:parquet 99367602 99929664 0.99
tpcds_q76/datafusion:parquet 29506875 30201200 0.98
tpcds_q77/datafusion:parquet 38699265 37626525 1.03
tpcds_q78/datafusion:parquet 115289351 115223568 1.00
tpcds_q79/datafusion:parquet 28216861 26467348 1.07
tpcds_q80/datafusion:parquet 82756458 79194683 1.04
tpcds_q81/datafusion:parquet 31484375 31494156 1.00
tpcds_q82/datafusion:parquet 19128109 19125928 1.00
tpcds_q83/datafusion:parquet 37100727 36016892 1.03
tpcds_q84/datafusion:parquet 39572592 40564017 0.98
tpcds_q85/datafusion:parquet 152852130 146092861 1.05
tpcds_q86/datafusion:parquet 🚨 15469037 14032539 1.10
tpcds_q87/datafusion:parquet 42493747 42059501 1.01
tpcds_q88/datafusion:parquet 60554798 60403367 1.00
tpcds_q89/datafusion:parquet 21435026 21508544 1.00
tpcds_q90/datafusion:parquet 13785758 14179708 0.97
tpcds_q91/datafusion:parquet 59315013 56368031 1.05
tpcds_q92/datafusion:parquet 17006050 18220435 0.93
tpcds_q93/datafusion:parquet 32980328 32015312 1.03
tpcds_q94/datafusion:parquet 20307061 19247277 1.06
tpcds_q95/datafusion:parquet 60373099 59311943 1.02
tpcds_q96/datafusion:parquet 12356930 12098328 1.02
tpcds_q97/datafusion:parquet 31440624 28887357 1.09
tpcds_q98/datafusion:parquet 21672053 21382460 1.01
tpcds_q99/datafusion:parquet 28794042 30539587 0.94
duckdb / vortex-file-compressed (1.002x ➖, 0↑ 1↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚨 26835468 23927067 1.12
tpcds_q02/duckdb:vortex-file-compressed 33191032 33442779 0.99
tpcds_q03/duckdb:vortex-file-compressed 22328589 21596912 1.03
tpcds_q04/duckdb:vortex-file-compressed 91164747 89823889 1.01
tpcds_q05/duckdb:vortex-file-compressed 33439499 30869377 1.08
tpcds_q06/duckdb:vortex-file-compressed 32701729 33064421 0.99
tpcds_q07/duckdb:vortex-file-compressed 21671188 21457529 1.01
tpcds_q08/duckdb:vortex-file-compressed 26276493 26748613 0.98
tpcds_q09/duckdb:vortex-file-compressed 17175820 16049212 1.07
tpcds_q10/duckdb:vortex-file-compressed 37191105 37252933 1.00
tpcds_q11/duckdb:vortex-file-compressed 63807427 64360297 0.99
tpcds_q12/duckdb:vortex-file-compressed 15308191 15409095 0.99
tpcds_q13/duckdb:vortex-file-compressed 31940351 33079847 0.97
tpcds_q14/duckdb:vortex-file-compressed 93910567 96790861 0.97
tpcds_q15/duckdb:vortex-file-compressed 26996577 26365202 1.02
tpcds_q16/duckdb:vortex-file-compressed 25863672 24975938 1.04
tpcds_q17/duckdb:vortex-file-compressed 44275111 43310910 1.02
tpcds_q18/duckdb:vortex-file-compressed 36670616 36065589 1.02
tpcds_q19/duckdb:vortex-file-compressed 31733529 31943308 0.99
tpcds_q20/duckdb:vortex-file-compressed 17407512 17956811 0.97
tpcds_q21/duckdb:vortex-file-compressed 17307888 17572936 0.98
tpcds_q22/duckdb:vortex-file-compressed 81821565 75522374 1.08
tpcds_q23/duckdb:vortex-file-compressed 96271460 100706683 0.96
tpcds_q24/duckdb:vortex-file-compressed 47470289 47792181 0.99
tpcds_q25/duckdb:vortex-file-compressed 40346014 40814633 0.99
tpcds_q26/duckdb:vortex-file-compressed 20532076 21831577 0.94
tpcds_q27/duckdb:vortex-file-compressed 23575675 23946686 0.98
tpcds_q28/duckdb:vortex-file-compressed 12641743 12576385 1.01
tpcds_q29/duckdb:vortex-file-compressed 39073942 39495426 0.99
tpcds_q30/duckdb:vortex-file-compressed 24648902 24835695 0.99
tpcds_q31/duckdb:vortex-file-compressed 30921683 29970584 1.03
tpcds_q32/duckdb:vortex-file-compressed 13105070 13171070 0.99
tpcds_q33/duckdb:vortex-file-compressed 23520288 23472993 1.00
tpcds_q34/duckdb:vortex-file-compressed 24932310 25279060 0.99
tpcds_q35/duckdb:vortex-file-compressed 63788495 63304413 1.01
tpcds_q36/duckdb:vortex-file-compressed 24569724 24044776 1.02
tpcds_q37/duckdb:vortex-file-compressed 19606106 19279705 1.02
tpcds_q38/duckdb:vortex-file-compressed 38495341 36467815 1.06
tpcds_q39/duckdb:vortex-file-compressed 35594914 35138493 1.01
tpcds_q40/duckdb:vortex-file-compressed 20021598 20744346 0.97
tpcds_q41/duckdb:vortex-file-compressed 10150733 10118162 1.00
tpcds_q42/duckdb:vortex-file-compressed 13709705 13099669 1.05
tpcds_q43/duckdb:vortex-file-compressed 20808947 20864636 1.00
tpcds_q44/duckdb:vortex-file-compressed 21661237 20575655 1.05
tpcds_q45/duckdb:vortex-file-compressed 29507600 29201413 1.01
tpcds_q46/duckdb:vortex-file-compressed 31326332 30940478 1.01
tpcds_q47/duckdb:vortex-file-compressed 51532489 50657486 1.02
tpcds_q48/duckdb:vortex-file-compressed 27993983 28899371 0.97
tpcds_q49/duckdb:vortex-file-compressed 30891646 33378236 0.93
tpcds_q50/duckdb:vortex-file-compressed 26725450 26732235 1.00
tpcds_q51/duckdb:vortex-file-compressed 106522964 105353049 1.01
tpcds_q52/duckdb:vortex-file-compressed 13513030 13144112 1.03
tpcds_q53/duckdb:vortex-file-compressed 22531467 21911470 1.03
tpcds_q54/duckdb:vortex-file-compressed 28898613 28200562 1.02
tpcds_q55/duckdb:vortex-file-compressed 12259215 12638172 0.97
tpcds_q56/duckdb:vortex-file-compressed 24707115 24361661 1.01
tpcds_q57/duckdb:vortex-file-compressed 42378513 41332909 1.03
tpcds_q58/duckdb:vortex-file-compressed 28086961 30875435 0.91
tpcds_q59/duckdb:vortex-file-compressed 56009289 56864054 0.98
tpcds_q60/duckdb:vortex-file-compressed 25061455 25390735 0.99
tpcds_q61/duckdb:vortex-file-compressed 31395874 29264517 1.07
tpcds_q62/duckdb:vortex-file-compressed 15231617 15263921 1.00
tpcds_q63/duckdb:vortex-file-compressed 20766631 20550286 1.01
tpcds_q64/duckdb:vortex-file-compressed 93112779 91387161 1.02
tpcds_q65/duckdb:vortex-file-compressed 22278066 24608908 0.91
tpcds_q66/duckdb:vortex-file-compressed 29231186 30124107 0.97
tpcds_q67/duckdb:vortex-file-compressed 139266092 141451478 0.98
tpcds_q68/duckdb:vortex-file-compressed 31911685 31368124 1.02
tpcds_q69/duckdb:vortex-file-compressed 39720939 39488886 1.01
tpcds_q70/duckdb:vortex-file-compressed 36090882 37478087 0.96
tpcds_q71/duckdb:vortex-file-compressed 20654948 21085522 0.98
tpcds_q72/duckdb:vortex-file-compressed 168978315 166907998 1.01
tpcds_q73/duckdb:vortex-file-compressed 25048534 24806972 1.01
tpcds_q74/duckdb:vortex-file-compressed 41641009 43766272 0.95
tpcds_q75/duckdb:vortex-file-compressed 48754403 47971642 1.02
tpcds_q76/duckdb:vortex-file-compressed 20527395 21461754 0.96
tpcds_q77/duckdb:vortex-file-compressed 22733510 24627484 0.92
tpcds_q78/duckdb:vortex-file-compressed 78881010 76739679 1.03
tpcds_q79/duckdb:vortex-file-compressed 24978095 24146423 1.03
tpcds_q80/duckdb:vortex-file-compressed 47494326 47632093 1.00
tpcds_q81/duckdb:vortex-file-compressed 28969997 29028820 1.00
tpcds_q82/duckdb:vortex-file-compressed 45254471 46581209 0.97
tpcds_q83/duckdb:vortex-file-compressed 25401799 26993889 0.94
tpcds_q84/duckdb:vortex-file-compressed 16276641 16795310 0.97
tpcds_q85/duckdb:vortex-file-compressed 38748309 39221744 0.99
tpcds_q86/duckdb:vortex-file-compressed 16441485 15881408 1.04
tpcds_q87/duckdb:vortex-file-compressed 40070421 39519504 1.01
tpcds_q88/duckdb:vortex-file-compressed 52703728 51636140 1.02
tpcds_q89/duckdb:vortex-file-compressed 21868817 21701924 1.01
tpcds_q90/duckdb:vortex-file-compressed 10009640 9838094 1.02
tpcds_q91/duckdb:vortex-file-compressed 21533124 20848694 1.03
tpcds_q92/duckdb:vortex-file-compressed 19745598 19633473 1.01
tpcds_q93/duckdb:vortex-file-compressed 30268711 29711251 1.02
tpcds_q94/duckdb:vortex-file-compressed 21895883 21074438 1.04
tpcds_q95/duckdb:vortex-file-compressed 156944268 156115303 1.01
tpcds_q96/duckdb:vortex-file-compressed 12004895 11764360 1.02
tpcds_q97/duckdb:vortex-file-compressed 38438528 37551895 1.02
tpcds_q98/duckdb:vortex-file-compressed 18863105 18915515 1.00
tpcds_q99/duckdb:vortex-file-compressed 22677163 22821469 0.99
duckdb / vortex-compact (0.998x ➖, 2↑ 0↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 26059383 28660511 0.91
tpcds_q02/duckdb:vortex-compact 41733522 39003296 1.07
tpcds_q03/duckdb:vortex-compact 50002711 49039770 1.02
tpcds_q04/duckdb:vortex-compact 104483834 106259962 0.98
tpcds_q05/duckdb:vortex-compact 41651280 39100736 1.07
tpcds_q06/duckdb:vortex-compact 39638766 40867591 0.97
tpcds_q07/duckdb:vortex-compact 34370230 35128762 0.98
tpcds_q08/duckdb:vortex-compact 39214193 41290137 0.95
tpcds_q09/duckdb:vortex-compact 19595562 19198145 1.02
tpcds_q10/duckdb:vortex-compact 53131086 51687436 1.03
tpcds_q11/duckdb:vortex-compact 72896784 75484152 0.97
tpcds_q12/duckdb:vortex-compact 21954163 21359609 1.03
tpcds_q13/duckdb:vortex-compact 55038114 52630132 1.05
tpcds_q14/duckdb:vortex-compact 115483986 117539067 0.98
tpcds_q15/duckdb:vortex-compact 29726139 29516333 1.01
tpcds_q16/duckdb:vortex-compact 27667776 27788787 1.00
tpcds_q17/duckdb:vortex-compact 54847990 54652809 1.00
tpcds_q18/duckdb:vortex-compact 49922575 50624251 0.99
tpcds_q19/duckdb:vortex-compact 44568686 43971745 1.01
tpcds_q20/duckdb:vortex-compact 20422995 20382537 1.00
tpcds_q21/duckdb:vortex-compact 17510442 17434206 1.00
tpcds_q22/duckdb:vortex-compact 77714248 81448508 0.95
tpcds_q23/duckdb:vortex-compact 106972915 110604080 0.97
tpcds_q24/duckdb:vortex-compact 58408204 59043295 0.99
tpcds_q25/duckdb:vortex-compact 54634228 55702250 0.98
tpcds_q26/duckdb:vortex-compact 31054073 31557847 0.98
tpcds_q27/duckdb:vortex-compact 36853997 38394678 0.96
tpcds_q28/duckdb:vortex-compact 33915530 33828002 1.00
tpcds_q29/duckdb:vortex-compact 52331922 52316341 1.00
tpcds_q30/duckdb:vortex-compact 29784996 30705566 0.97
tpcds_q31/duckdb:vortex-compact 36034515 35501696 1.02
tpcds_q32/duckdb:vortex-compact 21021699 21198272 0.99
tpcds_q33/duckdb:vortex-compact 31817812 31536268 1.01
tpcds_q34/duckdb:vortex-compact 31012076 30226975 1.03
tpcds_q35/duckdb:vortex-compact 76071168 75730519 1.00
tpcds_q36/duckdb:vortex-compact 35733507 36051264 0.99
tpcds_q37/duckdb:vortex-compact 23120532 23286278 0.99
tpcds_q38/duckdb:vortex-compact 40495547 39972635 1.01
tpcds_q39/duckdb:vortex-compact 37722839 38263908 0.99
tpcds_q40/duckdb:vortex-compact 23991730 23818631 1.01
tpcds_q41/duckdb:vortex-compact 11765102 11460452 1.03
tpcds_q42/duckdb:vortex-compact 18285453 18597143 0.98
tpcds_q43/duckdb:vortex-compact 32800549 33328896 0.98
tpcds_q44/duckdb:vortex-compact 30256615 29181550 1.04
tpcds_q45/duckdb:vortex-compact 36471273 36389573 1.00
tpcds_q46/duckdb:vortex-compact 44245028 44869003 0.99
tpcds_q47/duckdb:vortex-compact 61799796 62954169 0.98
tpcds_q48/duckdb:vortex-compact 44888534 46389677 0.97
tpcds_q49/duckdb:vortex-compact 49564967 46189964 1.07
tpcds_q50/duckdb:vortex-compact 37211594 38014539 0.98
tpcds_q51/duckdb:vortex-compact 113101741 111774271 1.01
tpcds_q52/duckdb:vortex-compact 19834173 19974442 0.99
tpcds_q53/duckdb:vortex-compact 32676051 32312176 1.01
tpcds_q54/duckdb:vortex-compact 36533736 37647508 0.97
tpcds_q55/duckdb:vortex-compact 18954681 18962137 1.00
tpcds_q56/duckdb:vortex-compact 33473686 33664932 0.99
tpcds_q57/duckdb:vortex-compact 🚀 45001151 50400635 0.89
tpcds_q58/duckdb:vortex-compact 37336868 37073904 1.01
tpcds_q59/duckdb:vortex-compact 67114947 66417342 1.01
tpcds_q60/duckdb:vortex-compact 35670859 34800132 1.03
tpcds_q61/duckdb:vortex-compact 52979122 53256727 0.99
tpcds_q62/duckdb:vortex-compact 21823334 20288221 1.08
tpcds_q63/duckdb:vortex-compact 32097930 32922298 0.97
tpcds_q64/duckdb:vortex-compact 123197809 121951933 1.01
tpcds_q65/duckdb:vortex-compact 32383177 31041522 1.04
tpcds_q66/duckdb:vortex-compact 34734491 35489049 0.98
tpcds_q67/duckdb:vortex-compact 148593247 152175095 0.98
tpcds_q68/duckdb:vortex-compact 46383311 43806476 1.06
tpcds_q69/duckdb:vortex-compact 54151437 53953604 1.00
tpcds_q70/duckdb:vortex-compact 61725759 58539264 1.05
tpcds_q71/duckdb:vortex-compact 28522596 28546421 1.00
tpcds_q72/duckdb:vortex-compact 183556412 187156926 0.98
tpcds_q73/duckdb:vortex-compact 28433533 27492633 1.03
tpcds_q74/duckdb:vortex-compact 48684041 48293195 1.01
tpcds_q75/duckdb:vortex-compact 60769916 58937956 1.03
tpcds_q76/duckdb:vortex-compact 29006767 28239762 1.03
tpcds_q77/duckdb:vortex-compact 36691837 37883516 0.97
tpcds_q78/duckdb:vortex-compact 86417786 86388886 1.00
tpcds_q79/duckdb:vortex-compact 41484683 39189370 1.06
tpcds_q80/duckdb:vortex-compact 70109857 70476952 0.99
tpcds_q81/duckdb:vortex-compact 32885666 33036651 1.00
tpcds_q82/duckdb:vortex-compact 48678962 49177357 0.99
tpcds_q83/duckdb:vortex-compact 35590665 36166695 0.98
tpcds_q84/duckdb:vortex-compact 19687461 21734150 0.91
tpcds_q85/duckdb:vortex-compact 54730294 52015968 1.05
tpcds_q86/duckdb:vortex-compact 20730868 21622267 0.96
tpcds_q87/duckdb:vortex-compact 45447585 45013076 1.01
tpcds_q88/duckdb:vortex-compact 75302093 74754773 1.01
tpcds_q89/duckdb:vortex-compact 32533288 31995259 1.02
tpcds_q90/duckdb:vortex-compact 🚀 11136738 13373994 0.83
tpcds_q91/duckdb:vortex-compact 42514653 42827635 0.99
tpcds_q92/duckdb:vortex-compact 47158955 47095001 1.00
tpcds_q93/duckdb:vortex-compact 32680013 32279161 1.01
tpcds_q94/duckdb:vortex-compact 28283304 28504878 0.99
tpcds_q95/duckdb:vortex-compact 162405122 163984816 0.99
tpcds_q96/duckdb:vortex-compact 16302410 16820700 0.97
tpcds_q97/duckdb:vortex-compact 43663418 42058369 1.04
tpcds_q98/duckdb:vortex-compact 27578193 26758678 1.03
tpcds_q99/duckdb:vortex-compact 25835550 25027346 1.03
duckdb / parquet (1.003x ➖, 1↑ 2↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29267717 29214016 1.00
tpcds_q02/duckdb:parquet 24399203 23637258 1.03
tpcds_q03/duckdb:parquet 12676117 12716905 1.00
tpcds_q04/duckdb:parquet 168800589 167645297 1.01
tpcds_q05/duckdb:parquet 32297415 31960007 1.01
tpcds_q06/duckdb:parquet 34207579 33448871 1.02
tpcds_q07/duckdb:parquet 24288564 23920565 1.02
tpcds_q08/duckdb:parquet 29400175 29679311 0.99
tpcds_q09/duckdb:parquet 44837792 44677933 1.00
tpcds_q10/duckdb:parquet 38023317 37418755 1.02
tpcds_q11/duckdb:parquet 90478561 92218426 0.98
tpcds_q12/duckdb:parquet 16818068 17100543 0.98
tpcds_q13/duckdb:parquet 35275068 34858128 1.01
tpcds_q14/duckdb:parquet 101805661 101705183 1.00
tpcds_q15/duckdb:parquet 30427127 30871426 0.99
tpcds_q16/duckdb:parquet 22712718 22545162 1.01
tpcds_q17/duckdb:parquet 40499871 38433749 1.05
tpcds_q18/duckdb:parquet 48915281 48474547 1.01
tpcds_q19/duckdb:parquet 31543961 31771793 0.99
tpcds_q20/duckdb:parquet 18227391 18392425 0.99
tpcds_q21/duckdb:parquet 11945166 11675277 1.02
tpcds_q22/duckdb:parquet 72108894 69804180 1.03
tpcds_q23/duckdb:parquet 80085157 83352156 0.96
tpcds_q24/duckdb:parquet 46836236 47236264 0.99
tpcds_q25/duckdb:parquet 35493557 35711074 0.99
tpcds_q26/duckdb:parquet 38709636 39027685 0.99
tpcds_q27/duckdb:parquet 53332348 52436306 1.02
tpcds_q28/duckdb:parquet 42943302 42349728 1.01
tpcds_q29/duckdb:parquet 36993119 36545515 1.01
tpcds_q30/duckdb:parquet 37835255 37285658 1.01
tpcds_q31/duckdb:parquet 27110293 26674455 1.02
tpcds_q32/duckdb:parquet 12458996 12473243 1.00
tpcds_q33/duckdb:parquet 23054762 23496450 0.98
tpcds_q34/duckdb:parquet 🚨 24343289 22086854 1.10
tpcds_q35/duckdb:parquet 61706276 61711181 1.00
tpcds_q36/duckdb:parquet 22797001 22641737 1.01
tpcds_q37/duckdb:parquet 13825655 14218476 0.97
tpcds_q38/duckdb:parquet 36981049 36602811 1.01
tpcds_q39/duckdb:parquet 31759913 32827843 0.97
tpcds_q40/duckdb:parquet 19121985 19894343 0.96
tpcds_q41/duckdb:parquet 8769595 8950733 0.98
tpcds_q42/duckdb:parquet 12451936 12430093 1.00
tpcds_q43/duckdb:parquet 16997794 17732791 0.96
tpcds_q44/duckdb:parquet 25726222 27341269 0.94
tpcds_q45/duckdb:parquet 29532606 28528533 1.04
tpcds_q46/duckdb:parquet 47663803 47453261 1.00
tpcds_q47/duckdb:parquet 49359575 50374195 0.98
tpcds_q48/duckdb:parquet 32571933 32091845 1.01
tpcds_q49/duckdb:parquet 28923787 27607567 1.05
tpcds_q50/duckdb:parquet 26219762 26187660 1.00
tpcds_q51/duckdb:parquet 106940345 104991780 1.02
tpcds_q52/duckdb:parquet 13080011 12808255 1.02
tpcds_q53/duckdb:parquet 19328639 19558507 0.99
tpcds_q54/duckdb:parquet 29610437 27639543 1.07
tpcds_q55/duckdb:parquet 12900803 12800326 1.01
tpcds_q56/duckdb:parquet 24022624 23973692 1.00
tpcds_q57/duckdb:parquet 38226308 37932469 1.01
tpcds_q58/duckdb:parquet 26123476 26519196 0.99
tpcds_q59/duckdb:parquet 36381361 36726484 0.99
tpcds_q60/duckdb:parquet 25448017 24146702 1.05
tpcds_q61/duckdb:parquet 34381474 33471976 1.03
tpcds_q62/duckdb:parquet 12477273 12444789 1.00
tpcds_q63/duckdb:parquet 17359159 17698783 0.98
tpcds_q64/duckdb:parquet 79831077 76708907 1.04
tpcds_q65/duckdb:parquet 23257222 22877160 1.02
tpcds_q66/duckdb:parquet 🚨 32875207 28874108 1.14
tpcds_q67/duckdb:parquet 137852581 137620977 1.00
tpcds_q68/duckdb:parquet 41703511 38778107 1.08
tpcds_q69/duckdb:parquet 38419954 39048721 0.98
tpcds_q70/duckdb:parquet 22699665 21930586 1.04
tpcds_q71/duckdb:parquet 23088646 22962320 1.01
tpcds_q72/duckdb:parquet 168381018 167565034 1.00
tpcds_q73/duckdb:parquet 20931984 20237682 1.03
tpcds_q74/duckdb:parquet 125709809 128559270 0.98
tpcds_q75/duckdb:parquet 57116360 57483373 0.99
tpcds_q76/duckdb:parquet 21725512 21913321 0.99
tpcds_q77/duckdb:parquet 25274045 24847545 1.02
tpcds_q78/duckdb:parquet 77198670 76899843 1.00
tpcds_q79/duckdb:parquet 30141623 30261050 1.00
tpcds_q80/duckdb:parquet 43171488 46161947 0.94
tpcds_q81/duckdb:parquet 35319067 34971007 1.01
tpcds_q82/duckdb:parquet 16301067 16661985 0.98
tpcds_q83/duckdb:parquet 18455595 18207182 1.01
tpcds_q84/duckdb:parquet 20504787 21192412 0.97
tpcds_q85/duckdb:parquet 43129823 41834647 1.03
tpcds_q86/duckdb:parquet 13863216 13686746 1.01
tpcds_q87/duckdb:parquet 39337017 39148095 1.00
tpcds_q88/duckdb:parquet 53977237 54795742 0.99
tpcds_q89/duckdb:parquet 20983709 21639002 0.97
tpcds_q90/duckdb:parquet 8575735 8289031 1.03
tpcds_q91/duckdb:parquet 24610109 26082006 0.94
tpcds_q92/duckdb:parquet 13214787 13070565 1.01
tpcds_q93/duckdb:parquet 31812729 30904493 1.03
tpcds_q94/duckdb:parquet 17713160 18027947 0.98
tpcds_q95/duckdb:parquet 🚀 121370796 141288661 0.86
tpcds_q96/duckdb:parquet 10740559 10914696 0.98
tpcds_q97/duckdb:parquet 38284409 40098840 0.95
tpcds_q98/duckdb:parquet 25019703 23971821 1.04
tpcds_q99/duckdb:parquet 20448902 20362546 1.00
duckdb / duckdb (1.002x ➖, 1↑ 1↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 21939700 22614155 0.97
tpcds_q02/duckdb:duckdb 19179622 19595458 0.98
tpcds_q03/duckdb:duckdb 10303905 10283730 1.00
tpcds_q04/duckdb:duckdb 177687526 175663016 1.01
tpcds_q05/duckdb:duckdb 22544730 20923675 1.08
tpcds_q06/duckdb:duckdb 28174615 27808174 1.01
tpcds_q07/duckdb:duckdb 41121786 40410351 1.02
tpcds_q08/duckdb:duckdb 120582815 120183978 1.00
tpcds_q09/duckdb:duckdb 20531595 20959386 0.98
tpcds_q10/duckdb:duckdb 27974859 28569658 0.98
tpcds_q11/duckdb:duckdb 95592759 92512122 1.03
tpcds_q12/duckdb:duckdb 13970921 14608887 0.96
tpcds_q13/duckdb:duckdb 26304027 26421997 1.00
tpcds_q14/duckdb:duckdb 94014314 92126819 1.02
tpcds_q15/duckdb:duckdb 24756522 24688452 1.00
tpcds_q16/duckdb:duckdb 19360780 19059981 1.02
tpcds_q17/duckdb:duckdb 24806902 24926514 1.00
tpcds_q18/duckdb:duckdb 48124461 46292006 1.04
tpcds_q19/duckdb:duckdb 19257721 20006493 0.96
tpcds_q20/duckdb:duckdb 13891350 14312266 0.97
tpcds_q21/duckdb:duckdb 7889456 7432412 1.06
tpcds_q22/duckdb:duckdb 61330805 63891208 0.96
tpcds_q23/duckdb:duckdb 78546486 77557038 1.01
tpcds_q24/duckdb:duckdb 25824616 25549442 1.01
tpcds_q25/duckdb:duckdb 18775249 18356302 1.02
tpcds_q26/duckdb:duckdb 28178372 28383453 0.99
tpcds_q27/duckdb:duckdb 41535572 41415492 1.00
tpcds_q28/duckdb:duckdb 26284392 26248815 1.00
tpcds_q29/duckdb:duckdb 23709938 23848624 0.99
tpcds_q30/duckdb:duckdb 31112505 28629558 1.09
tpcds_q31/duckdb:duckdb 51286118 51512684 1.00
tpcds_q32/duckdb:duckdb 8730525 8081386 1.08
tpcds_q33/duckdb:duckdb 16632295 16911673 0.98
tpcds_q34/duckdb:duckdb 18588951 18198522 1.02
tpcds_q35/duckdb:duckdb 37195908 38062717 0.98
tpcds_q36/duckdb:duckdb 71202994 70808751 1.01
tpcds_q37/duckdb:duckdb 8846069 8405707 1.05
tpcds_q38/duckdb:duckdb 35862065 32675666 1.10
tpcds_q39/duckdb:duckdb 28126231 28635533 0.98
tpcds_q40/duckdb:duckdb 14682222 14401212 1.02
tpcds_q41/duckdb:duckdb 9232462 9497227 0.97
tpcds_q42/duckdb:duckdb 9410245 9525831 0.99
tpcds_q43/duckdb:duckdb 14975894 15187492 0.99
tpcds_q44/duckdb:duckdb 15789723 15672310 1.01
tpcds_q45/duckdb:duckdb 18614009 18465208 1.01
tpcds_q46/duckdb:duckdb 38794824 38716258 1.00
tpcds_q47/duckdb:duckdb 47569891 45674161 1.04
tpcds_q48/duckdb:duckdb 24977699 24842828 1.01
tpcds_q49/duckdb:duckdb 21154273 21529562 0.98
tpcds_q50/duckdb:duckdb 16174488 16147774 1.00
tpcds_q51/duckdb:duckdb 99410301 101738192 0.98
tpcds_q52/duckdb:duckdb 🚀 9362591 10990915 0.85
tpcds_q53/duckdb:duckdb 17850808 18025064 0.99
tpcds_q54/duckdb:duckdb 19155576 19005429 1.01
tpcds_q55/duckdb:duckdb 9844562 9813068 1.00
tpcds_q56/duckdb:duckdb 16661935 17043383 0.98
tpcds_q57/duckdb:duckdb 36401034 36231980 1.00
tpcds_q58/duckdb:duckdb 18070040 17564999 1.03
tpcds_q59/duckdb:duckdb 36793629 36935386 1.00
tpcds_q60/duckdb:duckdb 19345818 19148375 1.01
tpcds_q61/duckdb:duckdb 17193727 17280084 1.00
tpcds_q62/duckdb:duckdb 9827647 9796405 1.00
tpcds_q63/duckdb:duckdb 16371535 16529934 0.99
tpcds_q64/duckdb:duckdb 57409820 57369139 1.00
tpcds_q65/duckdb:duckdb 36029989 36018960 1.00
tpcds_q66/duckdb:duckdb 26488669 26348002 1.01
tpcds_q67/duckdb:duckdb 128726761 136843082 0.94
tpcds_q68/duckdb:duckdb 27757594 26896169 1.03
tpcds_q69/duckdb:duckdb 29462500 28768970 1.02
tpcds_q70/duckdb:duckdb 16814925 16559599 1.02
tpcds_q71/duckdb:duckdb 15760434 16547341 0.95
tpcds_q72/duckdb:duckdb 45663097 46836417 0.97
tpcds_q73/duckdb:duckdb 14268688 13738704 1.04
tpcds_q74/duckdb:duckdb 143264116 143652629 1.00
tpcds_q75/duckdb:duckdb 46271408 46202547 1.00
tpcds_q76/duckdb:duckdb 14506779 14676070 0.99
tpcds_q77/duckdb:duckdb 16130048 16076624 1.00
tpcds_q78/duckdb:duckdb 66857471 65721416 1.02
tpcds_q79/duckdb:duckdb 20998614 21067505 1.00
tpcds_q80/duckdb:duckdb 30559153 33199968 0.92
tpcds_q81/duckdb:duckdb 39817696 39021654 1.02
tpcds_q82/duckdb:duckdb 10547546 10883621 0.97
tpcds_q83/duckdb:duckdb 10781030 10725252 1.01
tpcds_q84/duckdb:duckdb 14937432 14383429 1.04
tpcds_q85/duckdb:duckdb 25891692 26002452 1.00
tpcds_q86/duckdb:duckdb 12158443 11968652 1.02
tpcds_q87/duckdb:duckdb 35833850 35254147 1.02
tpcds_q88/duckdb:duckdb 30376373 30674579 0.99
tpcds_q89/duckdb:duckdb 21248986 23175931 0.92
tpcds_q90/duckdb:duckdb 6109513 6131698 1.00
tpcds_q91/duckdb:duckdb 14710316 15337699 0.96
tpcds_q92/duckdb:duckdb 9657682 9832323 0.98
tpcds_q93/duckdb:duckdb 23362260 23667197 0.99
tpcds_q94/duckdb:duckdb 14338977 14265893 1.01
tpcds_q95/duckdb:duckdb 🚨 131895437 108925630 1.21
tpcds_q96/duckdb:duckdb 5554283 5906253 0.94
tpcds_q97/duckdb:duckdb 31985636 31816499 1.01
tpcds_q98/duckdb:duckdb 21973077 20333184 1.08
tpcds_q99/duckdb:duckdb 16767695 16635921 1.01

File Size Changes (5 files changed, -0.0% overall, 2↑ 3↓)
File Scale Format Base HEAD Change %
item.vortex 1.0 vortex-compact 994.34 KB 994.61 KB +272 B +0.0%
catalog_page.vortex 1.0 vortex-file-compressed 571.25 KB 571.31 KB +64 B +0.0%
item.vortex 1.0 vortex-file-compressed 1.66 MB 1.66 MB 208 B -0.0%
customer_address.vortex 1.0 vortex-file-compressed 825.51 KB 824.55 KB 976 B -0.1%
customer.vortex 1.0 vortex-file-compressed 4.27 MB 4.17 MB 93.23 KB -2.1%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (+0.0%)
  • vortex-file-compressed: 271.85 MB → 271.76 MB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +2.8% +0.4% +2.4% +21.3% ➖ noise
1 datafusion:vortex-file-compressed +2.7% +0.4% +2.3% +26.9% ➖ noise
1 duckdb:duckdb -3.0% +0.4% -3.4% +21.6% ➖ noise
1 duckdb:vortex-compact -9.1% +0.4% -9.5% +22.2% ➖ noise
1 duckdb:vortex-file-compressed +12.2% +0.4% +11.7% +31.2% ➖ noise
2 datafusion:vortex-compact -0.4% -2.6% +2.3% +10.4% ➖ noise
2 datafusion:vortex-file-compressed -4.8% -2.6% -2.3% +10.0% ➖ noise
2 duckdb:duckdb -2.1% -2.6% +0.5% +10.1% ➖ noise
2 duckdb:vortex-compact +7.0% -2.6% +9.9% +21.0% ➖ noise
2 duckdb:vortex-file-compressed -0.8% -2.6% +1.9% +23.0% ➖ noise
3 datafusion:vortex-compact -6.8% -1.3% -5.6% +12.7% ➖ noise
3 datafusion:vortex-file-compressed -3.4% -1.3% -2.1% +10.0% ➖ noise
3 duckdb:duckdb +0.2% -1.3% +1.5% +10.0% ➖ noise
3 duckdb:vortex-compact +2.0% -1.3% +3.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +3.4% -1.3% +4.8% +10.0% ➖ noise
4 datafusion:vortex-compact +0.0% -0.4% +0.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -3.9% -0.4% -3.6% +10.0% ➖ noise
4 duckdb:duckdb +1.2% -0.4% +1.6% +10.0% ➖ noise
4 duckdb:vortex-compact -1.7% -0.4% -1.3% +10.9% ➖ noise
4 duckdb:vortex-file-compressed +1.5% -0.4% +1.9% +14.9% ➖ noise
5 datafusion:vortex-compact -1.0% -0.9% -0.2% +10.1% ➖ noise
5 datafusion:vortex-file-compressed -3.6% -0.9% -2.7% +20.9% ➖ noise
5 duckdb:duckdb +7.7% -0.9% +8.7% +13.7% ➖ noise
5 duckdb:vortex-compact +6.5% -0.9% +7.5% +13.0% ➖ noise
5 duckdb:vortex-file-compressed +8.3% -0.9% +9.3% +13.5% ➖ noise
6 datafusion:vortex-compact +1.1% +1.8% -0.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.9% +1.8% -2.6% +13.9% ➖ noise
6 duckdb:duckdb +1.3% +1.8% -0.5% +10.0% ➖ noise
6 duckdb:vortex-compact -3.0% +1.8% -4.7% +19.3% ➖ noise
6 duckdb:vortex-file-compressed -1.1% +1.8% -2.8% +10.0% ➖ noise
7 datafusion:vortex-compact -2.9% +2.5% -5.3% +29.5% ➖ noise
7 datafusion:vortex-file-compressed +1.1% +2.5% -1.3% +10.0% ➖ noise
7 duckdb:duckdb +1.8% +2.5% -0.7% +10.0% ➖ noise
7 duckdb:vortex-compact -2.2% +2.5% -4.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.0% +2.5% -1.5% +10.0% ➖ noise
8 datafusion:vortex-compact -2.1% -3.0% +1.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +1.4% -3.0% +4.6% +10.0% ➖ noise
8 duckdb:duckdb +0.3% -3.0% +3.5% +10.0% ➖ noise
8 duckdb:vortex-compact -5.0% -3.0% -2.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.8% -3.0% +1.3% +28.8% ➖ noise
9 datafusion:vortex-compact -1.2% +4.4% -5.4% +12.7% ➖ noise
9 datafusion:vortex-file-compressed -1.1% +4.4% -5.3% +11.3% ➖ noise
9 duckdb:duckdb -2.0% +4.4% -6.2% +10.0% ➖ noise
9 duckdb:vortex-compact +2.1% +4.4% -2.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +7.0% +4.4% +2.5% +14.8% ➖ noise
10 datafusion:vortex-compact -3.3% +2.3% -5.5% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +4.7% +2.3% +2.3% +12.2% ➖ noise
10 duckdb:duckdb -2.1% +2.3% -4.3% +10.7% ➖ noise
10 duckdb:vortex-compact +2.8% +2.3% +0.5% +15.4% ➖ noise
10 duckdb:vortex-file-compressed -0.2% +2.3% -2.4% +10.0% ➖ noise
11 datafusion:vortex-compact +1.6% -3.8% +5.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -5.5% -3.8% -1.8% +10.1% ➖ noise
11 duckdb:duckdb +3.3% -3.8% +7.4% +10.4% ➖ noise
11 duckdb:vortex-compact -3.4% -3.8% +0.4% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.9% -3.8% +3.1% +10.0% ➖ noise
12 datafusion:vortex-compact -3.8% -0.8% -3.0% +14.2% ➖ noise
12 datafusion:vortex-file-compressed +3.4% -0.8% +4.2% +12.4% ➖ noise
12 duckdb:duckdb -4.4% -0.8% -3.6% +10.0% ➖ noise
12 duckdb:vortex-compact +2.8% -0.8% +3.6% +10.1% ➖ noise
12 duckdb:vortex-file-compressed -0.7% -0.8% +0.2% +10.0% ➖ noise
13 datafusion:vortex-compact -18.3% +0.1% -18.3% +21.9% ✅ faster
13 datafusion:vortex-file-compressed +3.4% +0.1% +3.3% +12.1% ➖ noise
13 duckdb:duckdb -0.4% +0.1% -0.5% +12.2% ➖ noise
13 duckdb:vortex-compact +4.6% +0.1% +4.5% +18.1% ➖ noise
13 duckdb:vortex-file-compressed -3.4% +0.1% -3.5% +23.1% ➖ noise
14 datafusion:vortex-compact -3.8% -0.4% -3.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -3.0% -0.4% -2.6% +10.0% ➖ noise
14 duckdb:duckdb +2.0% -0.4% +2.4% +10.0% ➖ noise
14 duckdb:vortex-compact -1.7% -0.4% -1.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -3.0% -0.4% -2.6% +11.7% ➖ noise
15 datafusion:vortex-compact -12.9% -3.0% -10.3% +14.1% ➖ noise
15 datafusion:vortex-file-compressed -1.5% -3.0% +1.6% +29.0% ➖ noise
15 duckdb:duckdb +0.3% -3.0% +3.4% +10.0% ➖ noise
15 duckdb:vortex-compact +0.7% -3.0% +3.8% +10.5% ➖ noise
15 duckdb:vortex-file-compressed +2.4% -3.0% +5.6% +21.3% ➖ noise
16 datafusion:vortex-compact -1.1% -5.3% +4.4% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.2% -5.3% +5.8% +26.8% ➖ noise
16 duckdb:duckdb +1.6% -5.3% +7.2% +10.0% ➖ noise
16 duckdb:vortex-compact -0.4% -5.3% +5.1% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +3.6% -5.3% +9.3% +12.7% ➖ noise
17 datafusion:vortex-compact +3.3% +1.5% +1.7% +20.1% ➖ noise
17 datafusion:vortex-file-compressed -2.3% +1.5% -3.8% +10.0% ➖ noise
17 duckdb:duckdb -0.5% +1.5% -2.0% +11.0% ➖ noise
17 duckdb:vortex-compact +0.4% +1.5% -1.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +2.2% +1.5% +0.7% +10.4% ➖ noise
18 datafusion:vortex-compact -3.8% -0.6% -3.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -1.8% -0.6% -1.2% +10.8% ➖ noise
18 duckdb:duckdb +4.0% -0.6% +4.6% +10.0% ➖ noise
18 duckdb:vortex-compact -1.4% -0.6% -0.8% +10.8% ➖ noise
18 duckdb:vortex-file-compressed +1.7% -0.6% +2.3% +10.0% ➖ noise
19 datafusion:vortex-compact -1.7% -0.9% -0.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +1.5% -0.9% +2.4% +20.8% ➖ noise
19 duckdb:duckdb -3.7% -0.9% -2.8% +10.0% ➖ noise
19 duckdb:vortex-compact +1.4% -0.9% +2.3% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.7% -0.9% +0.3% +10.0% ➖ noise
20 datafusion:vortex-compact -3.4% +4.7% -7.7% +27.9% ➖ noise
20 datafusion:vortex-file-compressed -5.1% +4.7% -9.3% +25.3% ➖ noise
20 duckdb:duckdb -2.9% +4.7% -7.3% +10.0% ➖ noise
20 duckdb:vortex-compact +0.2% +4.7% -4.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -3.1% +4.7% -7.4% +11.4% ➖ noise
21 datafusion:vortex-compact +1.2% +1.3% -0.1% +21.4% ➖ noise
21 datafusion:vortex-file-compressed -0.1% +1.3% -1.3% +17.1% ➖ noise
21 duckdb:duckdb +6.1% +1.3% +4.8% +16.4% ➖ noise
21 duckdb:vortex-compact +0.4% +1.3% -0.8% +17.4% ➖ noise
21 duckdb:vortex-file-compressed -1.5% +1.3% -2.7% +17.4% ➖ noise
22 datafusion:vortex-compact -1.8% -2.2% +0.4% +33.4% ➖ noise
22 datafusion:vortex-file-compressed +13.1% -2.2% +15.6% +17.9% ➖ noise
22 duckdb:duckdb -4.0% -2.2% -1.9% +12.7% ➖ noise
22 duckdb:vortex-compact -4.6% -2.2% -2.5% +12.1% ➖ noise
22 duckdb:vortex-file-compressed +8.3% -2.2% +10.7% +14.7% ➖ noise
23 datafusion:vortex-compact -3.0% -2.8% -0.3% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -4.9% -2.8% -2.2% +10.1% ➖ noise
23 duckdb:duckdb +1.3% -2.8% +4.1% +10.0% ➖ noise
23 duckdb:vortex-compact -3.3% -2.8% -0.5% +13.7% ➖ noise
23 duckdb:vortex-file-compressed -4.4% -2.8% -1.7% +12.1% ➖ noise
24 datafusion:vortex-compact +0.8% -1.0% +1.8% +16.1% ➖ noise
24 datafusion:vortex-file-compressed +1.0% -1.0% +1.9% +16.3% ➖ noise
24 duckdb:duckdb +1.1% -1.0% +2.0% +10.0% ➖ noise
24 duckdb:vortex-compact -1.1% -1.0% -0.1% +13.3% ➖ noise
24 duckdb:vortex-file-compressed -0.7% -1.0% +0.3% +10.0% ➖ noise
25 datafusion:vortex-compact +2.7% -1.0% +3.8% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +1.2% -1.0% +2.3% +10.0% ➖ noise
25 duckdb:duckdb +2.3% -1.0% +3.4% +10.0% ➖ noise
25 duckdb:vortex-compact -1.9% -1.0% -0.9% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -1.1% -1.0% -0.1% +10.0% ➖ noise
26 datafusion:vortex-compact -1.5% -1.6% +0.1% +11.9% ➖ noise
26 datafusion:vortex-file-compressed -1.8% -1.6% -0.2% +10.0% ➖ noise
26 duckdb:duckdb -0.7% -1.6% +0.9% +10.0% ➖ noise
26 duckdb:vortex-compact -1.6% -1.6% -0.0% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -6.0% -1.6% -4.5% +32.4% ➖ noise
27 datafusion:vortex-compact +3.9% +1.4% +2.5% +11.6% ➖ noise
27 datafusion:vortex-file-compressed -1.7% +1.4% -3.1% +15.7% ➖ noise
27 duckdb:duckdb +0.3% +1.4% -1.1% +10.0% ➖ noise
27 duckdb:vortex-compact -4.0% +1.4% -5.3% +12.7% ➖ noise
27 duckdb:vortex-file-compressed -1.5% +1.4% -2.9% +10.0% ➖ noise
28 datafusion:vortex-compact +1.9% -0.4% +2.3% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -4.6% -0.4% -4.1% +10.0% ➖ noise
28 duckdb:duckdb +0.1% -0.4% +0.6% +10.0% ➖ noise
28 duckdb:vortex-compact +0.3% -0.4% +0.7% +31.7% ➖ noise
28 duckdb:vortex-file-compressed +0.5% -0.4% +1.0% +10.1% ➖ noise
29 datafusion:vortex-compact +0.2% +1.7% -1.5% +17.9% ➖ noise
29 datafusion:vortex-file-compressed +1.0% +1.7% -0.6% +11.2% ➖ noise
29 duckdb:duckdb -0.6% +1.7% -2.2% +13.5% ➖ noise
29 duckdb:vortex-compact +0.0% +1.7% -1.6% +12.8% ➖ noise
29 duckdb:vortex-file-compressed -1.1% +1.7% -2.7% +11.3% ➖ noise
30 datafusion:vortex-compact +3.8% -0.4% +4.2% +10.0% ➖ noise
30 datafusion:vortex-file-compressed +1.1% -0.4% +1.5% +10.4% ➖ noise
30 duckdb:duckdb +8.7% -0.4% +9.1% +10.0% ➖ noise
30 duckdb:vortex-compact -3.0% -0.4% -2.6% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -0.8% -0.4% -0.4% +10.0% ➖ noise
31 datafusion:vortex-compact -4.1% +0.5% -4.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -4.0% +0.5% -4.5% +17.1% ➖ noise
31 duckdb:duckdb -0.4% +0.5% -0.9% +10.0% ➖ noise
31 duckdb:vortex-compact +1.5% +0.5% +1.0% +27.1% ➖ noise
31 duckdb:vortex-file-compressed +3.2% +0.5% +2.7% +24.1% ➖ noise
32 datafusion:vortex-compact -3.0% +0.4% -3.4% +21.0% ➖ noise
32 datafusion:vortex-file-compressed -2.8% +0.4% -3.2% +10.0% ➖ noise
32 duckdb:duckdb +8.0% +0.4% +7.6% +10.4% ➖ noise
32 duckdb:vortex-compact -0.8% +0.4% -1.3% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -0.5% +0.4% -0.9% +10.0% ➖ noise
33 datafusion:vortex-compact +1.5% +0.7% +0.8% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -0.7% +0.7% -1.5% +10.0% ➖ noise
33 duckdb:duckdb -1.7% +0.7% -2.4% +10.0% ➖ noise
33 duckdb:vortex-compact +0.9% +0.7% +0.2% +11.2% ➖ noise
33 duckdb:vortex-file-compressed +0.2% +0.7% -0.5% +10.0% ➖ noise
34 datafusion:vortex-compact -2.8% +7.6% -9.7% +13.4% ➖ noise
34 datafusion:vortex-file-compressed +2.7% +7.6% -4.6% +12.2% ➖ noise
34 duckdb:duckdb +2.1% +7.6% -5.1% +11.2% ➖ noise
34 duckdb:vortex-compact +2.6% +7.6% -4.7% +15.8% ➖ noise
34 duckdb:vortex-file-compressed -1.4% +7.6% -8.4% +14.8% ➖ noise
35 datafusion:vortex-compact -2.0% +1.4% -3.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -4.1% +1.4% -5.4% +10.0% ➖ noise
35 duckdb:duckdb -2.3% +1.4% -3.6% +13.7% ➖ noise
35 duckdb:vortex-compact +0.4% +1.4% -1.0% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.8% +1.4% -0.6% +10.0% ➖ noise
36 datafusion:vortex-compact -1.5% +0.7% -2.2% +17.1% ➖ noise
36 datafusion:vortex-file-compressed +4.9% +0.7% +4.2% +12.1% ➖ noise
36 duckdb:duckdb +0.6% +0.7% -0.1% +10.0% ➖ noise
36 duckdb:vortex-compact -0.9% +0.7% -1.6% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +2.2% +0.7% +1.5% +10.0% ➖ noise
37 datafusion:vortex-compact +0.3% -3.0% +3.3% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +0.5% -3.0% +3.6% +10.9% ➖ noise
37 duckdb:duckdb +5.2% -3.0% +8.5% +10.0% ➖ noise
37 duckdb:vortex-compact -0.7% -3.0% +2.3% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +1.7% -3.0% +4.8% +10.0% ➖ noise
38 datafusion:vortex-compact -7.6% -1.1% -6.6% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -2.1% -1.1% -1.0% +10.0% ➖ noise
38 duckdb:duckdb +9.8% -1.1% +10.9% +17.4% ➖ noise
38 duckdb:vortex-compact +1.3% -1.1% +2.4% +24.2% ➖ noise
38 duckdb:vortex-file-compressed +5.6% -1.1% +6.7% +10.5% ➖ noise
39 datafusion:vortex-compact -1.7% -2.2% +0.5% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +3.5% -2.2% +5.8% +10.0% ➖ noise
39 duckdb:duckdb -1.8% -2.2% +0.4% +17.9% ➖ noise
39 duckdb:vortex-compact -1.4% -2.2% +0.8% +18.1% ➖ noise
39 duckdb:vortex-file-compressed +1.3% -2.2% +3.5% +15.5% ➖ noise
40 datafusion:vortex-compact +0.4% -1.2% +1.5% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -2.7% -1.2% -1.6% +10.0% ➖ noise
40 duckdb:duckdb +2.0% -1.2% +3.1% +10.0% ➖ noise
40 duckdb:vortex-compact +0.7% -1.2% +1.9% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -3.5% -1.2% -2.4% +20.5% ➖ noise
41 datafusion:vortex-compact +3.7% -1.2% +5.0% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +4.9% -1.2% +6.2% +10.0% ➖ noise
41 duckdb:duckdb -2.8% -1.2% -1.6% +10.0% ➖ noise
41 duckdb:vortex-compact +2.7% -1.2% +4.0% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +0.3% -1.2% +1.6% +10.0% ➖ noise
42 datafusion:vortex-compact -2.6% -1.1% -1.5% +15.1% ➖ noise
42 datafusion:vortex-file-compressed -7.0% -1.1% -5.9% +11.5% ➖ noise
42 duckdb:duckdb -1.2% -1.1% -0.1% +15.1% ➖ noise
42 duckdb:vortex-compact -1.7% -1.1% -0.6% +10.6% ➖ noise
42 duckdb:vortex-file-compressed +4.7% -1.1% +5.8% +14.6% ➖ noise
43 datafusion:vortex-compact +2.9% -3.0% +6.0% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -3.9% -3.0% -0.9% +10.0% ➖ noise
43 duckdb:duckdb -1.4% -3.0% +1.6% +10.0% ➖ noise
43 duckdb:vortex-compact -1.6% -3.0% +1.4% +30.4% ➖ noise
43 duckdb:vortex-file-compressed -0.3% -3.0% +2.8% +15.7% ➖ noise
44 datafusion:vortex-compact -0.2% -3.7% +3.6% +11.4% ➖ noise
44 datafusion:vortex-file-compressed +1.0% -3.7% +4.8% +10.0% ➖ noise
44 duckdb:duckdb +0.7% -3.7% +4.6% +10.0% ➖ noise
44 duckdb:vortex-compact +3.7% -3.7% +7.6% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +5.3% -3.7% +9.3% +10.0% ➖ noise
45 datafusion:vortex-compact +2.8% +3.4% -0.7% +10.2% ➖ noise
45 datafusion:vortex-file-compressed -4.1% +3.4% -7.3% +10.0% ➖ noise
45 duckdb:duckdb +0.8% +3.4% -2.5% +10.0% ➖ noise
45 duckdb:vortex-compact +0.2% +3.4% -3.1% +10.8% ➖ noise
45 duckdb:vortex-file-compressed +1.0% +3.4% -2.3% +13.6% ➖ noise
46 datafusion:vortex-compact -1.7% +1.0% -2.7% +14.6% ➖ noise
46 datafusion:vortex-file-compressed +1.4% +1.0% +0.5% +10.0% ➖ noise
46 duckdb:duckdb +0.2% +1.0% -0.8% +10.0% ➖ noise
46 duckdb:vortex-compact -1.4% +1.0% -2.3% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +1.2% +1.0% +0.3% +24.4% ➖ noise
47 datafusion:vortex-compact -0.9% -1.2% +0.3% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -0.5% -1.2% +0.7% +10.0% ➖ noise
47 duckdb:duckdb +4.2% -1.2% +5.4% +10.0% ➖ noise
47 duckdb:vortex-compact -1.8% -1.2% -0.7% +12.0% ➖ noise
47 duckdb:vortex-file-compressed +1.7% -1.2% +2.9% +10.0% ➖ noise
48 datafusion:vortex-compact +3.6% +3.0% +0.6% +13.7% ➖ noise
48 datafusion:vortex-file-compressed +0.4% +3.0% -2.5% +10.0% ➖ noise
48 duckdb:duckdb +0.5% +3.0% -2.4% +10.0% ➖ noise
48 duckdb:vortex-compact -3.2% +3.0% -6.0% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -3.1% +3.0% -5.9% +10.1% ➖ noise
49 datafusion:vortex-compact +1.3% +2.4% -1.1% +12.5% ➖ noise
49 datafusion:vortex-file-compressed -1.1% +2.4% -3.4% +10.0% ➖ noise
49 duckdb:duckdb -1.7% +2.4% -4.0% +10.0% ➖ noise
49 duckdb:vortex-compact +7.3% +2.4% +4.8% +24.7% ➖ noise
49 duckdb:vortex-file-compressed -7.4% +2.4% -9.6% +29.7% ➖ noise
50 datafusion:vortex-compact +4.7% +1.4% +3.3% +13.8% ➖ noise
50 datafusion:vortex-file-compressed -0.7% +1.4% -2.1% +10.0% ➖ noise
50 duckdb:duckdb +0.2% +1.4% -1.2% +10.0% ➖ noise
50 duckdb:vortex-compact -2.1% +1.4% -3.5% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -0.0% +1.4% -1.4% +10.0% ➖ noise
51 datafusion:vortex-compact -0.5% +1.3% -1.8% +10.5% ➖ noise
51 datafusion:vortex-file-compressed +1.6% +1.3% +0.4% +11.4% ➖ noise
51 duckdb:duckdb -2.3% +1.3% -3.5% +17.3% ➖ noise
51 duckdb:vortex-compact +1.2% +1.3% -0.1% +22.4% ➖ noise
51 duckdb:vortex-file-compressed +1.1% +1.3% -0.1% +20.2% ➖ noise
52 datafusion:vortex-compact +2.4% +1.4% +0.9% +12.2% ➖ noise
52 datafusion:vortex-file-compressed -5.8% +1.4% -7.2% +13.4% ➖ noise
52 duckdb:duckdb -14.8% +1.4% -16.0% +19.0% ✅ faster
52 duckdb:vortex-compact -0.7% +1.4% -2.1% +12.3% ➖ noise
52 duckdb:vortex-file-compressed +2.8% +1.4% +1.4% +51.6% ➖ noise
53 datafusion:vortex-compact -0.6% -4.0% +3.5% +18.8% ➖ noise
53 datafusion:vortex-file-compressed +4.3% -4.0% +8.6% +16.1% ➖ noise
53 duckdb:duckdb -1.0% -4.0% +3.1% +10.0% ➖ noise
53 duckdb:vortex-compact +1.1% -4.0% +5.3% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +2.8% -4.0% +7.1% +10.0% ➖ noise
54 datafusion:vortex-compact +0.5% +4.7% -4.0% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -4.7% +4.7% -9.0% +17.0% ➖ noise
54 duckdb:duckdb +0.8% +4.7% -3.8% +10.0% ➖ noise
54 duckdb:vortex-compact -3.0% +4.7% -7.4% +12.9% ➖ noise
54 duckdb:vortex-file-compressed +2.5% +4.7% -2.2% +10.0% ➖ noise
55 datafusion:vortex-compact -0.3% -0.8% +0.5% +10.0% ➖ noise
55 datafusion:vortex-file-compressed -7.5% -0.8% -6.8% +10.0% ➖ noise
55 duckdb:duckdb +0.3% -0.8% +1.1% +17.5% ➖ noise
55 duckdb:vortex-compact -0.0% -0.8% +0.8% +10.0% ➖ noise
55 duckdb:vortex-file-compressed -3.0% -0.8% -2.2% +16.0% ➖ noise
56 datafusion:vortex-compact -1.9% -0.3% -1.6% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -0.9% -0.3% -0.7% +10.0% ➖ noise
56 duckdb:duckdb -2.2% -0.3% -2.0% +10.0% ➖ noise
56 duckdb:vortex-compact -0.6% -0.3% -0.3% +25.7% ➖ noise
56 duckdb:vortex-file-compressed +1.4% -0.3% +1.7% +10.0% ➖ noise
57 datafusion:vortex-compact -3.4% +0.3% -3.7% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +3.5% +0.3% +3.2% +10.0% ➖ noise
57 duckdb:duckdb +0.5% +0.3% +0.2% +13.1% ➖ noise
57 duckdb:vortex-compact -10.7% +0.3% -11.0% +12.8% ➖ noise
57 duckdb:vortex-file-compressed +2.5% +0.3% +2.3% +10.0% ➖ noise
58 datafusion:vortex-compact -0.6% -1.1% +0.5% +10.7% ➖ noise
58 datafusion:vortex-file-compressed -4.6% -1.1% -3.5% +10.0% ➖ noise
58 duckdb:duckdb +2.9% -1.1% +4.0% +10.0% ➖ noise
58 duckdb:vortex-compact +0.7% -1.1% +1.8% +10.0% ➖ noise
58 duckdb:vortex-file-compressed -9.0% -1.1% -8.0% +10.0% ➖ noise
59 datafusion:vortex-compact -3.3% -1.3% -2.0% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -3.5% -1.3% -2.2% +10.0% ➖ noise
59 duckdb:duckdb -0.4% -1.3% +0.9% +10.1% ➖ noise
59 duckdb:vortex-compact +1.1% -1.3% +2.4% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -1.5% -1.3% -0.2% +26.5% ➖ noise
60 datafusion:vortex-compact -1.8% +2.0% -3.7% +12.1% ➖ noise
60 datafusion:vortex-file-compressed +1.5% +2.0% -0.5% +10.0% ➖ noise
60 duckdb:duckdb +1.0% +2.0% -1.0% +10.0% ➖ noise
60 duckdb:vortex-compact +2.5% +2.0% +0.5% +12.6% ➖ noise
60 duckdb:vortex-file-compressed -1.3% +2.0% -3.3% +12.0% ➖ noise
61 datafusion:vortex-compact -1.9% +0.9% -2.8% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +0.7% +0.9% -0.2% +10.0% ➖ noise
61 duckdb:duckdb -0.5% +0.9% -1.4% +10.0% ➖ noise
61 duckdb:vortex-compact -0.5% +0.9% -1.5% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +7.3% +0.9% +6.3% +22.9% ➖ noise
62 datafusion:vortex-compact -2.9% -0.2% -2.7% +24.7% ➖ noise
62 datafusion:vortex-file-compressed +13.0% -0.2% +13.3% +30.2% ➖ noise
62 duckdb:duckdb +0.3% -0.2% +0.5% +11.9% ➖ noise
62 duckdb:vortex-compact +7.6% -0.2% +7.8% +15.9% ➖ noise
62 duckdb:vortex-file-compressed -0.2% -0.2% -0.0% +16.3% ➖ noise
63 datafusion:vortex-compact +1.5% -1.5% +3.0% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -8.6% -1.5% -7.3% +19.2% ➖ noise
63 duckdb:duckdb -1.0% -1.5% +0.5% +10.0% ➖ noise
63 duckdb:vortex-compact -2.5% -1.5% -1.0% +10.4% ➖ noise
63 duckdb:vortex-file-compressed +1.1% -1.5% +2.6% +10.0% ➖ noise
64 datafusion:vortex-compact +0.9% +3.3% -2.3% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +2.1% +3.3% -1.2% +10.0% ➖ noise
64 duckdb:duckdb +0.1% +3.3% -3.1% +10.0% ➖ noise
64 duckdb:vortex-compact +1.0% +3.3% -2.2% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +1.9% +3.3% -1.4% +11.4% ➖ noise
65 datafusion:vortex-compact -3.8% +0.2% -4.0% +17.8% ➖ noise
65 datafusion:vortex-file-compressed -1.9% +0.2% -2.1% +10.0% ➖ noise
65 duckdb:duckdb +0.0% +0.2% -0.1% +10.0% ➖ noise
65 duckdb:vortex-compact +4.3% +0.2% +4.1% +27.4% ➖ noise
65 duckdb:vortex-file-compressed -9.5% +0.2% -9.6% +21.3% ➖ noise
66 datafusion:vortex-compact -4.1% +8.0% -11.2% +10.0% ✅ faster
66 datafusion:vortex-file-compressed +5.7% +8.0% -2.2% +13.7% ➖ noise
66 duckdb:duckdb +0.5% +8.0% -6.9% +16.8% ➖ noise
66 duckdb:vortex-compact -2.1% +8.0% -9.4% +10.8% ➖ noise
66 duckdb:vortex-file-compressed -3.0% +8.0% -10.2% +10.0% ✅ faster
67 datafusion:vortex-compact -2.2% -1.7% -0.5% +11.7% ➖ noise
67 datafusion:vortex-file-compressed -1.8% -1.7% -0.0% +13.3% ➖ noise
67 duckdb:duckdb -5.9% -1.7% -4.3% +10.0% ➖ noise
67 duckdb:vortex-compact -2.4% -1.7% -0.6% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -1.5% -1.7% +0.2% +10.0% ➖ noise
68 datafusion:vortex-compact +0.4% +5.1% -4.5% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -1.6% +5.1% -6.3% +10.0% ➖ noise
68 duckdb:duckdb +3.2% +5.1% -1.8% +11.0% ➖ noise
68 duckdb:vortex-compact +5.9% +5.1% +0.8% +14.4% ➖ noise
68 duckdb:vortex-file-compressed +1.7% +5.1% -3.2% +10.0% ➖ noise
69 datafusion:vortex-compact -4.9% -1.6% -3.3% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -1.7% -1.6% -0.1% +14.4% ➖ noise
69 duckdb:duckdb +2.4% -1.6% +4.1% +10.0% ➖ noise
69 duckdb:vortex-compact +0.4% -1.6% +2.0% +13.8% ➖ noise
69 duckdb:vortex-file-compressed +0.6% -1.6% +2.2% +10.0% ➖ noise
70 datafusion:vortex-compact -0.7% +0.1% -0.8% +15.8% ➖ noise
70 datafusion:vortex-file-compressed -1.1% +0.1% -1.2% +20.9% ➖ noise
70 duckdb:duckdb +1.5% +0.1% +1.4% +10.0% ➖ noise
70 duckdb:vortex-compact +5.4% +0.1% +5.3% +12.8% ➖ noise
70 duckdb:vortex-file-compressed -3.7% +0.1% -3.8% +30.9% ➖ noise
71 datafusion:vortex-compact +1.4% +0.0% +1.4% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -0.9% +0.0% -0.9% +10.0% ➖ noise
71 duckdb:duckdb -4.8% +0.0% -4.8% +11.4% ➖ noise
71 duckdb:vortex-compact -0.1% +0.0% -0.1% +10.9% ➖ noise
71 duckdb:vortex-file-compressed -2.0% +0.0% -2.1% +10.0% ➖ noise
72 datafusion:vortex-compact -0.5% +1.1% -1.6% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -1.2% +1.1% -2.3% +10.0% ➖ noise
72 duckdb:duckdb -2.5% +1.1% -3.6% +10.0% ➖ noise
72 duckdb:vortex-compact -1.9% +1.1% -3.0% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +1.2% +1.1% +0.1% +10.0% ➖ noise
73 datafusion:vortex-compact -2.7% +2.7% -5.2% +14.8% ➖ noise
73 datafusion:vortex-file-compressed -1.1% +2.7% -3.7% +10.0% ➖ noise
73 duckdb:duckdb +3.9% +2.7% +1.2% +10.8% ➖ noise
73 duckdb:vortex-compact +3.4% +2.7% +0.7% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +1.0% +2.7% -1.7% +10.6% ➖ noise
74 datafusion:vortex-compact -5.2% +2.3% -7.3% +14.1% ➖ noise
74 datafusion:vortex-file-compressed -3.4% +2.3% -5.6% +14.1% ➖ noise
74 duckdb:duckdb -0.3% +2.3% -2.5% +10.0% ➖ noise
74 duckdb:vortex-compact +0.8% +2.3% -1.5% +21.2% ➖ noise
74 duckdb:vortex-file-compressed -4.9% +2.3% -7.0% +10.0% ➖ noise
75 datafusion:vortex-compact +0.9% -0.6% +1.5% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +3.9% -0.6% +4.5% +13.4% ➖ noise
75 duckdb:duckdb +0.1% -0.6% +0.8% +10.0% ➖ noise
75 duckdb:vortex-compact +3.1% -0.6% +3.7% +10.0% ➖ noise
75 duckdb:vortex-file-compressed +1.6% -0.6% +2.2% +10.2% ➖ noise
76 datafusion:vortex-compact -1.6% -1.6% +0.0% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -1.8% -1.6% -0.3% +14.8% ➖ noise
76 duckdb:duckdb -1.2% -1.6% +0.4% +10.0% ➖ noise
76 duckdb:vortex-compact +2.7% -1.6% +4.4% +13.7% ➖ noise
76 duckdb:vortex-file-compressed -4.4% -1.6% -2.8% +12.4% ➖ noise
77 datafusion:vortex-compact -3.0% +2.3% -5.2% +25.1% ➖ noise
77 datafusion:vortex-file-compressed +1.8% +2.3% -0.4% +10.0% ➖ noise
77 duckdb:duckdb +0.3% +2.3% -1.9% +11.3% ➖ noise
77 duckdb:vortex-compact -3.1% +2.3% -5.3% +25.6% ➖ noise
77 duckdb:vortex-file-compressed -7.7% +2.3% -9.8% +11.6% ➖ noise
78 datafusion:vortex-compact +0.7% +0.2% +0.5% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +1.0% +0.2% +0.7% +13.1% ➖ noise
78 duckdb:duckdb +1.7% +0.2% +1.5% +10.0% ➖ noise
78 duckdb:vortex-compact +0.0% +0.2% -0.2% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +2.8% +0.2% +2.6% +10.0% ➖ noise
79 datafusion:vortex-compact -1.2% +3.0% -4.1% +26.9% ➖ noise
79 datafusion:vortex-file-compressed -2.1% +3.0% -5.0% +15.7% ➖ noise
79 duckdb:duckdb -0.3% +3.0% -3.3% +21.3% ➖ noise
79 duckdb:vortex-compact +5.9% +3.0% +2.7% +12.6% ➖ noise
79 duckdb:vortex-file-compressed +3.4% +3.0% +0.4% +32.7% ➖ noise
80 datafusion:vortex-compact +3.9% -1.1% +5.1% +11.3% ➖ noise
80 datafusion:vortex-file-compressed -2.8% -1.1% -1.7% +14.4% ➖ noise
80 duckdb:duckdb -8.0% -1.1% -6.9% +13.0% ➖ noise
80 duckdb:vortex-compact -0.5% -1.1% +0.6% +10.3% ➖ noise
80 duckdb:vortex-file-compressed -0.3% -1.1% +0.9% +14.1% ➖ noise
81 datafusion:vortex-compact +5.2% +0.5% +4.7% +10.0% ➖ noise
81 datafusion:vortex-file-compressed +0.2% +0.5% -0.3% +10.0% ➖ noise
81 duckdb:duckdb +2.0% +0.5% +1.6% +10.0% ➖ noise
81 duckdb:vortex-compact -0.5% +0.5% -0.9% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -0.2% +0.5% -0.7% +10.0% ➖ noise
82 datafusion:vortex-compact +0.6% -1.1% +1.7% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -0.7% -1.1% +0.3% +14.3% ➖ noise
82 duckdb:duckdb -3.1% -1.1% -2.0% +11.8% ➖ noise
82 duckdb:vortex-compact -1.0% -1.1% +0.1% +10.0% ➖ noise
82 duckdb:vortex-file-compressed -2.8% -1.1% -1.8% +11.3% ➖ noise
83 datafusion:vortex-compact +0.6% +2.2% -1.5% +20.7% ➖ noise
83 datafusion:vortex-file-compressed -1.7% +2.2% -3.8% +13.5% ➖ noise
83 duckdb:duckdb +0.5% +2.2% -1.6% +10.0% ➖ noise
83 duckdb:vortex-compact -1.6% +2.2% -3.7% +15.5% ➖ noise
83 duckdb:vortex-file-compressed -5.9% +2.2% -7.9% +10.0% ➖ noise
84 datafusion:vortex-compact +1.5% -2.8% +4.4% +12.6% ➖ noise
84 datafusion:vortex-file-compressed -4.5% -2.8% -1.7% +12.4% ➖ noise
84 duckdb:duckdb +3.9% -2.8% +6.9% +10.0% ➖ noise
84 duckdb:vortex-compact -9.4% -2.8% -6.8% +26.3% ➖ noise
84 duckdb:vortex-file-compressed -3.1% -2.8% -0.3% +10.0% ➖ noise
85 datafusion:vortex-compact +0.6% +3.9% -3.1% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +3.2% +3.9% -0.6% +10.0% ➖ noise
85 duckdb:duckdb -0.4% +3.9% -4.1% +10.0% ➖ noise
85 duckdb:vortex-compact +5.2% +3.9% +1.3% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -1.2% +3.9% -4.9% +11.3% ➖ noise
86 datafusion:vortex-compact +4.7% +5.7% -0.9% +38.2% ➖ noise
86 datafusion:vortex-file-compressed -4.4% +5.7% -9.6% +12.6% ➖ noise
86 duckdb:duckdb +1.6% +5.7% -3.9% +10.0% ➖ noise
86 duckdb:vortex-compact -4.1% +5.7% -9.3% +11.6% ➖ noise
86 duckdb:vortex-file-compressed +3.5% +5.7% -2.0% +11.0% ➖ noise
87 datafusion:vortex-compact -3.7% +0.8% -4.4% +12.4% ➖ noise
87 datafusion:vortex-file-compressed -3.6% +0.8% -4.3% +10.0% ➖ noise
87 duckdb:duckdb +1.6% +0.8% +0.9% +10.0% ➖ noise
87 duckdb:vortex-compact +1.0% +0.8% +0.2% +10.9% ➖ noise
87 duckdb:vortex-file-compressed +1.4% +0.8% +0.6% +11.8% ➖ noise
88 datafusion:vortex-compact +0.7% -0.6% +1.3% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -0.9% -0.6% -0.3% +10.0% ➖ noise
88 duckdb:duckdb -1.0% -0.6% -0.3% +10.0% ➖ noise
88 duckdb:vortex-compact +0.7% -0.6% +1.4% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +2.1% -0.6% +2.7% +10.0% ➖ noise
89 datafusion:vortex-compact +1.2% -1.7% +2.9% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +0.7% -1.7% +2.4% +10.0% ➖ noise
89 duckdb:duckdb -8.3% -1.7% -6.7% +10.0% ➖ noise
89 duckdb:vortex-compact +1.7% -1.7% +3.4% +10.0% ➖ noise
89 duckdb:vortex-file-compressed +0.8% -1.7% +2.5% +10.0% ➖ noise
90 datafusion:vortex-compact -1.7% +0.3% -2.0% +36.7% ➖ noise
90 datafusion:vortex-file-compressed -7.6% +0.3% -7.9% +41.5% ➖ noise
90 duckdb:duckdb -0.4% +0.3% -0.7% +11.9% ➖ noise
90 duckdb:vortex-compact -16.7% +0.3% -17.0% +27.0% ➖ noise
90 duckdb:vortex-file-compressed +1.7% +0.3% +1.4% +12.8% ➖ noise
91 datafusion:vortex-compact +0.9% -0.4% +1.3% +12.9% ➖ noise
91 datafusion:vortex-file-compressed +2.2% -0.4% +2.6% +15.4% ➖ noise
91 duckdb:duckdb -4.1% -0.4% -3.7% +10.0% ➖ noise
91 duckdb:vortex-compact -0.7% -0.4% -0.4% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +3.3% -0.4% +3.7% +10.0% ➖ noise
92 datafusion:vortex-compact +6.3% -2.9% +9.4% +25.8% ➖ noise
92 datafusion:vortex-file-compressed +2.1% -2.9% +5.1% +12.3% ➖ noise
92 duckdb:duckdb -1.8% -2.9% +1.1% +10.4% ➖ noise
92 duckdb:vortex-compact +0.1% -2.9% +3.1% +11.4% ➖ noise
92 duckdb:vortex-file-compressed +0.6% -2.9% +3.5% +22.4% ➖ noise
93 datafusion:vortex-compact -0.1% +3.0% -3.0% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -1.4% +3.0% -4.3% +10.0% ➖ noise
93 duckdb:duckdb -1.3% +3.0% -4.1% +10.0% ➖ noise
93 duckdb:vortex-compact +1.2% +3.0% -1.7% +10.0% ➖ noise
93 duckdb:vortex-file-compressed +1.9% +3.0% -1.1% +10.0% ➖ noise
94 datafusion:vortex-compact -7.0% +1.8% -8.7% +13.3% ➖ noise
94 datafusion:vortex-file-compressed +2.0% +1.8% +0.1% +13.4% ➖ noise
94 duckdb:duckdb +0.5% +1.8% -1.3% +12.2% ➖ noise
94 duckdb:vortex-compact -0.8% +1.8% -2.5% +17.6% ➖ noise
94 duckdb:vortex-file-compressed +3.9% +1.8% +2.0% +11.0% ➖ noise
95 datafusion:vortex-compact +3.6% -6.5% +10.7% +12.0% ➖ noise
95 datafusion:vortex-file-compressed -0.6% -6.5% +6.3% +11.3% ➖ noise
95 duckdb:duckdb +21.1% -6.5% +29.5% +24.2% 🚨 regression
95 duckdb:vortex-compact -1.0% -6.5% +5.9% +20.8% ➖ noise
95 duckdb:vortex-file-compressed +0.5% -6.5% +7.5% +21.9% ➖ noise
96 datafusion:vortex-compact -3.6% +0.3% -3.8% +23.5% ➖ noise
96 datafusion:vortex-file-compressed -1.6% +0.3% -1.8% +30.6% ➖ noise
96 duckdb:duckdb -6.0% +0.3% -6.2% +21.1% ➖ noise
96 duckdb:vortex-compact -3.1% +0.3% -3.3% +11.2% ➖ noise
96 duckdb:vortex-file-compressed +2.0% +0.3% +1.8% +14.8% ➖ noise
97 datafusion:vortex-compact -3.1% +1.9% -5.0% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +7.5% +1.9% +5.5% +20.4% ➖ noise
97 duckdb:duckdb +0.5% +1.9% -1.4% +13.3% ➖ noise
97 duckdb:vortex-compact +3.8% +1.9% +1.8% +10.0% ➖ noise
97 duckdb:vortex-file-compressed +2.4% +1.9% +0.4% +10.0% ➖ noise
98 datafusion:vortex-compact -1.0% +2.9% -3.7% +23.4% ➖ noise
98 datafusion:vortex-file-compressed -0.4% +2.9% -3.2% +10.0% ➖ noise
98 duckdb:duckdb +8.1% +2.9% +5.1% +10.0% ➖ noise
98 duckdb:vortex-compact +3.1% +2.9% +0.2% +10.0% ➖ noise
98 duckdb:vortex-file-compressed -0.3% +2.9% -3.0% +10.0% ➖ noise
99 datafusion:vortex-compact -1.4% -2.7% +1.4% +26.6% ➖ noise
99 datafusion:vortex-file-compressed +14.2% -2.7% +17.3% +20.7% ➖ noise
99 duckdb:duckdb +0.8% -2.7% +3.6% +31.5% ➖ noise
99 duckdb:vortex-compact +3.2% -2.7% +6.1% +17.9% ➖ noise
99 duckdb:vortex-file-compressed -0.6% -2.7% +2.1% +24.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +12.0%
Engines: DataFusion No clear signal (+21.2%, environment too noisy confidence) · DuckDB No clear signal (+3.5%, environment too noisy confidence)
Vortex (geomean): 1.141x ➖
Parquet (geomean): 1.019x ➖
Shifts: Parquet (control) +1.9% · Median polish +1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.083x ➖, 0↑ 1↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 55067389 31956930 1.72
fineweb_q01/datafusion:vortex-file-compressed 649309811 662364871 0.98
fineweb_q02/datafusion:vortex-file-compressed 654433663 629998647 1.04
fineweb_q03/datafusion:vortex-file-compressed 1206952966 1117652119 1.08
fineweb_q04/datafusion:vortex-file-compressed 1155138143 1128983242 1.02
fineweb_q05/datafusion:vortex-file-compressed 1114760342 1104658643 1.01
fineweb_q06/datafusion:vortex-file-compressed 1287057764 1274455444 1.01
fineweb_q07/datafusion:vortex-file-compressed 1146246050 1097663492 1.04
fineweb_q08/datafusion:vortex-file-compressed 454007885 456834397 0.99
datafusion / vortex-compact (1.544x ❌, 2↑ 6↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 51617326 110143304 0.47
fineweb_q01/datafusion:vortex-compact 597969394 757254038 0.79
fineweb_q02/datafusion:vortex-compact 🚀 519318765 778949376 0.67
fineweb_q03/datafusion:vortex-compact 🚨 2530852926 1348837563 1.88
fineweb_q04/datafusion:vortex-compact 🚨 2569571478 1557129590 1.65
fineweb_q05/datafusion:vortex-compact 🚨 3102960652 1379170147 2.25
fineweb_q06/datafusion:vortex-compact 🚨 8319440894 1888846819 4.40
fineweb_q07/datafusion:vortex-compact 🚨 2272425325 1207983034 1.88
fineweb_q08/datafusion:vortex-compact 🚨 1418478431 405299448 3.50
datafusion / parquet (1.067x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1278818125 1234351106 1.04
fineweb_q01/datafusion:parquet 2104624831 2157565138 0.98
fineweb_q02/datafusion:parquet 2224397997 2171915679 1.02
fineweb_q03/datafusion:parquet 2083538730 2056347380 1.01
fineweb_q04/datafusion:parquet 2323695053 2027719481 1.15
fineweb_q05/datafusion:parquet 2088376633 2043757746 1.02
fineweb_q06/datafusion:parquet 2095591980 1920017505 1.09
fineweb_q07/datafusion:parquet 2114154240 1923019573 1.10
fineweb_q08/datafusion:parquet 2510975548 2057799091 1.22
duckdb / vortex-file-compressed (0.979x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 68356767 83741235 0.82
fineweb_q01/duckdb:vortex-file-compressed 743360038 774685461 0.96
fineweb_q02/duckdb:vortex-file-compressed 698191857 562705218 1.24
fineweb_q03/duckdb:vortex-file-compressed 1286303497 1442999728 0.89
fineweb_q04/duckdb:vortex-file-compressed 1436444911 1373313856 1.05
fineweb_q05/duckdb:vortex-file-compressed 1386112686 1230683691 1.13
fineweb_q06/duckdb:vortex-file-compressed 1433934978 1610767425 0.89
fineweb_q07/duckdb:vortex-file-compressed 1379995300 1429765976 0.97
fineweb_q08/duckdb:vortex-file-compressed 614024564 649674130 0.95
duckdb / vortex-compact (1.037x ➖, 0↑ 1↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 96777327 99560860 0.97
fineweb_q01/duckdb:vortex-compact 🚨 881003844 630806755 1.40
fineweb_q02/duckdb:vortex-compact 593485209 683267006 0.87
fineweb_q03/duckdb:vortex-compact 1799117626 1619014057 1.11
fineweb_q04/duckdb:vortex-compact 1789860517 1711934982 1.05
fineweb_q05/duckdb:vortex-compact 1496094058 1559889863 0.96
fineweb_q06/duckdb:vortex-compact 1591917851 1566633408 1.02
fineweb_q07/duckdb:vortex-compact 1435952076 1460154839 0.98
fineweb_q08/duckdb:vortex-compact 544683525 517829797 1.05
duckdb / parquet (0.973x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1179726557 1299693656 0.91
fineweb_q01/duckdb:parquet 1443657150 1770257466 0.82
fineweb_q02/duckdb:parquet 1452188741 1526905063 0.95
fineweb_q03/duckdb:parquet 4072670330 4518309839 0.90
fineweb_q04/duckdb:parquet 2252592467 1944968839 1.16
fineweb_q05/duckdb:parquet 2367970144 2262509474 1.05
fineweb_q06/duckdb:parquet 4727017924 4858292632 0.97
fineweb_q07/duckdb:parquet 2883295574 2776844555 1.04
fineweb_q08/duckdb:parquet 1267264686 1254459322 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -53.1% -3.0% -51.7% +229.2% ➖ noise
0 datafusion:vortex-file-compressed +72.3% -3.0% +77.7% +233.9% ➖ noise
0 duckdb:vortex-compact -2.8% -3.0% +0.2% +120.4% ➖ noise
0 duckdb:vortex-file-compressed -18.4% -3.0% -15.8% +116.7% ➖ noise
1 datafusion:vortex-compact -21.0% -10.8% -11.5% +73.2% ➖ noise
1 datafusion:vortex-file-compressed -2.0% -10.8% +9.9% +125.3% ➖ noise
1 duckdb:vortex-compact +39.7% -10.8% +56.6% +53.3% 🚨 regression
1 duckdb:vortex-file-compressed -4.0% -10.8% +7.6% +45.4% ➖ noise
2 datafusion:vortex-compact -33.3% -1.3% -32.4% +34.3% ✅ faster
2 datafusion:vortex-file-compressed +3.9% -1.3% +5.3% +55.2% ➖ noise
2 duckdb:vortex-compact -13.1% -1.3% -12.0% +36.4% ➖ noise
2 duckdb:vortex-file-compressed +24.1% -1.3% +25.7% +34.7% ➖ noise
3 datafusion:vortex-compact +87.6% -4.4% +96.3% +38.1% 🚨 regression
3 datafusion:vortex-file-compressed +8.0% -4.4% +13.0% +30.0% ➖ noise
3 duckdb:vortex-compact +11.1% -4.4% +16.3% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -10.9% -4.4% -6.7% +36.2% ➖ noise
4 datafusion:vortex-compact +65.0% +15.2% +43.2% +34.4% 🚨 regression
4 datafusion:vortex-file-compressed +2.3% +15.2% -11.2% +30.0% ➖ noise
4 duckdb:vortex-compact +4.6% +15.2% -9.2% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +4.6% +15.2% -9.2% +30.0% ➖ noise
5 datafusion:vortex-compact +125.0% +3.4% +117.6% +30.0% 🚨 regression
5 datafusion:vortex-file-compressed +0.9% +3.4% -2.4% +30.0% ➖ noise
5 duckdb:vortex-compact -4.1% +3.4% -7.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +12.6% +3.4% +8.9% +30.0% ➖ noise
6 datafusion:vortex-compact +340.5% +3.1% +327.4% +38.1% 🚨 regression
6 datafusion:vortex-file-compressed +1.0% +3.1% -2.0% +30.0% ➖ noise
6 duckdb:vortex-compact +1.6% +3.1% -1.4% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -11.0% +3.1% -13.6% +30.0% ➖ noise
7 datafusion:vortex-compact +88.1% +6.8% +76.1% +46.0% 🚨 regression
7 datafusion:vortex-file-compressed +4.4% +6.8% -2.3% +30.0% ➖ noise
7 duckdb:vortex-compact -1.7% +6.8% -8.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -3.5% +6.8% -9.7% +30.0% ➖ noise
8 datafusion:vortex-compact +250.0% +11.0% +215.2% +164.2% 🚨 regression
8 datafusion:vortex-file-compressed -0.6% +11.0% -10.5% +30.0% ➖ noise
8 duckdb:vortex-compact +5.2% +11.0% -5.3% +37.0% ➖ noise
8 duckdb:vortex-file-compressed -5.5% +11.0% -14.9% +42.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): 0.996x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed (0.989x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12310155 12074839 1.02
statpopgen_q01/duckdb:vortex-file-compressed 26139804 27005347 0.97
statpopgen_q02/duckdb:vortex-file-compressed 536514061 537663186 1.00
statpopgen_q03/duckdb:vortex-file-compressed 1085701345 1059480199 1.02
statpopgen_q04/duckdb:vortex-file-compressed 1059991421 1073611958 0.99
statpopgen_q05/duckdb:vortex-file-compressed 481488370 512476194 0.94
statpopgen_q06/duckdb:vortex-file-compressed 1531183739 1533618748 1.00
statpopgen_q07/duckdb:vortex-file-compressed 198862823 205246483 0.97
statpopgen_q08/duckdb:vortex-file-compressed 236749687 233898478 1.01
statpopgen_q09/duckdb:vortex-file-compressed 821194048 845268671 0.97
statpopgen_q10/duckdb:vortex-file-compressed 2546344552 2560787378 0.99
duckdb / vortex-compact (1.004x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11814099 11683119 1.01
statpopgen_q01/duckdb:vortex-compact 217327799 215770138 1.01
statpopgen_q02/duckdb:vortex-compact 575526853 570068078 1.01
statpopgen_q03/duckdb:vortex-compact 1154791700 1153905040 1.00
statpopgen_q04/duckdb:vortex-compact 1168617017 1146520751 1.02
statpopgen_q05/duckdb:vortex-compact 561482752 558946187 1.00
statpopgen_q06/duckdb:vortex-compact 1503792353 1486351691 1.01
statpopgen_q07/duckdb:vortex-compact 886307629 895184159 0.99
statpopgen_q08/duckdb:vortex-compact 924360458 925203831 1.00
statpopgen_q09/duckdb:vortex-compact 917568140 922364538 0.99
statpopgen_q10/duckdb:vortex-compact 2596179840 2607211837 1.00
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 679fc05 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 299851600 305069977 0.98
statpopgen_q01/duckdb:parquet 383543728 385665393 0.99
statpopgen_q02/duckdb:parquet 770689558 764971590 1.01
statpopgen_q03/duckdb:parquet 1182309203 1178286980 1.00
statpopgen_q04/duckdb:parquet 1182774701 1192770374 0.99
statpopgen_q05/duckdb:parquet 810150728 811797796 1.00
statpopgen_q06/duckdb:parquet 1408905159 1420390303 0.99
statpopgen_q07/duckdb:parquet 858079229 851158736 1.01
statpopgen_q08/duckdb:parquet 855964633 868885623 0.99
statpopgen_q09/duckdb:parquet 1037370651 1034077172 1.00
statpopgen_q10/duckdb:parquet 2218780303 2235341665 0.99

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB +16.78 KB +0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +1.1% -1.7% +2.9% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +1.9% -1.7% +3.7% +10.0% ➖ noise
1 duckdb:vortex-compact +0.7% -0.6% +1.3% +35.4% ➖ noise
1 duckdb:vortex-file-compressed -3.2% -0.6% -2.7% +219.6% ➖ noise
2 duckdb:vortex-compact +1.0% +0.7% +0.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.2% +0.7% -1.0% +10.0% ➖ noise
3 duckdb:vortex-compact +0.1% +0.3% -0.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +2.5% +0.3% +2.1% +10.0% ➖ noise
4 duckdb:vortex-compact +1.9% -0.8% +2.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.3% -0.8% -0.4% +10.0% ➖ noise
5 duckdb:vortex-compact +0.5% -0.2% +0.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -6.0% -0.2% -5.9% +10.0% ➖ noise
6 duckdb:vortex-compact +1.2% -0.8% +2.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.2% -0.8% +0.7% +10.0% ➖ noise
7 duckdb:vortex-compact -1.0% +0.8% -1.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.1% +0.8% -3.9% +10.0% ➖ noise
8 duckdb:vortex-compact -0.1% -1.5% +1.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.2% -1.5% +2.7% +10.0% ➖ noise
9 duckdb:vortex-compact -0.5% +0.3% -0.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.8% +0.3% -3.2% +10.0% ➖ noise
10 duckdb:vortex-compact -0.4% -0.7% +0.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.6% -0.7% +0.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.8%
Engines: DataFusion No clear signal (-2.4%, low confidence) · DuckDB No clear signal (-1.1%, low confidence)
Vortex (geomean): 0.936x ➖
Parquet (geomean): 0.957x ➖
Shifts: Parquet (control) -4.3% · Median polish -5.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.925x ➖, 1↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 403001218 420796449 0.96
tpch_q02/datafusion:vortex-file-compressed 108520680 119779402 0.91
tpch_q03/datafusion:vortex-file-compressed 212946678 233788523 0.91
tpch_q04/datafusion:vortex-file-compressed 🚀 110909543 125079621 0.89
tpch_q05/datafusion:vortex-file-compressed 380484669 407727787 0.93
tpch_q06/datafusion:vortex-file-compressed 36606731 38287517 0.96
tpch_q07/datafusion:vortex-file-compressed 509807016 552962240 0.92
tpch_q08/datafusion:vortex-file-compressed 367673965 402858426 0.91
tpch_q09/datafusion:vortex-file-compressed 653271430 711189076 0.92
tpch_q10/datafusion:vortex-file-compressed 232944170 250847085 0.93
tpch_q11/datafusion:vortex-file-compressed 86181803 90069033 0.96
tpch_q12/datafusion:vortex-file-compressed 116144287 127600435 0.91
tpch_q13/datafusion:vortex-file-compressed 223627590 240113313 0.93
tpch_q14/datafusion:vortex-file-compressed 52326794 55262594 0.95
tpch_q15/datafusion:vortex-file-compressed 98387162 105755855 0.93
tpch_q16/datafusion:vortex-file-compressed 76951224 82671620 0.93
tpch_q17/datafusion:vortex-file-compressed 644457025 708232765 0.91
tpch_q18/datafusion:vortex-file-compressed 887320004 951043230 0.93
tpch_q19/datafusion:vortex-file-compressed 75865018 79863181 0.95
tpch_q20/datafusion:vortex-file-compressed 164174214 178111199 0.92
tpch_q21/datafusion:vortex-file-compressed 679243918 749728721 0.91
tpch_q22/datafusion:vortex-file-compressed 63314794 70190945 0.90
datafusion / vortex-compact (0.922x ➖, 5↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 454832608 467288073 0.97
tpch_q02/datafusion:vortex-compact 🚀 113878973 128481102 0.89
tpch_q03/datafusion:vortex-compact 🚀 212547309 237812347 0.89
tpch_q04/datafusion:vortex-compact 🚀 116239225 132543355 0.88
tpch_q05/datafusion:vortex-compact 389259798 424147517 0.92
tpch_q06/datafusion:vortex-compact 59544142 64203932 0.93
tpch_q07/datafusion:vortex-compact 528435702 580227992 0.91
tpch_q08/datafusion:vortex-compact 🚀 370036480 412385705 0.90
tpch_q09/datafusion:vortex-compact 658098508 722148525 0.91
tpch_q10/datafusion:vortex-compact 244805884 268212347 0.91
tpch_q11/datafusion:vortex-compact 88704168 95335195 0.93
tpch_q12/datafusion:vortex-compact 159446713 172038204 0.93
tpch_q13/datafusion:vortex-compact 268267091 289683689 0.93
tpch_q14/datafusion:vortex-compact 71977404 75878457 0.95
tpch_q15/datafusion:vortex-compact 157194679 163046596 0.96
tpch_q16/datafusion:vortex-compact 82286946 87294500 0.94
tpch_q17/datafusion:vortex-compact 652688293 701120477 0.93
tpch_q18/datafusion:vortex-compact 874728886 949177493 0.92
tpch_q19/datafusion:vortex-compact 124495362 133233331 0.93
tpch_q20/datafusion:vortex-compact 187560612 201092999 0.93
tpch_q21/datafusion:vortex-compact 🚀 673769782 751130269 0.90
tpch_q22/datafusion:vortex-compact 69463439 75798362 0.92
datafusion / parquet (0.948x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 464468006 479673669 0.97
tpch_q02/datafusion:parquet 174978905 187529227 0.93
tpch_q03/datafusion:parquet 291154475 308910642 0.94
tpch_q04/datafusion:parquet 129858668 138566968 0.94
tpch_q05/datafusion:parquet 448828403 483194297 0.93
tpch_q06/datafusion:parquet 127079772 133049823 0.96
tpch_q07/datafusion:parquet 616208959 666527231 0.92
tpch_q08/datafusion:parquet 472128539 510538365 0.92
tpch_q09/datafusion:parquet 770296875 824213227 0.93
tpch_q10/datafusion:parquet 510456953 535268583 0.95
tpch_q11/datafusion:parquet 122401548 124969330 0.98
tpch_q12/datafusion:parquet 210267282 205624353 1.02
tpch_q13/datafusion:parquet 336267307 347950237 0.97
tpch_q14/datafusion:parquet 160146406 168888681 0.95
tpch_q15/datafusion:parquet 264443190 278569097 0.95
tpch_q16/datafusion:parquet 124094125 136901609 0.91
tpch_q17/datafusion:parquet 697375101 757807810 0.92
tpch_q18/datafusion:parquet 906362390 980729745 0.92
tpch_q19/datafusion:parquet 269519511 276161421 0.98
tpch_q20/datafusion:parquet 300855898 310119304 0.97
tpch_q21/datafusion:parquet 711561917 769250154 0.93
tpch_q22/datafusion:parquet 222254536 226972554 0.98
datafusion / arrow (0.931x ➖, 1↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 616766574 665993736 0.93
tpch_q02/datafusion:arrow 166392476 178237764 0.93
tpch_q03/datafusion:arrow 468880014 517641287 0.91
tpch_q04/datafusion:arrow 🚀 344527913 388855450 0.89
tpch_q05/datafusion:arrow 955965851 1014533364 0.94
tpch_q06/datafusion:arrow 285155702 311901226 0.91
tpch_q07/datafusion:arrow 1196148391 1278212204 0.94
tpch_q08/datafusion:arrow 1174096974 1216829348 0.96
tpch_q09/datafusion:arrow 1378332132 1461473595 0.94
tpch_q10/datafusion:arrow 597563928 652453749 0.92
tpch_q11/datafusion:arrow 139211929 149015413 0.93
tpch_q12/datafusion:arrow 821083912 837341268 0.98
tpch_q13/datafusion:arrow 504963524 518517327 0.97
tpch_q14/datafusion:arrow 322104588 347967833 0.93
tpch_q15/datafusion:arrow 708303724 774890786 0.91
tpch_q16/datafusion:arrow 106207247 113468052 0.94
tpch_q17/datafusion:arrow 1350479092 1467022039 0.92
tpch_q18/datafusion:arrow 1938913545 2073042172 0.94
tpch_q19/datafusion:arrow 489758668 532215340 0.92
tpch_q20/datafusion:arrow 501279681 545097673 0.92
tpch_q21/datafusion:arrow 3016103707 3170393805 0.95
tpch_q22/datafusion:arrow 130535539 144847988 0.90
duckdb / vortex-file-compressed (0.948x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169734903 173420493 0.98
tpch_q02/duckdb:vortex-file-compressed 51658894 52950075 0.98
tpch_q03/duckdb:vortex-file-compressed 122626522 129901567 0.94
tpch_q04/duckdb:vortex-file-compressed 157816739 171445820 0.92
tpch_q05/duckdb:vortex-file-compressed 137682344 145132333 0.95
tpch_q06/duckdb:vortex-file-compressed 37071103 38731294 0.96
tpch_q07/duckdb:vortex-file-compressed 131963772 141015421 0.94
tpch_q08/duckdb:vortex-file-compressed 172472744 186837949 0.92
tpch_q09/duckdb:vortex-file-compressed 393826833 417930019 0.94
tpch_q10/duckdb:vortex-file-compressed 190384233 202903260 0.94
tpch_q11/duckdb:vortex-file-compressed 32306166 33611960 0.96
tpch_q12/duckdb:vortex-file-compressed 101940184 105943219 0.96
tpch_q13/duckdb:vortex-file-compressed 273719000 287989318 0.95
tpch_q14/duckdb:vortex-file-compressed 53751156 56728360 0.95
tpch_q15/duckdb:vortex-file-compressed 88876270 93942553 0.95
tpch_q16/duckdb:vortex-file-compressed 78673246 80754755 0.97
tpch_q17/duckdb:vortex-file-compressed 93877274 99297021 0.95
tpch_q18/duckdb:vortex-file-compressed 284562801 306183149 0.93
tpch_q19/duckdb:vortex-file-compressed 79697595 83773348 0.95
tpch_q20/duckdb:vortex-file-compressed 141971975 150973520 0.94
tpch_q21/duckdb:vortex-file-compressed 495081403 540294872 0.92
tpch_q22/duckdb:vortex-file-compressed 64796216 66871739 0.97
duckdb / vortex-compact (0.948x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 230326028 239799117 0.96
tpch_q02/duckdb:vortex-compact 57754466 59438269 0.97
tpch_q03/duckdb:vortex-compact 135421721 144928112 0.93
tpch_q04/duckdb:vortex-compact 172125816 184240232 0.93
tpch_q05/duckdb:vortex-compact 165852071 175929445 0.94
tpch_q06/duckdb:vortex-compact 56992951 58482553 0.97
tpch_q07/duckdb:vortex-compact 174922688 186000174 0.94
tpch_q08/duckdb:vortex-compact 186981908 200774887 0.93
tpch_q09/duckdb:vortex-compact 425649272 448377750 0.95
tpch_q10/duckdb:vortex-compact 219443060 229140817 0.96
tpch_q11/duckdb:vortex-compact 38685561 41695680 0.93
tpch_q12/duckdb:vortex-compact 163285614 171466753 0.95
tpch_q13/duckdb:vortex-compact 326764533 341444812 0.96
tpch_q14/duckdb:vortex-compact 73094287 75787084 0.96
tpch_q15/duckdb:vortex-compact 113823970 125034372 0.91
tpch_q16/duckdb:vortex-compact 80478313 84248603 0.96
tpch_q17/duckdb:vortex-compact 106355572 114473565 0.93
tpch_q18/duckdb:vortex-compact 291996387 302983249 0.96
tpch_q19/duckdb:vortex-compact 97682668 100695456 0.97
tpch_q20/duckdb:vortex-compact 176988599 188674370 0.94
tpch_q21/duckdb:vortex-compact 515470687 552409552 0.93
tpch_q22/duckdb:vortex-compact 71865318 74006492 0.97
duckdb / parquet (0.966x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 261723149 270326016 0.97
tpch_q02/duckdb:parquet 97871293 101005345 0.97
tpch_q03/duckdb:parquet 209613020 217842554 0.96
tpch_q04/duckdb:parquet 136671895 141187494 0.97
tpch_q05/duckdb:parquet 224559102 233301050 0.96
tpch_q06/duckdb:parquet 74205869 76773049 0.97
tpch_q07/duckdb:parquet 186209090 194373220 0.96
tpch_q08/duckdb:parquet 269021342 279490026 0.96
tpch_q09/duckdb:parquet 481681338 513551738 0.94
tpch_q10/duckdb:parquet 624511269 634409916 0.98
tpch_q11/duckdb:parquet 62028947 68823357 0.90
tpch_q12/duckdb:parquet 132025515 135118137 0.98
tpch_q13/duckdb:parquet 451825950 455480742 0.99
tpch_q14/duckdb:parquet 177683834 183629816 0.97
tpch_q15/duckdb:parquet 105824201 107750958 0.98
tpch_q16/duckdb:parquet 162259488 164750824 0.98
tpch_q17/duckdb:parquet 181224494 183066106 0.99
tpch_q18/duckdb:parquet 363913739 378438014 0.96
tpch_q19/duckdb:parquet 280828431 291569618 0.96
tpch_q20/duckdb:parquet 228806636 238789903 0.96
tpch_q21/duckdb:parquet 557029055 588764940 0.95
tpch_q22/duckdb:parquet 293988059 295130951 1.00
duckdb / duckdb (0.969x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120570443 122068251 0.99
tpch_q02/duckdb:duckdb 48784176 50034831 0.98
tpch_q03/duckdb:duckdb 103485483 108478797 0.95
tpch_q04/duckdb:duckdb 139471305 145283368 0.96
tpch_q05/duckdb:duckdb 119776660 123958284 0.97
tpch_q06/duckdb:duckdb 44732671 45895514 0.97
tpch_q07/duckdb:duckdb 91449879 92709604 0.99
tpch_q08/duckdb:duckdb 118579046 122278881 0.97
tpch_q09/duckdb:duckdb 282371989 290386874 0.97
tpch_q10/duckdb:duckdb 218997810 219128393 1.00
tpch_q11/duckdb:duckdb 19121761 19795870 0.97
tpch_q12/duckdb:duckdb 90434846 92779449 0.97
tpch_q13/duckdb:duckdb 231017215 239892870 0.96
tpch_q14/duckdb:duckdb 78446329 80609819 0.97
tpch_q15/duckdb:duckdb 82112170 84442659 0.97
tpch_q16/duckdb:duckdb 76979025 79646962 0.97
tpch_q17/duckdb:duckdb 88541143 90164395 0.98
tpch_q18/duckdb:duckdb 233256838 243362510 0.96
tpch_q19/duckdb:duckdb 124511500 130434487 0.95
tpch_q20/duckdb:duckdb 118242101 120645552 0.98
tpch_q21/duckdb:duckdb 300072104 318754808 0.94
tpch_q22/duckdb:duckdb 66019519 69929159 0.94

File Size Changes (27 files changed, -0.0% overall, 11↑ 16↓)
File Scale Format Base HEAD Change %
supplier_0.vortex 10.0 vortex-file-compressed 5.72 MB 5.78 MB +69.41 KB +1.2%
part_0.vortex 10.0 vortex-file-compressed 24.74 MB 24.82 MB +88.34 KB +0.3%
orders_1.vortex 10.0 vortex-file-compressed 145.67 MB 146.12 MB +458.44 KB +0.3%
partsupp_1.vortex 10.0 vortex-compact 105.05 MB 105.35 MB +306.80 KB +0.3%
lineitem_8.vortex 10.0 vortex-file-compressed 133.53 MB 133.77 MB +250.91 KB +0.2%
lineitem_4.vortex 10.0 vortex-file-compressed 133.87 MB 134.02 MB +148.37 KB +0.1%
lineitem_3.vortex 10.0 vortex-file-compressed 133.07 MB 133.19 MB +125.38 KB +0.1%
lineitem_0.vortex 10.0 vortex-file-compressed 134.21 MB 134.32 MB +119.41 KB +0.1%
lineitem_12.vortex 10.0 vortex-file-compressed 134.08 MB 134.13 MB +49.42 KB +0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 133.41 MB 133.43 MB +21.56 KB +0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 133.64 MB 133.65 MB +7.47 KB +0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 120.36 MB 120.35 MB 4.78 KB -0.0%
customer_0.vortex 10.0 vortex-file-compressed 88.52 MB 88.51 MB 4.45 KB -0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.32 MB 134.29 MB 25.87 KB -0.0%
lineitem_2.vortex 10.0 vortex-file-compressed 134.06 MB 134.02 MB 43.80 KB -0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 134.12 MB 134.07 MB 46.50 KB -0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 120.31 MB 120.26 MB 53.02 KB -0.0%
part_1.vortex 10.0 vortex-file-compressed 24.84 MB 24.83 MB 16.92 KB -0.1%
customer_0.vortex 10.0 vortex-compact 74.12 MB 74.06 MB 55.66 KB -0.1%
orders_2.vortex 10.0 vortex-file-compressed 145.93 MB 145.78 MB 153.19 KB -0.1%
lineitem_6.vortex 10.0 vortex-file-compressed 132.89 MB 132.75 MB 148.30 KB -0.1%
lineitem_1.vortex 10.0 vortex-file-compressed 133.77 MB 133.57 MB 201.56 KB -0.1%
lineitem_11.vortex 10.0 vortex-file-compressed 134.46 MB 134.23 MB 241.48 KB -0.2%
partsupp_0.vortex 10.0 vortex-compact 104.93 MB 104.74 MB 195.01 KB -0.2%
orders_0.vortex 10.0 vortex-file-compressed 144.79 MB 144.27 MB 527.59 KB -0.4%
part_1.vortex 10.0 vortex-compact 17.07 MB 16.93 MB 139.30 KB -0.8%
part_0.vortex 10.0 vortex-compact 16.99 MB 16.81 MB 187.73 KB -1.1%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (-0.0%)
  • vortex-file-compressed: 2.50 GB → 2.50 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -7.4% -3.2% -4.4% +10.0% ➖ noise
1 datafusion:vortex-compact -2.7% -3.2% +0.5% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -4.2% -3.2% -1.1% +10.0% ➖ noise
1 duckdb:duckdb -1.2% -3.2% +2.0% +10.0% ➖ noise
1 duckdb:vortex-compact -4.0% -3.2% -0.8% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -2.1% -3.2% +1.1% +10.0% ➖ noise
2 datafusion:arrow -6.6% -4.9% -1.8% +10.0% ➖ noise
2 datafusion:vortex-compact -11.4% -4.9% -6.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -9.4% -4.9% -4.7% +10.0% ➖ noise
2 duckdb:duckdb -2.5% -4.9% +2.5% +10.0% ➖ noise
2 duckdb:vortex-compact -2.8% -4.9% +2.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.4% -4.9% +2.6% +14.7% ➖ noise
3 datafusion:arrow -9.4% -4.8% -4.9% +10.0% ➖ noise
3 datafusion:vortex-compact -10.6% -4.8% -6.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -8.9% -4.8% -4.4% +10.0% ➖ noise
3 duckdb:duckdb -4.6% -4.8% +0.2% +10.0% ➖ noise
3 duckdb:vortex-compact -6.6% -4.8% -1.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -5.6% -4.8% -0.9% +10.0% ➖ noise
4 datafusion:arrow -11.4% -4.8% -7.0% +10.0% ➖ noise
4 datafusion:vortex-compact -12.3% -4.8% -7.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -11.3% -4.8% -6.9% +10.0% ➖ noise
4 duckdb:duckdb -4.0% -4.8% +0.8% +10.0% ➖ noise
4 duckdb:vortex-compact -6.6% -4.8% -1.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -7.9% -4.8% -3.4% +10.0% ➖ noise
5 datafusion:arrow -5.8% -5.4% -0.3% +10.0% ➖ noise
5 datafusion:vortex-compact -8.2% -5.4% -2.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -6.7% -5.4% -1.3% +10.0% ➖ noise
5 duckdb:duckdb -3.4% -5.4% +2.2% +10.0% ➖ noise
5 duckdb:vortex-compact -5.7% -5.4% -0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -5.1% -5.4% +0.3% +10.0% ➖ noise
6 datafusion:arrow -8.6% -3.9% -4.8% +10.0% ➖ noise
6 datafusion:vortex-compact -7.3% -3.9% -3.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.4% -3.9% -0.5% +10.0% ➖ noise
6 duckdb:duckdb -2.5% -3.9% +1.4% +10.0% ➖ noise
6 duckdb:vortex-compact -2.5% -3.9% +1.4% +11.3% ➖ noise
6 duckdb:vortex-file-compressed -4.3% -3.9% -0.4% +14.9% ➖ noise
7 datafusion:arrow -6.4% -5.9% -0.6% +10.0% ➖ noise
7 datafusion:vortex-compact -8.9% -5.9% -3.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -7.8% -5.9% -2.0% +10.0% ➖ noise
7 duckdb:duckdb -1.4% -5.9% +4.8% +10.0% ➖ noise
7 duckdb:vortex-compact -6.0% -5.9% -0.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -6.4% -5.9% -0.6% +10.0% ➖ noise
8 datafusion:arrow -3.5% -5.7% +2.3% +10.0% ➖ noise
8 datafusion:vortex-compact -10.3% -5.7% -4.9% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -8.7% -5.7% -3.3% +10.0% ➖ noise
8 duckdb:duckdb -3.0% -5.7% +2.8% +10.0% ➖ noise
8 duckdb:vortex-compact -6.9% -5.7% -1.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -7.7% -5.7% -2.2% +10.0% ➖ noise
9 datafusion:arrow -5.7% -6.4% +0.7% +10.0% ➖ noise
9 datafusion:vortex-compact -8.9% -6.4% -2.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -8.1% -6.4% -1.9% +10.0% ➖ noise
9 duckdb:duckdb -2.8% -6.4% +3.9% +10.0% ➖ noise
9 duckdb:vortex-compact -5.1% -6.4% +1.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -5.8% -6.4% +0.6% +10.0% ➖ noise
10 datafusion:arrow -8.4% -3.1% -5.5% +10.0% ➖ noise
10 datafusion:vortex-compact -8.7% -3.1% -5.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -7.1% -3.1% -4.2% +10.0% ➖ noise
10 duckdb:duckdb -0.1% -3.1% +3.1% +10.0% ➖ noise
10 duckdb:vortex-compact -4.2% -3.1% -1.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -6.2% -3.1% -3.2% +10.0% ➖ noise
11 datafusion:arrow -6.6% -6.0% -0.6% +13.3% ➖ noise
11 datafusion:vortex-compact -7.0% -6.0% -1.0% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -4.3% -6.0% +1.8% +10.0% ➖ noise
11 duckdb:duckdb -3.4% -6.0% +2.8% +10.0% ➖ noise
11 duckdb:vortex-compact -7.2% -6.0% -1.3% +14.4% ➖ noise
11 duckdb:vortex-file-compressed -3.9% -6.0% +2.3% +14.9% ➖ noise
12 datafusion:arrow -1.9% -0.0% -1.9% +39.8% ➖ noise
12 datafusion:vortex-compact -7.3% -0.0% -7.3% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -9.0% -0.0% -8.9% +10.0% ➖ noise
12 duckdb:duckdb -2.5% -0.0% -2.5% +10.0% ➖ noise
12 duckdb:vortex-compact -4.8% -0.0% -4.7% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -3.8% -0.0% -3.7% +10.0% ➖ noise
13 datafusion:arrow -2.6% -2.1% -0.5% +10.0% ➖ noise
13 datafusion:vortex-compact -7.4% -2.1% -5.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -6.9% -2.1% -4.9% +10.0% ➖ noise
13 duckdb:duckdb -3.7% -2.1% -1.6% +10.0% ➖ noise
13 duckdb:vortex-compact -4.3% -2.1% -2.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -5.0% -2.1% -2.9% +10.0% ➖ noise
14 datafusion:arrow -7.4% -4.2% -3.4% +10.0% ➖ noise
14 datafusion:vortex-compact -5.1% -4.2% -1.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -5.3% -4.2% -1.1% +10.0% ➖ noise
14 duckdb:duckdb -2.7% -4.2% +1.6% +10.0% ➖ noise
14 duckdb:vortex-compact -3.6% -4.2% +0.7% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -5.2% -4.2% -1.1% +10.0% ➖ noise
15 datafusion:arrow -8.6% -3.4% -5.3% +10.0% ➖ noise
15 datafusion:vortex-compact -3.6% -3.4% -0.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -7.0% -3.4% -3.6% +10.0% ➖ noise
15 duckdb:duckdb -2.8% -3.4% +0.7% +10.0% ➖ noise
15 duckdb:vortex-compact -9.0% -3.4% -5.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -5.4% -3.4% -2.0% +10.0% ➖ noise
16 datafusion:arrow -6.4% -5.5% -0.9% +11.7% ➖ noise
16 datafusion:vortex-compact -5.7% -5.5% -0.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -6.9% -5.5% -1.5% +10.0% ➖ noise
16 duckdb:duckdb -3.3% -5.5% +2.3% +10.0% ➖ noise
16 duckdb:vortex-compact -4.5% -5.5% +1.1% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -2.6% -5.5% +3.1% +10.0% ➖ noise
17 datafusion:arrow -7.9% -4.6% -3.6% +10.0% ➖ noise
17 datafusion:vortex-compact -6.9% -4.6% -2.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -9.0% -4.6% -4.7% +10.0% ➖ noise
17 duckdb:duckdb -1.8% -4.6% +2.9% +10.0% ➖ noise
17 duckdb:vortex-compact -7.1% -4.6% -2.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -5.5% -4.6% -0.9% +10.0% ➖ noise
18 datafusion:arrow -6.5% -5.7% -0.8% +10.0% ➖ noise
18 datafusion:vortex-compact -7.8% -5.7% -2.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -6.7% -5.7% -1.0% +10.0% ➖ noise
18 duckdb:duckdb -4.2% -5.7% +1.7% +10.0% ➖ noise
18 duckdb:vortex-compact -3.6% -5.7% +2.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -7.1% -5.7% -1.4% +10.0% ➖ noise
19 datafusion:arrow -8.0% -3.0% -5.1% +10.0% ➖ noise
19 datafusion:vortex-compact -6.6% -3.0% -3.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -5.0% -3.0% -2.0% +10.0% ➖ noise
19 duckdb:duckdb -4.5% -3.0% -1.5% +10.0% ➖ noise
19 duckdb:vortex-compact -3.0% -3.0% +0.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -4.9% -3.0% -1.9% +10.0% ➖ noise
20 datafusion:arrow -8.0% -3.6% -4.6% +10.0% ➖ noise
20 datafusion:vortex-compact -6.7% -3.6% -3.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -7.8% -3.6% -4.4% +10.0% ➖ noise
20 duckdb:duckdb -2.0% -3.6% +1.7% +10.0% ➖ noise
20 duckdb:vortex-compact -6.2% -3.6% -2.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -6.0% -3.6% -2.5% +10.0% ➖ noise
21 datafusion:arrow -4.9% -6.5% +1.7% +10.0% ➖ noise
21 datafusion:vortex-compact -10.3% -6.5% -4.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -9.4% -6.5% -3.2% +10.0% ➖ noise
21 duckdb:duckdb -5.9% -6.5% +0.6% +10.0% ➖ noise
21 duckdb:vortex-compact -6.7% -6.5% -0.3% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -8.4% -6.5% -2.0% +10.0% ➖ noise
22 datafusion:arrow -9.9% -1.2% -8.8% +10.0% ➖ noise
22 datafusion:vortex-compact -8.4% -1.2% -7.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -9.8% -1.2% -8.7% +10.0% ➖ noise
22 duckdb:duckdb -5.6% -1.2% -4.4% +10.0% ➖ noise
22 duckdb:vortex-compact -2.9% -1.2% -1.7% +11.7% ➖ noise
22 duckdb:vortex-file-compressed -3.1% -1.2% -1.9% +12.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (-3.3%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): 0.973x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.962x ➖, 5↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1608028 1750612 0.92
clickbench_q01/datafusion:vortex-file-compressed 🚀 14926819 17472572 0.85
clickbench_q02/datafusion:vortex-file-compressed 🚀 33477806 37527499 0.89
clickbench_q03/datafusion:vortex-file-compressed 🚀 40643541 47027562 0.86
clickbench_q04/datafusion:vortex-file-compressed 290875155 280995421 1.04
clickbench_q05/datafusion:vortex-file-compressed 313156926 330691036 0.95
clickbench_q06/datafusion:vortex-file-compressed 1707033 1808499 0.94
clickbench_q07/datafusion:vortex-file-compressed 🚀 17345089 20482843 0.85
clickbench_q08/datafusion:vortex-file-compressed 336263178 338770313 0.99
clickbench_q09/datafusion:vortex-file-compressed 548184550 556412269 0.99
clickbench_q10/datafusion:vortex-file-compressed 69030500 76385527 0.90
clickbench_q11/datafusion:vortex-file-compressed 82421969 86314860 0.95
clickbench_q12/datafusion:vortex-file-compressed 279290268 289186752 0.97
clickbench_q13/datafusion:vortex-file-compressed 418334354 428919022 0.98
clickbench_q14/datafusion:vortex-file-compressed 268368936 270373748 0.99
clickbench_q15/datafusion:vortex-file-compressed 323349927 322227961 1.00
clickbench_q16/datafusion:vortex-file-compressed 679591693 670274238 1.01
clickbench_q17/datafusion:vortex-file-compressed 650953863 655371562 0.99
clickbench_q18/datafusion:vortex-file-compressed 1352954139 1348310560 1.00
clickbench_q19/datafusion:vortex-file-compressed 🚀 29777390 38375667 0.78
clickbench_q20/datafusion:vortex-file-compressed 322623270 336638882 0.96
clickbench_q21/datafusion:vortex-file-compressed 409422527 411253193 1.00
clickbench_q22/datafusion:vortex-file-compressed 510030086 513577958 0.99
clickbench_q23/datafusion:vortex-file-compressed 538907973 536535113 1.00
clickbench_q24/datafusion:vortex-file-compressed 50880506 50173005 1.01
clickbench_q25/datafusion:vortex-file-compressed 78340433 78662111 1.00
clickbench_q26/datafusion:vortex-file-compressed 46693656 48655593 0.96
clickbench_q27/datafusion:vortex-file-compressed 775122051 833200464 0.93
clickbench_q28/datafusion:vortex-file-compressed 5878405858 5869949099 1.00
clickbench_q29/datafusion:vortex-file-compressed 221299403 224039468 0.99
clickbench_q30/datafusion:vortex-file-compressed 240663646 254211921 0.95
clickbench_q31/datafusion:vortex-file-compressed 293867743 295574653 0.99
clickbench_q32/datafusion:vortex-file-compressed 1117591901 1130116664 0.99
clickbench_q33/datafusion:vortex-file-compressed 1372932491 1388771942 0.99
clickbench_q34/datafusion:vortex-file-compressed 1373780781 1384562348 0.99
clickbench_q35/datafusion:vortex-file-compressed 448780455 460448175 0.97
clickbench_q36/datafusion:vortex-file-compressed 72116719 71725369 1.01
clickbench_q37/datafusion:vortex-file-compressed 34532360 35640279 0.97
clickbench_q38/datafusion:vortex-file-compressed 20904854 22560123 0.93
clickbench_q39/datafusion:vortex-file-compressed 142880773 141135694 1.01
clickbench_q40/datafusion:vortex-file-compressed 16101870 16548259 0.97
clickbench_q41/datafusion:vortex-file-compressed 15123199 15191011 1.00
clickbench_q42/datafusion:vortex-file-compressed 16989561 17400156 0.98
datafusion / parquet (0.996x ➖, 2↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1559738 1525873 1.02
clickbench_q01/datafusion:parquet 20030919 19661123 1.02
clickbench_q02/datafusion:parquet 46673137 46675405 1.00
clickbench_q03/datafusion:parquet 40207072 38698185 1.04
clickbench_q04/datafusion:parquet 300144548 302434124 0.99
clickbench_q05/datafusion:parquet 348414573 348538432 1.00
clickbench_q06/datafusion:parquet 🚀 1588795 1789802 0.89
clickbench_q07/datafusion:parquet 22865327 23117752 0.99
clickbench_q08/datafusion:parquet 373043070 375747118 0.99
clickbench_q09/datafusion:parquet 609268150 625428103 0.97
clickbench_q10/datafusion:parquet 106109984 105329340 1.01
clickbench_q11/datafusion:parquet 132818694 130686482 1.02
clickbench_q12/datafusion:parquet 350566831 341403427 1.03
clickbench_q13/datafusion:parquet 482589950 504643517 0.96
clickbench_q14/datafusion:parquet 345756263 342696429 1.01
clickbench_q15/datafusion:parquet 345569858 346884580 1.00
clickbench_q16/datafusion:parquet 679759790 691448431 0.98
clickbench_q17/datafusion:parquet 661561283 667801262 0.99
clickbench_q18/datafusion:parquet 1374053819 1341812578 1.02
clickbench_q19/datafusion:parquet 29801612 29659287 1.00
clickbench_q20/datafusion:parquet 601225566 602145615 1.00
clickbench_q21/datafusion:parquet 651200819 665390913 0.98
clickbench_q22/datafusion:parquet 958406075 975093058 0.98
clickbench_q23/datafusion:parquet 3707937368 3764275650 0.99
clickbench_q24/datafusion:parquet 84028706 84859132 0.99
clickbench_q25/datafusion:parquet 131797978 131763080 1.00
clickbench_q26/datafusion:parquet 85828664 84687621 1.01
clickbench_q27/datafusion:parquet 1050828139 1063233015 0.99
clickbench_q28/datafusion:parquet 6681856681 6624594860 1.01
clickbench_q29/datafusion:parquet 236120196 242221362 0.97
clickbench_q30/datafusion:parquet 329801327 334014551 0.99
clickbench_q31/datafusion:parquet 376764621 375296980 1.00
clickbench_q32/datafusion:parquet 🚀 1235721984 1377439435 0.90
clickbench_q33/datafusion:parquet 1490377772 1517114159 0.98
clickbench_q34/datafusion:parquet 1523130441 1485666129 1.03
clickbench_q35/datafusion:parquet 472015271 468116424 1.01
clickbench_q36/datafusion:parquet 142868743 147115236 0.97
clickbench_q37/datafusion:parquet 59033592 58078125 1.02
clickbench_q38/datafusion:parquet 86750044 84754398 1.02
clickbench_q39/datafusion:parquet 273948844 268059058 1.02
clickbench_q40/datafusion:parquet 31839837 31390740 1.01
clickbench_q41/datafusion:parquet 27586772 27265664 1.01
clickbench_q42/datafusion:parquet 29824800 29340328 1.02
duckdb / vortex-file-compressed (0.984x ➖, 3↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6373497 6440010 0.99
clickbench_q01/duckdb:vortex-file-compressed 11260065 11281823 1.00
clickbench_q02/duckdb:vortex-file-compressed 26385938 26523732 0.99
clickbench_q03/duckdb:vortex-file-compressed 30370907 31347813 0.97
clickbench_q04/duckdb:vortex-file-compressed 193234779 189541849 1.02
clickbench_q05/duckdb:vortex-file-compressed 181795417 177371626 1.02
clickbench_q06/duckdb:vortex-file-compressed 21560037 21732681 0.99
clickbench_q07/duckdb:vortex-file-compressed 14667528 15097831 0.97
clickbench_q08/duckdb:vortex-file-compressed 267122953 261758207 1.02
clickbench_q09/duckdb:vortex-file-compressed 347006566 338517548 1.03
clickbench_q10/duckdb:vortex-file-compressed 69127448 68904663 1.00
clickbench_q11/duckdb:vortex-file-compressed 78372818 77256161 1.01
clickbench_q12/duckdb:vortex-file-compressed 204654937 198238512 1.03
clickbench_q13/duckdb:vortex-file-compressed 412595438 410935787 1.00
clickbench_q14/duckdb:vortex-file-compressed 230498231 235667336 0.98
clickbench_q15/duckdb:vortex-file-compressed 240319122 238292038 1.01
clickbench_q16/duckdb:vortex-file-compressed 527985472 528639879 1.00
clickbench_q17/duckdb:vortex-file-compressed 422010467 426454997 0.99
clickbench_q18/duckdb:vortex-file-compressed 940488055 947961791 0.99
clickbench_q19/duckdb:vortex-file-compressed 22290900 22217368 1.00
clickbench_q20/duckdb:vortex-file-compressed 306804197 314532897 0.98
clickbench_q21/duckdb:vortex-file-compressed 397620307 401495993 0.99
clickbench_q22/duckdb:vortex-file-compressed 🚀 558157985 646810537 0.86
clickbench_q23/duckdb:vortex-file-compressed 169253471 173274062 0.98
clickbench_q24/duckdb:vortex-file-compressed 43532034 44766382 0.97
clickbench_q25/duckdb:vortex-file-compressed 76392674 73802429 1.04
clickbench_q26/duckdb:vortex-file-compressed 50695947 46316252 1.09
clickbench_q27/duckdb:vortex-file-compressed 520020849 520296627 1.00
clickbench_q28/duckdb:vortex-file-compressed 3069730376 3149436525 0.97
clickbench_q29/duckdb:vortex-file-compressed 28261316 30241327 0.93
clickbench_q30/duckdb:vortex-file-compressed 221631252 212396466 1.04
clickbench_q31/duckdb:vortex-file-compressed 312061048 310720568 1.00
clickbench_q32/duckdb:vortex-file-compressed 1112030440 1125458786 0.99
clickbench_q33/duckdb:vortex-file-compressed 🚀 1105120063 1312489979 0.84
clickbench_q34/duckdb:vortex-file-compressed 1193620495 1237457955 0.96
clickbench_q35/duckdb:vortex-file-compressed 381432680 376924962 1.01
clickbench_q36/duckdb:vortex-file-compressed 27180820 28751768 0.95
clickbench_q37/duckdb:vortex-file-compressed 19850325 20296976 0.98
clickbench_q38/duckdb:vortex-file-compressed 20653549 21282836 0.97
clickbench_q39/duckdb:vortex-file-compressed 42453997 43152892 0.98
clickbench_q40/duckdb:vortex-file-compressed 18207542 19104109 0.95
clickbench_q41/duckdb:vortex-file-compressed 🚀 17711246 19775113 0.90
clickbench_q42/duckdb:vortex-file-compressed 20083869 21904515 0.92
duckdb / parquet (0.993x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 22194615 23147906 0.96
clickbench_q01/duckdb:parquet 29082555 29609221 0.98
clickbench_q02/duckdb:parquet 49558216 50539817 0.98
clickbench_q03/duckdb:parquet 40047347 40193910 1.00
clickbench_q04/duckdb:parquet 202804491 204286086 0.99
clickbench_q05/duckdb:parquet 257363510 257828771 1.00
clickbench_q06/duckdb:parquet 47069743 47124796 1.00
clickbench_q07/duckdb:parquet 31909494 31305000 1.02
clickbench_q08/duckdb:parquet 270319886 268269389 1.01
clickbench_q09/duckdb:parquet 398733643 397490859 1.00
clickbench_q10/duckdb:parquet 82311808 82885000 0.99
clickbench_q11/duckdb:parquet 100624326 101676024 0.99
clickbench_q12/duckdb:parquet 277074631 279262122 0.99
clickbench_q13/duckdb:parquet 471693896 468795531 1.01
clickbench_q14/duckdb:parquet 312111890 316103111 0.99
clickbench_q15/duckdb:parquet 258945727 258421039 1.00
clickbench_q16/duckdb:parquet 595044476 599827804 0.99
clickbench_q17/duckdb:parquet 501091162 498327019 1.01
clickbench_q18/duckdb:parquet 1027003330 1031061638 1.00
clickbench_q19/duckdb:parquet 27555581 27638235 1.00
clickbench_q20/duckdb:parquet 412120497 426873520 0.97
clickbench_q21/duckdb:parquet 532784766 530865374 1.00
clickbench_q22/duckdb:parquet 916192438 922240491 0.99
clickbench_q23/duckdb:parquet 261053745 268362867 0.97
clickbench_q24/duckdb:parquet 73867122 71682628 1.03
clickbench_q25/duckdb:parquet 161857532 163784302 0.99
clickbench_q26/duckdb:parquet 53351012 53643160 0.99
clickbench_q27/duckdb:parquet 643432417 645489223 1.00
clickbench_q28/duckdb:parquet 4913931029 4887569095 1.01
clickbench_q29/duckdb:parquet 41816619 42804466 0.98
clickbench_q30/duckdb:parquet 310235345 312537540 0.99
clickbench_q31/duckdb:parquet 374474304 374067783 1.00
clickbench_q32/duckdb:parquet 1101660533 1118101468 0.99
clickbench_q33/duckdb:parquet 1101410820 1102492867 1.00
clickbench_q34/duckdb:parquet 1160764763 1155920744 1.00
clickbench_q35/duckdb:parquet 373101199 371263556 1.00
clickbench_q36/duckdb:parquet 44716601 45472909 0.98
clickbench_q37/duckdb:parquet 34183741 34710735 0.98
clickbench_q38/duckdb:parquet 35339780 35563004 0.99
clickbench_q39/duckdb:parquet 75725709 80041072 0.95
clickbench_q40/duckdb:parquet 20435806 20577958 0.99
clickbench_q41/duckdb:parquet 20221150 20691471 0.98
clickbench_q42/duckdb:parquet 22574721 22508911 1.00
duckdb / duckdb (1.004x ➖, 0↑ 1↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17333187 17249597 1.00
clickbench_q01/duckdb:duckdb 33827210 34562843 0.98
clickbench_q02/duckdb:duckdb 52375216 51820430 1.01
clickbench_q03/duckdb:duckdb 55746845 55411457 1.01
clickbench_q04/duckdb:duckdb 212219262 213186929 1.00
clickbench_q05/duckdb:duckdb 281528589 285060522 0.99
clickbench_q06/duckdb:duckdb 33937490 34627719 0.98
clickbench_q07/duckdb:duckdb 34892444 35022039 1.00
clickbench_q08/duckdb:duckdb 273937581 276108966 0.99
clickbench_q09/duckdb:duckdb 393280118 389910429 1.01
clickbench_q10/duckdb:duckdb 117249670 114707942 1.02
clickbench_q11/duckdb:duckdb 126400100 125755600 1.01
clickbench_q12/duckdb:duckdb 260010329 258667927 1.01
clickbench_q13/duckdb:duckdb 448487356 440522647 1.02
clickbench_q14/duckdb:duckdb 284726312 282221950 1.01
clickbench_q15/duckdb:duckdb 239924736 239605279 1.00
clickbench_q16/duckdb:duckdb 560504222 561925941 1.00
clickbench_q17/duckdb:duckdb 468330970 467691967 1.00
clickbench_q18/duckdb:duckdb 1001777557 993404409 1.01
clickbench_q19/duckdb:duckdb 35211754 35668326 0.99
clickbench_q20/duckdb:duckdb 486891666 472592865 1.03
clickbench_q21/duckdb:duckdb 469582343 461464177 1.02
clickbench_q22/duckdb:duckdb 528983330 551171123 0.96
clickbench_q23/duckdb:duckdb 249779513 253105987 0.99
clickbench_q24/duckdb:duckdb 60988965 61892835 0.99
clickbench_q25/duckdb:duckdb 149185620 148841746 1.00
clickbench_q26/duckdb:duckdb 61229017 61535786 1.00
clickbench_q27/duckdb:duckdb 550728757 539764578 1.02
clickbench_q28/duckdb:duckdb 4495853611 4482402053 1.00
clickbench_q29/duckdb:duckdb 50462742 50243103 1.00
clickbench_q30/duckdb:duckdb 280906310 276341290 1.02
clickbench_q31/duckdb:duckdb 364388230 362035365 1.01
clickbench_q32/duckdb:duckdb 1108718830 1115887516 0.99
clickbench_q33/duckdb:duckdb 1113078487 1108650112 1.00
clickbench_q34/duckdb:duckdb 1187306603 1186607858 1.00
clickbench_q35/duckdb:duckdb 297757793 301511260 0.99
clickbench_q36/duckdb:duckdb 49402762 48706073 1.01
clickbench_q37/duckdb:duckdb 28913226 28735697 1.01
clickbench_q38/duckdb:duckdb 33856886 34142313 0.99
clickbench_q39/duckdb:duckdb 🚨 89407742 78376170 1.14
clickbench_q40/duckdb:duckdb 27752023 27411040 1.01
clickbench_q41/duckdb:duckdb 27330613 27254237 1.00
clickbench_q42/duckdb:duckdb 29247711 29473733 0.99

File Size Changes (103 files changed, -0.0% overall, 51↑ 52↓)
File Scale Format Base HEAD Change %
hits_16.vortex 1.0 vortex-file-compressed 79.95 MB 80.23 MB +295.33 KB +0.4%
hits_16.vortex 1.0 vortex-compact 48.08 MB 48.22 MB +140.69 KB +0.3%
hits_36.vortex 1.0 vortex-file-compressed 68.47 MB 68.64 MB +166.37 KB +0.2%
hits_52.vortex 1.0 vortex-file-compressed 105.12 MB 105.34 MB +222.67 KB +0.2%
hits_73.vortex 1.0 vortex-file-compressed 110.56 MB 110.71 MB +151.42 KB +0.1%
hits_29.vortex 1.0 vortex-file-compressed 59.78 MB 59.85 MB +75.19 KB +0.1%
hits_20.vortex 1.0 vortex-file-compressed 62.95 MB 63.03 MB +76.68 KB +0.1%
hits_35.vortex 1.0 vortex-file-compressed 115.06 MB 115.19 MB +126.35 KB +0.1%
hits_77.vortex 1.0 vortex-file-compressed 168.65 MB 168.83 MB +182.54 KB +0.1%
hits_41.vortex 1.0 vortex-file-compressed 224.01 MB 224.25 MB +242.30 KB +0.1%
hits_89.vortex 1.0 vortex-file-compressed 184.37 MB 184.56 MB +193.04 KB +0.1%
hits_58.vortex 1.0 vortex-file-compressed 90.36 MB 90.44 MB +86.20 KB +0.1%
hits_6.vortex 1.0 vortex-file-compressed 93.30 MB 93.38 MB +85.56 KB +0.1%
hits_7.vortex 1.0 vortex-file-compressed 94.00 MB 94.07 MB +76.20 KB +0.1%
hits_74.vortex 1.0 vortex-file-compressed 120.04 MB 120.13 MB +94.27 KB +0.1%
hits_84.vortex 1.0 vortex-file-compressed 117.22 MB 117.30 MB +83.88 KB +0.1%
hits_97.vortex 1.0 vortex-file-compressed 107.00 MB 107.07 MB +72.40 KB +0.1%
hits_90.vortex 1.0 vortex-file-compressed 142.08 MB 142.17 MB +91.84 KB +0.1%
hits_13.vortex 1.0 vortex-file-compressed 99.26 MB 99.32 MB +62.18 KB +0.1%
hits_19.vortex 1.0 vortex-file-compressed 73.56 MB 73.61 MB +44.94 KB +0.1%
hits_98.vortex 1.0 vortex-file-compressed 118.40 MB 118.47 MB +70.38 KB +0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.30 MB 80.35 MB +44.00 KB +0.1%
hits_9.vortex 1.0 vortex-file-compressed 99.30 MB 99.36 MB +52.80 KB +0.1%
hits_88.vortex 1.0 vortex-file-compressed 111.40 MB 111.46 MB +57.27 KB +0.1%
hits_8.vortex 1.0 vortex-file-compressed 93.23 MB 93.28 MB +47.59 KB +0.0%
hits_1.vortex 1.0 vortex-file-compressed 138.52 MB 138.58 MB +62.69 KB +0.0%
hits_5.vortex 1.0 vortex-file-compressed 92.96 MB 92.99 MB +39.02 KB +0.0%
hits_76.vortex 1.0 vortex-file-compressed 114.41 MB 114.46 MB +42.67 KB +0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.33 MB 179.40 MB +66.08 KB +0.0%
hits_55.vortex 1.0 vortex-file-compressed 169.18 MB 169.24 MB +62.17 KB +0.0%
hits_53.vortex 1.0 vortex-file-compressed 87.70 MB 87.73 MB +28.82 KB +0.0%
hits_30.vortex 1.0 vortex-file-compressed 87.18 MB 87.21 MB +27.70 KB +0.0%
hits_61.vortex 1.0 vortex-file-compressed 101.31 MB 101.34 MB +30.15 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.75 MB 135.78 MB +37.38 KB +0.0%
hits_59.vortex 1.0 vortex-file-compressed 101.84 MB 101.87 MB +26.82 KB +0.0%
hits_56.vortex 1.0 vortex-file-compressed 123.52 MB 123.55 MB +30.22 KB +0.0%
hits_85.vortex 1.0 vortex-file-compressed 91.90 MB 91.92 MB +22.43 KB +0.0%
hits_43.vortex 1.0 vortex-file-compressed 227.54 MB 227.59 MB +55.24 KB +0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.84 MB 119.87 MB +28.00 KB +0.0%
hits_91.vortex 1.0 vortex-file-compressed 97.21 MB 97.23 MB +19.46 KB +0.0%
hits_68.vortex 1.0 vortex-file-compressed 123.31 MB 123.33 MB +23.12 KB +0.0%
hits_83.vortex 1.0 vortex-file-compressed 89.86 MB 89.88 MB +16.76 KB +0.0%
hits_99.vortex 1.0 vortex-file-compressed 123.22 MB 123.24 MB +22.30 KB +0.0%
hits_81.vortex 1.0 vortex-file-compressed 100.82 MB 100.84 MB +16.59 KB +0.0%
hits_63.vortex 1.0 vortex-file-compressed 69.33 MB 69.34 MB +11.05 KB +0.0%
hits_79.vortex 1.0 vortex-file-compressed 145.03 MB 145.05 MB +22.34 KB +0.0%
hits_17.vortex 1.0 vortex-file-compressed 87.55 MB 87.55 MB +8.09 KB +0.0%
hits_22.vortex 1.0 vortex-file-compressed 78.60 MB 78.60 MB +6.50 KB +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.32 MB 41.32 MB +760 B +0.0%
hits_71.vortex 1.0 vortex-file-compressed 102.08 MB 102.08 MB +1.64 KB +0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.35 MB 90.35 MB +1.36 KB +0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.50 MB 221.50 MB 4.31 KB -0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.26 MB 164.26 MB 4.42 KB -0.0%
hits_46.vortex 1.0 vortex-file-compressed 69.46 MB 69.46 MB 3.99 KB -0.0%
hits_11.vortex 1.0 vortex-file-compressed 80.02 MB 80.02 MB 5.93 KB -0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.98 MB 146.96 MB 13.52 KB -0.0%
hits_0.vortex 1.0 vortex-file-compressed 89.65 MB 89.64 MB 13.12 KB -0.0%
hits_49.vortex 1.0 vortex-file-compressed 75.78 MB 75.77 MB 13.23 KB -0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.03 MB 28.03 MB 5.02 KB -0.0%
hits_23.vortex 1.0 vortex-file-compressed 77.93 MB 77.92 MB 14.22 KB -0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.66 MB 277.61 MB 53.22 KB -0.0%
hits_40.vortex 1.0 vortex-file-compressed 117.85 MB 117.83 MB 25.82 KB -0.0%
hits_38.vortex 1.0 vortex-file-compressed 99.33 MB 99.30 MB 23.78 KB -0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.41 MB 122.37 MB 40.75 KB -0.0%
hits_26.vortex 1.0 vortex-file-compressed 110.09 MB 110.05 MB 39.76 KB -0.0%
hits_65.vortex 1.0 vortex-file-compressed 183.87 MB 183.80 MB 70.98 KB -0.0%
hits_3.vortex 1.0 vortex-file-compressed 142.38 MB 142.32 MB 60.15 KB -0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.62 MB 96.58 MB 43.32 KB -0.0%
hits_21.vortex 1.0 vortex-file-compressed 94.04 MB 93.99 MB 43.14 KB -0.0%
hits_12.vortex 1.0 vortex-file-compressed 101.09 MB 101.04 MB 51.73 KB -0.0%
hits_37.vortex 1.0 vortex-file-compressed 85.82 MB 85.78 MB 44.37 KB -0.1%
hits_24.vortex 1.0 vortex-file-compressed 77.47 MB 77.43 MB 41.26 KB -0.1%
hits_42.vortex 1.0 vortex-file-compressed 223.20 MB 223.06 MB 135.11 KB -0.1%
hits_80.vortex 1.0 vortex-file-compressed 105.03 MB 104.96 MB 72.02 KB -0.1%
hits_45.vortex 1.0 vortex-file-compressed 122.15 MB 122.07 MB 84.21 KB -0.1%
hits_94.vortex 1.0 vortex-file-compressed 138.83 MB 138.74 MB 95.94 KB -0.1%
hits_87.vortex 1.0 vortex-file-compressed 172.61 MB 172.49 MB 122.62 KB -0.1%
hits_70.vortex 1.0 vortex-file-compressed 93.74 MB 93.68 MB 67.20 KB -0.1%
hits_64.vortex 1.0 vortex-file-compressed 81.29 MB 81.23 MB 60.68 KB -0.1%
hits_33.vortex 1.0 vortex-file-compressed 57.31 MB 57.27 MB 43.49 KB -0.1%
hits_60.vortex 1.0 vortex-file-compressed 103.49 MB 103.41 MB 80.38 KB -0.1%
hits_34.vortex 1.0 vortex-file-compressed 98.00 MB 97.92 MB 81.81 KB -0.1%
hits_15.vortex 1.0 vortex-file-compressed 89.32 MB 89.24 MB 76.31 KB -0.1%
hits_75.vortex 1.0 vortex-file-compressed 63.36 MB 63.31 MB 58.16 KB -0.1%
hits_44.vortex 1.0 vortex-file-compressed 186.97 MB 186.80 MB 175.30 KB -0.1%
hits_18.vortex 1.0 vortex-file-compressed 104.89 MB 104.79 MB 99.99 KB -0.1%
hits_25.vortex 1.0 vortex-file-compressed 114.24 MB 114.13 MB 110.76 KB -0.1%
hits_10.vortex 1.0 vortex-file-compressed 69.64 MB 69.58 MB 70.93 KB -0.1%
hits_86.vortex 1.0 vortex-file-compressed 69.48 MB 69.41 MB 72.61 KB -0.1%
hits_72.vortex 1.0 vortex-file-compressed 84.85 MB 84.76 MB 89.66 KB -0.1%
hits_4.vortex 1.0 vortex-file-compressed 108.86 MB 108.73 MB 132.58 KB -0.1%
hits_32.vortex 1.0 vortex-file-compressed 66.89 MB 66.80 MB 87.13 KB -0.1%
hits_67.vortex 1.0 vortex-file-compressed 184.31 MB 184.07 MB 246.00 KB -0.1%
hits_14.vortex 1.0 vortex-file-compressed 111.48 MB 111.33 MB 149.02 KB -0.1%
hits_57.vortex 1.0 vortex-file-compressed 128.43 MB 128.26 MB 175.89 KB -0.1%
hits_93.vortex 1.0 vortex-file-compressed 90.59 MB 90.46 MB 124.32 KB -0.1%
hits_82.vortex 1.0 vortex-file-compressed 100.01 MB 99.82 MB 196.67 KB -0.2%
hits_69.vortex 1.0 vortex-file-compressed 123.23 MB 122.98 MB 254.56 KB -0.2%
hits_31.vortex 1.0 vortex-file-compressed 90.21 MB 90.02 MB 202.41 KB -0.2%
hits_62.vortex 1.0 vortex-file-compressed 117.69 MB 117.38 MB 321.76 KB -0.3%
hits_2.vortex 1.0 vortex-file-compressed 187.04 MB 186.38 MB 672.98 KB -0.4%
hits_55.vortex 1.0 vortex-compact 96.04 MB 94.94 MB 1.09 MB -1.1%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.04 GB → 7.04 GB (-0.0%)
  • vortex-file-compressed: 11.02 GB → 11.02 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -8.1% -1.0% -7.2% +839.7% ➖ noise
0 duckdb:duckdb +0.5% -1.0% +1.5% +274.3% ➖ noise
0 duckdb:vortex-file-compressed -1.0% -1.0% -0.0% +451.3% ➖ noise
1 datafusion:vortex-file-compressed -14.6% +0.0% -14.6% +24.7% ➖ noise
1 duckdb:duckdb -2.1% +0.0% -2.2% +49.2% ➖ noise
1 duckdb:vortex-file-compressed -0.2% +0.0% -0.2% +28.3% ➖ noise
2 datafusion:vortex-file-compressed -10.8% -1.0% -9.9% +18.2% ➖ noise
2 duckdb:duckdb +1.1% -1.0% +2.1% +25.0% ➖ noise
2 duckdb:vortex-file-compressed -0.5% -1.0% +0.5% +12.1% ➖ noise
3 datafusion:vortex-file-compressed -13.6% +1.7% -15.1% +148.0% ➖ noise
3 duckdb:duckdb +0.6% +1.7% -1.1% +51.2% ➖ noise
3 duckdb:vortex-file-compressed -3.1% +1.7% -4.8% +89.6% ➖ noise
4 datafusion:vortex-file-compressed +3.5% -0.7% +4.3% +10.0% ➖ noise
4 duckdb:duckdb -0.5% -0.7% +0.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.9% -0.7% +2.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -5.3% -0.1% -5.2% +10.0% ➖ noise
5 duckdb:duckdb -1.2% -0.1% -1.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.5% -0.1% +2.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -5.6% -5.8% +0.2% +215.0% ➖ noise
6 duckdb:duckdb -2.0% -5.8% +4.1% +13.9% ➖ noise
6 duckdb:vortex-file-compressed -0.8% -5.8% +5.4% +20.4% ➖ noise
7 datafusion:vortex-file-compressed -15.3% +0.4% -15.7% +30.1% ➖ noise
7 duckdb:duckdb -0.4% +0.4% -0.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -2.9% +0.4% -3.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.7% +0.0% -0.8% +10.0% ➖ noise
8 duckdb:duckdb -0.8% +0.0% -0.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.0% +0.0% +2.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.5% -1.1% -0.3% +10.0% ➖ noise
9 duckdb:duckdb +0.9% -1.1% +2.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.5% -1.1% +3.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -9.6% +0.0% -9.6% +10.0% ✅ faster
10 duckdb:duckdb +2.2% +0.0% +2.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.3% +0.0% +0.3% +12.6% ➖ noise
11 datafusion:vortex-file-compressed -4.5% +0.3% -4.8% +14.9% ➖ noise
11 duckdb:duckdb +0.5% +0.3% +0.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +1.4% +0.3% +1.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -3.4% +0.9% -4.3% +10.0% ➖ noise
12 duckdb:duckdb +0.5% +0.9% -0.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +3.2% +0.9% +2.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.5% -1.9% -0.6% +10.0% ➖ noise
13 duckdb:duckdb +1.8% -1.9% +3.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.4% -1.9% +2.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.7% -0.2% -0.6% +10.0% ➖ noise
14 duckdb:duckdb +0.9% -0.2% +1.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.2% -0.2% -2.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.3% -0.1% +0.4% +10.0% ➖ noise
15 duckdb:duckdb +0.1% -0.1% +0.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.9% -0.1% +0.9% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.4% -1.2% +2.7% +10.0% ➖ noise
16 duckdb:duckdb -0.3% -1.2% +1.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.1% -1.2% +1.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.7% -0.2% -0.5% +10.0% ➖ noise
17 duckdb:duckdb +0.1% -0.2% +0.3% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -1.0% -0.2% -0.9% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.3% +1.0% -0.6% +10.0% ➖ noise
18 duckdb:duckdb +0.8% +1.0% -0.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.8% +1.0% -1.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -22.4% +0.1% -22.5% +36.6% ➖ noise
19 duckdb:duckdb -1.3% +0.1% -1.4% +13.9% ➖ noise
19 duckdb:vortex-file-compressed +0.3% +0.1% +0.2% +20.8% ➖ noise
20 datafusion:vortex-file-compressed -4.2% -1.8% -2.4% +111.7% ➖ noise
20 duckdb:duckdb +3.0% -1.8% +4.9% +74.6% ➖ noise
20 duckdb:vortex-file-compressed -2.5% -1.8% -0.7% +50.4% ➖ noise
21 datafusion:vortex-file-compressed -0.4% -0.9% +0.5% +10.0% ➖ noise
21 duckdb:duckdb +1.8% -0.9% +2.7% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -1.0% -0.9% -0.1% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.7% -1.2% +0.5% +10.0% ➖ noise
22 duckdb:duckdb -4.0% -1.2% -2.9% +37.6% ➖ noise
22 duckdb:vortex-file-compressed -13.7% -1.2% -12.7% +20.6% ➖ noise
23 datafusion:vortex-file-compressed +0.4% -2.1% +2.6% +39.8% ➖ noise
23 duckdb:duckdb -1.3% -2.1% +0.8% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -2.3% -2.1% -0.2% +24.1% ➖ noise
24 datafusion:vortex-file-compressed +1.4% +1.0% +0.4% +13.2% ➖ noise
24 duckdb:duckdb -1.5% +1.0% -2.4% +27.5% ➖ noise
24 duckdb:vortex-file-compressed -2.8% +1.0% -3.7% +15.3% ➖ noise
25 datafusion:vortex-file-compressed -0.4% -0.6% +0.2% +13.0% ➖ noise
25 duckdb:duckdb +0.2% -0.6% +0.8% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +3.5% -0.6% +4.1% +12.3% ➖ noise
26 datafusion:vortex-file-compressed -4.0% +0.4% -4.4% +10.0% ➖ noise
26 duckdb:duckdb -0.5% +0.4% -0.9% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +9.5% +0.4% +9.0% +15.7% ➖ noise
27 datafusion:vortex-file-compressed -7.0% -0.7% -6.3% +10.0% ➖ noise
27 duckdb:duckdb +2.0% -0.7% +2.8% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -0.1% -0.7% +0.7% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.1% +0.7% -0.6% +10.0% ➖ noise
28 duckdb:duckdb +0.3% +0.7% -0.4% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -2.5% +0.7% -3.2% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -1.2% -2.4% +1.2% +10.0% ➖ noise
29 duckdb:duckdb +0.4% -2.4% +2.9% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -6.5% -2.4% -4.2% +37.1% ➖ noise
30 datafusion:vortex-file-compressed -5.3% -1.0% -4.4% +10.0% ➖ noise
30 duckdb:duckdb +1.7% -1.0% +2.7% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +4.3% -1.0% +5.4% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.6% +0.2% -0.8% +10.0% ➖ noise
31 duckdb:duckdb +0.6% +0.2% +0.4% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.4% +0.2% +0.2% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -1.1% -6.0% +5.2% +10.0% ➖ noise
32 duckdb:duckdb -0.6% -6.0% +5.7% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -1.2% -6.0% +5.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -1.1% -0.9% -0.2% +10.0% ➖ noise
33 duckdb:duckdb +0.4% -0.9% +1.3% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -15.8% -0.9% -15.0% +12.8% ✅ faster
34 datafusion:vortex-file-compressed -0.8% +1.5% -2.2% +10.0% ➖ noise
34 duckdb:duckdb +0.1% +1.5% -1.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -3.5% +1.5% -4.9% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -2.5% +0.7% -3.2% +10.0% ➖ noise
35 duckdb:duckdb -1.2% +0.7% -1.9% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +1.2% +0.7% +0.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +0.5% -2.3% +2.9% +10.0% ➖ noise
36 duckdb:duckdb +1.4% -2.3% +3.8% +16.4% ➖ noise
36 duckdb:vortex-file-compressed -5.5% -2.3% -3.3% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -3.1% +0.1% -3.2% +14.4% ➖ noise
37 duckdb:duckdb +0.6% +0.1% +0.6% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -2.2% +0.1% -2.3% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -7.3% +0.9% -8.1% +12.9% ➖ noise
38 duckdb:duckdb -0.8% +0.9% -1.7% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -3.0% +0.9% -3.8% +12.3% ➖ noise
39 datafusion:vortex-file-compressed +1.2% -1.7% +3.0% +10.0% ➖ noise
39 duckdb:duckdb +14.1% -1.7% +16.0% +13.2% 🚨 regression
39 duckdb:vortex-file-compressed -1.6% -1.7% +0.1% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -2.7% +0.4% -3.1% +13.7% ➖ noise
40 duckdb:duckdb +1.2% +0.4% +0.9% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -4.7% +0.4% -5.0% +15.5% ➖ noise
41 datafusion:vortex-file-compressed -0.4% -0.6% +0.1% +21.6% ➖ noise
41 duckdb:duckdb +0.3% -0.6% +0.8% +11.7% ➖ noise
41 duckdb:vortex-file-compressed -10.4% -0.6% -9.9% +10.0% ✅ faster
42 datafusion:vortex-file-compressed -2.4% +1.0% -3.3% +17.2% ➖ noise
42 duckdb:duckdb -0.8% +1.0% -1.7% +12.3% ➖ noise
42 duckdb:vortex-file-compressed -8.3% +1.0% -9.2% +23.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Benchmarks: Random Access

Vortex (geomean): 0.924x ➖
Parquet (geomean): 1.004x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (1.012x ➖, 5↑ 3↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 1736935 378809 4.59
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1041624 1050107 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8365914973 8471251501 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8256378657 8371524014 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 3731688 4669379 0.80
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 2872492 3015472 0.95
random-access/feature-vectors/uniform/lance-tokio-local-disk 1198647 1172331 1.02
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1865289 1841936 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8324874469 8391627403 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8335553926 8396682698 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 4419742 6152083 0.72
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 6053051 6048721 1.00
random-access/lance-tokio-local-disk 638802 627747 1.02
random-access/lance-tokio-local-disk-footer 1295315 1301879 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk 236968 238347 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 581894 581750 1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk 130229901 129830513 1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 129615598 129900628 1.00
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 525208 597454 0.88
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 558170 621864 0.90
random-access/nested-lists/uniform/lance-tokio-local-disk 1005133 1006032 1.00
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1350784 1358478 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk 129000519 129923957 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 129016184 129690262 0.99
random-access/nested-lists/uniform/vortex-tokio-local-disk 2007692 2128970 0.94
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2057750 2113579 0.97
random-access/nested-structs/correlated/lance-tokio-local-disk 367990 365290 1.01
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 572837 546180 1.05
random-access/nested-structs/correlated/parquet-tokio-local-disk 22379612 21669443 1.03
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 22457575 22210117 1.01
random-access/nested-structs/correlated/vortex-tokio-local-disk 708337 735309 0.96
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 721114 753751 0.96
random-access/nested-structs/uniform/lance-tokio-local-disk 🚨 2938053 2593272 1.13
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 🚨 3379820 2719695 1.24
random-access/nested-structs/uniform/parquet-tokio-local-disk 22645942 21731475 1.04
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 22047281 21616968 1.02
random-access/nested-structs/uniform/vortex-tokio-local-disk 1528697 1606300 0.95
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1563865 1562101 1.00
random-access/parquet-tokio-local-disk 166148030 166204783 1.00
random-access/parquet-tokio-local-disk-footer 166142359 166494524 1.00
random-access/taxi/correlated/lance-tokio-local-disk 938425 927833 1.01
random-access/taxi/correlated/lance-tokio-local-disk-footer 1799137 1814315 0.99
random-access/taxi/correlated/parquet-tokio-local-disk 250270218 249517440 1.00
random-access/taxi/correlated/parquet-tokio-local-disk-footer 250859683 248656318 1.01
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1391784 1632557 0.85
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1622144 1645874 0.99
random-access/taxi/uniform/lance-tokio-local-disk 9541201 9434053 1.01
random-access/taxi/uniform/lance-tokio-local-disk-footer 10126598 9960235 1.02
random-access/taxi/uniform/parquet-tokio-local-disk 265412207 264205597 1.00
random-access/taxi/uniform/parquet-tokio-local-disk-footer 265596643 265488568 1.00
random-access/taxi/uniform/vortex-tokio-local-disk 3819968 4164274 0.92
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4033200 4160310 0.97
random-access/vortex-tokio-local-disk 1060577 1149832 0.92
random-access/vortex-tokio-local-disk-footer 1176925 1173545 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (-4.0%, low confidence) · DuckDB No clear signal (+6.1%, low confidence)
Vortex (geomean): 0.943x ➖
Parquet (geomean): 0.952x ➖
Shifts: Parquet (control) -4.8% · Median polish -5.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.964x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 123996574 121457981 1.02
appian_q02/datafusion:vortex-file-compressed 652780398 659403260 0.99
appian_q03/datafusion:vortex-file-compressed 363293079 360062907 1.01
appian_q04/datafusion:vortex-file-compressed 28111338175 29467212297 0.95
appian_q05/datafusion:vortex-file-compressed 273591336 292044294 0.94
appian_q06/datafusion:vortex-file-compressed 418392842 445410283 0.94
appian_q07/datafusion:vortex-file-compressed 452523587 485577344 0.93
appian_q08/datafusion:vortex-file-compressed 1855030809 1981294428 0.94
datafusion / parquet (1.005x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 131678543 132327317 1.00
appian_q02/datafusion:parquet 675078412 664562205 1.02
appian_q03/datafusion:parquet 356493367 355051315 1.00
appian_q04/datafusion:parquet 28147997966 27715813384 1.02
appian_q05/datafusion:parquet 284821143 287509075 0.99
appian_q06/datafusion:parquet 437182943 436659586 1.00
appian_q07/datafusion:parquet 457961833 453580302 1.01
appian_q08/datafusion:parquet 1841798027 1828814705 1.01
duckdb / vortex-file-compressed (0.922x ➖, 3↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 🚀 194014190 216294619 0.90
appian_q02/duckdb:vortex-file-compressed 622243949 670152535 0.93
appian_q03/duckdb:vortex-file-compressed 🚀 263102578 298885257 0.88
appian_q04/duckdb:vortex-file-compressed 1321369161 1406622131 0.94
appian_q05/duckdb:vortex-file-compressed 🚀 296317466 337382037 0.88
appian_q06/duckdb:vortex-file-compressed 795889238 825400018 0.96
appian_q07/duckdb:vortex-file-compressed 343024031 366934005 0.93
appian_q08/duckdb:vortex-file-compressed 1305460015 1368462109 0.95
duckdb / parquet (0.902x ➖, 3↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 🚀 204003273 235832486 0.87
appian_q02/duckdb:parquet 605329500 663889502 0.91
appian_q03/duckdb:parquet 🚀 284474913 331634974 0.86
appian_q04/duckdb:parquet 1331618046 1432729860 0.93
appian_q05/duckdb:parquet 🚀 308764671 362799701 0.85
appian_q06/duckdb:parquet 790190455 820266089 0.96
appian_q07/duckdb:parquet 365106873 394686276 0.93
appian_q08/duckdb:parquet 1269016286 1382606015 0.92
duckdb / duckdb (0.994x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 172563851 173564718 0.99
appian_q02/duckdb:duckdb 552197811 548105008 1.01
appian_q03/duckdb:duckdb 377625590 393839653 0.96
appian_q04/duckdb:duckdb 1306811807 1300997814 1.00
appian_q05/duckdb:duckdb 281723030 282635668 1.00
appian_q06/duckdb:duckdb 783655856 786057214 1.00
appian_q07/duckdb:duckdb 325131529 325962572 1.00
appian_q08/duckdb:duckdb 1214131570 1222294913 0.99

File Size Changes (4 files changed, -0.0% overall, 2↑ 2↓)
File Scale Format Base HEAD Change %
creditcardview.vortex 1.0 vortex-file-compressed 60.97 MB 61.04 MB +62.21 KB +0.1%
orderview.vortex 1.0 vortex-file-compressed 81.06 MB 81.12 MB +56.37 KB +0.1%
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB 8 B -0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 513.67 MB → 513.78 MB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-file-compressed +2.1% -7.2% +10.0% +14.1% ➖ noise
1 duckdb:duckdb -0.6% -7.2% +7.2% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -10.3% -7.2% -3.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.0% -3.8% +2.9% +10.0% ➖ noise
2 duckdb:duckdb +0.7% -3.8% +4.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -7.1% -3.8% -3.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.9% -7.2% +8.7% +10.0% ➖ noise
3 duckdb:duckdb -4.1% -7.2% +3.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -12.0% -7.2% -5.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -4.6% -2.8% -1.8% +10.0% ➖ noise
4 duckdb:duckdb +0.4% -2.8% +3.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -6.1% -2.8% -3.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -6.3% -8.2% +2.0% +12.1% ➖ noise
5 duckdb:duckdb -0.3% -8.2% +8.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -12.2% -8.2% -4.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -6.1% -1.8% -4.4% +10.0% ➖ noise
6 duckdb:duckdb -0.3% -1.8% +1.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.6% -1.8% -1.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -6.8% -3.4% -3.6% +10.0% ➖ noise
7 duckdb:duckdb -0.3% -3.4% +3.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -6.5% -3.4% -3.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -6.4% -3.9% -2.6% +10.0% ➖ noise
8 duckdb:duckdb -0.7% -3.9% +3.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -4.6% -3.9% -0.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.9%
Engines: DataFusion No clear signal (+6.3%, environment too noisy confidence) · DuckDB No clear signal (-2.4%, environment too noisy confidence)
Vortex (geomean): 1.021x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +2.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.013x ➖, 1↑ 4↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 253903858 254343018 1.00
tpch_q02/datafusion:vortex-file-compressed 470524391 570859177 0.82
tpch_q03/datafusion:vortex-file-compressed 🚨 591523402 443891681 1.33
tpch_q04/datafusion:vortex-file-compressed 331261205 290877242 1.14
tpch_q05/datafusion:vortex-file-compressed 600305211 536541719 1.12
tpch_q06/datafusion:vortex-file-compressed 384946833 397503974 0.97
tpch_q07/datafusion:vortex-file-compressed 🚨 779736484 576133908 1.35
tpch_q08/datafusion:vortex-file-compressed 784929282 733801829 1.07
tpch_q09/datafusion:vortex-file-compressed 550191163 633862975 0.87
tpch_q10/datafusion:vortex-file-compressed 🚀 722843627 1064365280 0.68
tpch_q11/datafusion:vortex-file-compressed 352573045 405578647 0.87
tpch_q12/datafusion:vortex-file-compressed 521322030 671240082 0.78
tpch_q13/datafusion:vortex-file-compressed 154192752 209184858 0.74
tpch_q14/datafusion:vortex-file-compressed 351554693 291514992 1.21
tpch_q15/datafusion:vortex-file-compressed 🚨 619233691 469728226 1.32
tpch_q16/datafusion:vortex-file-compressed 🚨 331284714 230757281 1.44
tpch_q17/datafusion:vortex-file-compressed 469531028 464013603 1.01
tpch_q18/datafusion:vortex-file-compressed 420488703 410203973 1.03
tpch_q19/datafusion:vortex-file-compressed 571441634 548571235 1.04
tpch_q20/datafusion:vortex-file-compressed 509607479 437858567 1.16
tpch_q21/datafusion:vortex-file-compressed 795675920 853932653 0.93
tpch_q22/datafusion:vortex-file-compressed 152580852 177961419 0.86
datafusion / vortex-compact (1.080x ➖, 1↑ 5↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 285266549 346190372 0.82
tpch_q02/datafusion:vortex-compact 593298228 544273775 1.09
tpch_q03/datafusion:vortex-compact 581902386 476001569 1.22
tpch_q04/datafusion:vortex-compact 272013203 248841333 1.09
tpch_q05/datafusion:vortex-compact 479527844 440368388 1.09
tpch_q06/datafusion:vortex-compact 🚨 455724102 289630973 1.57
tpch_q07/datafusion:vortex-compact 472778899 460170259 1.03
tpch_q08/datafusion:vortex-compact 654133652 755529153 0.87
tpch_q09/datafusion:vortex-compact 523120738 601789924 0.87
tpch_q10/datafusion:vortex-compact 488563987 631822280 0.77
tpch_q11/datafusion:vortex-compact 339676614 358256488 0.95
tpch_q12/datafusion:vortex-compact 475158603 465861048 1.02
tpch_q13/datafusion:vortex-compact 🚨 302870425 140402424 2.16
tpch_q14/datafusion:vortex-compact 314113941 382910559 0.82
tpch_q15/datafusion:vortex-compact 628061893 603028763 1.04
tpch_q16/datafusion:vortex-compact 🚀 189525510 287151361 0.66
tpch_q17/datafusion:vortex-compact 🚨 762656703 578707581 1.32
tpch_q18/datafusion:vortex-compact 🚨 566877732 340695389 1.66
tpch_q19/datafusion:vortex-compact 🚨 844967864 572227209 1.48
tpch_q20/datafusion:vortex-compact 607886401 506217115 1.20
tpch_q21/datafusion:vortex-compact 650610759 643666406 1.01
tpch_q22/datafusion:vortex-compact 170926957 178677209 0.96
datafusion / parquet (0.984x ➖, 3↑ 2↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 202217238 360827625 0.56
tpch_q02/datafusion:parquet 451752219 487376145 0.93
tpch_q03/datafusion:parquet 346231254 430253891 0.80
tpch_q04/datafusion:parquet 217055827 213161220 1.02
tpch_q05/datafusion:parquet 🚨 733322913 506009173 1.45
tpch_q06/datafusion:parquet 215000784 183491869 1.17
tpch_q07/datafusion:parquet 565651987 531924675 1.06
tpch_q08/datafusion:parquet 876451514 853527929 1.03
tpch_q09/datafusion:parquet 🚀 463465613 792868799 0.58
tpch_q10/datafusion:parquet 🚀 564328564 913960662 0.62
tpch_q11/datafusion:parquet 337286976 317169700 1.06
tpch_q12/datafusion:parquet 284108693 252630327 1.12
tpch_q13/datafusion:parquet 451362278 445061914 1.01
tpch_q14/datafusion:parquet 260118201 265042563 0.98
tpch_q15/datafusion:parquet 357881560 433850419 0.82
tpch_q16/datafusion:parquet 186198247 164713853 1.13
tpch_q17/datafusion:parquet 446472194 446573661 1.00
tpch_q18/datafusion:parquet 566983472 527051136 1.08
tpch_q19/datafusion:parquet 392071249 396624130 0.99
tpch_q20/datafusion:parquet 389763865 386804197 1.01
tpch_q21/datafusion:parquet 636152178 533505138 1.19
tpch_q22/datafusion:parquet 🚨 181833709 104908341 1.73
duckdb / vortex-file-compressed (0.977x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 325122455 325685356 1.00
tpch_q02/duckdb:vortex-file-compressed 1036244803 1183883648 0.88
tpch_q03/duckdb:vortex-file-compressed 667377626 770828913 0.87
tpch_q04/duckdb:vortex-file-compressed 519050021 488208254 1.06
tpch_q05/duckdb:vortex-file-compressed 1014866473 985847648 1.03
tpch_q06/duckdb:vortex-file-compressed 368071496 401047962 0.92
tpch_q07/duckdb:vortex-file-compressed 1110391586 938760285 1.18
tpch_q08/duckdb:vortex-file-compressed 1094339817 1068311369 1.02
tpch_q09/duckdb:vortex-file-compressed 1036761410 1012067085 1.02
tpch_q10/duckdb:vortex-file-compressed 874660763 852240069 1.03
tpch_q11/duckdb:vortex-file-compressed 467679856 571597232 0.82
tpch_q12/duckdb:vortex-file-compressed 673341594 750648704 0.90
tpch_q13/duckdb:vortex-file-compressed 517904272 529110708 0.98
tpch_q14/duckdb:vortex-file-compressed 376372260 465822959 0.81
tpch_q15/duckdb:vortex-file-compressed 307849831 328016642 0.94
tpch_q16/duckdb:vortex-file-compressed 377227068 341351159 1.11
tpch_q17/duckdb:vortex-file-compressed 838778658 699180146 1.20
tpch_q18/duckdb:vortex-file-compressed 595691488 635705984 0.94
tpch_q19/duckdb:vortex-file-compressed 509783127 582322682 0.88
tpch_q20/duckdb:vortex-file-compressed 836142696 880212408 0.95
tpch_q21/duckdb:vortex-file-compressed 1180370208 1134854092 1.04
tpch_q22/duckdb:vortex-file-compressed 319991750 304864217 1.05
duckdb / vortex-compact (1.017x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 358461659 323089023 1.11
tpch_q02/duckdb:vortex-compact 962838915 965397489 1.00
tpch_q03/duckdb:vortex-compact 695840329 660858130 1.05
tpch_q04/duckdb:vortex-compact 439628823 438931708 1.00
tpch_q05/duckdb:vortex-compact 873103090 919984084 0.95
tpch_q06/duckdb:vortex-compact 434171690 363036047 1.20
tpch_q07/duckdb:vortex-compact 847928040 969701744 0.87
tpch_q08/duckdb:vortex-compact 1080656537 1027897588 1.05
tpch_q09/duckdb:vortex-compact 1020251510 1014131098 1.01
tpch_q10/duckdb:vortex-compact 819294369 684454542 1.20
tpch_q11/duckdb:vortex-compact 600699862 509905419 1.18
tpch_q12/duckdb:vortex-compact 701014351 636238245 1.10
tpch_q13/duckdb:vortex-compact 435395867 368185570 1.18
tpch_q14/duckdb:vortex-compact 327267352 427386958 0.77
tpch_q15/duckdb:vortex-compact 274420220 330291088 0.83
tpch_q16/duckdb:vortex-compact 341925807 330990426 1.03
tpch_q17/duckdb:vortex-compact 715405167 753359324 0.95
tpch_q18/duckdb:vortex-compact 635533857 554774539 1.15
tpch_q19/duckdb:vortex-compact 509975895 530084718 0.96
tpch_q20/duckdb:vortex-compact 847100873 860615260 0.98
tpch_q21/duckdb:vortex-compact 1145399440 1103894956 1.04
tpch_q22/duckdb:vortex-compact 312801669 341659056 0.92
duckdb / parquet (1.021x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 503532746 466060847 1.08
tpch_q02/duckdb:parquet 1247692657 1184119314 1.05
tpch_q03/duckdb:parquet 981259009 957331988 1.02
tpch_q04/duckdb:parquet 749614660 740833110 1.01
tpch_q05/duckdb:parquet 1390929724 1315497904 1.06
tpch_q06/duckdb:parquet 415062766 523975637 0.79
tpch_q07/duckdb:parquet 1222713472 1186813598 1.03
tpch_q08/duckdb:parquet 1550646281 1464962585 1.06
tpch_q09/duckdb:parquet 1383190928 1453927670 0.95
tpch_q10/duckdb:parquet 1447383726 1752013447 0.83
tpch_q11/duckdb:parquet 694226962 734424896 0.95
tpch_q12/duckdb:parquet 815689828 654776248 1.25
tpch_q13/duckdb:parquet 1049920262 913434923 1.15
tpch_q14/duckdb:parquet 717704933 733246954 0.98
tpch_q15/duckdb:parquet 676429059 590935472 1.14
tpch_q16/duckdb:parquet 706213036 680488689 1.04
tpch_q17/duckdb:parquet 830663204 847111054 0.98
tpch_q18/duckdb:parquet 1053190570 919772415 1.15
tpch_q19/duckdb:parquet 888068228 826614543 1.07
tpch_q20/duckdb:parquet 1261890876 1227257452 1.03
tpch_q21/duckdb:parquet 1101887540 1206353290 0.91
tpch_q22/duckdb:parquet 651614258 625754504 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -17.6% -22.2% +5.9% +85.8% ➖ noise
1 datafusion:vortex-file-compressed -0.2% -22.2% +28.3% +72.5% ➖ noise
1 duckdb:vortex-compact +10.9% -22.2% +42.6% +70.7% ➖ noise
1 duckdb:vortex-file-compressed -0.2% -22.2% +28.3% +56.8% ➖ noise
2 datafusion:vortex-compact +9.0% -1.2% +10.3% +46.8% ➖ noise
2 datafusion:vortex-file-compressed -17.6% -1.2% -16.6% +46.8% ➖ noise
2 duckdb:vortex-compact -0.3% -1.2% +0.9% +46.8% ➖ noise
2 duckdb:vortex-file-compressed -12.5% -1.2% -11.4% +46.8% ➖ noise
3 datafusion:vortex-compact +22.2% -9.2% +34.6% +47.2% ➖ noise
3 datafusion:vortex-file-compressed +33.3% -9.2% +46.7% +65.6% ➖ noise
3 duckdb:vortex-compact +5.3% -9.2% +15.9% +46.8% ➖ noise
3 duckdb:vortex-file-compressed -13.4% -9.2% -4.7% +46.8% ➖ noise
4 datafusion:vortex-compact +9.3% +1.5% +7.7% +46.8% ➖ noise
4 datafusion:vortex-file-compressed +13.9% +1.5% +12.2% +46.8% ➖ noise
4 duckdb:vortex-compact +0.2% +1.5% -1.3% +46.8% ➖ noise
4 duckdb:vortex-file-compressed +6.3% +1.5% +4.7% +46.8% ➖ noise
5 datafusion:vortex-compact +8.9% +23.8% -12.0% +46.8% ➖ noise
5 datafusion:vortex-file-compressed +11.9% +23.8% -9.6% +46.8% ➖ noise
5 duckdb:vortex-compact -5.1% +23.8% -23.3% +46.8% ➖ noise
5 duckdb:vortex-file-compressed +2.9% +23.8% -16.8% +46.8% ➖ noise
6 datafusion:vortex-compact +57.3% -3.7% +63.3% +46.8% 🚨 regression
6 datafusion:vortex-file-compressed -3.2% -3.7% +0.5% +46.8% ➖ noise
6 duckdb:vortex-compact +19.6% -3.7% +24.1% +46.8% ➖ noise
6 duckdb:vortex-file-compressed -8.2% -3.7% -4.7% +46.8% ➖ noise
7 datafusion:vortex-compact +2.7% +4.7% -1.8% +46.8% ➖ noise
7 datafusion:vortex-file-compressed +35.3% +4.7% +29.3% +46.8% ➖ noise
7 duckdb:vortex-compact -12.6% +4.7% -16.5% +46.8% ➖ noise
7 duckdb:vortex-file-compressed +18.3% +4.7% +13.0% +46.8% ➖ noise
8 datafusion:vortex-compact -13.4% +4.3% -17.0% +46.8% ➖ noise
8 datafusion:vortex-file-compressed +7.0% +4.3% +2.6% +46.8% ➖ noise
8 duckdb:vortex-compact +5.1% +4.3% +0.8% +46.8% ➖ noise
8 duckdb:vortex-file-compressed +2.4% +4.3% -1.7% +46.8% ➖ noise
9 datafusion:vortex-compact -13.1% -25.4% +16.6% +46.8% ➖ noise
9 datafusion:vortex-file-compressed -13.2% -25.4% +16.4% +46.8% ➖ noise
9 duckdb:vortex-compact +0.6% -25.4% +34.9% +46.8% ➖ noise
9 duckdb:vortex-file-compressed +2.4% -25.4% +37.4% +46.8% ➖ noise
10 datafusion:vortex-compact -22.7% -28.6% +8.3% +46.8% ➖ noise
10 datafusion:vortex-file-compressed -32.1% -28.6% -4.9% +46.8% ➖ noise
10 duckdb:vortex-compact +19.7% -28.6% +67.6% +46.8% 🚨 regression
10 duckdb:vortex-file-compressed +2.6% -28.6% +43.7% +46.8% ➖ noise
11 datafusion:vortex-compact -5.2% +0.3% -5.4% +46.8% ➖ noise
11 datafusion:vortex-file-compressed -13.1% +0.3% -13.3% +46.8% ➖ noise
11 duckdb:vortex-compact +17.8% +0.3% +17.5% +46.8% ➖ noise
11 duckdb:vortex-file-compressed -18.2% +0.3% -18.4% +46.8% ➖ noise
12 datafusion:vortex-compact +2.0% +18.4% -13.8% +46.8% ➖ noise
12 datafusion:vortex-file-compressed -22.3% +18.4% -34.4% +46.8% ✅ faster
12 duckdb:vortex-compact +10.2% +18.4% -6.9% +46.8% ➖ noise
12 duckdb:vortex-file-compressed -10.3% +18.4% -24.2% +46.8% ➖ noise
13 datafusion:vortex-compact +115.7% +8.0% +99.8% +73.9% 🚨 regression
13 datafusion:vortex-file-compressed -26.3% +8.0% -31.7% +46.8% ➖ noise
13 duckdb:vortex-compact +18.3% +8.0% +9.5% +49.6% ➖ noise
13 duckdb:vortex-file-compressed -2.1% +8.0% -9.3% +46.8% ➖ noise
14 datafusion:vortex-compact -18.0% -2.0% -16.3% +46.8% ➖ noise
14 datafusion:vortex-file-compressed +20.6% -2.0% +23.0% +46.8% ➖ noise
14 duckdb:vortex-compact -23.4% -2.0% -21.9% +46.8% ➖ noise
14 duckdb:vortex-file-compressed -19.2% -2.0% -17.6% +46.8% ➖ noise
15 datafusion:vortex-compact +4.2% -2.8% +7.2% +46.8% ➖ noise
15 datafusion:vortex-file-compressed +31.8% -2.8% +35.7% +46.8% ➖ noise
15 duckdb:vortex-compact -16.9% -2.8% -14.5% +46.8% ➖ noise
15 duckdb:vortex-file-compressed -6.1% -2.8% -3.4% +46.8% ➖ noise
16 datafusion:vortex-compact -34.0% +8.3% -39.1% +46.8% ✅ faster
16 datafusion:vortex-file-compressed +43.6% +8.3% +32.5% +46.8% ➖ noise
16 duckdb:vortex-compact +3.3% +8.3% -4.6% +46.8% ➖ noise
16 duckdb:vortex-file-compressed +10.5% +8.3% +2.0% +46.8% ➖ noise
17 datafusion:vortex-compact +31.8% -1.0% +33.1% +46.8% ➖ noise
17 datafusion:vortex-file-compressed +1.2% -1.0% +2.2% +46.8% ➖ noise
17 duckdb:vortex-compact -5.0% -1.0% -4.1% +46.8% ➖ noise
17 duckdb:vortex-file-compressed +20.0% -1.0% +21.2% +46.8% ➖ noise
18 datafusion:vortex-compact +66.4% +11.0% +49.9% +53.8% ➖ noise
18 datafusion:vortex-file-compressed +2.5% +11.0% -7.6% +46.8% ➖ noise
18 duckdb:vortex-compact +14.6% +11.0% +3.2% +46.8% ➖ noise
18 duckdb:vortex-file-compressed -6.3% +11.0% -15.6% +46.8% ➖ noise
19 datafusion:vortex-compact +47.7% +3.1% +43.3% +46.8% ➖ noise
19 datafusion:vortex-file-compressed +4.2% +3.1% +1.1% +46.8% ➖ noise
19 duckdb:vortex-compact -3.8% +3.1% -6.6% +46.8% ➖ noise
19 duckdb:vortex-file-compressed -12.5% +3.1% -15.1% +46.8% ➖ noise
20 datafusion:vortex-compact +20.1% +1.8% +18.0% +46.8% ➖ noise
20 datafusion:vortex-file-compressed +16.4% +1.8% +14.3% +46.8% ➖ noise
20 duckdb:vortex-compact -1.6% +1.8% -3.3% +46.8% ➖ noise
20 duckdb:vortex-file-compressed -5.0% +1.8% -6.7% +46.8% ➖ noise
21 datafusion:vortex-compact +1.1% +4.4% -3.1% +46.8% ➖ noise
21 datafusion:vortex-file-compressed -6.8% +4.4% -10.7% +46.8% ➖ noise
21 duckdb:vortex-compact +3.8% +4.4% -0.6% +46.8% ➖ noise
21 duckdb:vortex-file-compressed +4.0% +4.4% -0.3% +46.8% ➖ noise
22 datafusion:vortex-compact -4.3% +34.3% -28.8% +46.8% ➖ noise
22 datafusion:vortex-file-compressed -14.3% +34.3% -36.2% +46.8% ✅ faster
22 duckdb:vortex-compact -8.4% +34.3% -31.9% +46.8% ➖ noise
22 duckdb:vortex-file-compressed +5.0% +34.3% -21.9% +46.8% ➖ noise

Comment thread vortex-layout/src/children.rs Outdated
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.6%
Engines: DataFusion No clear signal (-3.9%, environment too noisy confidence) · DuckDB No clear signal (-13.1%, environment too noisy confidence)
Vortex (geomean): 1.033x ➖
Parquet (geomean): 1.131x ➖
Shifts: Parquet (control) +13.1% · Median polish +8.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.147x ➖, 0↑ 5↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 708984135 688644481 1.03
tpch_q02/datafusion:vortex-file-compressed 🚨 1399504343 857603476 1.63
tpch_q03/datafusion:vortex-file-compressed 🚨 1230753211 845243002 1.46
tpch_q04/datafusion:vortex-file-compressed 721584905 591892680 1.22
tpch_q05/datafusion:vortex-file-compressed 1081471905 1014673984 1.07
tpch_q06/datafusion:vortex-file-compressed 673576562 585688089 1.15
tpch_q07/datafusion:vortex-file-compressed 1165985472 1049991067 1.11
tpch_q08/datafusion:vortex-file-compressed 🚨 1526476324 1169004048 1.31
tpch_q09/datafusion:vortex-file-compressed 1554878729 1539236836 1.01
tpch_q10/datafusion:vortex-file-compressed 1177239175 932719490 1.26
tpch_q11/datafusion:vortex-file-compressed 🚨 773474879 441670994 1.75
tpch_q12/datafusion:vortex-file-compressed 972387162 946302786 1.03
tpch_q13/datafusion:vortex-file-compressed 495555852 473640146 1.05
tpch_q14/datafusion:vortex-file-compressed 563013322 608138400 0.93
tpch_q15/datafusion:vortex-file-compressed 1045950962 1014877587 1.03
tpch_q16/datafusion:vortex-file-compressed 🚨 536574218 412061784 1.30
tpch_q17/datafusion:vortex-file-compressed 1244895282 1212419080 1.03
tpch_q18/datafusion:vortex-file-compressed 1265901746 1304196461 0.97
tpch_q19/datafusion:vortex-file-compressed 809084076 758580143 1.07
tpch_q20/datafusion:vortex-file-compressed 938386400 896011045 1.05
tpch_q21/datafusion:vortex-file-compressed 1800037410 1632853095 1.10
tpch_q22/datafusion:vortex-file-compressed 530798194 507407585 1.05
datafusion / vortex-compact (1.111x ➖, 1↑ 3↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 739536560 671970833 1.10
tpch_q02/datafusion:vortex-compact 997828564 824324182 1.21
tpch_q03/datafusion:vortex-compact 880667399 706228766 1.25
tpch_q04/datafusion:vortex-compact 499657294 490734588 1.02
tpch_q05/datafusion:vortex-compact 932598160 862391125 1.08
tpch_q06/datafusion:vortex-compact 641929763 574520680 1.12
tpch_q07/datafusion:vortex-compact 1125705726 945863044 1.19
tpch_q08/datafusion:vortex-compact 1388978690 1173777850 1.18
tpch_q09/datafusion:vortex-compact 1491843118 1204891145 1.24
tpch_q10/datafusion:vortex-compact 1106713523 890638821 1.24
tpch_q11/datafusion:vortex-compact 🚨 619767229 457779493 1.35
tpch_q12/datafusion:vortex-compact 806156185 802919270 1.00
tpch_q13/datafusion:vortex-compact 413175670 404504610 1.02
tpch_q14/datafusion:vortex-compact 492967737 606228596 0.81
tpch_q15/datafusion:vortex-compact 1162777004 1073698733 1.08
tpch_q16/datafusion:vortex-compact 🚀 472296825 816823203 0.58
tpch_q17/datafusion:vortex-compact 🚨 1543245203 1164933625 1.32
tpch_q18/datafusion:vortex-compact 1169918966 1166032310 1.00
tpch_q19/datafusion:vortex-compact 972555231 846218910 1.15
tpch_q20/datafusion:vortex-compact 984840953 889547513 1.11
tpch_q21/datafusion:vortex-compact 1624987625 1552361176 1.05
tpch_q22/datafusion:vortex-compact 🚨 841449513 460462621 1.83
datafusion / parquet (1.174x ➖, 0↑ 3↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 935847627 818785627 1.14
tpch_q02/datafusion:parquet 🚨 1401147840 819343503 1.71
tpch_q03/datafusion:parquet 1170839333 975547897 1.20
tpch_q04/datafusion:parquet 561508452 498167381 1.13
tpch_q05/datafusion:parquet 1315025993 1204874223 1.09
tpch_q06/datafusion:parquet 592560757 554851678 1.07
tpch_q07/datafusion:parquet 1252254710 1347074245 0.93
tpch_q08/datafusion:parquet 1638098348 1531012460 1.07
tpch_q09/datafusion:parquet 1865819525 1855096736 1.01
tpch_q10/datafusion:parquet 2097430469 2088207646 1.00
tpch_q11/datafusion:parquet 844214404 815151613 1.04
tpch_q12/datafusion:parquet 731102917 607152319 1.20
tpch_q13/datafusion:parquet 796705777 663531569 1.20
tpch_q14/datafusion:parquet 871212627 762936326 1.14
tpch_q15/datafusion:parquet 1393015913 1242283823 1.12
tpch_q16/datafusion:parquet 🚨 600866323 336692965 1.78
tpch_q17/datafusion:parquet 1648896888 1329887388 1.24
tpch_q18/datafusion:parquet 1890200326 1598196605 1.18
tpch_q19/datafusion:parquet 998916137 899493417 1.11
tpch_q20/datafusion:parquet 1284088609 1329922811 0.97
tpch_q21/datafusion:parquet 2129402850 1757512519 1.21
tpch_q22/datafusion:parquet 🚨 1519931321 897006795 1.69
duckdb / vortex-file-compressed (0.991x ➖, 0↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 667814537 614090098 1.09
tpch_q02/duckdb:vortex-file-compressed 1270438691 1227560861 1.03
tpch_q03/duckdb:vortex-file-compressed 1065012243 982603154 1.08
tpch_q04/duckdb:vortex-file-compressed 872248023 837488940 1.04
tpch_q05/duckdb:vortex-file-compressed 1198243018 1319591991 0.91
tpch_q06/duckdb:vortex-file-compressed 573599138 641804824 0.89
tpch_q07/duckdb:vortex-file-compressed 1340093067 1381574506 0.97
tpch_q08/duckdb:vortex-file-compressed 1637115777 1580856414 1.04
tpch_q09/duckdb:vortex-file-compressed 1903058710 1804636590 1.05
tpch_q10/duckdb:vortex-file-compressed 1338804302 1302282829 1.03
tpch_q11/duckdb:vortex-file-compressed 636039408 653270352 0.97
tpch_q12/duckdb:vortex-file-compressed 1367913517 1254303744 1.09
tpch_q13/duckdb:vortex-file-compressed 892409442 919112368 0.97
tpch_q14/duckdb:vortex-file-compressed 639314537 764464829 0.84
tpch_q15/duckdb:vortex-file-compressed 607817290 619543330 0.98
tpch_q16/duckdb:vortex-file-compressed 544088550 538996723 1.01
tpch_q17/duckdb:vortex-file-compressed 1041378910 1017046797 1.02
tpch_q18/duckdb:vortex-file-compressed 971802773 1100677054 0.88
tpch_q19/duckdb:vortex-file-compressed 797274913 812048615 0.98
tpch_q20/duckdb:vortex-file-compressed 1330162950 1317379825 1.01
tpch_q21/duckdb:vortex-file-compressed 2045539119 2086202298 0.98
tpch_q22/duckdb:vortex-file-compressed 472269454 490730948 0.96
duckdb / vortex-compact (0.903x ➖, 1↑ 0↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 609472915 684571370 0.89
tpch_q02/duckdb:vortex-compact 1066310763 1265609431 0.84
tpch_q03/duckdb:vortex-compact 856392885 980116529 0.87
tpch_q04/duckdb:vortex-compact 537948203 635326505 0.85
tpch_q05/duckdb:vortex-compact 1147041929 1175499507 0.98
tpch_q06/duckdb:vortex-compact 509439669 597484892 0.85
tpch_q07/duckdb:vortex-compact 1165290055 1298461480 0.90
tpch_q08/duckdb:vortex-compact 1486003659 1536638927 0.97
tpch_q09/duckdb:vortex-compact 1650016737 1698033446 0.97
tpch_q10/duckdb:vortex-compact 1045485048 1205777615 0.87
tpch_q11/duckdb:vortex-compact 646625615 772241529 0.84
tpch_q12/duckdb:vortex-compact 1073782679 1086032446 0.99
tpch_q13/duckdb:vortex-compact 941673888 812117012 1.16
tpch_q14/duckdb:vortex-compact 615616813 768750268 0.80
tpch_q15/duckdb:vortex-compact 525743590 574066849 0.92
tpch_q16/duckdb:vortex-compact 451895927 423752993 1.07
tpch_q17/duckdb:vortex-compact 901210343 1033751122 0.87
tpch_q18/duckdb:vortex-compact 792681873 883832967 0.90
tpch_q19/duckdb:vortex-compact 797092647 845870346 0.94
tpch_q20/duckdb:vortex-compact 1144410192 1264818305 0.90
tpch_q21/duckdb:vortex-compact 1731690187 1801079854 0.96
tpch_q22/duckdb:vortex-compact 🚀 455751904 701803141 0.65
duckdb / parquet (1.089x ➖, 0↑ 2↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 958843987 803678160 1.19
tpch_q02/duckdb:parquet 1403927513 1365918892 1.03
tpch_q03/duckdb:parquet 2329687621 2058355418 1.13
tpch_q04/duckdb:parquet 1248186873 1075795850 1.16
tpch_q05/duckdb:parquet 🚨 2422480502 1859542486 1.30
tpch_q06/duckdb:parquet 845422112 758388194 1.11
tpch_q07/duckdb:parquet 2017959877 1744650525 1.16
tpch_q08/duckdb:parquet 🚨 3045178522 2277277756 1.34
tpch_q09/duckdb:parquet 2836124992 2581241276 1.10
tpch_q10/duckdb:parquet 3429991913 3056695579 1.12
tpch_q11/duckdb:parquet 1066116723 980856893 1.09
tpch_q12/duckdb:parquet 1391191949 1133960243 1.23
tpch_q13/duckdb:parquet 1446246427 1256252881 1.15
tpch_q14/duckdb:parquet 1317434801 1320068957 1.00
tpch_q15/duckdb:parquet 1026559930 1132478980 0.91
tpch_q16/duckdb:parquet 900759952 1047428213 0.86
tpch_q17/duckdb:parquet 1424351354 1360179174 1.05
tpch_q18/duckdb:parquet 1672017451 1596416883 1.05
tpch_q19/duckdb:parquet 1810853836 1793634127 1.01
tpch_q20/duckdb:parquet 2241334482 2210633185 1.01
tpch_q21/duckdb:parquet 2013505176 1827450901 1.10
tpch_q22/duckdb:parquet 1198119569 1214170553 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +10.1% +16.8% -5.8% +51.2% ➖ noise
1 datafusion:vortex-file-compressed +3.0% +16.8% -11.8% +54.9% ➖ noise
1 duckdb:vortex-compact -11.0% +16.8% -23.8% +34.8% ➖ noise
1 duckdb:vortex-file-compressed +8.7% +16.8% -6.9% +40.3% ➖ noise
2 datafusion:vortex-compact +21.0% +32.6% -8.7% +48.4% ➖ noise
2 datafusion:vortex-file-compressed +63.2% +32.6% +23.1% +30.0% ➖ noise
2 duckdb:vortex-compact -15.7% +32.6% -36.5% +30.0% ✅ faster
2 duckdb:vortex-file-compressed +3.5% +32.6% -21.9% +32.9% ➖ noise
3 datafusion:vortex-compact +24.7% +16.6% +7.0% +47.4% ➖ noise
3 datafusion:vortex-file-compressed +45.6% +16.6% +24.9% +47.0% ➖ noise
3 duckdb:vortex-compact -12.6% +16.6% -25.0% +39.9% ➖ noise
3 duckdb:vortex-file-compressed +8.4% +16.6% -7.0% +41.2% ➖ noise
4 datafusion:vortex-compact +1.8% +14.4% -11.0% +33.0% ➖ noise
4 datafusion:vortex-file-compressed +21.9% +14.4% +6.6% +30.0% ➖ noise
4 duckdb:vortex-compact -15.3% +14.4% -26.0% +30.0% ✅ faster
4 duckdb:vortex-file-compressed +4.2% +14.4% -8.9% +30.0% ➖ noise
5 datafusion:vortex-compact +8.1% +19.2% -9.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +6.6% +19.2% -10.6% +30.0% ➖ noise
5 duckdb:vortex-compact -2.4% +19.2% -18.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -9.2% +19.2% -23.8% +30.0% ✅ faster
6 datafusion:vortex-compact +11.7% +9.1% +2.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +15.0% +9.1% +5.4% +30.0% ➖ noise
6 duckdb:vortex-compact -14.7% +9.1% -21.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -10.6% +9.1% -18.1% +30.0% ➖ noise
7 datafusion:vortex-compact +19.0% +3.7% +14.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +11.0% +3.7% +7.1% +30.0% ➖ noise
7 duckdb:vortex-compact -10.3% +3.7% -13.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -3.0% +3.7% -6.5% +30.0% ➖ noise
8 datafusion:vortex-compact +18.3% +19.6% -1.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +30.6% +19.6% +9.2% +30.0% ➖ noise
8 duckdb:vortex-compact -3.3% +19.6% -19.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +3.6% +19.6% -13.4% +30.0% ➖ noise
9 datafusion:vortex-compact +23.8% +5.1% +17.8% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +1.0% +5.1% -3.9% +30.0% ➖ noise
9 duckdb:vortex-compact -2.8% +5.1% -7.6% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +5.5% +5.1% +0.3% +30.0% ➖ noise
10 datafusion:vortex-compact +24.3% +6.2% +17.0% +48.2% ➖ noise
10 datafusion:vortex-file-compressed +26.2% +6.2% +18.9% +39.2% ➖ noise
10 duckdb:vortex-compact -13.3% +6.2% -18.3% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +2.8% +6.2% -3.2% +30.0% ➖ noise
11 datafusion:vortex-compact +35.4% +6.1% +27.6% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +75.1% +6.1% +65.1% +39.9% 🚨 regression
11 duckdb:vortex-compact -16.3% +6.1% -21.1% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -2.6% +6.1% -8.2% +30.0% ➖ noise
12 datafusion:vortex-compact +0.4% +21.5% -17.4% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +2.8% +21.5% -15.5% +30.0% ➖ noise
12 duckdb:vortex-compact -1.1% +21.5% -18.7% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +9.1% +21.5% -10.3% +30.0% ➖ noise
13 datafusion:vortex-compact +2.1% +17.6% -13.1% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +4.6% +17.6% -11.0% +32.3% ➖ noise
13 duckdb:vortex-compact +16.0% +17.6% -1.4% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -2.9% +17.6% -17.4% +30.0% ➖ noise
14 datafusion:vortex-compact -18.7% +6.8% -23.8% +30.0% ✅ faster
14 datafusion:vortex-file-compressed -7.4% +6.8% -13.3% +30.0% ➖ noise
14 duckdb:vortex-compact -19.9% +6.8% -25.0% +30.0% ✅ faster
14 duckdb:vortex-file-compressed -16.4% +6.8% -21.7% +30.0% ➖ noise
15 datafusion:vortex-compact +8.3% +0.8% +7.4% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +3.1% +0.8% +2.2% +30.0% ➖ noise
15 duckdb:vortex-compact -8.4% +0.8% -9.2% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -1.9% +0.8% -2.7% +30.0% ➖ noise
16 datafusion:vortex-compact -42.2% +23.9% -53.3% +41.7% ✅ faster
16 datafusion:vortex-file-compressed +30.2% +23.9% +5.1% +30.0% ➖ noise
16 duckdb:vortex-compact +6.6% +23.9% -13.9% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +0.9% +23.9% -18.5% +30.0% ➖ noise
17 datafusion:vortex-compact +32.5% +13.9% +16.3% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +2.7% +13.9% -9.9% +30.0% ➖ noise
17 duckdb:vortex-compact -12.8% +13.9% -23.5% +30.0% ✅ faster
17 duckdb:vortex-file-compressed +2.4% +13.9% -10.1% +30.0% ➖ noise
18 datafusion:vortex-compact +0.3% +11.3% -9.9% +30.2% ➖ noise
18 datafusion:vortex-file-compressed -2.9% +11.3% -12.8% +30.0% ➖ noise
18 duckdb:vortex-compact -10.3% +11.3% -19.4% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -11.7% +11.3% -20.7% +30.0% ➖ noise
19 datafusion:vortex-compact +14.9% +5.9% +8.5% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +6.7% +5.9% +0.7% +30.0% ➖ noise
19 duckdb:vortex-compact -5.8% +5.9% -11.0% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -1.8% +5.9% -7.3% +30.0% ➖ noise
20 datafusion:vortex-compact +10.7% -1.1% +11.9% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +4.7% -1.1% +5.8% +30.0% ➖ noise
20 duckdb:vortex-compact -9.5% -1.1% -8.6% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +1.0% -1.1% +2.1% +30.0% ➖ noise
21 datafusion:vortex-compact +4.7% +15.5% -9.4% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +10.2% +15.5% -4.6% +30.0% ➖ noise
21 duckdb:vortex-compact -3.9% +15.5% -16.8% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -1.9% +15.5% -15.1% +30.0% ➖ noise
22 datafusion:vortex-compact +82.7% +29.3% +41.3% +34.2% 🚨 regression
22 datafusion:vortex-file-compressed +4.6% +29.3% -19.1% +30.8% ➖ noise
22 duckdb:vortex-compact -35.1% +29.3% -49.8% +33.8% ✅ faster
22 duckdb:vortex-file-compressed -3.8% +29.3% -25.6% +30.0% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 3, 2026

Benchmarks: Compression

Vortex (geomean): 0.996x ➖
Parquet (geomean): 1.000x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (0.999x ➖, 1↑ 6↓)
name PR 64b2473 (ns) base 66335d4 (ns) ratio (PR/base)
compress time/Arade 1099634038 1140749077 0.96
compress time/Bimbo 5558388867 5789806543 0.96
compress time/CMSprovider 2736501210 2819919698 0.97
compress time/Euro2016 475873185 478118391 1.00
compress time/Food 344402545 381212506 0.90
compress time/HashTags 854652298 881249067 0.97
compress time/TPC-H l_comment canonical 1229767127 1259676085 0.98
compress time/TPC-H l_comment chunked 1229995500 1236403020 0.99
compress time/taxi 670228317 691582659 0.97
compress time/wide table cols=100 chunks=1 rows=1000 11707733 11651559 1.00
compress time/wide table cols=100 chunks=50 rows=1000 11912482 12191880 0.98
compress time/wide table cols=1000 chunks=1 rows=1000 127789008 124672310 1.02
compress time/wide table cols=1000 chunks=50 rows=1000 135276458 134787803 1.00
compress time/wide table cols=10000 chunks=1 rows=1000 1502012159 1482933720 1.01
compress time/wide table cols=10000 chunks=50 rows=1000 1469612033 1499531934 0.98
decompress time/Arade 25363767 27081984 0.94
decompress time/Bimbo 76051154 77623235 0.98
decompress time/CMSprovider 76720286 74920259 1.02
decompress time/Euro2016 19838257 19973776 0.99
decompress time/Food 8286633 8720311 0.95
decompress time/HashTags 89789735 89856733 1.00
decompress time/TPC-H l_comment canonical 40789466 39251346 1.04
decompress time/TPC-H l_comment chunked 38944925 40880641 0.95
decompress time/taxi 14190222 14903089 0.95
decompress time/wide table cols=100 chunks=1 rows=1000 2735861 2552798 1.07
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 2966281 2679069 1.11
decompress time/wide table cols=1000 chunks=1 rows=1000 24960602 23920788 1.04
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 27944374 23990427 1.16
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 275937994 248078793 1.11
decompress time/wide table cols=10000 chunks=50 rows=1000 258329780 267437582 0.97
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2630231480 2635495336 1.00
parquet_rs-zstd compress time/Bimbo 12859426472 13313384713 0.97
parquet_rs-zstd compress time/CMSprovider 6895152592 6875239185 1.00
parquet_rs-zstd compress time/Euro2016 1302013762 1338094600 0.97
parquet_rs-zstd compress time/Food 784195787 808729767 0.97
parquet_rs-zstd compress time/HashTags 2140441031 2251975849 0.95
parquet_rs-zstd compress time/TPC-H l_comment canonical 3192782341 3244658902 0.98
parquet_rs-zstd compress time/TPC-H l_comment chunked 3195431525 3269580333 0.98
parquet_rs-zstd compress time/taxi 1191814385 1201675655 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6260098 6195661 1.01
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 7489360 6005873 1.25
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 75855999 76309416 0.99
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 79643284 77436598 1.03
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 808997208 807203900 1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 815019106 785235596 1.04
parquet_rs-zstd decompress time/Arade 620792682 642295380 0.97
parquet_rs-zstd decompress time/Bimbo 1708542917 1728045097 0.99
parquet_rs-zstd decompress time/CMSprovider 1694860866 1702256476 1.00
parquet_rs-zstd decompress time/Euro2016 374390778 381773268 0.98
parquet_rs-zstd decompress time/Food 196211802 197344348 0.99
parquet_rs-zstd decompress time/HashTags 626955023 666058675 0.94
parquet_rs-zstd decompress time/TPC-H l_comment canonical 593826900 594500308 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked 595107530 595525767 1.00
parquet_rs-zstd decompress time/taxi 244553717 245660952 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2825078 2849690 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚨 3121887 2767857 1.13
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 33053733 32108279 1.03
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 36296604 33195807 1.09
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 346813353 349435166 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 352820288 349716013 1.01
vortex-file-compressed size/Arade 145363860 145363860 1.00
vortex-file-compressed size/Bimbo 468763396 468763396 1.00
vortex-file-compressed size/CMSprovider 417903916 417861268 1.00
vortex-file-compressed size/Euro2016 158436660 157961292 1.00
vortex-file-compressed size/Food 41927000 41927000 1.00
vortex-file-compressed size/HashTags 184978556 184712596 1.00
vortex-file-compressed size/TPC-H l_comment canonical 178439208 178454744 1.00
vortex-file-compressed size/TPC-H l_comment chunked 178402520 178262464 1.00
vortex-file-compressed size/taxi 52364012 52364012 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.97
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.97
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.02
vortex:parquet-zstd ratio compress time/Food 0 0 0.93
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio compress time/taxi 0 0 0.98
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚀 1 2 0.78
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.94
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.97
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio decompress time/Food 0 0 0.96
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.06
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.04
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.95
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.08
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.07
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.96
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@joseph-isaacs joseph-isaacs disabled auto-merge June 3, 2026 13:55
@myrrc myrrc enabled auto-merge (squash) June 3, 2026 13:59
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc myrrc force-pushed the myrrc/viewed-layout-children-cache branch from 8f6d4ab to 058a3fb Compare June 3, 2026 14:04
@myrrc myrrc disabled auto-merge June 3, 2026 14:44
@myrrc myrrc merged commit 9daf90f into develop Jun 3, 2026
82 of 87 checks passed
@myrrc myrrc deleted the myrrc/viewed-layout-children-cache branch June 3, 2026 14:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Tracking Issue: random access Lance parity

2 participants