Skip to content

Expression pushdown for duckdb#7727

Draft
myrrc wants to merge 1 commit intodevelopfrom
myrrc/duckdb-pushdown-expression
Draft

Expression pushdown for duckdb#7727
myrrc wants to merge 1 commit intodevelopfrom
myrrc/duckdb-pushdown-expression

Conversation

@myrrc
Copy link
Copy Markdown
Contributor

@myrrc myrrc commented Apr 30, 2026

  • Support expression pushdown similarly to how it's done for
    filter pushdown.
  • Support pushing down ~~ (LIKE), !~~ (NOT LIKE), and struct_extract (get_item) functions.
  • Support NOT IN pushdown.

@myrrc myrrc added changelog/feature A new feature ext/duckdb Relates to the DuckDB integration labels Apr 30, 2026
@myrrc myrrc force-pushed the myrrc/duckdb-pushdown-expression branch from 0f6d6f3 to 87d7c5a Compare April 30, 2026 11:44
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 30, 2026

Merging this PR will degrade performance by 10.6%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 2 improved benchmarks
❌ 1 regressed benchmark
✅ 1195 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime dynamic_dispatch_u32[10M] 161.8 µs 110.6 µs +46.3%
WallTime 10M_50%[5000000] 308.4 µs 279.1 µs +10.48%
Simulation bitwise_not_vortex_buffer_mut[128] 246.1 ns 275.3 ns -10.6%

Comparing myrrc/duckdb-pushdown-expression (86ce16f) with develop (128ce5f)

Open in CodSpeed

Signed-off-by: Mikhail Kot <to@myrrc.dev>
@myrrc myrrc force-pushed the myrrc/duckdb-pushdown-expression branch from 90f46e6 to 86ce16f Compare April 30, 2026 15:25
@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 30, 2026
@github-actions github-actions Bot removed action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 30, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 86ce16f 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.169x ❌


datafusion / vortex-file-compressed (1.169x ❌, 0↑ 8↓)
name PR 86ce16f (ns) base c73dbb2 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 133154099 125087611 1.06
polarsignals_q01/datafusion:vortex-file-compressed 304278268 278672894 1.09
polarsignals_q02/datafusion:vortex-file-compressed 🚨 26788281 23688507 1.13
polarsignals_q03/datafusion:vortex-file-compressed 🚨 350531047 264692259 1.32
polarsignals_q04/datafusion:vortex-file-compressed 🚨 14171689 11855503 1.20
polarsignals_q05/datafusion:vortex-file-compressed 🚨 18907235 15961327 1.18
polarsignals_q06/datafusion:vortex-file-compressed 🚨 21814763 19033353 1.15
polarsignals_q07/datafusion:vortex-file-compressed 🚨 17796806 14260932 1.25
polarsignals_q08/datafusion:vortex-file-compressed 🚨 420817459 356479269 1.18
polarsignals_q09/datafusion:vortex-file-compressed 🚨 13118048 11456358 1.15

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=1 on NVME failed! Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 1.036x ➖
Parquet (geomean): 1.039x ➖
Shifts: Parquet (control) +3.9% · Median polish +1.4%


datafusion / vortex-file-compressed (1.075x ➖, 0↑ 4↓)
name PR 86ce16f (ns) base c73dbb2 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5861038 4885602 1.20
fineweb_q01/datafusion:vortex-file-compressed 🚨 25463402 20863960 1.22
fineweb_q02/datafusion:vortex-file-compressed 🚨 23775744 21287988 1.12
fineweb_q03/datafusion:vortex-file-compressed 🚨 81858659 71117417 1.15
fineweb_q04/datafusion:vortex-file-compressed 235618944 233012822 1.01
fineweb_q05/datafusion:vortex-file-compressed 219495476 217326768 1.01
fineweb_q06/datafusion:vortex-file-compressed 53452609 51386781 1.04
fineweb_q07/datafusion:vortex-file-compressed 57970198 61870933 0.94
fineweb_q08/datafusion:vortex-file-compressed 22236357 21676200 1.03
datafusion / vortex-compact (1.025x ➖, 0↑ 1↓)
name PR 86ce16f (ns) base c73dbb2 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 6503276 5472925 1.19
fineweb_q01/datafusion:vortex-compact 127902864 126604786 1.01
fineweb_q02/datafusion:vortex-compact 126186705 128090474 0.99
fineweb_q03/datafusion:vortex-compact 1029734499 1030214771 1.00
fineweb_q04/datafusion:vortex-compact 1113308740 1113015145 1.00
fineweb_q05/datafusion:vortex-compact 984449208 946760498 1.04
fineweb_q06/datafusion:vortex-compact 531990679 512885544 1.04
fineweb_q07/datafusion:vortex-compact 543798632 534405406 1.02
fineweb_q08/datafusion:vortex-compact 18619293 19327458 0.96
datafusion / parquet (1.024x ➖, 0↑ 0↓)
name PR 86ce16f (ns) base c73dbb2 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6672671 6588518 1.01
fineweb_q01/datafusion:parquet 283600316 284871339 1.00
fineweb_q02/datafusion:parquet 287293620 286821280 1.00
fineweb_q03/datafusion:parquet 294155999 280890950 1.05
fineweb_q04/datafusion:parquet 307503282 290335366 1.06
fineweb_q05/datafusion:parquet 299608834 291286082 1.03
fineweb_q06/datafusion:parquet 291464223 290604421 1.00
fineweb_q07/datafusion:parquet 286988847 279936717 1.03
fineweb_q08/datafusion:parquet 281542666 270593319 1.04
duckdb / vortex-file-compressed (1.039x ➖, 0↑ 0↓)
name PR 86ce16f (ns) base c73dbb2 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3429591 3153211 1.09
fineweb_q01/duckdb:vortex-file-compressed 21851881 22405305 0.98
fineweb_q02/duckdb:vortex-file-compressed 24160360 22540016 1.07
fineweb_q03/duckdb:vortex-file-compressed 158563775 158841247 1.00
fineweb_q04/duckdb:vortex-file-compressed 221906283 217167093 1.02
fineweb_q05/duckdb:vortex-file-compressed 211726141 210185173 1.01
fineweb_q06/duckdb:vortex-file-compressed 54411043 51142949 1.06
fineweb_q07/duckdb:vortex-file-compressed 58129429 54469187 1.07
fineweb_q08/duckdb:vortex-file-compressed 23574428 22195504 1.06
duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR 86ce16f (ns) base c73dbb2 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3861033 3978549 0.97
fineweb_q01/duckdb:vortex-compact 106158850 106223229 1.00
fineweb_q02/duckdb:vortex-compact 109124036 113043609 0.97
fineweb_q03/duckdb:vortex-compact 857350115 864491341 0.99
fineweb_q04/duckdb:vortex-compact 910859636 899709969 1.01
fineweb_q05/duckdb:vortex-compact 815011579 810897936 1.01
fineweb_q06/duckdb:vortex-compact 461896818 451383412 1.02
fineweb_q07/duckdb:vortex-compact 479773355 478767005 1.00
fineweb_q08/duckdb:vortex-compact 20471473 18879765 1.08
duckdb / parquet (1.054x ➖, 0↑ 2↓)
name PR 86ce16f (ns) base c73dbb2 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 31585437 27739520 1.14
fineweb_q01/duckdb:parquet 86727869 81169624 1.07
fineweb_q02/duckdb:parquet 83871409 81967568 1.02
fineweb_q03/duckdb:parquet 310380371 305955279 1.01
fineweb_q04/duckdb:parquet 438613985 436719605 1.00
fineweb_q05/duckdb:parquet 413327110 408704846 1.01
fineweb_q06/duckdb:parquet 203115680 197693067 1.03
fineweb_q07/duckdb:parquet 212664081 207493080 1.02
fineweb_q08/duckdb:parquet 🚨 33199538 27981680 1.19
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +18.8% +7.4% +10.7% +53.3% ➖ noise
0 datafusion:vortex-file-compressed +20.0% +7.4% +11.7% +50.7% ➖ noise
0 duckdb:vortex-compact -3.0% +7.4% -9.6% +108.0% ➖ noise
0 duckdb:vortex-file-compressed +8.8% +7.4% +1.3% +85.8% ➖ noise
1 datafusion:vortex-compact +1.0% +3.1% -2.0% +10.4% ➖ noise
1 datafusion:vortex-file-compressed +22.0% +3.1% +18.3% +17.8% 🚨 regression
1 duckdb:vortex-compact -0.1% +3.1% -3.1% +16.7% ➖ noise
1 duckdb:vortex-file-compressed -2.5% +3.1% -5.4% +68.1% ➖ noise
2 datafusion:vortex-compact -1.5% +1.2% -2.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +11.7% +1.2% +10.3% +10.0% 🚨 regression
2 duckdb:vortex-compact -3.5% +1.2% -4.6% +19.6% ➖ noise
2 duckdb:vortex-file-compressed +7.2% +1.2% +5.9% +10.0% ➖ noise
3 datafusion:vortex-compact -0.0% +3.1% -3.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +15.1% +3.1% +11.7% +66.5% ➖ noise
3 duckdb:vortex-compact -0.8% +3.1% -3.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.2% +3.1% -3.1% +35.5% ➖ noise
4 datafusion:vortex-compact +0.0% +3.1% -3.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.1% +3.1% -2.0% +11.6% ➖ noise
4 duckdb:vortex-compact +1.2% +3.1% -1.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.2% +3.1% -0.9% +10.0% ➖ noise
5 datafusion:vortex-compact +4.0% +2.0% +2.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.0% +2.0% -1.0% +10.0% ➖ noise
5 duckdb:vortex-compact +0.5% +2.0% -1.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.7% +2.0% -1.2% +10.0% ➖ noise
6 datafusion:vortex-compact +3.7% +1.5% +2.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +4.0% +1.5% +2.5% +10.0% ➖ noise
6 duckdb:vortex-compact +2.3% +1.5% +0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +6.4% +1.5% +4.8% +10.0% ➖ noise
7 datafusion:vortex-compact +1.8% +2.5% -0.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -6.3% +2.5% -8.6% +41.6% ➖ noise
7 duckdb:vortex-compact +0.2% +2.5% -2.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +6.7% +2.5% +4.1% +10.0% ➖ noise
8 datafusion:vortex-compact -3.7% +11.1% -13.3% +55.1% ➖ noise
8 datafusion:vortex-file-compressed +2.6% +11.1% -7.7% +10.7% ➖ noise
8 duckdb:vortex-compact +8.4% +11.1% -2.4% +42.1% ➖ noise
8 duckdb:vortex-file-compressed +6.2% +11.1% -4.4% +11.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.0%
Vortex (geomean): 1.062x ➖
Parquet (geomean): 1.028x ➖
Shifts: Parquet (control) +2.8% · Median polish +4.0%


datafusion / vortex-file-compressed (1.057x ➖, 0↑ 12↓)
name PR 86ce16f (ns) base 40112f4 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨 27887258 25287529 1.10
tpcds_q02/datafusion:vortex-file-compressed 50206163 46823668 1.07
tpcds_q03/datafusion:vortex-file-compressed 16312384 15527213 1.05
tpcds_q04/datafusion:vortex-file-compressed 🚨 273258555 248117960 1.10
tpcds_q05/datafusion:vortex-file-compressed 45105567 44022880 1.02
tpcds_q06/datafusion:vortex-file-compressed 59272572 58667904 1.01
tpcds_q07/datafusion:vortex-file-compressed 43229336 41452044 1.04
tpcds_q08/datafusion:vortex-file-compressed 29696915 28411004 1.05
tpcds_q09/datafusion:vortex-file-compressed 44974951 43678992 1.03
tpcds_q10/datafusion:vortex-file-compressed 40233762 38457064 1.05
tpcds_q11/datafusion:vortex-file-compressed 🚨 140730258 124485048 1.13
tpcds_q12/datafusion:vortex-file-compressed 19940155 18766989 1.06
tpcds_q13/datafusion:vortex-file-compressed 46041693 43600462 1.06
tpcds_q14/datafusion:vortex-file-compressed 174086005 170398910 1.02
tpcds_q15/datafusion:vortex-file-compressed 29227771 27438871 1.07
tpcds_q16/datafusion:vortex-file-compressed 🚨 31562256 28164889 1.12
tpcds_q17/datafusion:vortex-file-compressed 66343339 62717775 1.06
tpcds_q18/datafusion:vortex-file-compressed 70982253 66915393 1.06
tpcds_q19/datafusion:vortex-file-compressed 23147348 22219791 1.04
tpcds_q20/datafusion:vortex-file-compressed 22970370 21116298 1.09
tpcds_q21/datafusion:vortex-file-compressed 🚨 38922306 34648260 1.12
tpcds_q22/datafusion:vortex-file-compressed 121070529 115975485 1.04
tpcds_q23/datafusion:vortex-file-compressed 162570978 152436853 1.07
tpcds_q24/datafusion:vortex-file-compressed 88473233 84472198 1.05
tpcds_q25/datafusion:vortex-file-compressed 66558935 66773436 1.00
tpcds_q26/datafusion:vortex-file-compressed 33143424 33280973 1.00
tpcds_q27/datafusion:vortex-file-compressed 110813662 103957145 1.07
tpcds_q28/datafusion:vortex-file-compressed 42240777 40500989 1.04
tpcds_q29/datafusion:vortex-file-compressed 66095148 61438170 1.08
tpcds_q30/datafusion:vortex-file-compressed 25001636 23139828 1.08
tpcds_q31/datafusion:vortex-file-compressed 77925709 72447373 1.08
tpcds_q32/datafusion:vortex-file-compressed 21133994 20446568 1.03
tpcds_q33/datafusion:vortex-file-compressed 29461542 29128149 1.01
tpcds_q34/datafusion:vortex-file-compressed 24010393 23856236 1.01
tpcds_q35/datafusion:vortex-file-compressed 44814292 44667286 1.00
tpcds_q36/datafusion:vortex-file-compressed 55552711 57943035 0.96
tpcds_q37/datafusion:vortex-file-compressed 27608991 25652498 1.08
tpcds_q38/datafusion:vortex-file-compressed 46519205 45778019 1.02
tpcds_q39/datafusion:vortex-file-compressed 116978517 107384467 1.09
tpcds_q40/datafusion:vortex-file-compressed 35040665 32770990 1.07
tpcds_q41/datafusion:vortex-file-compressed 17343036 16247672 1.07
tpcds_q42/datafusion:vortex-file-compressed 14958237 14694926 1.02
tpcds_q43/datafusion:vortex-file-compressed 19918311 18934431 1.05
tpcds_q44/datafusion:vortex-file-compressed 33791029 32022635 1.06
tpcds_q45/datafusion:vortex-file-compressed 27167384 27116372 1.00
tpcds_q46/datafusion:vortex-file-compressed 35347955 34109611 1.04
tpcds_q47/datafusion:vortex-file-compressed 139500861 132143450 1.06
tpcds_q48/datafusion:vortex-file-compressed 41046363 37838720 1.08
tpcds_q49/datafusion:vortex-file-compressed 62048607 58314243 1.06
tpcds_q50/datafusion:vortex-file-compressed 41434975 38976826 1.06
tpcds_q51/datafusion:vortex-file-compressed 91701035 86902501 1.06
tpcds_q52/datafusion:vortex-file-compressed 15490865 14569392 1.06
tpcds_q53/datafusion:vortex-file-compressed 22297463 20979725 1.06
tpcds_q54/datafusion:vortex-file-compressed 37925520 34966882 1.08
tpcds_q55/datafusion:vortex-file-compressed 14474603 13624018 1.06
tpcds_q56/datafusion:vortex-file-compressed 31740503 30496977 1.04
tpcds_q57/datafusion:vortex-file-compressed 110468777 105709409 1.05
tpcds_q58/datafusion:vortex-file-compressed 55276065 52351781 1.06
tpcds_q59/datafusion:vortex-file-compressed 58951474 56958006 1.03
tpcds_q60/datafusion:vortex-file-compressed 🚨 31786639 28487868 1.12
tpcds_q61/datafusion:vortex-file-compressed 42128110 39866196 1.06
tpcds_q62/datafusion:vortex-file-compressed 24385788 22627778 1.08
tpcds_q63/datafusion:vortex-file-compressed 22979748 21642080 1.06
tpcds_q64/datafusion:vortex-file-compressed 433869542 405452535 1.07
tpcds_q65/datafusion:vortex-file-compressed 42542667 39779136 1.07
tpcds_q66/datafusion:vortex-file-compressed 72156131 70896605 1.02
tpcds_q67/datafusion:vortex-file-compressed 148552514 146709652 1.01
tpcds_q68/datafusion:vortex-file-compressed 34541557 32377093 1.07
tpcds_q69/datafusion:vortex-file-compressed 39041980 36691959 1.06
tpcds_q70/datafusion:vortex-file-compressed 89340494 90549366 0.99
tpcds_q71/datafusion:vortex-file-compressed 24084676 22872965 1.05
tpcds_q72/datafusion:vortex-file-compressed 🚨 2325979740 2105370819 1.10
tpcds_q73/datafusion:vortex-file-compressed 24425508 22983034 1.06
tpcds_q74/datafusion:vortex-file-compressed 85288389 78988534 1.08
tpcds_q75/datafusion:vortex-file-compressed 110949965 104495522 1.06
tpcds_q76/datafusion:vortex-file-compressed 26277021 23983939 1.10
tpcds_q77/datafusion:vortex-file-compressed 42743622 40034733 1.07
tpcds_q78/datafusion:vortex-file-compressed 131461834 122634876 1.07
tpcds_q79/datafusion:vortex-file-compressed 31261852 28647257 1.09
tpcds_q80/datafusion:vortex-file-compressed 97949749 91174320 1.07
tpcds_q81/datafusion:vortex-file-compressed 24698660 23680124 1.04
tpcds_q82/datafusion:vortex-file-compressed 25644991 26123040 0.98
tpcds_q83/datafusion:vortex-file-compressed 35870134 34037985 1.05
tpcds_q84/datafusion:vortex-file-compressed 🚨 14003223 12481230 1.12
tpcds_q85/datafusion:vortex-file-compressed 96298931 92737880 1.04
tpcds_q86/datafusion:vortex-file-compressed 🚨 18301883 16319234 1.12
tpcds_q87/datafusion:vortex-file-compressed 47001822 43758685 1.07
tpcds_q88/datafusion:vortex-file-compressed 🚨 60903474 55248865 1.10
tpcds_q89/datafusion:vortex-file-compressed 26093147 24849089 1.05
tpcds_q90/datafusion:vortex-file-compressed 16718788 15282117 1.09
tpcds_q91/datafusion:vortex-file-compressed 18628943 17781303 1.05
tpcds_q92/datafusion:vortex-file-compressed 18657828 18405434 1.01
tpcds_q93/datafusion:vortex-file-compressed 34919413 32694201 1.07
tpcds_q94/datafusion:vortex-file-compressed 24672969 23927088 1.03
tpcds_q95/datafusion:vortex-file-compressed 63252661 61113814 1.03
tpcds_q96/datafusion:vortex-file-compressed 14842279 13757423 1.08
tpcds_q97/datafusion:vortex-file-compressed 34173013 32900044 1.04
tpcds_q98/datafusion:vortex-file-compressed 🚨 26017465 23201736 1.12
tpcds_q99/datafusion:vortex-file-compressed 🚨 34762036 31058750 1.12
datafusion / vortex-compact (1.032x ➖, 1↑ 6↓)
name PR 86ce16f (ns) base 40112f4 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚨 29164755 25318869 1.15
tpcds_q02/datafusion:vortex-compact 55597427 53578570 1.04
tpcds_q03/datafusion:vortex-compact 19745281 20504151 0.96
tpcds_q04/datafusion:vortex-compact 310506798 301283053 1.03
tpcds_q05/datafusion:vortex-compact 47215248 46297755 1.02
tpcds_q06/datafusion:vortex-compact 63714739 64012089 1.00
tpcds_q07/datafusion:vortex-compact 54677005 51348433 1.06
tpcds_q08/datafusion:vortex-compact 37693734 35390317 1.07
tpcds_q09/datafusion:vortex-compact 64380081 62460449 1.03
tpcds_q10/datafusion:vortex-compact 51620100 48354306 1.07
tpcds_q11/datafusion:vortex-compact 153885965 149074552 1.03
tpcds_q12/datafusion:vortex-compact 23410774 21678304 1.08
tpcds_q13/datafusion:vortex-compact 94757122 91397906 1.04
tpcds_q14/datafusion:vortex-compact 210604213 200148975 1.05
tpcds_q15/datafusion:vortex-compact 31656953 29600191 1.07
tpcds_q16/datafusion:vortex-compact 34205201 33236841 1.03
tpcds_q17/datafusion:vortex-compact 76736399 75032261 1.02
tpcds_q18/datafusion:vortex-compact 80466992 75328634 1.07
tpcds_q19/datafusion:vortex-compact 30737261 29728654 1.03
tpcds_q20/datafusion:vortex-compact 24916831 24273442 1.03
tpcds_q21/datafusion:vortex-compact 41465925 39964222 1.04
tpcds_q22/datafusion:vortex-compact 136459909 148200517 0.92
tpcds_q23/datafusion:vortex-compact 🚨 178104274 159117238 1.12
tpcds_q24/datafusion:vortex-compact 99768909 96505410 1.03
tpcds_q25/datafusion:vortex-compact 🚨 87975848 77700681 1.13
tpcds_q26/datafusion:vortex-compact 45135630 44036923 1.02
tpcds_q27/datafusion:vortex-compact 130473015 123146983 1.06
tpcds_q28/datafusion:vortex-compact 78328129 78440733 1.00
tpcds_q29/datafusion:vortex-compact 77460166 74610302 1.04
tpcds_q30/datafusion:vortex-compact 29696845 28237097 1.05
tpcds_q31/datafusion:vortex-compact 99498032 99188713 1.00
tpcds_q32/datafusion:vortex-compact 27731415 26289336 1.05
tpcds_q33/datafusion:vortex-compact 38069306 37072679 1.03
tpcds_q34/datafusion:vortex-compact 32182155 32007391 1.01
tpcds_q35/datafusion:vortex-compact 50115158 51058747 0.98
tpcds_q36/datafusion:vortex-compact 71013519 77412149 0.92
tpcds_q37/datafusion:vortex-compact 42296409 39286144 1.08
tpcds_q38/datafusion:vortex-compact 54176630 51562446 1.05
tpcds_q39/datafusion:vortex-compact 121257618 113431176 1.07
tpcds_q40/datafusion:vortex-compact 39324082 36655438 1.07
tpcds_q41/datafusion:vortex-compact 19366994 17694367 1.09
tpcds_q42/datafusion:vortex-compact 19262985 17837771 1.08
tpcds_q43/datafusion:vortex-compact 24963314 24717749 1.01
tpcds_q44/datafusion:vortex-compact 47197255 44832191 1.05
tpcds_q45/datafusion:vortex-compact 32404153 31307693 1.04
tpcds_q46/datafusion:vortex-compact 45899050 43785771 1.05
tpcds_q47/datafusion:vortex-compact 157405346 147311855 1.07
tpcds_q48/datafusion:vortex-compact 72576564 69051883 1.05
tpcds_q49/datafusion:vortex-compact 69508885 68497326 1.01
tpcds_q50/datafusion:vortex-compact 48596805 47366753 1.03
tpcds_q51/datafusion:vortex-compact 98438492 95650314 1.03
tpcds_q52/datafusion:vortex-compact 19283702 18347704 1.05
tpcds_q53/datafusion:vortex-compact 29450030 27253098 1.08
tpcds_q54/datafusion:vortex-compact 43512342 41706448 1.04
tpcds_q55/datafusion:vortex-compact 19468716 18995152 1.02
tpcds_q56/datafusion:vortex-compact 36624783 35566290 1.03
tpcds_q57/datafusion:vortex-compact 114174899 110029221 1.04
tpcds_q58/datafusion:vortex-compact 61542348 59979201 1.03
tpcds_q59/datafusion:vortex-compact 69321780 70385746 0.98
tpcds_q60/datafusion:vortex-compact 35926857 35077967 1.02
tpcds_q61/datafusion:vortex-compact 54220013 54362655 1.00
tpcds_q62/datafusion:vortex-compact 30288597 32407059 0.93
tpcds_q63/datafusion:vortex-compact 27850317 27683130 1.01
tpcds_q64/datafusion:vortex-compact 451455193 450966944 1.00
tpcds_q65/datafusion:vortex-compact 54672299 53932793 1.01
tpcds_q66/datafusion:vortex-compact 76313076 73959262 1.03
tpcds_q67/datafusion:vortex-compact 151823106 148930915 1.02
tpcds_q68/datafusion:vortex-compact 44950803 45382884 0.99
tpcds_q69/datafusion:vortex-compact 48437745 48102338 1.01
tpcds_q70/datafusion:vortex-compact 96510998 95191710 1.01
tpcds_q71/datafusion:vortex-compact 31015320 29247703 1.06
tpcds_q72/datafusion:vortex-compact 2237433330 2139779891 1.05
tpcds_q73/datafusion:vortex-compact 30928134 30541963 1.01
tpcds_q74/datafusion:vortex-compact 96557791 94238202 1.02
tpcds_q75/datafusion:vortex-compact 135855160 125149487 1.09
tpcds_q76/datafusion:vortex-compact 34006167 31998541 1.06
tpcds_q77/datafusion:vortex-compact 52024078 50783138 1.02
tpcds_q78/datafusion:vortex-compact 144177546 137572198 1.05
tpcds_q79/datafusion:vortex-compact 38786629 39405420 0.98
tpcds_q80/datafusion:vortex-compact 107150229 102177365 1.05
tpcds_q81/datafusion:vortex-compact 30053003 28672356 1.05
tpcds_q82/datafusion:vortex-compact 42094384 40783648 1.03
tpcds_q83/datafusion:vortex-compact 35348028 34019175 1.04
tpcds_q84/datafusion:vortex-compact 14886958 14838225 1.00
tpcds_q85/datafusion:vortex-compact 🚨 128406954 114827119 1.12
tpcds_q86/datafusion:vortex-compact 🚨 21344462 18228459 1.17
tpcds_q87/datafusion:vortex-compact 53712920 52634659 1.02
tpcds_q88/datafusion:vortex-compact 76099764 75374013 1.01
tpcds_q89/datafusion:vortex-compact 32312634 31006383 1.04
tpcds_q90/datafusion:vortex-compact 15461932 15907213 0.97
tpcds_q91/datafusion:vortex-compact 33149369 31479860 1.05
tpcds_q92/datafusion:vortex-compact 24447896 24888311 0.98
tpcds_q93/datafusion:vortex-compact 39335377 39197126 1.00
tpcds_q94/datafusion:vortex-compact 🚨 28245612 25471892 1.11
tpcds_q95/datafusion:vortex-compact 65535688 65711373 1.00
tpcds_q96/datafusion:vortex-compact 17459817 17048392 1.02
tpcds_q97/datafusion:vortex-compact 37051207 37704720 0.98
tpcds_q98/datafusion:vortex-compact 30347694 29135058 1.04
tpcds_q99/datafusion:vortex-compact 🚀 31209970 37557637 0.83
datafusion / parquet (1.021x ➖, 2↑ 6↓)
name PR 86ce16f (ns) base 40112f4 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 28610740 29761899 0.96
tpcds_q02/datafusion:parquet 41335388 41784809 0.99
tpcds_q03/datafusion:parquet 13719753 13500678 1.02
tpcds_q04/datafusion:parquet 259662190 277109223 0.94
tpcds_q05/datafusion:parquet 39827005 39753113 1.00
tpcds_q06/datafusion:parquet 58783070 60869807 0.97
tpcds_q07/datafusion:parquet 79318033 76600300 1.04
tpcds_q08/datafusion:parquet 27765443 26667434 1.04
tpcds_q09/datafusion:parquet 44744165 43870316 1.02
tpcds_q10/datafusion:parquet 74244231 73442110 1.01
tpcds_q11/datafusion:parquet 151740696 145108176 1.05
tpcds_q12/datafusion:parquet 18197513 17626354 1.03
tpcds_q13/datafusion:parquet 75494841 75138937 1.00
tpcds_q14/datafusion:parquet 160296801 165877797 0.97
tpcds_q15/datafusion:parquet 21253071 20770086 1.02
tpcds_q16/datafusion:parquet 🚀 23108743 25908325 0.89
tpcds_q17/datafusion:parquet 🚀 61707360 70081243 0.88
tpcds_q18/datafusion:parquet 112148189 116583615 0.96
tpcds_q19/datafusion:parquet 22404548 22448377 1.00
tpcds_q20/datafusion:parquet 15828847 16216875 0.98
tpcds_q21/datafusion:parquet 18826686 18887450 1.00
tpcds_q22/datafusion:parquet 131720875 141418314 0.93
tpcds_q23/datafusion:parquet 142795747 147764339 0.97
tpcds_q24/datafusion:parquet 88103455 90594686 0.97
tpcds_q25/datafusion:parquet 62237565 64155265 0.97
tpcds_q26/datafusion:parquet 66447176 67802372 0.98
tpcds_q27/datafusion:parquet 148081607 145258442 1.02
tpcds_q28/datafusion:parquet 44384257 45010230 0.99
tpcds_q29/datafusion:parquet 63666976 67211709 0.95
tpcds_q30/datafusion:parquet 36182153 35197839 1.03
tpcds_q31/datafusion:parquet 63354481 63926927 0.99
tpcds_q32/datafusion:parquet 18348919 19088333 0.96
tpcds_q33/datafusion:parquet 25961269 26321745 0.99
tpcds_q34/datafusion:parquet 21222663 21477697 0.99
tpcds_q35/datafusion:parquet 71649778 70491095 1.02
tpcds_q36/datafusion:parquet 55718955 56477760 0.99
tpcds_q37/datafusion:parquet 18834415 18658305 1.01
tpcds_q38/datafusion:parquet 39917544 40028428 1.00
tpcds_q39/datafusion:parquet 71229004 71460656 1.00
tpcds_q40/datafusion:parquet 24076496 23554838 1.02
tpcds_q41/datafusion:parquet 12843408 13243296 0.97
tpcds_q42/datafusion:parquet 12273990 11755045 1.04
tpcds_q43/datafusion:parquet 16514487 17526692 0.94
tpcds_q44/datafusion:parquet 33383641 33225087 1.00
tpcds_q45/datafusion:parquet 27203733 28281342 0.96
tpcds_q46/datafusion:parquet 31429515 31493210 1.00
tpcds_q47/datafusion:parquet 125453162 124949071 1.00
tpcds_q48/datafusion:parquet 69493189 70511265 0.99
tpcds_q49/datafusion:parquet 55039687 53984841 1.02
tpcds_q50/datafusion:parquet 42979616 42630170 1.01
tpcds_q51/datafusion:parquet 82234263 85825187 0.96
tpcds_q52/datafusion:parquet 11892076 11976297 0.99
tpcds_q53/datafusion:parquet 17432429 17603091 0.99
tpcds_q54/datafusion:parquet 35387673 33591049 1.05
tpcds_q55/datafusion:parquet 11503799 11283299 1.02
tpcds_q56/datafusion:parquet 27317948 27048974 1.01
tpcds_q57/datafusion:parquet 89342453 88874407 1.01
tpcds_q58/datafusion:parquet 51455428 50002274 1.03
tpcds_q59/datafusion:parquet 52241325 52316851 1.00
tpcds_q60/datafusion:parquet 26297456 27730466 0.95
tpcds_q61/datafusion:parquet 41916924 43072238 0.97
tpcds_q62/datafusion:parquet 🚨 24387711 20137030 1.21
tpcds_q63/datafusion:parquet 17629078 17618047 1.00
tpcds_q64/datafusion:parquet 544988586 513292889 1.06
tpcds_q65/datafusion:parquet 39666057 36755399 1.08
tpcds_q66/datafusion:parquet 73922029 70259998 1.05
tpcds_q67/datafusion:parquet 143558470 141905129 1.01
tpcds_q68/datafusion:parquet 35130963 32121707 1.09
tpcds_q69/datafusion:parquet 🚨 75449101 67921375 1.11
tpcds_q70/datafusion:parquet 89195226 83999370 1.06
tpcds_q71/datafusion:parquet 23209855 21619053 1.07
tpcds_q72/datafusion:parquet 650784165 592783499 1.10
tpcds_q73/datafusion:parquet 22273903 21081093 1.06
tpcds_q74/datafusion:parquet 83835903 81988595 1.02
tpcds_q75/datafusion:parquet 101160095 97725395 1.04
tpcds_q76/datafusion:parquet 32159297 29595192 1.09
tpcds_q77/datafusion:parquet 40674961 37834434 1.08
tpcds_q78/datafusion:parquet 118487056 109119382 1.09
tpcds_q79/datafusion:parquet 27875399 26136946 1.07
tpcds_q80/datafusion:parquet 78449926 76862842 1.02
tpcds_q81/datafusion:parquet 34042602 31433301 1.08
tpcds_q82/datafusion:parquet 20575970 20015371 1.03
tpcds_q83/datafusion:parquet 38381876 36152260 1.06
tpcds_q84/datafusion:parquet 41146894 38525424 1.07
tpcds_q85/datafusion:parquet 156473434 146698153 1.07
tpcds_q86/datafusion:parquet 16016556 14838560 1.08
tpcds_q87/datafusion:parquet 42308436 39928790 1.06
tpcds_q88/datafusion:parquet 61333108 61788722 0.99
tpcds_q89/datafusion:parquet 23366121 22001981 1.06
tpcds_q90/datafusion:parquet 🚨 16301848 14305917 1.14
tpcds_q91/datafusion:parquet 63482636 58772850 1.08
tpcds_q92/datafusion:parquet 19739854 17998661 1.10
tpcds_q93/datafusion:parquet 33046427 31935821 1.03
tpcds_q94/datafusion:parquet 🚨 22290348 19411491 1.15
tpcds_q95/datafusion:parquet 59212274 56997918 1.04
tpcds_q96/datafusion:parquet 12694654 11966510 1.06
tpcds_q97/datafusion:parquet 🚨 34216560 28982033 1.18
tpcds_q98/datafusion:parquet 23185009 21467956 1.08
tpcds_q99/datafusion:parquet 🚨 28926065 26289229 1.10
duckdb / vortex-file-compressed (1.125x ❌, 1↑ 58↓)
name PR 86ce16f (ns) base 40112f4 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21697899 20990446 1.03
tpcds_q02/duckdb:vortex-file-compressed 37332570 33974543 1.10
tpcds_q03/duckdb:vortex-file-compressed 31904166 32174486 0.99
tpcds_q04/duckdb:vortex-file-compressed 🚨 121569250 104474530 1.16
tpcds_q05/duckdb:vortex-file-compressed 🚨 41212765 36306303 1.14
tpcds_q06/duckdb:vortex-file-compressed 🚨 37681515 31960419 1.18
tpcds_q07/duckdb:vortex-file-compressed 🚨 25176880 20303256 1.24
tpcds_q08/duckdb:vortex-file-compressed 28424871 27664314 1.03
tpcds_q09/duckdb:vortex-file-compressed 39919018 37020766 1.08
tpcds_q10/duckdb:vortex-file-compressed 🚨 46048488 40223310 1.14
tpcds_q11/duckdb:vortex-file-compressed 🚨 72389468 61283806 1.18
tpcds_q12/duckdb:vortex-file-compressed 🚨 16087888 14232967 1.13
tpcds_q13/duckdb:vortex-file-compressed 33543395 32404914 1.04
tpcds_q14/duckdb:vortex-file-compressed 116059416 106679399 1.09
tpcds_q15/duckdb:vortex-file-compressed 🚨 32638644 26460007 1.23
tpcds_q16/duckdb:vortex-file-compressed 🚨 31333246 25947261 1.21
tpcds_q17/duckdb:vortex-file-compressed 45844349 41788206 1.10
tpcds_q18/duckdb:vortex-file-compressed 🚨 52983070 45844586 1.16
tpcds_q19/duckdb:vortex-file-compressed 🚨 38648861 32654337 1.18
tpcds_q20/duckdb:vortex-file-compressed 🚨 18816888 15482171 1.22
tpcds_q21/duckdb:vortex-file-compressed 19143140 17559929 1.09
tpcds_q22/duckdb:vortex-file-compressed 81768407 75218700 1.09
tpcds_q23/duckdb:vortex-file-compressed 🚨 119588780 104726352 1.14
tpcds_q24/duckdb:vortex-file-compressed 🚨 56943667 48973313 1.16
tpcds_q25/duckdb:vortex-file-compressed 50707416 49098093 1.03
tpcds_q26/duckdb:vortex-file-compressed 🚨 44133284 39338189 1.12
tpcds_q27/duckdb:vortex-file-compressed 🚨 55902119 47985527 1.16
tpcds_q28/duckdb:vortex-file-compressed 38238306 34974501 1.09
tpcds_q29/duckdb:vortex-file-compressed 🚨 47962850 40524554 1.18
tpcds_q30/duckdb:vortex-file-compressed 🚨 25845446 22636675 1.14
tpcds_q31/duckdb:vortex-file-compressed 🚀 30150435 35728281 0.84
tpcds_q32/duckdb:vortex-file-compressed 15094431 13802835 1.09
tpcds_q33/duckdb:vortex-file-compressed 🚨 26817762 23145245 1.16
tpcds_q34/duckdb:vortex-file-compressed 🚨 28181141 22999159 1.23
tpcds_q35/duckdb:vortex-file-compressed 🚨 75624211 64314954 1.18
tpcds_q36/duckdb:vortex-file-compressed 🚨 28328055 24866214 1.14
tpcds_q37/duckdb:vortex-file-compressed 🚨 16692332 15160503 1.10
tpcds_q38/duckdb:vortex-file-compressed 38179924 36333556 1.05
tpcds_q39/duckdb:vortex-file-compressed 37882698 35034431 1.08
tpcds_q40/duckdb:vortex-file-compressed 🚨 24431392 19082580 1.28
tpcds_q41/duckdb:vortex-file-compressed 🚨 15601139 12865881 1.21
tpcds_q42/duckdb:vortex-file-compressed 🚨 14938604 12846533 1.16
tpcds_q43/duckdb:vortex-file-compressed 24415758 22591903 1.08
tpcds_q44/duckdb:vortex-file-compressed 🚨 24337488 20885267 1.17
tpcds_q45/duckdb:vortex-file-compressed 30622398 29050407 1.05
tpcds_q46/duckdb:vortex-file-compressed 🚨 55573979 50317322 1.10
tpcds_q47/duckdb:vortex-file-compressed 🚨 56398661 47014393 1.20
tpcds_q48/duckdb:vortex-file-compressed 🚨 35399530 29126911 1.22
tpcds_q49/duckdb:vortex-file-compressed 🚨 38621070 33937321 1.14
tpcds_q50/duckdb:vortex-file-compressed 33966453 32953079 1.03
tpcds_q51/duckdb:vortex-file-compressed 🚨 126418352 102875937 1.23
tpcds_q52/duckdb:vortex-file-compressed 🚨 14753539 12972989 1.14
tpcds_q53/duckdb:vortex-file-compressed 🚨 26104997 22718953 1.15
tpcds_q54/duckdb:vortex-file-compressed 🚨 31864029 28432161 1.12
tpcds_q55/duckdb:vortex-file-compressed 🚨 14572266 12839376 1.13
tpcds_q56/duckdb:vortex-file-compressed 24848570 23629098 1.05
tpcds_q57/duckdb:vortex-file-compressed 42524445 44760392 0.95
tpcds_q58/duckdb:vortex-file-compressed 🚨 34302053 29904719 1.15
tpcds_q59/duckdb:vortex-file-compressed 72793744 66617899 1.09
tpcds_q60/duckdb:vortex-file-compressed 26168644 24802177 1.06
tpcds_q61/duckdb:vortex-file-compressed 🚨 37486827 30293409 1.24
tpcds_q62/duckdb:vortex-file-compressed 🚨 20539372 16747579 1.23
tpcds_q63/duckdb:vortex-file-compressed 🚨 25843588 20758665 1.24
tpcds_q64/duckdb:vortex-file-compressed 🚨 95878095 83380901 1.15
tpcds_q65/duckdb:vortex-file-compressed 24121652 22261012 1.08
tpcds_q66/duckdb:vortex-file-compressed 30471960 28925606 1.05
tpcds_q67/duckdb:vortex-file-compressed 🚨 163693185 140215628 1.17
tpcds_q68/duckdb:vortex-file-compressed 42537823 40402528 1.05
tpcds_q69/duckdb:vortex-file-compressed 🚨 50334362 41626776 1.21
tpcds_q70/duckdb:vortex-file-compressed 🚨 29874454 25552469 1.17
tpcds_q71/duckdb:vortex-file-compressed 🚨 24325830 20720076 1.17
tpcds_q72/duckdb:vortex-file-compressed 183735277 173205924 1.06
tpcds_q73/duckdb:vortex-file-compressed 🚨 27330442 22620524 1.21
tpcds_q74/duckdb:vortex-file-compressed 89321070 92874006 0.96
tpcds_q75/duckdb:vortex-file-compressed 61098242 56652171 1.08
tpcds_q76/duckdb:vortex-file-compressed 19383042 18249456 1.06
tpcds_q77/duckdb:vortex-file-compressed 26410124 25604752 1.03
tpcds_q78/duckdb:vortex-file-compressed 🚨 85534174 76620765 1.12
tpcds_q79/duckdb:vortex-file-compressed 32389765 31972126 1.01
tpcds_q80/duckdb:vortex-file-compressed 48855410 45100163 1.08
tpcds_q81/duckdb:vortex-file-compressed 🚨 31654813 26873017 1.18
tpcds_q82/duckdb:vortex-file-compressed 🚨 19946611 16235733 1.23
tpcds_q83/duckdb:vortex-file-compressed 🚨 27919129 23781813 1.17
tpcds_q84/duckdb:vortex-file-compressed 19270787 20236393 0.95
tpcds_q85/duckdb:vortex-file-compressed 🚨 48570814 43327471 1.12
tpcds_q86/duckdb:vortex-file-compressed 17521155 16599345 1.06
tpcds_q87/duckdb:vortex-file-compressed 🚨 44666660 39560631 1.13
tpcds_q88/duckdb:vortex-file-compressed 🚨 67886290 33683632 2.02
tpcds_q89/duckdb:vortex-file-compressed 22736641 21734338 1.05
tpcds_q90/duckdb:vortex-file-compressed 13478264 12394698 1.09
tpcds_q91/duckdb:vortex-file-compressed 31811041 29104649 1.09
tpcds_q92/duckdb:vortex-file-compressed 🚨 24654578 21316477 1.16
tpcds_q93/duckdb:vortex-file-compressed 🚨 33672729 27578625 1.22
tpcds_q94/duckdb:vortex-file-compressed 🚨 24959270 22541481 1.11
tpcds_q95/duckdb:vortex-file-compressed 152880429 147849023 1.03
tpcds_q96/duckdb:vortex-file-compressed 🚨 15188527 12685898 1.20
tpcds_q97/duckdb:vortex-file-compressed 🚨 40239120 35797173 1.12
tpcds_q98/duckdb:vortex-file-compressed 18897995 18285911 1.03
tpcds_q99/duckdb:vortex-file-compressed 29794442 27636514 1.08
duckdb / vortex-compact (1.036x ➖, 0↑ 11↓)
name PR 86ce16f (ns) base 40112f4 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 27313948 25296132 1.08
tpcds_q02/duckdb:vortex-compact 43580554 43172853 1.01
tpcds_q03/duckdb:vortex-compact 57462055 56153012 1.02
tpcds_q04/duckdb:vortex-compact 🚨 135050415 119442912 1.13
tpcds_q05/duckdb:vortex-compact 53586176 52423303 1.02
tpcds_q06/duckdb:vortex-compact 43352373 40953000 1.06
tpcds_q07/duckdb:vortex-compact 36847964 33584827 1.10
tpcds_q08/duckdb:vortex-compact 41898508 45386723 0.92
tpcds_q09/duckdb:vortex-compact 59458543 58527570 1.02
tpcds_q10/duckdb:vortex-compact 🚨 67396606 60220831 1.12
tpcds_q11/duckdb:vortex-compact 🚨 77730043 69805796 1.11
tpcds_q12/duckdb:vortex-compact 23863953 22568192 1.06
tpcds_q13/duckdb:vortex-compact 🚨 64925807 57882684 1.12
tpcds_q14/duckdb:vortex-compact 130035435 133283791 0.98
tpcds_q15/duckdb:vortex-compact 31679700 30491569 1.04
tpcds_q16/duckdb:vortex-compact 32406329 30350342 1.07
tpcds_q17/duckdb:vortex-compact 55044320 53710691 1.02
tpcds_q18/duckdb:vortex-compact 60307939 56177948 1.07
tpcds_q19/duckdb:vortex-compact 50586574 50455580 1.00
tpcds_q20/duckdb:vortex-compact 20252247 19894427 1.02
tpcds_q21/duckdb:vortex-compact 🚨 21487527 19472127 1.10
tpcds_q22/duckdb:vortex-compact 74985319 78402728 0.96
tpcds_q23/duckdb:vortex-compact 127428355 131542046 0.97
tpcds_q24/duckdb:vortex-compact 63386476 63476308 1.00
tpcds_q25/duckdb:vortex-compact 80986818 78990730 1.03
tpcds_q26/duckdb:vortex-compact 49697455 49722615 1.00
tpcds_q27/duckdb:vortex-compact 69381847 68155783 1.02
tpcds_q28/duckdb:vortex-compact 84996940 86108288 0.99
tpcds_q29/duckdb:vortex-compact 51203650 54229798 0.94
tpcds_q30/duckdb:vortex-compact 29814109 28567086 1.04
tpcds_q31/duckdb:vortex-compact 41160349 43955367 0.94
tpcds_q32/duckdb:vortex-compact 22623532 21924849 1.03
tpcds_q33/duckdb:vortex-compact 34713698 35905737 0.97
tpcds_q34/duckdb:vortex-compact 40819233 37565473 1.09
tpcds_q35/duckdb:vortex-compact 79585832 79511975 1.00
tpcds_q36/duckdb:vortex-compact 41441043 41249808 1.00
tpcds_q37/duckdb:vortex-compact 24005177 23377330 1.03
tpcds_q38/duckdb:vortex-compact 48662576 45776597 1.06
tpcds_q39/duckdb:vortex-compact 38411915 36626176 1.05
tpcds_q40/duckdb:vortex-compact 26045992 25434439 1.02
tpcds_q41/duckdb:vortex-compact 15480550 15057190 1.03
tpcds_q42/duckdb:vortex-compact 22005208 21799290 1.01
tpcds_q43/duckdb:vortex-compact 36451122 35439059 1.03
tpcds_q44/duckdb:vortex-compact 🚨 33318541 28324230 1.18
tpcds_q45/duckdb:vortex-compact 🚨 43409523 36039253 1.20
tpcds_q46/duckdb:vortex-compact 69954025 69038070 1.01
tpcds_q47/duckdb:vortex-compact 62001906 62357034 0.99
tpcds_q48/duckdb:vortex-compact 54301982 50333648 1.08
tpcds_q49/duckdb:vortex-compact 55761030 53899017 1.03
tpcds_q50/duckdb:vortex-compact 47259536 46802791 1.01
tpcds_q51/duckdb:vortex-compact 105218639 109004768 0.97
tpcds_q52/duckdb:vortex-compact 23304500 22192674 1.05
tpcds_q53/duckdb:vortex-compact 38127061 37359179 1.02
tpcds_q54/duckdb:vortex-compact 39004609 39960621 0.98
tpcds_q55/duckdb:vortex-compact 22138107 23583825 0.94
tpcds_q56/duckdb:vortex-compact 35612711 35376387 1.01
tpcds_q57/duckdb:vortex-compact 45702310 42618032 1.07
tpcds_q58/duckdb:vortex-compact 41033287 42657621 0.96
tpcds_q59/duckdb:vortex-compact 91512600 88966201 1.03
tpcds_q60/duckdb:vortex-compact 37334110 36876792 1.01
tpcds_q61/duckdb:vortex-compact 61969533 66874505 0.93
tpcds_q62/duckdb:vortex-compact 27505363 25968957 1.06
tpcds_q63/duckdb:vortex-compact 36084227 36609653 0.99
tpcds_q64/duckdb:vortex-compact 118130328 113309674 1.04
tpcds_q65/duckdb:vortex-compact 32469786 31990305 1.01
tpcds_q66/duckdb:vortex-compact 38934392 39225963 0.99
tpcds_q67/duckdb:vortex-compact 160295819 153598838 1.04
tpcds_q68/duckdb:vortex-compact 61723615 61013031 1.01
tpcds_q69/duckdb:vortex-compact 63457494 60544454 1.05
tpcds_q70/duckdb:vortex-compact 37151713 39677396 0.94
tpcds_q71/duckdb:vortex-compact 33855560 33519604 1.01
tpcds_q72/duckdb:vortex-compact 197096168 193142829 1.02
tpcds_q73/duckdb:vortex-compact 37077329 37322400 0.99
tpcds_q74/duckdb:vortex-compact 86872792 93590885 0.93
tpcds_q75/duckdb:vortex-compact 73688839 68309861 1.08
tpcds_q76/duckdb:vortex-compact 32877791 35200001 0.93
tpcds_q77/duckdb:vortex-compact 43448637 41984434 1.03
tpcds_q78/duckdb:vortex-compact 91718570 88959681 1.03
tpcds_q79/duckdb:vortex-compact 56569747 53973365 1.05
tpcds_q80/duckdb:vortex-compact 🚨 88007124 79233362 1.11
tpcds_q81/duckdb:vortex-compact 37233276 34817666 1.07
tpcds_q82/duckdb:vortex-compact 27307603 26028583 1.05
tpcds_q83/duckdb:vortex-compact 34149161 32407027 1.05
tpcds_q84/duckdb:vortex-compact 26658932 26791892 1.00
tpcds_q85/duckdb:vortex-compact 60263833 58365444 1.03
tpcds_q86/duckdb:vortex-compact 22967913 23564368 0.97
tpcds_q87/duckdb:vortex-compact 48923217 49409621 0.99
tpcds_q88/duckdb:vortex-compact 🚨 90370893 40429843 2.24
tpcds_q89/duckdb:vortex-compact 38665460 37435486 1.03
tpcds_q90/duckdb:vortex-compact 15833797 14867750 1.06
tpcds_q91/duckdb:vortex-compact 54339142 49758730 1.09
tpcds_q92/duckdb:vortex-compact 🚨 57830021 52525864 1.10
tpcds_q93/duckdb:vortex-compact 32590944 30998100 1.05
tpcds_q94/duckdb:vortex-compact 35512224 32792732 1.08
tpcds_q95/duckdb:vortex-compact 160399740 161118231 1.00
tpcds_q96/duckdb:vortex-compact 19069661 17566788 1.09
tpcds_q97/duckdb:vortex-compact 45950648 43638274 1.05
tpcds_q98/duckdb:vortex-compact 29175700 28820757 1.01
tpcds_q99/duckdb:vortex-compact 🚨 34798143 31587160 1.10
duckdb / parquet (1.036x ➖, 0↑ 8↓)
name PR 86ce16f (ns) base 40112f4 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28996454 27395432 1.06
tpcds_q02/duckdb:parquet 24287304 23325776 1.04
tpcds_q03/duckdb:parquet 11449319 11347531 1.01
tpcds_q04/duckdb:parquet 169292806 163025319 1.04
tpcds_q05/duckdb:parquet 29159580 29513778 0.99
tpcds_q06/duckdb:parquet 28513385 27499523 1.04
tpcds_q07/duckdb:parquet 21586106 20721288 1.04
tpcds_q08/duckdb:parquet 26979303 26213776 1.03
tpcds_q09/duckdb:parquet 39629643 39491843 1.00
tpcds_q10/duckdb:parquet 33453681 31776319 1.05
tpcds_q11/duckdb:parquet 88943603 88016810 1.01
tpcds_q12/duckdb:parquet 14862884 14212907 1.05
tpcds_q13/duckdb:parquet 32342190 31720826 1.02
tpcds_q14/duckdb:parquet 101167103 100379169 1.01
tpcds_q15/duckdb:parquet 30878661 29449220 1.05
tpcds_q16/duckdb:parquet 21502871 19990142 1.08
tpcds_q17/duckdb:parquet 38811929 37577786 1.03
tpcds_q18/duckdb:parquet 45518102 43986240 1.03
tpcds_q19/duckdb:parquet 28931158 29677193 0.97
tpcds_q20/duckdb:parquet 15619048 15495963 1.01
tpcds_q21/duckdb:parquet 10330457 9767614 1.06
tpcds_q22/duckdb:parquet 🚨 74614258 65187797 1.14
tpcds_q23/duckdb:parquet 81670421 79504487 1.03
tpcds_q24/duckdb:parquet 45731611 43674426 1.05
tpcds_q25/duckdb:parquet 33131760 32261717 1.03
tpcds_q26/duckdb:parquet 35347826 34629594 1.02
tpcds_q27/duckdb:parquet 48807745 49258538 0.99
tpcds_q28/duckdb:parquet 39064278 37373302 1.05
tpcds_q29/duckdb:parquet 36776382 34572970 1.06
tpcds_q30/duckdb:parquet 37144088 34360470 1.08
tpcds_q31/duckdb:parquet 23878848 22279584 1.07
tpcds_q32/duckdb:parquet 11063124 11918158 0.93
tpcds_q33/duckdb:parquet 21100705 21308970 0.99
tpcds_q34/duckdb:parquet 19701546 19785530 1.00
tpcds_q35/duckdb:parquet 58863872 54204443 1.09
tpcds_q36/duckdb:parquet 19881997 19856808 1.00
tpcds_q37/duckdb:parquet 12681696 12194088 1.04
tpcds_q38/duckdb:parquet 🚨 38433469 34123838 1.13
tpcds_q39/duckdb:parquet 29764133 29228709 1.02
tpcds_q40/duckdb:parquet 18156786 17616230 1.03
tpcds_q41/duckdb:parquet 7669590 7151545 1.07
tpcds_q42/duckdb:parquet 10142469 9261245 1.10
tpcds_q43/duckdb:parquet 15213917 15088849 1.01
tpcds_q44/duckdb:parquet 22638987 21728381 1.04
tpcds_q45/duckdb:parquet 27509174 26244628 1.05
tpcds_q46/duckdb:parquet 47508839 45121909 1.05
tpcds_q47/duckdb:parquet 44261217 44275437 1.00
tpcds_q48/duckdb:parquet 🚨 31322580 28351453 1.10
tpcds_q49/duckdb:parquet 24242591 23033560 1.05
tpcds_q50/duckdb:parquet 25763583 24198602 1.06
tpcds_q51/duckdb:parquet 96778963 92974467 1.04
tpcds_q52/duckdb:parquet 10355850 10288306 1.01
tpcds_q53/duckdb:parquet 15442956 14599485 1.06
tpcds_q54/duckdb:parquet 26530599 24511196 1.08
tpcds_q55/duckdb:parquet 9962304 9592947 1.04
tpcds_q56/duckdb:parquet 🚨 23033407 20936990 1.10
tpcds_q57/duckdb:parquet 35400991 34329449 1.03
tpcds_q58/duckdb:parquet 22789069 23506620 0.97
tpcds_q59/duckdb:parquet 35779675 34100446 1.05
tpcds_q60/duckdb:parquet 21732743 21646659 1.00
tpcds_q61/duckdb:parquet 31450799 30950399 1.02
tpcds_q62/duckdb:parquet 11797835 11683150 1.01
tpcds_q63/duckdb:parquet 14460694 13345570 1.08
tpcds_q64/duckdb:parquet 🚨 79711572 72088667 1.11
tpcds_q65/duckdb:parquet 19882533 19421914 1.02
tpcds_q66/duckdb:parquet 28695260 27368982 1.05
tpcds_q67/duckdb:parquet 136873947 131628325 1.04
tpcds_q68/duckdb:parquet 37265259 36330747 1.03
tpcds_q69/duckdb:parquet 36159852 34444527 1.05
tpcds_q70/duckdb:parquet 19405384 18846122 1.03
tpcds_q71/duckdb:parquet 20480852 19201277 1.07
tpcds_q72/duckdb:parquet 166462698 164188980 1.01
tpcds_q73/duckdb:parquet 17496931 17518134 1.00
tpcds_q74/duckdb:parquet 128851862 125786949 1.02
tpcds_q75/duckdb:parquet 53752243 54358862 0.99
tpcds_q76/duckdb:parquet 18336041 18362671 1.00
tpcds_q77/duckdb:parquet 21197127 21453679 0.99
tpcds_q78/duckdb:parquet 74079628 74620338 0.99
tpcds_q79/duckdb:parquet 27334132 26456856 1.03
tpcds_q80/duckdb:parquet 39758721 39516950 1.01
tpcds_q81/duckdb:parquet 32490635 30966426 1.05
tpcds_q82/duckdb:parquet 13435544 13070197 1.03
tpcds_q83/duckdb:parquet 16994978 15885141 1.07
tpcds_q84/duckdb:parquet 19827787 19344068 1.03
tpcds_q85/duckdb:parquet 38572123 38107759 1.01
tpcds_q86/duckdb:parquet 12024632 11862238 1.01
tpcds_q87/duckdb:parquet 37191200 36547596 1.02
tpcds_q88/duckdb:parquet 48655088 47947066 1.01
tpcds_q89/duckdb:parquet 16198922 16824149 0.96
tpcds_q90/duckdb:parquet 7585052 7360191 1.03
tpcds_q91/duckdb:parquet 🚨 23675786 21397741 1.11
tpcds_q92/duckdb:parquet 🚨 12143167 10637949 1.14
tpcds_q93/duckdb:parquet 30021552 27560239 1.09
tpcds_q94/duckdb:parquet 17184409 16090255 1.07
tpcds_q95/duckdb:parquet 🚨 147052145 128837035 1.14
tpcds_q96/duckdb:parquet 8684917 8720701 1.00
tpcds_q97/duckdb:parquet 37524068 34142487 1.10
tpcds_q98/duckdb:parquet 17010381 17679649 0.96
tpcds_q99/duckdb:parquet 20123282 19963981 1.01
duckdb / duckdb (1.050x ➖, 1↑ 19↓)
name PR 86ce16f (ns) base 40112f4 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20863439 19905917 1.05
tpcds_q02/duckdb:duckdb 19325882 18518968 1.04
tpcds_q03/duckdb:duckdb 🚨 9355502 8384542 1.12
tpcds_q04/duckdb:duckdb 180849693 171872212 1.05
tpcds_q05/duckdb:duckdb 20691558 18924301 1.09
tpcds_q06/duckdb:duckdb 24379816 23082110 1.06
tpcds_q07/duckdb:duckdb 40839330 38459522 1.06
tpcds_q08/duckdb:duckdb 122994353 120213110 1.02
tpcds_q09/duckdb:duckdb 20506519 20062386 1.02
tpcds_q10/duckdb:duckdb 25841320 23640607 1.09
tpcds_q11/duckdb:duckdb 88679026 92951476 0.95
tpcds_q12/duckdb:duckdb 11897104 11211181 1.06
tpcds_q13/duckdb:duckdb 25466438 23997355 1.06
tpcds_q14/duckdb:duckdb 92979013 92742598 1.00
tpcds_q15/duckdb:duckdb 27068516 25074216 1.08
tpcds_q16/duckdb:duckdb 19417985 18727560 1.04
tpcds_q17/duckdb:duckdb 24005967 21836465 1.10
tpcds_q18/duckdb:duckdb 44736991 43809653 1.02
tpcds_q19/duckdb:duckdb 17689649 16793838 1.05
tpcds_q20/duckdb:duckdb 12999631 12174643 1.07
tpcds_q21/duckdb:duckdb 🚨 8337192 7149580 1.17
tpcds_q22/duckdb:duckdb 🚨 68622327 62164796 1.10
tpcds_q23/duckdb:duckdb 77155676 82560785 0.93
tpcds_q24/duckdb:duckdb 26652497 26128230 1.02
tpcds_q25/duckdb:duckdb 18760736 18165905 1.03
tpcds_q26/duckdb:duckdb 🚨 29376595 26423365 1.11
tpcds_q27/duckdb:duckdb 42453706 39104677 1.09
tpcds_q28/duckdb:duckdb 22965509 21518309 1.07
tpcds_q29/duckdb:duckdb 20812135 20627580 1.01
tpcds_q30/duckdb:duckdb 29947058 30130480 0.99
tpcds_q31/duckdb:duckdb 🚨 54109675 48386403 1.12
tpcds_q32/duckdb:duckdb 8123931 7591927 1.07
tpcds_q33/duckdb:duckdb 13860148 13062652 1.06
tpcds_q34/duckdb:duckdb 16197896 16593352 0.98
tpcds_q35/duckdb:duckdb 35928325 34517682 1.04
tpcds_q36/duckdb:duckdb 69574019 70583830 0.99
tpcds_q37/duckdb:duckdb 8437603 7874558 1.07
tpcds_q38/duckdb:duckdb 32743408 31655341 1.03
tpcds_q39/duckdb:duckdb 27373659 29389480 0.93
tpcds_q40/duckdb:duckdb 14466976 13657621 1.06
tpcds_q41/duckdb:duckdb 🚨 9470625 8408575 1.13
tpcds_q42/duckdb:duckdb 🚨 7736759 6149782 1.26
tpcds_q43/duckdb:duckdb 12071600 11341146 1.06
tpcds_q44/duckdb:duckdb 12847477 13601512 0.94
tpcds_q45/duckdb:duckdb 17134211 17893139 0.96
tpcds_q46/duckdb:duckdb 39664426 38174533 1.04
tpcds_q47/duckdb:duckdb 🚨 45508340 40854066 1.11
tpcds_q48/duckdb:duckdb 🚨 24780031 21991138 1.13
tpcds_q49/duckdb:duckdb 🚨 18773050 16637073 1.13
tpcds_q50/duckdb:duckdb 15527674 14403516 1.08
tpcds_q51/duckdb:duckdb 93449348 89672163 1.04
tpcds_q52/duckdb:duckdb 7924037 7387277 1.07
tpcds_q53/duckdb:duckdb 🚨 14493900 13165950 1.10
tpcds_q54/duckdb:duckdb 🚨 18550283 16459217 1.13
tpcds_q55/duckdb:duckdb 7763128 7343889 1.06
tpcds_q56/duckdb:duckdb 14849499 14555426 1.02
tpcds_q57/duckdb:duckdb 34306679 32247544 1.06
tpcds_q58/duckdb:duckdb 13264767 12761890 1.04
tpcds_q59/duckdb:duckdb 35674679 36455223 0.98
tpcds_q60/duckdb:duckdb 15763429 15670076 1.01
tpcds_q61/duckdb:duckdb 16218170 14772750 1.10
tpcds_q62/duckdb:duckdb 10366568 9672620 1.07
tpcds_q63/duckdb:duckdb 13260112 12675270 1.05
tpcds_q64/duckdb:duckdb 57762213 56137711 1.03
tpcds_q65/duckdb:duckdb 🚨 35664398 31366890 1.14
tpcds_q66/duckdb:duckdb 25864354 26642755 0.97
tpcds_q67/duckdb:duckdb 139079834 130662653 1.06
tpcds_q68/duckdb:duckdb 27348824 26987558 1.01
tpcds_q69/duckdb:duckdb 27074080 25435075 1.06
tpcds_q70/duckdb:duckdb 14520902 14671029 0.99
tpcds_q71/duckdb:duckdb 12401893 12666213 0.98
tpcds_q72/duckdb:duckdb 46577527 44990693 1.04
tpcds_q73/duckdb:duckdb 11726296 11729604 1.00
tpcds_q74/duckdb:duckdb 154059750 145652231 1.06
tpcds_q75/duckdb:duckdb 42024996 42025017 1.00
tpcds_q76/duckdb:duckdb 12469713 11932583 1.05
tpcds_q77/duckdb:duckdb 🚨 13410539 11974227 1.12
tpcds_q78/duckdb:duckdb 67620509 63650040 1.06
tpcds_q79/duckdb:duckdb 19991120 20269553 0.99
tpcds_q80/duckdb:duckdb 29993670 27495488 1.09
tpcds_q81/duckdb:duckdb 41625278 40362136 1.03
tpcds_q82/duckdb:duckdb 🚨 9601495 8331097 1.15
tpcds_q83/duckdb:duckdb 10125451 9456409 1.07
tpcds_q84/duckdb:duckdb 14065828 14934740 0.94
tpcds_q85/duckdb:duckdb 24169194 23922839 1.01
tpcds_q86/duckdb:duckdb 11637356 11490835 1.01
tpcds_q87/duckdb:duckdb 36622837 35373247 1.04
tpcds_q88/duckdb:duckdb 27501197 26086604 1.05
tpcds_q89/duckdb:duckdb 15290614 14903690 1.03
tpcds_q90/duckdb:duckdb 🚨 6670023 5590500 1.19
tpcds_q91/duckdb:duckdb 🚨 14759683 12938339 1.14
tpcds_q92/duckdb:duckdb 🚨 10194226 8413431 1.21
tpcds_q93/duckdb:duckdb 23326494 22296711 1.05
tpcds_q94/duckdb:duckdb 🚀 11994929 13516834 0.89
tpcds_q95/duckdb:duckdb 114569015 107496998 1.07
tpcds_q96/duckdb:duckdb 🚨 5186585 4550476 1.14
tpcds_q97/duckdb:duckdb 29527194 29132751 1.01
tpcds_q98/duckdb:duckdb 13842444 14232420 0.97
tpcds_q99/duckdb:duckdb 16709569 16274075 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +15.2% +0.9% +14.2% +20.7% ➖ noise
1 datafusion:vortex-file-compressed +10.3% +0.9% +9.3% +22.3% ➖ noise
1 duckdb:duckdb +4.8% +0.9% +3.9% +21.0% ➖ noise
1 duckdb:vortex-compact +8.0% +0.9% +7.0% +23.2% ➖ noise
1 duckdb:vortex-file-compressed +3.4% +0.9% +2.5% +34.9% ➖ noise
2 datafusion:vortex-compact +3.8% +1.5% +2.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +7.2% +1.5% +5.6% +10.0% ➖ noise
2 duckdb:duckdb +4.4% +1.5% +2.8% +10.0% ➖ noise
2 duckdb:vortex-compact +0.9% +1.5% -0.5% +23.0% ➖ noise
2 duckdb:vortex-file-compressed +9.9% +1.5% +8.3% +22.1% ➖ noise
3 datafusion:vortex-compact -3.7% +1.3% -4.9% +10.7% ➖ noise
3 datafusion:vortex-file-compressed +5.1% +1.3% +3.8% +10.6% ➖ noise
3 duckdb:duckdb +11.6% +1.3% +10.2% +14.6% ➖ noise
3 duckdb:vortex-compact +2.3% +1.3% +1.1% +10.9% ➖ noise
3 duckdb:vortex-file-compressed -0.8% +1.3% -2.1% +11.3% ➖ noise
4 datafusion:vortex-compact +3.1% -1.4% +4.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +10.1% -1.4% +11.6% +10.0% 🚨 regression
4 duckdb:duckdb +5.2% -1.4% +6.7% +10.0% ➖ noise
4 duckdb:vortex-compact +13.1% -1.4% +14.6% +12.1% 🚨 regression
4 duckdb:vortex-file-compressed +16.4% -1.4% +18.0% +10.1% 🚨 regression
5 datafusion:vortex-compact +2.0% -0.5% +2.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.5% -0.5% +3.0% +12.7% ➖ noise
5 duckdb:duckdb +9.3% -0.5% +9.9% +12.5% ➖ noise
5 duckdb:vortex-compact +2.2% -0.5% +2.7% +11.5% ➖ noise
5 duckdb:vortex-file-compressed +13.5% -0.5% +14.1% +12.9% 🚨 regression
6 datafusion:vortex-compact -0.5% +0.1% -0.5% +13.8% ➖ noise
6 datafusion:vortex-file-compressed +1.0% +0.1% +1.0% +10.0% ➖ noise
6 duckdb:duckdb +5.6% +0.1% +5.6% +12.1% ➖ noise
6 duckdb:vortex-compact +5.9% +0.1% +5.8% +10.1% ➖ noise
6 duckdb:vortex-file-compressed +17.9% +0.1% +17.8% +10.0% 🚨 regression
7 datafusion:vortex-compact +6.5% +3.9% +2.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +4.3% +3.9% +0.4% +10.0% ➖ noise
7 duckdb:duckdb +6.2% +3.9% +2.2% +17.4% ➖ noise
7 duckdb:vortex-compact +9.7% +3.9% +5.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +24.0% +3.9% +19.4% +30.0% ➖ noise
8 datafusion:vortex-compact +6.5% +3.5% +2.9% +10.6% ➖ noise
8 datafusion:vortex-file-compressed +4.5% +3.5% +1.0% +10.3% ➖ noise
8 duckdb:duckdb +2.3% +3.5% -1.2% +10.4% ➖ noise
8 duckdb:vortex-compact -7.7% +3.5% -10.8% +10.0% ✅ faster
8 duckdb:vortex-file-compressed +2.7% +3.5% -0.7% +10.0% ➖ noise
9 datafusion:vortex-compact +3.1% +1.2% +1.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.0% +1.2% +1.8% +10.0% ➖ noise
9 duckdb:duckdb +2.2% +1.2% +1.0% +10.0% ➖ noise
9 duckdb:vortex-compact +1.6% +1.2% +0.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +7.8% +1.2% +6.6% +10.0% ➖ noise
10 datafusion:vortex-compact +6.8% +3.2% +3.5% +11.0% ➖ noise
10 datafusion:vortex-file-compressed +4.6% +3.2% +1.4% +12.6% ➖ noise
10 duckdb:duckdb +9.3% +3.2% +6.0% +10.0% ➖ noise
10 duckdb:vortex-compact +11.9% +3.2% +8.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +14.5% +3.2% +11.0% +13.2% ➖ noise
11 datafusion:vortex-compact +3.2% +2.8% +0.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +13.0% +2.8% +10.0% +10.0% ➖ noise
11 duckdb:duckdb -4.6% +2.8% -7.2% +10.0% ➖ noise
11 duckdb:vortex-compact +11.4% +2.8% +8.3% +13.6% ➖ noise
11 duckdb:vortex-file-compressed +18.1% +2.8% +14.9% +10.0% 🚨 regression
12 datafusion:vortex-compact +8.0% +3.9% +3.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +6.3% +3.9% +2.3% +10.1% ➖ noise
12 duckdb:duckdb +6.1% +3.9% +2.1% +13.7% ➖ noise
12 duckdb:vortex-compact +5.7% +3.9% +1.8% +10.2% ➖ noise
12 duckdb:vortex-file-compressed +13.0% +3.9% +8.8% +12.4% ➖ noise
13 datafusion:vortex-compact +3.7% +1.2% +2.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +5.6% +1.2% +4.3% +10.0% ➖ noise
13 duckdb:duckdb +6.1% +1.2% +4.8% +10.0% ➖ noise
13 duckdb:vortex-compact +12.2% +1.2% +10.8% +10.0% 🚨 regression
13 duckdb:vortex-file-compressed +3.5% +1.2% +2.3% +10.0% ➖ noise
14 datafusion:vortex-compact +5.2% -1.3% +6.6% +10.7% ➖ noise
14 datafusion:vortex-file-compressed +2.2% -1.3% +3.5% +10.0% ➖ noise
14 duckdb:duckdb +0.3% -1.3% +1.6% +10.0% ➖ noise
14 duckdb:vortex-compact -2.4% -1.3% -1.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +8.8% -1.3% +10.2% +10.0% 🚨 regression
15 datafusion:vortex-compact +6.9% +3.6% +3.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +6.5% +3.6% +2.8% +16.1% ➖ noise
15 duckdb:duckdb +8.0% +3.6% +4.2% +11.5% ➖ noise
15 duckdb:vortex-compact +3.9% +3.6% +0.3% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +23.4% +3.6% +19.1% +13.3% 🚨 regression
16 datafusion:vortex-compact +2.9% -2.0% +5.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +12.1% -2.0% +14.4% +13.5% 🚨 regression
16 duckdb:duckdb +3.7% -2.0% +5.9% +14.3% ➖ noise
16 duckdb:vortex-compact +6.8% -2.0% +9.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +20.8% -2.0% +23.3% +13.9% 🚨 regression
17 datafusion:vortex-compact +2.3% -4.6% +7.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +5.8% -4.6% +10.9% +10.0% 🚨 regression
17 duckdb:duckdb +9.9% -4.6% +15.3% +12.9% 🚨 regression
17 duckdb:vortex-compact +2.5% -4.6% +7.5% +15.0% ➖ noise
17 duckdb:vortex-file-compressed +9.7% -4.6% +15.0% +10.0% 🚨 regression
18 datafusion:vortex-compact +6.8% -0.2% +7.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +6.1% -0.2% +6.3% +10.0% ➖ noise
18 duckdb:duckdb +2.1% -0.2% +2.3% +10.0% ➖ noise
18 duckdb:vortex-compact +7.4% -0.2% +7.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +15.6% -0.2% +15.8% +10.0% 🚨 regression
19 datafusion:vortex-compact +3.4% -1.4% +4.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +4.2% -1.4% +5.6% +19.6% ➖ noise
19 duckdb:duckdb +5.3% -1.4% +6.8% +10.2% ➖ noise
19 duckdb:vortex-compact +0.3% -1.4% +1.6% +10.2% ➖ noise
19 duckdb:vortex-file-compressed +18.4% -1.4% +20.0% +10.0% 🚨 regression
20 datafusion:vortex-compact +2.7% -0.8% +3.5% +19.3% ➖ noise
20 datafusion:vortex-file-compressed +8.8% -0.8% +9.7% +10.0% ➖ noise
20 duckdb:duckdb +6.8% -0.8% +7.7% +10.0% ➖ noise
20 duckdb:vortex-compact +1.8% -0.8% +2.6% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +21.5% -0.8% +22.5% +10.0% 🚨 regression
21 datafusion:vortex-compact +3.8% +2.7% +1.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +12.3% +2.7% +9.4% +10.0% ➖ noise
21 duckdb:duckdb +16.6% +2.7% +13.6% +26.9% ➖ noise
21 duckdb:vortex-compact +10.4% +2.7% +7.5% +13.4% ➖ noise
21 duckdb:vortex-file-compressed +9.0% +2.7% +6.2% +10.0% ➖ noise
22 datafusion:vortex-compact -7.9% +3.3% -10.8% +32.3% ➖ noise
22 datafusion:vortex-file-compressed +4.4% +3.3% +1.1% +27.3% ➖ noise
22 duckdb:duckdb +10.4% +3.3% +6.9% +14.2% ➖ noise
22 duckdb:vortex-compact -4.4% +3.3% -7.4% +15.3% ➖ noise
22 duckdb:vortex-file-compressed +8.7% +3.3% +5.3% +15.4% ➖ noise
23 datafusion:vortex-compact +11.9% -0.4% +12.3% +10.5% 🚨 regression
23 datafusion:vortex-file-compressed +6.6% -0.4% +7.0% +10.0% ➖ noise
23 duckdb:duckdb -6.5% -0.4% -6.2% +14.1% ➖ noise
23 duckdb:vortex-compact -3.1% -0.4% -2.8% +21.5% ➖ noise
23 duckdb:vortex-file-compressed +14.2% -0.4% +14.6% +11.4% 🚨 regression
24 datafusion:vortex-compact +3.4% +0.9% +2.4% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +4.7% +0.9% +3.8% +11.0% ➖ noise
24 duckdb:duckdb +2.0% +0.9% +1.1% +10.3% ➖ noise
24 duckdb:vortex-compact -0.1% +0.9% -1.0% +13.8% ➖ noise
24 duckdb:vortex-file-compressed +16.3% +0.9% +15.2% +18.1% ➖ noise
25 datafusion:vortex-compact +13.2% -0.2% +13.4% +10.0% 🚨 regression
25 datafusion:vortex-file-compressed -0.3% -0.2% -0.1% +10.0% ➖ noise
25 duckdb:duckdb +3.3% -0.2% +3.5% +10.0% ➖ noise
25 duckdb:vortex-compact +2.5% -0.2% +2.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +3.3% -0.2% +3.5% +10.0% ➖ noise
26 datafusion:vortex-compact +2.5% +0.0% +2.5% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -0.4% +0.0% -0.4% +10.0% ➖ noise
26 duckdb:duckdb +11.2% +0.0% +11.2% +14.1% ➖ noise
26 duckdb:vortex-compact -0.1% +0.0% -0.1% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +12.2% +0.0% +12.2% +11.6% 🚨 regression
27 datafusion:vortex-compact +5.9% +0.5% +5.4% +12.3% ➖ noise
27 datafusion:vortex-file-compressed +6.6% +0.5% +6.1% +10.8% ➖ noise
27 duckdb:duckdb +8.6% +0.5% +8.0% +18.3% ➖ noise
27 duckdb:vortex-compact +1.8% +0.5% +1.3% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +16.5% +0.5% +15.9% +19.2% ➖ noise
28 datafusion:vortex-compact -0.1% +1.5% -1.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +4.3% +1.5% +2.7% +10.0% ➖ noise
28 duckdb:duckdb +6.7% +1.5% +5.1% +10.0% ➖ noise
28 duckdb:vortex-compact -1.3% +1.5% -2.8% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +9.3% +1.5% +7.7% +10.0% ➖ noise
29 datafusion:vortex-compact +3.8% +0.4% +3.4% +12.8% ➖ noise
29 datafusion:vortex-file-compressed +7.6% +0.4% +7.2% +10.0% ➖ noise
29 duckdb:duckdb +0.9% +0.4% +0.5% +10.0% ➖ noise
29 duckdb:vortex-compact -5.6% +0.4% -5.9% +18.8% ➖ noise
29 duckdb:vortex-file-compressed +18.4% +0.4% +17.9% +10.0% 🚨 regression
30 datafusion:vortex-compact +5.2% +5.4% -0.2% +11.9% ➖ noise
30 datafusion:vortex-file-compressed +8.0% +5.4% +2.5% +10.0% ➖ noise
30 duckdb:duckdb -0.6% +5.4% -5.7% +12.1% ➖ noise
30 duckdb:vortex-compact +4.4% +5.4% -1.0% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +14.2% +5.4% +8.3% +13.3% ➖ noise
31 datafusion:vortex-compact +0.3% +3.1% -2.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +7.6% +3.1% +4.4% +10.0% ➖ noise
31 duckdb:duckdb +11.8% +3.1% +8.5% +10.0% ➖ noise
31 duckdb:vortex-compact -6.4% +3.1% -9.1% +10.0% ✅ faster
31 duckdb:vortex-file-compressed -15.6% +3.1% -18.1% +14.0% ✅ faster
32 datafusion:vortex-compact +5.5% -5.5% +11.7% +11.5% 🚨 regression
32 datafusion:vortex-file-compressed +3.4% -5.5% +9.4% +11.5% ➖ noise
32 duckdb:duckdb +7.0% -5.5% +13.3% +14.3% ➖ noise
32 duckdb:vortex-compact +3.2% -5.5% +9.2% +10.4% ➖ noise
32 duckdb:vortex-file-compressed +9.4% -5.5% +15.8% +13.1% 🚨 regression
33 datafusion:vortex-compact +2.7% -1.2% +3.9% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +1.1% -1.2% +2.3% +10.0% ➖ noise
33 duckdb:duckdb +6.1% -1.2% +7.4% +10.0% ➖ noise
33 duckdb:vortex-compact -3.3% -1.2% -2.2% +14.5% ➖ noise
33 duckdb:vortex-file-compressed +15.9% -1.2% +17.2% +10.0% 🚨 regression
34 datafusion:vortex-compact +0.5% -0.8% +1.4% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.6% -0.8% +1.5% +10.0% ➖ noise
34 duckdb:duckdb -2.4% -0.8% -1.6% +10.6% ➖ noise
34 duckdb:vortex-compact +8.7% -0.8% +9.5% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +22.5% -0.8% +23.5% +18.6% 🚨 regression
35 datafusion:vortex-compact -1.8% +5.1% -6.6% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.3% +5.1% -4.5% +10.0% ➖ noise
35 duckdb:duckdb +4.1% +5.1% -0.9% +17.0% ➖ noise
35 duckdb:vortex-compact +0.1% +5.1% -4.7% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +17.6% +5.1% +11.9% +10.9% 🚨 regression
36 datafusion:vortex-compact -8.3% -0.6% -7.7% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -4.1% -0.6% -3.5% +12.2% ➖ noise
36 duckdb:duckdb -1.4% -0.6% -0.8% +10.0% ➖ noise
36 duckdb:vortex-compact +0.5% -0.6% +1.1% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +13.9% -0.6% +14.6% +10.0% 🚨 regression
37 datafusion:vortex-compact +7.7% +2.5% +5.1% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +7.6% +2.5% +5.0% +10.0% ➖ noise
37 duckdb:duckdb +7.2% +2.5% +4.6% +12.8% ➖ noise
37 duckdb:vortex-compact +2.7% +2.5% +0.2% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +10.1% +2.5% +7.5% +10.0% ➖ noise
38 datafusion:vortex-compact +5.1% +6.0% -0.9% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +1.6% +6.0% -4.1% +10.0% ➖ noise
38 duckdb:duckdb +3.4% +6.0% -2.4% +10.0% ➖ noise
38 duckdb:vortex-compact +6.3% +6.0% +0.3% +10.1% ➖ noise
38 duckdb:vortex-file-compressed +5.1% +6.0% -0.8% +12.1% ➖ noise
39 datafusion:vortex-compact +6.9% +0.7% +6.1% +16.0% ➖ noise
39 datafusion:vortex-file-compressed +8.9% +0.7% +8.1% +11.7% ➖ noise
39 duckdb:duckdb -6.9% +0.7% -7.6% +26.1% ➖ noise
39 duckdb:vortex-compact +4.9% +0.7% +4.1% +13.2% ➖ noise
39 duckdb:vortex-file-compressed +8.1% +0.7% +7.3% +15.6% ➖ noise
40 datafusion:vortex-compact +7.3% +2.6% +4.5% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +6.9% +2.6% +4.2% +10.0% ➖ noise
40 duckdb:duckdb +5.9% +2.6% +3.2% +11.4% ➖ noise
40 duckdb:vortex-compact +2.4% +2.6% -0.2% +10.7% ➖ noise
40 duckdb:vortex-file-compressed +28.0% +2.6% +24.7% +12.8% 🚨 regression
41 datafusion:vortex-compact +9.5% +2.0% +7.3% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +6.7% +2.0% +4.7% +15.2% ➖ noise
41 duckdb:duckdb +12.6% +2.0% +10.4% +12.8% ➖ noise
41 duckdb:vortex-compact +2.8% +2.0% +0.8% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +21.3% +2.0% +18.9% +10.0% 🚨 regression
42 datafusion:vortex-compact +8.0% +6.9% +1.0% +10.5% ➖ noise
42 datafusion:vortex-file-compressed +1.8% +6.9% -4.8% +10.1% ➖ noise
42 duckdb:duckdb +25.8% +6.9% +17.6% +14.7% 🚨 regression
42 duckdb:vortex-compact +0.9% +6.9% -5.6% +10.4% ➖ noise
42 duckdb:vortex-file-compressed +16.3% +6.9% +8.7% +15.6% ➖ noise
43 datafusion:vortex-compact +1.0% -2.5% +3.6% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +5.2% -2.5% +7.9% +10.0% ➖ noise
43 duckdb:duckdb +6.4% -2.5% +9.2% +10.0% ➖ noise
43 duckdb:vortex-compact +2.9% -2.5% +5.5% +14.8% ➖ noise
43 duckdb:vortex-file-compressed +8.1% -2.5% +10.9% +10.6% 🚨 regression
44 datafusion:vortex-compact +5.3% +2.3% +2.9% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +5.5% +2.3% +3.1% +11.4% ➖ noise
44 duckdb:duckdb -5.5% +2.3% -7.7% +11.6% ➖ noise
44 duckdb:vortex-compact +17.6% +2.3% +15.0% +16.3% ➖ noise
44 duckdb:vortex-file-compressed +16.5% +2.3% +13.9% +12.0% 🚨 regression
45 datafusion:vortex-compact +3.5% +0.4% +3.1% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +0.2% +0.4% -0.2% +10.0% ➖ noise
45 duckdb:duckdb -4.2% +0.4% -4.6% +12.3% ➖ noise
45 duckdb:vortex-compact +20.5% +0.4% +20.0% +12.1% 🚨 regression
45 duckdb:vortex-file-compressed +5.4% +0.4% +5.0% +11.5% ➖ noise
46 datafusion:vortex-compact +4.8% +2.5% +2.3% +11.1% ➖ noise
46 datafusion:vortex-file-compressed +3.6% +2.5% +1.1% +16.6% ➖ noise
46 duckdb:duckdb +3.9% +2.5% +1.4% +11.4% ➖ noise
46 duckdb:vortex-compact +1.3% +2.5% -1.2% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +10.4% +2.5% +7.7% +10.0% ➖ noise
47 datafusion:vortex-compact +6.9% +0.2% +6.7% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +5.6% +0.2% +5.4% +10.0% ➖ noise
47 duckdb:duckdb +11.4% +0.2% +11.2% +10.0% 🚨 regression
47 duckdb:vortex-compact -0.6% +0.2% -0.8% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +20.0% +0.2% +19.7% +10.0% 🚨 regression
48 datafusion:vortex-compact +5.1% +4.3% +0.7% +10.8% ➖ noise
48 datafusion:vortex-file-compressed +8.5% +4.3% +4.0% +10.0% ➖ noise
48 duckdb:duckdb +12.7% +4.3% +8.0% +10.3% ➖ noise
48 duckdb:vortex-compact +7.9% +4.3% +3.4% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +21.5% +4.3% +16.5% +10.0% 🚨 regression
49 datafusion:vortex-compact +1.5% +3.6% -2.0% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +6.4% +3.6% +2.7% +10.0% ➖ noise
49 duckdb:duckdb +12.8% +3.6% +8.9% +11.0% ➖ noise
49 duckdb:vortex-compact +3.5% +3.6% -0.1% +12.1% ➖ noise
49 duckdb:vortex-file-compressed +13.8% +3.6% +9.9% +28.0% ➖ noise
50 datafusion:vortex-compact +2.6% +3.6% -1.0% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +6.3% +3.6% +2.6% +10.0% ➖ noise
50 duckdb:duckdb +7.8% +3.6% +4.1% +10.5% ➖ noise
50 duckdb:vortex-compact +1.0% +3.6% -2.5% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +3.1% +3.6% -0.5% +11.5% ➖ noise
51 datafusion:vortex-compact +2.9% -0.1% +3.1% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +5.5% -0.1% +5.7% +10.0% ➖ noise
51 duckdb:duckdb +4.2% -0.1% +4.3% +10.0% ➖ noise
51 duckdb:vortex-compact -3.5% -0.1% -3.3% +15.6% ➖ noise
51 duckdb:vortex-file-compressed +22.9% -0.1% +23.0% +27.2% ➖ noise
52 datafusion:vortex-compact +5.1% -0.0% +5.1% +10.0% ➖ noise
52 datafusion:vortex-file-compressed +6.3% -0.0% +6.4% +10.0% ➖ noise
52 duckdb:duckdb +7.3% -0.0% +7.3% +14.5% ➖ noise
52 duckdb:vortex-compact +5.0% -0.0% +5.0% +10.4% ➖ noise
52 duckdb:vortex-file-compressed +13.7% -0.0% +13.8% +11.4% 🚨 regression
53 datafusion:vortex-compact +8.1% +2.3% +5.6% +10.0% ➖ noise
53 datafusion:vortex-file-compressed +6.3% +2.3% +3.8% +11.7% ➖ noise
53 duckdb:duckdb +10.1% +2.3% +7.6% +10.0% ➖ noise
53 duckdb:vortex-compact +2.1% +2.3% -0.3% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +14.9% +2.3% +12.3% +10.0% 🚨 regression
54 datafusion:vortex-compact +4.3% +6.8% -2.3% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +8.5% +6.8% +1.6% +10.0% ➖ noise
54 duckdb:duckdb +12.7% +6.8% +5.5% +10.0% ➖ noise
54 duckdb:vortex-compact -2.4% +6.8% -8.6% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +12.1% +6.8% +5.0% +10.0% ➖ noise
55 datafusion:vortex-compact +2.5% +2.9% -0.4% +17.1% ➖ noise
55 datafusion:vortex-file-compressed +6.2% +2.9% +3.3% +10.0% ➖ noise
55 duckdb:duckdb +5.7% +2.9% +2.7% +10.9% ➖ noise
55 duckdb:vortex-compact -6.1% +2.9% -8.8% +15.4% ➖ noise
55 duckdb:vortex-file-compressed +13.5% +2.9% +10.3% +20.4% ➖ noise
56 datafusion:vortex-compact +3.0% +5.4% -2.3% +10.9% ➖ noise
56 datafusion:vortex-file-compressed +4.1% +5.4% -1.3% +10.7% ➖ noise
56 duckdb:duckdb +2.0% +5.4% -3.2% +17.5% ➖ noise
56 duckdb:vortex-compact +0.7% +5.4% -4.5% +11.2% ➖ noise
56 duckdb:vortex-file-compressed +5.2% +5.4% -0.2% +19.3% ➖ noise
57 datafusion:vortex-compact +3.8% +1.8% +1.9% +11.3% ➖ noise
57 datafusion:vortex-file-compressed +4.5% +1.8% +2.6% +10.0% ➖ noise
57 duckdb:duckdb +6.4% +1.8% +4.5% +17.4% ➖ noise
57 duckdb:vortex-compact +7.2% +1.8% +5.3% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -5.0% +1.8% -6.7% +16.6% ➖ noise
58 datafusion:vortex-compact +2.6% -0.1% +2.7% +10.1% ➖ noise
58 datafusion:vortex-file-compressed +5.6% -0.1% +5.7% +10.0% ➖ noise
58 duckdb:duckdb +3.9% -0.1% +4.1% +12.7% ➖ noise
58 duckdb:vortex-compact -3.8% -0.1% -3.7% +10.0% ➖ noise
58 duckdb:vortex-file-compressed +14.7% -0.1% +14.8% +14.0% 🚨 regression
59 datafusion:vortex-compact -1.5% +2.4% -3.8% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +3.5% +2.4% +1.1% +10.0% ➖ noise
59 duckdb:duckdb -2.1% +2.4% -4.4% +10.0% ➖ noise
59 duckdb:vortex-compact +2.9% +2.4% +0.5% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +9.3% +2.4% +6.8% +10.0% ➖ noise
60 datafusion:vortex-compact +2.4% -2.4% +5.0% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +11.6% -2.4% +14.4% +10.3% 🚨 regression
60 duckdb:duckdb +0.6% -2.4% +3.1% +10.0% ➖ noise
60 duckdb:vortex-compact +1.2% -2.4% +3.8% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +5.5% -2.4% +8.1% +11.7% ➖ noise
61 datafusion:vortex-compact -0.3% -0.6% +0.3% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +5.7% -0.6% +6.3% +10.0% ➖ noise
61 duckdb:duckdb +9.8% -0.6% +10.4% +10.0% 🚨 regression
61 duckdb:vortex-compact -7.3% -0.6% -6.8% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +23.7% -0.6% +24.4% +14.8% 🚨 regression
62 datafusion:vortex-compact -6.5% +10.6% -15.5% +31.3% ➖ noise
62 datafusion:vortex-file-compressed +7.8% +10.6% -2.5% +31.0% ➖ noise
62 duckdb:duckdb +7.2% +10.6% -3.1% +21.2% ➖ noise
62 duckdb:vortex-compact +5.9% +10.6% -4.2% +18.9% ➖ noise
62 duckdb:vortex-file-compressed +22.6% +10.6% +10.9% +23.2% ➖ noise
63 datafusion:vortex-compact +0.6% +4.1% -3.4% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +6.2% +4.1% +2.0% +10.0% ➖ noise
63 duckdb:duckdb +4.6% +4.1% +0.5% +10.0% ➖ noise
63 duckdb:vortex-compact -1.4% +4.1% -5.3% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +24.5% +4.1% +19.6% +10.0% 🚨 regression
64 datafusion:vortex-compact +0.1% +8.4% -7.6% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +7.0% +8.4% -1.2% +10.0% ➖ noise
64 duckdb:duckdb +2.9% +8.4% -5.0% +10.0% ➖ noise
64 duckdb:vortex-compact +4.3% +8.4% -3.8% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +15.0% +8.4% +6.1% +10.0% ➖ noise
65 datafusion:vortex-compact +1.4% +5.1% -3.6% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +6.9% +5.1% +1.7% +12.5% ➖ noise
65 duckdb:duckdb +13.7% +5.1% +8.2% +13.3% ➖ noise
65 duckdb:vortex-compact +1.5% +5.1% -3.4% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +8.4% +5.1% +3.1% +10.0% ➖ noise
66 datafusion:vortex-compact +3.2% +5.0% -1.8% +11.5% ➖ noise
66 datafusion:vortex-file-compressed +1.8% +5.0% -3.1% +10.8% ➖ noise
66 duckdb:duckdb -2.9% +5.0% -7.6% +10.6% ➖ noise
66 duckdb:vortex-compact -0.7% +5.0% -5.5% +18.1% ➖ noise
66 duckdb:vortex-file-compressed +5.3% +5.0% +0.3% +10.9% ➖ noise
67 datafusion:vortex-compact +1.9% +2.6% -0.6% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +1.3% +2.6% -1.3% +10.0% ➖ noise
67 duckdb:duckdb +6.4% +2.6% +3.8% +10.0% ➖ noise
67 duckdb:vortex-compact +4.4% +2.6% +1.7% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +16.7% +2.6% +13.8% +12.1% 🚨 regression
68 datafusion:vortex-compact -1.0% +5.9% -6.5% +23.1% ➖ noise
68 datafusion:vortex-file-compressed +6.7% +5.9% +0.7% +10.0% ➖ noise
68 duckdb:duckdb +1.3% +5.9% -4.3% +10.0% ➖ noise
68 duckdb:vortex-compact +1.2% +5.9% -4.5% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +5.3% +5.9% -0.6% +13.8% ➖ noise
69 datafusion:vortex-compact +0.7% +8.0% -6.8% +10.3% ➖ noise
69 datafusion:vortex-file-compressed +6.4% +8.0% -1.5% +10.0% ➖ noise
69 duckdb:duckdb +6.4% +8.0% -1.4% +10.0% ➖ noise
69 duckdb:vortex-compact +4.8% +8.0% -2.9% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +20.9% +8.0% +12.0% +10.0% 🚨 regression
70 datafusion:vortex-compact +1.4% +4.6% -3.0% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -1.3% +4.6% -5.6% +14.5% ➖ noise
70 duckdb:duckdb -1.0% +4.6% -5.3% +18.3% ➖ noise
70 duckdb:vortex-compact -6.4% +4.6% -10.5% +14.5% ➖ noise
70 duckdb:vortex-file-compressed +16.9% +4.6% +11.8% +10.8% 🚨 regression
71 datafusion:vortex-compact +6.0% +7.0% -0.9% +10.3% ➖ noise
71 datafusion:vortex-file-compressed +5.3% +7.0% -1.6% +14.5% ➖ noise
71 duckdb:duckdb -2.1% +7.0% -8.5% +12.6% ➖ noise
71 duckdb:vortex-compact +1.0% +7.0% -5.6% +10.0% ➖ noise
71 duckdb:vortex-file-compressed +17.4% +7.0% +9.7% +10.0% ➖ noise
72 datafusion:vortex-compact +4.6% +5.5% -0.9% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +10.5% +5.5% +4.7% +10.0% ➖ noise
72 duckdb:duckdb +3.5% +5.5% -1.9% +10.6% ➖ noise
72 duckdb:vortex-compact +2.0% +5.5% -3.3% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +6.1% +5.5% +0.5% +10.0% ➖ noise
73 datafusion:vortex-compact +1.3% +2.7% -1.4% +10.0% ➖ noise
73 datafusion:vortex-file-compressed +6.3% +2.7% +3.5% +21.6% ➖ noise
73 duckdb:duckdb -0.0% +2.7% -2.7% +11.6% ➖ noise
73 duckdb:vortex-compact -0.7% +2.7% -3.3% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +20.8% +2.7% +17.6% +15.2% 🚨 regression
74 datafusion:vortex-compact +2.5% +2.3% +0.1% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +8.0% +2.3% +5.5% +10.0% ➖ noise
74 duckdb:duckdb +5.8% +2.3% +3.3% +10.0% ➖ noise
74 duckdb:vortex-compact -7.2% +2.3% -9.3% +21.6% ➖ noise
74 duckdb:vortex-file-compressed -3.8% +2.3% -6.0% +26.8% ➖ noise
75 datafusion:vortex-compact +8.6% +1.2% +7.3% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +6.2% +1.2% +4.9% +10.5% ➖ noise
75 duckdb:duckdb -0.0% +1.2% -1.2% +11.4% ➖ noise
75 duckdb:vortex-compact +7.9% +1.2% +6.6% +10.0% ➖ noise
75 duckdb:vortex-file-compressed +7.8% +1.2% +6.6% +10.7% ➖ noise
76 datafusion:vortex-compact +6.3% +4.2% +2.0% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +9.6% +4.2% +5.2% +21.9% ➖ noise
76 duckdb:duckdb +4.5% +4.2% +0.3% +14.5% ➖ noise
76 duckdb:vortex-compact -6.6% +4.2% -10.3% +18.2% ➖ noise
76 duckdb:vortex-file-compressed +6.2% +4.2% +2.0% +18.8% ➖ noise
77 datafusion:vortex-compact +2.4% +3.1% -0.6% +10.3% ➖ noise
77 datafusion:vortex-file-compressed +6.8% +3.1% +3.6% +10.0% ➖ noise
77 duckdb:duckdb +12.0% +3.1% +8.7% +11.2% ➖ noise
77 duckdb:vortex-compact +3.5% +3.1% +0.4% +14.3% ➖ noise
77 duckdb:vortex-file-compressed +3.1% +3.1% +0.1% +10.0% ➖ noise
78 datafusion:vortex-compact +4.8% +3.8% +0.9% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +7.2% +3.8% +3.2% +10.0% ➖ noise
78 duckdb:duckdb +6.2% +3.8% +2.3% +10.0% ➖ noise
78 duckdb:vortex-compact +3.1% +3.8% -0.7% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +11.6% +3.8% +7.5% +10.0% ➖ noise
79 datafusion:vortex-compact -1.6% +5.0% -6.2% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +9.1% +5.0% +4.0% +10.9% ➖ noise
79 duckdb:duckdb -1.4% +5.0% -6.0% +10.0% ➖ noise
79 duckdb:vortex-compact +4.8% +5.0% -0.2% +10.0% ➖ noise
79 duckdb:vortex-file-compressed +1.3% +5.0% -3.5% +16.2% ➖ noise
80 datafusion:vortex-compact +4.9% +1.3% +3.5% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +7.4% +1.3% +6.0% +10.2% ➖ noise
80 duckdb:duckdb +9.1% +1.3% +7.6% +12.0% ➖ noise
80 duckdb:vortex-compact +11.1% +1.3% +9.6% +14.0% ➖ noise
80 duckdb:vortex-file-compressed +8.3% +1.3% +6.9% +14.4% ➖ noise
81 datafusion:vortex-compact +4.8% +6.6% -1.7% +11.7% ➖ noise
81 datafusion:vortex-file-compressed +4.3% +6.6% -2.2% +10.0% ➖ noise
81 duckdb:duckdb +3.1% +6.6% -3.3% +10.0% ➖ noise
81 duckdb:vortex-compact +6.9% +6.6% +0.3% +11.8% ➖ noise
81 duckdb:vortex-file-compressed +17.8% +6.6% +10.5% +10.0% 🚨 regression
82 datafusion:vortex-compact +3.2% +2.8% +0.4% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -1.8% +2.8% -4.5% +10.0% ➖ noise
82 duckdb:duckdb +15.2% +2.8% +12.1% +14.6% ➖ noise
82 duckdb:vortex-compact +4.9% +2.8% +2.1% +10.3% ➖ noise
82 duckdb:vortex-file-compressed +22.9% +2.8% +19.5% +11.1% 🚨 regression
83 datafusion:vortex-compact +3.9% +6.6% -2.5% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +5.4% +6.6% -1.1% +17.9% ➖ noise
83 duckdb:duckdb +7.1% +6.6% +0.5% +11.7% ➖ noise
83 duckdb:vortex-compact +5.4% +6.6% -1.1% +10.9% ➖ noise
83 duckdb:vortex-file-compressed +17.4% +6.6% +10.2% +16.4% ➖ noise
84 datafusion:vortex-compact +0.3% +4.6% -4.1% +10.0% ➖ noise
84 datafusion:vortex-file-compressed +12.2% +4.6% +7.2% +10.0% ➖ noise
84 duckdb:duckdb -5.8% +4.6% -10.0% +10.0% ✅ faster
84 duckdb:vortex-compact -0.5% +4.6% -4.9% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -4.8% +4.6% -9.0% +13.7% ➖ noise
85 datafusion:vortex-compact +11.8% +3.9% +7.6% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +3.8% +3.9% -0.1% +10.0% ➖ noise
85 duckdb:duckdb +1.0% +3.9% -2.8% +13.7% ➖ noise
85 duckdb:vortex-compact +3.3% +3.9% -0.6% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +12.1% +3.9% +7.9% +10.0% ➖ noise
86 datafusion:vortex-compact +17.1% +4.6% +11.9% +19.7% ➖ noise
86 datafusion:vortex-file-compressed +12.1% +4.6% +7.2% +19.4% ➖ noise
86 duckdb:duckdb +1.3% +4.6% -3.2% +17.7% ➖ noise
86 duckdb:vortex-compact -2.5% +4.6% -6.8% +17.4% ➖ noise
86 duckdb:vortex-file-compressed +5.6% +4.6% +0.9% +14.5% ➖ noise
87 datafusion:vortex-compact +2.0% +3.8% -1.7% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +7.4% +3.8% +3.4% +10.0% ➖ noise
87 duckdb:duckdb +3.5% +3.8% -0.3% +12.2% ➖ noise
87 duckdb:vortex-compact -1.0% +3.8% -4.6% +15.0% ➖ noise
87 duckdb:vortex-file-compressed +12.9% +3.8% +8.7% +10.0% ➖ noise
88 datafusion:vortex-compact +1.0% +0.4% +0.6% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +10.2% +0.4% +9.8% +10.1% ➖ noise
88 duckdb:duckdb +5.4% +0.4% +5.0% +14.1% ➖ noise
88 duckdb:vortex-compact +123.5% +0.4% +122.7% +10.8% 🚨 regression
88 duckdb:vortex-file-compressed +101.5% +0.4% +100.8% +14.4% 🚨 regression
89 datafusion:vortex-compact +4.2% +1.1% +3.1% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +5.0% +1.1% +3.8% +13.3% ➖ noise
89 duckdb:duckdb +2.6% +1.1% +1.5% +11.0% ➖ noise
89 duckdb:vortex-compact +3.3% +1.1% +2.1% +10.0% ➖ noise
89 duckdb:vortex-file-compressed +4.6% +1.1% +3.5% +14.9% ➖ noise
90 datafusion:vortex-compact -2.8% +8.4% -10.3% +10.0% ✅ faster
90 datafusion:vortex-file-compressed +9.4% +8.4% +1.0% +10.0% ➖ noise
90 duckdb:duckdb +19.3% +8.4% +10.1% +11.1% ➖ noise
90 duckdb:vortex-compact +6.5% +8.4% -1.7% +18.4% ➖ noise
90 duckdb:vortex-file-compressed +8.7% +8.4% +0.3% +10.3% ➖ noise
91 datafusion:vortex-compact +5.3% +9.3% -3.7% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +4.8% +9.3% -4.2% +10.0% ➖ noise
91 duckdb:duckdb +14.1% +9.3% +4.3% +14.1% ➖ noise
91 duckdb:vortex-compact +9.2% +9.3% -0.1% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +9.3% +9.3% -0.0% +11.7% ➖ noise
92 datafusion:vortex-compact -1.8% +11.9% -12.2% +13.6% ✅ faster
92 datafusion:vortex-file-compressed +1.4% +11.9% -9.4% +10.0% ✅ faster
92 duckdb:duckdb +21.2% +11.9% +8.3% +13.3% ➖ noise
92 duckdb:vortex-compact +10.1% +11.9% -1.6% +16.6% ➖ noise
92 duckdb:vortex-file-compressed +15.7% +11.9% +3.4% +14.0% ➖ noise
93 datafusion:vortex-compact +0.4% +6.2% -5.5% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +6.8% +6.2% +0.6% +10.0% ➖ noise
93 duckdb:duckdb +4.6% +6.2% -1.5% +11.9% ➖ noise
93 duckdb:vortex-compact +5.1% +6.2% -1.0% +17.4% ➖ noise
93 duckdb:vortex-file-compressed +22.1% +6.2% +15.0% +13.5% 🚨 regression
94 datafusion:vortex-compact +10.9% +10.7% +0.1% +12.7% ➖ noise
94 datafusion:vortex-file-compressed +3.1% +10.7% -6.9% +11.2% ➖ noise
94 duckdb:duckdb -11.3% +10.7% -19.9% +13.7% ✅ faster
94 duckdb:vortex-compact +8.3% +10.7% -2.2% +13.4% ➖ noise
94 duckdb:vortex-file-compressed +10.7% +10.7% -0.0% +17.0% ➖ noise
95 datafusion:vortex-compact -0.3% +8.9% -8.4% +10.0% ➖ noise
95 datafusion:vortex-file-compressed +3.5% +8.9% -5.0% +10.0% ➖ noise
95 duckdb:duckdb +6.6% +8.9% -2.1% +21.3% ➖ noise
95 duckdb:vortex-compact -0.4% +8.9% -8.6% +14.6% ➖ noise
95 duckdb:vortex-file-compressed +3.4% +8.9% -5.0% +15.4% ➖ noise
96 datafusion:vortex-compact +2.4% +2.8% -0.4% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +7.9% +2.8% +5.0% +10.0% ➖ noise
96 duckdb:duckdb +14.0% +2.8% +10.9% +15.5% ➖ noise
96 duckdb:vortex-compact +8.6% +2.8% +5.6% +10.0% ➖ noise
96 duckdb:vortex-file-compressed +19.7% +2.8% +16.5% +11.4% 🚨 regression
97 datafusion:vortex-compact -1.7% +13.9% -13.7% +12.5% ✅ faster
97 datafusion:vortex-file-compressed +3.9% +13.9% -8.8% +10.0% ➖ noise
97 duckdb:duckdb +1.4% +13.9% -11.0% +10.5% ✅ faster
97 duckdb:vortex-compact +5.3% +13.9% -7.6% +14.2% ➖ noise
97 duckdb:vortex-file-compressed +12.4% +13.9% -1.3% +10.7% ➖ noise
98 datafusion:vortex-compact +4.2% +1.9% +2.2% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +12.1% +1.9% +10.0% +11.7% ➖ noise
98 duckdb:duckdb -2.7% +1.9% -4.6% +14.8% ➖ noise
98 duckdb:vortex-compact +1.2% +1.9% -0.7% +10.0% ➖ noise
98 duckdb:vortex-file-compressed +3.3% +1.9% +1.4% +10.0% ➖ noise
99 datafusion:vortex-compact -16.9% +5.3% -21.1% +14.0% ✅ faster
99 datafusion:vortex-file-compressed +11.9% +5.3% +6.3% +24.0% ➖ noise
99 duckdb:duckdb +2.7% +5.3% -2.5% +13.2% ➖ noise
99 duckdb:vortex-compact +10.2% +5.3% +4.6% +16.2% ➖ noise
99 duckdb:vortex-file-compressed +7.8% +5.3% +2.4% +26.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.8%
Vortex (geomean): 0.960x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -2.1%


datafusion / vortex-file-compressed (0.961x ➖, 0↑ 1↓)
name PR 86ce16f (ns) base 40112f4 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 36019010 35650039 1.01
fineweb_q01/datafusion:vortex-file-compressed 🚨 743626343 537275746 1.38
fineweb_q02/datafusion:vortex-file-compressed 568766956 504503228 1.13
fineweb_q03/datafusion:vortex-file-compressed 1361506587 1534402473 0.89
fineweb_q04/datafusion:vortex-file-compressed 1396341780 1627251003 0.86
fineweb_q05/datafusion:vortex-file-compressed 1436239872 1439832137 1.00
fineweb_q06/datafusion:vortex-file-compressed 1453787565 1781915778 0.82
fineweb_q07/datafusion:vortex-file-compressed 1349516243 1561201255 0.86
fineweb_q08/datafusion:vortex-file-compressed 517506210 624239000 0.83
datafusion / vortex-compact (1.041x ➖, 0↑ 0↓)
name PR 86ce16f (ns) base 40112f4 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 33817795 35555838 0.95
fineweb_q01/datafusion:vortex-compact 598671670 537611679 1.11
fineweb_q02/datafusion:vortex-compact 565032544 563778321 1.00
fineweb_q03/datafusion:vortex-compact 1476358975 1552958908 0.95
fineweb_q04/datafusion:vortex-compact 1761494418 1776968189 0.99
fineweb_q05/datafusion:vortex-compact 1482436130 1445599576 1.03
fineweb_q06/datafusion:vortex-compact 1437379661 1292237587 1.11
fineweb_q07/datafusion:vortex-compact 1191629449 1147450620 1.04
fineweb_q08/datafusion:vortex-compact 467355595 385745259 1.21
datafusion / parquet (1.022x ➖, 0↑ 0↓)
name PR 86ce16f (ns) base 40112f4 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1086826029 1053502110 1.03
fineweb_q01/datafusion:parquet 1794811484 1809092625 0.99
fineweb_q02/datafusion:parquet 1730203924 1786400784 0.97
fineweb_q03/datafusion:parquet 2069884416 1792176664 1.15
fineweb_q04/datafusion:parquet 1849409413 1739561980 1.06
fineweb_q05/datafusion:parquet 1750872793 1845336693 0.95
fineweb_q06/datafusion:parquet 1841864064 1892009577 0.97
fineweb_q07/datafusion:parquet 1768876329 1796261900 0.98
fineweb_q08/datafusion:parquet 1930665585 1755410662 1.10
duckdb / vortex-file-compressed (0.958x ➖, 0↑ 0↓)
name PR 86ce16f (ns) base 40112f4 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 78197423 109697864 0.71
fineweb_q01/duckdb:vortex-file-compressed 605317735 563945335 1.07
fineweb_q02/duckdb:vortex-file-compressed 488581832 460139945 1.06
fineweb_q03/duckdb:vortex-file-compressed 1474052170 1515081172 0.97
fineweb_q04/duckdb:vortex-file-compressed 1524996245 1512806050 1.01
fineweb_q05/duckdb:vortex-file-compressed 1463914368 1486829794 0.98
fineweb_q06/duckdb:vortex-file-compressed 1622440230 1700891770 0.95
fineweb_q07/duckdb:vortex-file-compressed 1423944190 1492225385 0.95
fineweb_q08/duckdb:vortex-file-compressed 608139540 636192034 0.96
duckdb / vortex-compact (0.885x ➖, 1↑ 0↓)
name PR 86ce16f (ns) base 40112f4 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 50001024 120401953 0.42
fineweb_q01/duckdb:vortex-compact 585892442 597632112 0.98
fineweb_q02/duckdb:vortex-compact 568260270 598706725 0.95
fineweb_q03/duckdb:vortex-compact 1624163694 1643286828 0.99
fineweb_q04/duckdb:vortex-compact 1727597683 1767700441 0.98
fineweb_q05/duckdb:vortex-compact 1578543066 1629032253 0.97
fineweb_q06/duckdb:vortex-compact 1487816519 1478080210 1.01
fineweb_q07/duckdb:vortex-compact 1312255916 1432488429 0.92
fineweb_q08/duckdb:vortex-compact 522180385 522540463 1.00
duckdb / parquet (0.955x ➖, 0↑ 0↓)
name PR 86ce16f (ns) base 40112f4 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1091657281 1200433016 0.91
fineweb_q01/duckdb:parquet 1397633050 1430843855 0.98
fineweb_q02/duckdb:parquet 1303862125 1390881333 0.94
fineweb_q03/duckdb:parquet 3924814314 3826399046 1.03
fineweb_q04/duckdb:parquet 1913861137 1952501765 0.98
fineweb_q05/duckdb:parquet 2106980609 2164079751 0.97
fineweb_q06/duckdb:parquet 4306542105 4716056261 0.91
fineweb_q07/duckdb:parquet 2624564115 2825529120 0.93
fineweb_q08/duckdb:parquet 1153251223 1208935430 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -4.9% -3.1% -1.8% +192.8% ➖ noise
0 datafusion:vortex-file-compressed +1.0% -3.1% +4.3% +157.3% ➖ noise
0 duckdb:vortex-compact -58.5% -3.1% -57.1% +68.8% ✅ faster
0 duckdb:vortex-file-compressed -28.7% -3.1% -26.4% +43.0% ➖ noise
1 datafusion:vortex-compact +11.4% -1.6% +13.1% +81.7% ➖ noise
1 datafusion:vortex-file-compressed +38.4% -1.6% +40.6% +72.4% ➖ noise
1 duckdb:vortex-compact -2.0% -1.6% -0.4% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +7.3% -1.6% +9.0% +30.9% ➖ noise
2 datafusion:vortex-compact +0.2% -4.7% +5.2% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +12.7% -4.7% +18.3% +42.5% ➖ noise
2 duckdb:vortex-compact -5.1% -4.7% -0.4% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +6.2% -4.7% +11.4% +30.0% ➖ noise
3 datafusion:vortex-compact -4.9% +8.8% -12.7% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -11.3% +8.8% -18.5% +30.0% ➖ noise
3 duckdb:vortex-compact -1.2% +8.8% -9.2% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -2.7% +8.8% -10.6% +30.0% ➖ noise
4 datafusion:vortex-compact -0.9% +2.1% -2.9% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -14.2% +2.1% -15.9% +30.0% ➖ noise
4 duckdb:vortex-compact -2.3% +2.1% -4.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +0.8% +2.1% -1.3% +30.0% ➖ noise
5 datafusion:vortex-compact +2.5% -3.9% +6.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -0.2% -3.9% +3.8% +30.0% ➖ noise
5 duckdb:vortex-compact -3.1% -3.9% +0.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -1.5% -3.9% +2.4% +30.0% ➖ noise
6 datafusion:vortex-compact +11.2% -5.7% +18.0% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -18.4% -5.7% -13.5% +30.0% ➖ noise
6 duckdb:vortex-compact +0.7% -5.7% +6.8% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -4.6% -5.7% +1.2% +30.0% ➖ noise
7 datafusion:vortex-compact +3.9% -4.4% +8.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -13.6% -4.4% -9.6% +30.0% ➖ noise
7 duckdb:vortex-compact -8.4% -4.4% -4.2% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -4.6% -4.4% -0.2% +30.0% ➖ noise
8 datafusion:vortex-compact +21.2% +2.4% +18.3% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -17.1% +2.4% -19.1% +30.0% ➖ noise
8 duckdb:vortex-compact -0.1% +2.4% -2.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -4.4% +2.4% -6.7% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=10 on NVME failed! Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=1 on S3 failed! Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Vortex (geomean): 0.987x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish -0.1%


duckdb / vortex-file-compressed (0.982x ➖, 1↑ 0↓)
name PR 86ce16f (ns) base 128ce5f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12240843 12151567 1.01
statpopgen_q01/duckdb:vortex-file-compressed 🚀 20158764 23640231 0.85
statpopgen_q02/duckdb:vortex-file-compressed 1414160692 1409487885 1.00
statpopgen_q03/duckdb:vortex-file-compressed 3156981102 3148866153 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3219000228 3246193316 0.99
statpopgen_q05/duckdb:vortex-file-compressed 1462968696 1463395466 1.00
statpopgen_q06/duckdb:vortex-file-compressed 2161677639 2161009808 1.00
statpopgen_q07/duckdb:vortex-file-compressed 219711670 225411149 0.97
statpopgen_q08/duckdb:vortex-file-compressed 256122320 260549623 0.98
statpopgen_q09/duckdb:vortex-file-compressed 2990306423 2980415423 1.00
statpopgen_q10/duckdb:vortex-file-compressed 4769591150 4789540763 1.00
duckdb / vortex-compact (0.992x ➖, 0↑ 0↓)
name PR 86ce16f (ns) base 128ce5f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11430090 11892665 0.96
statpopgen_q01/duckdb:vortex-compact 167353564 171875089 0.97
statpopgen_q02/duckdb:vortex-compact 1818909572 1849931354 0.98
statpopgen_q03/duckdb:vortex-compact 3541286389 3543493115 1.00
statpopgen_q04/duckdb:vortex-compact 3572400115 3553450965 1.01
statpopgen_q05/duckdb:vortex-compact 1878368305 1875003107 1.00
statpopgen_q06/duckdb:vortex-compact 2706454572 2714131343 1.00
statpopgen_q07/duckdb:vortex-compact 901175684 908010151 0.99
statpopgen_q08/duckdb:vortex-compact 943867553 944813384 1.00
statpopgen_q09/duckdb:vortex-compact 3363264707 3374701880 1.00
statpopgen_q10/duckdb:vortex-compact 5472374247 5442441316 1.01
duckdb / parquet (1.004x ➖, 0↑ 0↓)
name PR 86ce16f (ns) base 128ce5f (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 331794199 335542777 0.99
statpopgen_q01/duckdb:parquet 406873007 419255793 0.97
statpopgen_q02/duckdb:parquet 1011345795 1017875472 0.99
statpopgen_q03/duckdb:parquet 1524507655 1510741904 1.01
statpopgen_q04/duckdb:parquet 1529496374 1510333013 1.01
statpopgen_q05/duckdb:parquet 1029513833 1030027970 1.00
statpopgen_q06/duckdb:parquet 1491043773 1506791776 0.99
statpopgen_q07/duckdb:parquet 1347238726 1326114575 1.02
statpopgen_q08/duckdb:parquet 1353436440 1320740237 1.02
statpopgen_q09/duckdb:parquet 1443179767 1396089821 1.03
statpopgen_q10/duckdb:parquet 2723519562 2713241435 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -3.9% -1.1% -2.8% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +0.7% -1.1% +1.9% +13.9% ➖ noise
1 duckdb:vortex-compact -2.6% -3.0% +0.3% +27.9% ➖ noise
1 duckdb:vortex-file-compressed -14.7% -3.0% -12.1% +198.6% ➖ noise
2 duckdb:vortex-compact -1.7% -0.6% -1.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.3% -0.6% +1.0% +10.0% ➖ noise
3 duckdb:vortex-compact -0.1% +0.9% -1.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.3% +0.9% -0.6% +10.0% ➖ noise
4 duckdb:vortex-compact +0.5% +1.3% -0.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.8% +1.3% -2.1% +10.0% ➖ noise
5 duckdb:vortex-compact +0.2% -0.0% +0.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.0% -0.0% +0.0% +10.0% ➖ noise
6 duckdb:vortex-compact -0.3% -1.0% +0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.0% -1.0% +1.1% +10.0% ➖ noise
7 duckdb:vortex-compact -0.8% +1.6% -2.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -2.5% +1.6% -4.1% +10.0% ➖ noise
8 duckdb:vortex-compact -0.1% +2.5% -2.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.7% +2.5% -4.1% +10.0% ➖ noise
9 duckdb:vortex-compact -0.3% +3.4% -3.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.3% +3.4% -2.9% +10.0% ➖ noise
10 duckdb:vortex-compact +0.5% +0.4% +0.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.4% +0.4% -0.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.7%
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.4%


datafusion / vortex-file-compressed (0.992x ➖, 2↑ 0↓)
name PR 86ce16f (ns) base 128ce5f (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1617536 1608886 1.01
clickbench_q01/datafusion:vortex-file-compressed 19356065 19199530 1.01
clickbench_q02/datafusion:vortex-file-compressed 37511140 35522905 1.06
clickbench_q03/datafusion:vortex-file-compressed 43429765 42571317 1.02
clickbench_q04/datafusion:vortex-file-compressed 284878460 285344323 1.00
clickbench_q05/datafusion:vortex-file-compressed 294685351 300864883 0.98
clickbench_q06/datafusion:vortex-file-compressed 1718377 1814902 0.95
clickbench_q07/datafusion:vortex-file-compressed 🚀 23088943 27158448 0.85
clickbench_q08/datafusion:vortex-file-compressed 347712530 345456917 1.01
clickbench_q09/datafusion:vortex-file-compressed 546811282 545103101 1.00
clickbench_q10/datafusion:vortex-file-compressed 72603338 70724984 1.03
clickbench_q11/datafusion:vortex-file-compressed 85971703 86183934 1.00
clickbench_q12/datafusion:vortex-file-compressed 262970366 268102748 0.98
clickbench_q13/datafusion:vortex-file-compressed 400415510 405435105 0.99
clickbench_q14/datafusion:vortex-file-compressed 252023754 247517686 1.02
clickbench_q15/datafusion:vortex-file-compressed 322980534 318720678 1.01
clickbench_q16/datafusion:vortex-file-compressed 630369771 629991990 1.00
clickbench_q17/datafusion:vortex-file-compressed 619406141 619326923 1.00
clickbench_q18/datafusion:vortex-file-compressed 1279678507 1275988918 1.00
clickbench_q19/datafusion:vortex-file-compressed 🚀 29184454 33086111 0.88
clickbench_q20/datafusion:vortex-file-compressed 331879472 335335005 0.99
clickbench_q21/datafusion:vortex-file-compressed 365086454 366670415 1.00
clickbench_q22/datafusion:vortex-file-compressed 442847292 437628945 1.01
clickbench_q23/datafusion:vortex-file-compressed 671550418 643090807 1.04
clickbench_q24/datafusion:vortex-file-compressed 44953695 47490494 0.95
clickbench_q25/datafusion:vortex-file-compressed 68988378 71874412 0.96
clickbench_q26/datafusion:vortex-file-compressed 44088637 43658305 1.01
clickbench_q27/datafusion:vortex-file-compressed 707268283 713972778 0.99
clickbench_q28/datafusion:vortex-file-compressed 6721679398 6699194361 1.00
clickbench_q29/datafusion:vortex-file-compressed 238321027 229492140 1.04
clickbench_q30/datafusion:vortex-file-compressed 217202421 217053774 1.00
clickbench_q31/datafusion:vortex-file-compressed 251174330 250402603 1.00
clickbench_q32/datafusion:vortex-file-compressed 1089688847 1085446428 1.00
clickbench_q33/datafusion:vortex-file-compressed 1270158850 1272061470 1.00
clickbench_q34/datafusion:vortex-file-compressed 1264861936 1279659033 0.99
clickbench_q35/datafusion:vortex-file-compressed 435995260 449162970 0.97
clickbench_q36/datafusion:vortex-file-compressed 68900477 70327514 0.98
clickbench_q37/datafusion:vortex-file-compressed 33994752 33908102 1.00
clickbench_q38/datafusion:vortex-file-compressed 18659572 18843746 0.99
clickbench_q39/datafusion:vortex-file-compressed 130142194 129569636 1.00
clickbench_q40/datafusion:vortex-file-compressed 15868392 15672693 1.01
clickbench_q41/datafusion:vortex-file-compressed 14624470 14809789 0.99
clickbench_q42/datafusion:vortex-file-compressed 16767901 17112974 0.98
datafusion / parquet (1.005x ➖, 1↑ 0↓)
name PR 86ce16f (ns) base 128ce5f (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1504023 1558415 0.97
clickbench_q01/datafusion:parquet 18432159 18656123 0.99
clickbench_q02/datafusion:parquet 45000280 45994921 0.98
clickbench_q03/datafusion:parquet 36649522 37081388 0.99
clickbench_q04/datafusion:parquet 288075266 292503300 0.98
clickbench_q05/datafusion:parquet 351500874 338981379 1.04
clickbench_q06/datafusion:parquet 🚀 1574389 1780060 0.88
clickbench_q07/datafusion:parquet 22527142 21479672 1.05
clickbench_q08/datafusion:parquet 365186202 361258596 1.01
clickbench_q09/datafusion:parquet 606475337 609067727 1.00
clickbench_q10/datafusion:parquet 107156469 107915890 0.99
clickbench_q11/datafusion:parquet 132947268 133267921 1.00
clickbench_q12/datafusion:parquet 336966646 340544694 0.99
clickbench_q13/datafusion:parquet 491008436 486082081 1.01
clickbench_q14/datafusion:parquet 343111952 333675368 1.03
clickbench_q15/datafusion:parquet 329331261 330072408 1.00
clickbench_q16/datafusion:parquet 661764978 660255076 1.00
clickbench_q17/datafusion:parquet 641589174 641634990 1.00
clickbench_q18/datafusion:parquet 1323070724 1303080804 1.02
clickbench_q19/datafusion:parquet 28756339 28360631 1.01
clickbench_q20/datafusion:parquet 590290926 593669585 0.99
clickbench_q21/datafusion:parquet 660712183 660806211 1.00
clickbench_q22/datafusion:parquet 962275701 969270470 0.99
clickbench_q23/datafusion:parquet 3696156517 3700738604 1.00
clickbench_q24/datafusion:parquet 84542797 79884555 1.06
clickbench_q25/datafusion:parquet 136423086 136841459 1.00
clickbench_q26/datafusion:parquet 81269106 80421026 1.01
clickbench_q27/datafusion:parquet 1053990039 1033466863 1.02
clickbench_q28/datafusion:parquet 6317044095 6634168794 0.95
clickbench_q29/datafusion:parquet 225411915 233212594 0.97
clickbench_q30/datafusion:parquet 328633053 326122716 1.01
clickbench_q31/datafusion:parquet 359885787 354085275 1.02
clickbench_q32/datafusion:parquet 1182068170 1127943941 1.05
clickbench_q33/datafusion:parquet 1461058591 1445451359 1.01
clickbench_q34/datafusion:parquet 1464529371 1448623422 1.01
clickbench_q35/datafusion:parquet 448453642 450262768 1.00
clickbench_q36/datafusion:parquet 142643890 135302679 1.05
clickbench_q37/datafusion:parquet 57735303 55832518 1.03
clickbench_q38/datafusion:parquet 87332925 83680252 1.04
clickbench_q39/datafusion:parquet 260343234 255546349 1.02
clickbench_q40/datafusion:parquet 30059155 29717787 1.01
clickbench_q41/datafusion:parquet 26884505 26322804 1.02
clickbench_q42/datafusion:parquet 30241631 28895261 1.05
duckdb / vortex-file-compressed (1.012x ➖, 1↑ 3↓)
name PR 86ce16f (ns) base 128ce5f (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 7758249 5969085 1.30
clickbench_q01/duckdb:vortex-file-compressed 13174069 13307210 0.99
clickbench_q02/duckdb:vortex-file-compressed 26004749 24681566 1.05
clickbench_q03/duckdb:vortex-file-compressed 29329629 29579236 0.99
clickbench_q04/duckdb:vortex-file-compressed 181162861 180015414 1.01
clickbench_q05/duckdb:vortex-file-compressed 170443176 167741929 1.02
clickbench_q06/duckdb:vortex-file-compressed 19629225 19714805 1.00
clickbench_q07/duckdb:vortex-file-compressed 🚨 16351077 13814052 1.18
clickbench_q08/duckdb:vortex-file-compressed 259319418 250558381 1.03
clickbench_q09/duckdb:vortex-file-compressed 331058454 329415328 1.00
clickbench_q10/duckdb:vortex-file-compressed 66560527 64649507 1.03
clickbench_q11/duckdb:vortex-file-compressed 75222193 74117877 1.01
clickbench_q12/duckdb:vortex-file-compressed 193847649 188958836 1.03
clickbench_q13/duckdb:vortex-file-compressed 397068159 383098983 1.04
clickbench_q14/duckdb:vortex-file-compressed 226589716 227709507 1.00
clickbench_q15/duckdb:vortex-file-compressed 243751591 244742467 1.00
clickbench_q16/duckdb:vortex-file-compressed 579089352 583259163 0.99
clickbench_q17/duckdb:vortex-file-compressed 470723905 497682332 0.95
clickbench_q18/duckdb:vortex-file-compressed 960928279 982454115 0.98
clickbench_q19/duckdb:vortex-file-compressed 20599392 20555963 1.00
clickbench_q20/duckdb:vortex-file-compressed 314932216 331653142 0.95
clickbench_q21/duckdb:vortex-file-compressed 359106688 349891526 1.03
clickbench_q22/duckdb:vortex-file-compressed 473954554 486037439 0.98
clickbench_q23/duckdb:vortex-file-compressed 🚀 233582799 332462046 0.70
clickbench_q24/duckdb:vortex-file-compressed 37503624 35824359 1.05
clickbench_q25/duckdb:vortex-file-compressed 🚨 81830886 72755166 1.12
clickbench_q26/duckdb:vortex-file-compressed 49822897 49609673 1.00
clickbench_q27/duckdb:vortex-file-compressed 448066904 460929331 0.97
clickbench_q28/duckdb:vortex-file-compressed 2960537030 2952454838 1.00
clickbench_q29/duckdb:vortex-file-compressed 27191957 26966587 1.01
clickbench_q30/duckdb:vortex-file-compressed 186248117 186229319 1.00
clickbench_q31/duckdb:vortex-file-compressed 273369240 274458164 1.00
clickbench_q32/duckdb:vortex-file-compressed 1158284190 1182972884 0.98
clickbench_q33/duckdb:vortex-file-compressed 1133818296 1118332227 1.01
clickbench_q34/duckdb:vortex-file-compressed 1205673396 1224395923 0.98
clickbench_q35/duckdb:vortex-file-compressed 373953588 373210344 1.00
clickbench_q36/duckdb:vortex-file-compressed 26150593 25720538 1.02
clickbench_q37/duckdb:vortex-file-compressed 19592758 18303473 1.07
clickbench_q38/duckdb:vortex-file-compressed 21364878 19698281 1.08
clickbench_q39/duckdb:vortex-file-compressed 40680743 40210318 1.01
clickbench_q40/duckdb:vortex-file-compressed 20172515 18737679 1.08
clickbench_q41/duckdb:vortex-file-compressed 18907760 18379884 1.03
clickbench_q42/duckdb:vortex-file-compressed 19932154 20152794 0.99
duckdb / parquet (0.990x ➖, 0↑ 0↓)
name PR 86ce16f (ns) base 128ce5f (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 27229421 26726842 1.02
clickbench_q01/duckdb:parquet 27307201 26831781 1.02
clickbench_q02/duckdb:parquet 48258151 48863378 0.99
clickbench_q03/duckdb:parquet 37955219 37879944 1.00
clickbench_q04/duckdb:parquet 199828971 199513294 1.00
clickbench_q05/duckdb:parquet 260138046 269012576 0.97
clickbench_q06/duckdb:parquet 46207209 46018945 1.00
clickbench_q07/duckdb:parquet 29137739 29163696 1.00
clickbench_q08/duckdb:parquet 266633512 265159328 1.01
clickbench_q09/duckdb:parquet 394040138 394296698 1.00
clickbench_q10/duckdb:parquet 80777540 78977911 1.02
clickbench_q11/duckdb:parquet 97646619 96956813 1.01
clickbench_q12/duckdb:parquet 290714645 288709858 1.01
clickbench_q13/duckdb:parquet 483294440 482305597 1.00
clickbench_q14/duckdb:parquet 321382200 325667573 0.99
clickbench_q15/duckdb:parquet 264251540 259097058 1.02
clickbench_q16/duckdb:parquet 638894246 638855438 1.00
clickbench_q17/duckdb:parquet 531643744 535401340 0.99
clickbench_q18/duckdb:parquet 1072966695 1066625368 1.01
clickbench_q19/duckdb:parquet 25814005 25224471 1.02
clickbench_q20/duckdb:parquet 425305787 426520584 1.00
clickbench_q21/duckdb:parquet 547910225 545924173 1.00
clickbench_q22/duckdb:parquet 939400389 940480209 1.00
clickbench_q23/duckdb:parquet 291464703 303750146 0.96
clickbench_q24/duckdb:parquet 65174179 66739964 0.98
clickbench_q25/duckdb:parquet 156408638 156187703 1.00
clickbench_q26/duckdb:parquet 50949604 50361646 1.01
clickbench_q27/duckdb:parquet 642131215 648640946 0.99
clickbench_q28/duckdb:parquet 4832063089 4844973891 1.00
clickbench_q29/duckdb:parquet 41248648 40558446 1.02
clickbench_q30/duckdb:parquet 299640087 297441824 1.01
clickbench_q31/duckdb:parquet 362563400 362502080 1.00
clickbench_q32/duckdb:parquet 1154511908 1184847044 0.97
clickbench_q33/duckdb:parquet 1222289353 1285003594 0.95
clickbench_q34/duckdb:parquet 1346510172 1343997133 1.00
clickbench_q35/duckdb:parquet 357572973 360198176 0.99
clickbench_q36/duckdb:parquet 45375372 47121835 0.96
clickbench_q37/duckdb:parquet 30776500 32252258 0.95
clickbench_q38/duckdb:parquet 32744877 34607150 0.95
clickbench_q39/duckdb:parquet 89366021 90731259 0.98
clickbench_q40/duckdb:parquet 16012913 16958424 0.94
clickbench_q41/duckdb:parquet 17498491 18925137 0.92
clickbench_q42/duckdb:parquet 20861373 23015193 0.91
duckdb / duckdb (1.038x ➖, 1↑ 5↓)
name PR 86ce16f (ns) base 128ce5f (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18347979 18251512 1.01
clickbench_q01/duckdb:duckdb 34738519 31752921 1.09
clickbench_q02/duckdb:duckdb 46861137 43970629 1.07
clickbench_q03/duckdb:duckdb 49665579 45536680 1.09
clickbench_q04/duckdb:duckdb 187612380 186501929 1.01
clickbench_q05/duckdb:duckdb 262878895 263603742 1.00
clickbench_q06/duckdb:duckdb 🚀 29507193 34972131 0.84
clickbench_q07/duckdb:duckdb 🚨 37991135 34010490 1.12
clickbench_q08/duckdb:duckdb 248318703 248559238 1.00
clickbench_q09/duckdb:duckdb 365351697 363703445 1.00
clickbench_q10/duckdb:duckdb 99508270 97663689 1.02
clickbench_q11/duckdb:duckdb 108717257 105589034 1.03
clickbench_q12/duckdb:duckdb 239324994 237844969 1.01
clickbench_q13/duckdb:duckdb 472149710 447497001 1.06
clickbench_q14/duckdb:duckdb 270921923 275355274 0.98
clickbench_q15/duckdb:duckdb 218118065 218116402 1.00
clickbench_q16/duckdb:duckdb 620474933 629081766 0.99
clickbench_q17/duckdb:duckdb 552518118 546470777 1.01
clickbench_q18/duckdb:duckdb 1158521451 1179934183 0.98
clickbench_q19/duckdb:duckdb 36276919 34066610 1.06
clickbench_q20/duckdb:duckdb 🚨 1018293700 907840933 1.12
clickbench_q21/duckdb:duckdb 🚨 1110512355 934853209 1.19
clickbench_q22/duckdb:duckdb 🚨 1133720190 985454639 1.15
clickbench_q23/duckdb:duckdb 254123351 246580381 1.03
clickbench_q24/duckdb:duckdb 63542540 61310686 1.04
clickbench_q25/duckdb:duckdb 143525300 143542678 1.00
clickbench_q26/duckdb:duckdb 61990989 59181199 1.05
clickbench_q27/duckdb:duckdb 1098571874 1013849564 1.08
clickbench_q28/duckdb:duckdb 4622719443 4578580201 1.01
clickbench_q29/duckdb:duckdb 51181212 47534393 1.08
clickbench_q30/duckdb:duckdb 264460206 258433335 1.02
clickbench_q31/duckdb:duckdb 425755226 413616045 1.03
clickbench_q32/duckdb:duckdb 1414417722 1451043446 0.97
clickbench_q33/duckdb:duckdb 1979188061 1873340614 1.06
clickbench_q34/duckdb:duckdb 2086195327 2047994046 1.02
clickbench_q35/duckdb:duckdb 280666498 285073638 0.98
clickbench_q36/duckdb:duckdb 41850111 41065984 1.02
clickbench_q37/duckdb:duckdb 33974898 31094995 1.09
clickbench_q38/duckdb:duckdb 32226184 30569602 1.05
clickbench_q39/duckdb:duckdb 🚨 71483073 64317613 1.11
clickbench_q40/duckdb:duckdb 33838540 31291584 1.08
clickbench_q41/duckdb:duckdb 32047945 29669675 1.08
clickbench_q42/duckdb:duckdb 33931182 31224721 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +0.5% -0.8% +1.4% +767.0% ➖ noise
0 duckdb:duckdb +0.5% -0.8% +1.4% +291.2% ➖ noise
0 duckdb:vortex-file-compressed +30.0% -0.8% +31.1% +453.3% ➖ noise
1 datafusion:vortex-file-compressed +0.8% +0.3% +0.5% +22.4% ➖ noise
1 duckdb:duckdb +9.4% +0.3% +9.1% +57.0% ➖ noise
1 duckdb:vortex-file-compressed -1.0% +0.3% -1.3% +22.1% ➖ noise
2 datafusion:vortex-file-compressed +5.6% -1.7% +7.4% +10.1% ➖ noise
2 duckdb:duckdb +6.6% -1.7% +8.4% +20.6% ➖ noise
2 duckdb:vortex-file-compressed +5.4% -1.7% +7.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +2.0% -0.5% +2.5% +141.5% ➖ noise
3 duckdb:duckdb +9.1% -0.5% +9.6% +39.6% ➖ noise
3 duckdb:vortex-file-compressed -0.8% -0.5% -0.4% +53.7% ➖ noise
4 datafusion:vortex-file-compressed -0.2% -0.7% +0.5% +10.0% ➖ noise
4 duckdb:duckdb +0.6% -0.7% +1.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.6% -0.7% +1.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.1% +0.1% -2.2% +10.0% ➖ noise
5 duckdb:duckdb -0.3% +0.1% -0.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.6% +0.1% +1.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -5.3% -5.8% +0.5% +98.5% ➖ noise
6 duckdb:duckdb -15.6% -5.8% -10.5% +61.2% ➖ noise
6 duckdb:vortex-file-compressed -0.4% -5.8% +5.7% +55.0% ➖ noise
7 datafusion:vortex-file-compressed -15.0% +2.4% -16.9% +16.8% ✅ faster
7 duckdb:duckdb +11.7% +2.4% +9.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +18.4% +2.4% +15.6% +10.0% 🚨 regression
8 datafusion:vortex-file-compressed +0.7% +0.8% -0.2% +10.0% ➖ noise
8 duckdb:duckdb -0.1% +0.8% -0.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +3.5% +0.8% +2.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.3% -0.2% +0.6% +10.0% ➖ noise
9 duckdb:duckdb +0.5% -0.2% +0.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.5% -0.2% +0.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +2.7% +0.8% +1.9% +10.0% ➖ noise
10 duckdb:duckdb +1.9% +0.8% +1.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +3.0% +0.8% +2.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.2% +0.2% -0.5% +10.0% ➖ noise
11 duckdb:duckdb +3.0% +0.2% +2.7% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +1.5% +0.2% +1.3% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.9% -0.2% -1.7% +10.0% ➖ noise
12 duckdb:duckdb +0.6% -0.2% +0.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +2.6% -0.2% +2.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.2% +0.6% -1.8% +10.0% ➖ noise
13 duckdb:duckdb +5.5% +0.6% +4.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +3.6% +0.6% +3.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.8% +0.7% +1.1% +10.0% ➖ noise
14 duckdb:duckdb -1.6% +0.7% -2.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.5% +0.7% -1.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.3% +0.9% +0.5% +10.0% ➖ noise
15 duckdb:duckdb +0.0% +0.9% -0.9% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.4% +0.9% -1.3% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.1% +0.1% -0.1% +10.0% ➖ noise
16 duckdb:duckdb -1.4% +0.1% -1.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.7% +0.1% -0.8% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.0% -0.4% +0.4% +10.0% ➖ noise
17 duckdb:duckdb +1.1% -0.4% +1.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -5.4% -0.4% -5.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.3% +1.1% -0.8% +10.0% ➖ noise
18 duckdb:duckdb -1.8% +1.1% -2.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -2.2% +1.1% -3.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -11.8% +1.9% -13.4% +36.0% ➖ noise
19 duckdb:duckdb +6.5% +1.9% +4.5% +16.2% ➖ noise
19 duckdb:vortex-file-compressed +0.2% +1.9% -1.6% +17.7% ➖ noise
20 datafusion:vortex-file-compressed -1.0% -0.4% -0.6% +212.1% ➖ noise
20 duckdb:duckdb +12.2% -0.4% +12.6% +26.7% ➖ noise
20 duckdb:vortex-file-compressed -5.0% -0.4% -4.6% +35.8% ➖ noise
21 datafusion:vortex-file-compressed -0.4% +0.2% -0.6% +10.0% ➖ noise
21 duckdb:duckdb +18.8% +0.2% +18.6% +13.8% 🚨 regression
21 duckdb:vortex-file-compressed +2.6% +0.2% +2.5% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +1.2% -0.4% +1.6% +16.6% ➖ noise
22 duckdb:duckdb +15.0% -0.4% +15.5% +14.6% 🚨 regression
22 duckdb:vortex-file-compressed -2.5% -0.4% -2.1% +17.1% ➖ noise
23 datafusion:vortex-file-compressed +4.4% -2.1% +6.7% +44.4% ➖ noise
23 duckdb:duckdb +3.1% -2.1% +5.3% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -29.7% -2.1% -28.2% +12.1% ✅ faster
24 datafusion:vortex-file-compressed -5.3% +1.7% -6.9% +13.8% ➖ noise
24 duckdb:duckdb +3.6% +1.7% +1.9% +14.1% ➖ noise
24 duckdb:vortex-file-compressed +4.7% +1.7% +3.0% +12.1% ➖ noise
25 datafusion:vortex-file-compressed -4.0% -0.1% -3.9% +10.0% ➖ noise
25 duckdb:duckdb -0.0% -0.1% +0.1% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +12.5% -0.1% +12.6% +11.2% 🚨 regression
26 datafusion:vortex-file-compressed +1.0% +1.1% -0.1% +12.7% ➖ noise
26 duckdb:duckdb +4.7% +1.1% +3.6% +12.3% ➖ noise
26 duckdb:vortex-file-compressed +0.4% +1.1% -0.7% +13.0% ➖ noise
27 datafusion:vortex-file-compressed -0.9% +0.5% -1.4% +10.0% ➖ noise
27 duckdb:duckdb +8.4% +0.5% +7.8% +10.9% ➖ noise
27 duckdb:vortex-file-compressed -2.8% +0.5% -3.3% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.3% -2.5% +3.0% +10.0% ➖ noise
28 duckdb:duckdb +1.0% -2.5% +3.6% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.3% -2.5% +2.9% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +3.8% -0.9% +4.7% +10.0% ➖ noise
29 duckdb:duckdb +7.7% -0.9% +8.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +0.8% -0.9% +1.7% +26.9% ➖ noise
30 datafusion:vortex-file-compressed +0.1% +0.8% -0.7% +10.0% ➖ noise
30 duckdb:duckdb +2.3% +0.8% +1.6% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.0% +0.8% -0.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.3% +0.8% -0.5% +10.0% ➖ noise
31 duckdb:duckdb +2.9% +0.8% +2.1% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -0.4% +0.8% -1.2% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +0.4% +1.1% -0.7% +10.0% ➖ noise
32 duckdb:duckdb -2.5% +1.1% -3.5% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -2.1% +1.1% -3.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -0.1% -1.9% +1.8% +10.0% ➖ noise
33 duckdb:duckdb +5.7% -1.9% +7.7% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +1.4% -1.9% +3.4% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -1.2% +0.6% -1.8% +10.0% ➖ noise
34 duckdb:duckdb +1.9% +0.6% +1.2% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -1.5% +0.6% -2.2% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -2.9% -0.6% -2.4% +10.0% ➖ noise
35 duckdb:duckdb -1.5% -0.6% -1.0% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.2% -0.6% +0.8% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -2.0% +0.8% -2.8% +10.0% ➖ noise
36 duckdb:duckdb +1.9% +0.8% +1.1% +13.2% ➖ noise
36 duckdb:vortex-file-compressed +1.7% +0.8% +0.9% +10.6% ➖ noise
37 datafusion:vortex-file-compressed +0.3% -0.7% +0.9% +10.0% ➖ noise
37 duckdb:duckdb +9.3% -0.7% +10.0% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +7.0% -0.7% +7.8% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -1.0% -0.6% -0.4% +10.0% ➖ noise
38 duckdb:duckdb +5.4% -0.6% +6.1% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +8.5% -0.6% +9.1% +13.5% ➖ noise
39 datafusion:vortex-file-compressed +0.4% +0.2% +0.3% +10.0% ➖ noise
39 duckdb:duckdb +11.1% +0.2% +10.9% +13.6% ➖ noise
39 duckdb:vortex-file-compressed +1.2% +0.2% +1.0% +12.3% ➖ noise
40 datafusion:vortex-file-compressed +1.2% -2.3% +3.6% +10.5% ➖ noise
40 duckdb:duckdb +8.1% -2.3% +10.7% +12.3% ➖ noise
40 duckdb:vortex-file-compressed +7.7% -2.3% +10.2% +14.6% ➖ noise
41 datafusion:vortex-file-compressed -1.3% -2.8% +1.6% +10.0% ➖ noise
41 duckdb:duckdb +8.0% -2.8% +11.2% +10.4% 🚨 regression
41 duckdb:vortex-file-compressed +2.9% -2.8% +5.9% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -2.0% -2.6% +0.6% +11.4% ➖ noise
42 duckdb:duckdb +8.7% -2.6% +11.6% +12.5% ➖ noise
42 duckdb:vortex-file-compressed -1.1% -2.6% +1.5% +13.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant