Skip to content

use curl backend and duckdbfs for benchmarks#6685

Open
myrrc wants to merge 2 commits intodevelopfrom
myrrc/duckdbfs-curl
Open

use curl backend and duckdbfs for benchmarks#6685
myrrc wants to merge 2 commits intodevelopfrom
myrrc/duckdbfs-curl

Conversation

@myrrc
Copy link
Contributor

@myrrc myrrc commented Feb 26, 2026

Another guess for a regression in #5767: try benchmarks with duckdb fs but with curl backend.

#5889

@myrrc myrrc added do not merge Pull requests that are not intended to merge action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Feb 26, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Feb 26, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Feb 26, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done caa4063 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Contributor

Benchmarks: PolarSignals Profiling

Summary

  • Overall: 1.018x ➖
  • Vortex: 1.018x ➖
  • datafusion:vortex: 1.018x ➖
  • Best: polarsignals_q08/datafusion:vortex-file-compressed (0.997x)
  • Worst: polarsignals_q04/datafusion:vortex-file-compressed (1.056x)
  • Significant (>10%): 0↑ 0↓
Detailed Results Table
name PR caa4063 base ee29169 ratio (PR/base) unit remark
polarsignals_q00/datafusion:vortex-file-compressed 124276587 1.21126e+08 1.02601 ns
polarsignals_q01/datafusion:vortex-file-compressed 353027175 3.53537e+08 0.998557 ns
polarsignals_q02/datafusion:vortex-file-compressed 26056213 2.55635e+07 1.01927 ns
polarsignals_q03/datafusion:vortex-file-compressed 356855349 3.55105e+08 1.00493 ns
polarsignals_q04/datafusion:vortex-file-compressed 12987001 1.22957e+07 1.05623 ns
polarsignals_q05/datafusion:vortex-file-compressed 17358788 1.69766e+07 1.02251 ns
polarsignals_q06/datafusion:vortex-file-compressed 23709043 2.32622e+07 1.01921 ns
polarsignals_q07/datafusion:vortex-file-compressed 15903419 1.5453e+07 1.02914 ns
polarsignals_q08/datafusion:vortex-file-compressed 436096604 4.37206e+08 0.997463 ns
polarsignals_q09/datafusion:vortex-file-compressed 15389454 1.53003e+07 1.00583 ns

@codspeed-hq
Copy link

codspeed-hq bot commented Feb 26, 2026

Merging this PR will improve performance by 13.17%

⚡ 1 improved benchmark
✅ 953 untouched benchmarks
⏩ 1466 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation bitwise_not_vortex_buffer_mut[128] 501.1 ns 442.8 ns +13.17%

Comparing myrrc/duckdbfs-curl (7389e0f) with develop (e3c2838)

Open in CodSpeed

Footnotes

  1. 1466 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions
Copy link
Contributor

Benchmarks: TPC-H SF=1 on NVME

Summary

  • Overall: 0.931x ➖
  • Vortex: 0.900x ✅
  • duckdb:vortex: 0.796x ✅
  • datafusion:vortex: 1.018x ➖
  • Best: tpch_q11/duckdb:vortex-file-compressed (0.690x)
  • Worst: tpch_q15/datafusion:vortex-file-compressed (1.234x)
  • Significant (>10%): 54↑ 16↓
Detailed Results Table
name PR caa4063 base ee29169 ratio (PR/base) unit remark
tpch_q01/datafusion:arrow 63109358 6.48047e+07 0.973839 ns
tpch_q02/datafusion:arrow 23240247 2.33797e+07 0.994037 ns
tpch_q03/datafusion:arrow 36836570 3.70799e+07 0.993438 ns
tpch_q04/datafusion:arrow 29956242 3.05413e+07 0.980844 ns
tpch_q05/datafusion:arrow 94917785 9.21308e+07 1.03025 ns
tpch_q06/datafusion:arrow 21712684 2.12988e+07 1.01943 ns
tpch_q07/datafusion:arrow 183145840 1.70513e+08 1.07408 ns
tpch_q08/datafusion:arrow 47515372 4.72028e+07 1.00662 ns
tpch_q09/datafusion:arrow 75400641 7.92949e+07 0.950889 ns
tpch_q10/datafusion:arrow 57339211 6.31882e+07 0.907436 ns
tpch_q11/datafusion:arrow 12371337 1.21568e+07 1.01765 ns
tpch_q12/datafusion:arrow 62762328 6.57399e+07 0.954707 ns
tpch_q13/datafusion:arrow 52193019 5.83288e+07 0.894806 ns 🚀
tpch_q14/datafusion:arrow 25589968 3.14672e+07 0.813227 ns 🚀
tpch_q15/datafusion:arrow 49644722 5.73916e+07 0.865018 ns 🚀
tpch_q16/datafusion:arrow 24013102 2.65857e+07 0.903234 ns
tpch_q17/datafusion:arrow 82254768 8.68538e+07 0.947048 ns
tpch_q18/datafusion:arrow 161707617 1.62208e+08 0.996916 ns
tpch_q19/datafusion:arrow 40461546 4.06959e+07 0.994241 ns
tpch_q20/datafusion:arrow 40523164 4.20671e+07 0.963298 ns
tpch_q21/datafusion:arrow 223250913 2.82312e+08 0.790795 ns 🚀
tpch_q22/datafusion:arrow 22172961 2.22164e+07 0.998044 ns
tpch_q01/datafusion:parquet 109909531 1.06414e+08 1.03284 ns
tpch_q02/datafusion:parquet 81777448 8.71056e+07 0.938831 ns
tpch_q03/datafusion:parquet 91468609 9.10361e+07 1.00475 ns
tpch_q04/datafusion:parquet 57871836 5.9077e+07 0.9796 ns
tpch_q05/datafusion:parquet 174683478 1.95233e+08 0.894744 ns 🚀
tpch_q06/datafusion:parquet 46820547 4.00365e+07 1.16945 ns 🚨
tpch_q07/datafusion:parquet 189523744 2.15564e+08 0.879198 ns 🚀
tpch_q08/datafusion:parquet 173126771 1.94412e+08 0.890515 ns 🚀
tpch_q09/datafusion:parquet 241219577 2.46555e+08 0.97836 ns
tpch_q10/datafusion:parquet 214595797 2.33573e+08 0.918754 ns
tpch_q11/datafusion:parquet 67755761 7.4303e+07 0.911885 ns
tpch_q12/datafusion:parquet 125381062 1.3509e+08 0.928133 ns
tpch_q13/datafusion:parquet 216554537 2.37342e+08 0.912417 ns
tpch_q14/datafusion:parquet 91188689 8.89524e+07 1.02514 ns
tpch_q15/datafusion:parquet 74018531 7.27354e+07 1.01764 ns
tpch_q16/datafusion:parquet 62128668 5.6761e+07 1.09457 ns
tpch_q17/datafusion:parquet 207568715 1.71959e+08 1.20708 ns 🚨
tpch_q18/datafusion:parquet 266618928 2.43515e+08 1.09487 ns
tpch_q19/datafusion:parquet 109024773 8.58966e+07 1.26926 ns 🚨
tpch_q20/datafusion:parquet 134608664 1.30912e+08 1.02824 ns
tpch_q21/datafusion:parquet 204107901 1.96548e+08 1.03846 ns
tpch_q22/datafusion:parquet 43853215 4.33681e+07 1.01119 ns
tpch_q01/datafusion:vortex-file-compressed 62752203 5.49853e+07 1.14125 ns 🚨
tpch_q02/datafusion:vortex-file-compressed 62234744 5.80383e+07 1.0723 ns
tpch_q03/datafusion:vortex-file-compressed 35111333 3.31484e+07 1.05922 ns
tpch_q04/datafusion:vortex-file-compressed 25261240 2.23766e+07 1.12891 ns 🚨
tpch_q05/datafusion:vortex-file-compressed 99867351 8.68389e+07 1.15003 ns 🚨
tpch_q06/datafusion:vortex-file-compressed 12833390 1.15079e+07 1.11518 ns 🚨
tpch_q07/datafusion:vortex-file-compressed 115718649 9.71923e+07 1.19062 ns 🚨
tpch_q08/datafusion:vortex-file-compressed 78650525 7.53035e+07 1.04445 ns
tpch_q09/datafusion:vortex-file-compressed 107109755 9.28427e+07 1.15367 ns 🚨
tpch_q10/datafusion:vortex-file-compressed 95482036 8.80732e+07 1.08412 ns
tpch_q11/datafusion:vortex-file-compressed 23611495 2.1952e+07 1.0756 ns
tpch_q12/datafusion:vortex-file-compressed 44264106 3.7971e+07 1.16573 ns 🚨
tpch_q13/datafusion:vortex-file-compressed 37068713 3.55993e+07 1.04128 ns
tpch_q14/datafusion:vortex-file-compressed 34834010 3.0144e+07 1.15559 ns 🚨
tpch_q15/datafusion:vortex-file-compressed 33832619 2.74123e+07 1.23421 ns 🚨
tpch_q16/datafusion:vortex-file-compressed 41456716 3.61944e+07 1.14539 ns 🚨
tpch_q17/datafusion:vortex-file-compressed 92572153 8.18218e+07 1.13139 ns 🚨
tpch_q18/datafusion:vortex-file-compressed 129263845 1.13313e+08 1.14076 ns 🚨
tpch_q19/datafusion:vortex-file-compressed 43322221 3.96074e+07 1.09379 ns
tpch_q20/datafusion:vortex-file-compressed 61258660 5.82396e+07 1.05184 ns
tpch_q21/datafusion:vortex-file-compressed 122947894 1.13305e+08 1.08511 ns
tpch_q22/datafusion:vortex-file-compressed 20711244 2.02281e+07 1.02388 ns
tpch_q01/datafusion:vortex-compact 70099519 6.44223e+07 1.08812 ns
tpch_q02/datafusion:vortex-compact 65224682 6.01418e+07 1.08451 ns
tpch_q03/datafusion:vortex-compact 40227253 3.55114e+07 1.1328 ns 🚨
tpch_q04/datafusion:vortex-compact 31027259 2.6057e+07 1.19075 ns 🚨
tpch_q05/datafusion:vortex-compact 106120451 9.07402e+07 1.1695 ns 🚨
tpch_q06/datafusion:vortex-compact 18035173 1.55018e+07 1.16343 ns 🚨
tpch_q07/datafusion:vortex-compact 116075273 1.08758e+08 1.06728 ns
tpch_q08/datafusion:vortex-compact 79992956 8.47935e+07 0.943385 ns
tpch_q09/datafusion:vortex-compact 96747075 1.05061e+08 0.920869 ns
tpch_q10/datafusion:vortex-compact 85279903 9.73976e+07 0.875585 ns 🚀
tpch_q11/datafusion:vortex-compact 22728890 2.7106e+07 0.838518 ns 🚀
tpch_q12/datafusion:vortex-compact 45707538 5.5662e+07 0.821163 ns 🚀
tpch_q13/datafusion:vortex-compact 39711031 4.66434e+07 0.851376 ns 🚀
tpch_q14/datafusion:vortex-compact 34687976 4.06641e+07 0.853037 ns 🚀
tpch_q15/datafusion:vortex-compact 34952066 4.35235e+07 0.803061 ns 🚀
tpch_q16/datafusion:vortex-compact 43045124 4.85645e+07 0.886349 ns 🚀
tpch_q17/datafusion:vortex-compact 80299700 1.01018e+08 0.794906 ns 🚀
tpch_q18/datafusion:vortex-compact 115390955 1.41217e+08 0.817118 ns 🚀
tpch_q19/datafusion:vortex-compact 51248094 5.87775e+07 0.8719 ns 🚀
tpch_q20/datafusion:vortex-compact 58564237 6.81051e+07 0.85991 ns 🚀
tpch_q21/datafusion:vortex-compact 117703634 1.45209e+08 0.810581 ns 🚀
tpch_q22/datafusion:vortex-compact 17092104 2.00789e+07 0.851245 ns 🚀
tpch_q01/duckdb:parquet 80036548 9.97874e+07 0.80207 ns 🚀
tpch_q02/duckdb:parquet 48115783 5.27322e+07 0.912455 ns
tpch_q03/duckdb:parquet 76983045 8.66607e+07 0.888327 ns 🚀
tpch_q04/duckdb:parquet 61830592 6.66982e+07 0.92702 ns
tpch_q05/duckdb:parquet 75939183 8.66223e+07 0.876671 ns 🚀
tpch_q06/duckdb:parquet 23239314 2.46406e+07 0.943131 ns
tpch_q07/duckdb:parquet 83051325 9.29518e+07 0.893488 ns 🚀
tpch_q08/duckdb:parquet 99134951 1.15022e+08 0.861881 ns 🚀
tpch_q09/duckdb:parquet 171100313 2.0043e+08 0.853667 ns 🚀
tpch_q10/duckdb:parquet 141968329 1.55948e+08 0.91036 ns
tpch_q11/duckdb:parquet 26048415 2.93858e+07 0.88643 ns 🚀
tpch_q12/duckdb:parquet 70786731 7.53256e+07 0.939743 ns
tpch_q13/duckdb:parquet 278774396 3.31674e+08 0.840507 ns 🚀
tpch_q14/duckdb:parquet 68355242 5.79207e+07 1.18015 ns 🚨
tpch_q15/duckdb:parquet 33260591 3.99058e+07 0.833477 ns 🚀
tpch_q16/duckdb:parquet 59388017 6.79089e+07 0.874524 ns 🚀
tpch_q17/duckdb:parquet 67637020 7.32778e+07 0.923021 ns
tpch_q18/duckdb:parquet 158915483 1.40155e+08 1.13386 ns 🚨
tpch_q19/duckdb:parquet 92653284 9.46407e+07 0.979 ns
tpch_q20/duckdb:parquet 71297804 9.29898e+07 0.766727 ns 🚀
tpch_q21/duckdb:parquet 195320088 2.10221e+08 0.929116 ns
tpch_q22/duckdb:parquet 56237768 6.17104e+07 0.911317 ns
tpch_q01/duckdb:vortex-file-compressed 33877380 4.04093e+07 0.838356 ns 🚀
tpch_q02/duckdb:vortex-file-compressed 31356516 3.73922e+07 0.838585 ns 🚀
tpch_q03/duckdb:vortex-file-compressed 33108450 4.19676e+07 0.788905 ns 🚀
tpch_q04/duckdb:vortex-file-compressed 36214952 4.66552e+07 0.776225 ns 🚀
tpch_q05/duckdb:vortex-file-compressed 38579118 4.80687e+07 0.802584 ns 🚀
tpch_q06/duckdb:vortex-file-compressed 10714423 1.50645e+07 0.711237 ns 🚀
tpch_q07/duckdb:vortex-file-compressed 39565076 5.27563e+07 0.749959 ns 🚀
tpch_q08/duckdb:vortex-file-compressed 45867043 6.02568e+07 0.761193 ns 🚀
tpch_q09/duckdb:vortex-file-compressed 79834326 1.02231e+08 0.780921 ns 🚀
tpch_q10/duckdb:vortex-file-compressed 35968550 4.9746e+07 0.723044 ns 🚀
tpch_q11/duckdb:vortex-file-compressed 16733320 2.4262e+07 0.689693 ns 🚀
tpch_q12/duckdb:vortex-file-compressed 22974572 3.23645e+07 0.709869 ns 🚀
tpch_q13/duckdb:vortex-file-compressed 37618019 5.21539e+07 0.721289 ns 🚀
tpch_q14/duckdb:vortex-file-compressed 24094484 3.15609e+07 0.763428 ns 🚀
tpch_q15/duckdb:vortex-file-compressed 18205023 2.26241e+07 0.804676 ns 🚀
tpch_q16/duckdb:vortex-file-compressed 34172977 3.96526e+07 0.861809 ns 🚀
tpch_q17/duckdb:vortex-file-compressed 25427158 3.25201e+07 0.781889 ns 🚀
tpch_q18/duckdb:vortex-file-compressed 54751949 6.92812e+07 0.790286 ns 🚀
tpch_q19/duckdb:vortex-file-compressed 30638167 4.3169e+07 0.709726 ns 🚀
tpch_q20/duckdb:vortex-file-compressed 37106852 4.84259e+07 0.76626 ns 🚀
tpch_q21/duckdb:vortex-file-compressed 104069257 1.38387e+08 0.752015 ns 🚀
tpch_q22/duckdb:vortex-file-compressed 21434970 2.65819e+07 0.806376 ns 🚀
tpch_q01/duckdb:vortex-compact 41164380 4.7733e+07 0.862387 ns 🚀
tpch_q02/duckdb:vortex-compact 47367121 5.02606e+07 0.94243 ns
tpch_q03/duckdb:vortex-compact 37653094 4.67637e+07 0.805178 ns 🚀
tpch_q04/duckdb:vortex-compact 42164171 5.3001e+07 0.795535 ns 🚀
tpch_q05/duckdb:vortex-compact 46404072 5.54148e+07 0.837394 ns 🚀
tpch_q06/duckdb:vortex-compact 15174959 1.77802e+07 0.853476 ns 🚀
tpch_q07/duckdb:vortex-compact 49792189 6.01918e+07 0.827225 ns 🚀
tpch_q08/duckdb:vortex-compact 57290226 7.16226e+07 0.79989 ns 🚀
tpch_q09/duckdb:vortex-compact 92239310 1.19157e+08 0.774102 ns 🚀
tpch_q10/duckdb:vortex-compact 44273833 5.46772e+07 0.809731 ns 🚀
tpch_q11/duckdb:vortex-compact 25604838 3.12812e+07 0.818537 ns 🚀
tpch_q12/duckdb:vortex-compact 36107956 4.59793e+07 0.785309 ns 🚀
tpch_q13/duckdb:vortex-compact 42669957 5.91926e+07 0.720866 ns 🚀
tpch_q14/duckdb:vortex-compact 31202549 3.81604e+07 0.817669 ns 🚀
tpch_q15/duckdb:vortex-compact 21316390 2.64134e+07 0.807029 ns 🚀
tpch_q16/duckdb:vortex-compact 41151907 4.51333e+07 0.911785 ns
tpch_q17/duckdb:vortex-compact 29985187 3.85141e+07 0.778551 ns 🚀
tpch_q18/duckdb:vortex-compact 59331404 7.01334e+07 0.84598 ns 🚀
tpch_q19/duckdb:vortex-compact 36724997 4.67498e+07 0.785565 ns 🚀
tpch_q20/duckdb:vortex-compact 45908801 5.56738e+07 0.824604 ns 🚀
tpch_q21/duckdb:vortex-compact 115326070 1.36008e+08 0.847934 ns 🚀
tpch_q22/duckdb:vortex-compact 22185708 2.44231e+07 0.908389 ns
tpch_q01/duckdb:duckdb 17673904 1.77196e+07 0.997422 ns
tpch_q02/duckdb:duckdb 14904162 1.46372e+07 1.01824 ns
tpch_q03/duckdb:duckdb 23044415 2.29397e+07 1.00456 ns
tpch_q04/duckdb:duckdb 20353052 2.0564e+07 0.989743 ns
tpch_q05/duckdb:duckdb 23170100 2.25572e+07 1.02717 ns
tpch_q06/duckdb:duckdb 7432412 7.42529e+06 1.00096 ns
tpch_q07/duckdb:duckdb 27208811 2.75809e+07 0.98651 ns
tpch_q08/duckdb:duckdb 27174483 2.77438e+07 0.97948 ns
tpch_q09/duckdb:duckdb 61659462 6.40337e+07 0.962922 ns
tpch_q10/duckdb:duckdb 62328476 5.88723e+07 1.05871 ns
tpch_q11/duckdb:duckdb 7016790 8.1216e+06 0.863966 ns 🚀
tpch_q12/duckdb:duckdb 17897827 1.96438e+07 0.911119 ns
tpch_q13/duckdb:duckdb 40971308 4.08689e+07 1.00251 ns
tpch_q14/duckdb:duckdb 23316862 2.31292e+07 1.00811 ns
tpch_q15/duckdb:duckdb 14452666 1.43924e+07 1.00419 ns
tpch_q16/duckdb:duckdb 25829906 2.57997e+07 1.00117 ns
tpch_q17/duckdb:duckdb 18483704 1.88011e+07 0.983118 ns
tpch_q18/duckdb:duckdb 40529911 4.11366e+07 0.985251 ns
tpch_q19/duckdb:duckdb 34839003 3.31816e+07 1.04995 ns
tpch_q20/duckdb:duckdb 27205781 2.76904e+07 0.9825 ns
tpch_q21/duckdb:duckdb 63743571 6.57042e+07 0.97016 ns
tpch_q22/duckdb:duckdb 26722254 2.69673e+07 0.990912 ns

@github-actions
Copy link
Contributor

Benchmarks: FineWeb NVMe

Summary

  • Overall: 0.933x ➖
  • Vortex: 0.909x ➖
  • duckdb:vortex: 0.873x ✅
  • datafusion:vortex: 0.947x ➖
  • Best: fineweb_q08/duckdb:vortex-file-compressed (0.368x)
  • Worst: fineweb_q02/duckdb:vortex-compact (1.115x)
  • Significant (>10%): 8↑ 1↓
Detailed Results Table
name PR caa4063 base ee29169 ratio (PR/base) unit remark
fineweb_q00/datafusion:parquet 6132720 6.31677e+06 0.970864 ns
fineweb_q01/datafusion:parquet 268904830 2.71469e+08 0.990554 ns
fineweb_q02/datafusion:parquet 270376821 2.72059e+08 0.993816 ns
fineweb_q03/datafusion:parquet 271675617 2.62604e+08 1.03455 ns
fineweb_q04/datafusion:parquet 284148975 2.7812e+08 1.02168 ns
fineweb_q05/datafusion:parquet 279810311 2.83364e+08 0.987458 ns
fineweb_q06/datafusion:parquet 272482952 2.8623e+08 0.951973 ns
fineweb_q07/datafusion:parquet 266569495 2.80502e+08 0.950329 ns
fineweb_q08/datafusion:parquet 261704727 2.76966e+08 0.944897 ns
fineweb_q00/datafusion:vortex-file-compressed 4363135 5.03167e+06 0.867135 ns 🚀
fineweb_q01/datafusion:vortex-file-compressed 34352034 3.37734e+07 1.01713 ns
fineweb_q02/datafusion:vortex-file-compressed 35471232 3.7866e+07 0.936758 ns
fineweb_q03/datafusion:vortex-file-compressed 85289321 9.41604e+07 0.905788 ns
fineweb_q04/datafusion:vortex-file-compressed 215039375 2.3182e+08 0.927613 ns
fineweb_q05/datafusion:vortex-file-compressed 191280022 2.0432e+08 0.936181 ns
fineweb_q06/datafusion:vortex-file-compressed 72308934 7.9539e+07 0.9091 ns
fineweb_q07/datafusion:vortex-file-compressed 76651665 7.51921e+07 1.01941 ns
fineweb_q08/datafusion:vortex-file-compressed 28914557 3.37346e+07 0.857118 ns 🚀
fineweb_q00/datafusion:vortex-compact 5200683 5.46585e+06 0.951487 ns
fineweb_q01/datafusion:vortex-compact 140991206 1.50033e+08 0.939736 ns
fineweb_q02/datafusion:vortex-compact 149589164 1.66525e+08 0.898299 ns 🚀
fineweb_q03/datafusion:vortex-compact 1237562401 1.27469e+09 0.970876 ns
fineweb_q04/datafusion:vortex-compact 1457813887 1.46546e+09 0.994781 ns
fineweb_q05/datafusion:vortex-compact 1120769578 1.12998e+09 0.991848 ns
fineweb_q06/datafusion:vortex-compact 590256053 5.9522e+08 0.991661 ns
fineweb_q07/datafusion:vortex-compact 626391792 6.26292e+08 1.00016 ns
fineweb_q08/datafusion:vortex-compact 26265159 2.76711e+07 0.949193 ns
fineweb_q00/duckdb:parquet 33577081 3.36752e+07 0.997087 ns
fineweb_q01/duckdb:parquet 98875264 1.02636e+08 0.963358 ns
fineweb_q02/duckdb:parquet 106436110 1.09134e+08 0.975275 ns
fineweb_q03/duckdb:parquet 313528022 3.18605e+08 0.984065 ns
fineweb_q04/duckdb:parquet 437584743 4.41767e+08 0.990533 ns
fineweb_q05/duckdb:parquet 409894580 4.12644e+08 0.993337 ns
fineweb_q06/duckdb:parquet 207529391 2.06295e+08 1.00599 ns
fineweb_q07/duckdb:parquet 215996072 2.18434e+08 0.988839 ns
fineweb_q08/duckdb:parquet 62633211 6.52613e+07 0.95973 ns
fineweb_q00/duckdb:vortex-file-compressed 3949985 4.25889e+06 0.927468 ns
fineweb_q01/duckdb:vortex-file-compressed 25756776 3.1187e+07 0.825883 ns 🚀
fineweb_q02/duckdb:vortex-file-compressed 30627779 3.11005e+07 0.9848 ns
fineweb_q03/duckdb:vortex-file-compressed 126334624 1.36968e+08 0.922363 ns
fineweb_q04/duckdb:vortex-file-compressed 190157880 2.11572e+08 0.898786 ns 🚀
fineweb_q05/duckdb:vortex-file-compressed 188746453 1.93122e+08 0.977344 ns
fineweb_q06/duckdb:vortex-file-compressed 61756354 7.00064e+07 0.882153 ns 🚀
fineweb_q07/duckdb:vortex-file-compressed 70004525 7.03291e+07 0.995385 ns
fineweb_q08/duckdb:vortex-file-compressed 9759268 2.64892e+07 0.368424 ns 🚀
fineweb_q00/duckdb:vortex-compact 5323683 4.91788e+06 1.08251 ns
fineweb_q01/duckdb:vortex-compact 89268210 9.60837e+07 0.929068 ns
fineweb_q02/duckdb:vortex-compact 108055212 9.6942e+07 1.11464 ns 🚨
fineweb_q03/duckdb:vortex-compact 812848595 8.36682e+08 0.971514 ns
fineweb_q04/duckdb:vortex-compact 876695902 8.90322e+08 0.984695 ns
fineweb_q05/duckdb:vortex-compact 776932524 7.98563e+08 0.972914 ns
fineweb_q06/duckdb:vortex-compact 448800907 4.67879e+08 0.959224 ns
fineweb_q07/duckdb:vortex-compact 461901809 4.68548e+08 0.985815 ns
fineweb_q08/duckdb:vortex-compact 10742124 2.39379e+07 0.44875 ns 🚀

@github-actions
Copy link
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=1 on S3 failed! Check the workflow run for details.

@github-actions
Copy link
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Summary

  • Overall: 0.980x ➖
  • Vortex: 0.969x ➖
  • duckdb:vortex: 0.945x ➖
  • datafusion:vortex: 0.994x ➖
  • Best: tpcds_q51/duckdb:vortex-compact (0.701x)
  • Worst: tpcds_q90/duckdb:vortex-file-compressed (1.147x)
  • Significant (>10%): 23↑ 3↓
Detailed Results Table
name PR caa4063 base ee29169 ratio (PR/base) unit remark
tpcds_q01/datafusion:parquet 37988046 3.89655e+07 0.974915 ns
tpcds_q02/datafusion:parquet 52353934 5.50581e+07 0.950886 ns
tpcds_q03/datafusion:parquet 17740248 1.66795e+07 1.06359 ns
tpcds_q04/datafusion:parquet 361366579 3.61635e+08 0.999258 ns
tpcds_q05/datafusion:parquet 97757209 9.09033e+07 1.0754 ns
tpcds_q06/datafusion:parquet 101126192 1.01088e+08 1.00037 ns
tpcds_q07/datafusion:parquet 142421033 1.38433e+08 1.02881 ns
tpcds_q08/datafusion:parquet 40536942 3.87479e+07 1.04617 ns
tpcds_q09/datafusion:parquet 52700931 5.18471e+07 1.01647 ns
tpcds_q10/datafusion:parquet 104794468 1.0246e+08 1.02279 ns
tpcds_q11/datafusion:parquet 220607167 2.32351e+08 0.949458 ns
tpcds_q12/datafusion:parquet 28887217 3.29851e+07 0.875766 ns 🚀
tpcds_q13/datafusion:parquet 144365818 1.46906e+08 0.982707 ns
tpcds_q14/datafusion:parquet 214186776 2.14431e+08 0.99886 ns
tpcds_q15/datafusion:parquet 58312336 6.09375e+07 0.95692 ns
tpcds_q16/datafusion:parquet 32442092 3.28386e+07 0.987927 ns
tpcds_q17/datafusion:parquet 186762306 1.86936e+08 0.999072 ns
tpcds_q18/datafusion:parquet 177655331 1.87049e+08 0.949777 ns
tpcds_q19/datafusion:parquet 35099814 3.64002e+07 0.964276 ns
tpcds_q20/datafusion:parquet 24534101 2.41753e+07 1.01484 ns
tpcds_q21/datafusion:parquet 27880366 2.71405e+07 1.02726 ns
tpcds_q22/datafusion:parquet 152162379 1.46417e+08 1.03924 ns
tpcds_q23/datafusion:parquet 181209175 1.82976e+08 0.990343 ns
tpcds_q24/datafusion:parquet 227935621 2.27797e+08 1.00061 ns
tpcds_q25/datafusion:parquet 197927522 1.96065e+08 1.0095 ns
tpcds_q26/datafusion:parquet 120905992 1.18465e+08 1.02061 ns
tpcds_q27/datafusion:parquet 271364556 2.78007e+08 0.976106 ns
tpcds_q28/datafusion:parquet 51672212 5.24558e+07 0.985062 ns
tpcds_q29/datafusion:parquet 190164925 1.93682e+08 0.981839 ns
tpcds_q30/datafusion:parquet 44592389 4.45173e+07 1.00169 ns
tpcds_q31/datafusion:parquet 102987624 1.05162e+08 0.97932 ns
tpcds_q32/datafusion:parquet 30335717 2.97206e+07 1.0207 ns
tpcds_q33/datafusion:parquet 37389611 3.70758e+07 1.00846 ns
tpcds_q34/datafusion:parquet 35156869 3.63705e+07 0.966633 ns
tpcds_q35/datafusion:parquet 97898868 9.98372e+07 0.980585 ns
tpcds_q36/datafusion:parquet 83981296 8.6335e+07 0.972738 ns
tpcds_q37/datafusion:parquet 27481969 2.60326e+07 1.05568 ns
tpcds_q38/datafusion:parquet 64678424 6.43281e+07 1.00545 ns
tpcds_q39/datafusion:parquet 91282342 9.2402e+07 0.987882 ns
tpcds_q40/datafusion:parquet 36360995 3.62196e+07 1.0039 ns
tpcds_q41/datafusion:parquet 12519880 1.29279e+07 0.96844 ns
tpcds_q42/datafusion:parquet 15757580 1.51186e+07 1.04226 ns
tpcds_q43/datafusion:parquet 26012990 2.71366e+07 0.958596 ns
tpcds_q44/datafusion:parquet 38782759 4.03251e+07 0.961752 ns
tpcds_q45/datafusion:parquet 75949069 7.86597e+07 0.96554 ns
tpcds_q46/datafusion:parquet 51489959 5.41977e+07 0.95004 ns
tpcds_q47/datafusion:parquet 185476880 1.79372e+08 1.03403 ns
tpcds_q48/datafusion:parquet 135111205 1.35936e+08 0.993936 ns
tpcds_q49/datafusion:parquet 72765635 7.24736e+07 1.00403 ns
tpcds_q50/datafusion:parquet 120248168 1.20913e+08 0.994506 ns
tpcds_q51/datafusion:parquet 95019287 9.62017e+07 0.987709 ns
tpcds_q52/datafusion:parquet 15693230 1.56189e+07 1.00476 ns
tpcds_q53/datafusion:parquet 31548675 3.09351e+07 1.01983 ns
tpcds_q54/datafusion:parquet 47894755 4.85774e+07 0.985947 ns
tpcds_q55/datafusion:parquet 15613679 1.53218e+07 1.01905 ns
tpcds_q56/datafusion:parquet 36082217 3.68132e+07 0.980145 ns
tpcds_q57/datafusion:parquet 128705727 1.34742e+08 0.955201 ns
tpcds_q58/datafusion:parquet 73222450 7.44929e+07 0.982945 ns
tpcds_q59/datafusion:parquet 69176314 6.93554e+07 0.997418 ns
tpcds_q60/datafusion:parquet 36413415 3.62344e+07 1.00494 ns
tpcds_q61/datafusion:parquet 66111149 6.78887e+07 0.973817 ns
tpcds_q62/datafusion:parquet 46564497 4.66552e+07 0.998056 ns
tpcds_q63/datafusion:parquet 31072128 3.24228e+07 0.958341 ns
tpcds_q64/datafusion:parquet 1042869193 1.04172e+09 1.0011 ns
tpcds_q65/datafusion:parquet 50817063 5.08565e+07 0.999224 ns
tpcds_q66/datafusion:parquet 88872953 8.70411e+07 1.02105 ns
tpcds_q67/datafusion:parquet 176968687 1.70241e+08 1.03952 ns
tpcds_q68/datafusion:parquet 51053129 5.02751e+07 1.01547 ns
tpcds_q69/datafusion:parquet 97260071 9.6646e+07 1.00635 ns
tpcds_q70/datafusion:parquet 107852526 1.0801e+08 0.998546 ns
tpcds_q71/datafusion:parquet 28966462 2.9723e+07 0.974546 ns
tpcds_q72/datafusion:parquet 863203443 8.6188e+08 1.00154 ns
tpcds_q73/datafusion:parquet 36393957 3.65961e+07 0.994475 ns
tpcds_q74/datafusion:parquet 128819370 1.35872e+08 0.948092 ns
tpcds_q75/datafusion:parquet 138043717 1.36679e+08 1.00999 ns
tpcds_q76/datafusion:parquet 102131841 9.90029e+07 1.0316 ns
tpcds_q77/datafusion:parquet 59464815 5.98872e+07 0.992946 ns
tpcds_q78/datafusion:parquet 176127142 1.77452e+08 0.992536 ns
tpcds_q79/datafusion:parquet 41324984 4.34957e+07 0.950093 ns
tpcds_q80/datafusion:parquet 114949869 1.14352e+08 1.00523 ns
tpcds_q81/datafusion:parquet 42532129 4.42388e+07 0.961421 ns
tpcds_q82/datafusion:parquet 28764017 3.04399e+07 0.944943 ns
tpcds_q83/datafusion:parquet 55352684 5.49019e+07 1.00821 ns
tpcds_q84/datafusion:parquet 47629084 4.93361e+07 0.9654 ns
tpcds_q85/datafusion:parquet 245659924 2.49612e+08 0.984168 ns
tpcds_q86/datafusion:parquet 20699057 2.16918e+07 0.954232 ns
tpcds_q87/datafusion:parquet 63831842 6.65879e+07 0.958611 ns
tpcds_q88/datafusion:parquet 78417044 7.90326e+07 0.992212 ns
tpcds_q89/datafusion:parquet 38911456 3.69537e+07 1.05298 ns
tpcds_q90/datafusion:parquet 19171135 1.92796e+07 0.994376 ns
tpcds_q91/datafusion:parquet 77966844 8.03867e+07 0.969897 ns
tpcds_q92/datafusion:parquet 25034874 2.52795e+07 0.990323 ns
tpcds_q93/datafusion:parquet 37364303 3.80072e+07 0.983084 ns
tpcds_q94/datafusion:parquet 28307898 2.92488e+07 0.967832 ns
tpcds_q95/datafusion:parquet 135994711 1.44102e+08 0.943736 ns
tpcds_q96/datafusion:parquet 14387537 1.46586e+07 0.981505 ns
tpcds_q97/datafusion:parquet 35264435 3.70203e+07 0.952569 ns
tpcds_q98/datafusion:parquet 36986581 3.67978e+07 1.00513 ns
tpcds_q99/datafusion:parquet 48211310 4.5655e+07 1.05599 ns
tpcds_q01/datafusion:vortex-file-compressed 33747458 3.02567e+07 1.11537 ns 🚨
tpcds_q02/datafusion:vortex-file-compressed 78820391 7.9164e+07 0.995659 ns
tpcds_q03/datafusion:vortex-file-compressed 29636346 2.96505e+07 0.999522 ns
tpcds_q04/datafusion:vortex-file-compressed 397343775 3.99879e+08 0.993661 ns
tpcds_q05/datafusion:vortex-file-compressed 75557361 7.57804e+07 0.997057 ns
tpcds_q06/datafusion:vortex-file-compressed 76585059 8.10726e+07 0.944647 ns
tpcds_q07/datafusion:vortex-file-compressed 83427015 8.63788e+07 0.965827 ns
tpcds_q08/datafusion:vortex-file-compressed 41825175 4.17189e+07 1.00255 ns
tpcds_q09/datafusion:vortex-file-compressed 48887982 5.02001e+07 0.973863 ns
tpcds_q10/datafusion:vortex-file-compressed 51199013 5.30085e+07 0.965864 ns
tpcds_q11/datafusion:vortex-file-compressed 236147996 2.38772e+08 0.98901 ns
tpcds_q12/datafusion:vortex-file-compressed 39282012 3.84312e+07 1.02214 ns
tpcds_q13/datafusion:vortex-file-compressed 79741300 8.24104e+07 0.967612 ns
tpcds_q14/datafusion:vortex-file-compressed 217492409 2.14967e+08 1.01175 ns
tpcds_q15/datafusion:vortex-file-compressed 50824168 5.04237e+07 1.00794 ns
tpcds_q16/datafusion:vortex-file-compressed 31239836 3.11722e+07 1.00217 ns
tpcds_q17/datafusion:vortex-file-compressed 120693628 1.21194e+08 0.995873 ns
tpcds_q18/datafusion:vortex-file-compressed 108171169 1.03145e+08 1.04873 ns
tpcds_q19/datafusion:vortex-file-compressed 49896071 5.04292e+07 0.989428 ns
tpcds_q20/datafusion:vortex-file-compressed 44190906 4.47953e+07 0.986507 ns
tpcds_q21/datafusion:vortex-file-compressed 177617357 1.79828e+08 0.987708 ns
tpcds_q22/datafusion:vortex-file-compressed 74193320 7.33051e+07 1.01212 ns
tpcds_q23/datafusion:vortex-file-compressed 193183002 1.93045e+08 1.00071 ns
tpcds_q24/datafusion:vortex-file-compressed 191411934 1.9507e+08 0.981249 ns
tpcds_q25/datafusion:vortex-file-compressed 118121049 1.21557e+08 0.971737 ns
tpcds_q26/datafusion:vortex-file-compressed 64642705 7.03156e+07 0.919323 ns
tpcds_q27/datafusion:vortex-file-compressed 171018397 1.6823e+08 1.01657 ns
tpcds_q28/datafusion:vortex-file-compressed 52758942 5.20343e+07 1.01393 ns
tpcds_q29/datafusion:vortex-file-compressed 120557062 1.21123e+08 0.995329 ns
tpcds_q30/datafusion:vortex-file-compressed 29135021 3.05559e+07 0.953499 ns
tpcds_q31/datafusion:vortex-file-compressed 185935383 1.86344e+08 0.997806 ns
tpcds_q32/datafusion:vortex-file-compressed 25565899 2.56702e+07 0.995935 ns
tpcds_q33/datafusion:vortex-file-compressed 38164972 3.79667e+07 1.00522 ns
tpcds_q34/datafusion:vortex-file-compressed 35500586 3.75776e+07 0.944728 ns
tpcds_q35/datafusion:vortex-file-compressed 65061919 6.33688e+07 1.02672 ns
tpcds_q36/datafusion:vortex-file-compressed 109467971 1.09115e+08 1.00323 ns
tpcds_q37/datafusion:vortex-file-compressed 39129976 4.07453e+07 0.960357 ns
tpcds_q38/datafusion:vortex-file-compressed 92653027 9.23032e+07 1.00379 ns
tpcds_q39/datafusion:vortex-file-compressed 217694469 2.07031e+08 1.05151 ns
tpcds_q40/datafusion:vortex-file-compressed 55124164 5.67291e+07 0.971708 ns
tpcds_q41/datafusion:vortex-file-compressed 14190892 1.48252e+07 0.957215 ns
tpcds_q42/datafusion:vortex-file-compressed 31298586 3.17467e+07 0.985886 ns
tpcds_q43/datafusion:vortex-file-compressed 49209520 4.95197e+07 0.993736 ns
tpcds_q44/datafusion:vortex-file-compressed 42920205 4.44157e+07 0.96633 ns
tpcds_q45/datafusion:vortex-file-compressed 50730378 5.07143e+07 1.00032 ns
tpcds_q46/datafusion:vortex-file-compressed 66835042 6.75207e+07 0.989845 ns
tpcds_q47/datafusion:vortex-file-compressed 243963793 2.4985e+08 0.976441 ns
tpcds_q48/datafusion:vortex-file-compressed 70582648 7.2596e+07 0.972267 ns
tpcds_q49/datafusion:vortex-file-compressed 70922166 7.25861e+07 0.977076 ns
tpcds_q50/datafusion:vortex-file-compressed 78813173 7.89789e+07 0.997902 ns
tpcds_q51/datafusion:vortex-file-compressed 98139509 9.24223e+07 1.06186 ns
tpcds_q52/datafusion:vortex-file-compressed 32845568 3.3352e+07 0.984816 ns
tpcds_q53/datafusion:vortex-file-compressed 30108829 3.09043e+07 0.974259 ns
tpcds_q54/datafusion:vortex-file-compressed 48507950 5.00983e+07 0.968255 ns
tpcds_q55/datafusion:vortex-file-compressed 33272993 3.17416e+07 1.04825 ns
tpcds_q56/datafusion:vortex-file-compressed 47928874 4.85899e+07 0.986395 ns
tpcds_q57/datafusion:vortex-file-compressed 189051252 1.88929e+08 1.00065 ns
tpcds_q58/datafusion:vortex-file-compressed 117397692 1.15302e+08 1.01818 ns
tpcds_q59/datafusion:vortex-file-compressed 95866466 9.6467e+07 0.993774 ns
tpcds_q60/datafusion:vortex-file-compressed 47378696 4.82163e+07 0.982629 ns
tpcds_q61/datafusion:vortex-file-compressed 56264646 5.76452e+07 0.976051 ns
tpcds_q62/datafusion:vortex-file-compressed 48258391 4.73987e+07 1.01814 ns
tpcds_q63/datafusion:vortex-file-compressed 29825285 2.97791e+07 1.00155 ns
tpcds_q64/datafusion:vortex-file-compressed 734543351 7.38087e+08 0.9952 ns
tpcds_q65/datafusion:vortex-file-compressed 52944612 5.3759e+07 0.984851 ns
tpcds_q66/datafusion:vortex-file-compressed 103414492 1.06392e+08 0.972018 ns
tpcds_q67/datafusion:vortex-file-compressed 141932123 1.39942e+08 1.01422 ns
tpcds_q68/datafusion:vortex-file-compressed 65778481 6.87202e+07 0.957192 ns
tpcds_q69/datafusion:vortex-file-compressed 47660039 4.8792e+07 0.976801 ns
tpcds_q70/datafusion:vortex-file-compressed 124130921 1.23152e+08 1.00795 ns
tpcds_q71/datafusion:vortex-file-compressed 30525738 3.17146e+07 0.962512 ns
tpcds_q72/datafusion:vortex-file-compressed 3283215184 3.26547e+09 1.00543 ns
tpcds_q73/datafusion:vortex-file-compressed 37636626 3.81354e+07 0.986922 ns
tpcds_q74/datafusion:vortex-file-compressed 171623012 1.73822e+08 0.98735 ns
tpcds_q75/datafusion:vortex-file-compressed 136826618 1.4029e+08 0.975311 ns
tpcds_q76/datafusion:vortex-file-compressed 63686937 6.87527e+07 0.926319 ns
tpcds_q77/datafusion:vortex-file-compressed 55995972 5.60313e+07 0.99937 ns
tpcds_q78/datafusion:vortex-file-compressed 179232114 1.81222e+08 0.98902 ns
tpcds_q79/datafusion:vortex-file-compressed 45465524 4.55972e+07 0.997112 ns
tpcds_q80/datafusion:vortex-file-compressed 119868157 1.16087e+08 1.03257 ns
tpcds_q81/datafusion:vortex-file-compressed 37312190 3.77062e+07 0.989552 ns
tpcds_q82/datafusion:vortex-file-compressed 43597590 4.21663e+07 1.03394 ns
tpcds_q83/datafusion:vortex-file-compressed 69183751 6.94044e+07 0.99682 ns
tpcds_q84/datafusion:vortex-file-compressed 16190724 1.69299e+07 0.956339 ns
tpcds_q85/datafusion:vortex-file-compressed 138172508 1.41149e+08 0.97891 ns
tpcds_q86/datafusion:vortex-file-compressed 31144047 3.37066e+07 0.923975 ns
tpcds_q87/datafusion:vortex-file-compressed 95173485 9.4506e+07 1.00706 ns
tpcds_q88/datafusion:vortex-file-compressed 78182091 7.84552e+07 0.996519 ns
tpcds_q89/datafusion:vortex-file-compressed 61513850 5.93371e+07 1.03668 ns
tpcds_q90/datafusion:vortex-file-compressed 17038152 1.74658e+07 0.975517 ns
tpcds_q91/datafusion:vortex-file-compressed 27670204 2.74361e+07 1.00853 ns
tpcds_q92/datafusion:vortex-file-compressed 21996691 2.24129e+07 0.981429 ns
tpcds_q93/datafusion:vortex-file-compressed 41009580 4.08835e+07 1.00308 ns
tpcds_q94/datafusion:vortex-file-compressed 28668710 3.01905e+07 0.949594 ns
tpcds_q95/datafusion:vortex-file-compressed 94863253 9.50388e+07 0.998153 ns
tpcds_q96/datafusion:vortex-file-compressed 15594205 1.54971e+07 1.00627 ns
tpcds_q97/datafusion:vortex-file-compressed 32829097 3.50822e+07 0.935777 ns
tpcds_q98/datafusion:vortex-file-compressed 51583820 5.1436e+07 1.00287 ns
tpcds_q99/datafusion:vortex-file-compressed 65501256 6.32959e+07 1.03484 ns
tpcds_q01/datafusion:vortex-compact 35140483 3.3845e+07 1.03828 ns
tpcds_q02/datafusion:vortex-compact 85481117 8.38508e+07 1.01944 ns
tpcds_q03/datafusion:vortex-compact 32805072 3.46301e+07 0.9473 ns
tpcds_q04/datafusion:vortex-compact 437091948 4.36266e+08 1.00189 ns
tpcds_q05/datafusion:vortex-compact 86822777 8.51361e+07 1.01981 ns
tpcds_q06/datafusion:vortex-compact 84763815 8.62755e+07 0.982479 ns
tpcds_q07/datafusion:vortex-compact 98151400 9.89189e+07 0.992241 ns
tpcds_q08/datafusion:vortex-compact 50119521 5.10517e+07 0.98174 ns
tpcds_q09/datafusion:vortex-compact 99708348 1.00964e+08 0.987563 ns
tpcds_q10/datafusion:vortex-compact 68703331 6.99779e+07 0.981786 ns
tpcds_q11/datafusion:vortex-compact 261937968 2.53826e+08 1.03196 ns
tpcds_q12/datafusion:vortex-compact 41566433 4.2456e+07 0.979048 ns
tpcds_q13/datafusion:vortex-compact 142228655 1.39156e+08 1.02208 ns
tpcds_q14/datafusion:vortex-compact 268024913 2.73072e+08 0.981516 ns
tpcds_q15/datafusion:vortex-compact 58370668 5.48349e+07 1.06448 ns
tpcds_q16/datafusion:vortex-compact 42296169 4.26632e+07 0.991398 ns
tpcds_q17/datafusion:vortex-compact 137417779 1.36586e+08 1.00609 ns
tpcds_q18/datafusion:vortex-compact 119780850 1.2146e+08 0.986176 ns
tpcds_q19/datafusion:vortex-compact 64296184 6.28158e+07 1.02357 ns
tpcds_q20/datafusion:vortex-compact 47747533 4.98698e+07 0.957444 ns
tpcds_q21/datafusion:vortex-compact 187607084 1.80004e+08 1.04224 ns
tpcds_q22/datafusion:vortex-compact 78506732 7.99457e+07 0.982001 ns
tpcds_q23/datafusion:vortex-compact 229668388 2.33895e+08 0.981928 ns
tpcds_q24/datafusion:vortex-compact 223309462 2.2006e+08 1.01477 ns
tpcds_q25/datafusion:vortex-compact 130891312 1.30719e+08 1.00132 ns
tpcds_q26/datafusion:vortex-compact 74412860 7.8435e+07 0.94872 ns
tpcds_q27/datafusion:vortex-compact 208965438 2.0699e+08 1.00954 ns
tpcds_q28/datafusion:vortex-compact 104173692 1.05128e+08 0.990925 ns
tpcds_q29/datafusion:vortex-compact 133503260 1.32608e+08 1.00675 ns
tpcds_q30/datafusion:vortex-compact 36252035 3.53451e+07 1.02566 ns
tpcds_q31/datafusion:vortex-compact 223586228 2.21557e+08 1.00916 ns
tpcds_q32/datafusion:vortex-compact 30735863 3.09173e+07 0.994133 ns
tpcds_q33/datafusion:vortex-compact 53055316 5.35401e+07 0.990946 ns
tpcds_q34/datafusion:vortex-compact 57627490 5.69382e+07 1.01211 ns
tpcds_q35/datafusion:vortex-compact 77567038 7.85709e+07 0.987224 ns
tpcds_q36/datafusion:vortex-compact 133192213 1.30438e+08 1.02111 ns
tpcds_q37/datafusion:vortex-compact 52078852 5.26892e+07 0.988416 ns
tpcds_q38/datafusion:vortex-compact 106539188 1.07672e+08 0.989483 ns
tpcds_q39/datafusion:vortex-compact 194945586 1.98907e+08 0.980084 ns
tpcds_q40/datafusion:vortex-compact 61433047 6.32005e+07 0.972034 ns
tpcds_q41/datafusion:vortex-compact 16147482 1.64297e+07 0.982821 ns
tpcds_q42/datafusion:vortex-compact 38156641 4.08465e+07 0.934147 ns
tpcds_q43/datafusion:vortex-compact 54875726 5.45176e+07 1.00657 ns
tpcds_q44/datafusion:vortex-compact 72052455 7.31021e+07 0.985641 ns
tpcds_q45/datafusion:vortex-compact 55438047 5.39535e+07 1.02751 ns
tpcds_q46/datafusion:vortex-compact 94024797 9.3892e+07 1.00141 ns
tpcds_q47/datafusion:vortex-compact 277729308 2.67556e+08 1.03802 ns
tpcds_q48/datafusion:vortex-compact 114545117 1.16083e+08 0.986755 ns
tpcds_q49/datafusion:vortex-compact 100005594 9.93114e+07 1.00699 ns
tpcds_q50/datafusion:vortex-compact 97498347 9.68998e+07 1.00618 ns
tpcds_q51/datafusion:vortex-compact 99629394 1.00552e+08 0.990829 ns
tpcds_q52/datafusion:vortex-compact 37739415 4.0761e+07 0.925871 ns
tpcds_q53/datafusion:vortex-compact 39514101 4.04314e+07 0.977312 ns
tpcds_q54/datafusion:vortex-compact 66253965 6.46324e+07 1.02509 ns
tpcds_q55/datafusion:vortex-compact 38760799 3.65669e+07 1.06 ns
tpcds_q56/datafusion:vortex-compact 60873236 5.92815e+07 1.02685 ns
tpcds_q57/datafusion:vortex-compact 203460396 2.06241e+08 0.986518 ns
tpcds_q58/datafusion:vortex-compact 124065938 1.26592e+08 0.980049 ns
tpcds_q59/datafusion:vortex-compact 110890084 1.11938e+08 0.990642 ns
tpcds_q60/datafusion:vortex-compact 60011431 5.95425e+07 1.00788 ns
tpcds_q61/datafusion:vortex-compact 83434674 8.4851e+07 0.983308 ns
tpcds_q62/datafusion:vortex-compact 47667943 4.85608e+07 0.981613 ns
tpcds_q63/datafusion:vortex-compact 39180409 3.95365e+07 0.990992 ns
tpcds_q64/datafusion:vortex-compact 822380749 8.15723e+08 1.00816 ns
tpcds_q65/datafusion:vortex-compact 71833640 7.35842e+07 0.976211 ns
tpcds_q66/datafusion:vortex-compact 114579544 1.13818e+08 1.00669 ns
tpcds_q67/datafusion:vortex-compact 150428167 1.50243e+08 1.00123 ns
tpcds_q68/datafusion:vortex-compact 93744842 9.43785e+07 0.993286 ns
tpcds_q69/datafusion:vortex-compact 66973761 6.50132e+07 1.03016 ns
tpcds_q70/datafusion:vortex-compact 139414563 1.40138e+08 0.994837 ns
tpcds_q71/datafusion:vortex-compact 44822135 4.63367e+07 0.967313 ns
tpcds_q72/datafusion:vortex-compact 3319857255 3.30213e+09 1.00537 ns
tpcds_q73/datafusion:vortex-compact 58935059 5.72548e+07 1.02935 ns
tpcds_q74/datafusion:vortex-compact 189361726 1.89221e+08 1.00074 ns
tpcds_q75/datafusion:vortex-compact 180764741 1.81606e+08 0.995366 ns
tpcds_q76/datafusion:vortex-compact 82770885 8.39178e+07 0.986333 ns
tpcds_q77/datafusion:vortex-compact 69704643 6.80053e+07 1.02499 ns
tpcds_q78/datafusion:vortex-compact 207547006 2.02909e+08 1.02286 ns
tpcds_q79/datafusion:vortex-compact 72581133 7.08422e+07 1.02455 ns
tpcds_q80/datafusion:vortex-compact 136560504 1.38129e+08 0.988645 ns
tpcds_q81/datafusion:vortex-compact 41669444 4.174e+07 0.998309 ns
tpcds_q82/datafusion:vortex-compact 53464946 5.14194e+07 1.03978 ns
tpcds_q83/datafusion:vortex-compact 65912768 6.79314e+07 0.970284 ns
tpcds_q84/datafusion:vortex-compact 18802670 1.95961e+07 0.959512 ns
tpcds_q85/datafusion:vortex-compact 163459368 1.64287e+08 0.994962 ns
tpcds_q86/datafusion:vortex-compact 32985642 3.44692e+07 0.956961 ns
tpcds_q87/datafusion:vortex-compact 106139208 1.10084e+08 0.964162 ns
tpcds_q88/datafusion:vortex-compact 132026103 1.34249e+08 0.983443 ns
tpcds_q89/datafusion:vortex-compact 66524385 6.59114e+07 1.0093 ns
tpcds_q90/datafusion:vortex-compact 22883179 2.3392e+07 0.978248 ns
tpcds_q91/datafusion:vortex-compact 40518040 4.17865e+07 0.969644 ns
tpcds_q92/datafusion:vortex-compact 24133829 2.44931e+07 0.985334 ns
tpcds_q93/datafusion:vortex-compact 53574215 5.41911e+07 0.988616 ns
tpcds_q94/datafusion:vortex-compact 34186574 3.42429e+07 0.998354 ns
tpcds_q95/datafusion:vortex-compact 101471818 1.04755e+08 0.968662 ns
tpcds_q96/datafusion:vortex-compact 25931437 2.52283e+07 1.02787 ns
tpcds_q97/datafusion:vortex-compact 44950994 4.61992e+07 0.972981 ns
tpcds_q98/datafusion:vortex-compact 57034891 5.68143e+07 1.00388 ns
tpcds_q99/datafusion:vortex-compact 66932162 6.89038e+07 0.971386 ns
tpcds_q01/duckdb:parquet 47825207 4.8793e+07 0.980166 ns
tpcds_q02/duckdb:parquet 28481153 2.90457e+07 0.980563 ns
tpcds_q03/duckdb:parquet 13767027 1.40448e+07 0.980226 ns
tpcds_q04/duckdb:parquet 130910953 1.30667e+08 1.00186 ns
tpcds_q05/duckdb:parquet 30407521 3.05186e+07 0.996361 ns
tpcds_q06/duckdb:parquet 33586819 3.38209e+07 0.993079 ns
tpcds_q07/duckdb:parquet 28054476 2.81775e+07 0.995635 ns
tpcds_q08/duckdb:parquet 28388791 2.86994e+07 0.989177 ns
tpcds_q09/duckdb:parquet 41297700 4.1683e+07 0.990757 ns
tpcds_q10/duckdb:parquet 40651959 3.99519e+07 1.01752 ns
tpcds_q11/duckdb:parquet 86142921 8.94907e+07 0.962591 ns
tpcds_q12/duckdb:parquet 17462052 1.77529e+07 0.983616 ns
tpcds_q13/duckdb:parquet 37705357 3.79007e+07 0.994847 ns
tpcds_q14/duckdb:parquet 100539022 1.03936e+08 0.967314 ns
tpcds_q15/duckdb:parquet 27830648 2.70662e+07 1.02824 ns
tpcds_q16/duckdb:parquet 23312072 2.27091e+07 1.02655 ns
tpcds_q17/duckdb:parquet 41758419 4.04698e+07 1.03184 ns
tpcds_q18/duckdb:parquet 102673162 1.02208e+08 1.00455 ns
tpcds_q19/duckdb:parquet 32897096 3.27883e+07 1.00332 ns
tpcds_q20/duckdb:parquet 18699481 1.80706e+07 1.0348 ns
tpcds_q21/duckdb:parquet 13522501 1.36419e+07 0.991246 ns
tpcds_q22/duckdb:parquet 96726267 9.75331e+07 0.991728 ns
tpcds_q23/duckdb:parquet 100143686 1.01914e+08 0.982625 ns
tpcds_q24/duckdb:parquet 49928141 5.02449e+07 0.993695 ns
tpcds_q25/duckdb:parquet 36096026 3.61598e+07 0.998237 ns
tpcds_q26/duckdb:parquet 38359031 3.83403e+07 1.00049 ns
tpcds_q27/duckdb:parquet 82527360 8.06544e+07 1.02322 ns
tpcds_q28/duckdb:parquet 43156506 4.35022e+07 0.992053 ns
tpcds_q29/duckdb:parquet 39027725 3.7729e+07 1.03442 ns
tpcds_q30/duckdb:parquet 45254075 4.55992e+07 0.992432 ns
tpcds_q31/duckdb:parquet 27351819 2.81205e+07 0.972666 ns
tpcds_q32/duckdb:parquet 12686391 1.27516e+07 0.994886 ns
tpcds_q33/duckdb:parquet 21444180 2.13996e+07 1.00208 ns
tpcds_q34/duckdb:parquet 24319475 2.40047e+07 1.01311 ns
tpcds_q35/duckdb:parquet 68290145 6.83489e+07 0.99914 ns
tpcds_q36/duckdb:parquet 24719902 2.48817e+07 0.993498 ns
tpcds_q37/duckdb:parquet 15581049 1.58848e+07 0.980881 ns
tpcds_q38/duckdb:parquet 35579767 3.61136e+07 0.985218 ns
tpcds_q39/duckdb:parquet 37358657 3.66879e+07 1.01828 ns
tpcds_q40/duckdb:parquet 19761739 1.95621e+07 1.01021 ns
tpcds_q41/duckdb:parquet 9807125 9.79645e+06 1.00109 ns
tpcds_q42/duckdb:parquet 13621526 1.33056e+07 1.02374 ns
tpcds_q43/duckdb:parquet 19213413 1.83355e+07 1.04788 ns
tpcds_q44/duckdb:parquet 28757733 2.87246e+07 1.00115 ns
tpcds_q45/duckdb:parquet 28282865 2.89755e+07 0.976095 ns
tpcds_q46/duckdb:parquet 49298522 4.89716e+07 1.00668 ns
tpcds_q47/duckdb:parquet 57939311 5.98957e+07 0.967337 ns
tpcds_q48/duckdb:parquet 34381111 3.48303e+07 0.987102 ns
tpcds_q49/duckdb:parquet 25932910 2.69636e+07 0.961773 ns
tpcds_q50/duckdb:parquet 28597935 2.861e+07 0.999577 ns
tpcds_q51/duckdb:parquet 196281493 1.96874e+08 0.99699 ns
tpcds_q52/duckdb:parquet 13231001 1.33583e+07 0.990471 ns
tpcds_q53/duckdb:parquet 19956437 1.99967e+07 0.997985 ns
tpcds_q54/duckdb:parquet 26105079 2.63206e+07 0.991811 ns
tpcds_q55/duckdb:parquet 12475257 1.30888e+07 0.953126 ns
tpcds_q56/duckdb:parquet 23532817 2.32019e+07 1.01426 ns
tpcds_q57/duckdb:parquet 47721309 4.73396e+07 1.00806 ns
tpcds_q58/duckdb:parquet 26164564 2.52507e+07 1.03619 ns
tpcds_q59/duckdb:parquet 39622009 3.90706e+07 1.01411 ns
tpcds_q60/duckdb:parquet 23911220 2.37003e+07 1.0089 ns
tpcds_q61/duckdb:parquet 30734737 3.31425e+07 0.927352 ns
tpcds_q62/duckdb:parquet 13864851 1.39464e+07 0.994156 ns
tpcds_q63/duckdb:parquet 17361787 1.74376e+07 0.995654 ns
tpcds_q64/duckdb:parquet 76982506 7.71791e+07 0.997453 ns
tpcds_q65/duckdb:parquet 30003798 2.91483e+07 1.02935 ns
tpcds_q66/duckdb:parquet 31245451 3.35971e+07 0.930004 ns
tpcds_q67/duckdb:parquet 186231197 1.89119e+08 0.984732 ns
tpcds_q68/duckdb:parquet 38942806 3.92225e+07 0.992869 ns
tpcds_q69/duckdb:parquet 41303680 4.14332e+07 0.996873 ns
tpcds_q70/duckdb:parquet 56761380 5.7086e+07 0.994314 ns
tpcds_q71/duckdb:parquet 21051916 2.11364e+07 0.996002 ns
tpcds_q72/duckdb:parquet 169597629 1.70344e+08 0.99562 ns
tpcds_q73/duckdb:parquet 20753956 2.09713e+07 0.989638 ns
tpcds_q74/duckdb:parquet 56175330 5.67529e+07 0.989824 ns
tpcds_q75/duckdb:parquet 56824754 5.75534e+07 0.98734 ns
tpcds_q76/duckdb:parquet 21035329 2.14093e+07 0.982532 ns
tpcds_q77/duckdb:parquet 23964509 2.37868e+07 1.00747 ns
tpcds_q78/duckdb:parquet 78793933 8.10959e+07 0.971614 ns
tpcds_q79/duckdb:parquet 31361936 3.16196e+07 0.99185 ns
tpcds_q80/duckdb:parquet 43910957 4.47625e+07 0.980977 ns
tpcds_q81/duckdb:parquet 50081683 4.99766e+07 1.0021 ns
tpcds_q82/duckdb:parquet 19317321 1.92299e+07 1.00454 ns
tpcds_q83/duckdb:parquet 18361535 1.83539e+07 1.00042 ns
tpcds_q84/duckdb:parquet 21815761 2.0844e+07 1.04662 ns
tpcds_q85/duckdb:parquet 43697498 4.37828e+07 0.998051 ns
tpcds_q86/duckdb:parquet 38286904 3.88997e+07 0.984247 ns
tpcds_q87/duckdb:parquet 37552854 3.7945e+07 0.989667 ns
tpcds_q88/duckdb:parquet 53878268 5.38349e+07 1.0008 ns
tpcds_q89/duckdb:parquet 21646667 2.20807e+07 0.980344 ns
tpcds_q90/duckdb:parquet 9922132 1.00664e+07 0.985666 ns
tpcds_q91/duckdb:parquet 27503944 2.8516e+07 0.964508 ns
tpcds_q92/duckdb:parquet 13374615 1.36976e+07 0.97642 ns
tpcds_q93/duckdb:parquet 32869587 3.39233e+07 0.968938 ns
tpcds_q94/duckdb:parquet 18504137 1.86346e+07 0.992997 ns
tpcds_q95/duckdb:parquet 150528437 1.51838e+08 0.991377 ns
tpcds_q96/duckdb:parquet 11518615 1.13278e+07 1.01684 ns
tpcds_q97/duckdb:parquet 37924806 3.81827e+07 0.993245 ns
tpcds_q98/duckdb:parquet 23989660 2.34655e+07 1.02234 ns
tpcds_q99/duckdb:parquet 24214215 2.41779e+07 1.0015 ns
tpcds_q01/duckdb:vortex-file-compressed 30208098 3.0014e+07 1.00647 ns
tpcds_q02/duckdb:vortex-file-compressed 54483522 5.0254e+07 1.08416 ns
tpcds_q03/duckdb:vortex-file-compressed 23889964 2.43297e+07 0.981928 ns
tpcds_q04/duckdb:vortex-file-compressed 110297568 1.16109e+08 0.94995 ns
tpcds_q05/duckdb:vortex-file-compressed 37870731 4.14527e+07 0.91359 ns
tpcds_q06/duckdb:vortex-file-compressed 38041136 4.04411e+07 0.940656 ns
tpcds_q07/duckdb:vortex-file-compressed 29872158 3.28435e+07 0.909532 ns
tpcds_q08/duckdb:vortex-file-compressed 30175200 3.15394e+07 0.956745 ns
tpcds_q09/duckdb:vortex-file-compressed 42395041 4.18757e+07 1.0124 ns
tpcds_q10/duckdb:vortex-file-compressed 49874398 5.34122e+07 0.933764 ns
tpcds_q11/duckdb:vortex-file-compressed 72095474 7.92893e+07 0.909271 ns
tpcds_q12/duckdb:vortex-file-compressed 18534420 1.9057e+07 0.97258 ns
tpcds_q13/duckdb:vortex-file-compressed 36890064 3.97625e+07 0.927761 ns
tpcds_q14/duckdb:vortex-file-compressed 124390733 1.26671e+08 0.981998 ns
tpcds_q15/duckdb:vortex-file-compressed 28265436 2.97109e+07 0.951349 ns
tpcds_q16/duckdb:vortex-file-compressed 31788367 3.38654e+07 0.938669 ns
tpcds_q17/duckdb:vortex-file-compressed 45280592 4.97927e+07 0.909382 ns
tpcds_q18/duckdb:vortex-file-compressed 93975750 1.05378e+08 0.891793 ns 🚀
tpcds_q19/duckdb:vortex-file-compressed 39108044 4.25085e+07 0.920006 ns
tpcds_q20/duckdb:vortex-file-compressed 18527412 1.99901e+07 0.926828 ns
tpcds_q21/duckdb:vortex-file-compressed 17445578 2.27472e+07 0.766933 ns 🚀
tpcds_q22/duckdb:vortex-file-compressed 114759763 1.21519e+08 0.944379 ns
tpcds_q23/duckdb:vortex-file-compressed 130112204 1.47486e+08 0.882199 ns 🚀
tpcds_q24/duckdb:vortex-file-compressed 57998172 6.04619e+07 0.959252 ns
tpcds_q25/duckdb:vortex-file-compressed 45523406 4.88076e+07 0.932712 ns
tpcds_q26/duckdb:vortex-file-compressed 44482916 4.70905e+07 0.944626 ns
tpcds_q27/duckdb:vortex-file-compressed 80992507 8.41611e+07 0.96235 ns
tpcds_q28/duckdb:vortex-file-compressed 36943814 3.86553e+07 0.955725 ns
tpcds_q29/duckdb:vortex-file-compressed 47238454 5.10486e+07 0.925362 ns
tpcds_q30/duckdb:vortex-file-compressed 33203318 3.61586e+07 0.918268 ns
tpcds_q31/duckdb:vortex-file-compressed 34103322 3.53863e+07 0.963744 ns
tpcds_q32/duckdb:vortex-file-compressed 16512410 1.75131e+07 0.942862 ns
tpcds_q33/duckdb:vortex-file-compressed 33404920 3.15146e+07 1.05998 ns
tpcds_q34/duckdb:vortex-file-compressed 29515288 2.99674e+07 0.984913 ns
tpcds_q35/duckdb:vortex-file-compressed 81706627 8.34748e+07 0.978818 ns
tpcds_q36/duckdb:vortex-file-compressed 29902595 3.21783e+07 0.929278 ns
tpcds_q37/duckdb:vortex-file-compressed 17066818 1.96673e+07 0.867774 ns 🚀
tpcds_q38/duckdb:vortex-file-compressed 47234555 4.64201e+07 1.01754 ns
tpcds_q39/duckdb:vortex-file-compressed 45420585 4.96814e+07 0.914237 ns
tpcds_q40/duckdb:vortex-file-compressed 25190190 2.42458e+07 1.03895 ns
tpcds_q41/duckdb:vortex-file-compressed 17232480 1.76165e+07 0.9782 ns
tpcds_q42/duckdb:vortex-file-compressed 14726524 1.63209e+07 0.902312 ns
tpcds_q43/duckdb:vortex-file-compressed 21110138 2.19162e+07 0.963221 ns
tpcds_q44/duckdb:vortex-file-compressed 28263491 2.92801e+07 0.965281 ns
tpcds_q45/duckdb:vortex-file-compressed 34063055 3.29669e+07 1.03325 ns
tpcds_q46/duckdb:vortex-file-compressed 57167907 6.18589e+07 0.924166 ns
tpcds_q47/duckdb:vortex-file-compressed 65409157 6.93235e+07 0.943535 ns
tpcds_q48/duckdb:vortex-file-compressed 35296219 3.71174e+07 0.950935 ns
tpcds_q49/duckdb:vortex-file-compressed 32513062 3.48217e+07 0.933701 ns
tpcds_q50/duckdb:vortex-file-compressed 35202395 3.81895e+07 0.921782 ns
tpcds_q51/duckdb:vortex-file-compressed 117924394 1.25366e+08 0.94064 ns
tpcds_q52/duckdb:vortex-file-compressed 14186845 1.62794e+07 0.871459 ns 🚀
tpcds_q53/duckdb:vortex-file-compressed 24712522 2.68843e+07 0.919218 ns
tpcds_q54/duckdb:vortex-file-compressed 32084312 3.66266e+07 0.875983 ns 🚀
tpcds_q55/duckdb:vortex-file-compressed 14524977 1.55749e+07 0.932589 ns
tpcds_q56/duckdb:vortex-file-compressed 37010463 3.90116e+07 0.948705 ns
tpcds_q57/duckdb:vortex-file-compressed 57909403 6.05334e+07 0.956652 ns
tpcds_q58/duckdb:vortex-file-compressed 36366673 3.68398e+07 0.987158 ns
tpcds_q59/duckdb:vortex-file-compressed 52463642 6.06455e+07 0.865088 ns 🚀
tpcds_q60/duckdb:vortex-file-compressed 38195465 4.01163e+07 0.952117 ns
tpcds_q61/duckdb:vortex-file-compressed 40174244 4.96862e+07 0.808559 ns 🚀
tpcds_q62/duckdb:vortex-file-compressed 24514198 2.29204e+07 1.06954 ns
tpcds_q63/duckdb:vortex-file-compressed 25436143 2.65976e+07 0.956333 ns
tpcds_q64/duckdb:vortex-file-compressed 88368444 9.48314e+07 0.931848 ns
tpcds_q65/duckdb:vortex-file-compressed 33777109 3.4504e+07 0.978933 ns
tpcds_q66/duckdb:vortex-file-compressed 32684145 3.51719e+07 0.929268 ns
tpcds_q67/duckdb:vortex-file-compressed 181488102 1.96826e+08 0.922072 ns
tpcds_q68/duckdb:vortex-file-compressed 46788787 4.96917e+07 0.941582 ns
tpcds_q69/duckdb:vortex-file-compressed 51370340 5.32538e+07 0.964632 ns
tpcds_q70/duckdb:vortex-file-compressed 60554857 7.2824e+07 0.831523 ns 🚀
tpcds_q71/duckdb:vortex-file-compressed 25127871 2.68065e+07 0.93738 ns
tpcds_q72/duckdb:vortex-file-compressed 168318624 1.80054e+08 0.934823 ns
tpcds_q73/duckdb:vortex-file-compressed 26181091 2.88818e+07 0.906491 ns
tpcds_q74/duckdb:vortex-file-compressed 63131250 6.4932e+07 0.972267 ns
tpcds_q75/duckdb:vortex-file-compressed 67231403 6.75291e+07 0.995592 ns
tpcds_q76/duckdb:vortex-file-compressed 24563136 2.63505e+07 0.93217 ns
tpcds_q77/duckdb:vortex-file-compressed 29959989 3.05763e+07 0.979843 ns
tpcds_q78/duckdb:vortex-file-compressed 87300502 9.04769e+07 0.964893 ns
tpcds_q79/duckdb:vortex-file-compressed 36551571 3.92168e+07 0.932038 ns
tpcds_q80/duckdb:vortex-file-compressed 52392303 5.65138e+07 0.92707 ns
tpcds_q81/duckdb:vortex-file-compressed 39299107 3.97945e+07 0.987552 ns
tpcds_q82/duckdb:vortex-file-compressed 19462093 2.25189e+07 0.864256 ns 🚀
tpcds_q83/duckdb:vortex-file-compressed 38795430 3.94479e+07 0.98346 ns
tpcds_q84/duckdb:vortex-file-compressed 22266822 2.46882e+07 0.901922 ns
tpcds_q85/duckdb:vortex-file-compressed 54336107 5.66144e+07 0.959757 ns
tpcds_q86/duckdb:vortex-file-compressed 46196597 5.6672e+07 0.815157 ns 🚀
tpcds_q87/duckdb:vortex-file-compressed 48883164 4.89925e+07 0.997768 ns
tpcds_q88/duckdb:vortex-file-compressed 81694391 9.02115e+07 0.905587 ns
tpcds_q89/duckdb:vortex-file-compressed 26191590 2.85163e+07 0.918478 ns
tpcds_q90/duckdb:vortex-file-compressed 17759864 1.54808e+07 1.14722 ns 🚨
tpcds_q91/duckdb:vortex-file-compressed 31871701 3.28358e+07 0.97064 ns
tpcds_q92/duckdb:vortex-file-compressed 23715746 2.54861e+07 0.930537 ns
tpcds_q93/duckdb:vortex-file-compressed 30557431 3.38401e+07 0.902994 ns
tpcds_q94/duckdb:vortex-file-compressed 26903821 2.87167e+07 0.936869 ns
tpcds_q95/duckdb:vortex-file-compressed 151997513 1.59655e+08 0.952034 ns
tpcds_q96/duckdb:vortex-file-compressed 25723996 2.77655e+07 0.926475 ns
tpcds_q97/duckdb:vortex-file-compressed 42318492 4.50871e+07 0.938594 ns
tpcds_q98/duckdb:vortex-file-compressed 22823581 2.45018e+07 0.931506 ns
tpcds_q99/duckdb:vortex-file-compressed 49976726 4.54704e+07 1.09911 ns
tpcds_q01/duckdb:vortex-compact 36111034 4.05795e+07 0.889884 ns 🚀
tpcds_q02/duckdb:vortex-compact 63910862 5.82181e+07 1.09778 ns
tpcds_q03/duckdb:vortex-compact 51047399 5.33386e+07 0.957045 ns
tpcds_q04/duckdb:vortex-compact 142586390 1.41433e+08 1.00816 ns
tpcds_q05/duckdb:vortex-compact 57648737 5.26783e+07 1.09435 ns
tpcds_q06/duckdb:vortex-compact 47286990 4.90881e+07 0.963309 ns
tpcds_q07/duckdb:vortex-compact 55121093 6.00103e+07 0.918527 ns
tpcds_q08/duckdb:vortex-compact 43112193 4.54728e+07 0.948088 ns
tpcds_q09/duckdb:vortex-compact 105157283 1.05983e+08 0.992211 ns
tpcds_q10/duckdb:vortex-compact 73964513 7.90027e+07 0.936227 ns
tpcds_q11/duckdb:vortex-compact 101126753 1.07136e+08 0.943913 ns
tpcds_q12/duckdb:vortex-compact 27219999 3.01999e+07 0.901327 ns
tpcds_q13/duckdb:vortex-compact 68563961 7.62044e+07 0.899738 ns 🚀
tpcds_q14/duckdb:vortex-compact 148333422 1.54096e+08 0.962603 ns
tpcds_q15/duckdb:vortex-compact 33530451 3.5912e+07 0.933685 ns
tpcds_q16/duckdb:vortex-compact 38886711 3.81775e+07 1.01858 ns
tpcds_q17/duckdb:vortex-compact 61877948 6.80887e+07 0.908785 ns
tpcds_q18/duckdb:vortex-compact 136882548 1.44554e+08 0.946928 ns
tpcds_q19/duckdb:vortex-compact 59521792 6.45099e+07 0.922677 ns
tpcds_q20/duckdb:vortex-compact 25359559 2.57747e+07 0.983893 ns
tpcds_q21/duckdb:vortex-compact 20736888 2.51964e+07 0.823011 ns 🚀
tpcds_q22/duckdb:vortex-compact 121494785 1.29874e+08 0.935483 ns
tpcds_q23/duckdb:vortex-compact 149480212 1.77882e+08 0.840333 ns 🚀
tpcds_q24/duckdb:vortex-compact 79616997 8.06289e+07 0.98745 ns
tpcds_q25/duckdb:vortex-compact 64693422 7.10144e+07 0.91099 ns
tpcds_q26/duckdb:vortex-compact 55498742 5.86986e+07 0.945486 ns
tpcds_q27/duckdb:vortex-compact 135717522 1.37779e+08 0.985036 ns
tpcds_q28/duckdb:vortex-compact 105972493 1.07423e+08 0.986497 ns
tpcds_q29/duckdb:vortex-compact 73612930 7.90361e+07 0.931384 ns
tpcds_q30/duckdb:vortex-compact 41610538 4.33829e+07 0.959145 ns
tpcds_q31/duckdb:vortex-compact 49486307 4.96974e+07 0.995752 ns
tpcds_q32/duckdb:vortex-compact 26671740 2.78271e+07 0.958482 ns
tpcds_q33/duckdb:vortex-compact 47698349 4.84901e+07 0.983672 ns
tpcds_q34/duckdb:vortex-compact 48481944 5.39873e+07 0.898025 ns 🚀
tpcds_q35/duckdb:vortex-compact 102951451 1.07597e+08 0.956826 ns
tpcds_q36/duckdb:vortex-compact 42897283 4.46944e+07 0.959791 ns
tpcds_q37/duckdb:vortex-compact 26132026 2.65175e+07 0.985464 ns
tpcds_q38/duckdb:vortex-compact 60556942 6.01308e+07 1.00709 ns
tpcds_q39/duckdb:vortex-compact 47161499 5.45343e+07 0.864804 ns 🚀
tpcds_q40/duckdb:vortex-compact 32005354 3.20173e+07 0.999628 ns
tpcds_q41/duckdb:vortex-compact 20381359 2.1654e+07 0.941229 ns
tpcds_q42/duckdb:vortex-compact 19872983 2.24454e+07 0.885393 ns 🚀
tpcds_q43/duckdb:vortex-compact 31625763 3.12101e+07 1.01332 ns
tpcds_q44/duckdb:vortex-compact 45906989 4.74517e+07 0.967448 ns
tpcds_q45/duckdb:vortex-compact 40318630 4.07225e+07 0.990083 ns
tpcds_q46/duckdb:vortex-compact 83727295 8.82183e+07 0.949093 ns
tpcds_q47/duckdb:vortex-compact 77670335 8.09709e+07 0.959237 ns
tpcds_q48/duckdb:vortex-compact 61757736 6.59264e+07 0.936767 ns
tpcds_q49/duckdb:vortex-compact 65094459 5.86912e+07 1.1091 ns 🚨
tpcds_q50/duckdb:vortex-compact 55759483 5.99607e+07 0.929933 ns
tpcds_q51/duckdb:vortex-compact 144251597 2.0571e+08 0.701239 ns 🚀
tpcds_q52/duckdb:vortex-compact 20754064 2.21716e+07 0.936064 ns
tpcds_q53/duckdb:vortex-compact 35497231 3.85485e+07 0.920846 ns
tpcds_q54/duckdb:vortex-compact 45127161 4.65427e+07 0.969585 ns
tpcds_q55/duckdb:vortex-compact 20260461 2.11952e+07 0.955898 ns
tpcds_q56/duckdb:vortex-compact 56464082 5.90803e+07 0.955718 ns
tpcds_q57/duckdb:vortex-compact 62965842 6.55866e+07 0.960042 ns
tpcds_q58/duckdb:vortex-compact 43601440 4.77997e+07 0.91217 ns
tpcds_q59/duckdb:vortex-compact 59091628 7.06697e+07 0.836166 ns 🚀
tpcds_q60/duckdb:vortex-compact 51793630 5.47554e+07 0.945909 ns
tpcds_q61/duckdb:vortex-compact 66126731 7.83303e+07 0.844204 ns 🚀
tpcds_q62/duckdb:vortex-compact 37864793 3.7585e+07 1.00745 ns
tpcds_q63/duckdb:vortex-compact 36980325 3.86055e+07 0.957902 ns
tpcds_q64/duckdb:vortex-compact 127886503 1.34639e+08 0.949845 ns
tpcds_q65/duckdb:vortex-compact 46368176 4.86477e+07 0.953141 ns
tpcds_q66/duckdb:vortex-compact 52674038 5.44103e+07 0.968089 ns
tpcds_q67/duckdb:vortex-compact 228318079 2.44638e+08 0.933289 ns
tpcds_q68/duckdb:vortex-compact 75713723 7.8388e+07 0.965884 ns
tpcds_q69/duckdb:vortex-compact 74517953 7.798e+07 0.955603 ns
tpcds_q70/duckdb:vortex-compact 116327606 1.29056e+08 0.901376 ns
tpcds_q71/duckdb:vortex-compact 34379936 3.789e+07 0.907363 ns
tpcds_q72/duckdb:vortex-compact 183267892 1.9503e+08 0.93969 ns
tpcds_q73/duckdb:vortex-compact 46922717 4.95062e+07 0.947816 ns
tpcds_q74/duckdb:vortex-compact 86613428 8.67835e+07 0.998041 ns
tpcds_q75/duckdb:vortex-compact 78755346 8.03128e+07 0.980608 ns
tpcds_q76/duckdb:vortex-compact 38495741 3.99262e+07 0.964171 ns
tpcds_q77/duckdb:vortex-compact 43975790 4.5321e+07 0.970318 ns
tpcds_q78/duckdb:vortex-compact 97073728 9.73594e+07 0.997066 ns
tpcds_q79/duckdb:vortex-compact 62089640 6.70596e+07 0.925887 ns
tpcds_q80/duckdb:vortex-compact 76845459 8.53211e+07 0.900662 ns
tpcds_q81/duckdb:vortex-compact 45958625 4.78562e+07 0.960349 ns
tpcds_q82/duckdb:vortex-compact 28725722 3.11254e+07 0.922902 ns
tpcds_q83/duckdb:vortex-compact 59247247 6.01377e+07 0.985193 ns
tpcds_q84/duckdb:vortex-compact 29004406 3.11486e+07 0.931162 ns
tpcds_q85/duckdb:vortex-compact 74170058 7.57939e+07 0.978575 ns
tpcds_q86/duckdb:vortex-compact 65232159 7.92566e+07 0.82305 ns 🚀
tpcds_q87/duckdb:vortex-compact 59413125 6.28798e+07 0.944868 ns
tpcds_q88/duckdb:vortex-compact 95559385 1.02587e+08 0.931496 ns
tpcds_q89/duckdb:vortex-compact 36955365 3.92288e+07 0.942047 ns
tpcds_q90/duckdb:vortex-compact 16503035 1.56824e+07 1.05233 ns
tpcds_q91/duckdb:vortex-compact 46610265 4.82208e+07 0.966601 ns
tpcds_q92/duckdb:vortex-compact 53940987 5.97724e+07 0.902439 ns
tpcds_q93/duckdb:vortex-compact 39873340 4.04776e+07 0.985072 ns
tpcds_q94/duckdb:vortex-compact 37234310 3.94779e+07 0.943168 ns
tpcds_q95/duckdb:vortex-compact 172748848 1.71576e+08 1.00684 ns
tpcds_q96/duckdb:vortex-compact 30824516 3.65435e+07 0.843503 ns 🚀
tpcds_q97/duckdb:vortex-compact 46673892 4.85367e+07 0.96162 ns
tpcds_q98/duckdb:vortex-compact 31125495 3.29894e+07 0.943499 ns
tpcds_q99/duckdb:vortex-compact 48595883 5.27372e+07 0.921473 ns
tpcds_q01/duckdb:duckdb 23635399 2.38535e+07 0.990855 ns
tpcds_q02/duckdb:duckdb 25048174 2.49965e+07 1.00207 ns
tpcds_q03/duckdb:duckdb 10825615 1.09028e+07 0.992925 ns
tpcds_q04/duckdb:duckdb 172216262 1.74884e+08 0.984747 ns
tpcds_q05/duckdb:duckdb 21593812 2.15602e+07 1.00156 ns
tpcds_q06/duckdb:duckdb 27585387 2.71288e+07 1.01683 ns
tpcds_q07/duckdb:duckdb 41206743 4.07769e+07 1.01054 ns
tpcds_q08/duckdb:duckdb 125143313 1.24043e+08 1.00887 ns
tpcds_q09/duckdb:duckdb 18891344 1.89133e+07 0.998841 ns
tpcds_q10/duckdb:duckdb 27263475 2.75709e+07 0.988849 ns
tpcds_q11/duckdb:duckdb 153336119 1.48764e+08 1.03073 ns
tpcds_q12/duckdb:duckdb 14371393 1.39634e+07 1.02922 ns
tpcds_q13/duckdb:duckdb 26889114 2.71594e+07 0.990048 ns
tpcds_q14/duckdb:duckdb 94213786 9.37391e+07 1.00506 ns
tpcds_q15/duckdb:duckdb 22412546 2.27426e+07 0.985486 ns
tpcds_q16/duckdb:duckdb 19896127 1.99996e+07 0.994827 ns
tpcds_q17/duckdb:duckdb 24307610 2.48463e+07 0.978318 ns
tpcds_q18/duckdb:duckdb 50419333 5.06436e+07 0.995571 ns
tpcds_q19/duckdb:duckdb 19405512 1.99202e+07 0.974163 ns
tpcds_q20/duckdb:duckdb 14238790 1.43124e+07 0.994858 ns
tpcds_q21/duckdb:duckdb 7559320 7.61852e+06 0.99223 ns
tpcds_q22/duckdb:duckdb 83935052 8.49713e+07 0.987805 ns
tpcds_q23/duckdb:duckdb 71932381 7.94873e+07 0.904954 ns
tpcds_q24/duckdb:duckdb 25781561 2.58279e+07 0.998206 ns
tpcds_q25/duckdb:duckdb 18469089 1.82992e+07 1.00929 ns
tpcds_q26/duckdb:duckdb 29002857 2.89933e+07 1.00033 ns
tpcds_q27/duckdb:duckdb 53471000 5.36071e+07 0.997461 ns
tpcds_q28/duckdb:duckdb 24445757 2.46316e+07 0.992456 ns
tpcds_q29/duckdb:duckdb 23833602 2.37728e+07 1.00256 ns
tpcds_q30/duckdb:duckdb 32536771 3.03758e+07 1.07114 ns
tpcds_q31/duckdb:duckdb 24437240 2.44541e+07 0.99931 ns
tpcds_q32/duckdb:duckdb 8550394 8.43888e+06 1.01321 ns
tpcds_q33/duckdb:duckdb 15968899 1.63251e+07 0.978178 ns
tpcds_q34/duckdb:duckdb 18986410 1.9133e+07 0.99234 ns
tpcds_q35/duckdb:duckdb 40277942 4.05824e+07 0.992498 ns
tpcds_q36/duckdb:duckdb 77614644 7.75475e+07 1.00087 ns
tpcds_q37/duckdb:duckdb 8894727 8.74004e+06 1.0177 ns
tpcds_q38/duckdb:duckdb 32502966 3.32585e+07 0.977282 ns
tpcds_q39/duckdb:duckdb 30132639 3.00869e+07 1.00152 ns
tpcds_q40/duckdb:duckdb 15218507 1.53667e+07 0.990359 ns
tpcds_q41/duckdb:duckdb 9940182 9.92765e+06 1.00126 ns
tpcds_q42/duckdb:duckdb 8865989 8.88089e+06 0.998323 ns
tpcds_q43/duckdb:duckdb 13438636 1.46247e+07 0.918898 ns
tpcds_q44/duckdb:duckdb 16336014 1.75484e+07 0.930913 ns
tpcds_q45/duckdb:duckdb 18509107 1.88218e+07 0.983385 ns
tpcds_q46/duckdb:duckdb 40346711 3.95251e+07 1.02079 ns
tpcds_q47/duckdb:duckdb 54442425 5.46454e+07 0.996285 ns
tpcds_q48/duckdb:duckdb 25827134 2.54666e+07 1.01416 ns
tpcds_q49/duckdb:duckdb 18168587 1.77651e+07 1.02271 ns
tpcds_q50/duckdb:duckdb 16699094 1.69482e+07 0.985303 ns
tpcds_q51/duckdb:duckdb 106301130 1.0713e+08 0.992263 ns
tpcds_q52/duckdb:duckdb 10226835 9.39803e+06 1.08819 ns
tpcds_q53/duckdb:duckdb 15719020 1.59425e+07 0.985985 ns
tpcds_q54/duckdb:duckdb 20018214 1.98759e+07 1.00716 ns
tpcds_q55/duckdb:duckdb 9863172 9.22694e+06 1.06895 ns
tpcds_q56/duckdb:duckdb 17132741 1.75319e+07 0.977232 ns
tpcds_q57/duckdb:duckdb 45818690 4.62891e+07 0.989837 ns
tpcds_q58/duckdb:duckdb 15459571 1.56825e+07 0.985782 ns
tpcds_q59/duckdb:duckdb 37346610 3.75048e+07 0.995781 ns
tpcds_q60/duckdb:duckdb 18522479 1.90926e+07 0.970139 ns
tpcds_q61/duckdb:duckdb 17888022 1.8073e+07 0.989763 ns
tpcds_q62/duckdb:duckdb 10546625 1.05111e+07 1.00338 ns
tpcds_q63/duckdb:duckdb 14410268 1.40626e+07 1.02472 ns
tpcds_q64/duckdb:duckdb 58827250 5.89255e+07 0.998333 ns
tpcds_q65/duckdb:duckdb 36018579 3.31168e+07 1.08762 ns
tpcds_q66/duckdb:duckdb 27338331 2.71376e+07 1.0074 ns
tpcds_q67/duckdb:duckdb 152027500 1.5249e+08 0.996969 ns
tpcds_q68/duckdb:duckdb 28014023 2.76968e+07 1.01145 ns
tpcds_q69/duckdb:duckdb 30680521 2.94709e+07 1.04104 ns
tpcds_q70/duckdb:duckdb 19687601 1.97369e+07 0.997502 ns
tpcds_q71/duckdb:duckdb 16203437 1.6485e+07 0.982919 ns
tpcds_q72/duckdb:duckdb 45220717 4.50971e+07 1.00274 ns
tpcds_q73/duckdb:duckdb 14510468 1.46314e+07 0.991734 ns
tpcds_q74/duckdb:duckdb 105880017 1.05918e+08 0.999645 ns
tpcds_q75/duckdb:duckdb 45750248 4.42256e+07 1.03448 ns
tpcds_q76/duckdb:duckdb 15014122 1.47968e+07 1.01468 ns
tpcds_q77/duckdb:duckdb 14802069 1.45659e+07 1.01621 ns
tpcds_q78/duckdb:duckdb 66085592 6.65838e+07 0.992518 ns
tpcds_q79/duckdb:duckdb 21513716 2.1285e+07 1.01075 ns
tpcds_q80/duckdb:duckdb 31731309 3.06838e+07 1.03414 ns
tpcds_q81/duckdb:duckdb 39920072 4.00663e+07 0.99635 ns
tpcds_q82/duckdb:duckdb 10810804 1.08808e+07 0.993565 ns
tpcds_q83/duckdb:duckdb 10868817 1.0774e+07 1.0088 ns
tpcds_q84/duckdb:duckdb 14743382 1.47814e+07 0.997429 ns
tpcds_q85/duckdb:duckdb 25020036 2.51428e+07 0.995115 ns
tpcds_q86/duckdb:duckdb 13621858 1.37388e+07 0.991491 ns
tpcds_q87/duckdb:duckdb 34755506 3.45695e+07 1.00538 ns
tpcds_q88/duckdb:duckdb 26347402 2.58495e+07 1.01926 ns
tpcds_q89/duckdb:duckdb 18344944 1.81099e+07 1.01298 ns
tpcds_q90/duckdb:duckdb 6802724 6.68413e+06 1.01774 ns
tpcds_q91/duckdb:duckdb 15041347 1.57437e+07 0.955388 ns
tpcds_q92/duckdb:duckdb 9766646 9.9371e+06 0.982847 ns
tpcds_q93/duckdb:duckdb 23599293 2.3999e+07 0.983344 ns
tpcds_q94/duckdb:duckdb 16052624 1.4991e+07 1.07082 ns
tpcds_q95/duckdb:duckdb 128335583 1.32676e+08 0.967284 ns
tpcds_q96/duckdb:duckdb 5694265 6.41216e+06 0.888041 ns 🚀
tpcds_q97/duckdb:duckdb 32463848 3.27419e+07 0.991509 ns
tpcds_q98/duckdb:duckdb 19692415 1.84257e+07 1.06875 ns
tpcds_q99/duckdb:duckdb 21600979 2.14043e+07 1.00919 ns

@github-actions
Copy link
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark FineWeb S3 failed! Check the workflow run for details.

@github-actions
Copy link
Contributor

Benchmarks: TPC-H SF=10 on NVME

Summary

  • Overall: 1.018x ➖
  • Vortex: 1.050x ➖
  • duckdb:vortex: 1.081x ➖
  • datafusion:vortex: 1.020x ➖
  • Best: tpch_q06/datafusion:vortex-file-compressed (0.918x)
  • Worst: tpch_q06/duckdb:vortex-file-compressed (1.196x)
  • Significant (>10%): 0↑ 15↓
Detailed Results Table
name PR caa4063 base ee29169 ratio (PR/base) unit remark
tpch_q01/datafusion:arrow 702307370 9.84322e+08 0.713493 ns 🚀
tpch_q02/datafusion:arrow 200528829 2.61592e+08 0.766572 ns 🚀
tpch_q03/datafusion:arrow 529813301 8.32743e+08 0.636227 ns 🚀
tpch_q04/datafusion:arrow 389273776 6.13526e+08 0.634486 ns 🚀
tpch_q05/datafusion:arrow 1069362530 1.23332e+09 0.867058 ns 🚀
tpch_q06/datafusion:arrow 302035016 3.35455e+08 0.900373 ns
tpch_q07/datafusion:arrow 1311417333 1.44777e+09 0.905816 ns
tpch_q08/datafusion:arrow 1281343660 1.42704e+09 0.897905 ns 🚀
tpch_q09/datafusion:arrow 1554593642 1.75114e+09 0.887759 ns 🚀
tpch_q10/datafusion:arrow 649407645 6.99428e+08 0.928484 ns
tpch_q11/datafusion:arrow 182642608 1.95526e+08 0.934109 ns
tpch_q12/datafusion:arrow 718443671 7.47457e+08 0.961184 ns
tpch_q13/datafusion:arrow 528431078 5.64065e+08 0.936827 ns
tpch_q14/datafusion:arrow 346271098 3.66401e+08 0.945061 ns
tpch_q15/datafusion:arrow 730087993 7.6631e+08 0.952732 ns
tpch_q16/datafusion:arrow 121479118 1.32895e+08 0.914102 ns
tpch_q17/datafusion:arrow 1572720848 1.72157e+09 0.913538 ns
tpch_q18/datafusion:arrow 2071040155 2.26718e+09 0.913487 ns
tpch_q19/datafusion:arrow 574660049 5.95136e+08 0.965595 ns
tpch_q20/datafusion:arrow 542464929 5.74432e+08 0.94435 ns
tpch_q21/datafusion:arrow 3687478755 3.86582e+09 0.953867 ns
tpch_q22/datafusion:arrow 195554575 1.85647e+08 1.05337 ns
tpch_q01/datafusion:parquet 509649711 5.00456e+08 1.01837 ns
tpch_q02/datafusion:parquet 261352385 2.77557e+08 0.941617 ns
tpch_q03/datafusion:parquet 412799921 4.27759e+08 0.965028 ns
tpch_q04/datafusion:parquet 151286315 1.63444e+08 0.925617 ns
tpch_q05/datafusion:parquet 606432144 6.16608e+08 0.983497 ns
tpch_q06/datafusion:parquet 131996688 1.35932e+08 0.971048 ns
tpch_q07/datafusion:parquet 832453955 8.47717e+08 0.981996 ns
tpch_q08/datafusion:parquet 677957499 7.07048e+08 0.958856 ns
tpch_q09/datafusion:parquet 1005196640 1.03986e+09 0.96667 ns
tpch_q10/datafusion:parquet 601396285 6.28565e+08 0.956777 ns
tpch_q11/datafusion:parquet 206847518 2.08008e+08 0.994419 ns
tpch_q12/datafusion:parquet 258848491 2.68662e+08 0.963474 ns
tpch_q13/datafusion:parquet 347304483 3.6256e+08 0.957923 ns
tpch_q14/datafusion:parquet 211467536 2.11091e+08 1.00179 ns
tpch_q15/datafusion:parquet 262839481 2.84796e+08 0.922904 ns
tpch_q16/datafusion:parquet 183001153 1.90735e+08 0.959452 ns
tpch_q17/datafusion:parquet 849476027 9.04584e+08 0.939079 ns
tpch_q18/datafusion:parquet 1043708306 1.09384e+09 0.954171 ns
tpch_q19/datafusion:parquet 330698206 3.44142e+08 0.960935 ns
tpch_q20/datafusion:parquet 385620525 3.87866e+08 0.994211 ns
tpch_q21/datafusion:parquet 916598075 9.77568e+08 0.937631 ns
tpch_q22/datafusion:parquet 223670470 2.21857e+08 1.00817 ns
tpch_q01/datafusion:vortex-file-compressed 417696494 4.4357e+08 0.94167 ns
tpch_q02/datafusion:vortex-file-compressed 165065825 1.71795e+08 0.960831 ns
tpch_q03/datafusion:vortex-file-compressed 262183325 2.77866e+08 0.943561 ns
tpch_q04/datafusion:vortex-file-compressed 111695375 1.20083e+08 0.930151 ns
tpch_q05/datafusion:vortex-file-compressed 471716424 4.97563e+08 0.948053 ns
tpch_q06/datafusion:vortex-file-compressed 41038046 4.47118e+07 0.917835 ns
tpch_q07/datafusion:vortex-file-compressed 655588320 6.87005e+08 0.95427 ns
tpch_q08/datafusion:vortex-file-compressed 490030418 5.1319e+08 0.954871 ns
tpch_q09/datafusion:vortex-file-compressed 828968180 8.72909e+08 0.949661 ns
tpch_q10/datafusion:vortex-file-compressed 299434382 3.11029e+08 0.962723 ns
tpch_q11/datafusion:vortex-file-compressed 124194608 1.27662e+08 0.972839 ns
tpch_q12/datafusion:vortex-file-compressed 139860284 1.42193e+08 0.983591 ns
tpch_q13/datafusion:vortex-file-compressed 253082233 2.40962e+08 1.0503 ns
tpch_q14/datafusion:vortex-file-compressed 77831972 8.04892e+07 0.966987 ns
tpch_q15/datafusion:vortex-file-compressed 123524864 1.14971e+08 1.0744 ns
tpch_q16/datafusion:vortex-file-compressed 110165868 1.03295e+08 1.06652 ns
tpch_q17/datafusion:vortex-file-compressed 855380135 8.06893e+08 1.06009 ns
tpch_q18/datafusion:vortex-file-compressed 1112723781 1.03982e+09 1.07011 ns
tpch_q19/datafusion:vortex-file-compressed 140873247 1.38599e+08 1.01641 ns
tpch_q20/datafusion:vortex-file-compressed 228768303 2.18308e+08 1.04792 ns
tpch_q21/datafusion:vortex-file-compressed 876250352 8.27754e+08 1.05859 ns
tpch_q22/datafusion:vortex-file-compressed 73350171 6.81614e+07 1.07613 ns
tpch_q01/datafusion:vortex-compact 507425094 5.17561e+08 0.980416 ns
tpch_q02/datafusion:vortex-compact 194801200 1.79879e+08 1.08296 ns
tpch_q03/datafusion:vortex-compact 314467978 2.9636e+08 1.0611 ns
tpch_q04/datafusion:vortex-compact 154822674 1.44705e+08 1.06992 ns
tpch_q05/datafusion:vortex-compact 539794509 5.07229e+08 1.0642 ns
tpch_q06/datafusion:vortex-compact 73382426 7.17346e+07 1.02297 ns
tpch_q07/datafusion:vortex-compact 771673598 7.25974e+08 1.06295 ns
tpch_q08/datafusion:vortex-compact 562890548 5.35182e+08 1.05177 ns
tpch_q09/datafusion:vortex-compact 938800299 8.90357e+08 1.05441 ns
tpch_q10/datafusion:vortex-compact 377679981 3.60098e+08 1.04883 ns
tpch_q11/datafusion:vortex-compact 142021232 1.35481e+08 1.04828 ns
tpch_q12/datafusion:vortex-compact 216622287 2.10375e+08 1.0297 ns
tpch_q13/datafusion:vortex-compact 301880713 2.98035e+08 1.01291 ns
tpch_q14/datafusion:vortex-compact 102713547 9.9996e+07 1.02718 ns
tpch_q15/datafusion:vortex-compact 187925576 1.8007e+08 1.04362 ns
tpch_q16/datafusion:vortex-compact 115355798 1.08381e+08 1.06436 ns
tpch_q17/datafusion:vortex-compact 853602846 8.01542e+08 1.06495 ns
tpch_q18/datafusion:vortex-compact 1119374115 1.04904e+09 1.06704 ns
tpch_q19/datafusion:vortex-compact 242773016 2.39188e+08 1.01499 ns
tpch_q20/datafusion:vortex-compact 261645599 2.47911e+08 1.0554 ns
tpch_q21/datafusion:vortex-compact 925120378 9.00024e+08 1.02788 ns
tpch_q22/datafusion:vortex-compact 85721813 8.17206e+07 1.04896 ns
tpch_q01/duckdb:parquet 273335042 2.69723e+08 1.01339 ns
tpch_q02/duckdb:parquet 133919585 1.31211e+08 1.02064 ns
tpch_q03/duckdb:parquet 239740478 2.2988e+08 1.0429 ns
tpch_q04/duckdb:parquet 165826282 1.5485e+08 1.07089 ns
tpch_q05/duckdb:parquet 248116230 2.40815e+08 1.03032 ns
tpch_q06/duckdb:parquet 73494387 7.34921e+07 1.00003 ns
tpch_q07/duckdb:parquet 234420598 2.26097e+08 1.03682 ns
tpch_q08/duckdb:parquet 359092040 3.44472e+08 1.04244 ns
tpch_q09/duckdb:parquet 522792169 5.0956e+08 1.02597 ns
tpch_q10/duckdb:parquet 674738861 6.42874e+08 1.04957 ns
tpch_q11/duckdb:parquet 60187106 5.61959e+07 1.07102 ns
tpch_q12/duckdb:parquet 148186261 1.43321e+08 1.03394 ns
tpch_q13/duckdb:parquet 432562038 4.09528e+08 1.05625 ns
tpch_q14/duckdb:parquet 189974632 1.82583e+08 1.04048 ns
tpch_q15/duckdb:parquet 114814403 1.10992e+08 1.03444 ns
tpch_q16/duckdb:parquet 177766881 1.65961e+08 1.07114 ns
tpch_q17/duckdb:parquet 209838704 2.08945e+08 1.00428 ns
tpch_q18/duckdb:parquet 392113119 3.66923e+08 1.06865 ns
tpch_q19/duckdb:parquet 292902946 2.88062e+08 1.0168 ns
tpch_q20/duckdb:parquet 257950641 2.54195e+08 1.01478 ns
tpch_q21/duckdb:parquet 641045195 5.95105e+08 1.0772 ns
tpch_q22/duckdb:parquet 313177907 3.04642e+08 1.02802 ns
tpch_q01/duckdb:vortex-file-compressed 201374094 1.91651e+08 1.05073 ns
tpch_q02/duckdb:vortex-file-compressed 71863685 6.62208e+07 1.08521 ns
tpch_q03/duckdb:vortex-file-compressed 162347081 1.43973e+08 1.12762 ns 🚨
tpch_q04/duckdb:vortex-file-compressed 185849038 1.67563e+08 1.10913 ns 🚨
tpch_q05/duckdb:vortex-file-compressed 168485169 1.5523e+08 1.08539 ns
tpch_q06/duckdb:vortex-file-compressed 59451065 4.97114e+07 1.19592 ns 🚨
tpch_q07/duckdb:vortex-file-compressed 172600436 1.58184e+08 1.09114 ns
tpch_q08/duckdb:vortex-file-compressed 254908158 2.29669e+08 1.10989 ns 🚨
tpch_q09/duckdb:vortex-file-compressed 404262927 3.8489e+08 1.05033 ns
tpch_q10/duckdb:vortex-file-compressed 173139758 1.72763e+08 1.00218 ns
tpch_q11/duckdb:vortex-file-compressed 44250040 4.25362e+07 1.04029 ns
tpch_q12/duckdb:vortex-file-compressed 109644075 1.01549e+08 1.07971 ns
tpch_q13/duckdb:vortex-file-compressed 269468157 2.47055e+08 1.09072 ns
tpch_q14/duckdb:vortex-file-compressed 80946211 7.28241e+07 1.11153 ns 🚨
tpch_q15/duckdb:vortex-file-compressed 108524560 9.92904e+07 1.093 ns
tpch_q16/duckdb:vortex-file-compressed 91120344 8.75476e+07 1.04081 ns
tpch_q17/duckdb:vortex-file-compressed 134692711 1.2467e+08 1.0804 ns
tpch_q18/duckdb:vortex-file-compressed 324233284 3.01438e+08 1.07562 ns
tpch_q19/duckdb:vortex-file-compressed 93861801 8.72996e+07 1.07517 ns
tpch_q20/duckdb:vortex-file-compressed 191226909 1.73673e+08 1.10107 ns 🚨
tpch_q21/duckdb:vortex-file-compressed 646473358 5.86415e+08 1.10242 ns 🚨
tpch_q22/duckdb:vortex-file-compressed 80271710 8.08075e+07 0.99337 ns
tpch_q01/duckdb:vortex-compact 257104383 2.46147e+08 1.04451 ns
tpch_q02/duckdb:vortex-compact 86702854 7.347e+07 1.18011 ns 🚨
tpch_q03/duckdb:vortex-compact 190628716 1.73412e+08 1.09928 ns
tpch_q04/duckdb:vortex-compact 223044045 2.04618e+08 1.09005 ns
tpch_q05/duckdb:vortex-compact 200173265 1.81816e+08 1.10097 ns 🚨
tpch_q06/duckdb:vortex-compact 100096550 8.57929e+07 1.16672 ns 🚨
tpch_q07/duckdb:vortex-compact 245612796 2.2109e+08 1.11092 ns 🚨
tpch_q08/duckdb:vortex-compact 306747373 2.72441e+08 1.12592 ns 🚨
tpch_q09/duckdb:vortex-compact 453342493 4.06832e+08 1.11432 ns 🚨
tpch_q10/duckdb:vortex-compact 222319709 2.12908e+08 1.04421 ns
tpch_q11/duckdb:vortex-compact 46206380 4.44369e+07 1.03982 ns
tpch_q12/duckdb:vortex-compact 231265245 2.16616e+08 1.06763 ns
tpch_q13/duckdb:vortex-compact 314780535 2.95054e+08 1.06686 ns
tpch_q14/duckdb:vortex-compact 117905403 1.03742e+08 1.13653 ns 🚨
tpch_q15/duckdb:vortex-compact 131087583 1.21742e+08 1.07677 ns
tpch_q16/duckdb:vortex-compact 100443296 9.38068e+07 1.07075 ns
tpch_q17/duckdb:vortex-compact 155445067 1.33973e+08 1.16027 ns 🚨
tpch_q18/duckdb:vortex-compact 358556484 3.34319e+08 1.0725 ns
tpch_q19/duckdb:vortex-compact 118227776 1.12934e+08 1.04688 ns
tpch_q20/duckdb:vortex-compact 240757773 2.34964e+08 1.02466 ns
tpch_q21/duckdb:vortex-compact 749703513 7.37961e+08 1.01591 ns
tpch_q22/duckdb:vortex-compact 93323544 9.68042e+07 0.964044 ns
tpch_q01/duckdb:duckdb 123051366 1.17066e+08 1.05113 ns
tpch_q02/duckdb:duckdb 53905870 4.90384e+07 1.09926 ns
tpch_q03/duckdb:duckdb 109737236 1.00623e+08 1.09058 ns
tpch_q04/duckdb:duckdb 143379848 1.27618e+08 1.12351 ns 🚨
tpch_q05/duckdb:duckdb 123469565 1.1647e+08 1.0601 ns
tpch_q06/duckdb:duckdb 48174415 4.43444e+07 1.08637 ns
tpch_q07/duckdb:duckdb 118767978 1.11706e+08 1.06322 ns
tpch_q08/duckdb:duckdb 151684076 1.40842e+08 1.07698 ns
tpch_q09/duckdb:duckdb 337043490 3.14188e+08 1.07275 ns
tpch_q10/duckdb:duckdb 233364510 2.1504e+08 1.08521 ns
tpch_q11/duckdb:duckdb 24764784 2.27447e+07 1.08881 ns
tpch_q12/duckdb:duckdb 93447874 8.51917e+07 1.09691 ns
tpch_q13/duckdb:duckdb 261262329 2.38974e+08 1.09327 ns
tpch_q14/duckdb:duckdb 84301833 7.74629e+07 1.08829 ns
tpch_q15/duckdb:duckdb 86489593 8.31109e+07 1.04065 ns
tpch_q16/duckdb:duckdb 82208763 7.37106e+07 1.11529 ns 🚨
tpch_q17/duckdb:duckdb 105477616 9.98313e+07 1.05656 ns
tpch_q18/duckdb:duckdb 239230881 2.19391e+08 1.09043 ns
tpch_q19/duckdb:duckdb 135567624 1.27602e+08 1.06243 ns
tpch_q20/duckdb:duckdb 132355502 1.2332e+08 1.07327 ns
tpch_q21/duckdb:duckdb 356461009 3.28639e+08 1.08466 ns
tpch_q22/duckdb:duckdb 72079349 7.04301e+07 1.02342 ns

@github-actions
Copy link
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=10 on S3 failed! Check the workflow run for details.

@github-actions
Copy link
Contributor

Benchmarks: Statistical and Population Genetics

Summary

  • Overall: 1.065x ➖
  • Vortex: 1.071x ➖
  • duckdb:vortex: 1.071x ➖
  • Best: No improvements
  • Worst: statpopgen_q00/duckdb:vortex-file-compressed (1.159x)
  • Significant (>10%): 0↑ 3↓
Detailed Results Table
name PR caa4063 base ee29169 ratio (PR/base) unit remark
statpopgen_q00/duckdb:parquet 239413261 2.33574e+08 1.025 ns
statpopgen_q01/duckdb:parquet 391024151 3.7313e+08 1.04796 ns
statpopgen_q02/duckdb:parquet 740764838 6.84612e+08 1.08202 ns
statpopgen_q03/duckdb:parquet 1203651460 1.14768e+09 1.04877 ns
statpopgen_q04/duckdb:parquet 1197566750 1.14771e+09 1.04344 ns
statpopgen_q05/duckdb:parquet 795662376 7.48998e+08 1.0623 ns
statpopgen_q06/duckdb:parquet 1429525679 1.33219e+09 1.07307 ns
statpopgen_q07/duckdb:parquet 895833364 8.59021e+08 1.04285 ns
statpopgen_q08/duckdb:parquet 898904778 8.75156e+08 1.02714 ns
statpopgen_q09/duckdb:parquet 1002523356 9.42935e+08 1.06319 ns
statpopgen_q10/duckdb:parquet 2338081736 2.17618e+09 1.0744 ns
statpopgen_q00/duckdb:vortex-file-compressed 12294127 1.06096e+07 1.15878 ns 🚨
statpopgen_q01/duckdb:vortex-file-compressed 105679716 9.47929e+07 1.11485 ns 🚨
statpopgen_q02/duckdb:vortex-file-compressed 1235597876 1.20464e+09 1.02569 ns
statpopgen_q03/duckdb:vortex-file-compressed 2970665990 2.79372e+09 1.06334 ns
statpopgen_q04/duckdb:vortex-file-compressed 2973936979 2.78803e+09 1.06668 ns
statpopgen_q05/duckdb:vortex-file-compressed 1320397701 1.26167e+09 1.04654 ns
statpopgen_q06/duckdb:vortex-file-compressed 1999083635 1.91783e+09 1.04237 ns
statpopgen_q07/duckdb:vortex-file-compressed 211453552 1.94356e+08 1.08797 ns
statpopgen_q08/duckdb:vortex-file-compressed 224818505 2.10263e+08 1.06923 ns
statpopgen_q09/duckdb:vortex-file-compressed 2710835325 2.54977e+09 1.06317 ns
statpopgen_q10/duckdb:vortex-file-compressed 4412807764 4.06399e+09 1.08583 ns
statpopgen_q00/duckdb:vortex-compact 12012667 1.05125e+07 1.1427 ns 🚨
statpopgen_q01/duckdb:vortex-compact 113642370 1.07625e+08 1.05591 ns
statpopgen_q02/duckdb:vortex-compact 1694106274 1.58346e+09 1.06988 ns
statpopgen_q03/duckdb:vortex-compact 3450135219 3.21224e+09 1.07406 ns
statpopgen_q04/duckdb:vortex-compact 3457546227 3.21979e+09 1.07384 ns
statpopgen_q05/duckdb:vortex-compact 1705632583 1.60552e+09 1.06236 ns
statpopgen_q06/duckdb:vortex-compact 2623108148 2.48904e+09 1.05386 ns
statpopgen_q07/duckdb:vortex-compact 995296080 9.63702e+08 1.03278 ns
statpopgen_q08/duckdb:vortex-compact 1042838648 1.00553e+09 1.0371 ns
statpopgen_q09/duckdb:vortex-compact 3188895532 2.9881e+09 1.0672 ns
statpopgen_q10/duckdb:vortex-compact 5053672345 4.72271e+09 1.07008 ns

@github-actions
Copy link
Contributor

Benchmarks: Random Access

Summary

  • Overall: 0.987x ➖
  • Vortex: 0.919x ➖
  • Best: random-access/vortex-tokio-local-disk (0.771x)
  • Worst: random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer (1.085x)
  • Significant (>10%): 8↑ 0↓
Detailed Results Table
name PR caa4063 base ee29169 ratio (PR/base) unit remark
random-access/parquet-tokio-local-disk 185510352 1.88355e+08 0.9849 ns
random-access/parquet-tokio-local-disk-footer 183839005 1.88223e+08 0.976707 ns
random-access/taxi/correlated/parquet-tokio-local-disk 271969598 2.7815e+08 0.977781 ns
random-access/taxi/correlated/parquet-tokio-local-disk-footer 272180606 2.78608e+08 0.97693 ns
random-access/taxi/uniform/parquet-tokio-local-disk 287961833 2.94305e+08 0.978447 ns
random-access/taxi/uniform/parquet-tokio-local-disk-footer 289857610 2.95404e+08 0.981224 ns
random-access/vortex-tokio-local-disk 1442566 1.87059e+06 0.771182 ns 🚀
random-access/vortex-tokio-local-disk-footer 1464722 1.81076e+06 0.808901 ns 🚀
random-access/taxi/correlated/vortex-tokio-local-disk 2161673 2.55479e+06 0.846127 ns 🚀
random-access/taxi/correlated/vortex-tokio-local-disk-footer 2174844 2.5832e+06 0.841919 ns 🚀
random-access/taxi/uniform/vortex-tokio-local-disk 4766270 5.53274e+06 0.861466 ns 🚀
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4878465 5.61547e+06 0.868755 ns 🚀
random-access/lance-tokio-local-disk 766155 741546 1.03319 ns
random-access/lance-tokio-local-disk-footer 1399028 1.35217e+06 1.03466 ns
random-access/taxi/correlated/lance-tokio-local-disk 991646 975290 1.01677 ns
random-access/taxi/correlated/lance-tokio-local-disk-footer 1670300 1.65766e+06 1.00762 ns
random-access/taxi/uniform/lance-tokio-local-disk 8586795 8.40469e+06 1.02167 ns
random-access/taxi/uniform/lance-tokio-local-disk-footer 10220524 9.09951e+06 1.12319 ns 🚨
random-access/feature-vectors/correlated/parquet-tokio-local-disk 14079734583 1.40852e+10 0.99961 ns
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 13582639460 1.37136e+10 0.990447 ns
random-access/feature-vectors/uniform/parquet-tokio-local-disk 13468799109 1.37406e+10 0.980223 ns
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 13484147421 1.35324e+10 0.996432 ns
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7796194 8.19537e+06 0.951292 ns
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6432280 5.92944e+06 1.0848 ns
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13963585 1.46462e+07 0.953392 ns
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12810613 1.43869e+07 0.890439 ns 🚀
random-access/feature-vectors/correlated/lance-tokio-local-disk 2779744 2.67216e+06 1.04026 ns
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1361203 1.27576e+06 1.06697 ns
random-access/feature-vectors/uniform/lance-tokio-local-disk 1535516 1.4616e+06 1.05057 ns
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2459449 2.34334e+06 1.04955 ns
random-access/nested-lists/correlated/parquet-tokio-local-disk 161052349 1.60702e+08 1.00218 ns
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 158438498 1.60692e+08 0.985973 ns
random-access/nested-lists/uniform/parquet-tokio-local-disk 158932486 1.60903e+08 0.987753 ns
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 159304439 1.60965e+08 0.989681 ns
random-access/nested-lists/correlated/vortex-tokio-local-disk 830616 892464 0.9307 ns
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 807138 917168 0.880033 ns 🚀
random-access/nested-lists/uniform/vortex-tokio-local-disk 2398544 2.52384e+06 0.950353 ns
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2492245 2.63749e+06 0.944931 ns
random-access/nested-lists/correlated/lance-tokio-local-disk 278063 272307 1.02114 ns
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 753924 713656 1.05642 ns
random-access/nested-lists/uniform/lance-tokio-local-disk 1181456 1.16547e+06 1.01372 ns
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1657005 1.65263e+06 1.00265 ns
random-access/nested-structs/correlated/parquet-tokio-local-disk 26351089 2.54139e+07 1.03688 ns
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 30805702 2.51956e+07 1.22266 ns 🚨
random-access/nested-structs/uniform/parquet-tokio-local-disk 30954421 2.51847e+07 1.22909 ns 🚨
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 26467240 2.52181e+07 1.04953 ns
random-access/nested-structs/correlated/vortex-tokio-local-disk 898479 874960 1.02688 ns
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 976032 936225 1.04252 ns
random-access/nested-structs/uniform/vortex-tokio-local-disk 1878494 1.90622e+06 0.985454 ns
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1861188 1.92465e+06 0.967025 ns
random-access/nested-structs/correlated/lance-tokio-local-disk 434663 435619 0.997805 ns
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 643380 641701 1.00262 ns
random-access/nested-structs/uniform/lance-tokio-local-disk 2791444 2.82003e+06 0.989864 ns
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3063232 3.05794e+06 1.00173 ns

@github-actions
Copy link
Contributor

Benchmarks: Clickbench on NVME

Summary

  • Overall: 0.994x ➖
  • Vortex: 0.989x ➖
  • duckdb:vortex: 0.986x ➖
  • datafusion:vortex: 0.993x ➖
  • Best: clickbench_q37/duckdb:vortex-compact (0.777x)
  • Worst: clickbench_q23/duckdb:vortex-compact (1.236x)
  • Significant (>10%): 10↑ 5↓
Detailed Results Table
name PR caa4063 base ee29169 ratio (PR/base) unit remark
clickbench_q00/datafusion:parquet 1747019 1.75374e+06 0.996168 ns
clickbench_q01/datafusion:parquet 20228676 2.13344e+07 0.948172 ns
clickbench_q02/datafusion:parquet 52742459 5.34677e+07 0.986435 ns
clickbench_q03/datafusion:parquet 42817568 4.54465e+07 0.942153 ns
clickbench_q04/datafusion:parquet 354429609 3.6747e+08 0.964513 ns
clickbench_q05/datafusion:parquet 354244321 3.51201e+08 1.00866 ns
clickbench_q06/datafusion:parquet 1571395 1.56724e+06 1.00265 ns
clickbench_q07/datafusion:parquet 26807146 2.51061e+07 1.06775 ns
clickbench_q08/datafusion:parquet 435685899 4.53041e+08 0.961692 ns
clickbench_q09/datafusion:parquet 670802501 6.94589e+08 0.965754 ns
clickbench_q10/datafusion:parquet 118547479 1.20328e+08 0.985204 ns
clickbench_q11/datafusion:parquet 143019266 1.43439e+08 0.997072 ns
clickbench_q12/datafusion:parquet 352798917 3.63822e+08 0.969702 ns
clickbench_q13/datafusion:parquet 510822319 5.20363e+08 0.981665 ns
clickbench_q14/datafusion:parquet 352251023 3.55291e+08 0.991445 ns
clickbench_q15/datafusion:parquet 412683053 4.26281e+08 0.968101 ns
clickbench_q16/datafusion:parquet 731186999 7.52798e+08 0.971292 ns
clickbench_q17/datafusion:parquet 724853475 7.24655e+08 1.00027 ns
clickbench_q18/datafusion:parquet 1417723227 1.43789e+09 0.985973 ns
clickbench_q19/datafusion:parquet 34987146 3.51401e+07 0.995647 ns
clickbench_q20/datafusion:parquet 562612017 5.58574e+08 1.00723 ns
clickbench_q21/datafusion:parquet 649728580 6.40433e+08 1.01451 ns
clickbench_q22/datafusion:parquet 963287746 9.56214e+08 1.0074 ns
clickbench_q23/datafusion:parquet 3805594571 3.75602e+09 1.0132 ns
clickbench_q24/datafusion:parquet 99718334 1.03927e+08 0.959506 ns
clickbench_q25/datafusion:parquet 143110903 1.42335e+08 1.00545 ns
clickbench_q26/datafusion:parquet 106645431 1.02575e+08 1.03968 ns
clickbench_q27/datafusion:parquet 975568694 9.8109e+08 0.994373 ns
clickbench_q28/datafusion:parquet 5795805719 5.77939e+09 1.00284 ns
clickbench_q29/datafusion:parquet 217033422 2.23106e+08 0.97278 ns
clickbench_q30/datafusion:parquet 352100023 3.53274e+08 0.996676 ns
clickbench_q31/datafusion:parquet 406831254 4.04862e+08 1.00486 ns
clickbench_q32/datafusion:parquet 1319864719 1.36126e+09 0.969593 ns
clickbench_q33/datafusion:parquet 1516334367 1.55498e+09 0.97515 ns
clickbench_q34/datafusion:parquet 1509279765 1.55638e+09 0.969736 ns
clickbench_q35/datafusion:parquet 580750788 5.73588e+08 1.01249 ns
clickbench_q36/datafusion:parquet 151312035 1.44906e+08 1.04421 ns
clickbench_q37/datafusion:parquet 58982380 5.86972e+07 1.00486 ns
clickbench_q38/datafusion:parquet 95691255 9.06535e+07 1.05557 ns
clickbench_q39/datafusion:parquet 286277198 2.74264e+08 1.0438 ns
clickbench_q40/datafusion:parquet 34519843 3.43876e+07 1.00385 ns
clickbench_q41/datafusion:parquet 32968645 3.14509e+07 1.04826 ns
clickbench_q42/datafusion:parquet 34289457 3.17944e+07 1.07847 ns
clickbench_q00/datafusion:vortex-file-compressed 1698891 1.72051e+06 0.987436 ns
clickbench_q01/datafusion:vortex-file-compressed 13237417 1.46317e+07 0.904708 ns
clickbench_q02/datafusion:vortex-file-compressed 31719175 3.33444e+07 0.951261 ns
clickbench_q03/datafusion:vortex-file-compressed 38079530 3.6845e+07 1.03351 ns
clickbench_q04/datafusion:vortex-file-compressed 317673874 3.22987e+08 0.983549 ns
clickbench_q05/datafusion:vortex-file-compressed 315502883 3.16134e+08 0.998003 ns
clickbench_q06/datafusion:vortex-file-compressed 1622440 1.63045e+06 0.995085 ns
clickbench_q07/datafusion:vortex-file-compressed 18247796 1.86107e+07 0.9805 ns
clickbench_q08/datafusion:vortex-file-compressed 392515704 3.86021e+08 1.01683 ns
clickbench_q09/datafusion:vortex-file-compressed 569898157 5.75122e+08 0.990917 ns
clickbench_q10/datafusion:vortex-file-compressed 71105035 7.40105e+07 0.960742 ns
clickbench_q11/datafusion:vortex-file-compressed 78464215 7.98653e+07 0.982457 ns
clickbench_q12/datafusion:vortex-file-compressed 272102481 2.75798e+08 0.986602 ns
clickbench_q13/datafusion:vortex-file-compressed 416817850 4.15822e+08 1.00239 ns
clickbench_q14/datafusion:vortex-file-compressed 252511669 2.49552e+08 1.01186 ns
clickbench_q15/datafusion:vortex-file-compressed 378273621 3.81229e+08 0.992248 ns
clickbench_q16/datafusion:vortex-file-compressed 726495060 7.25509e+08 1.00136 ns
clickbench_q17/datafusion:vortex-file-compressed 714412912 7.17561e+08 0.995612 ns
clickbench_q18/datafusion:vortex-file-compressed 1360659197 1.38379e+09 0.983287 ns
clickbench_q19/datafusion:vortex-file-compressed 24972896 2.76315e+07 0.903783 ns
clickbench_q20/datafusion:vortex-file-compressed 350764071 3.43892e+08 1.01998 ns
clickbench_q21/datafusion:vortex-file-compressed 411765195 3.98341e+08 1.0337 ns
clickbench_q22/datafusion:vortex-file-compressed 558652843 5.62602e+08 0.992981 ns
clickbench_q23/datafusion:vortex-file-compressed 580658474 5.85127e+08 0.992363 ns
clickbench_q24/datafusion:vortex-file-compressed 48226373 4.88832e+07 0.986563 ns
clickbench_q25/datafusion:vortex-file-compressed 72028213 6.71042e+07 1.07338 ns
clickbench_q26/datafusion:vortex-file-compressed 46796560 4.81434e+07 0.972024 ns
clickbench_q27/datafusion:vortex-file-compressed 801241288 7.90036e+08 1.01418 ns
clickbench_q28/datafusion:vortex-file-compressed 6744531734 6.64284e+09 1.01531 ns
clickbench_q29/datafusion:vortex-file-compressed 236883907 2.41072e+08 0.982626 ns
clickbench_q30/datafusion:vortex-file-compressed 255583781 2.55297e+08 1.00112 ns
clickbench_q31/datafusion:vortex-file-compressed 296087004 2.9781e+08 0.994215 ns
clickbench_q32/datafusion:vortex-file-compressed 1476849685 1.3192e+09 1.11951 ns 🚨
clickbench_q33/datafusion:vortex-file-compressed 1411825298 1.46713e+09 0.962306 ns
clickbench_q34/datafusion:vortex-file-compressed 1406782203 1.47288e+09 0.955125 ns
clickbench_q35/datafusion:vortex-file-compressed 520272287 5.34224e+08 0.973885 ns
clickbench_q36/datafusion:vortex-file-compressed 82397706 8.06299e+07 1.02193 ns
clickbench_q37/datafusion:vortex-file-compressed 39565939 3.87248e+07 1.02172 ns
clickbench_q38/datafusion:vortex-file-compressed 23662647 2.43963e+07 0.969929 ns
clickbench_q39/datafusion:vortex-file-compressed 153790802 1.57743e+08 0.974944 ns
clickbench_q40/datafusion:vortex-file-compressed 21310947 2.2027e+07 0.967492 ns
clickbench_q41/datafusion:vortex-file-compressed 18970373 1.85206e+07 1.02428 ns
clickbench_q42/datafusion:vortex-file-compressed 22762302 2.20859e+07 1.03062 ns
clickbench_q00/datafusion:vortex-compact 1674819 1.72426e+06 0.971329 ns
clickbench_q01/datafusion:vortex-compact 16696020 1.77345e+07 0.941441 ns
clickbench_q02/datafusion:vortex-compact 42192868 4.25064e+07 0.992624 ns
clickbench_q03/datafusion:vortex-compact 41926346 4.067e+07 1.03089 ns
clickbench_q04/datafusion:vortex-compact 339972054 3.46086e+08 0.982334 ns
clickbench_q05/datafusion:vortex-compact 335807293 3.36469e+08 0.998034 ns
clickbench_q06/datafusion:vortex-compact 1740302 1.70686e+06 1.01959 ns
clickbench_q07/datafusion:vortex-compact 29775631 2.96308e+07 1.00489 ns
clickbench_q08/datafusion:vortex-compact 420398852 4.22599e+08 0.994795 ns
clickbench_q09/datafusion:vortex-compact 650079051 6.41863e+08 1.0128 ns
clickbench_q10/datafusion:vortex-compact 133660234 1.37375e+08 0.972961 ns
clickbench_q11/datafusion:vortex-compact 176173157 1.78313e+08 0.987997 ns
clickbench_q12/datafusion:vortex-compact 295296645 2.96866e+08 0.994714 ns
clickbench_q13/datafusion:vortex-compact 529230246 5.28658e+08 1.00108 ns
clickbench_q14/datafusion:vortex-compact 306036352 3.08917e+08 0.990675 ns
clickbench_q15/datafusion:vortex-compact 401665220 4.04381e+08 0.993283 ns
clickbench_q16/datafusion:vortex-compact 799753812 8.14025e+08 0.982469 ns
clickbench_q17/datafusion:vortex-compact 793650129 7.95772e+08 0.997334 ns
clickbench_q18/datafusion:vortex-compact 1472171470 1.48332e+09 0.992482 ns
clickbench_q19/datafusion:vortex-compact 31813740 3.10684e+07 1.02399 ns
clickbench_q20/datafusion:vortex-compact 418140996 4.3014e+08 0.972105 ns
clickbench_q21/datafusion:vortex-compact 600502834 6.08201e+08 0.987343 ns
clickbench_q22/datafusion:vortex-compact 1010926045 9.96615e+08 1.01436 ns
clickbench_q23/datafusion:vortex-compact 3001479348 2.92225e+09 1.02711 ns
clickbench_q24/datafusion:vortex-compact 93376813 9.14813e+07 1.02072 ns
clickbench_q25/datafusion:vortex-compact 114223983 1.15251e+08 0.991085 ns
clickbench_q26/datafusion:vortex-compact 95806887 9.31788e+07 1.02821 ns
clickbench_q27/datafusion:vortex-compact 884134169 8.98217e+08 0.984322 ns
clickbench_q28/datafusion:vortex-compact 5938346939 5.9894e+09 0.991477 ns
clickbench_q29/datafusion:vortex-compact 218328054 2.20063e+08 0.992115 ns
clickbench_q30/datafusion:vortex-compact 392871260 3.90782e+08 1.00535 ns
clickbench_q31/datafusion:vortex-compact 465213737 4.69964e+08 0.989893 ns
clickbench_q32/datafusion:vortex-compact 1307528488 1.3654e+09 0.957616 ns
clickbench_q33/datafusion:vortex-compact 1486277006 1.53183e+09 0.970261 ns
clickbench_q34/datafusion:vortex-compact 1486886001 1.51494e+09 0.981484 ns
clickbench_q35/datafusion:vortex-compact 569292003 5.7146e+08 0.996206 ns
clickbench_q36/datafusion:vortex-compact 87624364 9.05254e+07 0.967954 ns
clickbench_q37/datafusion:vortex-compact 41703739 4.20652e+07 0.991406 ns
clickbench_q38/datafusion:vortex-compact 32693889 3.33487e+07 0.980364 ns
clickbench_q39/datafusion:vortex-compact 167869453 1.74301e+08 0.963099 ns
clickbench_q40/datafusion:vortex-compact 25091903 2.58558e+07 0.970454 ns
clickbench_q41/datafusion:vortex-compact 26545295 2.62017e+07 1.01311 ns
clickbench_q42/datafusion:vortex-compact 22773017 2.3692e+07 0.961213 ns
clickbench_q00/duckdb:parquet 129089974 1.28484e+08 1.00471 ns
clickbench_q01/duckdb:parquet 51746232 5.24413e+07 0.986745 ns
clickbench_q02/duckdb:parquet 65222439 6.60776e+07 0.987059 ns
clickbench_q03/duckdb:parquet 63333396 6.40517e+07 0.988786 ns
clickbench_q04/duckdb:parquet 202976312 2.04929e+08 0.990471 ns
clickbench_q05/duckdb:parquet 273613393 2.78071e+08 0.98397 ns
clickbench_q06/duckdb:parquet 62287824 6.17122e+07 1.00933 ns
clickbench_q07/duckdb:parquet 56337414 5.66921e+07 0.993744 ns
clickbench_q08/duckdb:parquet 267832282 2.67019e+08 1.00305 ns
clickbench_q09/duckdb:parquet 392659581 3.94006e+08 0.996584 ns
clickbench_q10/duckdb:parquet 96109981 9.63462e+07 0.997548 ns
clickbench_q11/duckdb:parquet 107795818 1.06518e+08 1.012 ns
clickbench_q12/duckdb:parquet 287510985 2.88827e+08 0.995443 ns
clickbench_q13/duckdb:parquet 470299791 4.77277e+08 0.985382 ns
clickbench_q14/duckdb:parquet 322210009 3.22909e+08 0.997836 ns
clickbench_q15/duckdb:parquet 241027941 2.43271e+08 0.990779 ns
clickbench_q16/duckdb:parquet 573030729 5.72292e+08 1.00129 ns
clickbench_q17/duckdb:parquet 481380081 4.77386e+08 1.00837 ns
clickbench_q18/duckdb:parquet 985706146 9.9102e+08 0.994638 ns
clickbench_q19/duckdb:parquet 49619989 4.89452e+07 1.01379 ns
clickbench_q20/duckdb:parquet 408625643 4.06815e+08 1.00445 ns
clickbench_q21/duckdb:parquet 527219393 5.31053e+08 0.992782 ns
clickbench_q22/duckdb:parquet 916079150 9.14949e+08 1.00124 ns
clickbench_q23/duckdb:parquet 275403852 2.77318e+08 0.993098 ns
clickbench_q24/duckdb:parquet 77280593 7.92652e+07 0.974963 ns
clickbench_q25/duckdb:parquet 141814097 1.42185e+08 0.997391 ns
clickbench_q26/duckdb:parquet 54276460 5.44071e+07 0.9976 ns
clickbench_q27/duckdb:parquet 615318701 6.19595e+08 0.993099 ns
clickbench_q28/duckdb:parquet 4855659088 4.92713e+09 0.985495 ns
clickbench_q29/duckdb:parquet 63835083 6.40374e+07 0.996841 ns
clickbench_q30/duckdb:parquet 308007845 3.10692e+08 0.991362 ns
clickbench_q31/duckdb:parquet 346577299 3.53545e+08 0.980291 ns
clickbench_q32/duckdb:parquet 1049930867 1.06435e+09 0.986456 ns
clickbench_q33/duckdb:parquet 1066098047 1.06653e+09 0.999594 ns
clickbench_q34/duckdb:parquet 1111211006 1.11848e+09 0.993501 ns
clickbench_q35/duckdb:parquet 349760161 3.50989e+08 0.996498 ns
clickbench_q36/duckdb:parquet 63210270 6.20745e+07 1.0183 ns
clickbench_q37/duckdb:parquet 49912232 4.82829e+07 1.03374 ns
clickbench_q38/duckdb:parquet 53113852 5.23829e+07 1.01395 ns
clickbench_q39/duckdb:parquet 94106651 9.39467e+07 1.0017 ns
clickbench_q40/duckdb:parquet 54994089 5.43816e+07 1.01126 ns
clickbench_q41/duckdb:parquet 56683169 5.65672e+07 1.00205 ns
clickbench_q42/duckdb:parquet 45194137 4.34857e+07 1.03929 ns
clickbench_q00/duckdb:vortex-file-compressed 4830566 5.07744e+06 0.951378 ns
clickbench_q01/duckdb:vortex-file-compressed 14064610 1.329e+07 1.05828 ns
clickbench_q02/duckdb:vortex-file-compressed 23766511 2.34271e+07 1.01449 ns
clickbench_q03/duckdb:vortex-file-compressed 31792845 2.86604e+07 1.1093 ns 🚨
clickbench_q04/duckdb:vortex-file-compressed 168781950 1.70624e+08 0.989206 ns
clickbench_q05/duckdb:vortex-file-compressed 190065394 1.92224e+08 0.98877 ns
clickbench_q06/duckdb:vortex-file-compressed 19966897 2.02339e+07 0.986806 ns
clickbench_q07/duckdb:vortex-file-compressed 19096265 1.7031e+07 1.12127 ns 🚨
clickbench_q08/duckdb:vortex-file-compressed 259447381 2.59588e+08 0.999457 ns
clickbench_q09/duckdb:vortex-file-compressed 372103327 3.68374e+08 1.01012 ns
clickbench_q10/duckdb:vortex-file-compressed 73251702 7.35388e+07 0.996096 ns
clickbench_q11/duckdb:vortex-file-compressed 80989706 8.18949e+07 0.988947 ns
clickbench_q12/duckdb:vortex-file-compressed 198518865 2.001e+08 0.992099 ns
clickbench_q13/duckdb:vortex-file-compressed 469615822 4.6952e+08 1.0002 ns
clickbench_q14/duckdb:vortex-file-compressed 286857478 2.86596e+08 1.00091 ns
clickbench_q15/duckdb:vortex-file-compressed 213169893 2.101e+08 1.01461 ns
clickbench_q16/duckdb:vortex-file-compressed 927015567 1.04807e+09 0.884496 ns 🚀
clickbench_q17/duckdb:vortex-file-compressed 850868502 8.39746e+08 1.01324 ns
clickbench_q18/duckdb:vortex-file-compressed 1407532564 1.39601e+09 1.00825 ns
clickbench_q19/duckdb:vortex-file-compressed 21581800 2.28118e+07 0.94608 ns
clickbench_q20/duckdb:vortex-file-compressed 352260177 3.58659e+08 0.98216 ns
clickbench_q21/duckdb:vortex-file-compressed 378746956 4.02096e+08 0.941931 ns
clickbench_q22/duckdb:vortex-file-compressed 673061904 7.16657e+08 0.939169 ns
clickbench_q23/duckdb:vortex-file-compressed 1300515277 1.22582e+09 1.06093 ns
clickbench_q24/duckdb:vortex-file-compressed 48974026 5.73365e+07 0.854151 ns 🚀
clickbench_q25/duckdb:vortex-file-compressed 73427987 7.09565e+07 1.03483 ns
clickbench_q26/duckdb:vortex-file-compressed 44563215 4.53973e+07 0.981627 ns
clickbench_q27/duckdb:vortex-file-compressed 516490260 5.32493e+08 0.969947 ns
clickbench_q28/duckdb:vortex-file-compressed 3094131214 3.03228e+09 1.0204 ns
clickbench_q29/duckdb:vortex-file-compressed 29430598 2.91479e+07 1.0097 ns
clickbench_q30/duckdb:vortex-file-compressed 192375400 1.91507e+08 1.00453 ns
clickbench_q31/duckdb:vortex-file-compressed 261956964 2.69896e+08 0.970585 ns
clickbench_q32/duckdb:vortex-file-compressed 1052103967 1.05565e+09 0.99664 ns
clickbench_q33/duckdb:vortex-file-compressed 1040238048 1.09968e+09 0.94595 ns
clickbench_q34/duckdb:vortex-file-compressed 1500627760 1.53274e+09 0.979048 ns
clickbench_q35/duckdb:vortex-file-compressed 359079231 3.57456e+08 1.00454 ns
clickbench_q36/duckdb:vortex-file-compressed 31931273 3.21054e+07 0.994578 ns
clickbench_q37/duckdb:vortex-file-compressed 22507539 2.47595e+07 0.909046 ns
clickbench_q38/duckdb:vortex-file-compressed 23463439 2.44166e+07 0.960962 ns
clickbench_q39/duckdb:vortex-file-compressed 48849460 5.01291e+07 0.974474 ns
clickbench_q40/duckdb:vortex-file-compressed 23896731 2.25896e+07 1.05786 ns
clickbench_q41/duckdb:vortex-file-compressed 21770238 2.21929e+07 0.980954 ns
clickbench_q42/duckdb:vortex-file-compressed 24800069 2.75648e+07 0.899699 ns 🚀
clickbench_q00/duckdb:vortex-compact 4985946 5.75742e+06 0.866004 ns 🚀
clickbench_q01/duckdb:vortex-compact 17140853 1.54226e+07 1.11141 ns 🚨
clickbench_q02/duckdb:vortex-compact 36070717 3.66589e+07 0.983954 ns
clickbench_q03/duckdb:vortex-compact 38787508 3.88495e+07 0.998404 ns
clickbench_q04/duckdb:vortex-compact 193458684 1.9447e+08 0.9948 ns
clickbench_q05/duckdb:vortex-compact 222614792 2.2415e+08 0.993153 ns
clickbench_q06/duckdb:vortex-compact 19599275 1.96807e+07 0.995861 ns
clickbench_q07/duckdb:vortex-compact 22092905 2.01186e+07 1.09814 ns
clickbench_q08/duckdb:vortex-compact 299343071 2.98206e+08 1.00381 ns
clickbench_q09/duckdb:vortex-compact 457269818 4.55457e+08 1.00398 ns
clickbench_q10/duckdb:vortex-compact 127982955 1.27117e+08 1.00681 ns
clickbench_q11/duckdb:vortex-compact 164475576 1.63466e+08 1.00618 ns
clickbench_q12/duckdb:vortex-compact 242000203 2.42794e+08 0.99673 ns
clickbench_q13/duckdb:vortex-compact 583521545 5.85766e+08 0.996168 ns
clickbench_q14/duckdb:vortex-compact 354350883 3.54851e+08 0.998591 ns
clickbench_q15/duckdb:vortex-compact 233154521 2.31791e+08 1.00588 ns
clickbench_q16/duckdb:vortex-compact 1071343761 1.03783e+09 1.0323 ns
clickbench_q17/duckdb:vortex-compact 932923453 9.34199e+08 0.998634 ns
clickbench_q18/duckdb:vortex-compact 1514399335 1.50419e+09 1.00679 ns
clickbench_q19/duckdb:vortex-compact 27611891 2.68348e+07 1.02896 ns
clickbench_q20/duckdb:vortex-compact 426091431 4.8217e+08 0.883696 ns 🚀
clickbench_q21/duckdb:vortex-compact 577301649 6.57639e+08 0.87784 ns 🚀
clickbench_q22/duckdb:vortex-compact 1171513641 1.20902e+09 0.968974 ns
clickbench_q23/duckdb:vortex-compact 6124859737 4.95346e+09 1.23648 ns 🚨
clickbench_q24/duckdb:vortex-compact 81252529 8.02991e+07 1.01187 ns
clickbench_q25/duckdb:vortex-compact 122681568 1.21784e+08 1.00737 ns
clickbench_q26/duckdb:vortex-compact 82293036 8.45369e+07 0.973457 ns
clickbench_q27/duckdb:vortex-compact 566305558 5.98881e+08 0.945606 ns
clickbench_q28/duckdb:vortex-compact 3179355990 3.16925e+09 1.00319 ns
clickbench_q29/duckdb:vortex-compact 35353476 3.50555e+07 1.0085 ns
clickbench_q30/duckdb:vortex-compact 339290790 3.37749e+08 1.00457 ns
clickbench_q31/duckdb:vortex-compact 439926772 4.4342e+08 0.992122 ns
clickbench_q32/duckdb:vortex-compact 1121066593 1.14291e+09 0.98089 ns
clickbench_q33/duckdb:vortex-compact 1093723073 1.13929e+09 0.960005 ns
clickbench_q34/duckdb:vortex-compact 1567259993 1.61052e+09 0.973138 ns
clickbench_q35/duckdb:vortex-compact 369869264 3.6811e+08 1.00478 ns
clickbench_q36/duckdb:vortex-compact 32099783 3.67692e+07 0.873008 ns 🚀
clickbench_q37/duckdb:vortex-compact 23588920 3.03758e+07 0.77657 ns 🚀
clickbench_q38/duckdb:vortex-compact 27331271 3.21718e+07 0.84954 ns 🚀
clickbench_q39/duckdb:vortex-compact 57061077 6.44284e+07 0.885651 ns 🚀
clickbench_q40/duckdb:vortex-compact 28239021 2.73322e+07 1.03318 ns
clickbench_q41/duckdb:vortex-compact 25021913 2.65835e+07 0.941257 ns
clickbench_q42/duckdb:vortex-compact 26991556 2.48574e+07 1.08586 ns
clickbench_q00/duckdb:duckdb 19037436 1.86694e+07 1.01971 ns
clickbench_q01/duckdb:duckdb 38360841 3.82845e+07 1.00199 ns
clickbench_q02/duckdb:duckdb 47199530 4.70719e+07 1.00271 ns
clickbench_q03/duckdb:duckdb 48055653 4.79348e+07 1.00252 ns
clickbench_q04/duckdb:duckdb 202714954 1.87517e+08 1.08105 ns
clickbench_q05/duckdb:duckdb 320261553 2.97096e+08 1.07797 ns
clickbench_q06/duckdb:duckdb 37124046 3.68587e+07 1.0072 ns
clickbench_q07/duckdb:duckdb 39164999 3.85729e+07 1.01535 ns
clickbench_q08/duckdb:duckdb 263711717 2.49197e+08 1.05824 ns
clickbench_q09/duckdb:duckdb 365142152 3.63586e+08 1.00428 ns
clickbench_q10/duckdb:duckdb 112365463 1.11099e+08 1.0114 ns
clickbench_q11/duckdb:duckdb 121730778 1.2123e+08 1.00413 ns
clickbench_q12/duckdb:duckdb 269652312 2.66026e+08 1.01363 ns
clickbench_q13/duckdb:duckdb 449936197 4.47381e+08 1.00571 ns
clickbench_q14/duckdb:duckdb 293359925 2.89461e+08 1.01347 ns
clickbench_q15/duckdb:duckdb 220802756 2.20537e+08 1.0012 ns
clickbench_q16/duckdb:duckdb 546441372 5.4616e+08 1.00052 ns
clickbench_q17/duckdb:duckdb 462004768 4.5951e+08 1.00543 ns
clickbench_q18/duckdb:duckdb 963942400 9.60697e+08 1.00338 ns
clickbench_q19/duckdb:duckdb 37450484 3.70498e+07 1.01082 ns
clickbench_q20/duckdb:duckdb 450017042 4.49858e+08 1.00035 ns
clickbench_q21/duckdb:duckdb 473961395 4.75772e+08 0.996194 ns
clickbench_q22/duckdb:duckdb 528683596 5.34008e+08 0.990029 ns
clickbench_q23/duckdb:duckdb 245256978 2.41447e+08 1.01578 ns
clickbench_q24/duckdb:duckdb 49212499 4.97516e+07 0.989164 ns
clickbench_q25/duckdb:duckdb 111978017 1.10554e+08 1.01288 ns
clickbench_q26/duckdb:duckdb 47344669 4.73382e+07 1.00014 ns
clickbench_q27/duckdb:duckdb 527295406 5.32516e+08 0.990197 ns
clickbench_q28/duckdb:duckdb 4522285611 4.57779e+09 0.987874 ns
clickbench_q29/duckdb:duckdb 50048798 4.99905e+07 1.00117 ns
clickbench_q30/duckdb:duckdb 270944370 2.68826e+08 1.00788 ns
clickbench_q31/duckdb:duckdb 340773541 3.45755e+08 0.985593 ns
clickbench_q32/duckdb:duckdb 1044286954 1.04928e+09 0.995239 ns
clickbench_q33/duckdb:duckdb 1071147774 1.0744e+09 0.996968 ns
clickbench_q34/duckdb:duckdb 1150000889 1.1396e+09 1.00913 ns
clickbench_q35/duckdb:duckdb 267756662 2.66603e+08 1.00433 ns
clickbench_q36/duckdb:duckdb 44596203 4.20957e+07 1.0594 ns
clickbench_q37/duckdb:duckdb 33450402 3.33993e+07 1.00153 ns
clickbench_q38/duckdb:duckdb 34499578 3.4217e+07 1.00826 ns
clickbench_q39/duckdb:duckdb 71478261 7.89891e+07 0.904913 ns
clickbench_q40/duckdb:duckdb 33554347 3.40439e+07 0.985619 ns
clickbench_q41/duckdb:duckdb 34528647 3.35774e+07 1.02833 ns
clickbench_q42/duckdb:duckdb 33668171 3.35733e+07 1.00283 ns

@github-actions
Copy link
Contributor

Benchmarks: Compression

Summary

  • Overall: 1.005x ➖
  • Vortex: 0.999x ➖
  • Best: vortex:parquet-zstd ratio decompress time/Food (0.860x)
  • Worst: vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 (1.133x)
  • Significant (>10%): 1↑ 1↓
Detailed Results Table
name PR caa4063 base 24f57f6 ratio (PR/base) unit remark
parquet_rs-zstd compress time/taxi 1.39488e+09 1.37736e+09 1.01272 ns
parquet_rs-zstd decompress time/taxi 2.94785e+08 2.89192e+08 1.01934 ns
compress time/taxi 7.00568e+08 7.16471e+08 0.977804 ns
decompress time/taxi 2.10884e+07 2.04406e+07 1.03169 ns
parquet_rs-zstd compress time/Arade 2.50462e+09 2.47824e+09 1.01065 ns
parquet_rs-zstd decompress time/Arade 6.71838e+08 6.57872e+08 1.02123 ns
compress time/Arade 1.08066e+09 1.10156e+09 0.981027 ns
decompress time/Arade 3.19214e+07 3.10355e+07 1.02854 ns
parquet_rs-zstd compress time/Bimbo 1.59364e+10 1.56679e+10 1.01714 ns
parquet_rs-zstd decompress time/Bimbo 2.30381e+09 2.26791e+09 1.01583 ns
compress time/Bimbo 6.62205e+09 6.78633e+09 0.975793 ns
decompress time/Bimbo 1.01158e+08 9.73938e+07 1.03865 ns
parquet_rs-zstd compress time/CMSprovider 8.00315e+09 8.00119e+09 1.00024 ns
parquet_rs-zstd decompress time/CMSprovider 2.14396e+09 2.09689e+09 1.02244 ns
compress time/CMSprovider 2.92698e+09 2.8269e+09 1.0354 ns
decompress time/CMSprovider 8.6158e+07 8.25276e+07 1.04399 ns
parquet_rs-zstd compress time/Euro2016 1.48027e+09 1.46026e+09 1.0137 ns
parquet_rs-zstd decompress time/Euro2016 4.23159e+08 4.45352e+08 0.950167 ns
compress time/Euro2016 4.45661e+08 4.51076e+08 0.987997 ns
decompress time/Euro2016 2.17307e+07 2.17686e+07 0.998259 ns
parquet_rs-zstd compress time/Food 9.31242e+08 9.21998e+08 1.01003 ns
parquet_rs-zstd decompress time/Food 2.42447e+08 2.36834e+08 1.0237 ns
compress time/Food 3.92726e+08 4.00394e+08 0.980849 ns
decompress time/Food 8.93294e+06 1.0148e+07 0.880263 ns 🚀
parquet_rs-zstd compress time/HashTags 2.63577e+09 2.56321e+09 1.02831 ns
parquet_rs-zstd decompress time/HashTags 6.92403e+08 7.00758e+08 0.988078 ns
compress time/HashTags 9.22089e+08 9.46003e+08 0.974722 ns
decompress time/HashTags 9.36031e+07 8.8906e+07 1.05283 ns
parquet_rs-zstd compress time/TPC-H l_comment chunked 3.21013e+09 3.2364e+09 0.991883 ns
parquet_rs-zstd decompress time/TPC-H l_comment chunked 7.23826e+08 7.2148e+08 1.00325 ns
compress time/TPC-H l_comment chunked 1.30331e+09 1.27429e+09 1.02278 ns
decompress time/TPC-H l_comment chunked 4.58624e+07 4.51027e+07 1.01685 ns
parquet_rs-zstd compress time/TPC-H l_comment canonical 3.22274e+09 3.16428e+09 1.01848 ns
parquet_rs-zstd decompress time/TPC-H l_comment canonical 7.11496e+08 7.20958e+08 0.986876 ns
compress time/TPC-H l_comment canonical 1.27959e+09 1.27446e+09 1.00403 ns
decompress time/TPC-H l_comment canonical 4.4689e+07 4.44483e+07 1.00542 ns
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6.68059e+06 6.38903e+06 1.04564 ns
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2.57412e+06 2.54205e+06 1.01262 ns
compress time/wide table cols=100 chunks=1 rows=1000 1.47681e+07 1.49273e+07 0.989339 ns
decompress time/wide table cols=100 chunks=1 rows=1000 2.9317e+06 2.76444e+06 1.0605 ns
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 8.52181e+07 8.46175e+07 1.0071 ns
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 2.99332e+07 2.96605e+07 1.0092 ns
compress time/wide table cols=1000 chunks=1 rows=1000 1.53016e+08 1.47078e+08 1.04037 ns
decompress time/wide table cols=1000 chunks=1 rows=1000 2.6668e+07 2.56188e+07 1.04095 ns
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 9.23977e+08 8.88782e+08 1.0396 ns
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 3.42855e+08 3.64101e+08 0.941649 ns
compress time/wide table cols=10000 chunks=1 rows=1000 1.47224e+09 1.48552e+09 0.991059 ns
decompress time/wide table cols=10000 chunks=1 rows=1000 2.88386e+08 2.70268e+08 1.06704 ns
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 7.45936e+06 6.68003e+06 1.11666 ns 🚨
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2.57209e+06 2.60091e+06 0.988919 ns
compress time/wide table cols=100 chunks=50 rows=1000 1.58109e+07 1.57255e+07 1.00543 ns
decompress time/wide table cols=100 chunks=50 rows=1000 3.15112e+06 3.05263e+06 1.03226 ns
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 8.68706e+07 8.41354e+07 1.03251 ns
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 3.06838e+07 2.99318e+07 1.02512 ns
compress time/wide table cols=1000 chunks=50 rows=1000 1.52168e+08 1.54354e+08 0.985839 ns
decompress time/wide table cols=1000 chunks=50 rows=1000 2.71867e+07 2.56832e+07 1.05854 ns
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 9.10185e+08 8.88798e+08 1.02406 ns
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 3.4159e+08 3.33801e+08 1.02333 ns
compress time/wide table cols=10000 chunks=50 rows=1000 1.51465e+09 1.52713e+09 0.991828 ns
decompress time/wide table cols=10000 chunks=50 rows=1000 2.71307e+08 2.63217e+08 1.03073 ns
parquet size/taxi 5.58792e+07 5.58792e+07 1 bytes
vortex-file-compressed size/taxi 5.14542e+07 5.14542e+07 1 bytes
vortex:parquet-zstd size/taxi 0.920811 0.920811 1 ratio
vortex:parquet-zstd ratio compress time/taxi 0.502244 0.520175 0.965527 ratio
vortex:parquet-zstd ratio decompress time/taxi 0.0715382 0.0706819 1.01212 ratio
parquet size/Arade 3.05282e+08 3.05282e+08 1 bytes
vortex-file-compressed size/Arade 1.43322e+08 1.43322e+08 1 bytes
vortex:parquet-zstd size/Arade 0.469473 0.469473 1 ratio
vortex:parquet-zstd ratio compress time/Arade 0.431467 0.444493 0.970693 ratio
vortex:parquet-zstd ratio decompress time/Arade 0.0475135 0.0471756 1.00716 ratio
parquet size/Bimbo 3.88935e+08 3.88935e+08 1 bytes
vortex-file-compressed size/Bimbo 5.26092e+08 5.26092e+08 1 bytes
vortex:parquet-zstd size/Bimbo 1.35265 1.35265 1 ratio
vortex:parquet-zstd ratio compress time/Bimbo 0.415529 0.433134 0.959353 ratio
vortex:parquet-zstd ratio decompress time/Bimbo 0.0439091 0.0429443 1.02247 ratio
parquet size/CMSprovider 3.84635e+08 3.84635e+08 1 bytes
vortex-file-compressed size/CMSprovider 4.48348e+08 4.48348e+08 1 bytes
vortex:parquet-zstd size/CMSprovider 1.16565 1.16565 1 ratio
vortex:parquet-zstd ratio compress time/CMSprovider 0.365728 0.35331 1.03515 ratio
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0401865 0.0393571 1.02107 ratio
parquet size/Euro2016 1.23043e+08 1.23043e+08 1 bytes
vortex-file-compressed size/Euro2016 1.6803e+08 1.67859e+08 1.00102 bytes
vortex:parquet-zstd size/Euro2016 1.36562 1.36424 1.00102 ratio
vortex:parquet-zstd ratio compress time/Euro2016 0.301067 0.308901 0.97464 ratio
vortex:parquet-zstd ratio decompress time/Euro2016 0.0513536 0.0488796 1.05061 ratio
parquet size/Food 3.61776e+07 3.61776e+07 1 bytes
vortex-file-compressed size/Food 4.41635e+07 4.41635e+07 1 bytes
vortex:parquet-zstd size/Food 1.22074 1.22074 1 ratio
vortex:parquet-zstd ratio compress time/Food 0.421723 0.434268 0.971113 ratio
vortex:parquet-zstd ratio decompress time/Food 0.036845 0.0428488 0.859885 ratio 🚀
parquet size/HashTags 1.33855e+08 1.33855e+08 1 bytes
vortex-file-compressed size/HashTags 1.98707e+08 1.98707e+08 1 bytes
vortex:parquet-zstd size/HashTags 1.48449 1.48449 1 ratio
vortex:parquet-zstd ratio compress time/HashTags 0.349837 0.369069 0.947891 ratio
vortex:parquet-zstd ratio decompress time/HashTags 0.135186 0.126871 1.06554 ratio
parquet size/TPC-H l_comment chunked 1.58411e+08 1.58411e+08 1 bytes
vortex-file-compressed size/TPC-H l_comment chunked 1.80419e+08 1.80419e+08 1 bytes
vortex:parquet-zstd size/TPC-H l_comment chunked 1.13893 1.13893 1 ratio
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.406 0.393735 1.03115 ratio
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0633611 0.0625141 1.01355 ratio
parquet size/TPC-H l_comment canonical 1.58411e+08 1.58411e+08 1 bytes
vortex-file-compressed size/TPC-H l_comment canonical 1.80419e+08 1.80419e+08 1 bytes
vortex:parquet-zstd size/TPC-H l_comment canonical 1.13893 1.13893 1 ratio
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.397051 0.402764 0.985816 ratio
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0628099 0.0616517 1.01879 ratio
parquet size/wide table cols=100 chunks=1 rows=1000 932204 932204 1 bytes
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1 bytes
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0.948702 0.948702 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2.2106 2.33639 0.94616 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1.13891 1.08749 1.04729 ratio
parquet size/wide table cols=1000 chunks=1 rows=1000 9.322e+06 9.322e+06 1 bytes
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8.82958e+06 8.82958e+06 1 bytes
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.947177 0.947177 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.79558 1.73815 1.03304 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.890916 0.863735 1.03147 ratio
parquet size/wide table cols=10000 chunks=1 rows=1000 9.322e+07 9.322e+07 1 bytes
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 8.83176e+07 8.83176e+07 1 bytes
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.94741 0.94741 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.59337 1.67141 0.953309 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.841132 0.74229 1.13316 ratio 🚨
parquet size/wide table cols=100 chunks=50 rows=1000 932204 932204 1 bytes
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1 bytes
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0.948702 0.948702 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2.1196 2.35411 0.900385 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1.22512 1.17368 1.04383 ratio
parquet size/wide table cols=1000 chunks=50 rows=1000 9.322e+06 9.322e+06 1 bytes
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8.82958e+06 8.82958e+06 1 bytes
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.947177 0.947177 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.75166 1.83459 0.954798 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.88603 0.858055 1.0326 ratio
parquet size/wide table cols=10000 chunks=50 rows=1000 9.322e+07 9.322e+07 1 bytes
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 8.83176e+07 8.83176e+07 1 bytes
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.94741 0.94741 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.66411 1.71819 0.968522 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.794248 0.788544 1.00723 ratio

@myrrc
Copy link
Contributor Author

myrrc commented Feb 26, 2026

DuckdbFS incorrectly applies globs, as seen in the benchmarks:

~/duckdb-vortex ./build/release/duckdb -c "INSTALL httpfs; LOAD httpfs; SELECT count(*) FROM read_vortex('s3://vortex-bench-dev-eu/6685/merge/22445786768/fineweb/vortex-file-compressed/*.vortex');"
Binder Error:
Other error: No files matched the glob pattern '6685/merge/22445786768/fineweb/vortex-file-compressed/*.vortex'

LINE 1: SELECT count(*) FROM read_vortex('s3://vortex-bench-dev-eu/6685/merge/22445786768...
                             ^
~/duckdb-vortex ./build/release/duckdb -c "INSTALL httpfs; LOAD httpfs; SELECT count(*) FROM read_vortex('s3://vortex-bench-dev-eu/6685/merge/22445786768/fineweb/vortex-file-compressed/sample.vortex');"
┌────────────────┐
│  count_star()  │
│     int64      │
├────────────────┤
│    1046615     │
│ (1.05 million) │
└────────────────┘

@myrrc
Copy link
Contributor Author

myrrc commented Feb 26, 2026

From my current findings, for httplib backend the issue is on our side (we don't expand full path vs. relative path), but with curl backend the issue is on Duckdb httpfs' side:

~/duckdb-vortex with-aws ./build/release/duckdb -c "INSTALL httpfs; LOAD httpfs; SET httpfs_client_implementation=curl; SELECT count(*) FROM read_vortex('s3://vortex-bench-dev-eu/6685/merge/22445786768/fineweb/vortex-file-compressed/*.vortex');"
DuckDbFileSystem list 6685/merge/22445786768/fineweb/vortex-file-compressed s3://vortex-bench-dev-eu/6685/merge/22445786768/fineweb/vortex-file-compressed
DuckDbFileSystem list_recursive dir s3://vortex-bench-dev-eu/6685/merge/22445786768/fineweb/vortex-file-compressed
Binder Error:
Other error: {"exception_type":"IO","exception_message":"URL using bad/illegal format or missing URL error for HTTP GET to '/?encoding-type=url&list-type=2&prefix=6685%2Fmerge%2F22445786768%2Ffineweb%2Fvortex-file-compressed%2F'"}

LINE 1: SELECT count(*) FROM read_vortex('s3://vortex-bench-dev-eu/6685/merge/22445786768...
                             ^
~/duckdb-vortex with-aws ./build/release/duckdb -c "INSTALL httpfs; LOAD httpfs; SET httpfs_client_implementation=httplib; SELECT count(*) FROM read_vortex('s3://vortex-bench-dev-eu/6685/merge/22445786768/fineweb/vortex-file-compressed/*.vortex');"
DuckDbFileSystem list 6685/merge/22445786768/fineweb/vortex-file-compressed s3://vortex-bench-dev-eu/6685/merge/22445786768/fineweb/vortex-file-compressed
DuckDbFileSystem list_recursive dir s3://vortex-bench-dev-eu/6685/merge/22445786768/fineweb/vortex-file-compressed
DuckDbFileSystem list_recursive full_path s3://vortex-bench-dev-eu/6685/merge/22445786768/fineweb/vortex-file-compressed/s3://vortex-bench-dev-eu/6685/merge/22445786768/fineweb/vortex-file-compressed/sample.vortex
Binder Error:
Other error: No files matched the glob pattern '6685/merge/22445786768/fineweb/vortex-file-compressed/*.vortex'

LINE 1: SELECT count(*) FROM read_vortex('s3://vortex-bench-dev-eu/6685/merge/22445786768...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

action/benchmark-sql Trigger SQL benchmarks to run on this PR do not merge Pull requests that are not intended to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant