Skip to content

Change benchmark display order#6883

Merged
AdamGS merged 7 commits intodevelopfrom
adamg/split-bench-display
Mar 11, 2026
Merged

Change benchmark display order#6883
AdamGS merged 7 commits intodevelopfrom
adamg/split-bench-display

Conversation

@AdamGS
Copy link
Contributor

@AdamGS AdamGS commented Mar 11, 2026

Changes how the benchmark display works, making every (engine, format) a separate table, removes the "remark" column and overall trying to have less visual noise.

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Mar 11, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 11, 2026
@AdamGS AdamGS added the changelog/chore A trivial change label Mar 11, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 2ebc0e4 1 Explore Profiling Data
Previous Runs (5)
Status Commit Job Attempt Link
🟢 Done 93f5da0 2 Explore Profiling Data
🟢 Done be257ec 1 Explore Profiling Data
🟢 Done 32da870 1 Explore Profiling Data
🟢 Done 93f5da0 1 Explore Profiling Data
🟢 Done 2e70dce 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: PolarSignals Profiling

Summary

  • Overall: 1.069x ➖
  • Vortex: 1.069x ➖
datafusion / vortex-file-compressed (1.069x ➖, 0↑ 3↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
🚨 polarsignals_q00/datafusion:vortex-file-compressed 132213866 118510055 1.12
polarsignals_q01/datafusion:vortex-file-compressed 348463829 348864630 1.00
polarsignals_q02/datafusion:vortex-file-compressed 23418872 22778298 1.03
polarsignals_q03/datafusion:vortex-file-compressed 357164371 349281818 1.02
polarsignals_q04/datafusion:vortex-file-compressed 12892792 12062776 1.07
polarsignals_q05/datafusion:vortex-file-compressed 17198315 16299443 1.06
polarsignals_q06/datafusion:vortex-file-compressed 21077310 19641458 1.07
🚨 polarsignals_q07/datafusion:vortex-file-compressed 14236031 12046909 1.18
polarsignals_q08/datafusion:vortex-file-compressed 446854966 425273163 1.05
🚨 polarsignals_q09/datafusion:vortex-file-compressed 11971517 10804793 1.11

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: TPC-H SF=1 on NVME

Summary

  • Overall: 1.008x ➖
  • Vortex: 1.012x ➖
  • Parquet: 1.006x ➖
datafusion / vortex-file-compressed (1.016x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 52544707 50288167 1.04
tpch_q02/datafusion:vortex-file-compressed 55234704 52140789 1.06
tpch_q03/datafusion:vortex-file-compressed 29231573 27731266 1.05
tpch_q04/datafusion:vortex-file-compressed 19543289 19391103 1.01
tpch_q05/datafusion:vortex-file-compressed 79684680 79465378 1.00
tpch_q06/datafusion:vortex-file-compressed 10432313 10565144 0.99
tpch_q07/datafusion:vortex-file-compressed 93804486 93758945 1.00
tpch_q08/datafusion:vortex-file-compressed 72533202 69634483 1.04
tpch_q09/datafusion:vortex-file-compressed 89213525 86245818 1.03
tpch_q10/datafusion:vortex-file-compressed 84171579 84230085 1.00
tpch_q11/datafusion:vortex-file-compressed 19346010 19646384 0.98
tpch_q12/datafusion:vortex-file-compressed 38238618 36187241 1.06
tpch_q13/datafusion:vortex-file-compressed 28543707 29192198 0.98
tpch_q14/datafusion:vortex-file-compressed 30034251 30156016 1.00
tpch_q15/datafusion:vortex-file-compressed 25995250 25089298 1.04
tpch_q16/datafusion:vortex-file-compressed 36518335 37537673 0.97
tpch_q17/datafusion:vortex-file-compressed 74647428 76107221 0.98
tpch_q18/datafusion:vortex-file-compressed 105658390 104212041 1.01
tpch_q19/datafusion:vortex-file-compressed 37906671 37116278 1.02
tpch_q20/datafusion:vortex-file-compressed 52734522 51601472 1.02
tpch_q21/datafusion:vortex-file-compressed 99892111 92377811 1.08
tpch_q22/datafusion:vortex-file-compressed 15350739 15534593 0.99
datafusion / vortex-compact (1.004x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 61148781 60926694 1.00
tpch_q02/datafusion:vortex-compact 59003932 57549607 1.03
tpch_q03/datafusion:vortex-compact 31980185 32504377 0.98
tpch_q04/datafusion:vortex-compact 24413988 24249938 1.01
tpch_q05/datafusion:vortex-compact 88794237 86711984 1.02
tpch_q06/datafusion:vortex-compact 15260736 14703652 1.04
tpch_q07/datafusion:vortex-compact 100957488 98654541 1.02
tpch_q08/datafusion:vortex-compact 76511629 77083431 0.99
tpch_q09/datafusion:vortex-compact 95587069 96727817 0.99
tpch_q10/datafusion:vortex-compact 86079917 85342608 1.01
tpch_q11/datafusion:vortex-compact 21439728 21472725 1.00
tpch_q12/datafusion:vortex-compact 45659049 43962305 1.04
tpch_q13/datafusion:vortex-compact 36696414 37578374 0.98
tpch_q14/datafusion:vortex-compact 34251597 33563804 1.02
tpch_q15/datafusion:vortex-compact 33181501 33756649 0.98
tpch_q16/datafusion:vortex-compact 42218169 41068301 1.03
tpch_q17/datafusion:vortex-compact 79693238 81832976 0.97
tpch_q18/datafusion:vortex-compact 112963270 111998224 1.01
tpch_q19/datafusion:vortex-compact 47998589 53134862 0.90
tpch_q20/datafusion:vortex-compact 58985482 57543421 1.03
tpch_q21/datafusion:vortex-compact 112769492 111609527 1.01
tpch_q22/datafusion:vortex-compact 17103447 16528305 1.03
datafusion / parquet (1.017x ➖, 1↑ 1↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 104408639 105615769 0.99
tpch_q02/datafusion:parquet 81689408 80704207 1.01
tpch_q03/datafusion:parquet 88222909 80422718 1.10
tpch_q04/datafusion:parquet 54971525 54337260 1.01
tpch_q05/datafusion:parquet 174488872 176791286 0.99
🚀 tpch_q06/datafusion:parquet 41786746 46762306 0.89
tpch_q07/datafusion:parquet 189557970 188698482 1.00
tpch_q08/datafusion:parquet 173428237 177473440 0.98
tpch_q09/datafusion:parquet 218964939 218827487 1.00
tpch_q10/datafusion:parquet 200597545 194068659 1.03
tpch_q11/datafusion:parquet 61265681 60403185 1.01
tpch_q12/datafusion:parquet 128236084 126092463 1.02
tpch_q13/datafusion:parquet 209151135 201925401 1.04
tpch_q14/datafusion:parquet 83859845 84779421 0.99
tpch_q15/datafusion:parquet 71481490 75596352 0.95
tpch_q16/datafusion:parquet 55143296 55854929 0.99
tpch_q17/datafusion:parquet 188604930 173310807 1.09
tpch_q18/datafusion:parquet 245697236 233310549 1.05
🚨 tpch_q19/datafusion:parquet 101636982 84562928 1.20
tpch_q20/datafusion:parquet 132865301 123670348 1.07
tpch_q21/datafusion:parquet 189754989 198279795 0.96
tpch_q22/datafusion:parquet 43101931 41677300 1.03
datafusion / arrow (1.008x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 62533938 63116300 0.99
tpch_q02/datafusion:arrow 22706459 23077091 0.98
tpch_q03/datafusion:arrow 37198718 37083198 1.00
tpch_q04/datafusion:arrow 31251313 30802272 1.01
tpch_q05/datafusion:arrow 91792540 97279704 0.94
tpch_q06/datafusion:arrow 21063077 21737144 0.97
tpch_q07/datafusion:arrow 185864646 174626508 1.06
tpch_q08/datafusion:arrow 46610719 46319406 1.01
tpch_q09/datafusion:arrow 76782385 73806423 1.04
tpch_q10/datafusion:arrow 58770687 57933806 1.01
tpch_q11/datafusion:arrow 12510363 12055274 1.04
tpch_q12/datafusion:arrow 61525863 59338469 1.04
tpch_q13/datafusion:arrow 51479658 49845220 1.03
tpch_q14/datafusion:arrow 26661530 25074959 1.06
tpch_q15/datafusion:arrow 51967026 49025210 1.06
tpch_q16/datafusion:arrow 23245114 24072686 0.97
tpch_q17/datafusion:arrow 78030043 81742154 0.95
tpch_q18/datafusion:arrow 161697942 173957293 0.93
tpch_q19/datafusion:arrow 40164001 39336112 1.02
tpch_q20/datafusion:arrow 41608037 38815794 1.07
tpch_q21/datafusion:arrow 219811629 217488636 1.01
tpch_q22/datafusion:arrow 21704288 22110561 0.98
duckdb / vortex-file-compressed (1.011x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32780746 33008821 0.99
tpch_q02/duckdb:vortex-file-compressed 26960356 26732540 1.01
tpch_q03/duckdb:vortex-file-compressed 29330922 28981351 1.01
tpch_q04/duckdb:vortex-file-compressed 29712042 29267398 1.02
tpch_q05/duckdb:vortex-file-compressed 33396882 34564890 0.97
tpch_q06/duckdb:vortex-file-compressed 11099247 11463669 0.97
tpch_q07/duckdb:vortex-file-compressed 38188724 36547888 1.04
tpch_q08/duckdb:vortex-file-compressed 39506270 40108442 0.98
tpch_q09/duckdb:vortex-file-compressed 75913651 77993945 0.97
tpch_q10/duckdb:vortex-file-compressed 34880824 34814095 1.00
tpch_q11/duckdb:vortex-file-compressed 16379509 15085976 1.09
tpch_q12/duckdb:vortex-file-compressed 23582830 22395693 1.05
tpch_q13/duckdb:vortex-file-compressed 36781418 37120527 0.99
tpch_q14/duckdb:vortex-file-compressed 22841991 21866440 1.04
tpch_q15/duckdb:vortex-file-compressed 16080451 15687919 1.03
tpch_q16/duckdb:vortex-file-compressed 30051839 29486315 1.02
tpch_q17/duckdb:vortex-file-compressed 24355636 24842842 0.98
tpch_q18/duckdb:vortex-file-compressed 46301986 46544406 0.99
tpch_q19/duckdb:vortex-file-compressed 32525660 31593705 1.03
tpch_q20/duckdb:vortex-file-compressed 34254085 34952674 0.98
tpch_q21/duckdb:vortex-file-compressed 105160306 101156267 1.04
tpch_q22/duckdb:vortex-file-compressed 18652220 17983320 1.04
duckdb / vortex-compact (1.018x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39384692 38962877 1.01
tpch_q02/duckdb:vortex-compact 38165147 38706137 0.99
tpch_q03/duckdb:vortex-compact 32802354 31970123 1.03
tpch_q04/duckdb:vortex-compact 36566875 34811981 1.05
tpch_q05/duckdb:vortex-compact 37966403 37470881 1.01
tpch_q06/duckdb:vortex-compact 14739571 14885291 0.99
tpch_q07/duckdb:vortex-compact 42605460 42167141 1.01
tpch_q08/duckdb:vortex-compact 46936157 44944120 1.04
tpch_q09/duckdb:vortex-compact 87179424 83798008 1.04
tpch_q10/duckdb:vortex-compact 40920162 40209944 1.02
tpch_q11/duckdb:vortex-compact 21243170 21637618 0.98
tpch_q12/duckdb:vortex-compact 37726343 37794419 1.00
tpch_q13/duckdb:vortex-compact 46373421 44997021 1.03
tpch_q14/duckdb:vortex-compact 31492713 30456173 1.03
tpch_q15/duckdb:vortex-compact 19618545 19566259 1.00
tpch_q16/duckdb:vortex-compact 37225881 36297044 1.03
tpch_q17/duckdb:vortex-compact 30171046 30137491 1.00
tpch_q18/duckdb:vortex-compact 50604191 50059366 1.01
tpch_q19/duckdb:vortex-compact 38293021 37167498 1.03
tpch_q20/duckdb:vortex-compact 46028731 43960274 1.05
tpch_q21/duckdb:vortex-compact 111930966 112024793 1.00
tpch_q22/duckdb:vortex-compact 21630192 20697267 1.05
duckdb / parquet (0.996x ➖, 3↑ 2↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 76523185 82738748 0.92
tpch_q02/duckdb:parquet 39703174 38832976 1.02
tpch_q03/duckdb:parquet 74907328 69797850 1.07
🚀 tpch_q04/duckdb:parquet 46228952 55573533 0.83
tpch_q05/duckdb:parquet 72629279 66760364 1.09
tpch_q06/duckdb:parquet 21760813 20622516 1.06
tpch_q07/duckdb:parquet 68059408 73616423 0.92
🚀 tpch_q08/duckdb:parquet 81749266 100725266 0.81
🚀 tpch_q09/duckdb:parquet 135575120 157434240 0.86
tpch_q10/duckdb:parquet 126068057 132889660 0.95
tpch_q11/duckdb:parquet 22824868 23367245 0.98
🚨 tpch_q12/duckdb:parquet 59136623 45345562 1.30
tpch_q13/duckdb:parquet 264250320 261907399 1.01
tpch_q14/duckdb:parquet 48939760 48592568 1.01
tpch_q15/duckdb:parquet 25381467 23903911 1.06
tpch_q16/duckdb:parquet 56212126 54662505 1.03
tpch_q17/duckdb:parquet 57642212 60361334 0.95
tpch_q18/duckdb:parquet 119696011 115139363 1.04
🚨 tpch_q19/duckdb:parquet 79337292 71558964 1.11
tpch_q20/duckdb:parquet 65410627 63147498 1.04
tpch_q21/duckdb:parquet 169640826 176474672 0.96
tpch_q22/duckdb:parquet 52083231 52034458 1.00
duckdb / duckdb (0.995x ➖, 1↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16183967 15874887 1.02
tpch_q02/duckdb:duckdb 11491590 11719858 0.98
tpch_q03/duckdb:duckdb 19203399 19059845 1.01
tpch_q04/duckdb:duckdb 18838984 19586095 0.96
tpch_q05/duckdb:duckdb 19584222 19792898 0.99
tpch_q06/duckdb:duckdb 5415278 5257887 1.03
tpch_q07/duckdb:duckdb 23438261 22968048 1.02
tpch_q08/duckdb:duckdb 21174520 21193280 1.00
tpch_q09/duckdb:duckdb 54267282 54724293 0.99
tpch_q10/duckdb:duckdb 40691509 44901281 0.91
tpch_q11/duckdb:duckdb 6145320 5681494 1.08
tpch_q12/duckdb:duckdb 13875841 13584631 1.02
tpch_q13/duckdb:duckdb 37141420 37747971 0.98
🚀 tpch_q14/duckdb:duckdb 14818730 17814529 0.83
tpch_q15/duckdb:duckdb 11490736 11748663 0.98
tpch_q16/duckdb:duckdb 23577917 22800582 1.03
tpch_q17/duckdb:duckdb 13785261 13505413 1.02
tpch_q18/duckdb:duckdb 38166583 37757554 1.01
tpch_q19/duckdb:duckdb 28316882 29491367 0.96
tpch_q20/duckdb:duckdb 24022327 22715470 1.06
tpch_q21/duckdb:duckdb 57287420 56720370 1.01
tpch_q22/duckdb:duckdb 24130093 23679579 1.02

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: FineWeb NVMe

Summary

  • Overall: 1.068x ➖
  • Vortex: 1.062x ➖
  • Parquet: 1.082x ➖
datafusion / vortex-file-compressed (1.050x ➖, 0↑ 3↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
🚨 fineweb_q00/datafusion:vortex-file-compressed 5010823 4449418 1.13
🚨 fineweb_q01/datafusion:vortex-file-compressed 29163574 26264231 1.11
fineweb_q02/datafusion:vortex-file-compressed 29618021 30473325 0.97
🚨 fineweb_q03/datafusion:vortex-file-compressed 91608042 79822319 1.15
fineweb_q04/datafusion:vortex-file-compressed 235929180 237502371 0.99
fineweb_q05/datafusion:vortex-file-compressed 213017780 202058345 1.05
fineweb_q06/datafusion:vortex-file-compressed 79395574 73527644 1.08
fineweb_q07/datafusion:vortex-file-compressed 71483412 68340597 1.05
fineweb_q08/datafusion:vortex-file-compressed 26294028 27875960 0.94
datafusion / vortex-compact (1.063x ➖, 1↑ 4↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5295731 5096633 1.04
fineweb_q01/datafusion:vortex-compact 140419229 145718352 0.96
🚨 fineweb_q02/datafusion:vortex-compact 171600348 145543795 1.18
🚨 fineweb_q03/datafusion:vortex-compact 1400005281 1251328615 1.12
fineweb_q04/datafusion:vortex-compact 1605509193 1462437146 1.10
fineweb_q05/datafusion:vortex-compact 1253485403 1151909477 1.09
🚨 fineweb_q06/datafusion:vortex-compact 652714659 590092153 1.11
🚨 fineweb_q07/datafusion:vortex-compact 690473590 617070084 1.12
🚀 fineweb_q08/datafusion:vortex-compact 22404976 25164997 0.89
datafusion / parquet (1.094x ➖, 0↑ 4↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
🚨 fineweb_q00/datafusion:parquet 6998222 6055593 1.16
fineweb_q01/datafusion:parquet 286854271 269198385 1.07
fineweb_q02/datafusion:parquet 291909864 272145367 1.07
🚨 fineweb_q03/datafusion:parquet 302598533 269196198 1.12
fineweb_q04/datafusion:parquet 310735482 285463691 1.09
🚨 fineweb_q05/datafusion:parquet 309396608 277665251 1.11
fineweb_q06/datafusion:parquet 299364772 286358152 1.05
🚨 fineweb_q07/datafusion:parquet 299821985 271324085 1.11
fineweb_q08/datafusion:parquet 287361512 265426671 1.08
duckdb / vortex-file-compressed (1.062x ➖, 0↑ 2↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3815319 3502098 1.09
🚨 fineweb_q01/duckdb:vortex-file-compressed 30055521 26247431 1.15
fineweb_q02/duckdb:vortex-file-compressed 28025557 29465360 0.95
🚨 fineweb_q03/duckdb:vortex-file-compressed 146838865 129237758 1.14
fineweb_q04/duckdb:vortex-file-compressed 225468325 216846499 1.04
fineweb_q05/duckdb:vortex-file-compressed 198495048 189225546 1.05
fineweb_q06/duckdb:vortex-file-compressed 76484959 70500826 1.08
fineweb_q07/duckdb:vortex-file-compressed 75414717 71501242 1.05
fineweb_q08/duckdb:vortex-file-compressed 26795442 26201551 1.02
duckdb / vortex-compact (1.071x ➖, 0↑ 2↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4318081 4364016 0.99
fineweb_q01/duckdb:vortex-compact 101584052 95874445 1.06
fineweb_q02/duckdb:vortex-compact 106144161 99470591 1.07
fineweb_q03/duckdb:vortex-compact 928166307 845567205 1.10
🚨 fineweb_q04/duckdb:vortex-compact 995205305 896108970 1.11
fineweb_q05/duckdb:vortex-compact 882568793 803479285 1.10
fineweb_q06/duckdb:vortex-compact 490786893 467703176 1.05
fineweb_q07/duckdb:vortex-compact 501927739 476610791 1.05
🚨 fineweb_q08/duckdb:vortex-compact 25751371 22916099 1.12
duckdb / parquet (1.070x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 38229388 36545763 1.05
fineweb_q01/duckdb:parquet 99348702 91890404 1.08
fineweb_q02/duckdb:parquet 104506532 95781965 1.09
fineweb_q03/duckdb:parquet 320969540 301319021 1.07
fineweb_q04/duckdb:parquet 458241719 427128143 1.07
fineweb_q05/duckdb:parquet 429833922 400104258 1.07
fineweb_q06/duckdb:parquet 207389972 195488169 1.06
fineweb_q07/duckdb:parquet 220553415 207843415 1.06
fineweb_q08/duckdb:parquet 62089113 57816985 1.07

@codspeed-hq
Copy link

codspeed-hq bot commented Mar 11, 2026

Merging this PR will not alter performance

✅ 1029 untouched benchmarks
⏩ 1466 skipped benchmarks1


Comparing adamg/split-bench-display (2ebc0e4) with develop (2d1d952)

Open in CodSpeed

Footnotes

  1. 1466 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: TPC-DS SF=1 on NVME

Summary

  • Overall: 0.976x ➖
  • Vortex: 0.973x ➖
  • Parquet: 0.979x ➖
datafusion / vortex-file-compressed (0.975x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27030173 29226309 0.92
tpcds_q02/datafusion:vortex-file-compressed 80499143 83381041 0.97
tpcds_q03/datafusion:vortex-file-compressed 28740592 29243341 0.98
tpcds_q04/datafusion:vortex-file-compressed 402311843 414110535 0.97
tpcds_q05/datafusion:vortex-file-compressed 77045273 78501696 0.98
tpcds_q06/datafusion:vortex-file-compressed 77581264 84081203 0.92
tpcds_q07/datafusion:vortex-file-compressed 81939283 82607835 0.99
tpcds_q08/datafusion:vortex-file-compressed 41881003 42624195 0.98
tpcds_q09/datafusion:vortex-file-compressed 48895432 49448576 0.99
tpcds_q10/datafusion:vortex-file-compressed 48746346 53206338 0.92
tpcds_q11/datafusion:vortex-file-compressed 236566213 244903629 0.97
tpcds_q12/datafusion:vortex-file-compressed 38799270 37831289 1.03
tpcds_q13/datafusion:vortex-file-compressed 82793238 81822460 1.01
tpcds_q14/datafusion:vortex-file-compressed 215188478 225498717 0.95
tpcds_q15/datafusion:vortex-file-compressed 50318484 52760413 0.95
tpcds_q16/datafusion:vortex-file-compressed 30592968 29883323 1.02
tpcds_q17/datafusion:vortex-file-compressed 117310818 116489443 1.01
tpcds_q18/datafusion:vortex-file-compressed 105013704 106279919 0.99
tpcds_q19/datafusion:vortex-file-compressed 48007624 51373447 0.93
tpcds_q20/datafusion:vortex-file-compressed 43110936 42682437 1.01
tpcds_q21/datafusion:vortex-file-compressed 179980149 183250097 0.98
tpcds_q22/datafusion:vortex-file-compressed 72269120 77105942 0.94
tpcds_q23/datafusion:vortex-file-compressed 194992122 204192077 0.95
tpcds_q24/datafusion:vortex-file-compressed 188826900 197571514 0.96
tpcds_q25/datafusion:vortex-file-compressed 119675445 124680363 0.96
tpcds_q26/datafusion:vortex-file-compressed 67710449 72133052 0.94
tpcds_q27/datafusion:vortex-file-compressed 177846350 172516146 1.03
tpcds_q28/datafusion:vortex-file-compressed 49628238 52108388 0.95
tpcds_q29/datafusion:vortex-file-compressed 118910546 125716674 0.95
tpcds_q30/datafusion:vortex-file-compressed 30952584 32522158 0.95
tpcds_q31/datafusion:vortex-file-compressed 188426480 194855883 0.97
tpcds_q32/datafusion:vortex-file-compressed 24303989 24925020 0.98
tpcds_q33/datafusion:vortex-file-compressed 37955728 40033530 0.95
tpcds_q34/datafusion:vortex-file-compressed 39177807 38478715 1.02
tpcds_q35/datafusion:vortex-file-compressed 61536329 62688567 0.98
tpcds_q36/datafusion:vortex-file-compressed 107234727 114452959 0.94
tpcds_q37/datafusion:vortex-file-compressed 40510244 40124707 1.01
tpcds_q38/datafusion:vortex-file-compressed 92215847 96844843 0.95
tpcds_q39/datafusion:vortex-file-compressed 212951269 214265895 0.99
tpcds_q40/datafusion:vortex-file-compressed 55933112 58749814 0.95
tpcds_q41/datafusion:vortex-file-compressed 14917984 14674507 1.02
tpcds_q42/datafusion:vortex-file-compressed 33294081 33488326 0.99
tpcds_q43/datafusion:vortex-file-compressed 49044222 48722840 1.01
tpcds_q44/datafusion:vortex-file-compressed 42989154 44213651 0.97
tpcds_q45/datafusion:vortex-file-compressed 51623003 53046655 0.97
tpcds_q46/datafusion:vortex-file-compressed 66407144 69194777 0.96
tpcds_q47/datafusion:vortex-file-compressed 251196549 259061245 0.97
tpcds_q48/datafusion:vortex-file-compressed 71887050 74157028 0.97
tpcds_q49/datafusion:vortex-file-compressed 69645013 73951685 0.94
tpcds_q50/datafusion:vortex-file-compressed 76506550 80735676 0.95
tpcds_q51/datafusion:vortex-file-compressed 93892910 96612231 0.97
tpcds_q52/datafusion:vortex-file-compressed 33100213 32994919 1.00
tpcds_q53/datafusion:vortex-file-compressed 31746735 31274730 1.02
tpcds_q54/datafusion:vortex-file-compressed 50362889 50426872 1.00
tpcds_q55/datafusion:vortex-file-compressed 33319894 33341109 1.00
tpcds_q56/datafusion:vortex-file-compressed 47621748 48894778 0.97
tpcds_q57/datafusion:vortex-file-compressed 190821722 192562750 0.99
tpcds_q58/datafusion:vortex-file-compressed 115907943 119598100 0.97
tpcds_q59/datafusion:vortex-file-compressed 96545189 96814069 1.00
tpcds_q60/datafusion:vortex-file-compressed 49264643 49549213 0.99
tpcds_q61/datafusion:vortex-file-compressed 58252474 58471577 1.00
tpcds_q62/datafusion:vortex-file-compressed 46409064 47403420 0.98
tpcds_q63/datafusion:vortex-file-compressed 29717627 30806791 0.96
tpcds_q64/datafusion:vortex-file-compressed 748376933 755268091 0.99
tpcds_q65/datafusion:vortex-file-compressed 51624823 55739379 0.93
tpcds_q66/datafusion:vortex-file-compressed 104916196 106979886 0.98
tpcds_q67/datafusion:vortex-file-compressed 147829416 143075445 1.03
tpcds_q68/datafusion:vortex-file-compressed 66201404 68775707 0.96
tpcds_q69/datafusion:vortex-file-compressed 47797074 48522258 0.99
tpcds_q70/datafusion:vortex-file-compressed 126191261 124283509 1.02
tpcds_q71/datafusion:vortex-file-compressed 30452243 30155903 1.01
tpcds_q72/datafusion:vortex-file-compressed 3362202341 3592922319 0.94
tpcds_q73/datafusion:vortex-file-compressed 39644683 41267282 0.96
tpcds_q74/datafusion:vortex-file-compressed 173673287 179442592 0.97
tpcds_q75/datafusion:vortex-file-compressed 135736377 138868555 0.98
tpcds_q76/datafusion:vortex-file-compressed 67612259 66572827 1.02
tpcds_q77/datafusion:vortex-file-compressed 55664756 54520263 1.02
tpcds_q78/datafusion:vortex-file-compressed 177163228 188920865 0.94
tpcds_q79/datafusion:vortex-file-compressed 42700897 45275690 0.94
tpcds_q80/datafusion:vortex-file-compressed 120780689 120213907 1.00
tpcds_q81/datafusion:vortex-file-compressed 36546847 36334361 1.01
tpcds_q82/datafusion:vortex-file-compressed 40646532 41000809 0.99
tpcds_q83/datafusion:vortex-file-compressed 65601615 69407931 0.95
tpcds_q84/datafusion:vortex-file-compressed 15429558 16383652 0.94
tpcds_q85/datafusion:vortex-file-compressed 139586458 143151724 0.98
tpcds_q86/datafusion:vortex-file-compressed 33513554 32136861 1.04
tpcds_q87/datafusion:vortex-file-compressed 94075584 96931841 0.97
tpcds_q88/datafusion:vortex-file-compressed 80086829 83411059 0.96
tpcds_q89/datafusion:vortex-file-compressed 60822191 61670127 0.99
tpcds_q90/datafusion:vortex-file-compressed 16525160 16551363 1.00
tpcds_q91/datafusion:vortex-file-compressed 27248740 28390629 0.96
tpcds_q92/datafusion:vortex-file-compressed 20291807 21136701 0.96
tpcds_q93/datafusion:vortex-file-compressed 37563108 39215639 0.96
tpcds_q94/datafusion:vortex-file-compressed 27059327 28231017 0.96
tpcds_q95/datafusion:vortex-file-compressed 91011173 93545539 0.97
tpcds_q96/datafusion:vortex-file-compressed 16439559 16767321 0.98
tpcds_q97/datafusion:vortex-file-compressed 32785191 33858961 0.97
tpcds_q98/datafusion:vortex-file-compressed 52397527 55270671 0.95
tpcds_q99/datafusion:vortex-file-compressed 59693057 64392190 0.93
datafusion / vortex-compact (0.973x ➖, 1↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 35465554 36102350 0.98
tpcds_q02/datafusion:vortex-compact 83642956 85679001 0.98
tpcds_q03/datafusion:vortex-compact 33280476 34502579 0.96
tpcds_q04/datafusion:vortex-compact 444427075 458827442 0.97
tpcds_q05/datafusion:vortex-compact 86836912 86888384 1.00
tpcds_q06/datafusion:vortex-compact 83381149 87516631 0.95
tpcds_q07/datafusion:vortex-compact 96074146 99857907 0.96
tpcds_q08/datafusion:vortex-compact 48762215 50995360 0.96
tpcds_q09/datafusion:vortex-compact 100787737 101204349 1.00
tpcds_q10/datafusion:vortex-compact 68943457 71255728 0.97
tpcds_q11/datafusion:vortex-compact 262941288 268979045 0.98
tpcds_q12/datafusion:vortex-compact 40455898 41111025 0.98
tpcds_q13/datafusion:vortex-compact 140381201 142992032 0.98
tpcds_q14/datafusion:vortex-compact 275247651 272820410 1.01
tpcds_q15/datafusion:vortex-compact 53917332 57493798 0.94
tpcds_q16/datafusion:vortex-compact 41717403 44124063 0.95
tpcds_q17/datafusion:vortex-compact 135327130 132737540 1.02
tpcds_q18/datafusion:vortex-compact 122202925 120410113 1.01
tpcds_q19/datafusion:vortex-compact 62003076 62944908 0.99
tpcds_q20/datafusion:vortex-compact 46681981 49683220 0.94
tpcds_q21/datafusion:vortex-compact 191895985 188555703 1.02
tpcds_q22/datafusion:vortex-compact 80776081 81956071 0.99
tpcds_q23/datafusion:vortex-compact 234059403 234923348 1.00
tpcds_q24/datafusion:vortex-compact 223195565 225832798 0.99
tpcds_q25/datafusion:vortex-compact 133009516 135063757 0.98
tpcds_q26/datafusion:vortex-compact 76242525 79021536 0.96
tpcds_q27/datafusion:vortex-compact 214383392 224355148 0.96
tpcds_q28/datafusion:vortex-compact 103452280 102464718 1.01
tpcds_q29/datafusion:vortex-compact 134038397 137266010 0.98
tpcds_q30/datafusion:vortex-compact 36041707 37024614 0.97
tpcds_q31/datafusion:vortex-compact 223317599 228907038 0.98
tpcds_q32/datafusion:vortex-compact 30304713 31413017 0.96
tpcds_q33/datafusion:vortex-compact 51136918 53110888 0.96
tpcds_q34/datafusion:vortex-compact 57035678 59095934 0.97
tpcds_q35/datafusion:vortex-compact 74914900 79074743 0.95
tpcds_q36/datafusion:vortex-compact 131969212 136995562 0.96
tpcds_q37/datafusion:vortex-compact 51177763 52896574 0.97
tpcds_q38/datafusion:vortex-compact 110737689 109662465 1.01
tpcds_q39/datafusion:vortex-compact 199694245 212624520 0.94
🚀 tpcds_q40/datafusion:vortex-compact 61261745 70288566 0.87
tpcds_q41/datafusion:vortex-compact 15642584 17255696 0.91
tpcds_q42/datafusion:vortex-compact 37743680 38782999 0.97
tpcds_q43/datafusion:vortex-compact 55193760 57471535 0.96
tpcds_q44/datafusion:vortex-compact 71450158 72843804 0.98
tpcds_q45/datafusion:vortex-compact 55137778 54491877 1.01
tpcds_q46/datafusion:vortex-compact 94126962 98672269 0.95
tpcds_q47/datafusion:vortex-compact 277628434 283609042 0.98
tpcds_q48/datafusion:vortex-compact 113490317 109024319 1.04
tpcds_q49/datafusion:vortex-compact 97223548 99200403 0.98
tpcds_q50/datafusion:vortex-compact 95347702 95516724 1.00
tpcds_q51/datafusion:vortex-compact 102640552 101811239 1.01
tpcds_q52/datafusion:vortex-compact 38934852 38164325 1.02
tpcds_q53/datafusion:vortex-compact 41053114 39657584 1.04
tpcds_q54/datafusion:vortex-compact 65338205 64194104 1.02
tpcds_q55/datafusion:vortex-compact 38255769 38733729 0.99
tpcds_q56/datafusion:vortex-compact 60027527 60032070 1.00
tpcds_q57/datafusion:vortex-compact 203597971 211864935 0.96
tpcds_q58/datafusion:vortex-compact 122547319 125278736 0.98
tpcds_q59/datafusion:vortex-compact 111216243 113675552 0.98
tpcds_q60/datafusion:vortex-compact 61175452 62958193 0.97
tpcds_q61/datafusion:vortex-compact 81971614 86340690 0.95
tpcds_q62/datafusion:vortex-compact 47011458 50074835 0.94
tpcds_q63/datafusion:vortex-compact 39022821 39152352 1.00
tpcds_q64/datafusion:vortex-compact 818100173 842281546 0.97
tpcds_q65/datafusion:vortex-compact 71428210 72201564 0.99
tpcds_q66/datafusion:vortex-compact 115393417 113980602 1.01
tpcds_q67/datafusion:vortex-compact 145025442 150758305 0.96
tpcds_q68/datafusion:vortex-compact 94822206 93582956 1.01
tpcds_q69/datafusion:vortex-compact 63570399 64510149 0.99
tpcds_q70/datafusion:vortex-compact 136064604 136401188 1.00
tpcds_q71/datafusion:vortex-compact 46259661 48143251 0.96
tpcds_q72/datafusion:vortex-compact 3376338167 3615899982 0.93
tpcds_q73/datafusion:vortex-compact 55868010 60536672 0.92
tpcds_q74/datafusion:vortex-compact 192497377 190311337 1.01
tpcds_q75/datafusion:vortex-compact 182159772 186645351 0.98
tpcds_q76/datafusion:vortex-compact 83017722 84187108 0.99
tpcds_q77/datafusion:vortex-compact 70282209 72379114 0.97
tpcds_q78/datafusion:vortex-compact 204013393 204470602 1.00
tpcds_q79/datafusion:vortex-compact 68852947 70187041 0.98
tpcds_q80/datafusion:vortex-compact 140601816 139896335 1.01
tpcds_q81/datafusion:vortex-compact 41430820 44139190 0.94
tpcds_q82/datafusion:vortex-compact 51506334 55606636 0.93
tpcds_q83/datafusion:vortex-compact 66426270 70774659 0.94
tpcds_q84/datafusion:vortex-compact 19347814 19226190 1.01
tpcds_q85/datafusion:vortex-compact 165059083 169939788 0.97
tpcds_q86/datafusion:vortex-compact 33693769 34988493 0.96
tpcds_q87/datafusion:vortex-compact 108457140 112140410 0.97
tpcds_q88/datafusion:vortex-compact 133294628 133581830 1.00
tpcds_q89/datafusion:vortex-compact 63689401 68007564 0.94
tpcds_q90/datafusion:vortex-compact 22890995 23348684 0.98
tpcds_q91/datafusion:vortex-compact 40309339 43972361 0.92
tpcds_q92/datafusion:vortex-compact 22698936 23669410 0.96
tpcds_q93/datafusion:vortex-compact 52416441 54686866 0.96
tpcds_q94/datafusion:vortex-compact 32944008 36237205 0.91
tpcds_q95/datafusion:vortex-compact 101205285 103894524 0.97
tpcds_q96/datafusion:vortex-compact 25419987 26307389 0.97
tpcds_q97/datafusion:vortex-compact 44761750 47338663 0.95
tpcds_q98/datafusion:vortex-compact 57651222 60696891 0.95
tpcds_q99/datafusion:vortex-compact 66001880 72064377 0.92
datafusion / parquet (0.970x ➖, 7↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
🚀 tpcds_q01/datafusion:parquet 37294813 41469858 0.90
tpcds_q02/datafusion:parquet 52874358 52934247 1.00
tpcds_q03/datafusion:parquet 18502143 17856490 1.04
tpcds_q04/datafusion:parquet 377966884 380226872 0.99
tpcds_q05/datafusion:parquet 90576798 93946999 0.96
tpcds_q06/datafusion:parquet 106537198 100693829 1.06
tpcds_q07/datafusion:parquet 141588789 142371234 0.99
tpcds_q08/datafusion:parquet 40203035 42352233 0.95
tpcds_q09/datafusion:parquet 55109846 54749898 1.01
tpcds_q10/datafusion:parquet 105919490 109334501 0.97
tpcds_q11/datafusion:parquet 234146309 241170325 0.97
tpcds_q12/datafusion:parquet 32551025 31703360 1.03
tpcds_q13/datafusion:parquet 148217521 147964911 1.00
tpcds_q14/datafusion:parquet 215401602 220734716 0.98
tpcds_q15/datafusion:parquet 61068745 61854810 0.99
tpcds_q16/datafusion:parquet 35635874 35393203 1.01
tpcds_q17/datafusion:parquet 194928148 190078669 1.03
tpcds_q18/datafusion:parquet 180424416 185647980 0.97
tpcds_q19/datafusion:parquet 37072348 37327112 0.99
tpcds_q20/datafusion:parquet 24743724 25401548 0.97
tpcds_q21/datafusion:parquet 29306126 29741050 0.99
tpcds_q22/datafusion:parquet 158444336 150860441 1.05
tpcds_q23/datafusion:parquet 188018711 196122796 0.96
tpcds_q24/datafusion:parquet 230837134 235348276 0.98
tpcds_q25/datafusion:parquet 191593582 197485203 0.97
tpcds_q26/datafusion:parquet 119326934 127685936 0.93
tpcds_q27/datafusion:parquet 269207550 283685785 0.95
tpcds_q28/datafusion:parquet 52048439 53559431 0.97
tpcds_q29/datafusion:parquet 194254554 197957432 0.98
tpcds_q30/datafusion:parquet 47690300 46290614 1.03
tpcds_q31/datafusion:parquet 108446992 109726643 0.99
tpcds_q32/datafusion:parquet 30874543 31805743 0.97
tpcds_q33/datafusion:parquet 37322117 38966395 0.96
tpcds_q34/datafusion:parquet 36323690 37565344 0.97
tpcds_q35/datafusion:parquet 99312124 102495550 0.97
tpcds_q36/datafusion:parquet 84938605 88540671 0.96
tpcds_q37/datafusion:parquet 25985330 28185374 0.92
tpcds_q38/datafusion:parquet 68739115 65741699 1.05
tpcds_q39/datafusion:parquet 97455817 96653862 1.01
tpcds_q40/datafusion:parquet 35732734 37953978 0.94
tpcds_q41/datafusion:parquet 13131814 14207479 0.92
tpcds_q42/datafusion:parquet 16661490 17315536 0.96
tpcds_q43/datafusion:parquet 26476040 27671342 0.96
tpcds_q44/datafusion:parquet 41637496 40008989 1.04
tpcds_q45/datafusion:parquet 73727334 78748716 0.94
tpcds_q46/datafusion:parquet 56450450 57295277 0.99
tpcds_q47/datafusion:parquet 195938419 195137542 1.00
tpcds_q48/datafusion:parquet 138271290 140049127 0.99
tpcds_q49/datafusion:parquet 73737336 77795133 0.95
tpcds_q50/datafusion:parquet 120640517 117718348 1.02
tpcds_q51/datafusion:parquet 101611513 100901317 1.01
🚀 tpcds_q52/datafusion:parquet 16268406 18148068 0.90
tpcds_q53/datafusion:parquet 30857270 32499565 0.95
tpcds_q54/datafusion:parquet 49909717 51789159 0.96
tpcds_q55/datafusion:parquet 17513463 17664677 0.99
tpcds_q56/datafusion:parquet 36932096 36317605 1.02
tpcds_q57/datafusion:parquet 136238315 135293548 1.01
tpcds_q58/datafusion:parquet 74935985 79307281 0.94
tpcds_q59/datafusion:parquet 72209441 73211235 0.99
tpcds_q60/datafusion:parquet 38125043 38430570 0.99
tpcds_q61/datafusion:parquet 68564850 70532928 0.97
tpcds_q62/datafusion:parquet 46423932 46090369 1.01
tpcds_q63/datafusion:parquet 32891950 33035035 1.00
tpcds_q64/datafusion:parquet 1036392563 1056796765 0.98
🚀 tpcds_q65/datafusion:parquet 53494571 59988365 0.89
tpcds_q66/datafusion:parquet 89992996 94671623 0.95
tpcds_q67/datafusion:parquet 176655204 189387071 0.93
tpcds_q68/datafusion:parquet 55672025 55524299 1.00
tpcds_q69/datafusion:parquet 95969652 100285397 0.96
🚀 tpcds_q70/datafusion:parquet 108408118 124203401 0.87
tpcds_q71/datafusion:parquet 30218621 31459560 0.96
tpcds_q72/datafusion:parquet 883961580 922624361 0.96
tpcds_q73/datafusion:parquet 38586462 38742159 1.00
tpcds_q74/datafusion:parquet 131614492 141028928 0.93
tpcds_q75/datafusion:parquet 137099971 145584208 0.94
tpcds_q76/datafusion:parquet 99074267 101706076 0.97
tpcds_q77/datafusion:parquet 60895508 61498022 0.99
tpcds_q78/datafusion:parquet 183406803 188381272 0.97
tpcds_q79/datafusion:parquet 41162324 42425472 0.97
tpcds_q80/datafusion:parquet 113223272 115643686 0.98
tpcds_q81/datafusion:parquet 44613572 46569566 0.96
tpcds_q82/datafusion:parquet 29897863 30256748 0.99
tpcds_q83/datafusion:parquet 57369911 57812833 0.99
tpcds_q84/datafusion:parquet 50409945 51024050 0.99
tpcds_q85/datafusion:parquet 254756133 256480822 0.99
tpcds_q86/datafusion:parquet 21951017 23502670 0.93
tpcds_q87/datafusion:parquet 67892218 72869342 0.93
tpcds_q88/datafusion:parquet 81795058 80314623 1.02
🚀 tpcds_q89/datafusion:parquet 37461742 41682339 0.90
🚀 tpcds_q90/datafusion:parquet 19000601 21884273 0.87
tpcds_q91/datafusion:parquet 79726630 81360892 0.98
tpcds_q92/datafusion:parquet 26047387 27238470 0.96
tpcds_q93/datafusion:parquet 39296593 41655365 0.94
tpcds_q94/datafusion:parquet 30333127 30943814 0.98
tpcds_q95/datafusion:parquet 144382335 156591208 0.92
tpcds_q96/datafusion:parquet 14734522 15986008 0.92
tpcds_q97/datafusion:parquet 36540159 38185415 0.96
tpcds_q98/datafusion:parquet 37573837 41198525 0.91
🚀 tpcds_q99/datafusion:parquet 45829020 51249154 0.89
duckdb / vortex-file-compressed (0.966x ➖, 5↑ 1↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 26533404 27954565 0.95
tpcds_q02/duckdb:vortex-file-compressed 86876869 87997230 0.99
tpcds_q03/duckdb:vortex-file-compressed 23340371 22751678 1.03
tpcds_q04/duckdb:vortex-file-compressed 105037675 107786927 0.97
🚀 tpcds_q05/duckdb:vortex-file-compressed 97435591 108794537 0.90
tpcds_q06/duckdb:vortex-file-compressed 36079015 37777810 0.96
tpcds_q07/duckdb:vortex-file-compressed 23822727 24061795 0.99
tpcds_q08/duckdb:vortex-file-compressed 24135332 24297995 0.99
tpcds_q09/duckdb:vortex-file-compressed 40131007 40194087 1.00
tpcds_q10/duckdb:vortex-file-compressed 37251150 37668752 0.99
tpcds_q11/duckdb:vortex-file-compressed 60308568 60126028 1.00
tpcds_q12/duckdb:vortex-file-compressed 14945209 15351269 0.97
tpcds_q13/duckdb:vortex-file-compressed 32338501 34825358 0.93
tpcds_q14/duckdb:vortex-file-compressed 193080136 208705377 0.93
tpcds_q15/duckdb:vortex-file-compressed 41903811 45183617 0.93
tpcds_q16/duckdb:vortex-file-compressed 32557407 31228337 1.04
tpcds_q17/duckdb:vortex-file-compressed 39380353 40774169 0.97
tpcds_q18/duckdb:vortex-file-compressed 45914376 47269546 0.97
tpcds_q19/duckdb:vortex-file-compressed 33516927 33257508 1.01
tpcds_q20/duckdb:vortex-file-compressed 16781613 17264527 0.97
tpcds_q21/duckdb:vortex-file-compressed 20078030 21838914 0.92
tpcds_q22/duckdb:vortex-file-compressed 106211236 109051909 0.97
tpcds_q23/duckdb:vortex-file-compressed 130360906 128432183 1.02
tpcds_q24/duckdb:vortex-file-compressed 56352605 57284700 0.98
tpcds_q25/duckdb:vortex-file-compressed 38666753 38654829 1.00
tpcds_q26/duckdb:vortex-file-compressed 41636286 43475897 0.96
tpcds_q27/duckdb:vortex-file-compressed 92729291 92189886 1.01
tpcds_q28/duckdb:vortex-file-compressed 37111264 39630563 0.94
tpcds_q29/duckdb:vortex-file-compressed 37993541 37403733 1.02
tpcds_q30/duckdb:vortex-file-compressed 29427105 32215056 0.91
tpcds_q31/duckdb:vortex-file-compressed 26463048 26110814 1.01
tpcds_q32/duckdb:vortex-file-compressed 16908188 17167346 0.98
tpcds_q33/duckdb:vortex-file-compressed 65568740 69144578 0.95
tpcds_q34/duckdb:vortex-file-compressed 19922404 19295418 1.03
tpcds_q35/duckdb:vortex-file-compressed 68838140 69640437 0.99
tpcds_q36/duckdb:vortex-file-compressed 27071549 28629778 0.95
tpcds_q37/duckdb:vortex-file-compressed 23412222 25567340 0.92
tpcds_q38/duckdb:vortex-file-compressed 36863597 37438134 0.98
🚀 tpcds_q39/duckdb:vortex-file-compressed 44490576 52928633 0.84
tpcds_q40/duckdb:vortex-file-compressed 25861129 26759741 0.97
tpcds_q41/duckdb:vortex-file-compressed 13492793 14272674 0.95
tpcds_q42/duckdb:vortex-file-compressed 12255772 13105081 0.94
tpcds_q43/duckdb:vortex-file-compressed 20305652 21276686 0.95
tpcds_q44/duckdb:vortex-file-compressed 23666795 25503476 0.93
tpcds_q45/duckdb:vortex-file-compressed 27810148 28606082 0.97
tpcds_q46/duckdb:vortex-file-compressed 48096113 49017861 0.98
tpcds_q47/duckdb:vortex-file-compressed 49217897 49562698 0.99
tpcds_q48/duckdb:vortex-file-compressed 29884535 31301627 0.95
tpcds_q49/duckdb:vortex-file-compressed 30801659 30722863 1.00
tpcds_q50/duckdb:vortex-file-compressed 34521210 35633804 0.97
tpcds_q51/duckdb:vortex-file-compressed 98832000 101410707 0.97
tpcds_q52/duckdb:vortex-file-compressed 11994314 13045592 0.92
tpcds_q53/duckdb:vortex-file-compressed 17408212 18126364 0.96
tpcds_q54/duckdb:vortex-file-compressed 50745134 52598221 0.96
tpcds_q55/duckdb:vortex-file-compressed 11614223 11925196 0.97
tpcds_q56/duckdb:vortex-file-compressed 64143578 69500755 0.92
tpcds_q57/duckdb:vortex-file-compressed 45353382 45222835 1.00
tpcds_q58/duckdb:vortex-file-compressed 33104313 35553604 0.93
tpcds_q59/duckdb:vortex-file-compressed 55241015 57727719 0.96
tpcds_q60/duckdb:vortex-file-compressed 69528194 73249114 0.95
tpcds_q61/duckdb:vortex-file-compressed 35975387 39266133 0.92
🚀 tpcds_q62/duckdb:vortex-file-compressed 18484447 22563654 0.82
tpcds_q63/duckdb:vortex-file-compressed 19484444 18389815 1.06
tpcds_q64/duckdb:vortex-file-compressed 77863478 80200991 0.97
tpcds_q65/duckdb:vortex-file-compressed 23268092 25276502 0.92
🚀 tpcds_q66/duckdb:vortex-file-compressed 55073428 61646554 0.89
tpcds_q67/duckdb:vortex-file-compressed 146444718 144755412 1.01
tpcds_q68/duckdb:vortex-file-compressed 41551213 42002928 0.99
tpcds_q69/duckdb:vortex-file-compressed 38321299 40720599 0.94
tpcds_q70/duckdb:vortex-file-compressed 23491823 25304697 0.93
tpcds_q71/duckdb:vortex-file-compressed 21105302 21408486 0.99
tpcds_q72/duckdb:vortex-file-compressed 176146423 179751277 0.98
tpcds_q73/duckdb:vortex-file-compressed 19387115 20554436 0.94
tpcds_q74/duckdb:vortex-file-compressed 50190938 53646096 0.94
tpcds_q75/duckdb:vortex-file-compressed 57926290 59413684 0.97
🚀 tpcds_q76/duckdb:vortex-file-compressed 56449306 70756580 0.80
tpcds_q77/duckdb:vortex-file-compressed 66676908 68104159 0.98
tpcds_q78/duckdb:vortex-file-compressed 80709321 82916991 0.97
tpcds_q79/duckdb:vortex-file-compressed 35082793 35649708 0.98
tpcds_q80/duckdb:vortex-file-compressed 90413400 95610906 0.95
tpcds_q81/duckdb:vortex-file-compressed 34717345 34724450 1.00
tpcds_q82/duckdb:vortex-file-compressed 23834220 24851444 0.96
tpcds_q83/duckdb:vortex-file-compressed 27672674 29401389 0.94
tpcds_q84/duckdb:vortex-file-compressed 17918658 18723206 0.96
tpcds_q85/duckdb:vortex-file-compressed 47283794 48164548 0.98
tpcds_q86/duckdb:vortex-file-compressed 16834831 17682818 0.95
tpcds_q87/duckdb:vortex-file-compressed 40071337 40893689 0.98
tpcds_q88/duckdb:vortex-file-compressed 40257978 43122802 0.93
tpcds_q89/duckdb:vortex-file-compressed 19384166 19049088 1.02
tpcds_q90/duckdb:vortex-file-compressed 15754226 15984745 0.99
tpcds_q91/duckdb:vortex-file-compressed 27304640 29557559 0.92
tpcds_q92/duckdb:vortex-file-compressed 15158637 14243347 1.06
tpcds_q93/duckdb:vortex-file-compressed 30594675 31689429 0.97
tpcds_q94/duckdb:vortex-file-compressed 22342270 23370274 0.96
tpcds_q95/duckdb:vortex-file-compressed 154271920 153813662 1.00
🚨 tpcds_q96/duckdb:vortex-file-compressed 22255040 17885190 1.24
tpcds_q97/duckdb:vortex-file-compressed 38639805 40970204 0.94
tpcds_q98/duckdb:vortex-file-compressed 18375681 19226491 0.96
tpcds_q99/duckdb:vortex-file-compressed 35043872 33509851 1.05
duckdb / vortex-compact (0.977x ➖, 4↑ 1↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 36654597 35129208 1.04
tpcds_q02/duckdb:vortex-compact 125155530 129491110 0.97
tpcds_q03/duckdb:vortex-compact 51487389 53054971 0.97
tpcds_q04/duckdb:vortex-compact 127301174 128303182 0.99
tpcds_q05/duckdb:vortex-compact 178590583 175978121 1.01
tpcds_q06/duckdb:vortex-compact 41845740 42446090 0.99
tpcds_q07/duckdb:vortex-compact 39392303 40204398 0.98
tpcds_q08/duckdb:vortex-compact 29373174 30599795 0.96
tpcds_q09/duckdb:vortex-compact 113078921 112969978 1.00
tpcds_q10/duckdb:vortex-compact 48831060 52990532 0.92
tpcds_q11/duckdb:vortex-compact 77719302 83428431 0.93
tpcds_q12/duckdb:vortex-compact 21109720 20551645 1.03
tpcds_q13/duckdb:vortex-compact 54909090 55399917 0.99
tpcds_q14/duckdb:vortex-compact 290703486 293440522 0.99
tpcds_q15/duckdb:vortex-compact 47744856 47392542 1.01
tpcds_q16/duckdb:vortex-compact 38410495 39662380 0.97
tpcds_q17/duckdb:vortex-compact 53400080 51803104 1.03
tpcds_q18/duckdb:vortex-compact 69650458 67829288 1.03
tpcds_q19/duckdb:vortex-compact 41448847 41911257 0.99
tpcds_q20/duckdb:vortex-compact 21718251 22225047 0.98
tpcds_q21/duckdb:vortex-compact 26116848 28573870 0.91
tpcds_q22/duckdb:vortex-compact 113567536 113806771 1.00
tpcds_q23/duckdb:vortex-compact 169242088 179532056 0.94
tpcds_q24/duckdb:vortex-compact 76367298 80121258 0.95
tpcds_q25/duckdb:vortex-compact 52787952 56025610 0.94
tpcds_q26/duckdb:vortex-compact 55958217 52347475 1.07
tpcds_q27/duckdb:vortex-compact 143163713 149075948 0.96
tpcds_q28/duckdb:vortex-compact 109106848 110110740 0.99
tpcds_q29/duckdb:vortex-compact 53721845 54797999 0.98
tpcds_q30/duckdb:vortex-compact 37118168 36359080 1.02
🚀 tpcds_q31/duckdb:vortex-compact 29040252 33200731 0.87
tpcds_q32/duckdb:vortex-compact 23361435 23610665 0.99
tpcds_q33/duckdb:vortex-compact 144068285 152218967 0.95
tpcds_q34/duckdb:vortex-compact 31051454 30516840 1.02
tpcds_q35/duckdb:vortex-compact 74356549 77716853 0.96
tpcds_q36/duckdb:vortex-compact 35433996 35258055 1.00
tpcds_q37/duckdb:vortex-compact 31583869 33934912 0.93
tpcds_q38/duckdb:vortex-compact 39223600 39496941 0.99
🚀 tpcds_q39/duckdb:vortex-compact 53135211 60261101 0.88
tpcds_q40/duckdb:vortex-compact 31056154 30502866 1.02
tpcds_q41/duckdb:vortex-compact 17774455 18595222 0.96
tpcds_q42/duckdb:vortex-compact 15092511 16484602 0.92
tpcds_q43/duckdb:vortex-compact 24490847 24916172 0.98
tpcds_q44/duckdb:vortex-compact 35828403 35998713 1.00
tpcds_q45/duckdb:vortex-compact 34069014 35815255 0.95
tpcds_q46/duckdb:vortex-compact 63031972 65215948 0.97
tpcds_q47/duckdb:vortex-compact 56100368 57588450 0.97
tpcds_q48/duckdb:vortex-compact 45585425 47109047 0.97
tpcds_q49/duckdb:vortex-compact 48824467 49299184 0.99
tpcds_q50/duckdb:vortex-compact 56122670 56023252 1.00
tpcds_q51/duckdb:vortex-compact 105808739 105038683 1.01
tpcds_q52/duckdb:vortex-compact 15558844 17203095 0.90
tpcds_q53/duckdb:vortex-compact 22691539 23567483 0.96
tpcds_q54/duckdb:vortex-compact 88452645 94212552 0.94
tpcds_q55/duckdb:vortex-compact 16330780 14894979 1.10
tpcds_q56/duckdb:vortex-compact 142779134 155281547 0.92
tpcds_q57/duckdb:vortex-compact 48952320 49482920 0.99
tpcds_q58/duckdb:vortex-compact 44348177 45737784 0.97
tpcds_q59/duckdb:vortex-compact 69109777 68551969 1.01
tpcds_q60/duckdb:vortex-compact 154706748 150604272 1.03
tpcds_q61/duckdb:vortex-compact 50833289 55859318 0.91
🚨 tpcds_q62/duckdb:vortex-compact 29695392 26581074 1.12
tpcds_q63/duckdb:vortex-compact 23350875 24122552 0.97
tpcds_q64/duckdb:vortex-compact 107432047 108707024 0.99
tpcds_q65/duckdb:vortex-compact 28546447 29980778 0.95
tpcds_q66/duckdb:vortex-compact 105427644 102897892 1.02
tpcds_q67/duckdb:vortex-compact 150566112 153724300 0.98
tpcds_q68/duckdb:vortex-compact 57763591 57414256 1.01
tpcds_q69/duckdb:vortex-compact 51297057 50674297 1.01
tpcds_q70/duckdb:vortex-compact 29070582 29326725 0.99
tpcds_q71/duckdb:vortex-compact 26541174 26318705 1.01
tpcds_q72/duckdb:vortex-compact 196712165 198814032 0.99
tpcds_q73/duckdb:vortex-compact 30095670 30686563 0.98
tpcds_q74/duckdb:vortex-compact 61351908 63691986 0.96
tpcds_q75/duckdb:vortex-compact 69257825 74034812 0.94
tpcds_q76/duckdb:vortex-compact 129224506 129762414 1.00
tpcds_q77/duckdb:vortex-compact 143480690 142681041 1.01
tpcds_q78/duckdb:vortex-compact 89600851 92343775 0.97
tpcds_q79/duckdb:vortex-compact 62764006 64353892 0.98
tpcds_q80/duckdb:vortex-compact 175880770 179359130 0.98
tpcds_q81/duckdb:vortex-compact 42649799 43527361 0.98
tpcds_q82/duckdb:vortex-compact 31423779 30692757 1.02
tpcds_q83/duckdb:vortex-compact 47062812 49910979 0.94
tpcds_q84/duckdb:vortex-compact 22092373 23275635 0.95
tpcds_q85/duckdb:vortex-compact 65794246 65103441 1.01
🚀 tpcds_q86/duckdb:vortex-compact 20493176 23851941 0.86
tpcds_q87/duckdb:vortex-compact 43001060 43237198 0.99
tpcds_q88/duckdb:vortex-compact 45319130 46232126 0.98
tpcds_q89/duckdb:vortex-compact 25238700 24372420 1.04
tpcds_q90/duckdb:vortex-compact 16578898 17616813 0.94
tpcds_q91/duckdb:vortex-compact 47016543 46401417 1.01
tpcds_q92/duckdb:vortex-compact 20295079 21727732 0.93
tpcds_q93/duckdb:vortex-compact 37048698 38856507 0.95
tpcds_q94/duckdb:vortex-compact 31164826 28587225 1.09
🚀 tpcds_q95/duckdb:vortex-compact 148997459 166109053 0.90
tpcds_q96/duckdb:vortex-compact 18922201 19913246 0.95
tpcds_q97/duckdb:vortex-compact 41215256 43472551 0.95
tpcds_q98/duckdb:vortex-compact 22976988 24287357 0.95
tpcds_q99/duckdb:vortex-compact 35421663 37331303 0.95
duckdb / parquet (0.987x ➖, 1↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 45808636 45966257 1.00
tpcds_q02/duckdb:parquet 59642566 61523099 0.97
tpcds_q03/duckdb:parquet 12327653 12670738 0.97
tpcds_q04/duckdb:parquet 126509913 127875781 0.99
tpcds_q05/duckdb:parquet 76727716 73787672 1.04
tpcds_q06/duckdb:parquet 28941181 30170599 0.96
tpcds_q07/duckdb:parquet 23404610 24388326 0.96
tpcds_q08/duckdb:parquet 29020933 28949236 1.00
tpcds_q09/duckdb:parquet 39720200 39915966 1.00
tpcds_q10/duckdb:parquet 36924666 37928146 0.97
tpcds_q11/duckdb:parquet 90541326 89883536 1.01
tpcds_q12/duckdb:parquet 14856095 15577244 0.95
tpcds_q13/duckdb:parquet 34675843 35648169 0.97
tpcds_q14/duckdb:parquet 158696092 163830964 0.97
tpcds_q15/duckdb:parquet 30339249 30044733 1.01
tpcds_q16/duckdb:parquet 21840465 22297405 0.98
tpcds_q17/duckdb:parquet 39510910 39537598 1.00
tpcds_q18/duckdb:parquet 45833724 48365551 0.95
tpcds_q19/duckdb:parquet 29327244 30834701 0.95
tpcds_q20/duckdb:parquet 15837876 15610191 1.01
tpcds_q21/duckdb:parquet 11959645 11599492 1.03
tpcds_q22/duckdb:parquet 71318009 70510537 1.01
tpcds_q23/duckdb:parquet 110863417 111623285 0.99
tpcds_q24/duckdb:parquet 46165003 47630582 0.97
tpcds_q25/duckdb:parquet 33937696 34263728 0.99
tpcds_q26/duckdb:parquet 38018433 39243766 0.97
tpcds_q27/duckdb:parquet 89275615 91383280 0.98
tpcds_q28/duckdb:parquet 36946056 36918868 1.00
tpcds_q29/duckdb:parquet 35505474 36254648 0.98
tpcds_q30/duckdb:parquet 41048379 40963122 1.00
🚀 tpcds_q31/duckdb:parquet 22120451 24760959 0.89
tpcds_q32/duckdb:parquet 11653700 11091606 1.05
tpcds_q33/duckdb:parquet 67414539 70966714 0.95
tpcds_q34/duckdb:parquet 21083560 21889403 0.96
tpcds_q35/duckdb:parquet 61232841 63430516 0.97
tpcds_q36/duckdb:parquet 21239501 21099253 1.01
tpcds_q37/duckdb:parquet 13715313 14323217 0.96
tpcds_q38/duckdb:parquet 33519409 34884750 0.96
tpcds_q39/duckdb:parquet 32528251 33417026 0.97
tpcds_q40/duckdb:parquet 18720699 19151770 0.98
tpcds_q41/duckdb:parquet 7479480 8179070 0.91
tpcds_q42/duckdb:parquet 10657350 11270852 0.95
tpcds_q43/duckdb:parquet 16125858 16250429 0.99
tpcds_q44/duckdb:parquet 20985828 21195897 0.99
tpcds_q45/duckdb:parquet 27414279 27116143 1.01
tpcds_q46/duckdb:parquet 45689156 49651472 0.92
tpcds_q47/duckdb:parquet 47068560 45614164 1.03
tpcds_q48/duckdb:parquet 31153442 33952244 0.92
tpcds_q49/duckdb:parquet 24894001 24594956 1.01
tpcds_q50/duckdb:parquet 25196672 26556638 0.95
tpcds_q51/duckdb:parquet 93994176 97277914 0.97
tpcds_q52/duckdb:parquet 11436790 11675435 0.98
tpcds_q53/duckdb:parquet 16675594 16696448 1.00
tpcds_q54/duckdb:parquet 41079939 41883678 0.98
tpcds_q55/duckdb:parquet 11308931 10979952 1.03
tpcds_q56/duckdb:parquet 65450227 67573612 0.97
tpcds_q57/duckdb:parquet 36526418 35732851 1.02
tpcds_q58/duckdb:parquet 22060049 22278352 0.99
tpcds_q59/duckdb:parquet 37884011 36612468 1.03
tpcds_q60/duckdb:parquet 68485431 67967394 1.01
tpcds_q61/duckdb:parquet 29465731 28614620 1.03
tpcds_q62/duckdb:parquet 12273368 12776978 0.96
tpcds_q63/duckdb:parquet 15710408 16080425 0.98
tpcds_q64/duckdb:parquet 75136440 75794129 0.99
tpcds_q65/duckdb:parquet 20403629 20894310 0.98
tpcds_q66/duckdb:parquet 54160599 57190891 0.95
tpcds_q67/duckdb:parquet 138851516 138897649 1.00
tpcds_q68/duckdb:parquet 39247694 39222008 1.00
tpcds_q69/duckdb:parquet 38881412 36701303 1.06
tpcds_q70/duckdb:parquet 20230308 20333200 0.99
tpcds_q71/duckdb:parquet 17762540 17559341 1.01
tpcds_q72/duckdb:parquet 165030095 166647836 0.99
tpcds_q73/duckdb:parquet 18529507 19190890 0.97
tpcds_q74/duckdb:parquet 52160830 51012949 1.02
tpcds_q75/duckdb:parquet 53302565 56087516 0.95
tpcds_q76/duckdb:parquet 62300425 66488007 0.94
tpcds_q77/duckdb:parquet 64958882 64183879 1.01
tpcds_q78/duckdb:parquet 76888963 77700873 0.99
tpcds_q79/duckdb:parquet 27768376 29328579 0.95
tpcds_q80/duckdb:parquet 84914379 84203535 1.01
tpcds_q81/duckdb:parquet 47502075 48615642 0.98
tpcds_q82/duckdb:parquet 16213809 15967315 1.02
tpcds_q83/duckdb:parquet 16680014 16867525 0.99
tpcds_q84/duckdb:parquet 19644122 20507500 0.96
tpcds_q85/duckdb:parquet 40880149 40264763 1.02
tpcds_q86/duckdb:parquet 12603830 12582962 1.00
tpcds_q87/duckdb:parquet 35969173 36262531 0.99
tpcds_q88/duckdb:parquet 29409298 29509406 1.00
tpcds_q89/duckdb:parquet 17847085 17609214 1.01
tpcds_q90/duckdb:parquet 8239301 7581108 1.09
tpcds_q91/duckdb:parquet 25446433 24009884 1.06
tpcds_q92/duckdb:parquet 11596022 11696217 0.99
tpcds_q93/duckdb:parquet 30252460 30251648 1.00
tpcds_q94/duckdb:parquet 16453649 17035064 0.97
tpcds_q95/duckdb:parquet 149648073 144816117 1.03
tpcds_q96/duckdb:parquet 9385956 9769592 0.96
tpcds_q97/duckdb:parquet 37543013 37301718 1.01
tpcds_q98/duckdb:parquet 18404444 18074771 1.02
tpcds_q99/duckdb:parquet 20904666 20899693 1.00
duckdb / duckdb (0.981x ➖, 3↑ 2↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20472292 20554514 1.00
tpcds_q02/duckdb:duckdb 19472317 19054781 1.02
tpcds_q03/duckdb:duckdb 8508862 8799825 0.97
tpcds_q04/duckdb:duckdb 162948275 163437290 1.00
🚨 tpcds_q05/duckdb:duckdb 19133050 17261906 1.11
🚀 tpcds_q06/duckdb:duckdb 21992551 25518329 0.86
tpcds_q07/duckdb:duckdb 39112008 38062578 1.03
tpcds_q08/duckdb:duckdb 120862440 122314579 0.99
tpcds_q09/duckdb:duckdb 19611640 19691923 1.00
tpcds_q10/duckdb:duckdb 23865116 24581324 0.97
tpcds_q11/duckdb:duckdb 139212099 141619814 0.98
tpcds_q12/duckdb:duckdb 11959157 11506115 1.04
tpcds_q13/duckdb:duckdb 24442117 24730414 0.99
tpcds_q14/duckdb:duckdb 95539617 94896121 1.01
tpcds_q15/duckdb:duckdb 24872433 23099594 1.08
tpcds_q16/duckdb:duckdb 17890736 18189076 0.98
tpcds_q17/duckdb:duckdb 21214423 20942909 1.01
tpcds_q18/duckdb:duckdb 46320057 43492408 1.07
tpcds_q19/duckdb:duckdb 16520637 16871707 0.98
tpcds_q20/duckdb:duckdb 11592875 12815804 0.90
tpcds_q21/duckdb:duckdb 6626855 7043362 0.94
tpcds_q22/duckdb:duckdb 65356411 63384001 1.03
tpcds_q23/duckdb:duckdb 69056804 70571805 0.98
tpcds_q24/duckdb:duckdb 23257459 24536986 0.95
tpcds_q25/duckdb:duckdb 17590445 17752861 0.99
tpcds_q26/duckdb:duckdb 26382929 27239642 0.97
tpcds_q27/duckdb:duckdb 41030953 40975403 1.00
tpcds_q28/duckdb:duckdb 20903611 21218199 0.99
tpcds_q29/duckdb:duckdb 19945133 21332133 0.93
tpcds_q30/duckdb:duckdb 29810085 29530807 1.01
tpcds_q31/duckdb:duckdb 20134177 20460275 0.98
tpcds_q32/duckdb:duckdb 7509795 7748710 0.97
tpcds_q33/duckdb:duckdb 12563337 12639701 0.99
tpcds_q34/duckdb:duckdb 14763054 15353440 0.96
tpcds_q35/duckdb:duckdb 31951121 34490874 0.93
tpcds_q36/duckdb:duckdb 66939929 72233574 0.93
tpcds_q37/duckdb:duckdb 7421542 7460837 0.99
tpcds_q38/duckdb:duckdb 30795321 30482588 1.01
tpcds_q39/duckdb:duckdb 25917439 28446129 0.91
🚀 tpcds_q40/duckdb:duckdb 13681697 15395164 0.89
tpcds_q41/duckdb:duckdb 8266427 8393048 0.98
tpcds_q42/duckdb:duckdb 6561076 6552515 1.00
tpcds_q43/duckdb:duckdb 11348864 11182088 1.01
🚀 tpcds_q44/duckdb:duckdb 12367149 14004072 0.88
tpcds_q45/duckdb:duckdb 17262017 18332568 0.94
tpcds_q46/duckdb:duckdb 36581825 39244871 0.93
tpcds_q47/duckdb:duckdb 41654773 41582052 1.00
tpcds_q48/duckdb:duckdb 21928366 23317098 0.94
tpcds_q49/duckdb:duckdb 17059621 16258299 1.05
tpcds_q50/duckdb:duckdb 13749269 14207965 0.97
tpcds_q51/duckdb:duckdb 91348659 93094919 0.98
tpcds_q52/duckdb:duckdb 7579236 7982186 0.95
tpcds_q53/duckdb:duckdb 11796369 12187970 0.97
tpcds_q54/duckdb:duckdb 17776530 17468659 1.02
tpcds_q55/duckdb:duckdb 6917766 7207373 0.96
tpcds_q56/duckdb:duckdb 13517796 13605797 0.99
🚨 tpcds_q57/duckdb:duckdb 38623553 31992924 1.21
tpcds_q58/duckdb:duckdb 12466320 12411661 1.00
tpcds_q59/duckdb:duckdb 34689251 34890637 0.99
tpcds_q60/duckdb:duckdb 14943304 14959872 1.00
tpcds_q61/duckdb:duckdb 14577410 15894798 0.92
tpcds_q62/duckdb:duckdb 9505584 9524235 1.00
tpcds_q63/duckdb:duckdb 11099504 11663018 0.95
tpcds_q64/duckdb:duckdb 54714376 53635933 1.02
tpcds_q65/duckdb:duckdb 31554351 34851059 0.91
tpcds_q66/duckdb:duckdb 25273028 25211156 1.00
tpcds_q67/duckdb:duckdb 130625305 133117034 0.98
tpcds_q68/duckdb:duckdb 25245662 25484098 0.99
tpcds_q69/duckdb:duckdb 24535119 23856739 1.03
tpcds_q70/duckdb:duckdb 14091442 14236075 0.99
tpcds_q71/duckdb:duckdb 11756184 12560663 0.94
tpcds_q72/duckdb:duckdb 43240705 43811442 0.99
tpcds_q73/duckdb:duckdb 10424023 10790887 0.97
tpcds_q74/duckdb:duckdb 96742233 102183007 0.95
tpcds_q75/duckdb:duckdb 41241566 44408526 0.93
tpcds_q76/duckdb:duckdb 11308204 11591558 0.98
tpcds_q77/duckdb:duckdb 11387114 11596394 0.98
tpcds_q78/duckdb:duckdb 62534000 63276126 0.99
tpcds_q79/duckdb:duckdb 17615431 18163055 0.97
tpcds_q80/duckdb:duckdb 27168937 28411219 0.96
tpcds_q81/duckdb:duckdb 37802208 36541311 1.03
tpcds_q82/duckdb:duckdb 8324347 9027083 0.92
tpcds_q83/duckdb:duckdb 9174623 9754660 0.94
tpcds_q84/duckdb:duckdb 13426609 13752925 0.98
tpcds_q85/duckdb:duckdb 24813427 25040856 0.99
tpcds_q86/duckdb:duckdb 11152345 10970999 1.02
tpcds_q87/duckdb:duckdb 32861458 32137867 1.02
tpcds_q88/duckdb:duckdb 24052904 24180977 0.99
tpcds_q89/duckdb:duckdb 13021386 14287277 0.91
tpcds_q90/duckdb:duckdb 5717568 5650332 1.01
tpcds_q91/duckdb:duckdb 11747608 12337347 0.95
tpcds_q92/duckdb:duckdb 8771475 9363170 0.94
tpcds_q93/duckdb:duckdb 22599556 22761960 0.99
tpcds_q94/duckdb:duckdb 13264724 13217746 1.00
tpcds_q95/duckdb:duckdb 129873534 131708242 0.99
tpcds_q96/duckdb:duckdb 4563889 4678281 0.98
tpcds_q97/duckdb:duckdb 30998915 31497627 0.98
tpcds_q98/duckdb:duckdb 14673470 13962065 1.05
tpcds_q99/duckdb:duckdb 16195671 16213226 1.00

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 11, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 11, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: TPC-H SF=10 on NVME

Summary

  • Overall: 0.962x ➖
  • Vortex: 0.957x ➖
  • Parquet: 0.954x ➖
datafusion / vortex-file-compressed (0.956x ➖, 1↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 421566327 464753218 0.91
tpch_q02/datafusion:vortex-file-compressed 167373040 178124054 0.94
tpch_q03/datafusion:vortex-file-compressed 256097071 277779924 0.92
tpch_q04/datafusion:vortex-file-compressed 110567186 116253787 0.95
tpch_q05/datafusion:vortex-file-compressed 469633500 493123627 0.95
🚀 tpch_q06/datafusion:vortex-file-compressed 40926265 46319819 0.88
tpch_q07/datafusion:vortex-file-compressed 665947580 693619827 0.96
tpch_q08/datafusion:vortex-file-compressed 498965746 514397136 0.97
tpch_q09/datafusion:vortex-file-compressed 839083697 866872898 0.97
tpch_q10/datafusion:vortex-file-compressed 293613751 302588014 0.97
tpch_q11/datafusion:vortex-file-compressed 124702297 125728098 0.99
tpch_q12/datafusion:vortex-file-compressed 130807308 135721465 0.96
tpch_q13/datafusion:vortex-file-compressed 233340227 239454322 0.97
tpch_q14/datafusion:vortex-file-compressed 75288042 75825120 0.99
tpch_q15/datafusion:vortex-file-compressed 110268079 112901179 0.98
tpch_q16/datafusion:vortex-file-compressed 97889049 103089855 0.95
tpch_q17/datafusion:vortex-file-compressed 765424269 800501094 0.96
tpch_q18/datafusion:vortex-file-compressed 975892547 1043601184 0.94
tpch_q19/datafusion:vortex-file-compressed 134487562 131163452 1.03
tpch_q20/datafusion:vortex-file-compressed 209496403 216920100 0.97
tpch_q21/datafusion:vortex-file-compressed 785681992 822523568 0.96
tpch_q22/datafusion:vortex-file-compressed 58434229 63299053 0.92
datafusion / vortex-compact (0.955x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 464690782 462176958 1.01
tpch_q02/datafusion:vortex-compact 171056772 178231919 0.96
tpch_q03/datafusion:vortex-compact 274712329 286151867 0.96
tpch_q04/datafusion:vortex-compact 133566072 137065292 0.97
tpch_q05/datafusion:vortex-compact 478276340 495181576 0.97
tpch_q06/datafusion:vortex-compact 63353000 65266115 0.97
tpch_q07/datafusion:vortex-compact 684495575 691953086 0.99
tpch_q08/datafusion:vortex-compact 510275696 510586838 1.00
tpch_q09/datafusion:vortex-compact 847435235 871453739 0.97
tpch_q10/datafusion:vortex-compact 330288617 352425225 0.94
tpch_q11/datafusion:vortex-compact 125978482 135973358 0.93
tpch_q12/datafusion:vortex-compact 190510487 202144488 0.94
tpch_q13/datafusion:vortex-compact 275266564 293884004 0.94
tpch_q14/datafusion:vortex-compact 92098991 99373861 0.93
tpch_q15/datafusion:vortex-compact 166931870 177690984 0.94
tpch_q16/datafusion:vortex-compact 101007864 109793784 0.92
tpch_q17/datafusion:vortex-compact 756059955 835406495 0.91
tpch_q18/datafusion:vortex-compact 982149462 1078566072 0.91
tpch_q19/datafusion:vortex-compact 233162471 238796187 0.98
tpch_q20/datafusion:vortex-compact 228206535 244534350 0.93
tpch_q21/datafusion:vortex-compact 815853808 848179560 0.96
tpch_q22/datafusion:vortex-compact 70508608 69988041 1.01
datafusion / parquet (0.928x ➖, 5↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 463149748 512605334 0.90
tpch_q02/datafusion:parquet 276586493 291949517 0.95
🚀 tpch_q03/datafusion:parquet 399952868 457896621 0.87
🚀 tpch_q04/datafusion:parquet 148074499 172739875 0.86
🚀 tpch_q05/datafusion:parquet 591116058 660332639 0.90
tpch_q06/datafusion:parquet 129077914 136615374 0.94
🚀 tpch_q07/datafusion:parquet 810747658 912499673 0.89
tpch_q08/datafusion:parquet 667055898 733613621 0.91
tpch_q09/datafusion:parquet 976061969 1042116890 0.94
tpch_q10/datafusion:parquet 607787345 629869865 0.96
tpch_q11/datafusion:parquet 201625268 219236474 0.92
🚀 tpch_q12/datafusion:parquet 235195563 272581125 0.86
tpch_q13/datafusion:parquet 341725065 351334579 0.97
tpch_q14/datafusion:parquet 199385382 206479624 0.97
tpch_q15/datafusion:parquet 268796944 274970683 0.98
tpch_q16/datafusion:parquet 184261389 194152419 0.95
tpch_q17/datafusion:parquet 858171392 913063760 0.94
tpch_q18/datafusion:parquet 1059605127 1149526839 0.92
tpch_q19/datafusion:parquet 338863430 359279260 0.94
tpch_q20/datafusion:parquet 384678528 397934468 0.97
tpch_q21/datafusion:parquet 911226070 961385333 0.95
tpch_q22/datafusion:parquet 220432873 231002292 0.95
datafusion / arrow (0.969x ➖, 2↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 760690764 714739077 1.06
tpch_q02/datafusion:arrow 212049880 208752629 1.02
tpch_q03/datafusion:arrow 578547045 563073021 1.03
tpch_q04/datafusion:arrow 438730842 419643801 1.05
tpch_q05/datafusion:arrow 1130621828 1131638226 1.00
tpch_q06/datafusion:arrow 321974423 324396321 0.99
tpch_q07/datafusion:arrow 1427529973 1399124113 1.02
tpch_q08/datafusion:arrow 1365639801 1417828828 0.96
tpch_q09/datafusion:arrow 1619262797 1727123241 0.94
tpch_q10/datafusion:arrow 686149641 722087049 0.95
tpch_q11/datafusion:arrow 184815079 186966348 0.99
🚀 tpch_q12/datafusion:arrow 782847577 897689122 0.87
tpch_q13/datafusion:arrow 539339044 543487995 0.99
tpch_q14/datafusion:arrow 361412967 388911794 0.93
tpch_q15/datafusion:arrow 805026363 843564746 0.95
tpch_q16/datafusion:arrow 126978070 132668664 0.96
tpch_q17/datafusion:arrow 1593109223 1744044363 0.91
tpch_q18/datafusion:arrow 2128793523 2301721095 0.92
tpch_q19/datafusion:arrow 603028778 601406165 1.00
tpch_q20/datafusion:arrow 576661836 595637560 0.97
tpch_q21/datafusion:arrow 4111070119 4280158861 0.96
🚀 tpch_q22/datafusion:arrow 180995470 207453273 0.87
duckdb / vortex-file-compressed (0.967x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 175069086 178599818 0.98
tpch_q02/duckdb:vortex-file-compressed 50510951 53747154 0.94
tpch_q03/duckdb:vortex-file-compressed 127863864 130145398 0.98
tpch_q04/duckdb:vortex-file-compressed 146866985 153945129 0.95
tpch_q05/duckdb:vortex-file-compressed 126853829 134870443 0.94
tpch_q06/duckdb:vortex-file-compressed 48620917 48039308 1.01
tpch_q07/duckdb:vortex-file-compressed 144234072 145882103 0.99
tpch_q08/duckdb:vortex-file-compressed 173837784 174185570 1.00
tpch_q09/duckdb:vortex-file-compressed 327316712 336427401 0.97
tpch_q10/duckdb:vortex-file-compressed 151697533 154098951 0.98
tpch_q11/duckdb:vortex-file-compressed 35311117 36222595 0.97
tpch_q12/duckdb:vortex-file-compressed 91930998 98666759 0.93
tpch_q13/duckdb:vortex-file-compressed 238414380 247858091 0.96
tpch_q14/duckdb:vortex-file-compressed 66790127 73941232 0.90
tpch_q15/duckdb:vortex-file-compressed 95421750 99355578 0.96
tpch_q16/duckdb:vortex-file-compressed 78642931 80900581 0.97
tpch_q17/duckdb:vortex-file-compressed 98750272 104966621 0.94
tpch_q18/duckdb:vortex-file-compressed 287271474 275133624 1.04
tpch_q19/duckdb:vortex-file-compressed 89843310 92258081 0.97
tpch_q20/duckdb:vortex-file-compressed 159664236 168367914 0.95
tpch_q21/duckdb:vortex-file-compressed 550757803 567446035 0.97
tpch_q22/duckdb:vortex-file-compressed 76690688 80262517 0.96
duckdb / vortex-compact (0.948x ➖, 1↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 226498279 230674053 0.98
tpch_q02/duckdb:vortex-compact 57117018 60398443 0.95
tpch_q03/duckdb:vortex-compact 139358787 140879239 0.99
tpch_q04/duckdb:vortex-compact 176423984 178563295 0.99
tpch_q05/duckdb:vortex-compact 147923096 153302714 0.96
tpch_q06/duckdb:vortex-compact 84249990 88830979 0.95
tpch_q07/duckdb:vortex-compact 205448856 212897866 0.97
tpch_q08/duckdb:vortex-compact 189202360 198720811 0.95
tpch_q09/duckdb:vortex-compact 353874923 372417092 0.95
tpch_q10/duckdb:vortex-compact 182904960 197694236 0.93
tpch_q11/duckdb:vortex-compact 41833758 44110422 0.95
tpch_q12/duckdb:vortex-compact 209544569 218568674 0.96
tpch_q13/duckdb:vortex-compact 285721725 315694195 0.91
🚀 tpch_q14/duckdb:vortex-compact 101668008 113499380 0.90
tpch_q15/duckdb:vortex-compact 120540059 131518282 0.92
tpch_q16/duckdb:vortex-compact 86940107 91544742 0.95
tpch_q17/duckdb:vortex-compact 114248976 123995002 0.92
tpch_q18/duckdb:vortex-compact 303042748 302069052 1.00
tpch_q19/duckdb:vortex-compact 113577467 123183340 0.92
tpch_q20/duckdb:vortex-compact 203976281 219815419 0.93
tpch_q21/duckdb:vortex-compact 631897521 660973674 0.96
tpch_q22/duckdb:vortex-compact 87868242 92031657 0.95
duckdb / parquet (0.980x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 252166562 253122021 1.00
tpch_q02/duckdb:parquet 104783191 106140118 0.99
tpch_q03/duckdb:parquet 205730121 213398826 0.96
tpch_q04/duckdb:parquet 132218974 135293260 0.98
tpch_q05/duckdb:parquet 214377185 217316330 0.99
tpch_q06/duckdb:parquet 63401799 64358174 0.99
tpch_q07/duckdb:parquet 173049486 178536774 0.97
tpch_q08/duckdb:parquet 247214426 257746584 0.96
tpch_q09/duckdb:parquet 447723974 455557238 0.98
tpch_q10/duckdb:parquet 599497219 610224198 0.98
tpch_q11/duckdb:parquet 43378589 42811101 1.01
tpch_q12/duckdb:parquet 122793655 123307044 1.00
tpch_q13/duckdb:parquet 405651396 404559716 1.00
tpch_q14/duckdb:parquet 170609967 171394456 1.00
tpch_q15/duckdb:parquet 91883282 93088943 0.99
tpch_q16/duckdb:parquet 164319038 166577939 0.99
tpch_q17/duckdb:parquet 170953305 175252576 0.98
tpch_q18/duckdb:parquet 338693813 356471906 0.95
tpch_q19/duckdb:parquet 274757137 287208725 0.96
tpch_q20/duckdb:parquet 223958440 227559761 0.98
tpch_q21/duckdb:parquet 548022548 581674365 0.94
tpch_q22/duckdb:parquet 292252979 297610448 0.98
duckdb / duckdb (0.989x ➖, 0↑ 1↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 121447339 117270625 1.04
🚨 tpch_q02/duckdb:duckdb 50700851 45943497 1.10
tpch_q03/duckdb:duckdb 104118592 99877384 1.04
tpch_q04/duckdb:duckdb 144404423 141867260 1.02
tpch_q05/duckdb:duckdb 119395850 112787515 1.06
tpch_q06/duckdb:duckdb 37709741 40454669 0.93
tpch_q07/duckdb:duckdb 92130628 88400027 1.04
tpch_q08/duckdb:duckdb 120638990 118895445 1.01
tpch_q09/duckdb:duckdb 297446331 288963195 1.03
tpch_q10/duckdb:duckdb 212093989 216585192 0.98
tpch_q11/duckdb:duckdb 15236643 15938601 0.96
tpch_q12/duckdb:duckdb 84429355 87938761 0.96
tpch_q13/duckdb:duckdb 240835059 251660553 0.96
tpch_q14/duckdb:duckdb 70403390 74554011 0.94
tpch_q15/duckdb:duckdb 75991822 78248360 0.97
tpch_q16/duckdb:duckdb 74301609 77990440 0.95
tpch_q17/duckdb:duckdb 83734860 88639240 0.94
tpch_q18/duckdb:duckdb 213680950 225930665 0.95
tpch_q19/duckdb:duckdb 120108670 120597572 1.00
tpch_q20/duckdb:duckdb 111356988 114816682 0.97
tpch_q21/duckdb:duckdb 300428162 323818565 0.93
tpch_q22/duckdb:duckdb 72315758 71635099 1.01

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: FineWeb S3

Summary

  • Overall: 1.012x ➖
  • Vortex: 1.023x ➖
  • Parquet: 0.991x ➖
datafusion / vortex-file-compressed (1.025x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 31871273 33114872 0.96
fineweb_q01/datafusion:vortex-file-compressed 476965997 499167567 0.96
fineweb_q02/datafusion:vortex-file-compressed 557076052 494172811 1.13
fineweb_q03/datafusion:vortex-file-compressed 1429310693 1468045952 0.97
fineweb_q04/datafusion:vortex-file-compressed 1547792498 1372105274 1.13
fineweb_q05/datafusion:vortex-file-compressed 1411010225 1372537054 1.03
fineweb_q06/datafusion:vortex-file-compressed 1565285954 1491518047 1.05
fineweb_q07/datafusion:vortex-file-compressed 1405137281 1415802548 0.99
fineweb_q08/datafusion:vortex-file-compressed 565444781 550575220 1.03
datafusion / vortex-compact (1.019x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 34421732 34874912 0.99
fineweb_q01/datafusion:vortex-compact 531949656 508377557 1.05
fineweb_q02/datafusion:vortex-compact 630754879 623450773 1.01
fineweb_q03/datafusion:vortex-compact 1692517836 1711704124 0.99
fineweb_q04/datafusion:vortex-compact 2146664087 2144178497 1.00
fineweb_q05/datafusion:vortex-compact 1692109444 1633044673 1.04
fineweb_q06/datafusion:vortex-compact 1484074158 1387922243 1.07
fineweb_q07/datafusion:vortex-compact 1290092609 1292918935 1.00
fineweb_q08/datafusion:vortex-compact 409341154 396460218 1.03
datafusion / parquet (0.976x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1040413585 1056316360 0.98
fineweb_q01/datafusion:parquet 1756370700 1627450907 1.08
fineweb_q02/datafusion:parquet 1743436284 1658990992 1.05
fineweb_q03/datafusion:parquet 1678624328 2089083885 0.80
fineweb_q04/datafusion:parquet 1740382372 1635016474 1.06
fineweb_q05/datafusion:parquet 1732460352 1701661378 1.02
fineweb_q06/datafusion:parquet 1704742289 2152164175 0.79
fineweb_q07/datafusion:parquet 1728019716 1745328504 0.99
fineweb_q08/datafusion:parquet 1772233113 1678238872 1.06
duckdb / vortex-file-compressed (0.990x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 104334463 106197305 0.98
fineweb_q01/duckdb:vortex-file-compressed 569122212 523607323 1.09
fineweb_q02/duckdb:vortex-file-compressed 412678729 443157712 0.93
fineweb_q03/duckdb:vortex-file-compressed 1591179106 1572792856 1.01
fineweb_q04/duckdb:vortex-file-compressed 1730915119 1580182314 1.10
fineweb_q05/duckdb:vortex-file-compressed 1622608217 1643866206 0.99
fineweb_q06/duckdb:vortex-file-compressed 1722407117 1794078160 0.96
fineweb_q07/duckdb:vortex-file-compressed 1486944865 1643024647 0.91
fineweb_q08/duckdb:vortex-file-compressed 660502782 680506253 0.97
duckdb / vortex-compact (1.059x ➖, 0↑ 1↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 89521833 74271244 1.21
fineweb_q01/duckdb:vortex-compact 501009557 519988289 0.96
fineweb_q02/duckdb:vortex-compact 608626497 532542332 1.14
fineweb_q03/duckdb:vortex-compact 1728393447 1775562682 0.97
fineweb_q04/duckdb:vortex-compact 1818174680 1912170652 0.95
fineweb_q05/duckdb:vortex-compact 1656857665 1639784032 1.01
fineweb_q06/duckdb:vortex-compact 1513541588 1576394340 0.96
fineweb_q07/duckdb:vortex-compact 1410009766 1403204413 1.00
🚨 fineweb_q08/duckdb:vortex-compact 670000029 480299684 1.39
duckdb / parquet (1.007x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1078347021 1163002295 0.93
fineweb_q01/duckdb:parquet 1612926686 1606236569 1.00
fineweb_q02/duckdb:parquet 1590440374 1638420046 0.97
fineweb_q03/duckdb:parquet 4142760196 3810732577 1.09
fineweb_q04/duckdb:parquet 1935892890 1769253869 1.09
fineweb_q05/duckdb:parquet 2631969636 2539809286 1.04
fineweb_q06/duckdb:parquet 3312743755 3720754253 0.89
fineweb_q07/duckdb:parquet 3998661079 3916180258 1.02
fineweb_q08/duckdb:parquet 1135353523 1081323694 1.05

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@github-actions
Copy link
Contributor

Benchmarks: Statistical and Population Genetics

Summary

  • Overall: 0.976x ➖
  • Vortex: 0.966x ➖
  • Parquet: 0.995x ➖
  • duckdb:vortex: 0.966x ➖
  • Best: statpopgen_q01/duckdb:vortex-file-compressed (0.686x)
  • Worst: statpopgen_q01/duckdb:vortex-compact (1.326x)
  • Significant (>10%): 2↑ 1↓
Detailed Results Table

duckdb / vortex-file-compressed

name PR 93f5da0 base bf6303d ratio (PR/base) unit remark
statpopgen_q00/duckdb:vortex-file-compressed 10877345 11714775.00 0.93 ns
statpopgen_q01/duckdb:vortex-file-compressed 19494610 28431882.00 0.69 ns 🚀
statpopgen_q02/duckdb:vortex-file-compressed 1307163167 1337306571.00 0.98 ns
statpopgen_q03/duckdb:vortex-file-compressed 3093280790 3047406998.00 1.02 ns
statpopgen_q04/duckdb:vortex-file-compressed 3055771318 3102749007.00 0.98 ns
statpopgen_q05/duckdb:vortex-file-compressed 1402590680 1374394328.00 1.02 ns
statpopgen_q06/duckdb:vortex-file-compressed 2041309309 2127264660.00 0.96 ns
statpopgen_q07/duckdb:vortex-file-compressed 195983079 217084950.00 0.90 ns
statpopgen_q08/duckdb:vortex-file-compressed 210403677 238985216.00 0.88 ns 🚀
statpopgen_q09/duckdb:vortex-file-compressed 2923220222 2970615529.00 0.98 ns
statpopgen_q10/duckdb:vortex-file-compressed 4615310007 4712599413.00 0.98 ns

duckdb / vortex-compact

name PR 93f5da0 base bf6303d ratio (PR/base) unit remark
statpopgen_q00/duckdb:vortex-compact 11060765 11169712.00 0.99 ns
statpopgen_q01/duckdb:vortex-compact 164700133 124198176.00 1.33 ns 🚨
statpopgen_q02/duckdb:vortex-compact 1817734973 1811641865.00 1.00 ns
statpopgen_q03/duckdb:vortex-compact 3500308803 3530228761.00 0.99 ns
statpopgen_q04/duckdb:vortex-compact 3507901922 3592113667.00 0.98 ns
statpopgen_q05/duckdb:vortex-compact 1832711265 1887966621.00 0.97 ns
statpopgen_q06/duckdb:vortex-compact 2682332010 2739691003.00 0.98 ns
statpopgen_q07/duckdb:vortex-compact 958666069 1005129777.00 0.95 ns
statpopgen_q08/duckdb:vortex-compact 992063537 1032037727.00 0.96 ns
statpopgen_q09/duckdb:vortex-compact 3315689199 3500184950.00 0.95 ns
statpopgen_q10/duckdb:vortex-compact 5389125081 5650406127.00 0.95 ns

duckdb / parquet

name PR 93f5da0 base bf6303d ratio (PR/base) unit remark
statpopgen_q00/duckdb:parquet 324445491 312391287.00 1.04 ns
statpopgen_q01/duckdb:parquet 404699151 389910772.00 1.04 ns
statpopgen_q02/duckdb:parquet 1010358181 999026213.00 1.01 ns
statpopgen_q03/duckdb:parquet 1520290401 1535436101.00 0.99 ns
statpopgen_q04/duckdb:parquet 1517609353 1514312091.00 1.00 ns
statpopgen_q05/duckdb:parquet 1016581070 1021239229.00 1.00 ns
statpopgen_q06/duckdb:parquet 1463511556 1472238934.00 0.99 ns
statpopgen_q07/duckdb:parquet 1851399588 1938604519.00 0.96 ns
statpopgen_q08/duckdb:parquet 1899057734 1894340358.00 1.00 ns
statpopgen_q09/duckdb:parquet 1342996445 1394089859.00 0.96 ns
statpopgen_q10/duckdb:parquet 2658167191 2770095663.00 0.96 ns

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 11, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 11, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: TPC-H SF=10 on S3

Summary

  • Overall: 0.965x ➖
  • Vortex: 0.950x ➖
  • Parquet: 0.996x ➖
datafusion / vortex-file-compressed (0.953x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 745451989 717401296 1.04
tpch_q02/datafusion:vortex-file-compressed 640000206 713992585 0.90
tpch_q03/datafusion:vortex-file-compressed 774679716 804110929 0.96
tpch_q04/datafusion:vortex-file-compressed 568734025 685493018 0.83
tpch_q05/datafusion:vortex-file-compressed 1035494985 1064477274 0.97
tpch_q06/datafusion:vortex-file-compressed 582541767 700497383 0.83
tpch_q07/datafusion:vortex-file-compressed 1133534373 1211687505 0.94
tpch_q08/datafusion:vortex-file-compressed 1434404157 1204006393 1.19
tpch_q09/datafusion:vortex-file-compressed 1591532050 1709382723 0.93
tpch_q10/datafusion:vortex-file-compressed 1112064498 1272344102 0.87
tpch_q11/datafusion:vortex-file-compressed 643159319 614130758 1.05
tpch_q12/datafusion:vortex-file-compressed 1075804845 1087572915 0.99
tpch_q13/datafusion:vortex-file-compressed 464769227 467772042 0.99
tpch_q14/datafusion:vortex-file-compressed 609824350 807679217 0.76
tpch_q15/datafusion:vortex-file-compressed 1043536416 1317468259 0.79
tpch_q16/datafusion:vortex-file-compressed 387277819 306672947 1.26
tpch_q17/datafusion:vortex-file-compressed 1195689370 1191263894 1.00
tpch_q18/datafusion:vortex-file-compressed 1300493055 1371081278 0.95
tpch_q19/datafusion:vortex-file-compressed 638332609 705818939 0.90
tpch_q20/datafusion:vortex-file-compressed 919608999 939267811 0.98
tpch_q21/datafusion:vortex-file-compressed 1713381072 1831382294 0.94
tpch_q22/datafusion:vortex-file-compressed 395515917 381719987 1.04
datafusion / vortex-compact (0.902x ➖, 2↑ 1↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 690286854 708411691 0.97
tpch_q02/datafusion:vortex-compact 650924607 644969690 1.01
tpch_q03/datafusion:vortex-compact 699389342 714588046 0.98
tpch_q04/datafusion:vortex-compact 538731501 525156201 1.03
tpch_q05/datafusion:vortex-compact 971084405 1009595143 0.96
tpch_q06/datafusion:vortex-compact 629360873 606438642 1.04
tpch_q07/datafusion:vortex-compact 1140343530 1226763981 0.93
tpch_q08/datafusion:vortex-compact 1131552602 1595751902 0.71
tpch_q09/datafusion:vortex-compact 1347006756 1589432853 0.85
🚀 tpch_q10/datafusion:vortex-compact 885671081 1332002735 0.66
tpch_q11/datafusion:vortex-compact 429295677 493722238 0.87
tpch_q12/datafusion:vortex-compact 842190994 1177847993 0.72
tpch_q13/datafusion:vortex-compact 424062443 427444445 0.99
tpch_q14/datafusion:vortex-compact 611303851 626829201 0.98
tpch_q15/datafusion:vortex-compact 1077376635 1517126194 0.71
🚀 tpch_q16/datafusion:vortex-compact 296790522 719721734 0.41
tpch_q17/datafusion:vortex-compact 1175886529 1228892408 0.96
tpch_q18/datafusion:vortex-compact 1203558235 1238439401 0.97
tpch_q19/datafusion:vortex-compact 632008796 633588119 1.00
tpch_q20/datafusion:vortex-compact 1037578428 863479354 1.20
tpch_q21/datafusion:vortex-compact 1455527945 1448693158 1.00
🚨 tpch_q22/datafusion:vortex-compact 438023980 308410532 1.42
datafusion / parquet (1.009x ➖, 0↑ 2↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 865180937 885454834 0.98
tpch_q02/datafusion:parquet 676549649 725916885 0.93
tpch_q03/datafusion:parquet 957118658 909065280 1.05
tpch_q04/datafusion:parquet 504277883 476051834 1.06
tpch_q05/datafusion:parquet 1277086538 1216418913 1.05
tpch_q06/datafusion:parquet 542601520 519878349 1.04
tpch_q07/datafusion:parquet 1394498480 1491562379 0.93
🚨 tpch_q08/datafusion:parquet 2212262413 1685322325 1.31
tpch_q09/datafusion:parquet 1780281059 1789868803 0.99
tpch_q10/datafusion:parquet 2078849862 2027809910 1.03
tpch_q11/datafusion:parquet 549074865 599620980 0.92
tpch_q12/datafusion:parquet 691089397 729276067 0.95
tpch_q13/datafusion:parquet 676724688 778614968 0.87
tpch_q14/datafusion:parquet 802019650 793192126 1.01
tpch_q15/datafusion:parquet 1169361059 1233459241 0.95
tpch_q16/datafusion:parquet 459615954 497033657 0.92
tpch_q17/datafusion:parquet 1394779877 1448358094 0.96
tpch_q18/datafusion:parquet 1680008001 1631815169 1.03
tpch_q19/datafusion:parquet 965127057 973026259 0.99
🚨 tpch_q20/datafusion:parquet 1551981285 1115703022 1.39
tpch_q21/datafusion:parquet 1781233947 1838078738 0.97
tpch_q22/datafusion:parquet 662738297 665121917 1.00
duckdb / vortex-file-compressed (0.958x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 653371272 641069880 1.02
tpch_q02/duckdb:vortex-file-compressed 1144387133 1363368714 0.84
tpch_q03/duckdb:vortex-file-compressed 934757693 887177030 1.05
tpch_q04/duckdb:vortex-file-compressed 613590996 656493492 0.93
tpch_q05/duckdb:vortex-file-compressed 1051774048 1054525565 1.00
tpch_q06/duckdb:vortex-file-compressed 925871249 794792341 1.16
tpch_q07/duckdb:vortex-file-compressed 1102168932 1142104299 0.97
tpch_q08/duckdb:vortex-file-compressed 1363496891 1547545442 0.88
tpch_q09/duckdb:vortex-file-compressed 1528440578 1503785572 1.02
tpch_q10/duckdb:vortex-file-compressed 1221510333 1353926945 0.90
tpch_q11/duckdb:vortex-file-compressed 549191744 551200864 1.00
tpch_q12/duckdb:vortex-file-compressed 642929970 725348343 0.89
tpch_q13/duckdb:vortex-file-compressed 1042581385 1005384359 1.04
tpch_q14/duckdb:vortex-file-compressed 876061211 958866483 0.91
tpch_q15/duckdb:vortex-file-compressed 565294482 552869968 1.02
tpch_q16/duckdb:vortex-file-compressed 424540533 461781544 0.92
tpch_q17/duckdb:vortex-file-compressed 1037660411 991288050 1.05
tpch_q18/duckdb:vortex-file-compressed 910020521 942824138 0.97
tpch_q19/duckdb:vortex-file-compressed 748034867 876338235 0.85
tpch_q20/duckdb:vortex-file-compressed 1142722932 1234277251 0.93
tpch_q21/duckdb:vortex-file-compressed 1948094387 1999471789 0.97
tpch_q22/duckdb:vortex-file-compressed 507456781 612842450 0.83
duckdb / vortex-compact (0.992x ➖, 0↑ 2↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 586464475 605169717 0.97
tpch_q02/duckdb:vortex-compact 960603066 1123041538 0.86
tpch_q03/duckdb:vortex-compact 882165959 836640715 1.05
🚨 tpch_q04/duckdb:vortex-compact 661361979 457553297 1.45
tpch_q05/duckdb:vortex-compact 941829645 1011660618 0.93
tpch_q06/duckdb:vortex-compact 705037873 743918971 0.95
tpch_q07/duckdb:vortex-compact 1032854265 1095710950 0.94
tpch_q08/duckdb:vortex-compact 1489446093 1265718856 1.18
tpch_q09/duckdb:vortex-compact 1359209004 1381073932 0.98
tpch_q10/duckdb:vortex-compact 1122426719 1286409465 0.87
tpch_q11/duckdb:vortex-compact 612882525 707995321 0.87
tpch_q12/duckdb:vortex-compact 643112962 648728255 0.99
tpch_q13/duckdb:vortex-compact 809659661 938787663 0.86
tpch_q14/duckdb:vortex-compact 807855982 904696053 0.89
tpch_q15/duckdb:vortex-compact 567892658 568159073 1.00
tpch_q16/duckdb:vortex-compact 385094608 404338413 0.95
tpch_q17/duckdb:vortex-compact 908113867 979201056 0.93
tpch_q18/duckdb:vortex-compact 760890868 824446874 0.92
tpch_q19/duckdb:vortex-compact 764343459 752828856 1.02
🚨 tpch_q20/duckdb:vortex-compact 1644030244 1205549333 1.36
tpch_q21/duckdb:vortex-compact 1714879609 1650329378 1.04
tpch_q22/duckdb:vortex-compact 667660998 659755585 1.01
duckdb / parquet (0.982x ➖, 1↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1068149762 854691044 1.25
tpch_q02/duckdb:parquet 1384556669 1581823463 0.88
tpch_q03/duckdb:parquet 1806231011 1516087968 1.19
tpch_q04/duckdb:parquet 1155152659 1026415852 1.13
tpch_q05/duckdb:parquet 2081098836 2013842199 1.03
🚀 tpch_q06/duckdb:parquet 625416571 923693847 0.68
tpch_q07/duckdb:parquet 1703431346 1819736818 0.94
tpch_q08/duckdb:parquet 2272797443 2510352119 0.91
tpch_q09/duckdb:parquet 2357948170 2454540107 0.96
tpch_q10/duckdb:parquet 2847194791 3029251600 0.94
tpch_q11/duckdb:parquet 886066739 876080691 1.01
tpch_q12/duckdb:parquet 1034763257 1037855025 1.00
tpch_q13/duckdb:parquet 1252703127 1364248883 0.92
tpch_q14/duckdb:parquet 1170540523 1319848019 0.89
tpch_q15/duckdb:parquet 814599557 898167024 0.91
tpch_q16/duckdb:parquet 739078040 717889041 1.03
tpch_q17/duckdb:parquet 1204391844 1259247474 0.96
tpch_q18/duckdb:parquet 1427039555 1381147240 1.03
tpch_q19/duckdb:parquet 1565639546 1550781422 1.01
tpch_q20/duckdb:parquet 1932065045 1675235648 1.15
tpch_q21/duckdb:parquet 1822520706 1744088314 1.04
tpch_q22/duckdb:parquet 1073657836 1153112625 0.93

@AdamGS AdamGS marked this pull request as ready for review March 11, 2026 13:58
@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: TPC-H SF=1 on S3

Summary

  • Overall: 1.029x ➖
  • Vortex: 1.034x ➖
  • Parquet: 1.018x ➖
datafusion / vortex-file-compressed (1.058x ➖, 0↑ 1↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 184917404 188448075 0.98
tpch_q02/datafusion:vortex-file-compressed 483608283 427714510 1.13
tpch_q03/datafusion:vortex-file-compressed 362382129 295525276 1.23
tpch_q04/datafusion:vortex-file-compressed 214934447 227261104 0.95
tpch_q05/datafusion:vortex-file-compressed 486913963 446348625 1.09
tpch_q06/datafusion:vortex-file-compressed 287458528 235012998 1.22
tpch_q07/datafusion:vortex-file-compressed 421646496 473133303 0.89
tpch_q08/datafusion:vortex-file-compressed 642897947 627625693 1.02
tpch_q09/datafusion:vortex-file-compressed 534626236 524165942 1.02
tpch_q10/datafusion:vortex-file-compressed 546033417 522832283 1.04
tpch_q11/datafusion:vortex-file-compressed 381572002 295153876 1.29
🚨 tpch_q12/datafusion:vortex-file-compressed 594483680 375828666 1.58
tpch_q13/datafusion:vortex-file-compressed 238919291 227576316 1.05
tpch_q14/datafusion:vortex-file-compressed 205844134 185711765 1.11
tpch_q15/datafusion:vortex-file-compressed 318965643 326482061 0.98
tpch_q16/datafusion:vortex-file-compressed 215006384 186099396 1.16
tpch_q17/datafusion:vortex-file-compressed 332099542 336250510 0.99
tpch_q18/datafusion:vortex-file-compressed 339695393 394453380 0.86
tpch_q19/datafusion:vortex-file-compressed 351843810 464632974 0.76
tpch_q20/datafusion:vortex-file-compressed 385608423 364459285 1.06
tpch_q21/datafusion:vortex-file-compressed 504352639 544952075 0.93
tpch_q22/datafusion:vortex-file-compressed 188484236 155392754 1.21
datafusion / vortex-compact (1.122x ➖, 0↑ 5↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
🚨 tpch_q01/datafusion:vortex-compact 326529235 240280507 1.36
tpch_q02/datafusion:vortex-compact 451961783 481583135 0.94
tpch_q03/datafusion:vortex-compact 331911036 302598942 1.10
tpch_q04/datafusion:vortex-compact 214547026 229715792 0.93
tpch_q05/datafusion:vortex-compact 451613802 396655785 1.14
tpch_q06/datafusion:vortex-compact 288286323 313325070 0.92
tpch_q07/datafusion:vortex-compact 453575329 420765139 1.08
tpch_q08/datafusion:vortex-compact 538711762 485979438 1.11
tpch_q09/datafusion:vortex-compact 462455582 364337345 1.27
tpch_q10/datafusion:vortex-compact 492878745 449180843 1.10
🚨 tpch_q11/datafusion:vortex-compact 331846565 251434127 1.32
tpch_q12/datafusion:vortex-compact 465338989 450414269 1.03
tpch_q13/datafusion:vortex-compact 214474386 218577705 0.98
tpch_q14/datafusion:vortex-compact 271959986 299345444 0.91
tpch_q15/datafusion:vortex-compact 480146405 454941322 1.06
🚨 tpch_q16/datafusion:vortex-compact 253938394 181891141 1.40
🚨 tpch_q17/datafusion:vortex-compact 490886666 351774946 1.40
tpch_q18/datafusion:vortex-compact 323854716 295345642 1.10
🚨 tpch_q19/datafusion:vortex-compact 682897790 388751737 1.76
tpch_q20/datafusion:vortex-compact 599685172 463854269 1.29
tpch_q21/datafusion:vortex-compact 569241449 535222405 1.06
tpch_q22/datafusion:vortex-compact 114457055 136588309 0.84
datafusion / parquet (1.028x ➖, 1↑ 2↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 223308876 239008564 0.93
tpch_q02/datafusion:parquet 442144462 412358238 1.07
tpch_q03/datafusion:parquet 331725457 301602451 1.10
🚨 tpch_q04/datafusion:parquet 191004095 141741389 1.35
tpch_q05/datafusion:parquet 557031115 490603418 1.14
tpch_q06/datafusion:parquet 147490243 139765810 1.06
tpch_q07/datafusion:parquet 540040259 545787903 0.99
tpch_q08/datafusion:parquet 760949986 618681409 1.23
tpch_q09/datafusion:parquet 570580465 557274571 1.02
tpch_q10/datafusion:parquet 697470912 570713914 1.22
tpch_q11/datafusion:parquet 397226403 346425378 1.15
tpch_q12/datafusion:parquet 289628610 284058579 1.02
tpch_q13/datafusion:parquet 437029584 446394628 0.98
tpch_q14/datafusion:parquet 237626827 223810310 1.06
tpch_q15/datafusion:parquet 330247022 315996166 1.05
tpch_q16/datafusion:parquet 191452416 222867698 0.86
tpch_q17/datafusion:parquet 475204460 584720335 0.81
tpch_q18/datafusion:parquet 512930884 646503667 0.79
🚀 tpch_q19/datafusion:parquet 344526097 508729027 0.68
tpch_q20/datafusion:parquet 408032554 404975588 1.01
tpch_q21/datafusion:parquet 617252940 613623837 1.01
🚨 tpch_q22/datafusion:parquet 177846704 126607883 1.40
duckdb / vortex-file-compressed (0.960x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 269807211 257179059 1.05
tpch_q02/duckdb:vortex-file-compressed 872152845 897203348 0.97
tpch_q03/duckdb:vortex-file-compressed 580703953 565952541 1.03
tpch_q04/duckdb:vortex-file-compressed 367495510 397597390 0.92
tpch_q05/duckdb:vortex-file-compressed 898515192 911218746 0.99
tpch_q06/duckdb:vortex-file-compressed 383159060 371138832 1.03
tpch_q07/duckdb:vortex-file-compressed 721722487 825779632 0.87
tpch_q08/duckdb:vortex-file-compressed 871983458 901579951 0.97
tpch_q09/duckdb:vortex-file-compressed 879242305 863559963 1.02
tpch_q10/duckdb:vortex-file-compressed 773134051 750033006 1.03
tpch_q11/duckdb:vortex-file-compressed 460761405 514466487 0.90
tpch_q12/duckdb:vortex-file-compressed 478354158 545975897 0.88
tpch_q13/duckdb:vortex-file-compressed 479909528 479904921 1.00
tpch_q14/duckdb:vortex-file-compressed 415475449 468410128 0.89
tpch_q15/duckdb:vortex-file-compressed 299645491 294412473 1.02
tpch_q16/duckdb:vortex-file-compressed 292592378 314438491 0.93
tpch_q17/duckdb:vortex-file-compressed 590958665 587209194 1.01
tpch_q18/duckdb:vortex-file-compressed 518584800 548416718 0.95
tpch_q19/duckdb:vortex-file-compressed 488778690 537678182 0.91
tpch_q20/duckdb:vortex-file-compressed 702531967 778906842 0.90
tpch_q21/duckdb:vortex-file-compressed 953487469 960960151 0.99
tpch_q22/duckdb:vortex-file-compressed 336875216 367349699 0.92
duckdb / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 285327940 308467307 0.92
tpch_q02/duckdb:vortex-compact 754897064 829094590 0.91
tpch_q03/duckdb:vortex-compact 548030359 478465699 1.15
tpch_q04/duckdb:vortex-compact 337815238 310152095 1.09
tpch_q05/duckdb:vortex-compact 799307481 765647936 1.04
tpch_q06/duckdb:vortex-compact 384861936 386393346 1.00
tpch_q07/duckdb:vortex-compact 586012622 632247346 0.93
tpch_q08/duckdb:vortex-compact 840951502 834873102 1.01
tpch_q09/duckdb:vortex-compact 820711845 876568316 0.94
tpch_q10/duckdb:vortex-compact 624265442 672495319 0.93
tpch_q11/duckdb:vortex-compact 445576568 471076002 0.95
tpch_q12/duckdb:vortex-compact 463730389 413603752 1.12
tpch_q13/duckdb:vortex-compact 450331195 437585179 1.03
tpch_q14/duckdb:vortex-compact 403471531 458637422 0.88
tpch_q15/duckdb:vortex-compact 271052213 250537444 1.08
tpch_q16/duckdb:vortex-compact 315704079 323374206 0.98
tpch_q17/duckdb:vortex-compact 643189405 633620948 1.02
tpch_q18/duckdb:vortex-compact 484886044 500803795 0.97
tpch_q19/duckdb:vortex-compact 479919640 475135879 1.01
tpch_q20/duckdb:vortex-compact 775224805 731019389 1.06
tpch_q21/duckdb:vortex-compact 1027816767 969893518 1.06
tpch_q22/duckdb:vortex-compact 330094407 306807148 1.08
duckdb / parquet (1.008x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base bf6303d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 440530787 472545456 0.93
tpch_q02/duckdb:parquet 1222158375 1276122900 0.96
tpch_q03/duckdb:parquet 909042841 934264865 0.97
tpch_q04/duckdb:parquet 510178504 606249673 0.84
tpch_q05/duckdb:parquet 1476130151 1313499942 1.12
tpch_q06/duckdb:parquet 376502532 417361864 0.90
tpch_q07/duckdb:parquet 1290525075 1104621945 1.17
tpch_q08/duckdb:parquet 1537265051 1520049119 1.01
tpch_q09/duckdb:parquet 1368337153 1287293663 1.06
tpch_q10/duckdb:parquet 1282403007 1260824646 1.02
tpch_q11/duckdb:parquet 800985897 786855484 1.02
tpch_q12/duckdb:parquet 587137027 579006546 1.01
tpch_q13/duckdb:parquet 881941119 864158843 1.02
tpch_q14/duckdb:parquet 752111290 644766962 1.17
tpch_q15/duckdb:parquet 535903355 464263829 1.15
tpch_q16/duckdb:parquet 498457118 553584246 0.90
tpch_q17/duckdb:parquet 764084499 719614691 1.06
tpch_q18/duckdb:parquet 848153265 858136948 0.99
tpch_q19/duckdb:parquet 815630008 859723765 0.95
tpch_q20/duckdb:parquet 1020663048 990195377 1.03
tpch_q21/duckdb:parquet 1011611770 1237997935 0.82
tpch_q22/duckdb:parquet 549718517 471776274 1.17

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 11, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 11, 2026
@github-actions
Copy link
Contributor

Benchmarks: Random Access

Summary

  • Overall: 0.948x ➖
  • Vortex: 0.863x ✅
  • Parquet: 1.002x ➖
  • Best: random-access/taxi/correlated/vortex-tokio-local-disk-footer (0.680x)
  • Worst: No regressions
  • Significant (>10%): 7↑ 0↓
Detailed Results Table

unknown / unknown

name PR 93f5da0 base bf6303d ratio (PR/base) unit remark
random-access/feature-vectors/correlated/lance-tokio-local-disk 2777617 2332689.00 1.19 ns 🚨
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1268045 1283615.00 0.99 ns
random-access/feature-vectors/correlated/parquet-tokio-local-disk 13965730199 14269303272.00 0.98 ns
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 13473896131 13643417110.00 0.99 ns
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7606747 8045773.00 0.95 ns
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 5595529 6257817.00 0.89 ns 🚀
random-access/feature-vectors/uniform/lance-tokio-local-disk 1456020 1484828.00 0.98 ns
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2353147 2476779.00 0.95 ns
random-access/feature-vectors/uniform/parquet-tokio-local-disk 13465568244 13508848027.00 1.00 ns
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 13476217554 13442851174.00 1.00 ns
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12492176 13375059.00 0.93 ns
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12291747 13578926.00 0.91 ns
random-access/lance-tokio-local-disk 751070 745047.00 1.01 ns
random-access/lance-tokio-local-disk-footer 1360003 1359561.00 1.00 ns
random-access/nested-lists/correlated/lance-tokio-local-disk 260889 273384.00 0.95 ns
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 717012 776681.00 0.92 ns
random-access/nested-lists/correlated/parquet-tokio-local-disk 163236377 160753200.00 1.02 ns
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 163778725 160742070.00 1.02 ns
random-access/nested-lists/correlated/vortex-tokio-local-disk 706147 716176.00 0.99 ns
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 710898 728869.00 0.98 ns
random-access/nested-lists/uniform/lance-tokio-local-disk 1180045 1198718.00 0.98 ns
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1669689 1800512.00 0.93 ns
random-access/nested-lists/uniform/parquet-tokio-local-disk 161078488 159226752.00 1.01 ns
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 160961464 160487682.00 1.00 ns
random-access/nested-lists/uniform/vortex-tokio-local-disk 2397748 2459891.00 0.97 ns
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2517291 2625980.00 0.96 ns
random-access/nested-structs/correlated/lance-tokio-local-disk 432983 444421.00 0.97 ns
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 642034 684215.00 0.94 ns
random-access/nested-structs/correlated/parquet-tokio-local-disk 26833624 26714857.00 1.00 ns
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 27493086 27450776.00 1.00 ns
random-access/nested-structs/correlated/vortex-tokio-local-disk 886774 940025.00 0.94 ns
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 882347 918368.00 0.96 ns
random-access/nested-structs/uniform/lance-tokio-local-disk 2855029 3034317.00 0.94 ns
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3105027 3235380.00 0.96 ns
random-access/nested-structs/uniform/parquet-tokio-local-disk 27181645 25872994.00 1.05 ns
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 27157323 27170898.00 1.00 ns
random-access/nested-structs/uniform/vortex-tokio-local-disk 1726610 1894827.00 0.91 ns
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1721177 1868300.00 0.92 ns
random-access/parquet-tokio-local-disk 189108234 187436489.00 1.01 ns
random-access/parquet-tokio-local-disk-footer 187193589 189096883.00 0.99 ns
random-access/taxi/correlated/lance-tokio-local-disk 978669 974842.00 1.00 ns
random-access/taxi/correlated/lance-tokio-local-disk-footer 1668791 1668597.00 1.00 ns
random-access/taxi/correlated/parquet-tokio-local-disk 281813454 282976840.00 1.00 ns
random-access/taxi/correlated/parquet-tokio-local-disk-footer 278080909 281589429.00 0.99 ns
random-access/taxi/correlated/vortex-tokio-local-disk 1685377 2327284.00 0.72 ns 🚀
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1693096 2491596.00 0.68 ns 🚀
random-access/taxi/uniform/lance-tokio-local-disk 8805283 8698843.00 1.01 ns
random-access/taxi/uniform/lance-tokio-local-disk-footer 9420686 9402417.00 1.00 ns
random-access/taxi/uniform/parquet-tokio-local-disk 292860767 295301100.00 0.99 ns
random-access/taxi/uniform/parquet-tokio-local-disk-footer 294661354 297114989.00 0.99 ns
random-access/taxi/uniform/vortex-tokio-local-disk 4189085 5418365.00 0.77 ns 🚀
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4222690 5407055.00 0.78 ns 🚀
random-access/vortex-tokio-local-disk 1195153 1704268.00 0.70 ns 🚀
random-access/vortex-tokio-local-disk-footer 1214123 1751762.00 0.69 ns 🚀

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 11, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 11, 2026
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 11, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: Clickbench on NVME

Summary

  • Overall: 1.020x ➖
  • Vortex: 1.007x ➖
  • Parquet: 1.009x ➖
datafusion / vortex-file-compressed (0.991x ➖, 1↑ 1↓)
name PR 2ebc0e4 (ns) base b606e1a (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1665192 1663773 1.00
🚨 clickbench_q01/datafusion:vortex-file-compressed 14262784 12866724 1.11
clickbench_q02/datafusion:vortex-file-compressed 31826557 31711022 1.00
clickbench_q03/datafusion:vortex-file-compressed 35691123 37388069 0.95
clickbench_q04/datafusion:vortex-file-compressed 317129810 319366198 0.99
clickbench_q05/datafusion:vortex-file-compressed 317805824 320688708 0.99
🚀 clickbench_q06/datafusion:vortex-file-compressed 1936180 2236177 0.87
clickbench_q07/datafusion:vortex-file-compressed 18125780 17833326 1.02
clickbench_q08/datafusion:vortex-file-compressed 378172125 378781100 1.00
clickbench_q09/datafusion:vortex-file-compressed 573161898 584091577 0.98
clickbench_q10/datafusion:vortex-file-compressed 69782356 72019789 0.97
clickbench_q11/datafusion:vortex-file-compressed 81419686 80490358 1.01
clickbench_q12/datafusion:vortex-file-compressed 270728761 268780119 1.01
clickbench_q13/datafusion:vortex-file-compressed 408610646 409803028 1.00
clickbench_q14/datafusion:vortex-file-compressed 251336608 247924327 1.01
clickbench_q15/datafusion:vortex-file-compressed 376389275 378514047 0.99
clickbench_q16/datafusion:vortex-file-compressed 714057594 724764136 0.99
clickbench_q17/datafusion:vortex-file-compressed 703826027 704251913 1.00
clickbench_q18/datafusion:vortex-file-compressed 1352704534 1360264812 0.99
clickbench_q19/datafusion:vortex-file-compressed 23720597 23497548 1.01
clickbench_q20/datafusion:vortex-file-compressed 333891088 329841359 1.01
clickbench_q21/datafusion:vortex-file-compressed 388393584 389036675 1.00
clickbench_q22/datafusion:vortex-file-compressed 556619539 539688943 1.03
clickbench_q23/datafusion:vortex-file-compressed 530310622 580441295 0.91
clickbench_q24/datafusion:vortex-file-compressed 45581614 48090808 0.95
clickbench_q25/datafusion:vortex-file-compressed 72842742 68827661 1.06
clickbench_q26/datafusion:vortex-file-compressed 45471878 44475645 1.02
clickbench_q27/datafusion:vortex-file-compressed 765295597 793741036 0.96
clickbench_q28/datafusion:vortex-file-compressed 6632094267 6666869790 0.99
clickbench_q29/datafusion:vortex-file-compressed 239579098 240455869 1.00
clickbench_q30/datafusion:vortex-file-compressed 251409194 251588455 1.00
clickbench_q31/datafusion:vortex-file-compressed 292637392 289020376 1.01
clickbench_q32/datafusion:vortex-file-compressed 1345180759 1353944552 0.99
clickbench_q33/datafusion:vortex-file-compressed 1408334323 1413038249 1.00
clickbench_q34/datafusion:vortex-file-compressed 1395199711 1398447013 1.00
clickbench_q35/datafusion:vortex-file-compressed 528870637 531047679 1.00
clickbench_q36/datafusion:vortex-file-compressed 79852917 79667599 1.00
clickbench_q37/datafusion:vortex-file-compressed 36901604 38295835 0.96
clickbench_q38/datafusion:vortex-file-compressed 22743897 23777586 0.96
clickbench_q39/datafusion:vortex-file-compressed 150774385 148937891 1.01
clickbench_q40/datafusion:vortex-file-compressed 20337309 21282890 0.96
clickbench_q41/datafusion:vortex-file-compressed 18195910 18843747 0.97
clickbench_q42/datafusion:vortex-file-compressed 21443566 22636279 0.95
datafusion / vortex-compact (0.992x ➖, 1↑ 0↓)
name PR 2ebc0e4 (ns) base b606e1a (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-compact 1705250 1697663 1.00
clickbench_q01/datafusion:vortex-compact 16905509 16973975 1.00
clickbench_q02/datafusion:vortex-compact 41235709 41247112 1.00
clickbench_q03/datafusion:vortex-compact 40225376 39931736 1.01
clickbench_q04/datafusion:vortex-compact 338049052 336391073 1.00
clickbench_q05/datafusion:vortex-compact 335119335 334874802 1.00
clickbench_q06/datafusion:vortex-compact 1718634 1726700 1.00
clickbench_q07/datafusion:vortex-compact 27973901 28121971 0.99
clickbench_q08/datafusion:vortex-compact 422679961 416984082 1.01
clickbench_q09/datafusion:vortex-compact 644494481 630308710 1.02
clickbench_q10/datafusion:vortex-compact 133334581 138069356 0.97
clickbench_q11/datafusion:vortex-compact 174635528 169660214 1.03
clickbench_q12/datafusion:vortex-compact 293598168 290826559 1.01
clickbench_q13/datafusion:vortex-compact 527518794 519650183 1.02
clickbench_q14/datafusion:vortex-compact 310353847 304731592 1.02
clickbench_q15/datafusion:vortex-compact 390546914 388086580 1.01
clickbench_q16/datafusion:vortex-compact 782814783 781630384 1.00
clickbench_q17/datafusion:vortex-compact 784290320 778190373 1.01
clickbench_q18/datafusion:vortex-compact 1463100609 1466244429 1.00
clickbench_q19/datafusion:vortex-compact 28833837 29653378 0.97
clickbench_q20/datafusion:vortex-compact 410956129 408258870 1.01
clickbench_q21/datafusion:vortex-compact 596247546 609120906 0.98
clickbench_q22/datafusion:vortex-compact 998240884 990096988 1.01
🚀 clickbench_q23/datafusion:vortex-compact 2784273261 3228430069 0.86
clickbench_q24/datafusion:vortex-compact 92611914 91156898 1.02
clickbench_q25/datafusion:vortex-compact 114082938 118158632 0.97
clickbench_q26/datafusion:vortex-compact 90144247 96192081 0.94
clickbench_q27/datafusion:vortex-compact 849110594 885356273 0.96
clickbench_q28/datafusion:vortex-compact 5960153501 6001970160 0.99
clickbench_q29/datafusion:vortex-compact 221638472 216994259 1.02
clickbench_q30/datafusion:vortex-compact 394092616 393345229 1.00
clickbench_q31/datafusion:vortex-compact 461207117 460237536 1.00
clickbench_q32/datafusion:vortex-compact 1338054205 1426364419 0.94
clickbench_q33/datafusion:vortex-compact 1486991907 1455418697 1.02
clickbench_q34/datafusion:vortex-compact 1457188987 1442223185 1.01
clickbench_q35/datafusion:vortex-compact 561572410 553956426 1.01
clickbench_q36/datafusion:vortex-compact 86223051 90589486 0.95
clickbench_q37/datafusion:vortex-compact 40160012 41194461 0.97
clickbench_q38/datafusion:vortex-compact 31903697 31908960 1.00
clickbench_q39/datafusion:vortex-compact 162725088 160436094 1.01
clickbench_q40/datafusion:vortex-compact 24809491 25793984 0.96
clickbench_q41/datafusion:vortex-compact 24480534 25323060 0.97
clickbench_q42/datafusion:vortex-compact 22256339 21814532 1.02
datafusion / parquet (1.007x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base b606e1a (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1899242 1741715 1.09
clickbench_q01/datafusion:parquet 20725019 19937752 1.04
clickbench_q02/datafusion:parquet 51241156 52934107 0.97
clickbench_q03/datafusion:parquet 42454366 43588722 0.97
clickbench_q04/datafusion:parquet 345576652 368041709 0.94
clickbench_q05/datafusion:parquet 350790524 354089516 0.99
clickbench_q06/datafusion:parquet 1662694 1553077 1.07
clickbench_q07/datafusion:parquet 29023023 26608910 1.09
clickbench_q08/datafusion:parquet 432049557 433160119 1.00
clickbench_q09/datafusion:parquet 670981364 662695843 1.01
clickbench_q10/datafusion:parquet 114942233 115936623 0.99
clickbench_q11/datafusion:parquet 141608169 138934603 1.02
clickbench_q12/datafusion:parquet 348015405 346004771 1.01
clickbench_q13/datafusion:parquet 504289404 499108220 1.01
clickbench_q14/datafusion:parquet 340047668 340083005 1.00
clickbench_q15/datafusion:parquet 404442506 402588651 1.00
clickbench_q16/datafusion:parquet 716319020 719344985 1.00
clickbench_q17/datafusion:parquet 758954540 701798682 1.08
clickbench_q18/datafusion:parquet 1428983177 1469058686 0.97
clickbench_q19/datafusion:parquet 35924861 35979197 1.00
clickbench_q20/datafusion:parquet 563324703 560217552 1.01
clickbench_q21/datafusion:parquet 653988973 626613457 1.04
clickbench_q22/datafusion:parquet 958654151 950153964 1.01
clickbench_q23/datafusion:parquet 3696979415 3733907081 0.99
clickbench_q24/datafusion:parquet 98440623 101209239 0.97
clickbench_q25/datafusion:parquet 140810655 138409297 1.02
clickbench_q26/datafusion:parquet 102093914 105671231 0.97
clickbench_q27/datafusion:parquet 956835603 959060455 1.00
clickbench_q28/datafusion:parquet 5780343774 5792787156 1.00
clickbench_q29/datafusion:parquet 234825958 222466809 1.06
clickbench_q30/datafusion:parquet 347085992 346296087 1.00
clickbench_q31/datafusion:parquet 399641627 398405445 1.00
clickbench_q32/datafusion:parquet 1351227436 1328915855 1.02
clickbench_q33/datafusion:parquet 1522202513 1493388691 1.02
clickbench_q34/datafusion:parquet 1501419590 1487947419 1.01
clickbench_q35/datafusion:parquet 566505662 564945143 1.00
clickbench_q36/datafusion:parquet 142958912 150507560 0.95
clickbench_q37/datafusion:parquet 59461778 58915303 1.01
clickbench_q38/datafusion:parquet 93518552 89155595 1.05
clickbench_q39/datafusion:parquet 276782633 286000388 0.97
clickbench_q40/datafusion:parquet 34743711 34620307 1.00
clickbench_q41/datafusion:parquet 30816274 32016726 0.96
clickbench_q42/datafusion:parquet 33664871 32328324 1.04
duckdb / vortex-file-compressed (1.030x ➖, 0↑ 6↓)
name PR 2ebc0e4 (ns) base b606e1a (ns) ratio (PR/base)
🚨 clickbench_q00/duckdb:vortex-file-compressed 6605800 5900289 1.12
clickbench_q01/duckdb:vortex-file-compressed 13417261 13594672 0.99
clickbench_q02/duckdb:vortex-file-compressed 23533490 23391114 1.01
clickbench_q03/duckdb:vortex-file-compressed 29573161 29176350 1.01
clickbench_q04/duckdb:vortex-file-compressed 169566248 165610307 1.02
clickbench_q05/duckdb:vortex-file-compressed 194854577 193493191 1.01
clickbench_q06/duckdb:vortex-file-compressed 18746804 18987214 0.99
clickbench_q07/duckdb:vortex-file-compressed 17224378 15755098 1.09
clickbench_q08/duckdb:vortex-file-compressed 256060933 257153683 1.00
clickbench_q09/duckdb:vortex-file-compressed 366344474 363901708 1.01
clickbench_q10/duckdb:vortex-file-compressed 70674530 68526111 1.03
clickbench_q11/duckdb:vortex-file-compressed 79633628 76177460 1.05
clickbench_q12/duckdb:vortex-file-compressed 203437276 213833758 0.95
clickbench_q13/duckdb:vortex-file-compressed 423035570 422952479 1.00
clickbench_q14/duckdb:vortex-file-compressed 231540342 234673079 0.99
clickbench_q15/duckdb:vortex-file-compressed 210659443 202311985 1.04
clickbench_q16/duckdb:vortex-file-compressed 606017077 572828629 1.06
🚨 clickbench_q17/duckdb:vortex-file-compressed 595096062 497659329 1.20
clickbench_q18/duckdb:vortex-file-compressed 1233121832 1187413394 1.04
clickbench_q19/duckdb:vortex-file-compressed 19512943 18974398 1.03
🚨 clickbench_q20/duckdb:vortex-file-compressed 383901155 345599977 1.11
clickbench_q21/duckdb:vortex-file-compressed 384276553 374568198 1.03
🚨 clickbench_q22/duckdb:vortex-file-compressed 622925934 556086979 1.12
🚨 clickbench_q23/duckdb:vortex-file-compressed 1704408216 1529819445 1.11
clickbench_q24/duckdb:vortex-file-compressed 47772938 51599739 0.93
clickbench_q25/duckdb:vortex-file-compressed 79625196 75124465 1.06
🚨 clickbench_q26/duckdb:vortex-file-compressed 44068604 38876244 1.13
clickbench_q27/duckdb:vortex-file-compressed 523501478 499677735 1.05
clickbench_q28/duckdb:vortex-file-compressed 3010714613 2987835871 1.01
clickbench_q29/duckdb:vortex-file-compressed 27675611 26766783 1.03
clickbench_q30/duckdb:vortex-file-compressed 186368785 186532283 1.00
clickbench_q31/duckdb:vortex-file-compressed 268339350 264189756 1.02
clickbench_q32/duckdb:vortex-file-compressed 1224646121 1257852907 0.97
clickbench_q33/duckdb:vortex-file-compressed 1583751573 1487615067 1.06
clickbench_q34/duckdb:vortex-file-compressed 1613309310 1553377571 1.04
clickbench_q35/duckdb:vortex-file-compressed 363259860 367604846 0.99
clickbench_q36/duckdb:vortex-file-compressed 26212006 26303698 1.00
clickbench_q37/duckdb:vortex-file-compressed 18537786 18350841 1.01
clickbench_q38/duckdb:vortex-file-compressed 21512280 20565323 1.05
clickbench_q39/duckdb:vortex-file-compressed 41207420 40181386 1.03
clickbench_q40/duckdb:vortex-file-compressed 19381652 20498750 0.95
clickbench_q41/duckdb:vortex-file-compressed 19225742 18299066 1.05
clickbench_q42/duckdb:vortex-file-compressed 19822294 19870239 1.00
duckdb / vortex-compact (1.017x ➖, 1↑ 3↓)
name PR 2ebc0e4 (ns) base b606e1a (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-compact 5936037 6061339 0.98
clickbench_q01/duckdb:vortex-compact 17799431 16887868 1.05
clickbench_q02/duckdb:vortex-compact 35509527 35936595 0.99
clickbench_q03/duckdb:vortex-compact 39496557 39294268 1.01
clickbench_q04/duckdb:vortex-compact 188832940 187091324 1.01
clickbench_q05/duckdb:vortex-compact 227123199 223293450 1.02
clickbench_q06/duckdb:vortex-compact 18892913 18520713 1.02
clickbench_q07/duckdb:vortex-compact 20992213 19440453 1.08
clickbench_q08/duckdb:vortex-compact 295897353 293043349 1.01
clickbench_q09/duckdb:vortex-compact 451594071 447325295 1.01
clickbench_q10/duckdb:vortex-compact 124626608 125091845 1.00
clickbench_q11/duckdb:vortex-compact 161052679 161297979 1.00
clickbench_q12/duckdb:vortex-compact 246899319 247129002 1.00
clickbench_q13/duckdb:vortex-compact 527637077 528045606 1.00
clickbench_q14/duckdb:vortex-compact 297818052 295961725 1.01
clickbench_q15/duckdb:vortex-compact 233500605 229057334 1.02
clickbench_q16/duckdb:vortex-compact 650269195 642773218 1.01
clickbench_q17/duckdb:vortex-compact 564836129 554459273 1.02
clickbench_q18/duckdb:vortex-compact 1121799029 1135667738 0.99
clickbench_q19/duckdb:vortex-compact 25788220 25258675 1.02
clickbench_q20/duckdb:vortex-compact 468045283 429349153 1.09
clickbench_q21/duckdb:vortex-compact 603944119 603356330 1.00
🚀 clickbench_q22/duckdb:vortex-compact 1044219132 1195265479 0.87
🚨 clickbench_q23/duckdb:vortex-compact 7431891215 6531617710 1.14
clickbench_q24/duckdb:vortex-compact 75718347 81393448 0.93
clickbench_q25/duckdb:vortex-compact 117820883 118732398 0.99
clickbench_q26/duckdb:vortex-compact 85674023 86910534 0.99
clickbench_q27/duckdb:vortex-compact 588147297 576388475 1.02
clickbench_q28/duckdb:vortex-compact 3117215433 3112527402 1.00
clickbench_q29/duckdb:vortex-compact 33614593 33598932 1.00
clickbench_q30/duckdb:vortex-compact 333125949 331946692 1.00
clickbench_q31/duckdb:vortex-compact 444567709 439747464 1.01
clickbench_q32/duckdb:vortex-compact 1322518148 1394918495 0.95
clickbench_q33/duckdb:vortex-compact 1525099042 1502333741 1.02
clickbench_q34/duckdb:vortex-compact 1686212227 1581467765 1.07
clickbench_q35/duckdb:vortex-compact 374719351 377545563 0.99
clickbench_q36/duckdb:vortex-compact 31307021 29579507 1.06
🚨 clickbench_q37/duckdb:vortex-compact 24480410 21981007 1.11
clickbench_q38/duckdb:vortex-compact 26328407 24009665 1.10
clickbench_q39/duckdb:vortex-compact 52372176 51006238 1.03
clickbench_q40/duckdb:vortex-compact 20712409 20401167 1.02
clickbench_q41/duckdb:vortex-compact 21154934 19720332 1.07
🚨 clickbench_q42/duckdb:vortex-compact 20813875 18832529 1.11
duckdb / parquet (1.010x ➖, 0↑ 0↓)
name PR 2ebc0e4 (ns) base b606e1a (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 220792383 218606334 1.01
clickbench_q01/duckdb:parquet 50188542 49842636 1.01
clickbench_q02/duckdb:parquet 66125204 65977043 1.00
clickbench_q03/duckdb:parquet 64974043 63230840 1.03
clickbench_q04/duckdb:parquet 198724703 197395649 1.01
clickbench_q05/duckdb:parquet 277496159 274203632 1.01
clickbench_q06/duckdb:parquet 61392995 61536871 1.00
clickbench_q07/duckdb:parquet 53500377 52271223 1.02
clickbench_q08/duckdb:parquet 259022859 259541876 1.00
clickbench_q09/duckdb:parquet 386599073 385840638 1.00
clickbench_q10/duckdb:parquet 94976610 96744397 0.98
clickbench_q11/duckdb:parquet 108346844 107467951 1.01
clickbench_q12/duckdb:parquet 290568445 284758370 1.02
clickbench_q13/duckdb:parquet 498344586 492177103 1.01
clickbench_q14/duckdb:parquet 319030967 320034994 1.00
clickbench_q15/duckdb:parquet 235132100 232531435 1.01
clickbench_q16/duckdb:parquet 585235216 588041800 1.00
clickbench_q17/duckdb:parquet 486557414 485203176 1.00
clickbench_q18/duckdb:parquet 1017676632 1012113888 1.01
clickbench_q19/duckdb:parquet 49894745 49525762 1.01
clickbench_q20/duckdb:parquet 428429224 426447372 1.00
clickbench_q21/duckdb:parquet 542883652 548126260 0.99
clickbench_q22/duckdb:parquet 907295629 915831047 0.99
clickbench_q23/duckdb:parquet 310165514 308247475 1.01
clickbench_q24/duckdb:parquet 79112890 77376287 1.02
clickbench_q25/duckdb:parquet 136211341 135803593 1.00
clickbench_q26/duckdb:parquet 52088431 51173314 1.02
clickbench_q27/duckdb:parquet 630137318 628075491 1.00
clickbench_q28/duckdb:parquet 4918158010 4873956704 1.01
clickbench_q29/duckdb:parquet 63552877 62266985 1.02
clickbench_q30/duckdb:parquet 300135051 293456983 1.02
clickbench_q31/duckdb:parquet 342825628 335896469 1.02
clickbench_q32/duckdb:parquet 1133348414 1093296764 1.04
clickbench_q33/duckdb:parquet 1218252653 1149337502 1.06
clickbench_q34/duckdb:parquet 1248010712 1203352126 1.04
clickbench_q35/duckdb:parquet 347071957 347804575 1.00
clickbench_q36/duckdb:parquet 64201936 64074392 1.00
clickbench_q37/duckdb:parquet 53750048 53812266 1.00
clickbench_q38/duckdb:parquet 58920775 58291524 1.01
clickbench_q39/duckdb:parquet 101108729 96138797 1.05
clickbench_q40/duckdb:parquet 56057477 57176519 0.98
clickbench_q41/duckdb:parquet 60203003 59088776 1.02
clickbench_q42/duckdb:parquet 53500086 53442468 1.00
duckdb / duckdb (1.095x ➖, 0↑ 19↓)
name PR 2ebc0e4 (ns) base b606e1a (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18163932 18661613 0.97
clickbench_q01/duckdb:duckdb 33538950 33702686 1.00
clickbench_q02/duckdb:duckdb 47550582 45294288 1.05
clickbench_q03/duckdb:duckdb 49168958 47308724 1.04
clickbench_q04/duckdb:duckdb 223016240 206831748 1.08
🚨 clickbench_q05/duckdb:duckdb 343936341 307668169 1.12
🚨 clickbench_q06/duckdb:duckdb 39866086 35440620 1.12
clickbench_q07/duckdb:duckdb 38730890 35635816 1.09
🚨 clickbench_q08/duckdb:duckdb 340935114 279735006 1.22
🚨 clickbench_q09/duckdb:duckdb 570643700 442462988 1.29
🚨 clickbench_q10/duckdb:duckdb 118273586 95419043 1.24
🚨 clickbench_q11/duckdb:duckdb 120443741 104134545 1.16
clickbench_q12/duckdb:duckdb 308623681 281857890 1.09
🚨 clickbench_q13/duckdb:duckdb 584509381 490942894 1.19
🚨 clickbench_q14/duckdb:duckdb 367372461 323492584 1.14
🚨 clickbench_q15/duckdb:duckdb 297455304 236400062 1.26
🚨 clickbench_q16/duckdb:duckdb 715602323 590613281 1.21
🚨 clickbench_q17/duckdb:duckdb 599372114 505023464 1.19
🚨 clickbench_q18/duckdb:duckdb 1310615416 1122600199 1.17
🚨 clickbench_q19/duckdb:duckdb 47291302 34193363 1.38
clickbench_q20/duckdb:duckdb 934074854 919485113 1.02
🚨 clickbench_q21/duckdb:duckdb 1053587721 954182361 1.10
🚨 clickbench_q22/duckdb:duckdb 1156173865 960733375 1.20
🚨 clickbench_q23/duckdb:duckdb 307087045 255453538 1.20
🚨 clickbench_q24/duckdb:duckdb 67475415 61229719 1.10
clickbench_q25/duckdb:duckdb 133052266 122908409 1.08
🚨 clickbench_q26/duckdb:duckdb 62571570 52818926 1.18
🚨 clickbench_q27/duckdb:duckdb 1126010791 902053540 1.25
clickbench_q28/duckdb:duckdb 4610563856 4478216743 1.03
clickbench_q29/duckdb:duckdb 47762288 48161084 0.99
clickbench_q30/duckdb:duckdb 271674261 282322815 0.96
clickbench_q31/duckdb:duckdb 420109324 417030122 1.01
clickbench_q32/duckdb:duckdb 1355540743 1434031117 0.95
clickbench_q33/duckdb:duckdb 1728836719 1723355127 1.00
clickbench_q34/duckdb:duckdb 1858225798 1818478687 1.02
clickbench_q35/duckdb:duckdb 264872451 258663147 1.02
clickbench_q36/duckdb:duckdb 42674015 43044681 0.99
clickbench_q37/duckdb:duckdb 31836806 31118192 1.02
clickbench_q38/duckdb:duckdb 32322380 30575278 1.06
clickbench_q39/duckdb:duckdb 70439566 71156718 0.99
clickbench_q40/duckdb:duckdb 32689678 31351316 1.04
clickbench_q41/duckdb:duckdb 31331027 30165591 1.04
clickbench_q42/duckdb:duckdb 32200729 31514437 1.02

@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 11, 2026
@AdamGS AdamGS merged commit 9c051ae into develop Mar 11, 2026
63 of 65 checks passed
@AdamGS AdamGS deleted the adamg/split-bench-display branch March 11, 2026 15:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants