Skip to content

async scan for duckdb#8068

Draft
myrrc wants to merge 1 commit into
developfrom
myrrc/duckdb-async-scan
Draft

async scan for duckdb#8068
myrrc wants to merge 1 commit into
developfrom
myrrc/duckdb-async-scan

Conversation

@myrrc
Copy link
Copy Markdown
Contributor

@myrrc myrrc commented May 22, 2026

todo

@myrrc myrrc added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 22, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 22, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026 •
edited
Loading

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.157x ❌

datafusion / vortex-file-compressed (1.157x ❌, 0↑ 8↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 129109742 119718366 1.08
polarsignals_q01/datafusion:vortex-file-compressed 🚨 303279293 267420555 1.13
polarsignals_q02/datafusion:vortex-file-compressed 🚨 25862748 22970721 1.13
polarsignals_q03/datafusion:vortex-file-compressed 🚨 336089619 258545971 1.30
polarsignals_q04/datafusion:vortex-file-compressed 🚨 13079758 11197219 1.17
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17473484 14688773 1.19
polarsignals_q06/datafusion:vortex-file-compressed 🚨 20848365 17426953 1.20
polarsignals_q07/datafusion:vortex-file-compressed 🚨 16107535 13460862 1.20
polarsignals_q08/datafusion:vortex-file-compressed 🚨 458627206 398172414 1.15
polarsignals_q09/datafusion:vortex-file-compressed 11318539 10786765 1.05

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.1%
Vortex (geomean): 0.886x ➖
Parquet (geomean): 0.851x ➖
Shifts: Parquet (control) -14.9% · Median polish -8.7%

datafusion / vortex-file-compressed (0.855x ➖, 3↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 656187751 809711744 0.81
tpch_q02/datafusion:vortex-file-compressed 🚀 778071081 1650762916 0.47
tpch_q03/datafusion:vortex-file-compressed 787253939 1108439502 0.71
tpch_q04/datafusion:vortex-file-compressed 568620393 672068679 0.85
tpch_q05/datafusion:vortex-file-compressed 898035680 1057701236 0.85
tpch_q06/datafusion:vortex-file-compressed 588633569 624866738 0.94
tpch_q07/datafusion:vortex-file-compressed 1120766187 1241273553 0.90
tpch_q08/datafusion:vortex-file-compressed 1419165618 1416524048 1.00
tpch_q09/datafusion:vortex-file-compressed 1527684594 1534549678 1.00
tpch_q10/datafusion:vortex-file-compressed 977319958 984924253 0.99
tpch_q11/datafusion:vortex-file-compressed 490447834 613620899 0.80
tpch_q12/datafusion:vortex-file-compressed 909832326 941079693 0.97
tpch_q13/datafusion:vortex-file-compressed 444584964 437549055 1.02
tpch_q14/datafusion:vortex-file-compressed 533885166 537561658 0.99
tpch_q15/datafusion:vortex-file-compressed 991279415 1042085070 0.95
tpch_q16/datafusion:vortex-file-compressed 383869569 415552774 0.92
tpch_q17/datafusion:vortex-file-compressed 1255157723 1281652705 0.98
tpch_q18/datafusion:vortex-file-compressed 1374245074 1283956573 1.07
tpch_q19/datafusion:vortex-file-compressed 847151502 961819769 0.88
tpch_q20/datafusion:vortex-file-compressed 990946770 1292360101 0.77
tpch_q21/datafusion:vortex-file-compressed 🚀 1657708743 2541151090 0.65
tpch_q22/datafusion:vortex-file-compressed 🚀 364978985 587899881 0.62
datafusion / vortex-compact (0.871x ➖, 2↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 686648761 729077571 0.94
tpch_q02/datafusion:vortex-compact 1023236957 1161027335 0.88
tpch_q03/datafusion:vortex-compact 697797601 832691354 0.84
tpch_q04/datafusion:vortex-compact 513183581 618946236 0.83
tpch_q05/datafusion:vortex-compact 846315303 979008833 0.86
tpch_q06/datafusion:vortex-compact 519906129 582679524 0.89
tpch_q07/datafusion:vortex-compact 950135576 1182817202 0.80
tpch_q08/datafusion:vortex-compact 1131145520 1371987653 0.82
tpch_q09/datafusion:vortex-compact 1150271012 1402090973 0.82
tpch_q10/datafusion:vortex-compact 835046565 987236742 0.85
tpch_q11/datafusion:vortex-compact 🚀 392172639 594754198 0.66
tpch_q12/datafusion:vortex-compact 894783502 965431374 0.93
tpch_q13/datafusion:vortex-compact 407681979 441224701 0.92
tpch_q14/datafusion:vortex-compact 638291191 692719247 0.92
tpch_q15/datafusion:vortex-compact 989783221 1040867557 0.95
tpch_q16/datafusion:vortex-compact 359886135 320290228 1.12
tpch_q17/datafusion:vortex-compact 1146990709 1116000449 1.03
tpch_q18/datafusion:vortex-compact 1089087261 1181122262 0.92
tpch_q19/datafusion:vortex-compact 780917066 912443739 0.86
tpch_q20/datafusion:vortex-compact 939268365 1049902418 0.89
tpch_q21/datafusion:vortex-compact 1562188550 1472736511 1.06
tpch_q22/datafusion:vortex-compact 🚀 347524258 637336961 0.55
datafusion / parquet (0.797x ➖, 5↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 852935717 828067217 1.03
tpch_q02/datafusion:parquet 738205472 939519543 0.79
tpch_q03/datafusion:parquet 1013945655 1030073351 0.98
tpch_q04/datafusion:parquet 556549711 482376121 1.15
tpch_q05/datafusion:parquet 1221581655 1301098426 0.94
tpch_q06/datafusion:parquet 529620672 583005888 0.91
tpch_q07/datafusion:parquet 🚀 1255567497 1894734177 0.66
tpch_q08/datafusion:parquet 1608627595 1764604384 0.91
tpch_q09/datafusion:parquet 1834695354 1958043911 0.94
tpch_q10/datafusion:parquet 1980226080 2250123466 0.88
tpch_q11/datafusion:parquet 552655191 569232534 0.97
tpch_q12/datafusion:parquet 668986636 894426295 0.75
tpch_q13/datafusion:parquet 🚀 703268690 1134616750 0.62
tpch_q14/datafusion:parquet 739471552 1007553100 0.73
tpch_q15/datafusion:parquet 🚀 1243658415 2264013358 0.55
tpch_q16/datafusion:parquet 🚀 374110031 620168453 0.60
tpch_q17/datafusion:parquet 1313037249 1741677745 0.75
tpch_q18/datafusion:parquet 1529384852 1782184337 0.86
tpch_q19/datafusion:parquet 908404652 1167680864 0.78
tpch_q20/datafusion:parquet 🚀 1137817949 2272959479 0.50
tpch_q21/datafusion:parquet 1809510056 2043677471 0.89
tpch_q22/datafusion:parquet 734977782 1035321962 0.71
duckdb / vortex-file-compressed (0.927x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 626478947 717848269 0.87
tpch_q02/duckdb:vortex-file-compressed 1048156845 1214915451 0.86
tpch_q03/duckdb:vortex-file-compressed 975459738 1020706895 0.96
tpch_q04/duckdb:vortex-file-compressed 789847811 899178727 0.88
tpch_q05/duckdb:vortex-file-compressed 1077449610 1300831212 0.83
tpch_q06/duckdb:vortex-file-compressed 591351722 670583683 0.88
tpch_q07/duckdb:vortex-file-compressed 1380207247 1390210378 0.99
tpch_q08/duckdb:vortex-file-compressed 1465818020 1549801958 0.95
tpch_q09/duckdb:vortex-file-compressed 1656767911 1769865974 0.94
tpch_q10/duckdb:vortex-file-compressed 1288381536 1332882527 0.97
tpch_q11/duckdb:vortex-file-compressed 674966950 708811512 0.95
tpch_q12/duckdb:vortex-file-compressed 1299730582 1377776208 0.94
tpch_q13/duckdb:vortex-file-compressed 925708708 956793224 0.97
tpch_q14/duckdb:vortex-file-compressed 639307888 745928533 0.86
tpch_q15/duckdb:vortex-file-compressed 559255290 593869322 0.94
tpch_q16/duckdb:vortex-file-compressed 447980911 508153367 0.88
tpch_q17/duckdb:vortex-file-compressed 1010738961 1016081532 0.99
tpch_q18/duckdb:vortex-file-compressed 1014442897 973583998 1.04
tpch_q19/duckdb:vortex-file-compressed 745240696 801835846 0.93
tpch_q20/duckdb:vortex-file-compressed 1061063713 1299960590 0.82
tpch_q21/duckdb:vortex-file-compressed 1835573146 1945241678 0.94
tpch_q22/duckdb:vortex-file-compressed 478430479 457855661 1.04
duckdb / vortex-compact (0.893x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 613248938 610307094 1.00
tpch_q02/duckdb:vortex-compact 944227538 1164334138 0.81
tpch_q03/duckdb:vortex-compact 821110580 910948057 0.90
tpch_q04/duckdb:vortex-compact 596746411 624556616 0.96
tpch_q05/duckdb:vortex-compact 1084473081 1203279883 0.90
tpch_q06/duckdb:vortex-compact 563949724 604923481 0.93
tpch_q07/duckdb:vortex-compact 1161260734 1205814179 0.96
tpch_q08/duckdb:vortex-compact 1338936100 1447474015 0.93
tpch_q09/duckdb:vortex-compact 1544267379 1664275455 0.93
tpch_q10/duckdb:vortex-compact 1009327127 1222904056 0.83
tpch_q11/duckdb:vortex-compact 656790281 774939278 0.85
tpch_q12/duckdb:vortex-compact 1050475315 1025581305 1.02
tpch_q13/duckdb:vortex-compact 838690124 897953605 0.93
tpch_q14/duckdb:vortex-compact 618711210 763504986 0.81
tpch_q15/duckdb:vortex-compact 521679883 633669529 0.82
tpch_q16/duckdb:vortex-compact 389310395 415347794 0.94
tpch_q17/duckdb:vortex-compact 923627274 1033344801 0.89
tpch_q18/duckdb:vortex-compact 781193225 861798257 0.91
tpch_q19/duckdb:vortex-compact 741771715 826656288 0.90
tpch_q20/duckdb:vortex-compact 1025389021 1280811593 0.80
tpch_q21/duckdb:vortex-compact 1612290687 1792841362 0.90
tpch_q22/duckdb:vortex-compact 405538627 520421227 0.78
duckdb / parquet (0.909x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 883711876 872404883 1.01
tpch_q02/duckdb:parquet 1402230015 1500590920 0.93
tpch_q03/duckdb:parquet 1694688572 1882862392 0.90
tpch_q04/duckdb:parquet 1028379588 1155474784 0.89
tpch_q05/duckdb:parquet 1832418210 2104392356 0.87
tpch_q06/duckdb:parquet 766499170 918281429 0.83
tpch_q07/duckdb:parquet 1975831516 2299601705 0.86
tpch_q08/duckdb:parquet 2314063741 2665615931 0.87
tpch_q09/duckdb:parquet 2467931696 2824240331 0.87
tpch_q10/duckdb:parquet 3123951929 3265451166 0.96
tpch_q11/duckdb:parquet 1091965108 1049756298 1.04
tpch_q12/duckdb:parquet 1174472243 1515153248 0.78
tpch_q13/duckdb:parquet 1214154171 1366835815 0.89
tpch_q14/duckdb:parquet 1239048462 1416196996 0.87
tpch_q15/duckdb:parquet 913230053 1013038782 0.90
tpch_q16/duckdb:parquet 963952587 955575640 1.01
tpch_q17/duckdb:parquet 1266930002 1600034936 0.79
tpch_q18/duckdb:parquet 1428949006 1501990856 0.95
tpch_q19/duckdb:parquet 1547480143 1609715681 0.96
tpch_q20/duckdb:parquet 1964229584 2115681959 0.93
tpch_q21/duckdb:parquet 1745566764 1928246809 0.91
tpch_q22/duckdb:parquet 1170556038 1151122611 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -5.8% +2.1% -7.8% +45.5% ➖ noise
1 datafusion:vortex-file-compressed -19.0% +2.1% -20.7% +50.5% ➖ noise
1 duckdb:vortex-compact +0.5% +2.1% -1.6% +34.3% ➖ noise
1 duckdb:vortex-file-compressed -12.7% +2.1% -14.6% +34.3% ➖ noise
2 datafusion:vortex-compact -11.9% -14.3% +2.9% +46.6% ➖ noise
2 datafusion:vortex-file-compressed -52.9% -14.3% -45.0% +34.3% ✅ faster
2 duckdb:vortex-compact -18.9% -14.3% -5.4% +34.3% ➖ noise
2 duckdb:vortex-file-compressed -13.7% -14.3% +0.7% +34.3% ➖ noise
3 datafusion:vortex-compact -16.2% -5.9% -11.0% +46.4% ➖ noise
3 datafusion:vortex-file-compressed -29.0% -5.9% -24.5% +45.0% ➖ noise
3 duckdb:vortex-compact -9.9% -5.9% -4.2% +37.1% ➖ noise
3 duckdb:vortex-file-compressed -4.4% -5.9% +1.5% +37.2% ➖ noise
4 datafusion:vortex-compact -17.1% +1.3% -18.2% +43.5% ➖ noise
4 datafusion:vortex-file-compressed -15.4% +1.3% -16.5% +34.3% ➖ noise
4 duckdb:vortex-compact -4.5% +1.3% -5.7% +34.3% ➖ noise
4 duckdb:vortex-file-compressed -12.2% +1.3% -13.3% +34.3% ➖ noise
5 datafusion:vortex-compact -13.6% -9.6% -4.4% +34.3% ➖ noise
5 datafusion:vortex-file-compressed -15.1% -9.6% -6.1% +34.3% ➖ noise
5 duckdb:vortex-compact -9.9% -9.6% -0.3% +34.3% ➖ noise
5 duckdb:vortex-file-compressed -17.2% -9.6% -8.4% +34.3% ➖ noise
6 datafusion:vortex-compact -10.8% -12.9% +2.5% +34.3% ➖ noise
6 datafusion:vortex-file-compressed -5.8% -12.9% +8.2% +34.3% ➖ noise
6 duckdb:vortex-compact -6.8% -12.9% +7.1% +34.3% ➖ noise
6 duckdb:vortex-file-compressed -11.8% -12.9% +1.3% +34.3% ➖ noise
7 datafusion:vortex-compact -19.7% -24.5% +6.5% +34.3% ➖ noise
7 datafusion:vortex-file-compressed -9.7% -24.5% +19.7% +34.3% ➖ noise
7 duckdb:vortex-compact -3.7% -24.5% +27.6% +34.3% ➖ noise
7 duckdb:vortex-file-compressed -0.7% -24.5% +31.6% +34.3% ➖ noise
8 datafusion:vortex-compact -17.6% -11.0% -7.3% +34.3% ➖ noise
8 datafusion:vortex-file-compressed +0.2% -11.0% +12.6% +34.3% ➖ noise
8 duckdb:vortex-compact -7.5% -11.0% +4.0% +34.3% ➖ noise
8 duckdb:vortex-file-compressed -5.4% -11.0% +6.3% +34.3% ➖ noise
9 datafusion:vortex-compact -18.0% -9.5% -9.3% +34.3% ➖ noise
9 datafusion:vortex-file-compressed -0.4% -9.5% +10.0% +34.3% ➖ noise
9 duckdb:vortex-compact -7.2% -9.5% +2.5% +34.3% ➖ noise
9 duckdb:vortex-file-compressed -6.4% -9.5% +3.5% +34.3% ➖ noise
10 datafusion:vortex-compact -15.4% -8.2% -7.8% +34.3% ➖ noise
10 datafusion:vortex-file-compressed -0.8% -8.2% +8.1% +34.3% ➖ noise
10 duckdb:vortex-compact -17.5% -8.2% -10.0% +34.3% ➖ noise
10 duckdb:vortex-file-compressed -3.3% -8.2% +5.3% +34.3% ➖ noise
11 datafusion:vortex-compact -34.1% +0.5% -34.4% +34.3% ✅ faster
11 datafusion:vortex-file-compressed -20.1% +0.5% -20.5% +34.3% ➖ noise
11 duckdb:vortex-compact -15.2% +0.5% -15.7% +34.3% ➖ noise
11 duckdb:vortex-file-compressed -4.8% +0.5% -5.2% +34.3% ➖ noise
12 datafusion:vortex-compact -7.3% -23.9% +21.7% +34.3% ➖ noise
12 datafusion:vortex-file-compressed -3.3% -23.9% +27.0% +34.3% ➖ noise
12 duckdb:vortex-compact +2.4% -23.9% +34.5% +34.3% 🚨 regression
12 duckdb:vortex-file-compressed -5.7% -23.9% +23.9% +34.3% ➖ noise
13 datafusion:vortex-compact -7.6% -25.8% +24.5% +34.3% ➖ noise
13 datafusion:vortex-file-compressed +1.6% -25.8% +36.9% +34.3% 🚨 regression
13 duckdb:vortex-compact -6.6% -25.8% +25.9% +43.9% ➖ noise
13 duckdb:vortex-file-compressed -3.2% -25.8% +30.4% +34.3% ➖ noise
14 datafusion:vortex-compact -7.9% -19.9% +15.0% +34.3% ➖ noise
14 datafusion:vortex-file-compressed -0.7% -19.9% +23.9% +34.3% ➖ noise
14 duckdb:vortex-compact -19.0% -19.9% +1.1% +34.3% ➖ noise
14 duckdb:vortex-file-compressed -14.3% -19.9% +7.0% +34.3% ➖ noise
15 datafusion:vortex-compact -4.9% -29.6% +35.1% +34.3% 🚨 regression
15 datafusion:vortex-file-compressed -4.9% -29.6% +35.2% +34.3% 🚨 regression
15 duckdb:vortex-compact -17.7% -29.6% +17.0% +34.3% ➖ noise
15 duckdb:vortex-file-compressed -5.8% -29.6% +33.8% +34.3% ➖ noise
16 datafusion:vortex-compact +12.4% -22.0% +44.0% +34.3% 🚨 regression
16 datafusion:vortex-file-compressed -7.6% -22.0% +18.4% +34.3% ➖ noise
16 duckdb:vortex-compact -6.3% -22.0% +20.2% +34.3% ➖ noise
16 duckdb:vortex-file-compressed -11.8% -22.0% +13.0% +34.3% ➖ noise
17 datafusion:vortex-compact +2.8% -22.7% +33.0% +34.3% ➖ noise
17 datafusion:vortex-file-compressed -2.1% -22.7% +26.8% +34.3% ➖ noise
17 duckdb:vortex-compact -10.6% -22.7% +15.7% +34.3% ➖ noise
17 duckdb:vortex-file-compressed -0.5% -22.7% +28.7% +34.3% ➖ noise
18 datafusion:vortex-compact -7.8% -9.6% +2.0% +34.3% ➖ noise
18 datafusion:vortex-file-compressed +7.0% -9.6% +18.5% +34.3% ➖ noise
18 duckdb:vortex-compact -9.4% -9.6% +0.3% +34.3% ➖ noise
18 duckdb:vortex-file-compressed +4.2% -9.6% +15.3% +34.3% ➖ noise
19 datafusion:vortex-compact -14.4% -13.5% -1.0% +34.3% ➖ noise
19 datafusion:vortex-file-compressed -11.9% -13.5% +1.8% +34.3% ➖ noise
19 duckdb:vortex-compact -10.3% -13.5% +3.8% +34.3% ➖ noise
19 duckdb:vortex-file-compressed -7.1% -13.5% +7.5% +34.3% ➖ noise
20 datafusion:vortex-compact -10.5% -31.8% +31.2% +34.3% ➖ noise
20 datafusion:vortex-file-compressed -23.3% -31.8% +12.5% +34.3% ➖ noise
20 duckdb:vortex-compact -19.9% -31.8% +17.4% +34.3% ➖ noise
20 duckdb:vortex-file-compressed -18.4% -31.8% +19.7% +34.3% ➖ noise
21 datafusion:vortex-compact +6.1% -10.5% +18.5% +34.3% ➖ noise
21 datafusion:vortex-file-compressed -34.8% -10.5% -27.1% +34.3% ✅ faster
21 duckdb:vortex-compact -10.1% -10.5% +0.4% +34.3% ➖ noise
21 duckdb:vortex-file-compressed -5.6% -10.5% +5.4% +34.3% ➖ noise
22 datafusion:vortex-compact -45.5% -15.0% -35.8% +34.3% ✅ faster
22 datafusion:vortex-file-compressed -37.9% -15.0% -26.9% +36.0% ✅ faster
22 duckdb:vortex-compact -22.1% -15.0% -8.3% +34.3% ➖ noise
22 duckdb:vortex-file-compressed +4.5% -15.0% +23.0% +34.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026 •
edited
Loading

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.1%
Vortex (geomean): 0.939x ➖
Parquet (geomean): 0.910x ➖
Shifts: Parquet (control) -9.0% · Median polish -2.6%

datafusion / vortex-file-compressed (0.968x ➖, 1↑ 0↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5018214 5538791 0.91
fineweb_q01/datafusion:vortex-file-compressed 20289530 20861946 0.97
fineweb_q02/datafusion:vortex-file-compressed 21429353 22192688 0.97
fineweb_q03/datafusion:vortex-file-compressed 🚀 79271505 88907658 0.89
fineweb_q04/datafusion:vortex-file-compressed 227698605 231685297 0.98
fineweb_q05/datafusion:vortex-file-compressed 218340358 217716279 1.00
fineweb_q06/datafusion:vortex-file-compressed 49712872 51374802 0.97
fineweb_q07/datafusion:vortex-file-compressed 59535517 57468117 1.04
fineweb_q08/datafusion:vortex-file-compressed 22243689 22271684 1.00
datafusion / vortex-compact (0.950x ➖, 1↑ 0↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5428760 5965949 0.91
fineweb_q01/datafusion:vortex-compact 91262813 93945518 0.97
fineweb_q02/datafusion:vortex-compact 99798880 107369862 0.93
fineweb_q03/datafusion:vortex-compact 873595045 854398746 1.02
fineweb_q04/datafusion:vortex-compact 906539471 907441306 1.00
fineweb_q05/datafusion:vortex-compact 831103701 820245484 1.01
fineweb_q06/datafusion:vortex-compact 460255582 462762366 0.99
fineweb_q07/datafusion:vortex-compact 474889509 500435390 0.95
fineweb_q08/datafusion:vortex-compact 🚀 16741489 21243703 0.79
datafusion / parquet (0.987x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6379953 6722485 0.95
fineweb_q01/datafusion:parquet 291398473 293255121 0.99
fineweb_q02/datafusion:parquet 290713837 300930283 0.97
fineweb_q03/datafusion:parquet 290914739 281845565 1.03
fineweb_q04/datafusion:parquet 302267425 297283918 1.02
fineweb_q05/datafusion:parquet 301168998 305940406 0.98
fineweb_q06/datafusion:parquet 285201888 297260859 0.96
fineweb_q07/datafusion:parquet 287417657 289763530 0.99
fineweb_q08/datafusion:parquet 284277040 285430212 1.00
duckdb / vortex-file-compressed (0.909x ➖, 4↑ 1↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 4596453 3802077 1.21
fineweb_q01/duckdb:vortex-file-compressed 22241350 24301243 0.92
fineweb_q02/duckdb:vortex-file-compressed 🚀 24387837 27750367 0.88
fineweb_q03/duckdb:vortex-file-compressed 117090605 129256027 0.91
fineweb_q04/duckdb:vortex-file-compressed 217984308 239434659 0.91
fineweb_q05/duckdb:vortex-file-compressed 215230885 234904715 0.92
fineweb_q06/duckdb:vortex-file-compressed 🚀 51381375 64949230 0.79
fineweb_q07/duckdb:vortex-file-compressed 🚀 56004372 65868252 0.85
fineweb_q08/duckdb:vortex-file-compressed 🚀 22907294 26660963 0.86
duckdb / vortex-compact (0.928x ➖, 3↑ 0↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4723402 4968171 0.95
fineweb_q01/duckdb:vortex-compact 🚀 90742738 121836224 0.74
fineweb_q02/duckdb:vortex-compact 🚀 110060648 129247601 0.85
fineweb_q03/duckdb:vortex-compact 🚀 854124956 1033572961 0.83
fineweb_q04/duckdb:vortex-compact 891470927 899663513 0.99
fineweb_q05/duckdb:vortex-compact 800299053 795506519 1.01
fineweb_q06/duckdb:vortex-compact 460063403 462578318 0.99
fineweb_q07/duckdb:vortex-compact 467720616 475686585 0.98
fineweb_q08/duckdb:vortex-compact 21217382 20113093 1.05
duckdb / parquet (0.839x ✅, 8↑ 0↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚀 30926637 36117152 0.86
fineweb_q01/duckdb:parquet 🚀 84172179 100888980 0.83
fineweb_q02/duckdb:parquet 🚀 84719314 103729276 0.82
fineweb_q03/duckdb:parquet 🚀 315120967 380397088 0.83
fineweb_q04/duckdb:parquet 🚀 447448320 526979003 0.85
fineweb_q05/duckdb:parquet 🚀 414034645 489743631 0.85
fineweb_q06/duckdb:parquet 🚀 203863973 246410128 0.83
fineweb_q07/duckdb:parquet 214961693 220049919 0.98
fineweb_q08/duckdb:parquet 🚀 31970128 43513822 0.73
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -9.0% -9.9% +0.9% +51.2% ➖ noise
0 datafusion:vortex-file-compressed -9.4% -9.9% +0.5% +52.8% ➖ noise
0 duckdb:vortex-compact -4.9% -9.9% +5.5% +95.6% ➖ noise
0 duckdb:vortex-file-compressed +20.9% -9.9% +34.1% +77.5% ➖ noise
1 datafusion:vortex-compact -2.9% -8.9% +6.7% +11.2% ➖ noise
1 datafusion:vortex-file-compressed -2.7% -8.9% +6.8% +15.0% ➖ noise
1 duckdb:vortex-compact -25.5% -8.9% -18.2% +10.4% ✅ faster
1 duckdb:vortex-file-compressed -8.5% -8.9% +0.5% +55.1% ➖ noise
2 datafusion:vortex-compact -7.1% -11.2% +4.6% +28.4% ➖ noise
2 datafusion:vortex-file-compressed -3.4% -11.2% +8.7% +13.5% ➖ noise
2 duckdb:vortex-compact -14.8% -11.2% -4.1% +12.0% ➖ noise
2 duckdb:vortex-file-compressed -12.1% -11.2% -1.1% +10.4% ➖ noise
3 datafusion:vortex-compact +2.2% -7.5% +10.6% +10.4% 🚨 regression
3 datafusion:vortex-file-compressed -10.8% -7.5% -3.6% +12.0% ➖ noise
3 duckdb:vortex-compact -17.4% -7.5% -10.6% +10.4% ✅ faster
3 duckdb:vortex-file-compressed -9.4% -7.5% -2.0% +37.5% ➖ noise
4 datafusion:vortex-compact -0.1% -7.1% +7.5% +10.4% ➖ noise
4 datafusion:vortex-file-compressed -1.7% -7.1% +5.8% +10.4% ➖ noise
4 duckdb:vortex-compact -0.9% -7.1% +6.6% +10.4% ➖ noise
4 duckdb:vortex-file-compressed -9.0% -7.1% -2.0% +10.4% ➖ noise
5 datafusion:vortex-compact +1.3% -8.8% +11.1% +10.4% 🚨 regression
5 datafusion:vortex-file-compressed +0.3% -8.8% +9.9% +10.4% ➖ noise
5 duckdb:vortex-compact +0.6% -8.8% +10.3% +10.4% ➖ noise
5 duckdb:vortex-file-compressed -8.4% -8.8% +0.4% +10.4% ➖ noise
6 datafusion:vortex-compact -0.5% -10.9% +11.6% +10.4% 🚨 regression
6 datafusion:vortex-file-compressed -3.2% -10.9% +8.6% +10.4% ➖ noise
6 duckdb:vortex-compact -0.5% -10.9% +11.6% +10.4% 🚨 regression
6 duckdb:vortex-file-compressed -20.9% -10.9% -11.2% +10.4% ✅ faster
7 datafusion:vortex-compact -5.1% -1.6% -3.6% +10.4% ➖ noise
7 datafusion:vortex-file-compressed +3.6% -1.6% +5.2% +13.1% ➖ noise
7 duckdb:vortex-compact -1.7% -1.6% -0.1% +10.4% ➖ noise
7 duckdb:vortex-file-compressed -15.0% -1.6% -13.6% +17.2% ➖ noise
8 datafusion:vortex-compact -21.2% -14.5% -7.9% +18.6% ➖ noise
8 datafusion:vortex-file-compressed -0.1% -14.5% +16.8% +11.5% 🚨 regression
8 duckdb:vortex-compact +5.5% -14.5% +23.3% +17.6% 🚨 regression
8 duckdb:vortex-file-compressed -14.1% -14.5% +0.4% +10.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026 •
edited
Loading

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.0%
Vortex (geomean): 0.924x ➖
Parquet (geomean): 0.906x ➖
Shifts: Parquet (control) -9.4% · Median polish -8.8%

datafusion / vortex-file-compressed (0.925x ➖, 1↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 46009894 35531002 1.29
fineweb_q01/datafusion:vortex-file-compressed 🚀 505696383 730369362 0.69
fineweb_q02/datafusion:vortex-file-compressed 523409214 658653511 0.79
fineweb_q03/datafusion:vortex-file-compressed 1387097515 1427513810 0.97
fineweb_q04/datafusion:vortex-file-compressed 1390009335 1408142941 0.99
fineweb_q05/datafusion:vortex-file-compressed 1359568386 1354796569 1.00
fineweb_q06/datafusion:vortex-file-compressed 1499579647 1862141853 0.81
fineweb_q07/datafusion:vortex-file-compressed 1322724751 1406068653 0.94
fineweb_q08/datafusion:vortex-file-compressed 490646827 515479192 0.95
datafusion / vortex-compact (0.862x ➖, 2↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 34217759 47782945 0.72
fineweb_q01/datafusion:vortex-compact 🚀 450384588 731352626 0.62
fineweb_q02/datafusion:vortex-compact 🚀 585255548 890272482 0.66
fineweb_q03/datafusion:vortex-compact 1356334285 1331164218 1.02
fineweb_q04/datafusion:vortex-compact 1558823892 1524207525 1.02
fineweb_q05/datafusion:vortex-compact 1357511630 1334230502 1.02
fineweb_q06/datafusion:vortex-compact 1296669275 1282505686 1.01
fineweb_q07/datafusion:vortex-compact 1141434450 1289842177 0.88
fineweb_q08/datafusion:vortex-compact 354376679 372123844 0.95
datafusion / parquet (0.885x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1087675193 1309586739 0.83
fineweb_q01/datafusion:parquet 1950754199 2307330756 0.85
fineweb_q02/datafusion:parquet 1867830670 2199595201 0.85
fineweb_q03/datafusion:parquet 2012840854 2390390948 0.84
fineweb_q04/datafusion:parquet 2213597949 2027652758 1.09
fineweb_q05/datafusion:parquet 2006362923 2200659093 0.91
fineweb_q06/datafusion:parquet 1787854115 2106099745 0.85
fineweb_q07/datafusion:parquet 2056441388 2510337344 0.82
fineweb_q08/datafusion:parquet 2202109936 2302988219 0.96
duckdb / vortex-file-compressed (0.871x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 75646450 98211263 0.77
fineweb_q01/duckdb:vortex-file-compressed 616635997 776414273 0.79
fineweb_q02/duckdb:vortex-file-compressed 536541292 704124607 0.76
fineweb_q03/duckdb:vortex-file-compressed 1486931683 1801053262 0.83
fineweb_q04/duckdb:vortex-file-compressed 1632968590 1564872423 1.04
fineweb_q05/duckdb:vortex-file-compressed 1565836523 1423065406 1.10
fineweb_q06/duckdb:vortex-file-compressed 1646221889 1916078572 0.86
fineweb_q07/duckdb:vortex-file-compressed 1442756722 1550921741 0.93
fineweb_q08/duckdb:vortex-file-compressed 616972320 758180454 0.81
duckdb / vortex-compact (1.052x ➖, 0↑ 1↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 92563991 63283209 1.46
fineweb_q01/duckdb:vortex-compact 636261960 700785658 0.91
fineweb_q02/duckdb:vortex-compact 619950834 721341600 0.86
fineweb_q03/duckdb:vortex-compact 1716352827 1663282947 1.03
fineweb_q04/duckdb:vortex-compact 2092932445 1807759231 1.16
fineweb_q05/duckdb:vortex-compact 1749925199 1619178529 1.08
fineweb_q06/duckdb:vortex-compact 1479026309 1623414039 0.91
fineweb_q07/duckdb:vortex-compact 1385477817 1327570129 1.04
fineweb_q08/duckdb:vortex-compact 546190834 486433225 1.12
duckdb / parquet (0.927x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1157348057 1218556780 0.95
fineweb_q01/duckdb:parquet 1407139318 1467448585 0.96
fineweb_q02/duckdb:parquet 1394008461 1442444845 0.97
fineweb_q03/duckdb:parquet 3706973836 3779688631 0.98
fineweb_q04/duckdb:parquet 1944352927 2033985299 0.96
fineweb_q05/duckdb:parquet 2156733689 2483916174 0.87
fineweb_q06/duckdb:parquet 4382695745 4855812597 0.90
fineweb_q07/duckdb:parquet 2727811604 3151111179 0.87
fineweb_q08/duckdb:parquet 1121498997 1237613562 0.91
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -28.4% -11.2% -19.4% +183.2% ➖ noise
0 datafusion:vortex-file-compressed +29.5% -11.2% +45.8% +198.8% ➖ noise
0 duckdb:vortex-compact +46.3% -11.2% +64.7% +56.9% 🚨 regression
0 duckdb:vortex-file-compressed -23.0% -11.2% -13.3% +57.3% ➖ noise
1 datafusion:vortex-compact -38.4% -10.0% -31.6% +66.3% ➖ noise
1 datafusion:vortex-file-compressed -30.8% -10.0% -23.1% +67.0% ➖ noise
1 duckdb:vortex-compact -9.2% -10.0% +0.8% +47.2% ➖ noise
1 duckdb:vortex-file-compressed -20.6% -10.0% -11.8% +30.0% ➖ noise
2 datafusion:vortex-compact -34.3% -9.4% -27.4% +40.1% ➖ noise
2 datafusion:vortex-file-compressed -20.5% -9.4% -12.3% +30.0% ➖ noise
2 duckdb:vortex-compact -14.1% -9.4% -5.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -23.8% -9.4% -15.9% +83.8% ➖ noise
3 datafusion:vortex-compact +1.9% -9.1% +12.1% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -2.8% -9.1% +6.9% +30.0% ➖ noise
3 duckdb:vortex-compact +3.2% -9.1% +13.6% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -17.4% -9.1% -9.2% +30.0% ➖ noise
4 datafusion:vortex-compact +2.3% +2.2% +0.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -1.3% +2.2% -3.4% +30.0% ➖ noise
4 duckdb:vortex-compact +15.8% +2.2% +13.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +4.4% +2.2% +2.1% +30.0% ➖ noise
5 datafusion:vortex-compact +1.7% -11.0% +14.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +0.4% -11.0% +12.8% +30.0% ➖ noise
5 duckdb:vortex-compact +8.1% -11.0% +21.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +10.0% -11.0% +23.7% +30.0% ➖ noise
6 datafusion:vortex-compact +1.1% -12.5% +15.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -19.5% -12.5% -8.0% +30.0% ➖ noise
6 duckdb:vortex-compact -8.9% -12.5% +4.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -14.1% -12.5% -1.8% +30.0% ➖ noise
7 datafusion:vortex-compact -11.5% -15.8% +5.1% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -5.9% -15.8% +11.7% +30.0% ➖ noise
7 duckdb:vortex-compact +4.4% -15.8% +23.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -7.0% -15.8% +10.5% +30.0% ➖ noise
8 datafusion:vortex-compact -4.8% -6.9% +2.3% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -4.8% -6.9% +2.3% +30.0% ➖ noise
8 duckdb:vortex-compact +12.3% -6.9% +20.6% +60.2% ➖ noise
8 duckdb:vortex-file-compressed -18.6% -6.9% -12.6% +36.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Vortex (geomean): 1.005x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.4%

datafusion / vortex-file-compressed (0.985x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 391136276 400194709 0.98
tpch_q02/datafusion:vortex-file-compressed 105803932 105150333 1.01
tpch_q03/datafusion:vortex-file-compressed 211978248 206841631 1.02
tpch_q04/datafusion:vortex-file-compressed 110178424 111938647 0.98
tpch_q05/datafusion:vortex-file-compressed 369771633 378296165 0.98
tpch_q06/datafusion:vortex-file-compressed 36260704 36306513 1.00
tpch_q07/datafusion:vortex-file-compressed 498020706 503855041 0.99
tpch_q08/datafusion:vortex-file-compressed 354651845 354238308 1.00
tpch_q09/datafusion:vortex-file-compressed 632145142 629676353 1.00
tpch_q10/datafusion:vortex-file-compressed 224422317 234606636 0.96
tpch_q11/datafusion:vortex-file-compressed 81447538 83122586 0.98
tpch_q12/datafusion:vortex-file-compressed 115086049 119642558 0.96
tpch_q13/datafusion:vortex-file-compressed 213315048 221687954 0.96
tpch_q14/datafusion:vortex-file-compressed 51841805 55604344 0.93
tpch_q15/datafusion:vortex-file-compressed 96778835 100690479 0.96
tpch_q16/datafusion:vortex-file-compressed 76268800 75643727 1.01
tpch_q17/datafusion:vortex-file-compressed 630337653 641332230 0.98
tpch_q18/datafusion:vortex-file-compressed 835244627 855338052 0.98
tpch_q19/datafusion:vortex-file-compressed 69972871 68860814 1.02
tpch_q20/datafusion:vortex-file-compressed 160638862 158678546 1.01
tpch_q21/datafusion:vortex-file-compressed 649149719 656116496 0.99
tpch_q22/datafusion:vortex-file-compressed 62357910 64499252 0.97
datafusion / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 434175857 437418274 0.99
tpch_q02/datafusion:vortex-compact 108687866 112198923 0.97
tpch_q03/datafusion:vortex-compact 213828984 209977040 1.02
tpch_q04/datafusion:vortex-compact 117417400 118417365 0.99
tpch_q05/datafusion:vortex-compact 371506545 373987869 0.99
tpch_q06/datafusion:vortex-compact 58050536 59076573 0.98
tpch_q07/datafusion:vortex-compact 516113056 507920474 1.02
tpch_q08/datafusion:vortex-compact 362063195 352963535 1.03
tpch_q09/datafusion:vortex-compact 628070930 631637385 0.99
tpch_q10/datafusion:vortex-compact 242418052 243645484 0.99
tpch_q11/datafusion:vortex-compact 82875015 82648017 1.00
tpch_q12/datafusion:vortex-compact 157183420 158622925 0.99
tpch_q13/datafusion:vortex-compact 262599757 266745571 0.98
tpch_q14/datafusion:vortex-compact 70971112 69223865 1.03
tpch_q15/datafusion:vortex-compact 151896040 153441582 0.99
tpch_q16/datafusion:vortex-compact 77775839 80083306 0.97
tpch_q17/datafusion:vortex-compact 629071706 627091977 1.00
tpch_q18/datafusion:vortex-compact 829524983 834009578 0.99
tpch_q19/datafusion:vortex-compact 123892757 120738663 1.03
tpch_q20/datafusion:vortex-compact 183401576 184419169 0.99
tpch_q21/datafusion:vortex-compact 653814857 650172915 1.01
tpch_q22/datafusion:vortex-compact 69995771 70333999 1.00
datafusion / parquet (1.002x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 448271223 451301797 0.99
tpch_q02/datafusion:parquet 170403870 165510387 1.03
tpch_q03/datafusion:parquet 281568265 274132988 1.03
tpch_q04/datafusion:parquet 127795987 125283466 1.02
tpch_q05/datafusion:parquet 429566384 427656712 1.00
tpch_q06/datafusion:parquet 122328172 125121723 0.98
tpch_q07/datafusion:parquet 601880680 588945066 1.02
tpch_q08/datafusion:parquet 456553029 450282039 1.01
tpch_q09/datafusion:parquet 731469242 720742235 1.01
tpch_q10/datafusion:parquet 494202883 480140299 1.03
tpch_q11/datafusion:parquet 113760412 113925205 1.00
tpch_q12/datafusion:parquet 190477402 201556634 0.95
tpch_q13/datafusion:parquet 331973393 328050340 1.01
tpch_q14/datafusion:parquet 156086890 158665978 0.98
tpch_q15/datafusion:parquet 247388238 251507532 0.98
tpch_q16/datafusion:parquet 123307314 120691655 1.02
tpch_q17/datafusion:parquet 672537055 668929770 1.01
tpch_q18/datafusion:parquet 878782316 873451981 1.01
tpch_q19/datafusion:parquet 258697580 253022003 1.02
tpch_q20/datafusion:parquet 284736815 290352053 0.98
tpch_q21/datafusion:parquet 688276203 722536642 0.95
tpch_q22/datafusion:parquet 214200748 214842046 1.00
datafusion / arrow (1.006x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 594439992 587786305 1.01
tpch_q02/datafusion:arrow 164068155 160381914 1.02
tpch_q03/datafusion:arrow 467757332 454946962 1.03
tpch_q04/datafusion:arrow 333527894 337391314 0.99
tpch_q05/datafusion:arrow 914869929 911634164 1.00
tpch_q06/datafusion:arrow 274964048 277781797 0.99
tpch_q07/datafusion:arrow 1166262963 1140360877 1.02
tpch_q08/datafusion:arrow 1139614582 1123988986 1.01
tpch_q09/datafusion:arrow 1335700667 1334964127 1.00
tpch_q10/datafusion:arrow 590407764 579859371 1.02
tpch_q11/datafusion:arrow 136845305 135172539 1.01
tpch_q12/datafusion:arrow 691851713 739536755 0.94
tpch_q13/datafusion:arrow 496785388 503791190 0.99
tpch_q14/datafusion:arrow 312658262 311742061 1.00
tpch_q15/datafusion:arrow 680173740 682001256 1.00
tpch_q16/datafusion:arrow 104491595 103028344 1.01
tpch_q17/datafusion:arrow 1318583454 1292290591 1.02
tpch_q18/datafusion:arrow 1862791777 1844320548 1.01
tpch_q19/datafusion:arrow 480182143 468769463 1.02
tpch_q20/datafusion:arrow 478972099 478957742 1.00
tpch_q21/datafusion:arrow 2997419202 2946309554 1.02
tpch_q22/datafusion:arrow 130140823 128267943 1.01
duckdb / vortex-file-compressed (1.020x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170661640 167718022 1.02
tpch_q02/duckdb:vortex-file-compressed 56637133 53262642 1.06
tpch_q03/duckdb:vortex-file-compressed 126970442 122630189 1.04
tpch_q04/duckdb:vortex-file-compressed 160928018 157531070 1.02
tpch_q05/duckdb:vortex-file-compressed 142104624 138016453 1.03
tpch_q06/duckdb:vortex-file-compressed 33697403 32682034 1.03
tpch_q07/duckdb:vortex-file-compressed 137603117 133853233 1.03
tpch_q08/duckdb:vortex-file-compressed 169958133 171357436 0.99
tpch_q09/duckdb:vortex-file-compressed 395887085 398394893 0.99
tpch_q10/duckdb:vortex-file-compressed 189155078 189634368 1.00
tpch_q11/duckdb:vortex-file-compressed 34942083 32579708 1.07
tpch_q12/duckdb:vortex-file-compressed 99783405 101235336 0.99
tpch_q13/duckdb:vortex-file-compressed 228429244 229459866 1.00
tpch_q14/duckdb:vortex-file-compressed 55903326 55589133 1.01
tpch_q15/duckdb:vortex-file-compressed 91749607 87646724 1.05
tpch_q16/duckdb:vortex-file-compressed 78170264 78168676 1.00
tpch_q17/duckdb:vortex-file-compressed 95134676 94484782 1.01
tpch_q18/duckdb:vortex-file-compressed 290256844 282473920 1.03
tpch_q19/duckdb:vortex-file-compressed 79760070 78933266 1.01
tpch_q20/duckdb:vortex-file-compressed 155779810 144379485 1.08
tpch_q21/duckdb:vortex-file-compressed 490497579 485037748 1.01
tpch_q22/duckdb:vortex-file-compressed 64732471 64296325 1.01
duckdb / vortex-compact (1.017x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 226253348 228696244 0.99
tpch_q02/duckdb:vortex-compact 61677785 58451566 1.06
tpch_q03/duckdb:vortex-compact 139320696 136713100 1.02
tpch_q04/duckdb:vortex-compact 173883166 170486589 1.02
tpch_q05/duckdb:vortex-compact 170579204 163007826 1.05
tpch_q06/duckdb:vortex-compact 58036921 57993254 1.00
tpch_q07/duckdb:vortex-compact 175277105 173109380 1.01
tpch_q08/duckdb:vortex-compact 190517593 185070053 1.03
tpch_q09/duckdb:vortex-compact 426180438 423444993 1.01
tpch_q10/duckdb:vortex-compact 220280145 218516632 1.01
tpch_q11/duckdb:vortex-compact 40684631 38595923 1.05
tpch_q12/duckdb:vortex-compact 164345838 162003368 1.01
tpch_q13/duckdb:vortex-compact 277805391 276692738 1.00
tpch_q14/duckdb:vortex-compact 73154932 74010775 0.99
tpch_q15/duckdb:vortex-compact 114785809 115562375 0.99
tpch_q16/duckdb:vortex-compact 82717734 79565375 1.04
tpch_q17/duckdb:vortex-compact 107882590 108133156 1.00
tpch_q18/duckdb:vortex-compact 295260287 286756612 1.03
tpch_q19/duckdb:vortex-compact 95838072 95430421 1.00
tpch_q20/duckdb:vortex-compact 184283838 175762017 1.05
tpch_q21/duckdb:vortex-compact 518288231 508672244 1.02
tpch_q22/duckdb:vortex-compact 72441001 71794198 1.01
duckdb / parquet (1.001x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 261066457 262301244 1.00
tpch_q02/duckdb:parquet 101744599 103960279 0.98
tpch_q03/duckdb:parquet 213240347 212630727 1.00
tpch_q04/duckdb:parquet 135461981 131046978 1.03
tpch_q05/duckdb:parquet 224261700 224290937 1.00
tpch_q06/duckdb:parquet 75316677 74283090 1.01
tpch_q07/duckdb:parquet 188521435 189292794 1.00
tpch_q08/duckdb:parquet 267480564 264836062 1.01
tpch_q09/duckdb:parquet 475883015 477232918 1.00
tpch_q10/duckdb:parquet 624707833 618147957 1.01
tpch_q11/duckdb:parquet 61741799 63140544 0.98
tpch_q12/duckdb:parquet 132933091 132244374 1.01
tpch_q13/duckdb:parquet 455828645 441096838 1.03
tpch_q14/duckdb:parquet 179379231 180245567 1.00
tpch_q15/duckdb:parquet 104258049 105208922 0.99
tpch_q16/duckdb:parquet 165589079 161095295 1.03
tpch_q17/duckdb:parquet 180853904 183143332 0.99
tpch_q18/duckdb:parquet 359528529 362933009 0.99
tpch_q19/duckdb:parquet 285009139 286658109 0.99
tpch_q20/duckdb:parquet 225014777 231262880 0.97
tpch_q21/duckdb:parquet 558306228 550782837 1.01
tpch_q22/duckdb:parquet 292159878 293994532 0.99
duckdb / duckdb (1.011x ➖, 0↑ 1↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120384407 120320879 1.00
tpch_q02/duckdb:duckdb 52517731 49059472 1.07
tpch_q03/duckdb:duckdb 104135300 104232231 1.00
tpch_q04/duckdb:duckdb 139594351 137891420 1.01
tpch_q05/duckdb:duckdb 119560449 119209308 1.00
tpch_q06/duckdb:duckdb 44730267 44642256 1.00
tpch_q07/duckdb:duckdb 91099181 90506951 1.01
tpch_q08/duckdb:duckdb 118711202 117664557 1.01
tpch_q09/duckdb:duckdb 280733952 279335114 1.01
tpch_q10/duckdb:duckdb 215994032 214677770 1.01
tpch_q11/duckdb:duckdb 19078164 19261345 0.99
tpch_q12/duckdb:duckdb 91606618 89915232 1.02
tpch_q13/duckdb:duckdb 229769380 227995818 1.01
tpch_q14/duckdb:duckdb 78271275 77559523 1.01
tpch_q15/duckdb:duckdb 81578615 82531576 0.99
tpch_q16/duckdb:duckdb 75071708 75418043 1.00
tpch_q17/duckdb:duckdb 87981534 88101847 1.00
tpch_q18/duckdb:duckdb 232340756 232429472 1.00
tpch_q19/duckdb:duckdb 123585832 123918673 1.00
tpch_q20/duckdb:duckdb 118264508 117253307 1.01
tpch_q21/duckdb:duckdb 299241392 301840344 0.99
tpch_q22/duckdb:duckdb 🚨 71390963 62531163 1.14
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +1.1% -0.6% +1.7% +10.0% ➖ noise
1 datafusion:vortex-compact -0.7% -0.6% -0.2% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -2.3% -0.6% -1.7% +10.0% ➖ noise
1 duckdb:duckdb +0.1% -0.6% +0.6% +10.0% ➖ noise
1 duckdb:vortex-compact -1.1% -0.6% -0.5% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +1.8% -0.6% +2.3% +10.0% ➖ noise
2 datafusion:arrow +2.3% +0.4% +1.9% +10.0% ➖ noise
2 datafusion:vortex-compact -3.1% +0.4% -3.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.6% +0.4% +0.2% +10.0% ➖ noise
2 duckdb:duckdb +7.0% +0.4% +6.6% +10.0% ➖ noise
2 duckdb:vortex-compact +5.5% +0.4% +5.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +6.3% +0.4% +5.9% +10.0% ➖ noise
3 datafusion:arrow +2.8% +1.5% +1.3% +10.0% ➖ noise
3 datafusion:vortex-compact +1.8% +1.5% +0.3% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +2.5% +1.5% +1.0% +10.0% ➖ noise
3 duckdb:duckdb -0.1% +1.5% -1.6% +10.0% ➖ noise
3 duckdb:vortex-compact +1.9% +1.5% +0.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +3.5% +1.5% +2.0% +10.0% ➖ noise
4 datafusion:arrow -1.1% +2.7% -3.7% +10.0% ➖ noise
4 datafusion:vortex-compact -0.8% +2.7% -3.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.6% +2.7% -4.1% +10.0% ➖ noise
4 duckdb:duckdb +1.2% +2.7% -1.4% +10.0% ➖ noise
4 duckdb:vortex-compact +2.0% +2.7% -0.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.2% +2.7% -0.5% +10.0% ➖ noise
5 datafusion:arrow +0.4% +0.2% +0.1% +10.0% ➖ noise
5 datafusion:vortex-compact -0.7% +0.2% -0.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.3% +0.2% -2.5% +10.0% ➖ noise
5 duckdb:duckdb +0.3% +0.2% +0.1% +10.0% ➖ noise
5 duckdb:vortex-compact +4.6% +0.2% +4.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.0% +0.2% +2.7% +10.0% ➖ noise
6 datafusion:arrow -1.0% -0.4% -0.6% +10.0% ➖ noise
6 datafusion:vortex-compact -1.7% -0.4% -1.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.1% -0.4% +0.3% +10.0% ➖ noise
6 duckdb:duckdb +0.2% -0.4% +0.6% +10.0% ➖ noise
6 duckdb:vortex-compact +0.1% -0.4% +0.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +3.1% -0.4% +3.6% +11.7% ➖ noise
7 datafusion:arrow +2.3% +0.9% +1.4% +10.0% ➖ noise
7 datafusion:vortex-compact +1.6% +0.9% +0.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.2% +0.9% -2.0% +10.0% ➖ noise
7 duckdb:duckdb +0.7% +0.9% -0.2% +10.0% ➖ noise
7 duckdb:vortex-compact +1.3% +0.9% +0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +2.8% +0.9% +1.9% +10.0% ➖ noise
8 datafusion:arrow +1.4% +1.2% +0.2% +10.0% ➖ noise
8 datafusion:vortex-compact +2.6% +1.2% +1.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.1% +1.2% -1.1% +10.0% ➖ noise
8 duckdb:duckdb +0.9% +1.2% -0.3% +10.0% ➖ noise
8 duckdb:vortex-compact +2.9% +1.2% +1.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.8% +1.2% -2.0% +10.0% ➖ noise
9 datafusion:arrow +0.1% +0.6% -0.5% +10.0% ➖ noise
9 datafusion:vortex-compact -0.6% +0.6% -1.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.4% +0.6% -0.2% +10.0% ➖ noise
9 duckdb:duckdb +0.5% +0.6% -0.1% +10.0% ➖ noise
9 duckdb:vortex-compact +0.6% +0.6% +0.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.6% +0.6% -1.2% +10.0% ➖ noise
10 datafusion:arrow +1.8% +2.0% -0.2% +10.0% ➖ noise
10 datafusion:vortex-compact -0.5% +2.0% -2.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -4.3% +2.0% -6.2% +10.0% ➖ noise
10 duckdb:duckdb +0.6% +2.0% -1.4% +10.0% ➖ noise
10 duckdb:vortex-compact +0.8% +2.0% -1.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.3% +2.0% -2.2% +10.0% ➖ noise
11 datafusion:arrow +1.2% -1.2% +2.5% +10.0% ➖ noise
11 datafusion:vortex-compact +0.3% -1.2% +1.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.0% -1.2% -0.8% +10.0% ➖ noise
11 duckdb:duckdb -1.0% -1.2% +0.2% +10.0% ➖ noise
11 duckdb:vortex-compact +5.4% -1.2% +6.7% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +7.3% -1.2% +8.5% +13.5% ➖ noise
12 datafusion:arrow -6.4% -2.5% -4.0% +35.1% ➖ noise
12 datafusion:vortex-compact -0.9% -2.5% +1.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -3.8% -2.5% -1.3% +10.0% ➖ noise
12 duckdb:duckdb +1.9% -2.5% +4.5% +10.0% ➖ noise
12 duckdb:vortex-compact +1.4% -2.5% +4.1% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -1.4% -2.5% +1.1% +10.0% ➖ noise
13 datafusion:arrow -1.4% +2.3% -3.6% +10.0% ➖ noise
13 datafusion:vortex-compact -1.6% +2.3% -3.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -3.8% +2.3% -5.9% +10.0% ➖ noise
13 duckdb:duckdb +0.8% +2.3% -1.5% +10.0% ➖ noise
13 duckdb:vortex-compact +0.4% +2.3% -1.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.4% +2.3% -2.7% +10.0% ➖ noise
14 datafusion:arrow +0.3% -1.1% +1.4% +10.0% ➖ noise
14 datafusion:vortex-compact +2.5% -1.1% +3.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -6.8% -1.1% -5.8% +10.0% ➖ noise
14 duckdb:duckdb +0.9% -1.1% +2.0% +10.0% ➖ noise
14 duckdb:vortex-compact -1.2% -1.1% -0.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.6% -1.1% +1.6% +10.0% ➖ noise
15 datafusion:arrow -0.3% -1.3% +1.0% +10.0% ➖ noise
15 datafusion:vortex-compact -1.0% -1.3% +0.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -3.9% -1.3% -2.6% +10.0% ➖ noise
15 duckdb:duckdb -1.2% -1.3% +0.1% +10.0% ➖ noise
15 duckdb:vortex-compact -0.7% -1.3% +0.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +4.7% -1.3% +6.0% +10.0% ➖ noise
16 datafusion:arrow +1.4% +2.5% -1.0% +10.0% ➖ noise
16 datafusion:vortex-compact -2.9% +2.5% -5.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.8% +2.5% -1.6% +10.0% ➖ noise
16 duckdb:duckdb -0.5% +2.5% -2.9% +10.0% ➖ noise
16 duckdb:vortex-compact +4.0% +2.5% +1.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.0% +2.5% -2.4% +10.0% ➖ noise
17 datafusion:arrow +2.0% -0.4% +2.4% +10.0% ➖ noise
17 datafusion:vortex-compact +0.3% -0.4% +0.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.7% -0.4% -1.4% +10.0% ➖ noise
17 duckdb:duckdb -0.1% -0.4% +0.2% +10.0% ➖ noise
17 duckdb:vortex-compact -0.2% -0.4% +0.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +0.7% -0.4% +1.1% +10.0% ➖ noise
18 datafusion:arrow +1.0% -0.2% +1.2% +10.0% ➖ noise
18 datafusion:vortex-compact -0.5% -0.2% -0.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.3% -0.2% -2.2% +10.0% ➖ noise
18 duckdb:duckdb -0.0% -0.2% +0.1% +10.0% ➖ noise
18 duckdb:vortex-compact +3.0% -0.2% +3.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.8% -0.2% +2.9% +10.0% ➖ noise
19 datafusion:arrow +2.4% +0.8% +1.6% +10.0% ➖ noise
19 datafusion:vortex-compact +2.6% +0.8% +1.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +1.6% +0.8% +0.8% +10.0% ➖ noise
19 duckdb:duckdb -0.3% +0.8% -1.1% +10.0% ➖ noise
19 duckdb:vortex-compact +0.4% +0.8% -0.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.0% +0.8% +0.2% +10.0% ➖ noise
20 datafusion:arrow +0.0% -2.3% +2.4% +10.0% ➖ noise
20 datafusion:vortex-compact -0.6% -2.3% +1.8% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +1.2% -2.3% +3.6% +10.0% ➖ noise
20 duckdb:duckdb +0.9% -2.3% +3.3% +10.0% ➖ noise
20 duckdb:vortex-compact +4.8% -2.3% +7.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +7.9% -2.3% +10.5% +10.0% 🚨 regression
21 datafusion:arrow +1.7% -1.7% +3.5% +10.0% ➖ noise
21 datafusion:vortex-compact +0.6% -1.7% +2.3% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -1.1% -1.7% +0.7% +10.0% ➖ noise
21 duckdb:duckdb -0.9% -1.7% +0.9% +10.0% ➖ noise
21 duckdb:vortex-compact +1.9% -1.7% +3.7% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.1% -1.7% +2.9% +10.0% ➖ noise
22 datafusion:arrow +1.5% -0.5% +1.9% +10.0% ➖ noise
22 datafusion:vortex-compact -0.5% -0.5% -0.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -3.3% -0.5% -2.9% +10.0% ➖ noise
22 duckdb:duckdb +14.2% -0.5% +14.7% +10.0% 🚨 regression
22 duckdb:vortex-compact +0.9% -0.5% +1.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +0.7% -0.5% +1.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -9.7%
Vortex (geomean): 0.832x ➖
Parquet (geomean): 0.921x ➖
Shifts: Parquet (control) -7.9% · Median polish -11.5%

datafusion / vortex-file-compressed (0.802x ➖, 5↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 302478710 308178175 0.98
tpch_q02/datafusion:vortex-file-compressed 477098435 548958699 0.87
tpch_q03/datafusion:vortex-file-compressed 519784860 452875465 1.15
tpch_q04/datafusion:vortex-file-compressed 284814705 314093873 0.91
tpch_q05/datafusion:vortex-file-compressed 463225010 516397055 0.90
tpch_q06/datafusion:vortex-file-compressed 370691506 392767538 0.94
tpch_q07/datafusion:vortex-file-compressed 483373070 541302978 0.89
tpch_q08/datafusion:vortex-file-compressed 825856736 699482932 1.18
tpch_q09/datafusion:vortex-file-compressed 548473161 495231876 1.11
tpch_q10/datafusion:vortex-file-compressed 602844725 679987319 0.89
tpch_q11/datafusion:vortex-file-compressed 🚀 302845421 457580473 0.66
tpch_q12/datafusion:vortex-file-compressed 508148640 707892724 0.72
tpch_q13/datafusion:vortex-file-compressed 183615476 243825742 0.75
tpch_q14/datafusion:vortex-file-compressed 274991544 391446562 0.70
tpch_q15/datafusion:vortex-file-compressed 🚀 451193711 739883793 0.61
tpch_q16/datafusion:vortex-file-compressed 🚀 204385371 382837514 0.53
tpch_q17/datafusion:vortex-file-compressed 506695109 621584447 0.82
tpch_q18/datafusion:vortex-file-compressed 🚀 354152592 616578827 0.57
tpch_q19/datafusion:vortex-file-compressed 530943186 708585763 0.75
tpch_q20/datafusion:vortex-file-compressed 431756885 588251161 0.73
tpch_q21/datafusion:vortex-file-compressed 763534174 938225265 0.81
tpch_q22/datafusion:vortex-file-compressed 🚀 145361614 248874602 0.58
datafusion / vortex-compact (0.737x ➖, 9↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 253045574 268057471 0.94
tpch_q02/datafusion:vortex-compact 416157513 557366575 0.75
tpch_q03/datafusion:vortex-compact 370921131 499280332 0.74
tpch_q04/datafusion:vortex-compact 🚀 225428526 438939926 0.51
tpch_q05/datafusion:vortex-compact 399010575 509209254 0.78
tpch_q06/datafusion:vortex-compact 322872205 459541872 0.70
tpch_q07/datafusion:vortex-compact 511350619 493566176 1.04
tpch_q08/datafusion:vortex-compact 🚀 518459963 782924455 0.66
tpch_q09/datafusion:vortex-compact 🚀 397150169 588580630 0.67
tpch_q10/datafusion:vortex-compact 439138596 606946445 0.72
tpch_q11/datafusion:vortex-compact 🚀 262441690 412475188 0.64
tpch_q12/datafusion:vortex-compact 🚀 357565623 659191423 0.54
tpch_q13/datafusion:vortex-compact 🚀 128184116 216174634 0.59
tpch_q14/datafusion:vortex-compact 🚀 242700491 362042608 0.67
tpch_q15/datafusion:vortex-compact 474539090 609320691 0.78
tpch_q16/datafusion:vortex-compact 242914588 220852958 1.10
tpch_q17/datafusion:vortex-compact 🚀 436409374 659794537 0.66
tpch_q18/datafusion:vortex-compact 🚀 328973478 472731799 0.70
tpch_q19/datafusion:vortex-compact 528893573 705639207 0.75
tpch_q20/datafusion:vortex-compact 455153870 503234982 0.90
tpch_q21/datafusion:vortex-compact 672101330 803662488 0.84
tpch_q22/datafusion:vortex-compact 122294875 154206021 0.79
datafusion / parquet (0.917x ➖, 5↑ 5↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 210247486 274953096 0.76
tpch_q02/datafusion:parquet 431705264 603207200 0.72
tpch_q03/datafusion:parquet 🚀 310785878 630789152 0.49
tpch_q04/datafusion:parquet 🚀 232614172 333643747 0.70
tpch_q05/datafusion:parquet 559456791 704107442 0.79
tpch_q06/datafusion:parquet 🚨 228884621 172628199 1.33
tpch_q07/datafusion:parquet 512801923 560157999 0.92
tpch_q08/datafusion:parquet 646151616 906190298 0.71
tpch_q09/datafusion:parquet 580619195 490601713 1.18
tpch_q10/datafusion:parquet 🚨 770955250 526630571 1.46
tpch_q11/datafusion:parquet 331008277 339317942 0.98
tpch_q12/datafusion:parquet 308191631 249781816 1.23
tpch_q13/datafusion:parquet 429703875 441163610 0.97
tpch_q14/datafusion:parquet 244897630 326962598 0.75
tpch_q15/datafusion:parquet 🚀 309597991 457742717 0.68
tpch_q16/datafusion:parquet 🚀 214558224 324365994 0.66
tpch_q17/datafusion:parquet 440488214 464284609 0.95
tpch_q18/datafusion:parquet 🚨 632387244 452084322 1.40
tpch_q19/datafusion:parquet 🚨 427053047 309717180 1.38
tpch_q20/datafusion:parquet 🚨 420358224 292889267 1.44
tpch_q21/datafusion:parquet 564749095 555523349 1.02
tpch_q22/datafusion:parquet 🚀 119005762 187172086 0.64
duckdb / vortex-file-compressed (0.891x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 268653418 328758755 0.82
tpch_q02/duckdb:vortex-file-compressed 1014646854 1019185280 1.00
tpch_q03/duckdb:vortex-file-compressed 671735230 914906546 0.73
tpch_q04/duckdb:vortex-file-compressed 478892087 509760120 0.94
tpch_q05/duckdb:vortex-file-compressed 793240895 866778497 0.92
tpch_q06/duckdb:vortex-file-compressed 295869358 386503551 0.77
tpch_q07/duckdb:vortex-file-compressed 975952403 986477603 0.99
tpch_q08/duckdb:vortex-file-compressed 1027934389 1122272740 0.92
tpch_q09/duckdb:vortex-file-compressed 985918526 1138891146 0.87
tpch_q10/duckdb:vortex-file-compressed 726472497 870946290 0.83
tpch_q11/duckdb:vortex-file-compressed 513008322 594330917 0.86
tpch_q12/duckdb:vortex-file-compressed 596473626 769443627 0.78
tpch_q13/duckdb:vortex-file-compressed 447151975 494804703 0.90
tpch_q14/duckdb:vortex-file-compressed 446489661 452070840 0.99
tpch_q15/duckdb:vortex-file-compressed 313428488 321189135 0.98
tpch_q16/duckdb:vortex-file-compressed 356883363 377872093 0.94
tpch_q17/duckdb:vortex-file-compressed 747133486 814231261 0.92
tpch_q18/duckdb:vortex-file-compressed 613979120 692797643 0.89
tpch_q19/duckdb:vortex-file-compressed 494658298 531908440 0.93
tpch_q20/duckdb:vortex-file-compressed 768063761 824680398 0.93
tpch_q21/duckdb:vortex-file-compressed 991391162 1132130436 0.88
tpch_q22/duckdb:vortex-file-compressed 282791471 310994317 0.91
duckdb / vortex-compact (0.911x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 291176428 295752569 0.98
tpch_q02/duckdb:vortex-compact 1003186175 1016627027 0.99
tpch_q03/duckdb:vortex-compact 608216380 661461297 0.92
tpch_q04/duckdb:vortex-compact 394667625 453335876 0.87
tpch_q05/duckdb:vortex-compact 812732114 810765358 1.00
tpch_q06/duckdb:vortex-compact 368866735 407248011 0.91
tpch_q07/duckdb:vortex-compact 921052537 904605980 1.02
tpch_q08/duckdb:vortex-compact 1001957135 1089521116 0.92
tpch_q09/duckdb:vortex-compact 927079362 1089294558 0.85
tpch_q10/duckdb:vortex-compact 688887359 722381228 0.95
tpch_q11/duckdb:vortex-compact 486850989 527944480 0.92
tpch_q12/duckdb:vortex-compact 636732435 737132192 0.86
tpch_q13/duckdb:vortex-compact 471154214 474040595 0.99
tpch_q14/duckdb:vortex-compact 427463566 492677040 0.87
tpch_q15/duckdb:vortex-compact 310112298 357217199 0.87
tpch_q16/duckdb:vortex-compact 340521406 367608597 0.93
tpch_q17/duckdb:vortex-compact 693172509 663133457 1.05
tpch_q18/duckdb:vortex-compact 499104852 520789262 0.96
tpch_q19/duckdb:vortex-compact 438954321 548174521 0.80
tpch_q20/duckdb:vortex-compact 729595398 906156862 0.81
tpch_q21/duckdb:vortex-compact 919521297 1122767435 0.82
tpch_q22/duckdb:vortex-compact 263093963 317715793 0.83
duckdb / parquet (0.925x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 498632711 571934277 0.87
tpch_q02/duckdb:parquet 1136708945 1309656160 0.87
tpch_q03/duckdb:parquet 1065032982 1135182266 0.94
tpch_q04/duckdb:parquet 663132647 665355042 1.00
tpch_q05/duckdb:parquet 1322367003 1404658912 0.94
tpch_q06/duckdb:parquet 446474411 392996351 1.14
tpch_q07/duckdb:parquet 1131020297 1251812392 0.90
tpch_q08/duckdb:parquet 1482596952 1759009281 0.84
tpch_q09/duckdb:parquet 1381279359 1514824439 0.91
tpch_q10/duckdb:parquet 1360578884 1449569524 0.94
tpch_q11/duckdb:parquet 763627884 737057704 1.04
tpch_q12/duckdb:parquet 706499385 822357969 0.86
tpch_q13/duckdb:parquet 920683084 1010544585 0.91
tpch_q14/duckdb:parquet 707437773 905366209 0.78
tpch_q15/duckdb:parquet 535071500 620130790 0.86
tpch_q16/duckdb:parquet 660113991 656891751 1.00
tpch_q17/duckdb:parquet 812392695 926497654 0.88
tpch_q18/duckdb:parquet 923013043 994094898 0.93
tpch_q19/duckdb:parquet 871063422 944514392 0.92
tpch_q20/duckdb:parquet 1028980506 1294445115 0.79
tpch_q21/duckdb:parquet 1174298891 1189227359 0.99
tpch_q22/duckdb:parquet 656226891 577146816 1.14
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -5.6% -18.4% +15.6% +73.7% ➖ noise
1 datafusion:vortex-file-compressed -1.8% -18.4% +20.2% +74.0% ➖ noise
1 duckdb:vortex-compact -1.5% -18.4% +20.6% +56.1% ➖ noise
1 duckdb:vortex-file-compressed -18.3% -18.4% +0.1% +52.1% ➖ noise
2 datafusion:vortex-compact -25.3% -21.2% -5.3% +52.1% ➖ noise
2 datafusion:vortex-file-compressed -13.1% -21.2% +10.3% +52.1% ➖ noise
2 duckdb:vortex-compact -1.3% -21.2% +25.2% +52.1% ➖ noise
2 duckdb:vortex-file-compressed -0.4% -21.2% +26.3% +52.1% ➖ noise
3 datafusion:vortex-compact -25.7% -32.0% +9.3% +52.1% ➖ noise
3 datafusion:vortex-file-compressed +14.8% -32.0% +68.8% +54.9% 🚨 regression
3 duckdb:vortex-compact -8.0% -32.0% +35.2% +52.1% ➖ noise
3 duckdb:vortex-file-compressed -26.6% -32.0% +8.0% +52.1% ➖ noise
4 datafusion:vortex-compact -48.6% -16.6% -38.4% +55.8% ✅ faster
4 datafusion:vortex-file-compressed -9.3% -16.6% +8.8% +52.1% ➖ noise
4 duckdb:vortex-compact -12.9% -16.6% +4.4% +52.1% ➖ noise
4 duckdb:vortex-file-compressed -6.1% -16.6% +12.7% +52.1% ➖ noise
5 datafusion:vortex-compact -21.6% -13.5% -9.4% +52.1% ➖ noise
5 datafusion:vortex-file-compressed -10.3% -13.5% +3.7% +52.1% ➖ noise
5 duckdb:vortex-compact +0.2% -13.5% +15.9% +52.1% ➖ noise
5 duckdb:vortex-file-compressed -8.5% -13.5% +5.8% +52.1% ➖ noise
6 datafusion:vortex-compact -29.7% +22.7% -42.8% +62.8% ✅ faster
6 datafusion:vortex-file-compressed -5.6% +22.7% -23.1% +52.1% ➖ noise
6 duckdb:vortex-compact -9.4% +22.7% -26.2% +52.1% ➖ noise
6 duckdb:vortex-file-compressed -23.4% +22.7% -37.6% +52.1% ✅ faster
7 datafusion:vortex-compact +3.6% -9.1% +13.9% +52.1% ➖ noise
7 datafusion:vortex-file-compressed -10.7% -9.1% -1.8% +52.1% ➖ noise
7 duckdb:vortex-compact +1.8% -9.1% +12.0% +52.1% ➖ noise
7 duckdb:vortex-file-compressed -1.1% -9.1% +8.8% +52.1% ➖ noise
8 datafusion:vortex-compact -33.8% -22.5% -14.6% +52.1% ➖ noise
8 datafusion:vortex-file-compressed +18.1% -22.5% +52.3% +52.1% 🚨 regression
8 duckdb:vortex-compact -8.0% -22.5% +18.6% +52.1% ➖ noise
8 duckdb:vortex-file-compressed -8.4% -22.5% +18.1% +52.1% ➖ noise
9 datafusion:vortex-compact -32.5% +3.9% -35.0% +52.1% ✅ faster
9 datafusion:vortex-file-compressed +10.8% +3.9% +6.6% +52.1% ➖ noise
9 duckdb:vortex-compact -14.9% +3.9% -18.1% +52.1% ➖ noise
9 duckdb:vortex-file-compressed -13.4% +3.9% -16.7% +52.1% ➖ noise
10 datafusion:vortex-compact -27.6% +17.2% -38.3% +52.1% ✅ faster
10 datafusion:vortex-file-compressed -11.3% +17.2% -24.4% +52.1% ➖ noise
10 duckdb:vortex-compact -4.6% +17.2% -18.6% +52.1% ➖ noise
10 duckdb:vortex-file-compressed -16.6% +17.2% -28.8% +52.1% ➖ noise
11 datafusion:vortex-compact -36.4% +0.5% -36.7% +52.1% ✅ faster
11 datafusion:vortex-file-compressed -33.8% +0.5% -34.2% +52.1% ➖ noise
11 duckdb:vortex-compact -7.8% +0.5% -8.3% +52.1% ➖ noise
11 duckdb:vortex-file-compressed -13.7% +0.5% -14.1% +52.1% ➖ noise
12 datafusion:vortex-compact -45.8% +3.0% -47.3% +52.1% ✅ faster
12 datafusion:vortex-file-compressed -28.2% +3.0% -30.3% +52.1% ➖ noise
12 duckdb:vortex-compact -13.6% +3.0% -16.1% +52.1% ➖ noise
12 duckdb:vortex-file-compressed -22.5% +3.0% -24.7% +52.1% ➖ noise
13 datafusion:vortex-compact -40.7% -5.8% -37.1% +52.7% ✅ faster
13 datafusion:vortex-file-compressed -24.7% -5.8% -20.1% +52.1% ➖ noise
13 duckdb:vortex-compact -0.6% -5.8% +5.5% +52.1% ➖ noise
13 duckdb:vortex-file-compressed -9.6% -5.8% -4.1% +52.1% ➖ noise
14 datafusion:vortex-compact -33.0% -23.5% -12.4% +52.1% ➖ noise
14 datafusion:vortex-file-compressed -29.7% -23.5% -8.2% +52.1% ➖ noise
14 duckdb:vortex-compact -13.2% -23.5% +13.4% +52.1% ➖ noise
14 duckdb:vortex-file-compressed -1.2% -23.5% +29.1% +52.1% ➖ noise
15 datafusion:vortex-compact -22.1% -23.6% +1.9% +52.1% ➖ noise
15 datafusion:vortex-file-compressed -39.0% -23.6% -20.2% +52.1% ➖ noise
15 duckdb:vortex-compact -13.2% -23.6% +13.6% +52.1% ➖ noise
15 duckdb:vortex-file-compressed -2.4% -23.6% +27.7% +52.1% ➖ noise
16 datafusion:vortex-compact +10.0% -18.5% +34.9% +52.1% ➖ noise
16 datafusion:vortex-file-compressed -46.6% -18.5% -34.5% +52.1% ✅ faster
16 duckdb:vortex-compact -7.4% -18.5% +13.6% +52.1% ➖ noise
16 duckdb:vortex-file-compressed -5.6% -18.5% +15.8% +52.1% ➖ noise
17 datafusion:vortex-compact -33.9% -8.8% -27.5% +52.1% ➖ noise
17 datafusion:vortex-file-compressed -18.5% -8.8% -10.6% +52.1% ➖ noise
17 duckdb:vortex-compact +4.5% -8.8% +14.6% +52.1% ➖ noise
17 duckdb:vortex-file-compressed -8.2% -8.8% +0.6% +52.1% ➖ noise
18 datafusion:vortex-compact -30.4% +14.0% -38.9% +52.1% ✅ faster
18 datafusion:vortex-file-compressed -42.6% +14.0% -49.6% +52.1% ✅ faster
18 duckdb:vortex-compact -4.2% +14.0% -15.9% +52.1% ➖ noise
18 duckdb:vortex-file-compressed -11.4% +14.0% -22.2% +52.1% ➖ noise
19 datafusion:vortex-compact -25.0% +12.8% -33.5% +52.1% ➖ noise
19 datafusion:vortex-file-compressed -25.1% +12.8% -33.6% +52.1% ➖ noise
19 duckdb:vortex-compact -19.9% +12.8% -29.0% +52.1% ➖ noise
19 duckdb:vortex-file-compressed -7.0% +12.8% -17.5% +52.1% ➖ noise
20 datafusion:vortex-compact -9.6% +6.8% -15.3% +52.1% ➖ noise
20 datafusion:vortex-file-compressed -26.6% +6.8% -31.3% +52.1% ➖ noise
20 duckdb:vortex-compact -19.5% +6.8% -24.6% +52.1% ➖ noise
20 duckdb:vortex-file-compressed -6.9% +6.8% -12.8% +52.1% ➖ noise
21 datafusion:vortex-compact -16.4% +0.2% -16.5% +52.1% ➖ noise
21 datafusion:vortex-file-compressed -18.6% +0.2% -18.8% +52.1% ➖ noise
21 duckdb:vortex-compact -18.1% +0.2% -18.3% +52.1% ➖ noise
21 duckdb:vortex-file-compressed -12.4% +0.2% -12.6% +52.1% ➖ noise
22 datafusion:vortex-compact -20.7% -15.0% -6.7% +52.1% ➖ noise
22 datafusion:vortex-file-compressed -41.6% -15.0% -31.3% +52.1% ➖ noise
22 duckdb:vortex-compact -17.2% -15.0% -2.6% +52.1% ➖ noise
22 duckdb:vortex-file-compressed -9.1% -15.0% +6.9% +52.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026 •
edited
Loading

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Vortex (geomean): 0.983x ➖
Parquet (geomean): 0.975x ➖
Shifts: Parquet (control) -2.5% · Median polish -2.1%

duckdb / vortex-file-compressed (0.976x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11520182 12399421 0.93
statpopgen_q01/duckdb:vortex-file-compressed 28112531 27860584 1.01
statpopgen_q02/duckdb:vortex-file-compressed 518973100 536353785 0.97
statpopgen_q03/duckdb:vortex-file-compressed 1050056701 1077744524 0.97
statpopgen_q04/duckdb:vortex-file-compressed 1049465576 1098064381 0.96
statpopgen_q05/duckdb:vortex-file-compressed 490793081 490605487 1.00
statpopgen_q06/duckdb:vortex-file-compressed 1528294422 1543711674 0.99
statpopgen_q07/duckdb:vortex-file-compressed 203588104 210189012 0.97
statpopgen_q08/duckdb:vortex-file-compressed 234138531 241635572 0.97
statpopgen_q09/duckdb:vortex-file-compressed 836253101 848294637 0.99
statpopgen_q10/duckdb:vortex-file-compressed 2552668867 2570833836 0.99
duckdb / vortex-compact (0.989x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11589285 11994977 0.97
statpopgen_q01/duckdb:vortex-compact 224940543 219924943 1.02
statpopgen_q02/duckdb:vortex-compact 554206952 559753801 0.99
statpopgen_q03/duckdb:vortex-compact 1141109348 1147200918 0.99
statpopgen_q04/duckdb:vortex-compact 1163404307 1173154973 0.99
statpopgen_q05/duckdb:vortex-compact 585922413 593056068 0.99
statpopgen_q06/duckdb:vortex-compact 1488299735 1497566867 0.99
statpopgen_q07/duckdb:vortex-compact 881218474 896501001 0.98
statpopgen_q08/duckdb:vortex-compact 916359973 920689241 1.00
statpopgen_q09/duckdb:vortex-compact 917343899 944926418 0.97
statpopgen_q10/duckdb:vortex-compact 2578560072 2624558381 0.98
duckdb / parquet (0.975x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 292781377 306027462 0.96
statpopgen_q01/duckdb:parquet 380488435 386933180 0.98
statpopgen_q02/duckdb:parquet 754065140 774189162 0.97
statpopgen_q03/duckdb:parquet 1172971722 1189452535 0.99
statpopgen_q04/duckdb:parquet 1182828324 1197037303 0.99
statpopgen_q05/duckdb:parquet 797730488 819519197 0.97
statpopgen_q06/duckdb:parquet 1426255019 1441907512 0.99
statpopgen_q07/duckdb:parquet 828396993 863213266 0.96
statpopgen_q08/duckdb:parquet 837961142 870713671 0.96
statpopgen_q09/duckdb:parquet 996853294 1025891018 0.97
statpopgen_q10/duckdb:parquet 2170007599 2201175845 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -3.4% -4.3% +1.0% +12.5% ➖ noise
0 duckdb:vortex-file-compressed -7.1% -4.3% -2.9% +10.0% ➖ noise
1 duckdb:vortex-compact +2.3% -1.7% +4.0% +18.8% ➖ noise
1 duckdb:vortex-file-compressed +0.9% -1.7% +2.6% +214.9% ➖ noise
2 duckdb:vortex-compact -1.0% -2.6% +1.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -3.2% -2.6% -0.7% +10.0% ➖ noise
3 duckdb:vortex-compact -0.5% -1.4% +0.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.6% -1.4% -1.2% +10.0% ➖ noise
4 duckdb:vortex-compact -0.8% -1.2% +0.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -4.4% -1.2% -3.3% +10.0% ➖ noise
5 duckdb:vortex-compact -1.2% -2.7% +1.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.0% -2.7% +2.8% +10.0% ➖ noise
6 duckdb:vortex-compact -0.6% -1.1% +0.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.0% -1.1% +0.1% +10.0% ➖ noise
7 duckdb:vortex-compact -1.7% -4.0% +2.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.1% -4.0% +0.9% +10.0% ➖ noise
8 duckdb:vortex-compact -0.5% -3.8% +3.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.1% -3.8% +0.7% +10.0% ➖ noise
9 duckdb:vortex-compact -2.9% -2.8% -0.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.4% -2.8% +1.5% +10.0% ➖ noise
10 duckdb:vortex-compact -1.8% -1.4% -0.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.7% -1.4% +0.7% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026 •
edited
Loading

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.7%
Vortex (geomean): 0.972x ➖
Parquet (geomean): 0.982x ➖
Shifts: Parquet (control) -1.8% · Median polish -2.8%

datafusion / vortex-file-compressed (0.896x ✅, 60↑ 3↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 24719877 26920616 0.92
tpcds_q02/datafusion:vortex-file-compressed 46323893 50279424 0.92
tpcds_q03/datafusion:vortex-file-compressed 🚀 14969167 17105255 0.88
tpcds_q04/datafusion:vortex-file-compressed 🚀 251429503 295311562 0.85
tpcds_q05/datafusion:vortex-file-compressed 🚀 42691884 53175487 0.80
tpcds_q06/datafusion:vortex-file-compressed 63098633 59438973 1.06
tpcds_q07/datafusion:vortex-file-compressed 🚀 41778483 50404853 0.83
tpcds_q08/datafusion:vortex-file-compressed 🚀 28495929 32645940 0.87
tpcds_q09/datafusion:vortex-file-compressed 🚀 36948467 44910387 0.82
tpcds_q10/datafusion:vortex-file-compressed 🚀 37813699 44442018 0.85
tpcds_q11/datafusion:vortex-file-compressed 🚀 131486338 151242631 0.87
tpcds_q12/datafusion:vortex-file-compressed 🚀 18829980 23668990 0.80
tpcds_q13/datafusion:vortex-file-compressed 🚀 38642109 51562761 0.75
tpcds_q14/datafusion:vortex-file-compressed 🚀 171303751 201313285 0.85
tpcds_q15/datafusion:vortex-file-compressed 🚀 27730475 32020906 0.87
tpcds_q16/datafusion:vortex-file-compressed 🚀 28002161 32150068 0.87
tpcds_q17/datafusion:vortex-file-compressed 🚀 61845159 72658783 0.85
tpcds_q18/datafusion:vortex-file-compressed 🚀 67417186 79326172 0.85
tpcds_q19/datafusion:vortex-file-compressed 🚀 22139849 25705758 0.86
tpcds_q20/datafusion:vortex-file-compressed 🚀 20622078 26654329 0.77
tpcds_q21/datafusion:vortex-file-compressed 🚀 34739739 41189078 0.84
tpcds_q22/datafusion:vortex-file-compressed 🚨 144056103 127971063 1.13
tpcds_q23/datafusion:vortex-file-compressed 🚀 150517748 182069372 0.83
tpcds_q24/datafusion:vortex-file-compressed 🚀 81578769 101311067 0.81
tpcds_q25/datafusion:vortex-file-compressed 🚀 69376186 77962689 0.89
tpcds_q26/datafusion:vortex-file-compressed 🚀 33530084 43293991 0.77
tpcds_q27/datafusion:vortex-file-compressed 🚀 101431325 129301778 0.78
tpcds_q28/datafusion:vortex-file-compressed 34349759 37944876 0.91
tpcds_q29/datafusion:vortex-file-compressed 🚀 60493280 69414025 0.87
tpcds_q30/datafusion:vortex-file-compressed 22383176 24467216 0.91
tpcds_q31/datafusion:vortex-file-compressed 70591125 72360313 0.98
tpcds_q32/datafusion:vortex-file-compressed 21476367 19555236 1.10
tpcds_q33/datafusion:vortex-file-compressed 30138378 30874109 0.98
tpcds_q34/datafusion:vortex-file-compressed 24603713 25672498 0.96
tpcds_q35/datafusion:vortex-file-compressed 43519266 45775520 0.95
tpcds_q36/datafusion:vortex-file-compressed 56718110 62354318 0.91
tpcds_q37/datafusion:vortex-file-compressed 🚀 23380604 29728605 0.79
tpcds_q38/datafusion:vortex-file-compressed 🚀 41604629 48484099 0.86
tpcds_q39/datafusion:vortex-file-compressed 🚀 100642015 114566171 0.88
tpcds_q40/datafusion:vortex-file-compressed 🚀 32319211 37476586 0.86
tpcds_q41/datafusion:vortex-file-compressed 🚀 14939980 17735845 0.84
tpcds_q42/datafusion:vortex-file-compressed 🚀 13725686 17515762 0.78
tpcds_q43/datafusion:vortex-file-compressed 19381519 21172265 0.92
tpcds_q44/datafusion:vortex-file-compressed 🚀 30900145 34438049 0.90
tpcds_q45/datafusion:vortex-file-compressed 🚀 26666047 31094038 0.86
tpcds_q46/datafusion:vortex-file-compressed 🚀 33868278 38984842 0.87
tpcds_q47/datafusion:vortex-file-compressed 🚀 133163306 153827163 0.87
tpcds_q48/datafusion:vortex-file-compressed 🚀 34909549 40545961 0.86
tpcds_q49/datafusion:vortex-file-compressed 🚀 56689805 66888287 0.85
tpcds_q50/datafusion:vortex-file-compressed 🚀 38071487 44892449 0.85
tpcds_q51/datafusion:vortex-file-compressed 🚀 88343918 98864971 0.89
tpcds_q52/datafusion:vortex-file-compressed 🚀 14489576 16970100 0.85
tpcds_q53/datafusion:vortex-file-compressed 🚀 21360676 24266181 0.88
tpcds_q54/datafusion:vortex-file-compressed 🚀 33727525 38859345 0.87
tpcds_q55/datafusion:vortex-file-compressed 🚀 13441273 16289736 0.83
tpcds_q56/datafusion:vortex-file-compressed 🚀 29527621 34677770 0.85
tpcds_q57/datafusion:vortex-file-compressed 🚀 105907402 118586610 0.89
tpcds_q58/datafusion:vortex-file-compressed 🚀 50838851 61198724 0.83
tpcds_q59/datafusion:vortex-file-compressed 56230534 62019571 0.91
tpcds_q60/datafusion:vortex-file-compressed 🚀 30100040 34626134 0.87
tpcds_q61/datafusion:vortex-file-compressed 🚀 40130181 47280685 0.85
tpcds_q62/datafusion:vortex-file-compressed 🚀 24606914 27420688 0.90
tpcds_q63/datafusion:vortex-file-compressed 🚀 20449499 24165458 0.85
tpcds_q64/datafusion:vortex-file-compressed 🚀 396756843 489575713 0.81
tpcds_q65/datafusion:vortex-file-compressed 🚀 38304480 47079543 0.81
tpcds_q66/datafusion:vortex-file-compressed 🚀 69115061 78757055 0.88
tpcds_q67/datafusion:vortex-file-compressed 🚀 139867389 170546892 0.82
tpcds_q68/datafusion:vortex-file-compressed 🚀 32673634 37490424 0.87
tpcds_q69/datafusion:vortex-file-compressed 🚀 34732701 40515679 0.86
tpcds_q70/datafusion:vortex-file-compressed 🚀 81457667 96378997 0.85
tpcds_q71/datafusion:vortex-file-compressed 🚀 22315524 25577113 0.87
tpcds_q72/datafusion:vortex-file-compressed 🚀 2072682791 2624284128 0.79
tpcds_q73/datafusion:vortex-file-compressed 🚀 22305103 27159411 0.82
tpcds_q74/datafusion:vortex-file-compressed 79448395 87694570 0.91
tpcds_q75/datafusion:vortex-file-compressed 107418166 108559648 0.99
tpcds_q76/datafusion:vortex-file-compressed 🚀 23923424 32161125 0.74
tpcds_q77/datafusion:vortex-file-compressed 39271928 40088410 0.98
tpcds_q78/datafusion:vortex-file-compressed 123245115 122794041 1.00
tpcds_q79/datafusion:vortex-file-compressed 28885656 27677555 1.04
tpcds_q80/datafusion:vortex-file-compressed 90938358 93957701 0.97
tpcds_q81/datafusion:vortex-file-compressed 🚨 27625578 23895478 1.16
tpcds_q82/datafusion:vortex-file-compressed 25619830 24748358 1.04
tpcds_q83/datafusion:vortex-file-compressed 33025870 32886350 1.00
tpcds_q84/datafusion:vortex-file-compressed 12440112 12567981 0.99
tpcds_q85/datafusion:vortex-file-compressed 89920787 90002976 1.00
tpcds_q86/datafusion:vortex-file-compressed 15791210 16657053 0.95
tpcds_q87/datafusion:vortex-file-compressed 42069332 43216420 0.97
tpcds_q88/datafusion:vortex-file-compressed 54834044 55637590 0.99
tpcds_q89/datafusion:vortex-file-compressed 24159570 24500362 0.99
tpcds_q90/datafusion:vortex-file-compressed 14366554 14568189 0.99
tpcds_q91/datafusion:vortex-file-compressed 17764222 17876264 0.99
tpcds_q92/datafusion:vortex-file-compressed 17465442 18066231 0.97
tpcds_q93/datafusion:vortex-file-compressed 33979866 33211216 1.02
tpcds_q94/datafusion:vortex-file-compressed 23375905 23646478 0.99
tpcds_q95/datafusion:vortex-file-compressed 59445441 61901194 0.96
tpcds_q96/datafusion:vortex-file-compressed 13398725 13197881 1.02
tpcds_q97/datafusion:vortex-file-compressed 31019115 30824458 1.01
tpcds_q98/datafusion:vortex-file-compressed 23464838 23471422 1.00
tpcds_q99/datafusion:vortex-file-compressed 🚨 32351361 28937433 1.12
datafusion / vortex-compact (0.993x ➖, 1↑ 2↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 27047175 25829129 1.05
tpcds_q02/datafusion:vortex-compact 53374388 53455740 1.00
tpcds_q03/datafusion:vortex-compact 19720220 19641297 1.00
tpcds_q04/datafusion:vortex-compact 284255853 294974366 0.96
tpcds_q05/datafusion:vortex-compact 48873278 51015297 0.96
tpcds_q06/datafusion:vortex-compact 60877118 60841869 1.00
tpcds_q07/datafusion:vortex-compact 52781603 52742414 1.00
tpcds_q08/datafusion:vortex-compact 38005783 35231706 1.08
tpcds_q09/datafusion:vortex-compact 52453177 52088140 1.01
tpcds_q10/datafusion:vortex-compact 47405552 48421381 0.98
tpcds_q11/datafusion:vortex-compact 154047685 154421894 1.00
tpcds_q12/datafusion:vortex-compact 23722242 24760805 0.96
tpcds_q13/datafusion:vortex-compact 🚀 123194328 157541855 0.78
tpcds_q14/datafusion:vortex-compact 199041291 196921743 1.01
tpcds_q15/datafusion:vortex-compact 29648450 30559482 0.97
tpcds_q16/datafusion:vortex-compact 31517388 32390813 0.97
tpcds_q17/datafusion:vortex-compact 74714265 73242771 1.02
tpcds_q18/datafusion:vortex-compact 77690335 79001558 0.98
tpcds_q19/datafusion:vortex-compact 29568334 28811517 1.03
tpcds_q20/datafusion:vortex-compact 26268391 25591785 1.03
tpcds_q21/datafusion:vortex-compact 38807875 39343485 0.99
tpcds_q22/datafusion:vortex-compact 123599526 114619971 1.08
tpcds_q23/datafusion:vortex-compact 164373753 164526064 1.00
tpcds_q24/datafusion:vortex-compact 95460395 95779440 1.00
tpcds_q25/datafusion:vortex-compact 77870100 81336888 0.96
tpcds_q26/datafusion:vortex-compact 43924920 43819335 1.00
tpcds_q27/datafusion:vortex-compact 124640969 125667845 0.99
tpcds_q28/datafusion:vortex-compact 97908751 99207732 0.99
tpcds_q29/datafusion:vortex-compact 71881658 73350706 0.98
tpcds_q30/datafusion:vortex-compact 26678329 27905477 0.96
tpcds_q31/datafusion:vortex-compact 99226130 98234491 1.01
tpcds_q32/datafusion:vortex-compact 25454706 24733809 1.03
tpcds_q33/datafusion:vortex-compact 35756340 35827124 1.00
tpcds_q34/datafusion:vortex-compact 33859047 34309440 0.99
tpcds_q35/datafusion:vortex-compact 50236443 50624325 0.99
tpcds_q36/datafusion:vortex-compact 74432097 75695440 0.98
tpcds_q37/datafusion:vortex-compact 32958685 33793426 0.98
tpcds_q38/datafusion:vortex-compact 51287639 52238225 0.98
tpcds_q39/datafusion:vortex-compact 111670893 112841057 0.99
tpcds_q40/datafusion:vortex-compact 36301347 35822562 1.01
tpcds_q41/datafusion:vortex-compact 16836011 17967872 0.94
tpcds_q42/datafusion:vortex-compact 18002227 18089935 1.00
tpcds_q43/datafusion:vortex-compact 26056746 24469309 1.06
tpcds_q44/datafusion:vortex-compact 47178591 48022340 0.98
tpcds_q45/datafusion:vortex-compact 30324857 31300588 0.97
tpcds_q46/datafusion:vortex-compact 42802035 43622391 0.98
tpcds_q47/datafusion:vortex-compact 149069829 149748983 1.00
tpcds_q48/datafusion:vortex-compact 78886136 83292228 0.95
tpcds_q49/datafusion:vortex-compact 68929966 69317099 0.99
tpcds_q50/datafusion:vortex-compact 47145290 46721534 1.01
tpcds_q51/datafusion:vortex-compact 94812950 97197525 0.98
tpcds_q52/datafusion:vortex-compact 18297358 18564359 0.99
tpcds_q53/datafusion:vortex-compact 27965394 27522555 1.02
tpcds_q54/datafusion:vortex-compact 40755383 41103196 0.99
tpcds_q55/datafusion:vortex-compact 17855122 17639712 1.01
tpcds_q56/datafusion:vortex-compact 36067704 36622555 0.98
tpcds_q57/datafusion:vortex-compact 114368320 113433073 1.01
tpcds_q58/datafusion:vortex-compact 62902240 63232323 0.99
tpcds_q59/datafusion:vortex-compact 68225620 70671754 0.97
tpcds_q60/datafusion:vortex-compact 35376101 35134748 1.01
tpcds_q61/datafusion:vortex-compact 53945664 54122104 1.00
tpcds_q62/datafusion:vortex-compact 🚨 29026450 23758097 1.22
tpcds_q63/datafusion:vortex-compact 27442085 28113755 0.98
tpcds_q64/datafusion:vortex-compact 442553271 444634179 1.00
tpcds_q65/datafusion:vortex-compact 53376660 53545077 1.00
tpcds_q66/datafusion:vortex-compact 74857818 75901427 0.99
tpcds_q67/datafusion:vortex-compact 153722487 154450324 1.00
tpcds_q68/datafusion:vortex-compact 45040392 44095988 1.02
tpcds_q69/datafusion:vortex-compact 46204437 46071235 1.00
tpcds_q70/datafusion:vortex-compact 98498846 95914553 1.03
tpcds_q71/datafusion:vortex-compact 31046066 30001723 1.03
tpcds_q72/datafusion:vortex-compact 2109226348 2125744871 0.99
tpcds_q73/datafusion:vortex-compact 29982253 29912115 1.00
tpcds_q74/datafusion:vortex-compact 92678439 93446092 0.99
tpcds_q75/datafusion:vortex-compact 131460000 126831149 1.04
tpcds_q76/datafusion:vortex-compact 31529930 31772427 0.99
tpcds_q77/datafusion:vortex-compact 50971927 50580674 1.01
tpcds_q78/datafusion:vortex-compact 137325638 135780230 1.01
tpcds_q79/datafusion:vortex-compact 37119091 38182262 0.97
tpcds_q80/datafusion:vortex-compact 102212955 103018953 0.99
tpcds_q81/datafusion:vortex-compact 26786143 27067967 0.99
tpcds_q82/datafusion:vortex-compact 33356139 35389374 0.94
tpcds_q83/datafusion:vortex-compact 32398206 33861467 0.96
tpcds_q84/datafusion:vortex-compact 14396138 14443736 1.00
tpcds_q85/datafusion:vortex-compact 153124802 156037627 0.98
tpcds_q86/datafusion:vortex-compact 17534423 19298594 0.91
tpcds_q87/datafusion:vortex-compact 49484147 51666392 0.96
tpcds_q88/datafusion:vortex-compact 76635201 77382382 0.99
tpcds_q89/datafusion:vortex-compact 30192159 30776402 0.98
tpcds_q90/datafusion:vortex-compact 14713806 14839389 0.99
tpcds_q91/datafusion:vortex-compact 31684069 33763279 0.94
tpcds_q92/datafusion:vortex-compact 🚨 23623954 21461307 1.10
tpcds_q93/datafusion:vortex-compact 37695781 37976702 0.99
tpcds_q94/datafusion:vortex-compact 27947079 28296391 0.99
tpcds_q95/datafusion:vortex-compact 65837199 63817180 1.03
tpcds_q96/datafusion:vortex-compact 17162916 17140881 1.00
tpcds_q97/datafusion:vortex-compact 35606488 36823446 0.97
tpcds_q98/datafusion:vortex-compact 30518195 30340488 1.01
tpcds_q99/datafusion:vortex-compact 28787141 30307510 0.95
datafusion / parquet (0.976x ➖, 3↑ 1↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30188445 29952611 1.01
tpcds_q02/datafusion:parquet 41758376 42971419 0.97
tpcds_q03/datafusion:parquet 12833887 13907975 0.92
tpcds_q04/datafusion:parquet 255829234 263544798 0.97
tpcds_q05/datafusion:parquet 40545710 41405359 0.98
tpcds_q06/datafusion:parquet 58330243 57605225 1.01
tpcds_q07/datafusion:parquet 76053026 77304506 0.98
tpcds_q08/datafusion:parquet 25907708 26546678 0.98
tpcds_q09/datafusion:parquet 🚨 52605362 44420603 1.18
tpcds_q10/datafusion:parquet 72213391 69963832 1.03
tpcds_q11/datafusion:parquet 145931747 146785014 0.99
tpcds_q12/datafusion:parquet 17894356 17642502 1.01
tpcds_q13/datafusion:parquet 73784688 76552744 0.96
tpcds_q14/datafusion:parquet 160459930 164216286 0.98
tpcds_q15/datafusion:parquet 20288168 21736521 0.93
tpcds_q16/datafusion:parquet 22300488 23652983 0.94
tpcds_q17/datafusion:parquet 61378794 64088380 0.96
tpcds_q18/datafusion:parquet 112182227 112514860 1.00
tpcds_q19/datafusion:parquet 21995677 23073639 0.95
tpcds_q20/datafusion:parquet 16153575 16323983 0.99
tpcds_q21/datafusion:parquet 17859142 18260070 0.98
tpcds_q22/datafusion:parquet 151352037 156038349 0.97
tpcds_q23/datafusion:parquet 143054198 149958880 0.95
tpcds_q24/datafusion:parquet 87936579 88686408 0.99
tpcds_q25/datafusion:parquet 62387216 65448233 0.95
tpcds_q26/datafusion:parquet 64228114 66061447 0.97
tpcds_q27/datafusion:parquet 139625897 143178518 0.98
tpcds_q28/datafusion:parquet 44184304 44805652 0.99
tpcds_q29/datafusion:parquet 64486832 65189363 0.99
tpcds_q30/datafusion:parquet 32738662 33636540 0.97
tpcds_q31/datafusion:parquet 63997574 64571392 0.99
tpcds_q32/datafusion:parquet 17668444 17807620 0.99
tpcds_q33/datafusion:parquet 26343450 26943782 0.98
tpcds_q34/datafusion:parquet 21960782 21052527 1.04
tpcds_q35/datafusion:parquet 68620753 67560601 1.02
tpcds_q36/datafusion:parquet 54839089 57776107 0.95
tpcds_q37/datafusion:parquet 18672609 19150843 0.98
tpcds_q38/datafusion:parquet 39775776 41675278 0.95
tpcds_q39/datafusion:parquet 71063201 76077530 0.93
tpcds_q40/datafusion:parquet 23249209 24286464 0.96
tpcds_q41/datafusion:parquet 12941284 13333938 0.97
tpcds_q42/datafusion:parquet 11281004 11502559 0.98
tpcds_q43/datafusion:parquet 18083258 17302965 1.05
tpcds_q44/datafusion:parquet 32923294 34060873 0.97
tpcds_q45/datafusion:parquet 27676812 28288601 0.98
tpcds_q46/datafusion:parquet 31244289 31776926 0.98
tpcds_q47/datafusion:parquet 121230876 123061062 0.99
tpcds_q48/datafusion:parquet 66355919 66924207 0.99
tpcds_q49/datafusion:parquet 54880084 53934549 1.02
tpcds_q50/datafusion:parquet 41948314 43182775 0.97
tpcds_q51/datafusion:parquet 84085626 85574155 0.98
tpcds_q52/datafusion:parquet 🚀 11231969 12837868 0.87
tpcds_q53/datafusion:parquet 17354016 17373107 1.00
tpcds_q54/datafusion:parquet 32825801 33427007 0.98
tpcds_q55/datafusion:parquet 11629563 11175141 1.04
tpcds_q56/datafusion:parquet 27214839 28261676 0.96
tpcds_q57/datafusion:parquet 93986993 94900629 0.99
tpcds_q58/datafusion:parquet 48424612 50145947 0.97
tpcds_q59/datafusion:parquet 55877562 57076767 0.98
tpcds_q60/datafusion:parquet 26708757 26710261 1.00
tpcds_q61/datafusion:parquet 42418580 43283426 0.98
tpcds_q62/datafusion:parquet 23932205 24844177 0.96
tpcds_q63/datafusion:parquet 17036388 17605120 0.97
tpcds_q64/datafusion:parquet 502896770 517585111 0.97
tpcds_q65/datafusion:parquet 35656299 37563096 0.95
tpcds_q66/datafusion:parquet 64339631 66469477 0.97
tpcds_q67/datafusion:parquet 144012770 144859606 0.99
tpcds_q68/datafusion:parquet 30559361 31575326 0.97
tpcds_q69/datafusion:parquet 62879076 64922262 0.97
tpcds_q70/datafusion:parquet 84654418 88823856 0.95
tpcds_q71/datafusion:parquet 21614889 22701731 0.95
tpcds_q72/datafusion:parquet 587092638 600715552 0.98
tpcds_q73/datafusion:parquet 19646290 20944499 0.94
tpcds_q74/datafusion:parquet 81238720 84845681 0.96
tpcds_q75/datafusion:parquet 96431264 98501147 0.98
tpcds_q76/datafusion:parquet 29475013 30631881 0.96
tpcds_q77/datafusion:parquet 38889660 39402947 0.99
tpcds_q78/datafusion:parquet 116179657 114058396 1.02
tpcds_q79/datafusion:parquet 25496562 25697247 0.99
tpcds_q80/datafusion:parquet 78066156 79338017 0.98
tpcds_q81/datafusion:parquet 32885454 30940056 1.06
tpcds_q82/datafusion:parquet 18734339 19255741 0.97
tpcds_q83/datafusion:parquet 34766379 36075051 0.96
tpcds_q84/datafusion:parquet 37214525 38704447 0.96
tpcds_q85/datafusion:parquet 145628242 146526596 0.99
tpcds_q86/datafusion:parquet 15438974 15581538 0.99
tpcds_q87/datafusion:parquet 39623035 40265489 0.98
tpcds_q88/datafusion:parquet 58251157 58437738 1.00
tpcds_q89/datafusion:parquet 20842135 20690286 1.01
tpcds_q90/datafusion:parquet 13976835 14263579 0.98
tpcds_q91/datafusion:parquet 55435385 56953952 0.97
tpcds_q92/datafusion:parquet 16136022 17328429 0.93
tpcds_q93/datafusion:parquet 30567177 31203696 0.98
tpcds_q94/datafusion:parquet 19838789 18838101 1.05
tpcds_q95/datafusion:parquet 57503814 59307874 0.97
tpcds_q96/datafusion:parquet 11181877 11743642 0.95
tpcds_q97/datafusion:parquet 28191698 29915377 0.94
tpcds_q98/datafusion:parquet 🚀 21057360 25486125 0.83
tpcds_q99/datafusion:parquet 🚀 24968354 32082562 0.78
duckdb / vortex-file-compressed (1.055x ➖, 0↑ 23↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25552436 23759316 1.08
tpcds_q02/duckdb:vortex-file-compressed 35995653 34008331 1.06
tpcds_q03/duckdb:vortex-file-compressed 28848434 26475692 1.09
tpcds_q04/duckdb:vortex-file-compressed 90871223 95676267 0.95
tpcds_q05/duckdb:vortex-file-compressed 34097024 35209369 0.97
tpcds_q06/duckdb:vortex-file-compressed 🚨 39784072 33443238 1.19
tpcds_q07/duckdb:vortex-file-compressed 21152013 22129237 0.96
tpcds_q08/duckdb:vortex-file-compressed 🚨 31531869 28023645 1.13
tpcds_q09/duckdb:vortex-file-compressed 15469948 16072090 0.96
tpcds_q10/duckdb:vortex-file-compressed 40477559 38402683 1.05
tpcds_q11/duckdb:vortex-file-compressed 65542878 66311094 0.99
tpcds_q12/duckdb:vortex-file-compressed 18049137 16901227 1.07
tpcds_q13/duckdb:vortex-file-compressed 34025232 33093688 1.03
tpcds_q14/duckdb:vortex-file-compressed 98993592 98351769 1.01
tpcds_q15/duckdb:vortex-file-compressed 29368361 27475923 1.07
tpcds_q16/duckdb:vortex-file-compressed 29687723 27056385 1.10
tpcds_q17/duckdb:vortex-file-compressed 🚨 48623110 44190520 1.10
tpcds_q18/duckdb:vortex-file-compressed 37936415 38477480 0.99
tpcds_q19/duckdb:vortex-file-compressed 33665093 33806667 1.00
tpcds_q20/duckdb:vortex-file-compressed 18569323 17402857 1.07
tpcds_q21/duckdb:vortex-file-compressed 17935490 17829308 1.01
tpcds_q22/duckdb:vortex-file-compressed 74619284 80771992 0.92
tpcds_q23/duckdb:vortex-file-compressed 🚨 111558747 94129894 1.19
tpcds_q24/duckdb:vortex-file-compressed 49481991 48438710 1.02
tpcds_q25/duckdb:vortex-file-compressed 🚨 52057109 43047481 1.21
tpcds_q26/duckdb:vortex-file-compressed 19286622 20364046 0.95
tpcds_q27/duckdb:vortex-file-compressed 22752801 23415819 0.97
tpcds_q28/duckdb:vortex-file-compressed 13388715 12727556 1.05
tpcds_q29/duckdb:vortex-file-compressed 🚨 44923656 40672988 1.10
tpcds_q30/duckdb:vortex-file-compressed 28629685 28973480 0.99
tpcds_q31/duckdb:vortex-file-compressed 29118099 29613381 0.98
tpcds_q32/duckdb:vortex-file-compressed 🚨 16716901 14528127 1.15
tpcds_q33/duckdb:vortex-file-compressed 24980207 23993771 1.04
tpcds_q34/duckdb:vortex-file-compressed 27252045 25355447 1.07
tpcds_q35/duckdb:vortex-file-compressed 67461555 66162354 1.02
tpcds_q36/duckdb:vortex-file-compressed 24184227 24814511 0.97
tpcds_q37/duckdb:vortex-file-compressed 21891401 20200973 1.08
tpcds_q38/duckdb:vortex-file-compressed 39047818 36522794 1.07
tpcds_q39/duckdb:vortex-file-compressed 36296686 36290077 1.00
tpcds_q40/duckdb:vortex-file-compressed 21316173 19969446 1.07
tpcds_q41/duckdb:vortex-file-compressed 11178382 10367296 1.08
tpcds_q42/duckdb:vortex-file-compressed 13403045 13130033 1.02
tpcds_q43/duckdb:vortex-file-compressed 21994317 20483548 1.07
tpcds_q44/duckdb:vortex-file-compressed 22986714 22363958 1.03
tpcds_q45/duckdb:vortex-file-compressed 31689992 29790249 1.06
tpcds_q46/duckdb:vortex-file-compressed 🚨 32793416 29523776 1.11
tpcds_q47/duckdb:vortex-file-compressed 53389447 52553839 1.02
tpcds_q48/duckdb:vortex-file-compressed 30809386 30446871 1.01
tpcds_q49/duckdb:vortex-file-compressed 32264457 33441106 0.96
tpcds_q50/duckdb:vortex-file-compressed 🚨 31810984 26270215 1.21
tpcds_q51/duckdb:vortex-file-compressed 107516169 108578543 0.99
tpcds_q52/duckdb:vortex-file-compressed 13657850 13254725 1.03
tpcds_q53/duckdb:vortex-file-compressed 23038952 22205846 1.04
tpcds_q54/duckdb:vortex-file-compressed 🚨 32345883 28675878 1.13
tpcds_q55/duckdb:vortex-file-compressed 13335257 12614524 1.06
tpcds_q56/duckdb:vortex-file-compressed 26856810 25919398 1.04
tpcds_q57/duckdb:vortex-file-compressed 42802800 42058325 1.02
tpcds_q58/duckdb:vortex-file-compressed 30911246 30038742 1.03
tpcds_q59/duckdb:vortex-file-compressed 🚨 68586543 57193704 1.20
tpcds_q60/duckdb:vortex-file-compressed 26920653 26101871 1.03
tpcds_q61/duckdb:vortex-file-compressed 30785170 30339926 1.01
tpcds_q62/duckdb:vortex-file-compressed 🚨 18732124 16721312 1.12
tpcds_q63/duckdb:vortex-file-compressed 🚨 23146251 20969986 1.10
tpcds_q64/duckdb:vortex-file-compressed 105374101 98407893 1.07
tpcds_q65/duckdb:vortex-file-compressed 23141994 22137462 1.05
tpcds_q66/duckdb:vortex-file-compressed 30551147 30241369 1.01
tpcds_q67/duckdb:vortex-file-compressed 140352650 143940264 0.98
tpcds_q68/duckdb:vortex-file-compressed 31672084 30268581 1.05
tpcds_q69/duckdb:vortex-file-compressed 44078309 41474370 1.06
tpcds_q70/duckdb:vortex-file-compressed 37771311 35347053 1.07
tpcds_q71/duckdb:vortex-file-compressed 21865989 20804942 1.05
tpcds_q72/duckdb:vortex-file-compressed 170196918 169833457 1.00
tpcds_q73/duckdb:vortex-file-compressed 🚨 26253830 23389063 1.12
tpcds_q74/duckdb:vortex-file-compressed 43139148 41591548 1.04
tpcds_q75/duckdb:vortex-file-compressed 51665329 47883578 1.08
tpcds_q76/duckdb:vortex-file-compressed 21477738 19888795 1.08
tpcds_q77/duckdb:vortex-file-compressed 25660211 25729783 1.00
tpcds_q78/duckdb:vortex-file-compressed 77610758 78392929 0.99
tpcds_q79/duckdb:vortex-file-compressed 26092415 23828919 1.09
tpcds_q80/duckdb:vortex-file-compressed 48782795 46678660 1.05
tpcds_q81/duckdb:vortex-file-compressed 🚨 34000355 29920321 1.14
tpcds_q82/duckdb:vortex-file-compressed 46459841 46337871 1.00
tpcds_q83/duckdb:vortex-file-compressed 🚨 30328633 26607056 1.14
tpcds_q84/duckdb:vortex-file-compressed 🚨 23280236 16830167 1.38
tpcds_q85/duckdb:vortex-file-compressed 🚨 49990676 42489867 1.18
tpcds_q86/duckdb:vortex-file-compressed 16879486 17610659 0.96
tpcds_q87/duckdb:vortex-file-compressed 41502152 41895757 0.99
tpcds_q88/duckdb:vortex-file-compressed 54344790 51456048 1.06
tpcds_q89/duckdb:vortex-file-compressed 22942425 23009056 1.00
tpcds_q90/duckdb:vortex-file-compressed 🚨 11963958 10155957 1.18
tpcds_q91/duckdb:vortex-file-compressed 🚨 27461389 22696527 1.21
tpcds_q92/duckdb:vortex-file-compressed 🚨 22368668 19066990 1.17
tpcds_q93/duckdb:vortex-file-compressed 30114945 29182059 1.03
tpcds_q94/duckdb:vortex-file-compressed 🚨 24913540 21126269 1.18
tpcds_q95/duckdb:vortex-file-compressed 147215205 156593027 0.94
tpcds_q96/duckdb:vortex-file-compressed 13337046 12870475 1.04
tpcds_q97/duckdb:vortex-file-compressed 39100176 38718903 1.01
tpcds_q98/duckdb:vortex-file-compressed 21020829 19473300 1.08
tpcds_q99/duckdb:vortex-file-compressed 🚨 26743634 22758898 1.18
duckdb / vortex-compact (0.949x ➖, 25↑ 4↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 28626739 28860205 0.99
tpcds_q02/duckdb:vortex-compact 44305013 42416748 1.04
tpcds_q03/duckdb:vortex-compact 50627685 49315477 1.03
tpcds_q04/duckdb:vortex-compact 🚀 102639071 116823818 0.88
tpcds_q05/duckdb:vortex-compact 42515761 41382515 1.03
tpcds_q06/duckdb:vortex-compact 46286040 43659459 1.06
tpcds_q07/duckdb:vortex-compact 🚀 34212514 40437034 0.85
tpcds_q08/duckdb:vortex-compact 41079428 44755411 0.92
tpcds_q09/duckdb:vortex-compact 20533936 21739272 0.94
tpcds_q10/duckdb:vortex-compact 55679810 58790490 0.95
tpcds_q11/duckdb:vortex-compact 🚀 72952775 81611213 0.89
tpcds_q12/duckdb:vortex-compact 🚀 22935804 25645595 0.89
tpcds_q13/duckdb:vortex-compact 52370472 58111269 0.90
tpcds_q14/duckdb:vortex-compact 119589248 125375891 0.95
tpcds_q15/duckdb:vortex-compact 32129952 34516482 0.93
tpcds_q16/duckdb:vortex-compact 29593343 31127558 0.95
tpcds_q17/duckdb:vortex-compact 58478284 62852785 0.93
tpcds_q18/duckdb:vortex-compact 🚀 50165741 56161165 0.89
tpcds_q19/duckdb:vortex-compact 45844498 47648037 0.96
tpcds_q20/duckdb:vortex-compact 23287723 23836475 0.98
tpcds_q21/duckdb:vortex-compact 21737913 22257653 0.98
tpcds_q22/duckdb:vortex-compact 🚀 76283204 90160697 0.85
tpcds_q23/duckdb:vortex-compact 🚨 135463704 122747001 1.10
tpcds_q24/duckdb:vortex-compact 59282695 64771193 0.92
tpcds_q25/duckdb:vortex-compact 🚨 83702888 59695955 1.40
tpcds_q26/duckdb:vortex-compact 31577081 34385024 0.92
tpcds_q27/duckdb:vortex-compact 37031068 38629275 0.96
tpcds_q28/duckdb:vortex-compact 34458742 35006706 0.98
tpcds_q29/duckdb:vortex-compact 56062598 59147221 0.95
tpcds_q30/duckdb:vortex-compact 33802290 32878589 1.03
tpcds_q31/duckdb:vortex-compact 🚀 37136055 43609394 0.85
tpcds_q32/duckdb:vortex-compact 23409735 23955536 0.98
tpcds_q33/duckdb:vortex-compact 33917543 33670214 1.01
tpcds_q34/duckdb:vortex-compact 31717957 31854894 1.00
tpcds_q35/duckdb:vortex-compact 81548706 85663210 0.95
tpcds_q36/duckdb:vortex-compact 37303227 38623003 0.97
tpcds_q37/duckdb:vortex-compact 26078577 27089014 0.96
tpcds_q38/duckdb:vortex-compact 🚀 41984582 49617354 0.85
tpcds_q39/duckdb:vortex-compact 41560499 40744713 1.02
tpcds_q40/duckdb:vortex-compact 🚀 26832489 30223002 0.89
tpcds_q41/duckdb:vortex-compact 12467616 13284133 0.94
tpcds_q42/duckdb:vortex-compact 20470661 20833863 0.98
tpcds_q43/duckdb:vortex-compact 33398206 33301417 1.00
tpcds_q44/duckdb:vortex-compact 33604512 31032126 1.08
tpcds_q45/duckdb:vortex-compact 🚀 37679628 42151345 0.89
tpcds_q46/duckdb:vortex-compact 🚀 45034456 50046285 0.90
tpcds_q47/duckdb:vortex-compact 64350579 69465532 0.93
tpcds_q48/duckdb:vortex-compact 46718907 49627506 0.94
tpcds_q49/duckdb:vortex-compact 47860733 51034366 0.94
tpcds_q50/duckdb:vortex-compact 39380349 40548102 0.97
tpcds_q51/duckdb:vortex-compact 🚀 113163105 133061474 0.85
tpcds_q52/duckdb:vortex-compact 20605507 22317256 0.92
tpcds_q53/duckdb:vortex-compact 33960446 36097841 0.94
tpcds_q54/duckdb:vortex-compact 40921929 40384597 1.01
tpcds_q55/duckdb:vortex-compact 19316305 19852190 0.97
tpcds_q56/duckdb:vortex-compact 35065287 38858533 0.90
tpcds_q57/duckdb:vortex-compact 47021197 48281496 0.97
tpcds_q58/duckdb:vortex-compact 38992225 41927344 0.93
tpcds_q59/duckdb:vortex-compact 🚨 87473451 70332522 1.24
tpcds_q60/duckdb:vortex-compact 35614845 39153192 0.91
tpcds_q61/duckdb:vortex-compact 54108301 58093433 0.93
tpcds_q62/duckdb:vortex-compact 23399621 23875344 0.98
tpcds_q63/duckdb:vortex-compact 33530244 34467672 0.97
tpcds_q64/duckdb:vortex-compact 132212457 142770966 0.93
tpcds_q65/duckdb:vortex-compact 31387538 32479858 0.97
tpcds_q66/duckdb:vortex-compact 39690793 38883551 1.02
tpcds_q67/duckdb:vortex-compact 🚀 149237823 183941915 0.81
tpcds_q68/duckdb:vortex-compact 🚀 45878177 51679581 0.89
tpcds_q69/duckdb:vortex-compact 60038548 61746054 0.97
tpcds_q70/duckdb:vortex-compact 59420031 63151253 0.94
tpcds_q71/duckdb:vortex-compact 30266468 32867773 0.92
tpcds_q72/duckdb:vortex-compact 187208956 198289354 0.94
tpcds_q73/duckdb:vortex-compact 🚀 28905555 32992133 0.88
tpcds_q74/duckdb:vortex-compact 🚀 48783348 55331019 0.88
tpcds_q75/duckdb:vortex-compact 🚀 59264362 72543872 0.82
tpcds_q76/duckdb:vortex-compact 32247340 31162180 1.03
tpcds_q77/duckdb:vortex-compact 38686399 41807636 0.93
tpcds_q78/duckdb:vortex-compact 🚀 85153129 98658262 0.86
tpcds_q79/duckdb:vortex-compact 🚀 42048084 46810650 0.90
tpcds_q80/duckdb:vortex-compact 🚀 68063188 79364267 0.86
tpcds_q81/duckdb:vortex-compact 37521865 41659319 0.90
tpcds_q82/duckdb:vortex-compact 53008288 55766795 0.95
tpcds_q83/duckdb:vortex-compact 40581760 39831386 1.02
tpcds_q84/duckdb:vortex-compact 🚨 28949263 26055043 1.11
tpcds_q85/duckdb:vortex-compact 63577727 61524577 1.03
tpcds_q86/duckdb:vortex-compact 🚀 22227219 25241629 0.88
tpcds_q87/duckdb:vortex-compact 🚀 45832803 51172484 0.90
tpcds_q88/duckdb:vortex-compact 78426709 83215211 0.94
tpcds_q89/duckdb:vortex-compact 33942627 35215021 0.96
tpcds_q90/duckdb:vortex-compact 12902520 12969728 0.99
tpcds_q91/duckdb:vortex-compact 46463993 47047485 0.99
tpcds_q92/duckdb:vortex-compact 47520312 45833102 1.04
tpcds_q93/duckdb:vortex-compact 🚀 32995564 38496838 0.86
tpcds_q94/duckdb:vortex-compact 31323852 30967140 1.01
tpcds_q95/duckdb:vortex-compact 🚀 138853842 177381838 0.78
tpcds_q96/duckdb:vortex-compact 17553385 17753126 0.99
tpcds_q97/duckdb:vortex-compact 43720319 48571774 0.90
tpcds_q98/duckdb:vortex-compact 🚀 27387587 31429959 0.87
tpcds_q99/duckdb:vortex-compact 29105102 30171524 0.96
duckdb / parquet (0.988x ➖, 1↑ 1↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29322029 29810499 0.98
tpcds_q02/duckdb:parquet 23887756 24850485 0.96
tpcds_q03/duckdb:parquet 12710879 13457340 0.94
tpcds_q04/duckdb:parquet 169041820 168990979 1.00
tpcds_q05/duckdb:parquet 30756602 33559619 0.92
tpcds_q06/duckdb:parquet 33603757 34151682 0.98
tpcds_q07/duckdb:parquet 23904495 24711089 0.97
tpcds_q08/duckdb:parquet 29427917 29396029 1.00
tpcds_q09/duckdb:parquet 44210507 44552240 0.99
tpcds_q10/duckdb:parquet 37614369 38301552 0.98
tpcds_q11/duckdb:parquet 90258579 88133781 1.02
tpcds_q12/duckdb:parquet 17235096 17380711 0.99
tpcds_q13/duckdb:parquet 34963712 35161554 0.99
tpcds_q14/duckdb:parquet 102547144 103629836 0.99
tpcds_q15/duckdb:parquet 30487515 30761918 0.99
tpcds_q16/duckdb:parquet 🚀 22337456 26321157 0.85
tpcds_q17/duckdb:parquet 38833330 38585714 1.01
tpcds_q18/duckdb:parquet 47141674 48655708 0.97
tpcds_q19/duckdb:parquet 31639162 31725522 1.00
tpcds_q20/duckdb:parquet 18403578 18422297 1.00
tpcds_q21/duckdb:parquet 11714678 12055572 0.97
tpcds_q22/duckdb:parquet 71489187 69562637 1.03
tpcds_q23/duckdb:parquet 81873644 81721101 1.00
tpcds_q24/duckdb:parquet 46726857 46874080 1.00
tpcds_q25/duckdb:parquet 35432407 35815998 0.99
tpcds_q26/duckdb:parquet 39184260 38245562 1.02
tpcds_q27/duckdb:parquet 52490703 53258506 0.99
tpcds_q28/duckdb:parquet 42411446 42955491 0.99
tpcds_q29/duckdb:parquet 38353582 38197311 1.00
tpcds_q30/duckdb:parquet 37285515 37518261 0.99
tpcds_q31/duckdb:parquet 28371837 29135171 0.97
tpcds_q32/duckdb:parquet 12531286 12533485 1.00
tpcds_q33/duckdb:parquet 23910758 23991085 1.00
tpcds_q34/duckdb:parquet 22363904 22909769 0.98
tpcds_q35/duckdb:parquet 59404950 61533214 0.97
tpcds_q36/duckdb:parquet 22516422 22784543 0.99
tpcds_q37/duckdb:parquet 14095349 15005336 0.94
tpcds_q38/duckdb:parquet 36168263 36851289 0.98
tpcds_q39/duckdb:parquet 31162881 32830777 0.95
tpcds_q40/duckdb:parquet 19264455 19295321 1.00
tpcds_q41/duckdb:parquet 8707403 8831903 0.99
tpcds_q42/duckdb:parquet 12350111 13352910 0.92
tpcds_q43/duckdb:parquet 18095330 19809487 0.91
tpcds_q44/duckdb:parquet 26373667 26282225 1.00
tpcds_q45/duckdb:parquet 29142135 27859500 1.05
tpcds_q46/duckdb:parquet 47153539 47740310 0.99
tpcds_q47/duckdb:parquet 50600129 49818165 1.02
tpcds_q48/duckdb:parquet 32089172 32550444 0.99
tpcds_q49/duckdb:parquet 27957480 28445411 0.98
tpcds_q50/duckdb:parquet 25708300 25907873 0.99
tpcds_q51/duckdb:parquet 106690894 103031496 1.04
tpcds_q52/duckdb:parquet 12708639 13609309 0.93
tpcds_q53/duckdb:parquet 19055403 19598359 0.97
tpcds_q54/duckdb:parquet 28015894 28468604 0.98
tpcds_q55/duckdb:parquet 12921259 13200252 0.98
tpcds_q56/duckdb:parquet 23753018 24920750 0.95
tpcds_q57/duckdb:parquet 37968043 38103858 1.00
tpcds_q58/duckdb:parquet 26369588 25387945 1.04
tpcds_q59/duckdb:parquet 36440495 36073124 1.01
tpcds_q60/duckdb:parquet 23998104 25137735 0.95
tpcds_q61/duckdb:parquet 32598101 34286576 0.95
tpcds_q62/duckdb:parquet 12541214 12529661 1.00
tpcds_q63/duckdb:parquet 17021947 18106196 0.94
tpcds_q64/duckdb:parquet 73775676 81688449 0.90
tpcds_q65/duckdb:parquet 24144835 23860884 1.01
tpcds_q66/duckdb:parquet 32368076 29789062 1.09
tpcds_q67/duckdb:parquet 140532784 137480351 1.02
tpcds_q68/duckdb:parquet 39040059 38618409 1.01
tpcds_q69/duckdb:parquet 38102377 38416381 0.99
tpcds_q70/duckdb:parquet 22872265 22604360 1.01
tpcds_q71/duckdb:parquet 22481164 23050706 0.98
tpcds_q72/duckdb:parquet 165992722 167404963 0.99
tpcds_q73/duckdb:parquet 20293070 20890479 0.97
tpcds_q74/duckdb:parquet 128025463 128683346 0.99
tpcds_q75/duckdb:parquet 56897653 57242997 0.99
tpcds_q76/duckdb:parquet 21439409 22052205 0.97
tpcds_q77/duckdb:parquet 25820613 24742424 1.04
tpcds_q78/duckdb:parquet 76402428 82472729 0.93
tpcds_q79/duckdb:parquet 29946005 30306527 0.99
tpcds_q80/duckdb:parquet 43497407 43657736 1.00
tpcds_q81/duckdb:parquet 35379388 36037560 0.98
tpcds_q82/duckdb:parquet 15953403 16462652 0.97
tpcds_q83/duckdb:parquet 18162581 18552079 0.98
tpcds_q84/duckdb:parquet 20396649 20308645 1.00
tpcds_q85/duckdb:parquet 42061877 41106451 1.02
tpcds_q86/duckdb:parquet 13706362 13703920 1.00
tpcds_q87/duckdb:parquet 39187673 39310899 1.00
tpcds_q88/duckdb:parquet 52727069 53353404 0.99
tpcds_q89/duckdb:parquet 20386705 21750217 0.94
tpcds_q90/duckdb:parquet 8428850 8430088 1.00
tpcds_q91/duckdb:parquet 25451626 25232130 1.01
tpcds_q92/duckdb:parquet 12826572 13032490 0.98
tpcds_q93/duckdb:parquet 31705095 31518576 1.01
tpcds_q94/duckdb:parquet 17888813 17832314 1.00
tpcds_q95/duckdb:parquet 🚨 144113486 122428620 1.18
tpcds_q96/duckdb:parquet 11629055 10639845 1.09
tpcds_q97/duckdb:parquet 38665531 38256686 1.01
tpcds_q98/duckdb:parquet 24208984 24709337 0.98
tpcds_q99/duckdb:parquet 20424243 20238229 1.01
duckdb / duckdb (0.892x ✅, 60↑ 0↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚀 22071345 24740129 0.89
tpcds_q02/duckdb:duckdb 19745806 21095792 0.94
tpcds_q03/duckdb:duckdb 🚀 10438259 12346631 0.85
tpcds_q04/duckdb:duckdb 179533440 194191809 0.92
tpcds_q05/duckdb:duckdb 21465561 23768823 0.90
tpcds_q06/duckdb:duckdb 28078025 30768401 0.91
tpcds_q07/duckdb:duckdb 🚀 40916052 46023833 0.89
tpcds_q08/duckdb:duckdb 120442595 123247554 0.98
tpcds_q09/duckdb:duckdb 20571227 21726446 0.95
tpcds_q10/duckdb:duckdb 🚀 27439135 30955546 0.89
tpcds_q11/duckdb:duckdb 94198555 101140872 0.93
tpcds_q12/duckdb:duckdb 🚀 13992421 16251407 0.86
tpcds_q13/duckdb:duckdb 25847628 28523750 0.91
tpcds_q14/duckdb:duckdb 🚀 90980453 105221516 0.86
tpcds_q15/duckdb:duckdb 🚀 24421534 28920136 0.84
tpcds_q16/duckdb:duckdb 🚀 19265647 21771390 0.88
tpcds_q17/duckdb:duckdb 🚀 24474083 28252331 0.87
tpcds_q18/duckdb:duckdb 🚀 47385159 53596712 0.88
tpcds_q19/duckdb:duckdb 🚀 19395724 21822496 0.89
tpcds_q20/duckdb:duckdb 🚀 13890514 15970898 0.87
tpcds_q21/duckdb:duckdb 🚀 7439178 8414882 0.88
tpcds_q22/duckdb:duckdb 🚀 62689246 76821724 0.82
tpcds_q23/duckdb:duckdb 🚀 78181882 91357547 0.86
tpcds_q24/duckdb:duckdb 25515894 28028816 0.91
tpcds_q25/duckdb:duckdb 🚀 18660752 21309432 0.88
tpcds_q26/duckdb:duckdb 🚀 27830903 32677142 0.85
tpcds_q27/duckdb:duckdb 42710951 46554047 0.92
tpcds_q28/duckdb:duckdb 25924852 26214756 0.99
tpcds_q29/duckdb:duckdb 24268636 26136354 0.93
tpcds_q30/duckdb:duckdb 🚀 31072467 34590390 0.90
tpcds_q31/duckdb:duckdb 🚀 50780397 61067003 0.83
tpcds_q32/duckdb:duckdb 🚀 7924343 9471750 0.84
tpcds_q33/duckdb:duckdb 16320258 17351889 0.94
tpcds_q34/duckdb:duckdb 18833669 19335164 0.97
tpcds_q35/duckdb:duckdb 🚀 36003087 42236981 0.85
tpcds_q36/duckdb:duckdb 🚀 70173613 82215808 0.85
tpcds_q37/duckdb:duckdb 🚀 8404930 10074720 0.83
tpcds_q38/duckdb:duckdb 🚀 33360971 37663337 0.89
tpcds_q39/duckdb:duckdb 28083704 30857476 0.91
tpcds_q40/duckdb:duckdb 🚀 14476659 17637768 0.82
tpcds_q41/duckdb:duckdb 🚀 9178608 11721195 0.78
tpcds_q42/duckdb:duckdb 9150828 9726292 0.94
tpcds_q43/duckdb:duckdb 14813237 15588110 0.95
tpcds_q44/duckdb:duckdb 🚀 14915279 18040300 0.83
tpcds_q45/duckdb:duckdb 🚀 18851500 21783921 0.87
tpcds_q46/duckdb:duckdb 🚀 39213184 44752124 0.88
tpcds_q47/duckdb:duckdb 🚀 45692041 54418060 0.84
tpcds_q48/duckdb:duckdb 25980609 26810421 0.97
tpcds_q49/duckdb:duckdb 21876019 21836113 1.00
tpcds_q50/duckdb:duckdb 16159605 17907097 0.90
tpcds_q51/duckdb:duckdb 🚀 96571104 109305291 0.88
tpcds_q52/duckdb:duckdb 10813056 10849810 1.00
tpcds_q53/duckdb:duckdb 🚀 17639464 20504927 0.86
tpcds_q54/duckdb:duckdb 🚀 18864915 21215117 0.89
tpcds_q55/duckdb:duckdb 10187864 10784540 0.94
tpcds_q56/duckdb:duckdb 17173472 18215141 0.94
tpcds_q57/duckdb:duckdb 🚀 36342600 40935369 0.89
tpcds_q58/duckdb:duckdb 16944401 18802697 0.90
tpcds_q59/duckdb:duckdb 36683525 39428658 0.93
tpcds_q60/duckdb:duckdb 18675014 19652476 0.95
tpcds_q61/duckdb:duckdb 🚀 15944667 18345175 0.87
tpcds_q62/duckdb:duckdb 🚀 9815854 11497228 0.85
tpcds_q63/duckdb:duckdb 🚀 16051837 18221518 0.88
tpcds_q64/duckdb:duckdb 🚀 57471607 64996411 0.88
tpcds_q65/duckdb:duckdb 🚀 37076301 41327754 0.90
tpcds_q66/duckdb:duckdb 🚀 26183455 29859910 0.88
tpcds_q67/duckdb:duckdb 🚀 131781114 152988421 0.86
tpcds_q68/duckdb:duckdb 26935065 29704236 0.91
tpcds_q69/duckdb:duckdb 29653511 31036601 0.96
tpcds_q70/duckdb:duckdb 🚀 16734209 18710121 0.89
tpcds_q71/duckdb:duckdb 16499951 17436881 0.95
tpcds_q72/duckdb:duckdb 45886217 50552602 0.91
tpcds_q73/duckdb:duckdb 13963953 14977702 0.93
tpcds_q74/duckdb:duckdb 143750586 157307217 0.91
tpcds_q75/duckdb:duckdb 46541742 50160027 0.93
tpcds_q76/duckdb:duckdb 🚀 14408410 16105839 0.89
tpcds_q77/duckdb:duckdb 15443736 16520662 0.93
tpcds_q78/duckdb:duckdb 68797684 73544789 0.94
tpcds_q79/duckdb:duckdb 20188113 22131710 0.91
tpcds_q80/duckdb:duckdb 🚀 31405857 37500817 0.84
tpcds_q81/duckdb:duckdb 40450053 43558653 0.93
tpcds_q82/duckdb:duckdb 🚀 10063124 11722780 0.86
tpcds_q83/duckdb:duckdb 🚀 11051328 12528649 0.88
tpcds_q84/duckdb:duckdb 🚀 14855051 16747947 0.89
tpcds_q85/duckdb:duckdb 🚀 26284814 30275222 0.87
tpcds_q86/duckdb:duckdb 🚀 12266300 13749681 0.89
tpcds_q87/duckdb:duckdb 🚀 35065710 39760663 0.88
tpcds_q88/duckdb:duckdb 30333137 31002955 0.98
tpcds_q89/duckdb:duckdb 🚀 21567354 24656057 0.87
tpcds_q90/duckdb:duckdb 🚀 6236298 7325033 0.85
tpcds_q91/duckdb:duckdb 🚀 14333030 16752402 0.86
tpcds_q92/duckdb:duckdb 🚀 9979779 11392129 0.88
tpcds_q93/duckdb:duckdb 🚀 23283200 27647323 0.84
tpcds_q94/duckdb:duckdb 🚀 14529255 16668177 0.87
tpcds_q95/duckdb:duckdb 🚀 110753312 140585390 0.79
tpcds_q96/duckdb:duckdb 🚀 5835505 6773147 0.86
tpcds_q97/duckdb:duckdb 🚀 32096808 36715219 0.87
tpcds_q98/duckdb:duckdb 🚀 20236704 22875881 0.88
tpcds_q99/duckdb:duckdb 16901169 18322128 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +4.7% -0.4% +5.2% +23.5% ➖ noise
1 datafusion:vortex-file-compressed -8.2% -0.4% -7.8% +24.8% ➖ noise
1 duckdb:duckdb -10.8% -0.4% -10.4% +20.4% ➖ noise
1 duckdb:vortex-compact -0.8% -0.4% -0.4% +22.5% ➖ noise
1 duckdb:vortex-file-compressed +7.5% -0.4% +8.0% +28.4% ➖ noise
2 datafusion:vortex-compact -0.2% -3.3% +3.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -7.9% -3.3% -4.7% +10.3% ➖ noise
2 duckdb:duckdb -6.4% -3.3% -3.2% +11.3% ➖ noise
2 duckdb:vortex-compact +4.5% -3.3% +8.1% +30.5% ➖ noise
2 duckdb:vortex-file-compressed +5.8% -3.3% +9.5% +34.8% ➖ noise
3 datafusion:vortex-compact +0.4% -6.6% +7.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -12.5% -6.6% -6.3% +10.0% ➖ noise
3 duckdb:duckdb -15.5% -6.6% -9.4% +10.0% ✅ faster
3 duckdb:vortex-compact +2.7% -6.6% +10.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +9.0% -6.6% +16.7% +10.0% 🚨 regression
4 datafusion:vortex-compact -3.6% -1.5% -2.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -14.9% -1.5% -13.6% +10.0% ✅ faster
4 duckdb:duckdb -7.5% -1.5% -6.2% +10.0% ➖ noise
4 duckdb:vortex-compact -12.1% -1.5% -10.8% +12.7% ➖ noise
4 duckdb:vortex-file-compressed -5.0% -1.5% -3.6% +10.8% ➖ noise
5 datafusion:vortex-compact -4.2% -5.3% +1.1% +15.6% ➖ noise
5 datafusion:vortex-file-compressed -19.7% -5.3% -15.3% +10.1% ✅ faster
5 duckdb:duckdb -9.7% -5.3% -4.7% +13.8% ➖ noise
5 duckdb:vortex-compact +2.7% -5.3% +8.4% +13.3% ➖ noise
5 duckdb:vortex-file-compressed -3.2% -5.3% +2.2% +11.2% ➖ noise
6 datafusion:vortex-compact +0.1% -0.2% +0.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +6.2% -0.2% +6.4% +10.0% ➖ noise
6 duckdb:duckdb -8.7% -0.2% -8.6% +10.0% ➖ noise
6 duckdb:vortex-compact +6.0% -0.2% +6.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +19.0% -0.2% +19.2% +10.0% 🚨 regression
7 datafusion:vortex-compact +0.1% -2.4% +2.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -17.1% -2.4% -15.0% +10.0% ✅ faster
7 duckdb:duckdb -11.1% -2.4% -8.9% +10.0% ➖ noise
7 duckdb:vortex-compact -15.4% -2.4% -13.3% +12.2% ✅ faster
7 duckdb:vortex-file-compressed -4.4% -2.4% -2.0% +10.0% ➖ noise
8 datafusion:vortex-compact +7.9% -1.2% +9.1% +21.4% ➖ noise
8 datafusion:vortex-file-compressed -12.7% -1.2% -11.7% +11.3% ✅ faster
8 duckdb:duckdb -2.3% -1.2% -1.1% +10.0% ➖ noise
8 duckdb:vortex-compact -8.2% -1.2% -7.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +12.5% -1.2% +13.8% +13.0% 🚨 regression
9 datafusion:vortex-compact +0.7% +8.4% -7.1% +10.5% ➖ noise
9 datafusion:vortex-file-compressed -17.7% +8.4% -24.1% +10.2% ✅ faster
9 duckdb:duckdb -5.3% +8.4% -12.7% +10.0% ✅ faster
9 duckdb:vortex-compact -5.5% +8.4% -12.9% +10.8% ✅ faster
9 duckdb:vortex-file-compressed -3.7% +8.4% -11.2% +14.5% ➖ noise
10 datafusion:vortex-compact -2.1% +0.7% -2.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -14.9% +0.7% -15.5% +10.0% ✅ faster
10 duckdb:duckdb -11.4% +0.7% -12.0% +10.0% ✅ faster
10 duckdb:vortex-compact -5.3% +0.7% -5.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +5.4% +0.7% +4.7% +10.0% ➖ noise
11 datafusion:vortex-compact -0.2% +0.9% -1.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -13.1% +0.9% -13.8% +14.8% ✅ faster
11 duckdb:duckdb -6.9% +0.9% -7.7% +10.0% ➖ noise
11 duckdb:vortex-compact -10.6% +0.9% -11.4% +10.0% ✅ faster
11 duckdb:vortex-file-compressed -1.2% +0.9% -2.0% +10.0% ➖ noise
12 datafusion:vortex-compact -4.2% +0.3% -4.5% +13.8% ➖ noise
12 datafusion:vortex-file-compressed -20.4% +0.3% -20.7% +12.2% ✅ faster
12 duckdb:duckdb -13.9% +0.3% -14.1% +10.0% ✅ faster
12 duckdb:vortex-compact -10.6% +0.3% -10.8% +16.6% ➖ noise
12 duckdb:vortex-file-compressed +6.8% +0.3% +6.5% +15.1% ➖ noise
13 datafusion:vortex-compact -21.8% -2.1% -20.1% +29.6% ➖ noise
13 datafusion:vortex-file-compressed -25.1% -2.1% -23.4% +10.0% ✅ faster
13 duckdb:duckdb -9.4% -2.1% -7.4% +10.0% ➖ noise
13 duckdb:vortex-compact -9.9% -2.1% -7.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +2.8% -2.1% +5.0% +10.0% ➖ noise
14 datafusion:vortex-compact +1.1% -1.7% +2.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -14.9% -1.7% -13.5% +10.0% ✅ faster
14 duckdb:duckdb -13.5% -1.7% -12.1% +10.6% ✅ faster
14 duckdb:vortex-compact -4.6% -1.7% -3.0% +11.1% ➖ noise
14 duckdb:vortex-file-compressed +0.7% -1.7% +2.4% +10.0% ➖ noise
15 datafusion:vortex-compact -3.0% -3.8% +0.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -13.4% -3.8% -10.0% +10.0% ✅ faster
15 duckdb:duckdb -15.6% -3.8% -12.2% +10.0% ✅ faster
15 duckdb:vortex-compact -6.9% -3.8% -3.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +6.9% -3.8% +11.1% +13.8% ➖ noise
16 datafusion:vortex-compact -2.7% -10.6% +8.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -12.9% -10.6% -2.6% +21.7% ➖ noise
16 duckdb:duckdb -11.5% -10.6% -1.1% +13.0% ➖ noise
16 duckdb:vortex-compact -4.9% -10.6% +6.3% +12.1% ➖ noise
16 duckdb:vortex-file-compressed +9.7% -10.6% +22.7% +12.2% 🚨 regression
17 datafusion:vortex-compact +2.0% -1.8% +3.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -14.9% -1.8% -13.3% +10.0% ✅ faster
17 duckdb:duckdb -13.4% -1.8% -11.8% +10.0% ✅ faster
17 duckdb:vortex-compact -7.0% -1.8% -5.2% +11.5% ➖ noise
17 duckdb:vortex-file-compressed +10.0% -1.8% +12.1% +11.7% 🚨 regression
18 datafusion:vortex-compact -1.7% -1.7% +0.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -15.0% -1.7% -13.5% +10.0% ✅ faster
18 duckdb:duckdb -11.6% -1.7% -10.0% +10.0% ✅ faster
18 duckdb:vortex-compact -10.7% -1.7% -9.1% +10.0% ✅ faster
18 duckdb:vortex-file-compressed -1.4% -1.7% +0.3% +10.0% ➖ noise
19 datafusion:vortex-compact +2.6% -2.5% +5.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -13.9% -2.5% -11.7% +10.0% ✅ faster
19 duckdb:duckdb -11.1% -2.5% -8.8% +10.0% ➖ noise
19 duckdb:vortex-compact -3.8% -2.5% -1.3% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.4% -2.5% +2.1% +12.9% ➖ noise
20 datafusion:vortex-compact +2.6% -0.6% +3.2% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -22.6% -0.6% -22.2% +12.9% ✅ faster
20 duckdb:duckdb -13.0% -0.6% -12.5% +10.0% ✅ faster
20 duckdb:vortex-compact -2.3% -0.6% -1.7% +21.6% ➖ noise
20 duckdb:vortex-file-compressed +6.7% -0.6% +7.3% +10.0% ➖ noise
21 datafusion:vortex-compact -1.4% -2.5% +1.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -15.7% -2.5% -13.5% +10.1% ✅ faster
21 duckdb:duckdb -11.6% -2.5% -9.3% +19.1% ➖ noise
21 duckdb:vortex-compact -2.3% -2.5% +0.2% +18.1% ➖ noise
21 duckdb:vortex-file-compressed +0.6% -2.5% +3.2% +10.7% ➖ noise
22 datafusion:vortex-compact +7.8% -0.2% +8.0% +21.3% ➖ noise
22 datafusion:vortex-file-compressed +12.6% -0.2% +12.7% +29.2% ➖ noise
22 duckdb:duckdb -18.4% -0.2% -18.3% +10.1% ✅ faster
22 duckdb:vortex-compact -15.4% -0.2% -15.3% +10.2% ✅ faster
22 duckdb:vortex-file-compressed -7.6% -0.2% -7.5% +11.5% ➖ noise
23 datafusion:vortex-compact -0.1% -2.2% +2.2% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -17.3% -2.2% -15.4% +10.0% ✅ faster
23 duckdb:duckdb -14.4% -2.2% -12.5% +11.4% ✅ faster
23 duckdb:vortex-compact +10.4% -2.2% +12.9% +14.2% ➖ noise
23 duckdb:vortex-file-compressed +18.5% -2.2% +21.2% +16.8% 🚨 regression
24 datafusion:vortex-compact -0.3% -0.6% +0.2% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -19.5% -0.6% -19.0% +10.0% ✅ faster
24 duckdb:duckdb -9.0% -0.6% -8.4% +10.0% ➖ noise
24 duckdb:vortex-compact -8.5% -0.6% -7.9% +10.7% ➖ noise
24 duckdb:vortex-file-compressed +2.2% -0.6% +2.7% +10.0% ➖ noise
25 datafusion:vortex-compact -4.3% -2.9% -1.4% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -11.0% -2.9% -8.4% +10.1% ➖ noise
25 duckdb:duckdb -12.4% -2.9% -9.8% +10.0% ✅ faster
25 duckdb:vortex-compact +40.2% -2.9% +44.4% +10.0% 🚨 regression
25 duckdb:vortex-file-compressed +20.9% -2.9% +24.5% +14.4% 🚨 regression
26 datafusion:vortex-compact +0.2% -0.2% +0.4% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -22.6% -0.2% -22.4% +12.9% ✅ faster
26 duckdb:duckdb -14.8% -0.2% -14.7% +10.0% ✅ faster
26 duckdb:vortex-compact -8.2% -0.2% -8.0% +12.9% ➖ noise
26 duckdb:vortex-file-compressed -5.3% -0.2% -5.1% +10.4% ➖ noise
27 datafusion:vortex-compact -0.8% -2.0% +1.2% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -21.6% -2.0% -20.0% +10.0% ✅ faster
27 duckdb:duckdb -8.3% -2.0% -6.4% +10.0% ➖ noise
27 duckdb:vortex-compact -4.1% -2.0% -2.2% +14.6% ➖ noise
27 duckdb:vortex-file-compressed -2.8% -2.0% -0.9% +10.0% ➖ noise
28 datafusion:vortex-compact -1.3% -1.3% +0.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -9.5% -1.3% -8.3% +10.0% ➖ noise
28 duckdb:duckdb -1.1% -1.3% +0.2% +10.0% ➖ noise
28 duckdb:vortex-compact -1.6% -1.3% -0.2% +22.7% ➖ noise
28 duckdb:vortex-file-compressed +5.2% -1.3% +6.6% +10.0% ➖ noise
29 datafusion:vortex-compact -2.0% -0.3% -1.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -12.9% -0.3% -12.6% +15.6% ➖ noise
29 duckdb:duckdb -7.1% -0.3% -6.8% +10.0% ➖ noise
29 duckdb:vortex-compact -5.2% -0.3% -4.9% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +10.5% -0.3% +10.8% +10.0% 🚨 regression
30 datafusion:vortex-compact -4.4% -1.7% -2.8% +13.6% ➖ noise
30 datafusion:vortex-file-compressed -8.5% -1.7% -7.0% +10.0% ➖ noise
30 duckdb:duckdb -10.2% -1.7% -8.7% +16.6% ➖ noise
30 duckdb:vortex-compact +2.8% -1.7% +4.5% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -1.2% -1.7% +0.5% +10.0% ➖ noise
31 datafusion:vortex-compact +1.0% -1.8% +2.8% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -2.4% -1.8% -0.7% +10.0% ➖ noise
31 duckdb:duckdb -16.8% -1.8% -15.4% +10.0% ✅ faster
31 duckdb:vortex-compact -14.8% -1.8% -13.3% +14.3% ✅ faster
31 duckdb:vortex-file-compressed -1.7% -1.8% +0.1% +10.0% ➖ noise
32 datafusion:vortex-compact +2.9% -0.4% +3.3% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +9.8% -0.4% +10.3% +25.4% ➖ noise
32 duckdb:duckdb -16.3% -0.4% -16.0% +10.0% ✅ faster
32 duckdb:vortex-compact -2.3% -0.4% -1.9% +18.4% ➖ noise
32 duckdb:vortex-file-compressed +15.1% -0.4% +15.5% +10.0% 🚨 regression
33 datafusion:vortex-compact -0.2% -1.3% +1.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -2.4% -1.3% -1.1% +12.8% ➖ noise
33 duckdb:duckdb -5.9% -1.3% -4.7% +10.0% ➖ noise
33 duckdb:vortex-compact +0.7% -1.3% +2.0% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +4.1% -1.3% +5.5% +10.0% ➖ noise
34 datafusion:vortex-compact -1.3% +0.9% -2.2% +15.0% ➖ noise
34 datafusion:vortex-file-compressed -4.2% +0.9% -5.0% +11.0% ➖ noise
34 duckdb:duckdb -2.6% +0.9% -3.5% +10.0% ➖ noise
34 duckdb:vortex-compact -0.4% +0.9% -1.3% +11.6% ➖ noise
34 duckdb:vortex-file-compressed +7.5% +0.9% +6.5% +12.3% ➖ noise
35 datafusion:vortex-compact -0.8% -1.0% +0.2% +11.9% ➖ noise
35 datafusion:vortex-file-compressed -4.9% -1.0% -4.0% +10.0% ➖ noise
35 duckdb:duckdb -14.8% -1.0% -13.9% +10.0% ✅ faster
35 duckdb:vortex-compact -4.8% -1.0% -3.9% +10.8% ➖ noise
35 duckdb:vortex-file-compressed +2.0% -1.0% +3.0% +10.0% ➖ noise
36 datafusion:vortex-compact -1.7% -3.1% +1.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -9.0% -3.1% -6.1% +10.0% ➖ noise
36 duckdb:duckdb -14.6% -3.1% -11.9% +10.0% ✅ faster
36 duckdb:vortex-compact -3.4% -3.1% -0.3% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -2.5% -3.1% +0.6% +10.0% ➖ noise
37 datafusion:vortex-compact -2.5% -4.3% +1.9% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -21.4% -4.3% -17.8% +12.4% ✅ faster
37 duckdb:duckdb -16.6% -4.3% -12.8% +10.0% ✅ faster
37 duckdb:vortex-compact -3.7% -4.3% +0.6% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +8.4% -4.3% +13.2% +10.0% 🚨 regression
38 datafusion:vortex-compact -1.8% -3.2% +1.4% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -14.2% -3.2% -11.3% +16.4% ➖ noise
38 duckdb:duckdb -11.4% -3.2% -8.5% +14.9% ➖ noise
38 duckdb:vortex-compact -15.4% -3.2% -12.6% +12.3% ✅ faster
38 duckdb:vortex-file-compressed +6.9% -3.2% +10.5% +12.4% ➖ noise
39 datafusion:vortex-compact -1.0% -5.8% +5.1% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -12.2% -5.8% -6.7% +10.8% ➖ noise
39 duckdb:duckdb -9.0% -5.8% -3.3% +11.1% ➖ noise
39 duckdb:vortex-compact +2.0% -5.8% +8.3% +13.6% ➖ noise
39 duckdb:vortex-file-compressed +0.0% -5.8% +6.2% +10.0% ➖ noise
40 datafusion:vortex-compact +1.3% -2.2% +3.7% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -13.8% -2.2% -11.8% +10.0% ✅ faster
40 duckdb:duckdb -17.9% -2.2% -16.0% +10.0% ✅ faster
40 duckdb:vortex-compact -11.2% -2.2% -9.2% +14.2% ➖ noise
40 duckdb:vortex-file-compressed +6.7% -2.2% +9.2% +10.0% ➖ noise
41 datafusion:vortex-compact -6.3% -2.2% -4.2% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -15.8% -2.2% -13.9% +15.8% ✅ faster
41 duckdb:duckdb -21.7% -2.2% -19.9% +11.4% ✅ faster
41 duckdb:vortex-compact -6.1% -2.2% -4.1% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +7.8% -2.2% +10.2% +10.0% 🚨 regression
42 datafusion:vortex-compact -0.5% -4.8% +4.5% +15.3% ➖ noise
42 datafusion:vortex-file-compressed -21.6% -4.8% -17.7% +10.2% ✅ faster
42 duckdb:duckdb -5.9% -4.8% -1.2% +20.8% ➖ noise
42 duckdb:vortex-compact -1.7% -4.8% +3.2% +10.4% ➖ noise
42 duckdb:vortex-file-compressed +2.1% -4.8% +7.2% +10.0% ➖ noise
43 datafusion:vortex-compact +6.5% -2.3% +9.0% +13.9% ➖ noise
43 datafusion:vortex-file-compressed -8.5% -2.3% -6.3% +13.6% ➖ noise
43 duckdb:duckdb -5.0% -2.3% -2.7% +13.1% ➖ noise
43 duckdb:vortex-compact +0.3% -2.3% +2.6% +12.4% ➖ noise
43 duckdb:vortex-file-compressed +7.4% -2.3% +9.9% +18.7% ➖ noise
44 datafusion:vortex-compact -1.8% -1.5% -0.2% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -10.3% -1.5% -8.9% +11.5% ➖ noise
44 duckdb:duckdb -17.3% -1.5% -16.1% +10.5% ✅ faster
44 duckdb:vortex-compact +8.3% -1.5% +10.0% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +2.8% -1.5% +4.4% +10.0% ➖ noise
45 datafusion:vortex-compact -3.1% +1.2% -4.2% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -14.2% +1.2% -15.2% +10.0% ✅ faster
45 duckdb:duckdb -13.5% +1.2% -14.5% +10.0% ✅ faster
45 duckdb:vortex-compact -10.6% +1.2% -11.6% +10.0% ✅ faster
45 duckdb:vortex-file-compressed +6.4% +1.2% +5.2% +10.0% ➖ noise
46 datafusion:vortex-compact -1.9% -1.5% -0.4% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -13.1% -1.5% -11.8% +10.0% ✅ faster
46 duckdb:duckdb -12.4% -1.5% -11.1% +10.0% ✅ faster
46 duckdb:vortex-compact -10.0% -1.5% -8.7% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +11.1% -1.5% +12.7% +10.0% 🚨 regression
47 datafusion:vortex-compact -0.5% +0.0% -0.5% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -13.4% +0.0% -13.5% +10.0% ✅ faster
47 duckdb:duckdb -16.0% +0.0% -16.1% +10.0% ✅ faster
47 duckdb:vortex-compact -7.4% +0.0% -7.4% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +1.6% +0.0% +1.6% +10.7% ➖ noise
48 datafusion:vortex-compact -5.3% -1.1% -4.2% +12.2% ➖ noise
48 datafusion:vortex-file-compressed -13.9% -1.1% -12.9% +10.0% ✅ faster
48 duckdb:duckdb -3.1% -1.1% -2.0% +10.0% ➖ noise
48 duckdb:vortex-compact -5.9% -1.1% -4.8% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +1.2% -1.1% +2.4% +12.3% ➖ noise
49 datafusion:vortex-compact -0.6% +0.0% -0.6% +11.3% ➖ noise
49 datafusion:vortex-file-compressed -15.2% +0.0% -15.3% +12.7% ✅ faster
49 duckdb:duckdb +0.2% +0.0% +0.2% +10.0% ➖ noise
49 duckdb:vortex-compact -6.2% +0.0% -6.2% +10.0% ➖ noise
49 duckdb:vortex-file-compressed -3.5% +0.0% -3.5% +11.7% ➖ noise
50 datafusion:vortex-compact +0.9% -1.8% +2.8% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -15.2% -1.8% -13.6% +10.0% ✅ faster
50 duckdb:duckdb -9.8% -1.8% -8.1% +10.0% ➖ noise
50 duckdb:vortex-compact -2.9% -1.8% -1.1% +19.0% ➖ noise
50 duckdb:vortex-file-compressed +21.1% -1.8% +23.3% +15.4% 🚨 regression
51 datafusion:vortex-compact -2.5% +0.9% -3.3% +10.8% ➖ noise
51 datafusion:vortex-file-compressed -10.6% +0.9% -11.4% +12.2% ✅ faster
51 duckdb:duckdb -11.7% +0.9% -12.4% +10.2% ✅ faster
51 duckdb:vortex-compact -15.0% +0.9% -15.7% +22.4% ➖ noise
51 duckdb:vortex-file-compressed -1.0% +0.9% -1.8% +14.8% ➖ noise
52 datafusion:vortex-compact -1.4% -9.6% +9.0% +12.2% ➖ noise
52 datafusion:vortex-file-compressed -14.6% -9.6% -5.5% +12.2% ➖ noise
52 duckdb:duckdb -0.3% -9.6% +10.3% +10.0% 🚨 regression
52 duckdb:vortex-compact -7.7% -9.6% +2.1% +27.0% ➖ noise
52 duckdb:vortex-file-compressed +3.0% -9.6% +14.0% +10.0% 🚨 regression
53 datafusion:vortex-compact +1.6% -1.4% +3.1% +10.3% ➖ noise
53 datafusion:vortex-file-compressed -12.0% -1.4% -10.7% +17.6% ➖ noise
53 duckdb:duckdb -14.0% -1.4% -12.7% +10.0% ✅ faster
53 duckdb:vortex-compact -5.9% -1.4% -4.5% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +3.8% -1.4% +5.3% +10.0% ➖ noise
54 datafusion:vortex-compact -0.8% -1.7% +0.9% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -13.2% -1.7% -11.7% +10.0% ✅ faster
54 duckdb:duckdb -11.1% -1.7% -9.5% +10.0% ✅ faster
54 duckdb:vortex-compact +1.3% -1.7% +3.1% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +12.8% -1.7% +14.7% +10.0% 🚨 regression
55 datafusion:vortex-compact +1.2% +0.9% +0.3% +10.0% ➖ noise
55 datafusion:vortex-file-compressed -17.5% +0.9% -18.2% +12.4% ✅ faster
55 duckdb:duckdb -5.5% +0.9% -6.4% +15.7% ➖ noise
55 duckdb:vortex-compact -2.7% +0.9% -3.6% +10.0% ➖ noise
55 duckdb:vortex-file-compressed +5.7% +0.9% +4.7% +10.0% ➖ noise
56 datafusion:vortex-compact -1.5% -4.2% +2.8% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -14.9% -4.2% -11.1% +20.6% ➖ noise
56 duckdb:duckdb -5.7% -4.2% -1.6% +10.0% ➖ noise
56 duckdb:vortex-compact -9.8% -4.2% -5.8% +16.1% ➖ noise
56 duckdb:vortex-file-compressed +3.6% -4.2% +8.2% +10.1% ➖ noise
57 datafusion:vortex-compact +0.8% -0.7% +1.5% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -10.7% -0.7% -10.1% +10.0% ✅ faster
57 duckdb:duckdb -11.2% -0.7% -10.6% +10.0% ✅ faster
57 duckdb:vortex-compact -2.6% -0.7% -2.0% +10.0% ➖ noise
57 duckdb:vortex-file-compressed +1.8% -0.7% +2.4% +10.0% ➖ noise
58 datafusion:vortex-compact -0.5% +0.2% -0.7% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -16.9% +0.2% -17.1% +10.0% ✅ faster
58 duckdb:duckdb -9.9% +0.2% -10.0% +11.2% ➖ noise
58 duckdb:vortex-compact -7.0% +0.2% -7.1% +14.7% ➖ noise
58 duckdb:vortex-file-compressed +2.9% +0.2% +2.7% +10.0% ➖ noise
59 datafusion:vortex-compact -3.5% -0.6% -2.9% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -9.3% -0.6% -8.8% +10.0% ➖ noise
59 duckdb:duckdb -7.0% -0.6% -6.4% +10.0% ➖ noise
59 duckdb:vortex-compact +24.4% -0.6% +25.1% +25.7% ➖ noise
59 duckdb:vortex-file-compressed +19.9% -0.6% +20.6% +10.0% 🚨 regression
60 datafusion:vortex-compact +0.7% -2.3% +3.1% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -13.1% -2.3% -11.0% +10.0% ✅ faster
60 duckdb:duckdb -5.0% -2.3% -2.7% +10.0% ➖ noise
60 duckdb:vortex-compact -9.0% -2.3% -6.9% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +3.1% -2.3% +5.6% +10.0% ➖ noise
61 datafusion:vortex-compact -0.3% -3.5% +3.3% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -15.1% -3.5% -12.1% +10.0% ✅ faster
61 duckdb:duckdb -13.1% -3.5% -10.0% +10.0% ✅ faster
61 duckdb:vortex-compact -6.9% -3.5% -3.5% +11.9% ➖ noise
61 duckdb:vortex-file-compressed +1.5% -3.5% +5.1% +10.0% ➖ noise
62 datafusion:vortex-compact +22.2% -1.8% +24.4% +28.9% ➖ noise
62 datafusion:vortex-file-compressed -10.3% -1.8% -8.6% +18.8% ➖ noise
62 duckdb:duckdb -14.6% -1.8% -13.1% +12.4% ✅ faster
62 duckdb:vortex-compact -2.0% -1.8% -0.2% +21.0% ➖ noise
62 duckdb:vortex-file-compressed +12.0% -1.8% +14.1% +19.7% ➖ noise
63 datafusion:vortex-compact -2.4% -4.6% +2.3% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -15.4% -4.6% -11.3% +10.0% ✅ faster
63 duckdb:duckdb -11.9% -4.6% -7.6% +10.0% ➖ noise
63 duckdb:vortex-compact -2.7% -4.6% +2.0% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +10.4% -4.6% +15.7% +10.0% 🚨 regression
64 datafusion:vortex-compact -0.5% -6.3% +6.3% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -19.0% -6.3% -13.5% +10.0% ✅ faster
64 duckdb:duckdb -11.6% -6.3% -5.6% +10.0% ➖ noise
64 duckdb:vortex-compact -7.4% -6.3% -1.1% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +7.1% -6.3% +14.3% +10.0% 🚨 regression
65 datafusion:vortex-compact -0.3% -2.0% +1.7% +14.4% ➖ noise
65 datafusion:vortex-file-compressed -18.6% -2.0% -17.0% +11.8% ✅ faster
65 duckdb:duckdb -10.3% -2.0% -8.5% +10.0% ➖ noise
65 duckdb:vortex-compact -3.4% -2.0% -1.4% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +4.5% -2.0% +6.7% +18.0% ➖ noise
66 datafusion:vortex-compact -1.4% +2.6% -3.8% +10.0% ➖ noise
66 datafusion:vortex-file-compressed -12.2% +2.6% -14.4% +14.2% ✅ faster
66 duckdb:duckdb -12.3% +2.6% -14.5% +10.0% ✅ faster
66 duckdb:vortex-compact +2.1% +2.6% -0.5% +10.0% ➖ noise
66 duckdb:vortex-file-compressed +1.0% +2.6% -1.5% +10.8% ➖ noise
67 datafusion:vortex-compact -0.5% +0.8% -1.3% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -18.0% +0.8% -18.6% +10.0% ✅ faster
67 duckdb:duckdb -13.9% +0.8% -14.6% +10.0% ✅ faster
67 duckdb:vortex-compact -18.9% +0.8% -19.5% +10.0% ✅ faster
67 duckdb:vortex-file-compressed -2.5% +0.8% -3.3% +10.0% ➖ noise
68 datafusion:vortex-compact +2.1% -1.1% +3.3% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -12.8% -1.1% -11.9% +22.6% ➖ noise
68 duckdb:duckdb -9.3% -1.1% -8.3% +10.1% ➖ noise
68 duckdb:vortex-compact -11.2% -1.1% -10.3% +10.0% ✅ faster
68 duckdb:vortex-file-compressed +4.6% -1.1% +5.8% +14.1% ➖ noise
69 datafusion:vortex-compact +0.3% -2.0% +2.3% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -14.3% -2.0% -12.5% +10.0% ✅ faster
69 duckdb:duckdb -4.5% -2.0% -2.5% +10.0% ➖ noise
69 duckdb:vortex-compact -2.8% -2.0% -0.8% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +6.3% -2.0% +8.4% +10.7% ➖ noise
70 datafusion:vortex-compact +2.7% -1.8% +4.6% +11.2% ➖ noise
70 datafusion:vortex-file-compressed -15.5% -1.8% -13.9% +10.0% ✅ faster
70 duckdb:duckdb -10.6% -1.8% -8.9% +10.0% ➖ noise
70 duckdb:vortex-compact -5.9% -1.8% -4.2% +13.4% ➖ noise
70 duckdb:vortex-file-compressed +6.9% -1.8% +8.8% +10.0% ➖ noise
71 datafusion:vortex-compact +3.5% -3.6% +7.4% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -12.8% -3.6% -9.5% +10.0% ✅ faster
71 duckdb:duckdb -5.4% -3.6% -1.8% +10.0% ➖ noise
71 duckdb:vortex-compact -7.9% -3.6% -4.4% +10.5% ➖ noise
71 duckdb:vortex-file-compressed +5.1% -3.6% +9.1% +22.1% ➖ noise
72 datafusion:vortex-compact -0.8% -1.6% +0.8% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -21.0% -1.6% -19.8% +11.5% ✅ faster
72 duckdb:duckdb -9.2% -1.6% -7.8% +10.0% ➖ noise
72 duckdb:vortex-compact -5.6% -1.6% -4.1% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.2% -1.6% +1.8% +10.0% ➖ noise
73 datafusion:vortex-compact +0.2% -4.5% +5.0% +10.0% ➖ noise
73 datafusion:vortex-file-compressed -17.9% -4.5% -14.0% +10.0% ✅ faster
73 duckdb:duckdb -6.8% -4.5% -2.3% +12.6% ➖ noise
73 duckdb:vortex-compact -12.4% -4.5% -8.2% +14.8% ➖ noise
73 duckdb:vortex-file-compressed +12.2% -4.5% +17.6% +12.6% 🚨 regression
74 datafusion:vortex-compact -0.8% -2.4% +1.6% +10.8% ➖ noise
74 datafusion:vortex-file-compressed -9.4% -2.4% -7.2% +10.0% ➖ noise
74 duckdb:duckdb -8.6% -2.4% -6.4% +10.0% ➖ noise
74 duckdb:vortex-compact -11.8% -2.4% -9.7% +10.0% ✅ faster
74 duckdb:vortex-file-compressed +3.7% -2.4% +6.3% +10.0% ➖ noise
75 datafusion:vortex-compact +3.6% -1.4% +5.1% +13.6% ➖ noise
75 datafusion:vortex-file-compressed -1.1% -1.4% +0.3% +13.1% ➖ noise
75 duckdb:duckdb -7.2% -1.4% -5.9% +10.0% ➖ noise
75 duckdb:vortex-compact -18.3% -1.4% -17.2% +10.0% ✅ faster
75 duckdb:vortex-file-compressed +7.9% -1.4% +9.4% +10.0% ➖ noise
76 datafusion:vortex-compact -0.8% -3.3% +2.6% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -25.6% -3.3% -23.1% +16.1% ✅ faster
76 duckdb:duckdb -10.5% -3.3% -7.5% +11.6% ➖ noise
76 duckdb:vortex-compact +3.5% -3.3% +7.0% +13.3% ➖ noise
76 duckdb:vortex-file-compressed +8.0% -3.3% +11.7% +10.5% 🚨 regression
77 datafusion:vortex-compact +0.8% +1.5% -0.7% +16.7% ➖ noise
77 datafusion:vortex-file-compressed -2.0% +1.5% -3.5% +10.0% ➖ noise
77 duckdb:duckdb -6.5% +1.5% -7.9% +10.0% ➖ noise
77 duckdb:vortex-compact -7.5% +1.5% -8.8% +12.3% ➖ noise
77 duckdb:vortex-file-compressed -0.3% +1.5% -1.7% +14.7% ➖ noise
78 datafusion:vortex-compact +1.1% -2.9% +4.1% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +0.4% -2.9% +3.3% +10.0% ➖ noise
78 duckdb:duckdb -6.5% -2.9% -3.7% +10.0% ➖ noise
78 duckdb:vortex-compact -13.7% -2.9% -11.1% +10.4% ✅ faster
78 duckdb:vortex-file-compressed -1.0% -2.9% +1.9% +10.0% ➖ noise
79 datafusion:vortex-compact -2.8% -1.0% -1.8% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +4.4% -1.0% +5.4% +10.0% ➖ noise
79 duckdb:duckdb -8.8% -1.0% -7.9% +10.0% ➖ noise
79 duckdb:vortex-compact -10.2% -1.0% -9.3% +12.1% ➖ noise
79 duckdb:vortex-file-compressed +9.5% -1.0% +10.6% +17.7% ➖ noise
80 datafusion:vortex-compact -0.8% -1.0% +0.2% +10.4% ➖ noise
80 datafusion:vortex-file-compressed -3.2% -1.0% -2.2% +10.0% ➖ noise
80 duckdb:duckdb -16.3% -1.0% -15.4% +10.5% ✅ faster
80 duckdb:vortex-compact -14.2% -1.0% -13.4% +10.2% ✅ faster
80 duckdb:vortex-file-compressed +4.5% -1.0% +5.5% +10.0% ➖ noise
81 datafusion:vortex-compact -1.0% +2.2% -3.1% +10.0% ➖ noise
81 datafusion:vortex-file-compressed +15.6% +2.2% +13.2% +19.8% ➖ noise
81 duckdb:duckdb -7.1% +2.2% -9.1% +10.0% ✅ faster
81 duckdb:vortex-compact -9.9% +2.2% -11.8% +10.4% ✅ faster
81 duckdb:vortex-file-compressed +13.6% +2.2% +11.2% +18.0% ➖ noise
82 datafusion:vortex-compact -5.7% -2.9% -2.9% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +3.5% -2.9% +6.6% +11.8% ➖ noise
82 duckdb:duckdb -14.2% -2.9% -11.6% +12.1% ✅ faster
82 duckdb:vortex-compact -4.9% -2.9% -2.1% +13.6% ➖ noise
82 duckdb:vortex-file-compressed +0.3% -2.9% +3.3% +11.9% ➖ noise
83 datafusion:vortex-compact -4.3% -2.9% -1.5% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +0.4% -2.9% +3.4% +10.0% ➖ noise
83 duckdb:duckdb -11.8% -2.9% -9.2% +10.0% ✅ faster
83 duckdb:vortex-compact +1.9% -2.9% +4.9% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +14.0% -2.9% +17.4% +10.2% 🚨 regression
84 datafusion:vortex-compact -0.3% -1.7% +1.4% +25.4% ➖ noise
84 datafusion:vortex-file-compressed -1.0% -1.7% +0.7% +10.0% ➖ noise
84 duckdb:duckdb -11.3% -1.7% -9.7% +10.0% ✅ faster
84 duckdb:vortex-compact +11.1% -1.7% +13.1% +11.6% 🚨 regression
84 duckdb:vortex-file-compressed +38.3% -1.7% +40.8% +10.0% 🚨 regression
85 datafusion:vortex-compact -1.9% +0.8% -2.7% +12.4% ➖ noise
85 datafusion:vortex-file-compressed -0.1% +0.8% -0.9% +10.0% ➖ noise
85 duckdb:duckdb -13.2% +0.8% -13.9% +11.4% ✅ faster
85 duckdb:vortex-compact +3.3% +0.8% +2.5% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +17.7% +0.8% +16.7% +10.0% 🚨 regression
86 datafusion:vortex-compact -9.1% -0.4% -8.7% +20.9% ➖ noise
86 datafusion:vortex-file-compressed -5.2% -0.4% -4.8% +21.7% ➖ noise
86 duckdb:duckdb -10.8% -0.4% -10.4% +10.0% ✅ faster
86 duckdb:vortex-compact -11.9% -0.4% -11.5% +10.0% ✅ faster
86 duckdb:vortex-file-compressed -4.2% -0.4% -3.7% +10.0% ➖ noise
87 datafusion:vortex-compact -4.2% -1.0% -3.3% +13.5% ➖ noise
87 datafusion:vortex-file-compressed -2.7% -1.0% -1.7% +12.5% ➖ noise
87 duckdb:duckdb -11.8% -1.0% -11.0% +10.5% ✅ faster
87 duckdb:vortex-compact -10.4% -1.0% -9.6% +14.0% ➖ noise
87 duckdb:vortex-file-compressed -0.9% -1.0% +0.0% +10.0% ➖ noise
88 datafusion:vortex-compact -1.0% -0.7% -0.2% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -1.4% -0.7% -0.7% +10.0% ➖ noise
88 duckdb:duckdb -2.2% -0.7% -1.4% +10.0% ➖ noise
88 duckdb:vortex-compact -5.8% -0.7% -5.0% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +5.6% -0.7% +6.4% +10.0% ➖ noise
89 datafusion:vortex-compact -1.9% -2.8% +1.0% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -1.4% -2.8% +1.5% +10.0% ➖ noise
89 duckdb:duckdb -12.5% -2.8% -10.0% +11.0% ✅ faster
89 duckdb:vortex-compact -3.6% -2.8% -0.8% +16.9% ➖ noise
89 duckdb:vortex-file-compressed -0.3% -2.8% +2.6% +15.0% ➖ noise
90 datafusion:vortex-compact -0.8% -1.0% +0.2% +13.0% ➖ noise
90 datafusion:vortex-file-compressed -1.4% -1.0% -0.4% +10.0% ➖ noise
90 duckdb:duckdb -14.9% -1.0% -14.0% +10.0% ✅ faster
90 duckdb:vortex-compact -0.5% -1.0% +0.5% +12.3% ➖ noise
90 duckdb:vortex-file-compressed +17.8% -1.0% +19.0% +10.0% 🚨 regression
91 datafusion:vortex-compact -6.2% -0.9% -5.3% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -0.6% -0.9% +0.3% +10.0% ➖ noise
91 duckdb:duckdb -14.4% -0.9% -13.7% +10.0% ✅ faster
91 duckdb:vortex-compact -1.2% -0.9% -0.3% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +21.0% -0.9% +22.1% +18.8% 🚨 regression
92 datafusion:vortex-compact +10.1% -4.3% +15.0% +15.4% ➖ noise
92 datafusion:vortex-file-compressed -3.3% -4.3% +1.0% +13.8% ➖ noise
92 duckdb:duckdb -12.4% -4.3% -8.5% +10.0% ➖ noise
92 duckdb:vortex-compact +3.7% -4.3% +8.3% +15.2% ➖ noise
92 duckdb:vortex-file-compressed +17.3% -4.3% +22.5% +15.5% 🚨 regression
93 datafusion:vortex-compact -0.7% -0.7% -0.0% +10.3% ➖ noise
93 datafusion:vortex-file-compressed +2.3% -0.7% +3.1% +11.0% ➖ noise
93 duckdb:duckdb -15.8% -0.7% -15.2% +10.0% ✅ faster
93 duckdb:vortex-compact -14.3% -0.7% -13.7% +13.1% ✅ faster
93 duckdb:vortex-file-compressed +3.2% -0.7% +4.0% +10.0% ➖ noise
94 datafusion:vortex-compact -1.2% +2.8% -3.9% +12.1% ➖ noise
94 datafusion:vortex-file-compressed -1.1% +2.8% -3.8% +16.2% ➖ noise
94 duckdb:duckdb -12.8% +2.8% -15.2% +10.5% ✅ faster
94 duckdb:vortex-compact +1.2% +2.8% -1.6% +11.3% ➖ noise
94 duckdb:vortex-file-compressed +17.9% +2.8% +14.7% +17.5% ➖ noise
95 datafusion:vortex-compact +3.2% +6.8% -3.4% +10.0% ➖ noise
95 datafusion:vortex-file-compressed -4.0% +6.8% -10.1% +10.0% ✅ faster
95 duckdb:duckdb -21.2% +6.8% -26.3% +17.1% ✅ faster
95 duckdb:vortex-compact -21.7% +6.8% -26.7% +17.0% ✅ faster
95 duckdb:vortex-file-compressed -6.0% +6.8% -12.0% +17.6% ➖ noise
96 datafusion:vortex-compact +0.1% +2.0% -1.8% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +1.5% +2.0% -0.5% +10.2% ➖ noise
96 duckdb:duckdb -13.8% +2.0% -15.5% +10.7% ✅ faster
96 duckdb:vortex-compact -1.1% +2.0% -3.1% +10.0% ➖ noise
96 duckdb:vortex-file-compressed +3.6% +2.0% +1.6% +14.5% ➖ noise
97 datafusion:vortex-compact -3.3% -2.4% -0.9% +10.2% ➖ noise
97 datafusion:vortex-file-compressed +0.6% -2.4% +3.1% +10.0% ➖ noise
97 duckdb:duckdb -12.6% -2.4% -10.4% +10.0% ✅ faster
97 duckdb:vortex-compact -10.0% -2.4% -7.8% +10.4% ➖ noise
97 duckdb:vortex-file-compressed +1.0% -2.4% +3.5% +10.0% ➖ noise
98 datafusion:vortex-compact +0.6% -10.0% +11.8% +10.7% 🚨 regression
98 datafusion:vortex-file-compressed -0.0% -10.0% +11.1% +10.0% 🚨 regression
98 duckdb:duckdb -11.5% -10.0% -1.7% +12.2% ➖ noise
98 duckdb:vortex-compact -12.9% -10.0% -3.1% +11.4% ➖ noise
98 duckdb:vortex-file-compressed +7.9% -10.0% +20.0% +15.2% 🚨 regression
99 datafusion:vortex-compact -5.0% -11.4% +7.2% +27.3% ➖ noise
99 datafusion:vortex-file-compressed +11.8% -11.4% +26.1% +25.8% 🚨 regression
99 duckdb:duckdb -7.8% -11.4% +4.1% +16.8% ➖ noise
99 duckdb:vortex-compact -3.5% -11.4% +8.8% +21.2% ➖ noise
99 duckdb:vortex-file-compressed +17.5% -11.4% +32.6% +16.6% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026 •
edited
Loading

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.9%

datafusion / vortex-file-compressed (0.999x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1667074 1671050 1.00
clickbench_q01/datafusion:vortex-file-compressed 19490623 18946571 1.03
clickbench_q02/datafusion:vortex-file-compressed 38940236 40103195 0.97
clickbench_q03/datafusion:vortex-file-compressed 43754410 41754671 1.05
clickbench_q04/datafusion:vortex-file-compressed 280016635 288044938 0.97
clickbench_q05/datafusion:vortex-file-compressed 301385712 304201621 0.99
clickbench_q06/datafusion:vortex-file-compressed 1638603 1637743 1.00
clickbench_q07/datafusion:vortex-file-compressed 22064324 22299675 0.99
clickbench_q08/datafusion:vortex-file-compressed 349815604 364010132 0.96
clickbench_q09/datafusion:vortex-file-compressed 536503595 560303115 0.96
clickbench_q10/datafusion:vortex-file-compressed 76029300 73818101 1.03
clickbench_q11/datafusion:vortex-file-compressed 85206583 86440834 0.99
clickbench_q12/datafusion:vortex-file-compressed 266155112 274317103 0.97
clickbench_q13/datafusion:vortex-file-compressed 413641326 416105386 0.99
clickbench_q14/datafusion:vortex-file-compressed 252151415 256501162 0.98
clickbench_q15/datafusion:vortex-file-compressed 325222962 328291381 0.99
clickbench_q16/datafusion:vortex-file-compressed 639030719 648038103 0.99
clickbench_q17/datafusion:vortex-file-compressed 631348374 647890248 0.97
clickbench_q18/datafusion:vortex-file-compressed 1283110366 1306638859 0.98
clickbench_q19/datafusion:vortex-file-compressed 33246609 30526697 1.09
clickbench_q20/datafusion:vortex-file-compressed 346213867 347992471 0.99
clickbench_q21/datafusion:vortex-file-compressed 368836171 371274989 0.99
clickbench_q22/datafusion:vortex-file-compressed 445243669 444368296 1.00
clickbench_q23/datafusion:vortex-file-compressed 633916044 612615580 1.03
clickbench_q24/datafusion:vortex-file-compressed 45381942 44001102 1.03
clickbench_q25/datafusion:vortex-file-compressed 72882006 70347584 1.04
clickbench_q26/datafusion:vortex-file-compressed 42738135 45173034 0.95
clickbench_q27/datafusion:vortex-file-compressed 742171155 721286921 1.03
clickbench_q28/datafusion:vortex-file-compressed 6577528286 6474720599 1.02
clickbench_q29/datafusion:vortex-file-compressed 237104368 238806065 0.99
clickbench_q30/datafusion:vortex-file-compressed 220368272 219909075 1.00
clickbench_q31/datafusion:vortex-file-compressed 254275368 254554900 1.00
clickbench_q32/datafusion:vortex-file-compressed 1105263187 1085011268 1.02
clickbench_q33/datafusion:vortex-file-compressed 1306348457 1300513442 1.00
clickbench_q34/datafusion:vortex-file-compressed 1289372881 1287736886 1.00
clickbench_q35/datafusion:vortex-file-compressed 452510217 446539377 1.01
clickbench_q36/datafusion:vortex-file-compressed 69106700 68794584 1.00
clickbench_q37/datafusion:vortex-file-compressed 34427092 34534478 1.00
clickbench_q38/datafusion:vortex-file-compressed 18206572 18362243 0.99
clickbench_q39/datafusion:vortex-file-compressed 126424517 127962196 0.99
clickbench_q40/datafusion:vortex-file-compressed 15476616 15415357 1.00
clickbench_q41/datafusion:vortex-file-compressed 14390430 14384760 1.00
clickbench_q42/datafusion:vortex-file-compressed 16456749 16933193 0.97
datafusion / parquet (0.992x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1518038 1515741 1.00
clickbench_q01/datafusion:parquet 19260852 19892036 0.97
clickbench_q02/datafusion:parquet 47918637 49110828 0.98
clickbench_q03/datafusion:parquet 36655620 38190247 0.96
clickbench_q04/datafusion:parquet 291977724 296680483 0.98
clickbench_q05/datafusion:parquet 346622291 337453839 1.03
clickbench_q06/datafusion:parquet 1571860 1554285 1.01
clickbench_q07/datafusion:parquet 22443990 22059591 1.02
clickbench_q08/datafusion:parquet 365787171 368632112 0.99
clickbench_q09/datafusion:parquet 607627754 610803983 0.99
clickbench_q10/datafusion:parquet 103330047 103287794 1.00
clickbench_q11/datafusion:parquet 127901449 129222099 0.99
clickbench_q12/datafusion:parquet 335495654 335486739 1.00
clickbench_q13/datafusion:parquet 474920501 489700757 0.97
clickbench_q14/datafusion:parquet 336908453 340955448 0.99
clickbench_q15/datafusion:parquet 336228886 337265871 1.00
clickbench_q16/datafusion:parquet 664378615 663341982 1.00
clickbench_q17/datafusion:parquet 642255194 631218693 1.02
clickbench_q18/datafusion:parquet 1355169276 1304103867 1.04
clickbench_q19/datafusion:parquet 29129663 29001381 1.00
clickbench_q20/datafusion:parquet 597511738 589308210 1.01
clickbench_q21/datafusion:parquet 663258085 649779217 1.02
clickbench_q22/datafusion:parquet 952810746 977986658 0.97
clickbench_q23/datafusion:parquet 3630640959 3616127379 1.00
clickbench_q24/datafusion:parquet 81590412 82683072 0.99
clickbench_q25/datafusion:parquet 131683878 131626414 1.00
clickbench_q26/datafusion:parquet 80180955 83093567 0.96
clickbench_q27/datafusion:parquet 1046527619 1057382217 0.99
clickbench_q28/datafusion:parquet 6495669935 6614210920 0.98
clickbench_q29/datafusion:parquet 229781357 235844463 0.97
clickbench_q30/datafusion:parquet 314769207 322697922 0.98
clickbench_q31/datafusion:parquet 358901824 360439977 1.00
clickbench_q32/datafusion:parquet 1212623859 1212343825 1.00
clickbench_q33/datafusion:parquet 1454132667 1481690434 0.98
clickbench_q34/datafusion:parquet 1480406475 1483481772 1.00
clickbench_q35/datafusion:parquet 450591109 468769122 0.96
clickbench_q36/datafusion:parquet 137969409 138519519 1.00
clickbench_q37/datafusion:parquet 56448953 57118903 0.99
clickbench_q38/datafusion:parquet 82851995 83111836 1.00
clickbench_q39/datafusion:parquet 255787703 257905801 0.99
clickbench_q40/datafusion:parquet 29628068 30145347 0.98
clickbench_q41/datafusion:parquet 27589558 29109085 0.95
clickbench_q42/datafusion:parquet 29703692 29725298 1.00
duckdb / vortex-file-compressed (0.990x ➖, 1↑ 3↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6418503 6284660 1.02
clickbench_q01/duckdb:vortex-file-compressed 12061402 12076307 1.00
clickbench_q02/duckdb:vortex-file-compressed 25955355 26680146 0.97
clickbench_q03/duckdb:vortex-file-compressed 30496722 32370649 0.94
clickbench_q04/duckdb:vortex-file-compressed 188629295 187685011 1.01
clickbench_q05/duckdb:vortex-file-compressed 170742990 173837941 0.98
clickbench_q06/duckdb:vortex-file-compressed 20306292 20854567 0.97
clickbench_q07/duckdb:vortex-file-compressed 15347399 16179746 0.95
clickbench_q08/duckdb:vortex-file-compressed 256264686 264911862 0.97
clickbench_q09/duckdb:vortex-file-compressed 340721903 336580372 1.01
clickbench_q10/duckdb:vortex-file-compressed 68911298 70035026 0.98
clickbench_q11/duckdb:vortex-file-compressed 78822187 78039852 1.01
clickbench_q12/duckdb:vortex-file-compressed 195141490 194839053 1.00
clickbench_q13/duckdb:vortex-file-compressed 403026220 414363999 0.97
clickbench_q14/duckdb:vortex-file-compressed 224796131 246815596 0.91
clickbench_q15/duckdb:vortex-file-compressed 242429515 245224019 0.99
clickbench_q16/duckdb:vortex-file-compressed 521689171 527482387 0.99
clickbench_q17/duckdb:vortex-file-compressed 418419717 425963508 0.98
clickbench_q18/duckdb:vortex-file-compressed 940381700 952794658 0.99
clickbench_q19/duckdb:vortex-file-compressed 21297831 21679157 0.98
clickbench_q20/duckdb:vortex-file-compressed 327989590 334071915 0.98
clickbench_q21/duckdb:vortex-file-compressed 370798197 372573050 1.00
clickbench_q22/duckdb:vortex-file-compressed 501238365 521757077 0.96
clickbench_q23/duckdb:vortex-file-compressed 🚀 153187115 176616054 0.87
clickbench_q24/duckdb:vortex-file-compressed 🚨 40098653 32598538 1.23
clickbench_q25/duckdb:vortex-file-compressed 70356435 69395544 1.01
clickbench_q26/duckdb:vortex-file-compressed 🚨 47226003 40514924 1.17
clickbench_q27/duckdb:vortex-file-compressed 471629348 482837650 0.98
clickbench_q28/duckdb:vortex-file-compressed 2979537034 2996745777 0.99
clickbench_q29/duckdb:vortex-file-compressed 28638692 29590635 0.97
clickbench_q30/duckdb:vortex-file-compressed 190976212 189772758 1.01
clickbench_q31/duckdb:vortex-file-compressed 284145799 286000284 0.99
clickbench_q32/duckdb:vortex-file-compressed 1112381096 1117977265 0.99
clickbench_q33/duckdb:vortex-file-compressed 1035495483 1100369498 0.94
clickbench_q34/duckdb:vortex-file-compressed 1136247221 1158194521 0.98
clickbench_q35/duckdb:vortex-file-compressed 370910944 379497085 0.98
clickbench_q36/duckdb:vortex-file-compressed 25746567 27394251 0.94
clickbench_q37/duckdb:vortex-file-compressed 19021851 18861795 1.01
clickbench_q38/duckdb:vortex-file-compressed 19499822 19602810 0.99
clickbench_q39/duckdb:vortex-file-compressed 40197162 40171096 1.00
clickbench_q40/duckdb:vortex-file-compressed 18465843 19827004 0.93
clickbench_q41/duckdb:vortex-file-compressed 🚨 19710633 17421847 1.13
clickbench_q42/duckdb:vortex-file-compressed 18041630 18851936 0.96
duckdb / parquet (0.994x ➖, 2↑ 1↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚨 24052018 21472319 1.12
clickbench_q01/duckdb:parquet 28829233 29393444 0.98
clickbench_q02/duckdb:parquet 49955314 51048674 0.98
clickbench_q03/duckdb:parquet 40326849 40767077 0.99
clickbench_q04/duckdb:parquet 203460174 202658142 1.00
clickbench_q05/duckdb:parquet 258268289 255654481 1.01
clickbench_q06/duckdb:parquet 47227894 47234476 1.00
clickbench_q07/duckdb:parquet 31563709 32539013 0.97
clickbench_q08/duckdb:parquet 271310387 275909206 0.98
clickbench_q09/duckdb:parquet 398936516 404318572 0.99
clickbench_q10/duckdb:parquet 81063780 83356276 0.97
clickbench_q11/duckdb:parquet 100842450 102211896 0.99
clickbench_q12/duckdb:parquet 🚀 278662924 309772142 0.90
clickbench_q13/duckdb:parquet 🚀 466069806 542807461 0.86
clickbench_q14/duckdb:parquet 315408049 323175418 0.98
clickbench_q15/duckdb:parquet 253594406 258288597 0.98
clickbench_q16/duckdb:parquet 594320301 596090115 1.00
clickbench_q17/duckdb:parquet 500002118 498048552 1.00
clickbench_q18/duckdb:parquet 1034094843 1039838784 0.99
clickbench_q19/duckdb:parquet 27601061 28343754 0.97
clickbench_q20/duckdb:parquet 415768147 418336102 0.99
clickbench_q21/duckdb:parquet 531120419 538460265 0.99
clickbench_q22/duckdb:parquet 920612768 922328336 1.00
clickbench_q23/duckdb:parquet 265771763 275335643 0.97
clickbench_q24/duckdb:parquet 73238270 70035222 1.05
clickbench_q25/duckdb:parquet 161964753 164138243 0.99
clickbench_q26/duckdb:parquet 56040122 54457175 1.03
clickbench_q27/duckdb:parquet 635170517 637006733 1.00
clickbench_q28/duckdb:parquet 4887681815 4873811444 1.00
clickbench_q29/duckdb:parquet 41842042 42109719 0.99
clickbench_q30/duckdb:parquet 310960957 311852996 1.00
clickbench_q31/duckdb:parquet 375548786 380185457 0.99
clickbench_q32/duckdb:parquet 1099908568 1116791746 0.98
clickbench_q33/duckdb:parquet 1102133248 1101186147 1.00
clickbench_q34/duckdb:parquet 1142563382 1152609155 0.99
clickbench_q35/duckdb:parquet 368462516 370432272 0.99
clickbench_q36/duckdb:parquet 50738533 46798975 1.08
clickbench_q37/duckdb:parquet 34566274 33897963 1.02
clickbench_q38/duckdb:parquet 35274678 34718024 1.02
clickbench_q39/duckdb:parquet 88771003 86945082 1.02
clickbench_q40/duckdb:parquet 20134268 20500044 0.98
clickbench_q41/duckdb:parquet 21041438 20890713 1.01
clickbench_q42/duckdb:parquet 22566336 21801604 1.04
duckdb / duckdb (0.964x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 96ffd3f (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17027399 18177576 0.94
clickbench_q01/duckdb:duckdb 34395915 35517893 0.97
clickbench_q02/duckdb:duckdb 51190168 52945021 0.97
clickbench_q03/duckdb:duckdb 55611364 56753721 0.98
clickbench_q04/duckdb:duckdb 210550240 212719535 0.99
clickbench_q05/duckdb:duckdb 279914927 290169069 0.96
clickbench_q06/duckdb:duckdb 33295713 35194274 0.95
clickbench_q07/duckdb:duckdb 34901997 36103325 0.97
clickbench_q08/duckdb:duckdb 272935342 287212768 0.95
clickbench_q09/duckdb:duckdb 391657325 413831995 0.95
clickbench_q10/duckdb:duckdb 115534294 119950273 0.96
clickbench_q11/duckdb:duckdb 125385125 133333547 0.94
clickbench_q12/duckdb:duckdb 257571101 274943900 0.94
clickbench_q13/duckdb:duckdb 437119034 464218506 0.94
clickbench_q14/duckdb:duckdb 284284697 296756367 0.96
clickbench_q15/duckdb:duckdb 239673483 244754518 0.98
clickbench_q16/duckdb:duckdb 557525462 583168733 0.96
clickbench_q17/duckdb:duckdb 468102875 480530879 0.97
clickbench_q18/duckdb:duckdb 987928645 1063530166 0.93
clickbench_q19/duckdb:duckdb 33943907 36098352 0.94
clickbench_q20/duckdb:duckdb 464669083 493180067 0.94
clickbench_q21/duckdb:duckdb 466819873 475614421 0.98
clickbench_q22/duckdb:duckdb 536802986 547233488 0.98
clickbench_q23/duckdb:duckdb 243729540 254398466 0.96
clickbench_q24/duckdb:duckdb 60473089 63110171 0.96
clickbench_q25/duckdb:duckdb 147996031 149931782 0.99
clickbench_q26/duckdb:duckdb 61855487 63034636 0.98
clickbench_q27/duckdb:duckdb 549486425 559488576 0.98
clickbench_q28/duckdb:duckdb 4478973975 4508629029 0.99
clickbench_q29/duckdb:duckdb 50014665 52042159 0.96
clickbench_q30/duckdb:duckdb 279782841 289849399 0.97
clickbench_q31/duckdb:duckdb 360805649 380420964 0.95
clickbench_q32/duckdb:duckdb 1110133610 1142592987 0.97
clickbench_q33/duckdb:duckdb 1116685417 1178361947 0.95
clickbench_q34/duckdb:duckdb 1186450039 1229670855 0.96
clickbench_q35/duckdb:duckdb 299136658 298860769 1.00
clickbench_q36/duckdb:duckdb 53938675 53024816 1.02
clickbench_q37/duckdb:duckdb 28317472 29257136 0.97
clickbench_q38/duckdb:duckdb 32592507 33472611 0.97
clickbench_q39/duckdb:duckdb 79261019 83487839 0.95
clickbench_q40/duckdb:duckdb 27676533 29169955 0.95
clickbench_q41/duckdb:duckdb 27113142 28068226 0.97
clickbench_q42/duckdb:duckdb 28996859 30101567 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -0.2% +5.9% -5.8% +798.5% ➖ noise
0 duckdb:duckdb -6.3% +5.9% -11.6% +306.8% ➖ noise
0 duckdb:vortex-file-compressed +2.1% +5.9% -3.6% +510.9% ➖ noise
1 datafusion:vortex-file-compressed +2.9% -2.5% +5.6% +22.4% ➖ noise
1 duckdb:duckdb -3.2% -2.5% -0.6% +51.1% ➖ noise
1 duckdb:vortex-file-compressed -0.1% -2.5% +2.5% +24.2% ➖ noise
2 datafusion:vortex-file-compressed -2.9% -2.3% -0.6% +14.5% ➖ noise
2 duckdb:duckdb -3.3% -2.3% -1.1% +26.2% ➖ noise
2 duckdb:vortex-file-compressed -2.7% -2.3% -0.4% +10.9% ➖ noise
3 datafusion:vortex-file-compressed +4.8% -2.6% +7.5% +141.8% ➖ noise
3 duckdb:duckdb -2.0% -2.6% +0.6% +46.1% ➖ noise
3 duckdb:vortex-file-compressed -5.8% -2.6% -3.3% +64.1% ➖ noise
4 datafusion:vortex-file-compressed -2.8% -0.6% -2.2% +10.0% ➖ noise
4 duckdb:duckdb -1.0% -0.6% -0.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.5% -0.6% +1.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -0.9% +1.9% -2.7% +10.0% ➖ noise
5 duckdb:duckdb -3.5% +1.9% -5.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.8% +1.9% -3.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.1% +0.6% -0.5% +39.7% ➖ noise
6 duckdb:duckdb -5.4% +0.6% -5.9% +15.9% ➖ noise
6 duckdb:vortex-file-compressed -2.6% +0.6% -3.2% +16.7% ➖ noise
7 datafusion:vortex-file-compressed -1.1% -0.7% -0.4% +12.2% ➖ noise
7 duckdb:duckdb -3.3% -0.7% -2.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.1% -0.7% -4.5% +16.9% ➖ noise
8 datafusion:vortex-file-compressed -3.9% -1.2% -2.7% +10.0% ➖ noise
8 duckdb:duckdb -5.0% -1.2% -3.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.3% -1.2% -2.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -4.2% -0.9% -3.4% +10.0% ➖ noise
9 duckdb:duckdb -5.4% -0.9% -4.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.2% -0.9% +2.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +3.0% -1.4% +4.4% +10.0% ➖ noise
10 duckdb:duckdb -3.7% -1.4% -2.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.6% -1.4% -0.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.4% -1.2% -0.2% +10.0% ➖ noise
11 duckdb:duckdb -6.0% -1.2% -4.8% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +1.0% -1.2% +2.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -3.0% -5.2% +2.3% +10.0% ➖ noise
12 duckdb:duckdb -6.3% -5.2% -1.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.2% -5.2% +5.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.6% -8.7% +8.9% +10.0% ➖ noise
13 duckdb:duckdb -5.8% -8.7% +3.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.7% -8.7% +6.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.7% -1.8% +0.1% +10.0% ➖ noise
14 duckdb:duckdb -4.2% -1.8% -2.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -8.9% -1.8% -7.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.9% -1.1% +0.1% +10.0% ➖ noise
15 duckdb:duckdb -2.1% -1.1% -1.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.1% -1.1% -0.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -1.4% -0.1% -1.3% +10.0% ➖ noise
16 duckdb:duckdb -4.4% -0.1% -4.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -1.1% -0.1% -1.0% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -2.6% +1.1% -3.6% +10.0% ➖ noise
17 duckdb:duckdb -2.6% +1.1% -3.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -1.8% +1.1% -2.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -1.8% +1.7% -3.4% +10.0% ➖ noise
18 duckdb:duckdb -7.1% +1.7% -8.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.3% +1.7% -2.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +8.9% -1.1% +10.1% +22.1% ➖ noise
19 duckdb:duckdb -6.0% -1.1% -4.9% +14.9% ➖ noise
19 duckdb:vortex-file-compressed -1.8% -1.1% -0.7% +18.4% ➖ noise
20 datafusion:vortex-file-compressed -0.5% +0.4% -0.9% +204.6% ➖ noise
20 duckdb:duckdb -5.8% +0.4% -6.1% +80.6% ➖ noise
20 duckdb:vortex-file-compressed -1.8% +0.4% -2.2% +63.7% ➖ noise
21 datafusion:vortex-file-compressed -0.7% +0.3% -1.0% +10.0% ➖ noise
21 duckdb:duckdb -1.8% +0.3% -2.2% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -0.5% +0.3% -0.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.2% -1.4% +1.6% +14.9% ➖ noise
22 duckdb:duckdb -1.9% -1.4% -0.5% +42.4% ➖ noise
22 duckdb:vortex-file-compressed -3.9% -1.4% -2.6% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +3.5% -1.6% +5.1% +55.0% ➖ noise
23 duckdb:duckdb -4.2% -1.6% -2.7% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -13.3% -1.6% -11.9% +37.8% ➖ noise
24 datafusion:vortex-file-compressed +3.1% +1.6% +1.5% +13.5% ➖ noise
24 duckdb:duckdb -4.2% +1.6% -5.7% +32.6% ➖ noise
24 duckdb:vortex-file-compressed +23.0% +1.6% +21.1% +22.9% ➖ noise
25 datafusion:vortex-file-compressed +3.6% -0.6% +4.3% +10.0% ➖ noise
25 duckdb:duckdb -1.3% -0.6% -0.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +1.4% -0.6% +2.0% +11.5% ➖ noise
26 datafusion:vortex-file-compressed -5.4% -0.4% -5.1% +15.3% ➖ noise
26 duckdb:duckdb -1.9% -0.4% -1.5% +12.0% ➖ noise
26 duckdb:vortex-file-compressed +16.6% -0.4% +17.0% +18.0% ➖ noise
27 datafusion:vortex-file-compressed +2.9% -0.7% +3.6% +10.0% ➖ noise
27 duckdb:duckdb -1.8% -0.7% -1.1% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -2.3% -0.7% -1.7% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.6% -0.8% +2.4% +10.0% ➖ noise
28 duckdb:duckdb -0.7% -0.8% +0.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.6% -0.8% +0.2% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -0.7% -1.6% +0.9% +10.0% ➖ noise
29 duckdb:duckdb -3.9% -1.6% -2.3% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -3.2% -1.6% -1.6% +11.5% ➖ noise
30 datafusion:vortex-file-compressed +0.2% -1.4% +1.6% +10.0% ➖ noise
30 duckdb:duckdb -3.5% -1.4% -2.1% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.6% -1.4% +2.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.1% -0.8% +0.7% +10.0% ➖ noise
31 duckdb:duckdb -5.2% -0.8% -4.4% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -0.6% -0.8% +0.2% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +1.9% -0.7% +2.6% +10.0% ➖ noise
32 duckdb:duckdb -2.8% -0.7% -2.1% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -0.5% -0.7% +0.2% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +0.4% -0.9% +1.4% +10.0% ➖ noise
33 duckdb:duckdb -5.2% -0.9% -4.4% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -5.9% -0.9% -5.0% +20.0% ➖ noise
34 datafusion:vortex-file-compressed +0.1% -0.5% +0.7% +10.0% ➖ noise
34 duckdb:duckdb -3.5% -0.5% -3.0% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -1.9% -0.5% -1.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +1.3% -2.2% +3.6% +10.0% ➖ noise
35 duckdb:duckdb +0.1% -2.2% +2.4% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -2.3% -2.2% -0.0% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +0.5% +3.9% -3.3% +10.0% ➖ noise
36 duckdb:duckdb +1.7% +3.9% -2.1% +15.9% ➖ noise
36 duckdb:vortex-file-compressed -6.0% +3.9% -9.6% +12.3% ➖ noise
37 datafusion:vortex-file-compressed -0.3% +0.4% -0.7% +10.0% ➖ noise
37 duckdb:duckdb -3.2% +0.4% -3.6% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +0.8% +0.4% +0.5% +10.3% ➖ noise
38 datafusion:vortex-file-compressed -0.8% +0.6% -1.5% +10.7% ➖ noise
38 duckdb:duckdb -2.6% +0.6% -3.2% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -0.5% +0.6% -1.2% +11.1% ➖ noise
39 datafusion:vortex-file-compressed -1.2% +0.6% -1.8% +10.0% ➖ noise
39 duckdb:duckdb -5.1% +0.6% -5.7% +17.4% ➖ noise
39 duckdb:vortex-file-compressed +0.1% +0.6% -0.6% +10.3% ➖ noise
40 datafusion:vortex-file-compressed +0.4% -1.8% +2.2% +13.5% ➖ noise
40 duckdb:duckdb -5.1% -1.8% -3.4% +12.1% ➖ noise
40 duckdb:vortex-file-compressed -6.9% -1.8% -5.2% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +0.0% -2.3% +2.4% +10.0% ➖ noise
41 duckdb:duckdb -3.4% -2.3% -1.1% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +13.1% -2.3% +15.8% +11.5% 🚨 regression
42 datafusion:vortex-file-compressed -2.8% +1.7% -4.4% +10.0% ➖ noise
42 duckdb:duckdb -3.7% +1.7% -5.3% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -4.3% +1.7% -5.9% +11.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.5%
Vortex (geomean): 1.027x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +1.2%

datafusion / vortex-file-compressed (1.016x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 52166743 51479025 1.01
tpch_q02/datafusion:vortex-file-compressed 22194515 22029834 1.01
tpch_q03/datafusion:vortex-file-compressed 28585432 27813895 1.03
tpch_q04/datafusion:vortex-file-compressed 20200360 20514254 0.98
tpch_q05/datafusion:vortex-file-compressed 48807698 46855115 1.04
tpch_q06/datafusion:vortex-file-compressed 10513432 10396695 1.01
tpch_q07/datafusion:vortex-file-compressed 54842833 53857532 1.02
tpch_q08/datafusion:vortex-file-compressed 39333308 38982658 1.01
tpch_q09/datafusion:vortex-file-compressed 52748279 51119691 1.03
tpch_q10/datafusion:vortex-file-compressed 39795054 39188437 1.02
tpch_q11/datafusion:vortex-file-compressed 15889173 16138360 0.98
tpch_q12/datafusion:vortex-file-compressed 24459204 23833861 1.03
tpch_q13/datafusion:vortex-file-compressed 25288775 24555027 1.03
tpch_q14/datafusion:vortex-file-compressed 16025646 15443393 1.04
tpch_q15/datafusion:vortex-file-compressed 24588130 24558003 1.00
tpch_q16/datafusion:vortex-file-compressed 20327726 19563092 1.04
tpch_q17/datafusion:vortex-file-compressed 66737678 68028231 0.98
tpch_q18/datafusion:vortex-file-compressed 81408863 78067685 1.04
tpch_q19/datafusion:vortex-file-compressed 20181585 19484470 1.04
tpch_q20/datafusion:vortex-file-compressed 29028363 29018715 1.00
tpch_q21/datafusion:vortex-file-compressed 71742262 71831451 1.00
tpch_q22/datafusion:vortex-file-compressed 12321598 12071540 1.02
datafusion / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 57913923 57131298 1.01
tpch_q02/datafusion:vortex-compact 25897171 25193177 1.03
tpch_q03/datafusion:vortex-compact 29762406 28576905 1.04
tpch_q04/datafusion:vortex-compact 22385081 21909238 1.02
tpch_q05/datafusion:vortex-compact 49744089 50405291 0.99
tpch_q06/datafusion:vortex-compact 12476263 12786302 0.98
tpch_q07/datafusion:vortex-compact 58618995 57745398 1.02
tpch_q08/datafusion:vortex-compact 43205518 42868496 1.01
tpch_q09/datafusion:vortex-compact 56130744 55842634 1.01
tpch_q10/datafusion:vortex-compact 45138284 45280798 1.00
tpch_q11/datafusion:vortex-compact 16951603 17201966 0.99
tpch_q12/datafusion:vortex-compact 31436424 30798064 1.02
tpch_q13/datafusion:vortex-compact 31254492 31478407 0.99
tpch_q14/datafusion:vortex-compact 19137175 19265852 0.99
tpch_q15/datafusion:vortex-compact 31118884 30500628 1.02
tpch_q16/datafusion:vortex-compact 23780822 23606970 1.01
tpch_q17/datafusion:vortex-compact 69427462 70348123 0.99
tpch_q18/datafusion:vortex-compact 84151995 82583908 1.02
tpch_q19/datafusion:vortex-compact 30124573 31673927 0.95
tpch_q20/datafusion:vortex-compact 33440947 33699348 0.99
tpch_q21/datafusion:vortex-compact 74278997 73357502 1.01
tpch_q22/datafusion:vortex-compact 12421545 12527270 0.99
datafusion / parquet (1.025x ➖, 1↑ 2↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 132620545 95935419 1.38
tpch_q02/datafusion:parquet 60805538 59968648 1.01
tpch_q03/datafusion:parquet 72915474 67657766 1.08
tpch_q04/datafusion:parquet 43151634 41941229 1.03
tpch_q05/datafusion:parquet 92427619 90544268 1.02
tpch_q06/datafusion:parquet 33206468 36333204 0.91
tpch_q07/datafusion:parquet 103748876 105300541 0.99
tpch_q08/datafusion:parquet 94290253 92137262 1.02
tpch_q09/datafusion:parquet 131520774 126451288 1.04
tpch_q10/datafusion:parquet 111423535 107363127 1.04
tpch_q11/datafusion:parquet 40007118 40388622 0.99
tpch_q12/datafusion:parquet 🚀 72086700 81384786 0.89
tpch_q13/datafusion:parquet 191442656 194806223 0.98
tpch_q14/datafusion:parquet 47512316 46367083 1.02
tpch_q15/datafusion:parquet 58282876 57023788 1.02
tpch_q16/datafusion:parquet 39693657 39142320 1.01
tpch_q17/datafusion:parquet 126779516 127618627 0.99
tpch_q18/datafusion:parquet 158980349 163143754 0.97
tpch_q19/datafusion:parquet 🚨 73115823 62386121 1.17
tpch_q20/datafusion:parquet 65323993 67646504 0.97
tpch_q21/datafusion:parquet 134467040 130147052 1.03
tpch_q22/datafusion:parquet 31996153 30723287 1.04
datafusion / arrow (1.004x ➖, 1↑ 1↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 51506946 57753597 0.89
tpch_q02/datafusion:arrow 19051724 19073239 1.00
tpch_q03/datafusion:arrow 29150379 28682265 1.02
tpch_q04/datafusion:arrow 24487383 24353611 1.01
tpch_q05/datafusion:arrow 73995228 70975713 1.04
tpch_q06/datafusion:arrow 🚨 21902138 19651308 1.11
tpch_q07/datafusion:arrow 100423806 101760302 0.99
tpch_q08/datafusion:arrow 41898402 43617553 0.96
tpch_q09/datafusion:arrow 62763034 64616724 0.97
tpch_q10/datafusion:arrow 45536382 49730582 0.92
tpch_q11/datafusion:arrow 9135617 9097279 1.00
tpch_q12/datafusion:arrow 51227099 51078407 1.00
tpch_q13/datafusion:arrow 46732033 45616624 1.02
tpch_q14/datafusion:arrow 21552047 21305662 1.01
tpch_q15/datafusion:arrow 42409686 40547573 1.05
tpch_q16/datafusion:arrow 18746948 18725674 1.00
tpch_q17/datafusion:arrow 68212162 65575659 1.04
tpch_q18/datafusion:arrow 135154452 134842797 1.00
tpch_q19/datafusion:arrow 35290981 34709854 1.02
tpch_q20/datafusion:arrow 34535099 34007075 1.02
tpch_q21/datafusion:arrow 146637200 147883052 0.99
tpch_q22/datafusion:arrow 17979655 17148022 1.05
duckdb / vortex-file-compressed (1.051x ➖, 0↑ 2↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32183930 31358886 1.03
tpch_q02/duckdb:vortex-file-compressed 🚨 30310333 25794973 1.18
tpch_q03/duckdb:vortex-file-compressed 34888505 32557925 1.07
tpch_q04/duckdb:vortex-file-compressed 28645298 28328688 1.01
tpch_q05/duckdb:vortex-file-compressed 39415128 36869184 1.07
tpch_q06/duckdb:vortex-file-compressed 🚨 8433235 7665581 1.10
tpch_q07/duckdb:vortex-file-compressed 37843897 35020892 1.08
tpch_q08/duckdb:vortex-file-compressed 39624799 38024715 1.04
tpch_q09/duckdb:vortex-file-compressed 60330142 57500329 1.05
tpch_q10/duckdb:vortex-file-compressed 41790875 41291164 1.01
tpch_q11/duckdb:vortex-file-compressed 15925999 14968565 1.06
tpch_q12/duckdb:vortex-file-compressed 22687702 22407974 1.01
tpch_q13/duckdb:vortex-file-compressed 38609600 37325349 1.03
tpch_q14/duckdb:vortex-file-compressed 23038950 22586736 1.02
tpch_q15/duckdb:vortex-file-compressed 17613885 16795028 1.05
tpch_q16/duckdb:vortex-file-compressed 31083820 29831723 1.04
tpch_q17/duckdb:vortex-file-compressed 25744608 23845772 1.08
tpch_q18/duckdb:vortex-file-compressed 54682522 52223282 1.05
tpch_q19/duckdb:vortex-file-compressed 29458217 29265374 1.01
tpch_q20/duckdb:vortex-file-compressed 34736460 32433653 1.07
tpch_q21/duckdb:vortex-file-compressed 101779849 99669039 1.02
tpch_q22/duckdb:vortex-file-compressed 17664956 16780443 1.05
duckdb / vortex-compact (1.039x ➖, 0↑ 1↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38429004 38391111 1.00
tpch_q02/duckdb:vortex-compact 37588255 34510139 1.09
tpch_q03/duckdb:vortex-compact 35772453 34689550 1.03
tpch_q04/duckdb:vortex-compact 30215074 30723127 0.98
tpch_q05/duckdb:vortex-compact 42798883 40501528 1.06
tpch_q06/duckdb:vortex-compact 11602161 10798192 1.07
tpch_q07/duckdb:vortex-compact 43903945 40974312 1.07
tpch_q08/duckdb:vortex-compact 44095651 41904889 1.05
tpch_q09/duckdb:vortex-compact 67440571 65676809 1.03
tpch_q10/duckdb:vortex-compact 46160875 45487886 1.01
tpch_q11/duckdb:vortex-compact 🚨 20161557 18106552 1.11
tpch_q12/duckdb:vortex-compact 30865365 29394334 1.05
tpch_q13/duckdb:vortex-compact 45280409 43540209 1.04
tpch_q14/duckdb:vortex-compact 27217024 25794930 1.06
tpch_q15/duckdb:vortex-compact 20579103 19838717 1.04
tpch_q16/duckdb:vortex-compact 32830344 32890766 1.00
tpch_q17/duckdb:vortex-compact 29777345 28916467 1.03
tpch_q18/duckdb:vortex-compact 54412071 52832868 1.03
tpch_q19/duckdb:vortex-compact 34019776 33192470 1.02
tpch_q20/duckdb:vortex-compact 40254242 39406347 1.02
tpch_q21/duckdb:vortex-compact 102686310 102653563 1.00
tpch_q22/duckdb:vortex-compact 19013938 17890445 1.06
duckdb / parquet (0.984x ➖, 2↑ 1↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 75988921 76933030 0.99
tpch_q02/duckdb:parquet 38980194 39253736 0.99
tpch_q03/duckdb:parquet 70881845 70021089 1.01
tpch_q04/duckdb:parquet 49892420 49672632 1.00
tpch_q05/duckdb:parquet 68163563 68067218 1.00
tpch_q06/duckdb:parquet 22309881 22294379 1.00
tpch_q07/duckdb:parquet 75610239 83393398 0.91
tpch_q08/duckdb:parquet 83084324 81976835 1.01
tpch_q09/duckdb:parquet 🚀 133481697 155378973 0.86
tpch_q10/duckdb:parquet 127350378 125021436 1.02
tpch_q11/duckdb:parquet 21891008 22052238 0.99
tpch_q12/duckdb:parquet 🚀 46720724 56836684 0.82
tpch_q13/duckdb:parquet 251342400 254842194 0.99
tpch_q14/duckdb:parquet 50676738 50706718 1.00
tpch_q15/duckdb:parquet 25833158 26354103 0.98
tpch_q16/duckdb:parquet 58639848 57498953 1.02
tpch_q17/duckdb:parquet 56635700 58988614 0.96
tpch_q18/duckdb:parquet 118774125 119097994 1.00
tpch_q19/duckdb:parquet 68801066 76381434 0.90
tpch_q20/duckdb:parquet 🚨 84275078 65042164 1.30
tpch_q21/duckdb:parquet 172448754 179108110 0.96
tpch_q22/duckdb:parquet 54211080 53471241 1.01
duckdb / duckdb (1.003x ➖, 0↑ 0↓)
name PR 281de76 (ns) base 90dea93 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17514542 17592233 1.00
tpch_q02/duckdb:duckdb 14933974 14468802 1.03
tpch_q03/duckdb:duckdb 22730975 22996376 0.99
tpch_q04/duckdb:duckdb 22195937 22382171 0.99
tpch_q05/duckdb:duckdb 23444687 23647558 0.99
tpch_q06/duckdb:duckdb 6913192 7087887 0.98
tpch_q07/duckdb:duckdb 25384782 25279479 1.00
tpch_q08/duckdb:duckdb 24264582 24022259 1.01
tpch_q09/duckdb:duckdb 57048384 57529851 0.99
tpch_q10/duckdb:duckdb 51756644 51510914 1.00
tpch_q11/duckdb:duckdb 7130948 7310646 0.98
tpch_q12/duckdb:duckdb 17790546 18203510 0.98
tpch_q13/duckdb:duckdb 38931717 39388801 0.99
tpch_q14/duckdb:duckdb 21678232 20922055 1.04
tpch_q15/duckdb:duckdb 13559294 13611824 1.00
tpch_q16/duckdb:duckdb 26498299 25776155 1.03
tpch_q17/duckdb:duckdb 16273855 16084114 1.01
tpch_q18/duckdb:duckdb 41209210 40792283 1.01
tpch_q19/duckdb:duckdb 31549723 30865792 1.02
tpch_q20/duckdb:duckdb 25422470 25188404 1.01
tpch_q21/duckdb:duckdb 61686994 60558822 1.02
tpch_q22/duckdb:duckdb 25616934 25298429 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -10.8% +16.9% -23.7% +17.4% ✅ faster
1 datafusion:vortex-compact +1.4% +16.9% -13.2% +16.8% ➖ noise
1 datafusion:vortex-file-compressed +1.3% +16.9% -13.3% +16.8% ➖ noise
1 duckdb:duckdb -0.4% +16.9% -14.8% +16.8% ✅ faster
1 duckdb:vortex-compact +0.1% +16.9% -14.3% +16.8% ➖ noise
1 duckdb:vortex-file-compressed +2.6% +16.9% -12.2% +17.2% ➖ noise
2 datafusion:arrow -0.1% +0.3% -0.5% +16.8% ➖ noise
2 datafusion:vortex-compact +2.8% +0.3% +2.4% +16.8% ➖ noise
2 datafusion:vortex-file-compressed +0.7% +0.3% +0.4% +16.8% ➖ noise
2 duckdb:duckdb +3.2% +0.3% +2.9% +16.8% ➖ noise
2 duckdb:vortex-compact +8.9% +0.3% +8.5% +16.8% ➖ noise
2 duckdb:vortex-file-compressed +17.5% +0.3% +17.1% +16.8% 🚨 regression
3 datafusion:arrow +1.6% +4.4% -2.7% +16.8% ➖ noise
3 datafusion:vortex-compact +4.1% +4.4% -0.3% +16.8% ➖ noise
3 datafusion:vortex-file-compressed +2.8% +4.4% -1.6% +16.8% ➖ noise
3 duckdb:duckdb -1.2% +4.4% -5.4% +16.8% ➖ noise
3 duckdb:vortex-compact +3.1% +4.4% -1.3% +16.8% ➖ noise
3 duckdb:vortex-file-compressed +7.2% +4.4% +2.6% +16.8% ➖ noise
4 datafusion:arrow +0.5% +1.7% -1.1% +16.8% ➖ noise
4 datafusion:vortex-compact +2.2% +1.7% +0.5% +16.8% ➖ noise
4 datafusion:vortex-file-compressed -1.5% +1.7% -3.1% +16.8% ➖ noise
4 duckdb:duckdb -0.8% +1.7% -2.4% +16.8% ➖ noise
4 duckdb:vortex-compact -1.7% +1.7% -3.3% +16.8% ➖ noise
4 duckdb:vortex-file-compressed +1.1% +1.7% -0.5% +16.8% ➖ noise
5 datafusion:arrow +4.3% +1.1% +3.1% +16.8% ➖ noise
5 datafusion:vortex-compact -1.3% +1.1% -2.4% +16.8% ➖ noise
5 datafusion:vortex-file-compressed +4.2% +1.1% +3.0% +16.8% ➖ noise
5 duckdb:duckdb -0.9% +1.1% -1.9% +16.8% ➖ noise
5 duckdb:vortex-compact +5.7% +1.1% +4.5% +16.8% ➖ noise
5 duckdb:vortex-file-compressed +6.9% +1.1% +5.7% +16.8% ➖ noise
6 datafusion:arrow +11.5% -4.4% +16.5% +16.8% ➖ noise
6 datafusion:vortex-compact -2.4% -4.4% +2.0% +18.7% ➖ noise
6 datafusion:vortex-file-compressed +1.1% -4.4% +5.7% +16.8% ➖ noise
6 duckdb:duckdb -2.5% -4.4% +2.0% +16.8% ➖ noise
6 duckdb:vortex-compact +7.4% -4.4% +12.4% +18.8% ➖ noise
6 duckdb:vortex-file-compressed +10.0% -4.4% +15.0% +17.0% ➖ noise
7 datafusion:arrow -1.3% -5.5% +4.4% +16.8% ➖ noise
7 datafusion:vortex-compact +1.5% -5.5% +7.4% +16.8% ➖ noise
7 datafusion:vortex-file-compressed +1.8% -5.5% +7.7% +16.8% ➖ noise
7 duckdb:duckdb +0.4% -5.5% +6.2% +16.8% ➖ noise
7 duckdb:vortex-compact +7.1% -5.5% +13.4% +16.8% ➖ noise
7 duckdb:vortex-file-compressed +8.1% -5.5% +14.3% +16.8% ➖ noise
8 datafusion:arrow -3.9% +1.8% -5.7% +16.8% ➖ noise
8 datafusion:vortex-compact +0.8% +1.8% -1.0% +16.8% ➖ noise
8 datafusion:vortex-file-compressed +0.9% +1.8% -0.9% +16.8% ➖ noise
8 duckdb:duckdb +1.0% +1.8% -0.8% +16.8% ➖ noise
8 duckdb:vortex-compact +5.2% +1.8% +3.3% +16.8% ➖ noise
8 duckdb:vortex-file-compressed +4.2% +1.8% +2.3% +16.8% ➖ noise
9 datafusion:arrow -2.9% -5.5% +2.8% +16.8% ➖ noise
9 datafusion:vortex-compact +0.5% -5.5% +6.3% +16.8% ➖ noise
9 datafusion:vortex-file-compressed +3.2% -5.5% +9.2% +16.8% ➖ noise
9 duckdb:duckdb -0.8% -5.5% +4.9% +16.8% ➖ noise
9 duckdb:vortex-compact +2.7% -5.5% +8.6% +16.8% ➖ noise
9 duckdb:vortex-file-compressed +4.9% -5.5% +11.0% +16.8% ➖ noise
10 datafusion:arrow -8.4% +2.8% -10.9% +16.8% ➖ noise
10 datafusion:vortex-compact -0.3% +2.8% -3.0% +16.8% ➖ noise
10 datafusion:vortex-file-compressed +1.5% +2.8% -1.2% +16.8% ➖ noise
10 duckdb:duckdb +0.5% +2.8% -2.3% +16.8% ➖ noise
10 duckdb:vortex-compact +1.5% +2.8% -1.3% +16.8% ➖ noise
10 duckdb:vortex-file-compressed +1.2% +2.8% -1.6% +16.8% ➖ noise
11 datafusion:arrow +0.4% -0.8% +1.3% +16.8% ➖ noise
11 datafusion:vortex-compact -1.5% -0.8% -0.6% +16.8% ➖ noise
11 datafusion:vortex-file-compressed -1.5% -0.8% -0.7% +16.8% ➖ noise
11 duckdb:duckdb -2.5% -0.8% -1.6% +16.8% ➖ noise
11 duckdb:vortex-compact +11.3% -0.8% +12.3% +16.8% ➖ noise
11 duckdb:vortex-file-compressed +6.4% -0.8% +7.3% +16.8% ➖ noise
12 datafusion:arrow +0.3% -14.7% +17.5% +23.1% ➖ noise
12 datafusion:vortex-compact +2.1% -14.7% +19.6% +16.8% 🚨 regression
12 datafusion:vortex-file-compressed +2.6% -14.7% +20.3% +16.8% 🚨 regression
12 duckdb:duckdb -2.3% -14.7% +14.5% +16.8% ➖ noise
12 duckdb:vortex-compact +5.0% -14.7% +23.1% +16.8% 🚨 regression
12 duckdb:vortex-file-compressed +1.2% -14.7% +18.7% +16.8% 🚨 regression
13 datafusion:arrow +2.4% -1.6% +4.1% +16.8% ➖ noise
13 datafusion:vortex-compact -0.7% -1.6% +0.9% +16.8% ➖ noise
13 datafusion:vortex-file-compressed +3.0% -1.6% +4.6% +16.8% ➖ noise
13 duckdb:duckdb -1.2% -1.6% +0.4% +16.8% ➖ noise
13 duckdb:vortex-compact +4.0% -1.6% +5.6% +16.8% ➖ noise
13 duckdb:vortex-file-compressed +3.4% -1.6% +5.1% +16.8% ➖ noise
14 datafusion:arrow +1.2% +1.2% -0.0% +16.8% ➖ noise
14 datafusion:vortex-compact -0.7% +1.2% -1.8% +16.8% ➖ noise
14 datafusion:vortex-file-compressed +3.8% +1.2% +2.5% +16.8% ➖ noise
14 duckdb:duckdb +3.6% +1.2% +2.4% +16.8% ➖ noise
14 duckdb:vortex-compact +5.5% +1.2% +4.3% +16.8% ➖ noise
14 duckdb:vortex-file-compressed +2.0% +1.2% +0.8% +16.8% ➖ noise
15 datafusion:arrow +4.6% +0.1% +4.5% +16.8% ➖ noise
15 datafusion:vortex-compact +2.0% +0.1% +1.9% +16.8% ➖ noise
15 datafusion:vortex-file-compressed +0.1% +0.1% +0.0% +16.8% ➖ noise
15 duckdb:duckdb -0.4% +0.1% -0.5% +16.8% ➖ noise
15 duckdb:vortex-compact +3.7% +0.1% +3.6% +16.8% ➖ noise
15 duckdb:vortex-file-compressed +4.9% +0.1% +4.8% +16.8% ➖ noise
16 datafusion:arrow +0.1% +1.7% -1.6% +16.8% ➖ noise
16 datafusion:vortex-compact +0.7% +1.7% -0.9% +16.8% ➖ noise
16 datafusion:vortex-file-compressed +3.9% +1.7% +2.2% +16.8% ➖ noise
16 duckdb:duckdb +2.8% +1.7% +1.1% +16.8% ➖ noise
16 duckdb:vortex-compact -0.2% +1.7% -1.8% +16.8% ➖ noise
16 duckdb:vortex-file-compressed +4.2% +1.7% +2.5% +16.8% ➖ noise
17 datafusion:arrow +4.0% -2.3% +6.5% +16.8% ➖ noise
17 datafusion:vortex-compact -1.3% -2.3% +1.1% +16.8% ➖ noise
17 datafusion:vortex-file-compressed -1.9% -2.3% +0.5% +16.8% ➖ noise
17 duckdb:duckdb +1.2% -2.3% +3.6% +16.8% ➖ noise
17 duckdb:vortex-compact +3.0% -2.3% +5.4% +16.8% ➖ noise
17 duckdb:vortex-file-compressed +8.0% -2.3% +10.5% +16.8% ➖ noise
18 datafusion:arrow +0.2% -1.4% +1.7% +16.8% ➖ noise
18 datafusion:vortex-compact +1.9% -1.4% +3.4% +16.8% ➖ noise
18 datafusion:vortex-file-compressed +4.3% -1.4% +5.8% +16.8% ➖ noise
18 duckdb:duckdb +1.0% -1.4% +2.5% +16.8% ➖ noise
18 duckdb:vortex-compact +3.0% -1.4% +4.5% +16.8% ➖ noise
18 duckdb:vortex-file-compressed +4.7% -1.4% +6.2% +16.8% ➖ noise
19 datafusion:arrow +1.7% +2.7% -1.0% +19.7% ➖ noise
19 datafusion:vortex-compact -4.9% +2.7% -7.4% +16.8% ➖ noise
19 datafusion:vortex-file-compressed +3.6% +2.7% +0.8% +16.8% ➖ noise
19 duckdb:duckdb +2.2% +2.7% -0.5% +16.8% ➖ noise
19 duckdb:vortex-compact +2.5% +2.7% -0.2% +16.8% ➖ noise
19 duckdb:vortex-file-compressed +0.7% +2.7% -2.0% +16.8% ➖ noise
20 datafusion:arrow +1.6% +11.9% -9.2% +16.8% ➖ noise
20 datafusion:vortex-compact -0.8% +11.9% -11.3% +16.8% ➖ noise
20 datafusion:vortex-file-compressed +0.0% +11.9% -10.6% +16.8% ➖ noise
20 duckdb:duckdb +0.9% +11.9% -9.8% +16.8% ➖ noise
20 duckdb:vortex-compact +2.2% +11.9% -8.7% +16.8% ➖ noise
20 duckdb:vortex-file-compressed +7.1% +11.9% -4.3% +16.8% ➖ noise
21 datafusion:arrow -0.8% -0.3% -0.6% +16.8% ➖ noise
21 datafusion:vortex-compact +1.3% -0.3% +1.5% +16.8% ➖ noise
21 datafusion:vortex-file-compressed -0.1% -0.3% +0.1% +16.8% ➖ noise
21 duckdb:duckdb +1.9% -0.3% +2.1% +16.8% ➖ noise
21 duckdb:vortex-compact +0.0% -0.3% +0.3% +16.8% ➖ noise
21 duckdb:vortex-file-compressed +2.1% -0.3% +2.4% +16.8% ➖ noise
22 datafusion:arrow +4.8% +2.8% +2.0% +16.8% ➖ noise
22 datafusion:vortex-compact -0.8% +2.8% -3.5% +16.8% ➖ noise
22 datafusion:vortex-file-compressed +2.1% +2.8% -0.7% +16.8% ➖ noise
22 duckdb:duckdb +1.3% +2.8% -1.5% +16.8% ➖ noise
22 duckdb:vortex-compact +6.3% +2.8% +3.4% +16.8% ➖ noise
22 duckdb:vortex-file-compressed +5.3% +2.8% +2.4% +16.8% ➖ noise

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 22, 2026 •
edited
Loading

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 1 improved benchmark
❌ 1 regressed benchmark
✅ 1249 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation chunked_varbinview_opt_canonical_into[(1000, 10)] 187.9 µs 225.3 µs -16.58%
⚡ Simulation chunked_varbinview_canonical_into[(100, 100)] 307.9 µs 273.1 µs +12.72%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing myrrc/duckdb-async-scan (281de76) with develop (96ffd3f)

Open in CodSpeed

@myrrc myrrc force-pushed the myrrc/duckdb-async-scan branch from ac58d6e to 281de76 Compare May 22, 2026 16:20
@myrrc myrrc added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 22, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 22, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 281de76 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@myrrc