Skip to content

file_index virtual column for duckdb#7631

Draft
myrrc wants to merge 1 commit intodevelopfrom
myrrc/duckdb-row-id-columns
Draft

file_index virtual column for duckdb#7631
myrrc wants to merge 1 commit intodevelopfrom
myrrc/duckdb-row-id-columns

Conversation

@myrrc
Copy link
Copy Markdown
Contributor

@myrrc myrrc commented Apr 24, 2026

(Partial) late materialization support for duckdb.
Rest to implement is row index

@myrrc myrrc added changelog/feature A new feature action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 24, 2026
@github-actions github-actions Bot removed action/benchmark-sql Trigger SQL benchmarks to run on this PR action/benchmark Trigger full benchmarks to run on this PR labels Apr 24, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done b0f2e4a 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done a3e6376 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.007x ➖


datafusion / vortex-file-compressed (1.007x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 119495094 126346418 0.95
polarsignals_q01/datafusion:vortex-file-compressed 259443992 274866922 0.94
polarsignals_q02/datafusion:vortex-file-compressed 23286589 23821871 0.98
polarsignals_q03/datafusion:vortex-file-compressed 284323254 266572090 1.07
polarsignals_q04/datafusion:vortex-file-compressed 12223798 11517632 1.06
polarsignals_q05/datafusion:vortex-file-compressed 16344817 15318779 1.07
polarsignals_q06/datafusion:vortex-file-compressed 18821718 18925421 0.99
polarsignals_q07/datafusion:vortex-file-compressed 14391539 14220708 1.01
polarsignals_q08/datafusion:vortex-file-compressed 350552151 361614926 0.97
polarsignals_q09/datafusion:vortex-file-compressed 11530021 11025131 1.05

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Vortex (geomean): 1.003x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.1%


datafusion / vortex-file-compressed (0.999x ➖, 0↑ 1↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 4919033 5206510 0.94
fineweb_q01/datafusion:vortex-file-compressed 20736871 22192792 0.93
fineweb_q02/datafusion:vortex-file-compressed 22169148 22257739 1.00
fineweb_q03/datafusion:vortex-file-compressed 🚨 78975244 69325509 1.14
fineweb_q04/datafusion:vortex-file-compressed 236328054 241583632 0.98
fineweb_q05/datafusion:vortex-file-compressed 217116423 212611301 1.02
fineweb_q06/datafusion:vortex-file-compressed 51347160 53695901 0.96
fineweb_q07/datafusion:vortex-file-compressed 59928564 56603758 1.06
fineweb_q08/datafusion:vortex-file-compressed 21441271 21998211 0.97
datafusion / vortex-compact (1.011x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5660014 6036494 0.94
fineweb_q01/datafusion:vortex-compact 130138782 126304115 1.03
fineweb_q02/datafusion:vortex-compact 131232415 125190817 1.05
fineweb_q03/datafusion:vortex-compact 1032870927 1039057353 0.99
fineweb_q04/datafusion:vortex-compact 1107084900 1101368918 1.01
fineweb_q05/datafusion:vortex-compact 947291460 964516082 0.98
fineweb_q06/datafusion:vortex-compact 523748213 507926193 1.03
fineweb_q07/datafusion:vortex-compact 537167239 535714398 1.00
fineweb_q08/datafusion:vortex-compact 21370967 19935093 1.07
datafusion / parquet (0.983x ➖, 1↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 5997480 6708630 0.89
fineweb_q01/datafusion:parquet 272801567 285529997 0.96
fineweb_q02/datafusion:parquet 278055438 286593351 0.97
fineweb_q03/datafusion:parquet 290052087 282615018 1.03
fineweb_q04/datafusion:parquet 295563009 288639846 1.02
fineweb_q05/datafusion:parquet 291492341 298082195 0.98
fineweb_q06/datafusion:parquet 279262948 288081447 0.97
fineweb_q07/datafusion:parquet 282122049 274021076 1.03
fineweb_q08/datafusion:parquet 274932016 273599494 1.00
duckdb / vortex-file-compressed (1.015x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3147689 3180250 0.99
fineweb_q01/duckdb:vortex-file-compressed 21896132 21245694 1.03
fineweb_q02/duckdb:vortex-file-compressed 23081333 22506133 1.03
fineweb_q03/duckdb:vortex-file-compressed 130941827 119609438 1.09
fineweb_q04/duckdb:vortex-file-compressed 219726631 218453735 1.01
fineweb_q05/duckdb:vortex-file-compressed 209536786 213476533 0.98
fineweb_q06/duckdb:vortex-file-compressed 51760119 51692773 1.00
fineweb_q07/duckdb:vortex-file-compressed 55210248 54324073 1.02
fineweb_q08/duckdb:vortex-file-compressed 22082772 22306793 0.99
duckdb / vortex-compact (0.990x ➖, 1↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3822681 3728875 1.03
fineweb_q01/duckdb:vortex-compact 🚀 93620432 109456423 0.86
fineweb_q02/duckdb:vortex-compact 108969231 110861849 0.98
fineweb_q03/duckdb:vortex-compact 846578877 862603566 0.98
fineweb_q04/duckdb:vortex-compact 894543818 893667181 1.00
fineweb_q05/duckdb:vortex-compact 800824447 803629237 1.00
fineweb_q06/duckdb:vortex-compact 459460530 454269301 1.01
fineweb_q07/duckdb:vortex-compact 471956687 471307335 1.00
fineweb_q08/duckdb:vortex-compact 20599445 19263430 1.07
duckdb / parquet (1.009x ➖, 0↑ 1↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30592758 31651357 0.97
fineweb_q01/duckdb:parquet 81671539 81517489 1.00
fineweb_q02/duckdb:parquet 82675724 82630214 1.00
fineweb_q03/duckdb:parquet 306362405 307466900 1.00
fineweb_q04/duckdb:parquet 438528607 435840122 1.01
fineweb_q05/duckdb:parquet 409939818 407388055 1.01
fineweb_q06/duckdb:parquet 196608453 196667135 1.00
fineweb_q07/duckdb:parquet 207104888 206739122 1.00
fineweb_q08/duckdb:parquet 🚨 31299104 28228646 1.11
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -6.2% -7.0% +0.9% +48.5% ➖ noise
0 datafusion:vortex-file-compressed -5.5% -7.0% +1.6% +46.8% ➖ noise
0 duckdb:vortex-compact +2.5% -7.0% +10.3% +108.0% ➖ noise
0 duckdb:vortex-file-compressed -1.0% -7.0% +6.5% +85.7% ➖ noise
1 datafusion:vortex-compact +3.0% -2.2% +5.3% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -6.6% -2.2% -4.5% +25.3% ➖ noise
1 duckdb:vortex-compact -14.5% -2.2% -12.6% +21.2% ➖ noise
1 duckdb:vortex-file-compressed +3.1% -2.2% +5.3% +62.1% ➖ noise
2 datafusion:vortex-compact +4.8% -1.5% +6.4% +10.9% ➖ noise
2 datafusion:vortex-file-compressed -0.4% -1.5% +1.1% +10.0% ➖ noise
2 duckdb:vortex-compact -1.7% -1.5% -0.2% +12.7% ➖ noise
2 duckdb:vortex-file-compressed +2.6% -1.5% +4.1% +10.0% ➖ noise
3 datafusion:vortex-compact -0.6% +1.1% -1.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +13.9% +1.1% +12.7% +30.1% ➖ noise
3 duckdb:vortex-compact -1.9% +1.1% -2.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +9.5% +1.1% +8.3% +32.2% ➖ noise
4 datafusion:vortex-compact +0.5% +1.5% -1.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.2% +1.5% -3.6% +12.6% ➖ noise
4 duckdb:vortex-compact +0.1% +1.5% -1.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.6% +1.5% -0.9% +10.0% ➖ noise
5 datafusion:vortex-compact -1.8% -0.8% -1.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.1% -0.8% +2.9% +10.0% ➖ noise
5 duckdb:vortex-compact -0.3% -0.8% +0.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.8% -0.8% -1.1% +10.0% ➖ noise
6 datafusion:vortex-compact +3.1% -1.6% +4.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.4% -1.6% -2.9% +15.6% ➖ noise
6 duckdb:vortex-compact +1.1% -1.6% +2.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.1% -1.6% +1.7% +10.0% ➖ noise
7 datafusion:vortex-compact +0.3% +1.6% -1.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +5.9% +1.6% +4.3% +22.6% ➖ noise
7 duckdb:vortex-compact +0.1% +1.6% -1.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.6% +1.6% +0.1% +12.5% ➖ noise
8 datafusion:vortex-compact +7.2% +5.6% +1.6% +31.4% ➖ noise
8 datafusion:vortex-file-compressed -2.5% +5.6% -7.7% +20.7% ➖ noise
8 duckdb:vortex-compact +6.9% +5.6% +1.3% +38.8% ➖ noise
8 duckdb:vortex-file-compressed -1.0% +5.6% -6.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Vortex (geomean): 1.040x ➖
Parquet (geomean): 1.029x ➖
Shifts: Parquet (control) +2.9% · Median polish +3.4%


datafusion / vortex-file-compressed (1.045x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51590603 50869885 1.01
tpch_q02/datafusion:vortex-file-compressed 22781351 22267458 1.02
tpch_q03/datafusion:vortex-file-compressed 29519488 28078266 1.05
tpch_q04/datafusion:vortex-file-compressed 22637783 20869333 1.08
tpch_q05/datafusion:vortex-file-compressed 50678647 47113732 1.08
tpch_q06/datafusion:vortex-file-compressed 13422512 12969522 1.03
tpch_q07/datafusion:vortex-file-compressed 58951881 54233936 1.09
tpch_q08/datafusion:vortex-file-compressed 40639818 40177314 1.01
tpch_q09/datafusion:vortex-file-compressed 56311694 51631833 1.09
tpch_q10/datafusion:vortex-file-compressed 40563676 39888637 1.02
tpch_q11/datafusion:vortex-file-compressed 17054774 15994475 1.07
tpch_q12/datafusion:vortex-file-compressed 27139128 25714173 1.06
tpch_q13/datafusion:vortex-file-compressed 25805245 24966448 1.03
tpch_q14/datafusion:vortex-file-compressed 17492766 16639386 1.05
tpch_q15/datafusion:vortex-file-compressed 27706839 26746718 1.04
tpch_q16/datafusion:vortex-file-compressed 19884487 19513321 1.02
tpch_q17/datafusion:vortex-file-compressed 70359038 68030253 1.03
tpch_q18/datafusion:vortex-file-compressed 84616396 81338569 1.04
tpch_q19/datafusion:vortex-file-compressed 23957963 23657301 1.01
tpch_q20/datafusion:vortex-file-compressed 31323628 29843808 1.05
tpch_q21/datafusion:vortex-file-compressed 76761989 72211695 1.06
tpch_q22/datafusion:vortex-file-compressed 12808930 12364627 1.04
datafusion / vortex-compact (1.034x ➖, 0↑ 1↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58538079 57758521 1.01
tpch_q02/datafusion:vortex-compact 26473934 25896971 1.02
tpch_q03/datafusion:vortex-compact 31636466 30302440 1.04
tpch_q04/datafusion:vortex-compact 25432099 24086598 1.06
tpch_q05/datafusion:vortex-compact 56996965 51934943 1.10
tpch_q06/datafusion:vortex-compact 15782011 15398822 1.02
tpch_q07/datafusion:vortex-compact 63171654 59030567 1.07
tpch_q08/datafusion:vortex-compact 45702248 44526968 1.03
tpch_q09/datafusion:vortex-compact 59561988 56367755 1.06
tpch_q10/datafusion:vortex-compact 48612618 47468046 1.02
tpch_q11/datafusion:vortex-compact 17796325 16539284 1.08
tpch_q12/datafusion:vortex-compact 33888166 33355046 1.02
tpch_q13/datafusion:vortex-compact 32390395 31871884 1.02
tpch_q14/datafusion:vortex-compact 20950404 20476120 1.02
tpch_q15/datafusion:vortex-compact 🚨 35708260 31996382 1.12
tpch_q16/datafusion:vortex-compact 23034195 23292899 0.99
tpch_q17/datafusion:vortex-compact 73090471 70472800 1.04
tpch_q18/datafusion:vortex-compact 86668526 86656223 1.00
tpch_q19/datafusion:vortex-compact 31484291 30994545 1.02
tpch_q20/datafusion:vortex-compact 34769901 35292916 0.99
tpch_q21/datafusion:vortex-compact 83693071 79494852 1.05
tpch_q22/datafusion:vortex-compact 12899586 12859617 1.00
datafusion / parquet (1.031x ➖, 0↑ 2↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 128050663 100649602 1.27
tpch_q02/datafusion:parquet 66461003 62273619 1.07
tpch_q03/datafusion:parquet 70828439 72617300 0.98
tpch_q04/datafusion:parquet 45733810 45462351 1.01
tpch_q05/datafusion:parquet 96651250 94104388 1.03
tpch_q06/datafusion:parquet 37201948 39076159 0.95
tpch_q07/datafusion:parquet 105779895 105443502 1.00
tpch_q08/datafusion:parquet 🚨 100954427 89544726 1.13
tpch_q09/datafusion:parquet 137540195 128616935 1.07
tpch_q10/datafusion:parquet 115983104 112944401 1.03
tpch_q11/datafusion:parquet 44622818 41639450 1.07
tpch_q12/datafusion:parquet 88609708 90216661 0.98
tpch_q13/datafusion:parquet 196753066 190003584 1.04
tpch_q14/datafusion:parquet 44130891 46737596 0.94
tpch_q15/datafusion:parquet 61472061 61458458 1.00
tpch_q16/datafusion:parquet 46239947 44365472 1.04
tpch_q17/datafusion:parquet 142955691 130071577 1.10
tpch_q18/datafusion:parquet 169342659 163535684 1.04
tpch_q19/datafusion:parquet 81967489 86775841 0.94
tpch_q20/datafusion:parquet 67783718 68668564 0.99
tpch_q21/datafusion:parquet 136399242 131679316 1.04
tpch_q22/datafusion:parquet 31761497 30917916 1.03
datafusion / arrow (1.046x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 52066707 50997084 1.02
tpch_q02/datafusion:arrow 18584612 18886661 0.98
tpch_q03/datafusion:arrow 31580332 30227160 1.04
tpch_q04/datafusion:arrow 26764286 24609246 1.09
tpch_q05/datafusion:arrow 76527220 71480202 1.07
tpch_q06/datafusion:arrow 21529738 19783712 1.09
tpch_q07/datafusion:arrow 107517273 98766055 1.09
tpch_q08/datafusion:arrow 46194662 42603259 1.08
tpch_q09/datafusion:arrow 64258263 63436459 1.01
tpch_q10/datafusion:arrow 47741250 48558602 0.98
tpch_q11/datafusion:arrow 8947723 9068557 0.99
tpch_q12/datafusion:arrow 54386957 51323659 1.06
tpch_q13/datafusion:arrow 47824857 48040840 1.00
tpch_q14/datafusion:arrow 22820018 21824971 1.05
tpch_q15/datafusion:arrow 44193740 43580428 1.01
tpch_q16/datafusion:arrow 18938525 18338556 1.03
tpch_q17/datafusion:arrow 71040442 65510154 1.08
tpch_q18/datafusion:arrow 144064013 131894546 1.09
tpch_q19/datafusion:arrow 38730066 35528115 1.09
tpch_q20/datafusion:arrow 36264026 34255962 1.06
tpch_q21/datafusion:arrow 156726331 149587303 1.05
tpch_q22/datafusion:arrow 18120096 17225846 1.05
duckdb / vortex-file-compressed (1.046x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32304218 31132652 1.04
tpch_q02/duckdb:vortex-file-compressed 24641239 23787134 1.04
tpch_q03/duckdb:vortex-file-compressed 30127224 29440077 1.02
tpch_q04/duckdb:vortex-file-compressed 30722502 28781936 1.07
tpch_q05/duckdb:vortex-file-compressed 33841405 31851870 1.06
tpch_q06/duckdb:vortex-file-compressed 10907146 11232181 0.97
tpch_q07/duckdb:vortex-file-compressed 37988590 36356253 1.04
tpch_q08/duckdb:vortex-file-compressed 39977484 37500640 1.07
tpch_q09/duckdb:vortex-file-compressed 75718555 72484813 1.04
tpch_q10/duckdb:vortex-file-compressed 35850905 34432355 1.04
tpch_q11/duckdb:vortex-file-compressed 14901279 14150246 1.05
tpch_q12/duckdb:vortex-file-compressed 22929202 21477602 1.07
tpch_q13/duckdb:vortex-file-compressed 36629513 33926485 1.08
tpch_q14/duckdb:vortex-file-compressed 21986221 20664570 1.06
tpch_q15/duckdb:vortex-file-compressed 16750419 16322366 1.03
tpch_q16/duckdb:vortex-file-compressed 29354511 27125036 1.08
tpch_q17/duckdb:vortex-file-compressed 25608886 24215853 1.06
tpch_q18/duckdb:vortex-file-compressed 52670879 49234100 1.07
tpch_q19/duckdb:vortex-file-compressed 29700735 28691298 1.04
tpch_q20/duckdb:vortex-file-compressed 35025934 33868419 1.03
tpch_q21/duckdb:vortex-file-compressed 107645625 105641983 1.02
tpch_q22/duckdb:vortex-file-compressed 17071634 16549097 1.03
duckdb / vortex-compact (1.034x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39553324 37908994 1.04
tpch_q02/duckdb:vortex-compact 35100862 35225247 1.00
tpch_q03/duckdb:vortex-compact 33498183 31698672 1.06
tpch_q04/duckdb:vortex-compact 34721026 32827265 1.06
tpch_q05/duckdb:vortex-compact 38641558 37416770 1.03
tpch_q06/duckdb:vortex-compact 14225125 15298830 0.93
tpch_q07/duckdb:vortex-compact 43864121 41423780 1.06
tpch_q08/duckdb:vortex-compact 44898325 44436559 1.01
tpch_q09/duckdb:vortex-compact 86866109 82390052 1.05
tpch_q10/duckdb:vortex-compact 40307810 38644256 1.04
tpch_q11/duckdb:vortex-compact 19293825 18849970 1.02
tpch_q12/duckdb:vortex-compact 35342343 34864770 1.01
tpch_q13/duckdb:vortex-compact 44663269 44133409 1.01
tpch_q14/duckdb:vortex-compact 30784896 29122569 1.06
tpch_q15/duckdb:vortex-compact 19784858 19346364 1.02
tpch_q16/duckdb:vortex-compact 37119993 34885808 1.06
tpch_q17/duckdb:vortex-compact 31240892 29808593 1.05
tpch_q18/duckdb:vortex-compact 52423658 50170489 1.04
tpch_q19/duckdb:vortex-compact 35844720 34951413 1.03
tpch_q20/duckdb:vortex-compact 43039548 41952085 1.03
tpch_q21/duckdb:vortex-compact 115224876 110038532 1.05
tpch_q22/duckdb:vortex-compact 20997036 19094223 1.10
duckdb / parquet (1.026x ➖, 1↑ 1↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 80584231 77008654 1.05
tpch_q02/duckdb:parquet 40002398 39326558 1.02
tpch_q03/duckdb:parquet 72551292 68612911 1.06
tpch_q04/duckdb:parquet 47268522 46799805 1.01
tpch_q05/duckdb:parquet 66807268 67081784 1.00
tpch_q06/duckdb:parquet 21188086 20670105 1.03
tpch_q07/duckdb:parquet 67561985 66776577 1.01
tpch_q08/duckdb:parquet 90996101 88228888 1.03
tpch_q09/duckdb:parquet 151292338 147700200 1.02
tpch_q10/duckdb:parquet 117043410 114492648 1.02
tpch_q11/duckdb:parquet 22959280 22072743 1.04
tpch_q12/duckdb:parquet 45901877 45586240 1.01
tpch_q13/duckdb:parquet 260614563 246785705 1.06
tpch_q14/duckdb:parquet 🚀 48940980 56310515 0.87
tpch_q15/duckdb:parquet 25246335 24352875 1.04
tpch_q16/duckdb:parquet 56838093 55761387 1.02
tpch_q17/duckdb:parquet 54152792 49430859 1.10
tpch_q18/duckdb:parquet 114883442 112014372 1.03
tpch_q19/duckdb:parquet 66614221 65626658 1.02
tpch_q20/duckdb:parquet 🚨 71293142 63046226 1.13
tpch_q21/duckdb:parquet 165619685 162496071 1.02
tpch_q22/duckdb:parquet 52899581 50823895 1.04
duckdb / duckdb (1.020x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16343909 16589676 0.99
tpch_q02/duckdb:duckdb 12511886 11954668 1.05
tpch_q03/duckdb:duckdb 18736311 17957573 1.04
tpch_q04/duckdb:duckdb 19768110 19438649 1.02
tpch_q05/duckdb:duckdb 20488791 19779537 1.04
tpch_q06/duckdb:duckdb 5444679 5271448 1.03
tpch_q07/duckdb:duckdb 22599890 21737632 1.04
tpch_q08/duckdb:duckdb 21887367 21404617 1.02
tpch_q09/duckdb:duckdb 55740492 54907401 1.02
tpch_q10/duckdb:duckdb 42568862 45210833 0.94
tpch_q11/duckdb:duckdb 6139408 5870729 1.05
tpch_q12/duckdb:duckdb 14205995 13562755 1.05
tpch_q13/duckdb:duckdb 38560595 38739783 1.00
tpch_q14/duckdb:duckdb 18179703 17746054 1.02
tpch_q15/duckdb:duckdb 11960480 11912056 1.00
tpch_q16/duckdb:duckdb 23966641 23806789 1.01
tpch_q17/duckdb:duckdb 14026009 13589976 1.03
tpch_q18/duckdb:duckdb 39240709 38458791 1.02
tpch_q19/duckdb:duckdb 28477567 27137740 1.05
tpch_q20/duckdb:duckdb 22596461 23192342 0.97
tpch_q21/duckdb:duckdb 59447536 56033745 1.06
tpch_q22/duckdb:duckdb 24654076 24549797 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +2.1% +15.4% -11.5% +20.5% ➖ noise
1 datafusion:vortex-compact +1.3% +15.4% -12.2% +18.9% ➖ noise
1 datafusion:vortex-file-compressed +1.4% +15.4% -12.1% +19.3% ➖ noise
1 duckdb:duckdb -1.5% +15.4% -14.6% +17.6% ➖ noise
1 duckdb:vortex-compact +4.3% +15.4% -9.6% +18.1% ➖ noise
1 duckdb:vortex-file-compressed +3.8% +15.4% -10.1% +20.2% ➖ noise
2 datafusion:arrow -1.6% +4.2% -5.6% +12.6% ➖ noise
2 datafusion:vortex-compact +2.2% +4.2% -1.9% +12.6% ➖ noise
2 datafusion:vortex-file-compressed +2.3% +4.2% -1.8% +12.6% ➖ noise
2 duckdb:duckdb +4.7% +4.2% +0.5% +12.6% ➖ noise
2 duckdb:vortex-compact -0.4% +4.2% -4.4% +12.6% ➖ noise
2 duckdb:vortex-file-compressed +3.6% +4.2% -0.6% +12.6% ➖ noise
3 datafusion:arrow +4.5% +1.6% +2.9% +12.6% ➖ noise
3 datafusion:vortex-compact +4.4% +1.6% +2.8% +12.6% ➖ noise
3 datafusion:vortex-file-compressed +5.1% +1.6% +3.5% +12.6% ➖ noise
3 duckdb:duckdb +4.3% +1.6% +2.7% +12.6% ➖ noise
3 duckdb:vortex-compact +5.7% +1.6% +4.1% +12.6% ➖ noise
3 duckdb:vortex-file-compressed +2.3% +1.6% +0.8% +17.0% ➖ noise
4 datafusion:arrow +8.8% +0.8% +7.9% +12.6% ➖ noise
4 datafusion:vortex-compact +5.6% +0.8% +4.7% +12.6% ➖ noise
4 datafusion:vortex-file-compressed +8.5% +0.8% +7.6% +12.6% ➖ noise
4 duckdb:duckdb +1.7% +0.8% +0.9% +12.6% ➖ noise
4 duckdb:vortex-compact +5.8% +0.8% +4.9% +12.6% ➖ noise
4 duckdb:vortex-file-compressed +6.7% +0.8% +5.9% +12.6% ➖ noise
5 datafusion:arrow +7.1% +1.1% +5.9% +12.6% ➖ noise
5 datafusion:vortex-compact +9.7% +1.1% +8.5% +12.6% ➖ noise
5 datafusion:vortex-file-compressed +7.6% +1.1% +6.4% +12.6% ➖ noise
5 duckdb:duckdb +3.6% +1.1% +2.4% +12.6% ➖ noise
5 duckdb:vortex-compact +3.3% +1.1% +2.1% +12.6% ➖ noise
5 duckdb:vortex-file-compressed +6.2% +1.1% +5.1% +12.6% ➖ noise
6 datafusion:arrow +8.8% -1.2% +10.2% +14.7% ➖ noise
6 datafusion:vortex-compact +2.5% -1.2% +3.7% +16.8% ➖ noise
6 datafusion:vortex-file-compressed +3.5% -1.2% +4.8% +14.6% ➖ noise
6 duckdb:duckdb +3.3% -1.2% +4.6% +16.8% ➖ noise
6 duckdb:vortex-compact -7.0% -1.2% -5.9% +18.8% ➖ noise
6 duckdb:vortex-file-compressed -2.9% -1.2% -1.7% +19.4% ➖ noise
7 datafusion:arrow +8.9% +0.7% +8.1% +12.6% ➖ noise
7 datafusion:vortex-compact +7.0% +0.7% +6.2% +12.6% ➖ noise
7 datafusion:vortex-file-compressed +8.7% +0.7% +7.9% +12.6% ➖ noise
7 duckdb:duckdb +4.0% +0.7% +3.2% +12.6% ➖ noise
7 duckdb:vortex-compact +5.9% +0.7% +5.1% +12.6% ➖ noise
7 duckdb:vortex-file-compressed +4.5% +0.7% +3.7% +12.6% ➖ noise
8 datafusion:arrow +8.4% +7.8% +0.6% +12.6% ➖ noise
8 datafusion:vortex-compact +2.6% +7.8% -4.8% +12.6% ➖ noise
8 datafusion:vortex-file-compressed +1.2% +7.8% -6.2% +12.6% ➖ noise
8 duckdb:duckdb +2.3% +7.8% -5.2% +12.6% ➖ noise
8 duckdb:vortex-compact +1.0% +7.8% -6.3% +12.6% ➖ noise
8 duckdb:vortex-file-compressed +6.6% +7.8% -1.1% +12.6% ➖ noise
9 datafusion:arrow +1.3% +4.7% -3.2% +12.6% ➖ noise
9 datafusion:vortex-compact +5.7% +4.7% +1.0% +12.6% ➖ noise
9 datafusion:vortex-file-compressed +9.1% +4.7% +4.2% +12.6% ➖ noise
9 duckdb:duckdb +1.5% +4.7% -3.0% +12.6% ➖ noise
9 duckdb:vortex-compact +5.4% +4.7% +0.7% +12.6% ➖ noise
9 duckdb:vortex-file-compressed +4.5% +4.7% -0.2% +12.6% ➖ noise
10 datafusion:arrow -1.7% +2.5% -4.0% +12.6% ➖ noise
10 datafusion:vortex-compact +2.4% +2.5% -0.0% +12.6% ➖ noise
10 datafusion:vortex-file-compressed +1.7% +2.5% -0.7% +12.6% ➖ noise
10 duckdb:duckdb -5.8% +2.5% -8.1% +12.6% ➖ noise
10 duckdb:vortex-compact +4.3% +2.5% +1.8% +12.6% ➖ noise
10 duckdb:vortex-file-compressed +4.1% +2.5% +1.6% +12.6% ➖ noise
11 datafusion:arrow -1.3% +5.6% -6.5% +12.6% ➖ noise
11 datafusion:vortex-compact +7.6% +5.6% +1.9% +12.6% ➖ noise
11 datafusion:vortex-file-compressed +6.6% +5.6% +1.0% +12.6% ➖ noise
11 duckdb:duckdb +4.6% +5.6% -0.9% +12.6% ➖ noise
11 duckdb:vortex-compact +2.4% +5.6% -3.1% +12.6% ➖ noise
11 duckdb:vortex-file-compressed +5.3% +5.6% -0.3% +12.6% ➖ noise
12 datafusion:arrow +6.0% -0.6% +6.6% +19.8% ➖ noise
12 datafusion:vortex-compact +1.6% -0.6% +2.2% +12.6% ➖ noise
12 datafusion:vortex-file-compressed +5.5% -0.6% +6.1% +12.6% ➖ noise
12 duckdb:duckdb +4.7% -0.6% +5.3% +12.6% ➖ noise
12 duckdb:vortex-compact +1.4% -0.6% +1.9% +12.6% ➖ noise
12 duckdb:vortex-file-compressed +6.8% -0.6% +7.4% +12.6% ➖ noise
13 datafusion:arrow -0.4% +4.6% -4.8% +12.6% ➖ noise
13 datafusion:vortex-compact +1.6% +4.6% -2.8% +12.6% ➖ noise
13 datafusion:vortex-file-compressed +3.4% +4.6% -1.2% +12.6% ➖ noise
13 duckdb:duckdb -0.5% +4.6% -4.8% +12.6% ➖ noise
13 duckdb:vortex-compact +1.2% +4.6% -3.2% +12.6% ➖ noise
13 duckdb:vortex-file-compressed +8.0% +4.6% +3.2% +12.6% ➖ noise
14 datafusion:arrow +4.6% -9.4% +15.4% +12.6% 🚨 regression
14 datafusion:vortex-compact +2.3% -9.4% +12.9% +12.6% 🚨 regression
14 datafusion:vortex-file-compressed +5.1% -9.4% +16.0% +12.6% 🚨 regression
14 duckdb:duckdb +2.4% -9.4% +13.1% +15.3% ➖ noise
14 duckdb:vortex-compact +5.7% -9.4% +16.7% +12.6% 🚨 regression
14 duckdb:vortex-file-compressed +6.4% -9.4% +17.4% +12.6% 🚨 regression
15 datafusion:arrow +1.4% +1.8% -0.4% +12.6% ➖ noise
15 datafusion:vortex-compact +11.6% +1.8% +9.6% +12.6% ➖ noise
15 datafusion:vortex-file-compressed +3.6% +1.8% +1.7% +12.6% ➖ noise
15 duckdb:duckdb +0.4% +1.8% -1.4% +17.3% ➖ noise
15 duckdb:vortex-compact +2.3% +1.8% +0.4% +12.6% ➖ noise
15 duckdb:vortex-file-compressed +2.6% +1.8% +0.8% +12.6% ➖ noise
16 datafusion:arrow +3.3% +3.1% +0.2% +12.6% ➖ noise
16 datafusion:vortex-compact -1.1% +3.1% -4.1% +12.6% ➖ noise
16 datafusion:vortex-file-compressed +1.9% +3.1% -1.1% +12.6% ➖ noise
16 duckdb:duckdb +0.7% +3.1% -2.3% +12.6% ➖ noise
16 duckdb:vortex-compact +6.4% +3.1% +3.2% +12.6% ➖ noise
16 duckdb:vortex-file-compressed +8.2% +3.1% +5.0% +12.6% ➖ noise
17 datafusion:arrow +8.4% +9.7% -1.2% +12.6% ➖ noise
17 datafusion:vortex-compact +3.7% +9.7% -5.5% +12.6% ➖ noise
17 datafusion:vortex-file-compressed +3.4% +9.7% -5.7% +12.6% ➖ noise
17 duckdb:duckdb +3.2% +9.7% -5.9% +12.8% ➖ noise
17 duckdb:vortex-compact +4.8% +9.7% -4.5% +12.6% ➖ noise
17 duckdb:vortex-file-compressed +5.8% +9.7% -3.6% +12.6% ➖ noise
18 datafusion:arrow +9.2% +3.1% +6.0% +12.6% ➖ noise
18 datafusion:vortex-compact +0.0% +3.1% -3.0% +12.6% ➖ noise
18 datafusion:vortex-file-compressed +4.0% +3.1% +0.9% +12.6% ➖ noise
18 duckdb:duckdb +2.0% +3.1% -1.0% +12.6% ➖ noise
18 duckdb:vortex-compact +4.5% +3.1% +1.4% +12.6% ➖ noise
18 duckdb:vortex-file-compressed +7.0% +3.1% +3.8% +12.6% ➖ noise
19 datafusion:arrow +9.0% -2.1% +11.3% +16.7% ➖ noise
19 datafusion:vortex-compact +1.6% -2.1% +3.7% +13.0% ➖ noise
19 datafusion:vortex-file-compressed +1.3% -2.1% +3.4% +15.0% ➖ noise
19 duckdb:duckdb +4.9% -2.1% +7.2% +14.0% ➖ noise
19 duckdb:vortex-compact +2.6% -2.1% +4.7% +12.6% ➖ noise
19 duckdb:vortex-file-compressed +3.5% -2.1% +5.7% +13.3% ➖ noise
20 datafusion:arrow +5.9% +5.7% +0.2% +12.6% ➖ noise
20 datafusion:vortex-compact -1.5% +5.7% -6.8% +12.6% ➖ noise
20 datafusion:vortex-file-compressed +5.0% +5.7% -0.7% +12.6% ➖ noise
20 duckdb:duckdb -2.6% +5.7% -7.8% +12.6% ➖ noise
20 duckdb:vortex-compact +2.6% +5.7% -2.9% +12.6% ➖ noise
20 duckdb:vortex-file-compressed +3.4% +5.7% -2.1% +12.6% ➖ noise
21 datafusion:arrow +4.8% +2.7% +2.0% +12.6% ➖ noise
21 datafusion:vortex-compact +5.3% +2.7% +2.5% +12.6% ➖ noise
21 datafusion:vortex-file-compressed +6.3% +2.7% +3.5% +12.6% ➖ noise
21 duckdb:duckdb +6.1% +2.7% +3.3% +12.6% ➖ noise
21 duckdb:vortex-compact +4.7% +2.7% +1.9% +12.6% ➖ noise
21 duckdb:vortex-file-compressed +1.9% +2.7% -0.8% +12.6% ➖ noise
22 datafusion:arrow +5.2% +3.4% +1.7% +12.6% ➖ noise
22 datafusion:vortex-compact +0.3% +3.4% -3.0% +12.6% ➖ noise
22 datafusion:vortex-file-compressed +3.6% +3.4% +0.2% +12.6% ➖ noise
22 duckdb:duckdb +0.4% +3.4% -2.9% +12.6% ➖ noise
22 duckdb:vortex-compact +10.0% +3.4% +6.3% +12.6% ➖ noise
22 duckdb:vortex-file-compressed +3.2% +3.4% -0.2% +12.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Vortex (geomean): 1.016x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish +1.2%


datafusion / vortex-file-compressed (1.016x ➖, 0↑ 4↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27300280 25348200 1.08
tpcds_q02/datafusion:vortex-file-compressed 47076718 46401150 1.01
tpcds_q03/datafusion:vortex-file-compressed 15372028 15443728 1.00
tpcds_q04/datafusion:vortex-file-compressed 255314451 250285135 1.02
tpcds_q05/datafusion:vortex-file-compressed 44644989 41974957 1.06
tpcds_q06/datafusion:vortex-file-compressed 59754370 59388186 1.01
tpcds_q07/datafusion:vortex-file-compressed 41681557 41692331 1.00
tpcds_q08/datafusion:vortex-file-compressed 29471629 28825246 1.02
tpcds_q09/datafusion:vortex-file-compressed 45482760 46215235 0.98
tpcds_q10/datafusion:vortex-file-compressed 41323336 39258196 1.05
tpcds_q11/datafusion:vortex-file-compressed 134684821 134178316 1.00
tpcds_q12/datafusion:vortex-file-compressed 19926882 20614785 0.97
tpcds_q13/datafusion:vortex-file-compressed 44673469 45351120 0.99
tpcds_q14/datafusion:vortex-file-compressed 180890782 170919748 1.06
tpcds_q15/datafusion:vortex-file-compressed 28014504 30201050 0.93
tpcds_q16/datafusion:vortex-file-compressed 29397779 28760944 1.02
tpcds_q17/datafusion:vortex-file-compressed 61554640 62447204 0.99
tpcds_q18/datafusion:vortex-file-compressed 69121978 67907468 1.02
tpcds_q19/datafusion:vortex-file-compressed 23295331 22201402 1.05
tpcds_q20/datafusion:vortex-file-compressed 🚨 24192370 21709485 1.11
tpcds_q21/datafusion:vortex-file-compressed 🚨 39160198 35061371 1.12
tpcds_q22/datafusion:vortex-file-compressed 🚨 147385288 117792123 1.25
tpcds_q23/datafusion:vortex-file-compressed 165465022 154871712 1.07
tpcds_q24/datafusion:vortex-file-compressed 88904878 83720216 1.06
tpcds_q25/datafusion:vortex-file-compressed 68907691 68014224 1.01
tpcds_q26/datafusion:vortex-file-compressed 33878598 33377392 1.02
tpcds_q27/datafusion:vortex-file-compressed 102679364 105719956 0.97
tpcds_q28/datafusion:vortex-file-compressed 41704314 43353214 0.96
tpcds_q29/datafusion:vortex-file-compressed 65518202 61343787 1.07
tpcds_q30/datafusion:vortex-file-compressed 23510307 23329060 1.01
tpcds_q31/datafusion:vortex-file-compressed 74404849 74107734 1.00
tpcds_q32/datafusion:vortex-file-compressed 21546770 20706007 1.04
tpcds_q33/datafusion:vortex-file-compressed 30945864 29796393 1.04
tpcds_q34/datafusion:vortex-file-compressed 26217503 24250977 1.08
tpcds_q35/datafusion:vortex-file-compressed 46434209 44670356 1.04
tpcds_q36/datafusion:vortex-file-compressed 58544703 58057613 1.01
tpcds_q37/datafusion:vortex-file-compressed 25474099 25797630 0.99
tpcds_q38/datafusion:vortex-file-compressed 45127343 42628528 1.06
tpcds_q39/datafusion:vortex-file-compressed 103364951 104855883 0.99
tpcds_q40/datafusion:vortex-file-compressed 31819085 32516201 0.98
tpcds_q41/datafusion:vortex-file-compressed 15766533 16110445 0.98
tpcds_q42/datafusion:vortex-file-compressed 14461765 13914791 1.04
tpcds_q43/datafusion:vortex-file-compressed 19072622 18940523 1.01
tpcds_q44/datafusion:vortex-file-compressed 31341020 33499534 0.94
tpcds_q45/datafusion:vortex-file-compressed 27129815 27333431 0.99
tpcds_q46/datafusion:vortex-file-compressed 34966797 35120425 1.00
tpcds_q47/datafusion:vortex-file-compressed 137659681 134218323 1.03
tpcds_q48/datafusion:vortex-file-compressed 38851996 37918353 1.02
tpcds_q49/datafusion:vortex-file-compressed 57935322 59786038 0.97
tpcds_q50/datafusion:vortex-file-compressed 39949258 39357701 1.02
tpcds_q51/datafusion:vortex-file-compressed 95925431 89417575 1.07
tpcds_q52/datafusion:vortex-file-compressed 14699374 15003419 0.98
tpcds_q53/datafusion:vortex-file-compressed 22022881 21470620 1.03
tpcds_q54/datafusion:vortex-file-compressed 35111860 35274448 1.00
tpcds_q55/datafusion:vortex-file-compressed 14344574 13962769 1.03
tpcds_q56/datafusion:vortex-file-compressed 29975533 30697402 0.98
tpcds_q57/datafusion:vortex-file-compressed 108660653 106637403 1.02
tpcds_q58/datafusion:vortex-file-compressed 53606216 52555094 1.02
tpcds_q59/datafusion:vortex-file-compressed 57540103 57110701 1.01
tpcds_q60/datafusion:vortex-file-compressed 30027124 29742332 1.01
tpcds_q61/datafusion:vortex-file-compressed 41308082 41950585 0.98
tpcds_q62/datafusion:vortex-file-compressed 🚨 26928704 22385050 1.20
tpcds_q63/datafusion:vortex-file-compressed 21554006 21216041 1.02
tpcds_q64/datafusion:vortex-file-compressed 408478423 404196413 1.01
tpcds_q65/datafusion:vortex-file-compressed 41656131 40426431 1.03
tpcds_q66/datafusion:vortex-file-compressed 72245239 70579892 1.02
tpcds_q67/datafusion:vortex-file-compressed 142199039 148635928 0.96
tpcds_q68/datafusion:vortex-file-compressed 33671228 34319284 0.98
tpcds_q69/datafusion:vortex-file-compressed 36793232 37043120 0.99
tpcds_q70/datafusion:vortex-file-compressed 84977051 88245628 0.96
tpcds_q71/datafusion:vortex-file-compressed 23701542 22975001 1.03
tpcds_q72/datafusion:vortex-file-compressed 2147628771 2106221788 1.02
tpcds_q73/datafusion:vortex-file-compressed 23020286 22780567 1.01
tpcds_q74/datafusion:vortex-file-compressed 81087939 78175686 1.04
tpcds_q75/datafusion:vortex-file-compressed 108229873 109241058 0.99
tpcds_q76/datafusion:vortex-file-compressed 24626392 24662783 1.00
tpcds_q77/datafusion:vortex-file-compressed 40049496 40328082 0.99
tpcds_q78/datafusion:vortex-file-compressed 123988239 123180385 1.01
tpcds_q79/datafusion:vortex-file-compressed 29067243 28351622 1.03
tpcds_q80/datafusion:vortex-file-compressed 95934632 93254323 1.03
tpcds_q81/datafusion:vortex-file-compressed 23541949 23879519 0.99
tpcds_q82/datafusion:vortex-file-compressed 26610619 26944319 0.99
tpcds_q83/datafusion:vortex-file-compressed 33358093 33901935 0.98
tpcds_q84/datafusion:vortex-file-compressed 12957037 13087688 0.99
tpcds_q85/datafusion:vortex-file-compressed 93214809 90901776 1.03
tpcds_q86/datafusion:vortex-file-compressed 18135114 18293979 0.99
tpcds_q87/datafusion:vortex-file-compressed 43899995 44028638 1.00
tpcds_q88/datafusion:vortex-file-compressed 56080437 54229466 1.03
tpcds_q89/datafusion:vortex-file-compressed 25772717 24539410 1.05
tpcds_q90/datafusion:vortex-file-compressed 14684237 14672588 1.00
tpcds_q91/datafusion:vortex-file-compressed 18985267 18154270 1.05
tpcds_q92/datafusion:vortex-file-compressed 19279908 18767394 1.03
tpcds_q93/datafusion:vortex-file-compressed 33293902 33934580 0.98
tpcds_q94/datafusion:vortex-file-compressed 23355600 25240147 0.93
tpcds_q95/datafusion:vortex-file-compressed 60473431 58555465 1.03
tpcds_q96/datafusion:vortex-file-compressed 13791208 13787097 1.00
tpcds_q97/datafusion:vortex-file-compressed 32827742 32153841 1.02
tpcds_q98/datafusion:vortex-file-compressed 25102789 24744332 1.01
tpcds_q99/datafusion:vortex-file-compressed 28307653 28055507 1.01
datafusion / vortex-compact (1.009x ➖, 1↑ 1↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 26258802 25707197 1.02
tpcds_q02/datafusion:vortex-compact 53764789 53368818 1.01
tpcds_q03/datafusion:vortex-compact 19563734 20649331 0.95
tpcds_q04/datafusion:vortex-compact 300575655 300890252 1.00
tpcds_q05/datafusion:vortex-compact 47856228 49492557 0.97
tpcds_q06/datafusion:vortex-compact 62113563 64172786 0.97
tpcds_q07/datafusion:vortex-compact 54035794 53056470 1.02
tpcds_q08/datafusion:vortex-compact 36104811 36145589 1.00
tpcds_q09/datafusion:vortex-compact 63061402 63427214 0.99
tpcds_q10/datafusion:vortex-compact 51306256 49913102 1.03
tpcds_q11/datafusion:vortex-compact 145741362 149275197 0.98
tpcds_q12/datafusion:vortex-compact 25204502 26062591 0.97
tpcds_q13/datafusion:vortex-compact 92158896 93279377 0.99
tpcds_q14/datafusion:vortex-compact 199942464 201114552 0.99
tpcds_q15/datafusion:vortex-compact 31058605 29982134 1.04
tpcds_q16/datafusion:vortex-compact 31966117 31962767 1.00
tpcds_q17/datafusion:vortex-compact 73960405 74565275 0.99
tpcds_q18/datafusion:vortex-compact 77216591 76957274 1.00
tpcds_q19/datafusion:vortex-compact 30269728 29916027 1.01
tpcds_q20/datafusion:vortex-compact 25232468 25836139 0.98
tpcds_q21/datafusion:vortex-compact 40426720 39738224 1.02
tpcds_q22/datafusion:vortex-compact 🚀 122660360 145204005 0.84
tpcds_q23/datafusion:vortex-compact 165154383 170878304 0.97
tpcds_q24/datafusion:vortex-compact 97145138 99391775 0.98
tpcds_q25/datafusion:vortex-compact 84311727 79520594 1.06
tpcds_q26/datafusion:vortex-compact 44786169 45151899 0.99
tpcds_q27/datafusion:vortex-compact 128831139 124664870 1.03
tpcds_q28/datafusion:vortex-compact 79672684 80077871 0.99
tpcds_q29/datafusion:vortex-compact 76012519 75601456 1.01
tpcds_q30/datafusion:vortex-compact 27862197 27251143 1.02
tpcds_q31/datafusion:vortex-compact 97643431 96223102 1.01
tpcds_q32/datafusion:vortex-compact 27362609 26215137 1.04
tpcds_q33/datafusion:vortex-compact 38762932 36393976 1.07
tpcds_q34/datafusion:vortex-compact 32805770 31842354 1.03
tpcds_q35/datafusion:vortex-compact 53185332 52126599 1.02
tpcds_q36/datafusion:vortex-compact 75960221 76112943 1.00
tpcds_q37/datafusion:vortex-compact 41937562 40826868 1.03
tpcds_q38/datafusion:vortex-compact 54246481 51378863 1.06
tpcds_q39/datafusion:vortex-compact 113990463 116518035 0.98
tpcds_q40/datafusion:vortex-compact 37234255 36299599 1.03
tpcds_q41/datafusion:vortex-compact 18973422 18116537 1.05
tpcds_q42/datafusion:vortex-compact 18849150 18079992 1.04
tpcds_q43/datafusion:vortex-compact 24801828 25202467 0.98
tpcds_q44/datafusion:vortex-compact 50959957 49453245 1.03
tpcds_q45/datafusion:vortex-compact 34431378 32109892 1.07
tpcds_q46/datafusion:vortex-compact 45795122 44784368 1.02
tpcds_q47/datafusion:vortex-compact 152948035 152910178 1.00
tpcds_q48/datafusion:vortex-compact 73404715 70905055 1.04
tpcds_q49/datafusion:vortex-compact 71209695 69598419 1.02
tpcds_q50/datafusion:vortex-compact 49129759 47778320 1.03
tpcds_q51/datafusion:vortex-compact 95456338 96498020 0.99
tpcds_q52/datafusion:vortex-compact 19010696 19002393 1.00
tpcds_q53/datafusion:vortex-compact 28424487 28589805 0.99
tpcds_q54/datafusion:vortex-compact 43104117 42716834 1.01
tpcds_q55/datafusion:vortex-compact 18521264 18042952 1.03
tpcds_q56/datafusion:vortex-compact 37244681 36084900 1.03
tpcds_q57/datafusion:vortex-compact 113052461 117480273 0.96
tpcds_q58/datafusion:vortex-compact 65567179 61452988 1.07
tpcds_q59/datafusion:vortex-compact 72040041 69981063 1.03
tpcds_q60/datafusion:vortex-compact 37807411 37292028 1.01
tpcds_q61/datafusion:vortex-compact 56265214 55016488 1.02
tpcds_q62/datafusion:vortex-compact 26662448 28745309 0.93
tpcds_q63/datafusion:vortex-compact 28436904 28467376 1.00
tpcds_q64/datafusion:vortex-compact 454357042 448963030 1.01
tpcds_q65/datafusion:vortex-compact 54646829 53845089 1.01
tpcds_q66/datafusion:vortex-compact 79606120 76406260 1.04
tpcds_q67/datafusion:vortex-compact 153011417 150437429 1.02
tpcds_q68/datafusion:vortex-compact 45478545 45208317 1.01
tpcds_q69/datafusion:vortex-compact 48497121 47584929 1.02
tpcds_q70/datafusion:vortex-compact 101697149 97232611 1.05
tpcds_q71/datafusion:vortex-compact 28907213 30415445 0.95
tpcds_q72/datafusion:vortex-compact 2148381090 2112868643 1.02
tpcds_q73/datafusion:vortex-compact 31320281 31333426 1.00
tpcds_q74/datafusion:vortex-compact 94470312 93153572 1.01
tpcds_q75/datafusion:vortex-compact 128981354 128331696 1.01
tpcds_q76/datafusion:vortex-compact 32495278 32359155 1.00
tpcds_q77/datafusion:vortex-compact 50709387 51445794 0.99
tpcds_q78/datafusion:vortex-compact 142665108 136075233 1.05
tpcds_q79/datafusion:vortex-compact 38675875 38304350 1.01
tpcds_q80/datafusion:vortex-compact 105420915 104243281 1.01
tpcds_q81/datafusion:vortex-compact 29051276 28430413 1.02
tpcds_q82/datafusion:vortex-compact 40934167 42014953 0.97
tpcds_q83/datafusion:vortex-compact 33525878 33832164 0.99
tpcds_q84/datafusion:vortex-compact 15129359 14621490 1.03
tpcds_q85/datafusion:vortex-compact 121238301 120558873 1.01
tpcds_q86/datafusion:vortex-compact 🚨 20826489 18737639 1.11
tpcds_q87/datafusion:vortex-compact 53539625 51156726 1.05
tpcds_q88/datafusion:vortex-compact 80055311 77654589 1.03
tpcds_q89/datafusion:vortex-compact 31687590 31431735 1.01
tpcds_q90/datafusion:vortex-compact 15635032 15148786 1.03
tpcds_q91/datafusion:vortex-compact 32886545 33269259 0.99
tpcds_q92/datafusion:vortex-compact 24794660 25079805 0.99
tpcds_q93/datafusion:vortex-compact 39899698 38485407 1.04
tpcds_q94/datafusion:vortex-compact 27308203 26943081 1.01
tpcds_q95/datafusion:vortex-compact 63827749 61960947 1.03
tpcds_q96/datafusion:vortex-compact 17518432 18674469 0.94
tpcds_q97/datafusion:vortex-compact 36010178 38239389 0.94
tpcds_q98/datafusion:vortex-compact 30797708 30213840 1.02
tpcds_q99/datafusion:vortex-compact 34886245 31937754 1.09
datafusion / parquet (1.009x ➖, 0↑ 2↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 29979294 30943878 0.97
tpcds_q02/datafusion:parquet 41608420 43635855 0.95
tpcds_q03/datafusion:parquet 13608327 14080924 0.97
tpcds_q04/datafusion:parquet 266276364 268834969 0.99
tpcds_q05/datafusion:parquet 41718531 42775908 0.98
tpcds_q06/datafusion:parquet 60027397 59099200 1.02
tpcds_q07/datafusion:parquet 78466765 79644155 0.99
tpcds_q08/datafusion:parquet 26870409 25747123 1.04
tpcds_q09/datafusion:parquet 45453499 43744308 1.04
tpcds_q10/datafusion:parquet 74080006 71799557 1.03
tpcds_q11/datafusion:parquet 161676560 149504803 1.08
tpcds_q12/datafusion:parquet 18545217 17467084 1.06
tpcds_q13/datafusion:parquet 75559487 76611925 0.99
tpcds_q14/datafusion:parquet 164475182 165868318 0.99
tpcds_q15/datafusion:parquet 21087040 21971442 0.96
tpcds_q16/datafusion:parquet 24726065 25824371 0.96
tpcds_q17/datafusion:parquet 62853161 63577116 0.99
tpcds_q18/datafusion:parquet 112857396 113490468 0.99
tpcds_q19/datafusion:parquet 23038889 23897064 0.96
tpcds_q20/datafusion:parquet 16498787 16765575 0.98
tpcds_q21/datafusion:parquet 18877872 18566268 1.02
tpcds_q22/datafusion:parquet 134844055 142228914 0.95
tpcds_q23/datafusion:parquet 141997546 143455672 0.99
tpcds_q24/datafusion:parquet 92854438 90277607 1.03
tpcds_q25/datafusion:parquet 64443748 63015250 1.02
tpcds_q26/datafusion:parquet 67869543 68265285 0.99
tpcds_q27/datafusion:parquet 150448873 147269095 1.02
tpcds_q28/datafusion:parquet 45448919 44947520 1.01
tpcds_q29/datafusion:parquet 65304248 65642578 0.99
tpcds_q30/datafusion:parquet 35613721 35723409 1.00
tpcds_q31/datafusion:parquet 64949812 65342120 0.99
tpcds_q32/datafusion:parquet 18990797 18345407 1.04
tpcds_q33/datafusion:parquet 27575066 26978783 1.02
tpcds_q34/datafusion:parquet 23608669 23028471 1.03
tpcds_q35/datafusion:parquet 71874168 71038703 1.01
tpcds_q36/datafusion:parquet 57257463 55549360 1.03
tpcds_q37/datafusion:parquet 20663782 19390628 1.07
tpcds_q38/datafusion:parquet 41864750 41270374 1.01
tpcds_q39/datafusion:parquet 70383476 71418924 0.99
tpcds_q40/datafusion:parquet 23904719 22980825 1.04
tpcds_q41/datafusion:parquet 13350826 13675320 0.98
tpcds_q42/datafusion:parquet 12131902 12086355 1.00
tpcds_q43/datafusion:parquet 17821049 18980139 0.94
tpcds_q44/datafusion:parquet 35074480 32954191 1.06
tpcds_q45/datafusion:parquet 27768591 28135609 0.99
tpcds_q46/datafusion:parquet 31394080 31627610 0.99
tpcds_q47/datafusion:parquet 125340410 123171281 1.02
tpcds_q48/datafusion:parquet 70215829 70353408 1.00
tpcds_q49/datafusion:parquet 55371916 54865940 1.01
tpcds_q50/datafusion:parquet 43345569 42440659 1.02
tpcds_q51/datafusion:parquet 84676292 86279272 0.98
tpcds_q52/datafusion:parquet 12642370 12551005 1.01
tpcds_q53/datafusion:parquet 18398752 17637662 1.04
tpcds_q54/datafusion:parquet 35713662 34252461 1.04
tpcds_q55/datafusion:parquet 12072515 11423612 1.06
tpcds_q56/datafusion:parquet 28024593 27706052 1.01
tpcds_q57/datafusion:parquet 92789359 95693256 0.97
tpcds_q58/datafusion:parquet 49331890 50750091 0.97
tpcds_q59/datafusion:parquet 52737147 52801268 1.00
tpcds_q60/datafusion:parquet 27031744 28164615 0.96
tpcds_q61/datafusion:parquet 43551174 42696875 1.02
tpcds_q62/datafusion:parquet 25117938 24884520 1.01
tpcds_q63/datafusion:parquet 17804833 17689601 1.01
tpcds_q64/datafusion:parquet 523697862 520882050 1.01
tpcds_q65/datafusion:parquet 38040714 37434884 1.02
tpcds_q66/datafusion:parquet 65277931 65622404 0.99
tpcds_q67/datafusion:parquet 141342325 145703876 0.97
tpcds_q68/datafusion:parquet 31978577 31772920 1.01
tpcds_q69/datafusion:parquet 71457999 68341615 1.05
tpcds_q70/datafusion:parquet 87298525 84331976 1.04
tpcds_q71/datafusion:parquet 22416032 23412043 0.96
tpcds_q72/datafusion:parquet 595122578 590783183 1.01
tpcds_q73/datafusion:parquet 20964386 20906392 1.00
tpcds_q74/datafusion:parquet 84022142 83926788 1.00
tpcds_q75/datafusion:parquet 97276991 100891284 0.96
tpcds_q76/datafusion:parquet 29776248 30514165 0.98
tpcds_q77/datafusion:parquet 39311319 38107531 1.03
tpcds_q78/datafusion:parquet 112158599 111984255 1.00
tpcds_q79/datafusion:parquet 27207758 26601893 1.02
tpcds_q80/datafusion:parquet 79358182 78695822 1.01
tpcds_q81/datafusion:parquet 31791935 32162490 0.99
tpcds_q82/datafusion:parquet 19447019 20338104 0.96
tpcds_q83/datafusion:parquet 36386536 37478354 0.97
tpcds_q84/datafusion:parquet 40088055 40239454 1.00
tpcds_q85/datafusion:parquet 150386725 147686114 1.02
tpcds_q86/datafusion:parquet 15452830 15671544 0.99
tpcds_q87/datafusion:parquet 41441095 40527879 1.02
tpcds_q88/datafusion:parquet 59941210 58746443 1.02
tpcds_q89/datafusion:parquet 21560220 21742079 0.99
tpcds_q90/datafusion:parquet 15046854 14066846 1.07
tpcds_q91/datafusion:parquet 59851639 59271904 1.01
tpcds_q92/datafusion:parquet 19485368 17891125 1.09
tpcds_q93/datafusion:parquet 32959978 30864131 1.07
tpcds_q94/datafusion:parquet 19497523 20273652 0.96
tpcds_q95/datafusion:parquet 58347734 57858397 1.01
tpcds_q96/datafusion:parquet 🚨 12689785 11525450 1.10
tpcds_q97/datafusion:parquet 29902192 29604209 1.01
tpcds_q98/datafusion:parquet 21601719 21736175 0.99
tpcds_q99/datafusion:parquet 🚨 33498141 24288596 1.38
duckdb / vortex-file-compressed (1.005x ➖, 2↑ 3↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21613527 21777538 0.99
tpcds_q02/duckdb:vortex-file-compressed 32860860 34002771 0.97
tpcds_q03/duckdb:vortex-file-compressed 31644807 31213655 1.01
tpcds_q04/duckdb:vortex-file-compressed 106438081 101385390 1.05
tpcds_q05/duckdb:vortex-file-compressed 38371841 38254062 1.00
tpcds_q06/duckdb:vortex-file-compressed 32839174 31623350 1.04
tpcds_q07/duckdb:vortex-file-compressed 20426482 19543690 1.05
tpcds_q08/duckdb:vortex-file-compressed 29818567 28872074 1.03
tpcds_q09/duckdb:vortex-file-compressed 40013319 40566097 0.99
tpcds_q10/duckdb:vortex-file-compressed 40398828 41087121 0.98
tpcds_q11/duckdb:vortex-file-compressed 61831158 59862292 1.03
tpcds_q12/duckdb:vortex-file-compressed 14741249 14530615 1.01
tpcds_q13/duckdb:vortex-file-compressed 34052705 33779353 1.01
tpcds_q14/duckdb:vortex-file-compressed 104166906 101642994 1.02
tpcds_q15/duckdb:vortex-file-compressed 26720375 27198702 0.98
tpcds_q16/duckdb:vortex-file-compressed 27178389 26636370 1.02
tpcds_q17/duckdb:vortex-file-compressed 43729676 42027871 1.04
tpcds_q18/duckdb:vortex-file-compressed 45274214 45792493 0.99
tpcds_q19/duckdb:vortex-file-compressed 33685562 32718453 1.03
tpcds_q20/duckdb:vortex-file-compressed 15403723 15623093 0.99
tpcds_q21/duckdb:vortex-file-compressed 16538609 16723625 0.99
tpcds_q22/duckdb:vortex-file-compressed 74446261 74208429 1.00
tpcds_q23/duckdb:vortex-file-compressed 🚨 106123896 94196213 1.13
tpcds_q24/duckdb:vortex-file-compressed 48455814 50526232 0.96
tpcds_q25/duckdb:vortex-file-compressed 51117151 48365379 1.06
tpcds_q26/duckdb:vortex-file-compressed 39842586 39717486 1.00
tpcds_q27/duckdb:vortex-file-compressed 48746653 47464861 1.03
tpcds_q28/duckdb:vortex-file-compressed 34506954 35945195 0.96
tpcds_q29/duckdb:vortex-file-compressed 40822463 42049013 0.97
tpcds_q30/duckdb:vortex-file-compressed 23766267 24864286 0.96
tpcds_q31/duckdb:vortex-file-compressed 34447390 36956893 0.93
tpcds_q32/duckdb:vortex-file-compressed 14779034 14979831 0.99
tpcds_q33/duckdb:vortex-file-compressed 24821451 24852177 1.00
tpcds_q34/duckdb:vortex-file-compressed 24533063 22936603 1.07
tpcds_q35/duckdb:vortex-file-compressed 62874588 64576051 0.97
tpcds_q36/duckdb:vortex-file-compressed 24568114 24817195 0.99
tpcds_q37/duckdb:vortex-file-compressed 15374852 15226956 1.01
tpcds_q38/duckdb:vortex-file-compressed 35915019 37299265 0.96
tpcds_q39/duckdb:vortex-file-compressed 🚀 34576084 39707947 0.87
tpcds_q40/duckdb:vortex-file-compressed 19535767 19420105 1.01
tpcds_q41/duckdb:vortex-file-compressed 13453284 13496576 1.00
tpcds_q42/duckdb:vortex-file-compressed 13146911 13461368 0.98
tpcds_q43/duckdb:vortex-file-compressed 23062046 21963740 1.05
tpcds_q44/duckdb:vortex-file-compressed 20874341 20283326 1.03
tpcds_q45/duckdb:vortex-file-compressed 29633951 28300206 1.05
tpcds_q46/duckdb:vortex-file-compressed 51464252 51524789 1.00
tpcds_q47/duckdb:vortex-file-compressed 47644356 46987237 1.01
tpcds_q48/duckdb:vortex-file-compressed 31069536 30696818 1.01
tpcds_q49/duckdb:vortex-file-compressed 36700936 34811547 1.05
tpcds_q50/duckdb:vortex-file-compressed 33556317 33832747 0.99
tpcds_q51/duckdb:vortex-file-compressed 🚨 121815550 104135510 1.17
tpcds_q52/duckdb:vortex-file-compressed 13216524 13435831 0.98
tpcds_q53/duckdb:vortex-file-compressed 22877130 22313385 1.03
tpcds_q54/duckdb:vortex-file-compressed 27879462 27716219 1.01
tpcds_q55/duckdb:vortex-file-compressed 13662490 12914732 1.06
tpcds_q56/duckdb:vortex-file-compressed 24403785 26240134 0.93
tpcds_q57/duckdb:vortex-file-compressed 39031198 38863489 1.00
tpcds_q58/duckdb:vortex-file-compressed 30702808 30140055 1.02
tpcds_q59/duckdb:vortex-file-compressed 66769873 69063062 0.97
tpcds_q60/duckdb:vortex-file-compressed 27166589 26971922 1.01
tpcds_q61/duckdb:vortex-file-compressed 🚀 30642084 34749844 0.88
tpcds_q62/duckdb:vortex-file-compressed 17609276 17079989 1.03
tpcds_q63/duckdb:vortex-file-compressed 21282556 21324175 1.00
tpcds_q64/duckdb:vortex-file-compressed 84737322 84799893 1.00
tpcds_q65/duckdb:vortex-file-compressed 21695982 21701959 1.00
tpcds_q66/duckdb:vortex-file-compressed 29876031 29702629 1.01
tpcds_q67/duckdb:vortex-file-compressed 137714569 140661135 0.98
tpcds_q68/duckdb:vortex-file-compressed 40698598 43203076 0.94
tpcds_q69/duckdb:vortex-file-compressed 41629236 40967866 1.02
tpcds_q70/duckdb:vortex-file-compressed 26214150 25544266 1.03
tpcds_q71/duckdb:vortex-file-compressed 20728794 20794503 1.00
tpcds_q72/duckdb:vortex-file-compressed 170416945 170393286 1.00
tpcds_q73/duckdb:vortex-file-compressed 24334423 22774114 1.07
tpcds_q74/duckdb:vortex-file-compressed 75636508 77404510 0.98
tpcds_q75/duckdb:vortex-file-compressed 60024037 57044467 1.05
tpcds_q76/duckdb:vortex-file-compressed 18968222 20124118 0.94
tpcds_q77/duckdb:vortex-file-compressed 25429256 27384002 0.93
tpcds_q78/duckdb:vortex-file-compressed 75357324 75122789 1.00
tpcds_q79/duckdb:vortex-file-compressed 33649373 32151115 1.05
tpcds_q80/duckdb:vortex-file-compressed 45709445 48204574 0.95
tpcds_q81/duckdb:vortex-file-compressed 29051253 28591758 1.02
tpcds_q82/duckdb:vortex-file-compressed 16538169 16363640 1.01
tpcds_q83/duckdb:vortex-file-compressed 24434757 22391792 1.09
tpcds_q84/duckdb:vortex-file-compressed 20062216 19294730 1.04
tpcds_q85/duckdb:vortex-file-compressed 45656331 44414330 1.03
tpcds_q86/duckdb:vortex-file-compressed 16278477 16509462 0.99
tpcds_q87/duckdb:vortex-file-compressed 40238615 39121636 1.03
tpcds_q88/duckdb:vortex-file-compressed 33245131 32577648 1.02
tpcds_q89/duckdb:vortex-file-compressed 22283848 22666857 0.98
tpcds_q90/duckdb:vortex-file-compressed 12488784 12528524 1.00
tpcds_q91/duckdb:vortex-file-compressed 30523238 30494614 1.00
tpcds_q92/duckdb:vortex-file-compressed 🚨 22367315 20092376 1.11
tpcds_q93/duckdb:vortex-file-compressed 28429833 28727908 0.99
tpcds_q94/duckdb:vortex-file-compressed 23308770 23346605 1.00
tpcds_q95/duckdb:vortex-file-compressed 157283892 154981846 1.01
tpcds_q96/duckdb:vortex-file-compressed 13061872 13612615 0.96
tpcds_q97/duckdb:vortex-file-compressed 37420203 36132498 1.04
tpcds_q98/duckdb:vortex-file-compressed 18533361 19043536 0.97
tpcds_q99/duckdb:vortex-file-compressed 29433828 28567287 1.03
duckdb / vortex-compact (1.035x ➖, 0↑ 9↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 22887196 23548901 0.97
tpcds_q02/duckdb:vortex-compact 43917991 43649830 1.01
tpcds_q03/duckdb:vortex-compact 58548658 56234595 1.04
tpcds_q04/duckdb:vortex-compact 119088662 117383303 1.01
tpcds_q05/duckdb:vortex-compact 54308236 52945627 1.03
tpcds_q06/duckdb:vortex-compact 40492661 41017609 0.99
tpcds_q07/duckdb:vortex-compact 34403710 34025008 1.01
tpcds_q08/duckdb:vortex-compact 47757079 45008974 1.06
tpcds_q09/duckdb:vortex-compact 57051997 57203637 1.00
tpcds_q10/duckdb:vortex-compact 61784611 61883833 1.00
tpcds_q11/duckdb:vortex-compact 70846358 76362745 0.93
tpcds_q12/duckdb:vortex-compact 22151951 21345896 1.04
tpcds_q13/duckdb:vortex-compact 61759055 61827708 1.00
tpcds_q14/duckdb:vortex-compact 131120186 128819498 1.02
tpcds_q15/duckdb:vortex-compact 32807787 31240091 1.05
tpcds_q16/duckdb:vortex-compact 32180696 30749755 1.05
tpcds_q17/duckdb:vortex-compact 56306757 56922730 0.99
tpcds_q18/duckdb:vortex-compact 58173445 57372375 1.01
tpcds_q19/duckdb:vortex-compact 51887585 52415008 0.99
tpcds_q20/duckdb:vortex-compact 20694755 20129225 1.03
tpcds_q21/duckdb:vortex-compact 19415772 18889530 1.03
tpcds_q22/duckdb:vortex-compact 77407074 74958440 1.03
tpcds_q23/duckdb:vortex-compact 🚨 139708263 124107562 1.13
tpcds_q24/duckdb:vortex-compact 63757384 63784549 1.00
tpcds_q25/duckdb:vortex-compact 80987971 79992805 1.01
tpcds_q26/duckdb:vortex-compact 51290440 53316033 0.96
tpcds_q27/duckdb:vortex-compact 68584098 71914747 0.95
tpcds_q28/duckdb:vortex-compact 85558892 87534913 0.98
tpcds_q29/duckdb:vortex-compact 52223265 53287899 0.98
tpcds_q30/duckdb:vortex-compact 29057548 28325765 1.03
tpcds_q31/duckdb:vortex-compact 48422435 44860879 1.08
tpcds_q32/duckdb:vortex-compact 22637908 23069692 0.98
tpcds_q33/duckdb:vortex-compact 35810024 36748710 0.97
tpcds_q34/duckdb:vortex-compact 41778580 39323438 1.06
tpcds_q35/duckdb:vortex-compact 83377541 82416389 1.01
tpcds_q36/duckdb:vortex-compact 42158009 41593624 1.01
tpcds_q37/duckdb:vortex-compact 23762607 24068716 0.99
tpcds_q38/duckdb:vortex-compact 48831480 47782371 1.02
tpcds_q39/duckdb:vortex-compact 36213884 36348319 1.00
tpcds_q40/duckdb:vortex-compact 25613235 24880043 1.03
tpcds_q41/duckdb:vortex-compact 16429810 15351345 1.07
tpcds_q42/duckdb:vortex-compact 22884226 22132675 1.03
tpcds_q43/duckdb:vortex-compact 37343900 34893283 1.07
tpcds_q44/duckdb:vortex-compact 29075129 29341440 0.99
tpcds_q45/duckdb:vortex-compact 40123252 39474124 1.02
tpcds_q46/duckdb:vortex-compact 73201225 73624766 0.99
tpcds_q47/duckdb:vortex-compact 65123690 63608387 1.02
tpcds_q48/duckdb:vortex-compact 54074658 52293415 1.03
tpcds_q49/duckdb:vortex-compact 56981027 58167458 0.98
tpcds_q50/duckdb:vortex-compact 49321902 47470187 1.04
tpcds_q51/duckdb:vortex-compact 110321451 109232836 1.01
tpcds_q52/duckdb:vortex-compact 23919687 22111319 1.08
tpcds_q53/duckdb:vortex-compact 41223417 39621327 1.04
tpcds_q54/duckdb:vortex-compact 42116667 42535455 0.99
tpcds_q55/duckdb:vortex-compact 23679455 22829299 1.04
tpcds_q56/duckdb:vortex-compact 38424737 35841784 1.07
tpcds_q57/duckdb:vortex-compact 46665255 44288553 1.05
tpcds_q58/duckdb:vortex-compact 🚨 47799707 43356499 1.10
tpcds_q59/duckdb:vortex-compact 92517518 85653384 1.08
tpcds_q60/duckdb:vortex-compact 40545779 39235488 1.03
tpcds_q61/duckdb:vortex-compact 63207108 61770631 1.02
tpcds_q62/duckdb:vortex-compact 27510366 27080449 1.02
tpcds_q63/duckdb:vortex-compact 37917732 38228406 0.99
tpcds_q64/duckdb:vortex-compact 119905166 117449155 1.02
tpcds_q65/duckdb:vortex-compact 32206406 33764233 0.95
tpcds_q66/duckdb:vortex-compact 40148875 38338611 1.05
tpcds_q67/duckdb:vortex-compact 152382359 149816055 1.02
tpcds_q68/duckdb:vortex-compact 62216094 62498082 1.00
tpcds_q69/duckdb:vortex-compact 63264783 64901188 0.97
tpcds_q70/duckdb:vortex-compact 36416634 36504985 1.00
tpcds_q71/duckdb:vortex-compact 35574452 34152229 1.04
tpcds_q72/duckdb:vortex-compact 195136651 191236957 1.02
tpcds_q73/duckdb:vortex-compact 38968178 38439921 1.01
tpcds_q74/duckdb:vortex-compact 🚨 107838247 84710625 1.27
tpcds_q75/duckdb:vortex-compact 77159697 77511989 1.00
tpcds_q76/duckdb:vortex-compact 35711138 34962963 1.02
tpcds_q77/duckdb:vortex-compact 43552230 42884637 1.02
tpcds_q78/duckdb:vortex-compact 89227302 88324545 1.01
tpcds_q79/duckdb:vortex-compact 56064403 53998435 1.04
tpcds_q80/duckdb:vortex-compact 🚨 92006093 82706425 1.11
tpcds_q81/duckdb:vortex-compact 35667860 32722080 1.09
tpcds_q82/duckdb:vortex-compact 26618681 25136587 1.06
tpcds_q83/duckdb:vortex-compact 🚨 35771786 31425368 1.14
tpcds_q84/duckdb:vortex-compact 🚨 30052792 26194963 1.15
tpcds_q85/duckdb:vortex-compact 62124383 57089020 1.09
tpcds_q86/duckdb:vortex-compact 26885919 24469037 1.10
tpcds_q87/duckdb:vortex-compact 53766352 51922097 1.04
tpcds_q88/duckdb:vortex-compact 42828830 39363654 1.09
tpcds_q89/duckdb:vortex-compact 39761543 38938859 1.02
tpcds_q90/duckdb:vortex-compact 🚨 17448766 15184310 1.15
tpcds_q91/duckdb:vortex-compact 🚨 57066319 51413697 1.11
tpcds_q92/duckdb:vortex-compact 52205908 48502771 1.08
tpcds_q93/duckdb:vortex-compact 🚨 38172365 30687208 1.24
tpcds_q94/duckdb:vortex-compact 34538648 31569934 1.09
tpcds_q95/duckdb:vortex-compact 170036413 159639652 1.07
tpcds_q96/duckdb:vortex-compact 19898319 18791275 1.06
tpcds_q97/duckdb:vortex-compact 46090141 45132462 1.02
tpcds_q98/duckdb:vortex-compact 31022258 28399537 1.09
tpcds_q99/duckdb:vortex-compact 34184356 32012116 1.07
duckdb / parquet (1.006x ➖, 0↑ 1↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 30066252 27893735 1.08
tpcds_q02/duckdb:parquet 23416305 23756366 0.99
tpcds_q03/duckdb:parquet 12450345 11475132 1.08
tpcds_q04/duckdb:parquet 166292151 165365308 1.01
tpcds_q05/duckdb:parquet 29749343 29664382 1.00
tpcds_q06/duckdb:parquet 27349107 27213015 1.01
tpcds_q07/duckdb:parquet 21963243 20838320 1.05
tpcds_q08/duckdb:parquet 26561172 26675079 1.00
tpcds_q09/duckdb:parquet 38921362 39099243 1.00
tpcds_q10/duckdb:parquet 33270874 32391371 1.03
tpcds_q11/duckdb:parquet 84714823 88467311 0.96
tpcds_q12/duckdb:parquet 14225890 14456206 0.98
tpcds_q13/duckdb:parquet 33142326 33401935 0.99
tpcds_q14/duckdb:parquet 98366571 99662479 0.99
tpcds_q15/duckdb:parquet 29370107 29802709 0.99
tpcds_q16/duckdb:parquet 21100689 20931016 1.01
tpcds_q17/duckdb:parquet 37629804 37207735 1.01
tpcds_q18/duckdb:parquet 44651265 45583141 0.98
tpcds_q19/duckdb:parquet 28374603 28007602 1.01
tpcds_q20/duckdb:parquet 15264713 14969186 1.02
tpcds_q21/duckdb:parquet 10008054 10192550 0.98
tpcds_q22/duckdb:parquet 70146916 69721641 1.01
tpcds_q23/duckdb:parquet 79360688 78701506 1.01
tpcds_q24/duckdb:parquet 44679106 44423665 1.01
tpcds_q25/duckdb:parquet 32365873 33209467 0.97
tpcds_q26/duckdb:parquet 33869911 35974680 0.94
tpcds_q27/duckdb:parquet 44629456 45302089 0.99
tpcds_q28/duckdb:parquet 37820366 37926284 1.00
tpcds_q29/duckdb:parquet 36232374 36201164 1.00
tpcds_q30/duckdb:parquet 34760834 33522185 1.04
tpcds_q31/duckdb:parquet 22565297 22348409 1.01
tpcds_q32/duckdb:parquet 11278030 10652504 1.06
tpcds_q33/duckdb:parquet 20405527 20946905 0.97
tpcds_q34/duckdb:parquet 19591593 21339540 0.92
tpcds_q35/duckdb:parquet 56348396 52957422 1.06
tpcds_q36/duckdb:parquet 19349519 19173027 1.01
tpcds_q37/duckdb:parquet 12636542 12341469 1.02
tpcds_q38/duckdb:parquet 34329592 33388056 1.03
tpcds_q39/duckdb:parquet 29706317 28823575 1.03
tpcds_q40/duckdb:parquet 17784289 16928641 1.05
tpcds_q41/duckdb:parquet 7419147 7570783 0.98
tpcds_q42/duckdb:parquet 9454121 9291941 1.02
tpcds_q43/duckdb:parquet 15087621 15536394 0.97
tpcds_q44/duckdb:parquet 21879282 21482635 1.02
tpcds_q45/duckdb:parquet 26004384 25271912 1.03
tpcds_q46/duckdb:parquet 43987849 45721336 0.96
tpcds_q47/duckdb:parquet 43898304 44079218 1.00
tpcds_q48/duckdb:parquet 28819347 29306730 0.98
tpcds_q49/duckdb:parquet 24090844 24862199 0.97
tpcds_q50/duckdb:parquet 24523673 24264893 1.01
tpcds_q51/duckdb:parquet 95466346 94508468 1.01
tpcds_q52/duckdb:parquet 10271898 10269896 1.00
tpcds_q53/duckdb:parquet 14827793 14391214 1.03
tpcds_q54/duckdb:parquet 25377603 25667932 0.99
tpcds_q55/duckdb:parquet 9893670 10065724 0.98
tpcds_q56/duckdb:parquet 20316007 21275332 0.95
tpcds_q57/duckdb:parquet 34336294 34894687 0.98
tpcds_q58/duckdb:parquet 21921003 22220174 0.99
tpcds_q59/duckdb:parquet 35535029 35436736 1.00
tpcds_q60/duckdb:parquet 21984534 21120116 1.04
tpcds_q61/duckdb:parquet 30293810 30225900 1.00
tpcds_q62/duckdb:parquet 11643343 12624204 0.92
tpcds_q63/duckdb:parquet 13927192 13787498 1.01
tpcds_q64/duckdb:parquet 72668831 72500688 1.00
tpcds_q65/duckdb:parquet 19414376 19871687 0.98
tpcds_q66/duckdb:parquet 27480459 26873943 1.02
tpcds_q67/duckdb:parquet 142132740 135432757 1.05
tpcds_q68/duckdb:parquet 38076920 35829255 1.06
tpcds_q69/duckdb:parquet 37290342 36100477 1.03
tpcds_q70/duckdb:parquet 19368119 19084187 1.01
tpcds_q71/duckdb:parquet 20348318 18645345 1.09
tpcds_q72/duckdb:parquet 163902131 164653654 1.00
tpcds_q73/duckdb:parquet 17307747 17814752 0.97
tpcds_q74/duckdb:parquet 127983675 129072651 0.99
tpcds_q75/duckdb:parquet 53520489 54542173 0.98
tpcds_q76/duckdb:parquet 19565817 19990627 0.98
tpcds_q77/duckdb:parquet 20887133 21677814 0.96
tpcds_q78/duckdb:parquet 74004463 73704236 1.00
tpcds_q79/duckdb:parquet 27713080 26769666 1.04
tpcds_q80/duckdb:parquet 40735069 40774959 1.00
tpcds_q81/duckdb:parquet 32394133 31621517 1.02
tpcds_q82/duckdb:parquet 13461742 13624951 0.99
tpcds_q83/duckdb:parquet 15993437 16562037 0.97
tpcds_q84/duckdb:parquet 19693372 19602343 1.00
tpcds_q85/duckdb:parquet 39470200 38983809 1.01
tpcds_q86/duckdb:parquet 12474587 12295137 1.01
tpcds_q87/duckdb:parquet 36686623 36400941 1.01
tpcds_q88/duckdb:parquet 47921008 48757385 0.98
tpcds_q89/duckdb:parquet 16116993 16296496 0.99
tpcds_q90/duckdb:parquet 7589667 7145503 1.06
tpcds_q91/duckdb:parquet 22939474 22716490 1.01
tpcds_q92/duckdb:parquet 11600118 11115173 1.04
tpcds_q93/duckdb:parquet 29358035 29494246 1.00
tpcds_q94/duckdb:parquet 17459326 15934810 1.10
tpcds_q95/duckdb:parquet 145231074 135666834 1.07
tpcds_q96/duckdb:parquet 8393422 8572473 0.98
tpcds_q97/duckdb:parquet 34760645 34704759 1.00
tpcds_q98/duckdb:parquet 🚨 18950065 17168541 1.10
tpcds_q99/duckdb:parquet 19345041 19406594 1.00
duckdb / duckdb (1.031x ➖, 1↑ 5↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20846390 20335373 1.03
tpcds_q02/duckdb:duckdb 19036191 19035880 1.00
tpcds_q03/duckdb:duckdb 9682940 9260555 1.05
tpcds_q04/duckdb:duckdb 174982037 173712226 1.01
tpcds_q05/duckdb:duckdb 20537142 20694319 0.99
tpcds_q06/duckdb:duckdb 24082823 22788343 1.06
tpcds_q07/duckdb:duckdb 40185652 38866489 1.03
tpcds_q08/duckdb:duckdb 121165308 120610331 1.00
tpcds_q09/duckdb:duckdb 20514504 19868813 1.03
tpcds_q10/duckdb:duckdb 24316420 22990174 1.06
tpcds_q11/duckdb:duckdb 88383111 86877562 1.02
tpcds_q12/duckdb:duckdb 11428839 10948443 1.04
tpcds_q13/duckdb:duckdb 25002196 23830696 1.05
tpcds_q14/duckdb:duckdb 92152536 91696358 1.00
tpcds_q15/duckdb:duckdb 24549203 23346209 1.05
tpcds_q16/duckdb:duckdb 18145530 16871631 1.08
tpcds_q17/duckdb:duckdb 22576898 22714686 0.99
tpcds_q18/duckdb:duckdb 46510831 44927635 1.04
tpcds_q19/duckdb:duckdb 17061974 16222166 1.05
tpcds_q20/duckdb:duckdb 12932539 11924218 1.08
tpcds_q21/duckdb:duckdb 7199994 6641167 1.08
tpcds_q22/duckdb:duckdb 64035085 62062225 1.03
tpcds_q23/duckdb:duckdb 74300667 78718260 0.94
tpcds_q24/duckdb:duckdb 23833618 24766029 0.96
tpcds_q25/duckdb:duckdb 17725519 18441485 0.96
tpcds_q26/duckdb:duckdb 25883340 25823567 1.00
tpcds_q27/duckdb:duckdb 38071376 39255974 0.97
tpcds_q28/duckdb:duckdb 22594075 21942245 1.03
tpcds_q29/duckdb:duckdb 20111943 20771035 0.97
tpcds_q30/duckdb:duckdb 28897788 27648156 1.05
tpcds_q31/duckdb:duckdb 48251757 48995586 0.98
tpcds_q32/duckdb:duckdb 7139346 7207075 0.99
tpcds_q33/duckdb:duckdb 🚀 12909716 14529325 0.89
tpcds_q34/duckdb:duckdb 14927948 14640544 1.02
tpcds_q35/duckdb:duckdb 31385188 33002052 0.95
tpcds_q36/duckdb:duckdb 71264906 70976997 1.00
tpcds_q37/duckdb:duckdb 7657012 8139673 0.94
tpcds_q38/duckdb:duckdb 32137676 29663767 1.08
tpcds_q39/duckdb:duckdb 25753788 25217488 1.02
tpcds_q40/duckdb:duckdb 13115157 13129729 1.00
tpcds_q41/duckdb:duckdb 8391046 7975967 1.05
tpcds_q42/duckdb:duckdb 6408901 6562796 0.98
tpcds_q43/duckdb:duckdb 11690508 11555877 1.01
tpcds_q44/duckdb:duckdb 13185069 13874435 0.95
tpcds_q45/duckdb:duckdb 17249749 17798269 0.97
tpcds_q46/duckdb:duckdb 39648616 37374199 1.06
tpcds_q47/duckdb:duckdb 41203072 40679861 1.01
tpcds_q48/duckdb:duckdb 23419507 23407826 1.00
tpcds_q49/duckdb:duckdb 17385811 16781121 1.04
tpcds_q50/duckdb:duckdb 14518625 14681933 0.99
tpcds_q51/duckdb:duckdb 90432746 90746968 1.00
tpcds_q52/duckdb:duckdb 8083552 7367787 1.10
tpcds_q53/duckdb:duckdb 14014598 13240272 1.06
tpcds_q54/duckdb:duckdb 🚨 17743504 16054874 1.11
tpcds_q55/duckdb:duckdb 7564550 7060118 1.07
tpcds_q56/duckdb:duckdb 🚨 15127411 13245839 1.14
tpcds_q57/duckdb:duckdb 33532144 32742699 1.02
tpcds_q58/duckdb:duckdb 14010089 12857393 1.09
tpcds_q59/duckdb:duckdb 36563776 35406299 1.03
tpcds_q60/duckdb:duckdb 15863156 14835346 1.07
tpcds_q61/duckdb:duckdb 14528676 14610253 0.99
tpcds_q62/duckdb:duckdb 10181557 9745361 1.04
tpcds_q63/duckdb:duckdb 12327965 12370044 1.00
tpcds_q64/duckdb:duckdb 54621682 54761966 1.00
tpcds_q65/duckdb:duckdb 35351289 33754165 1.05
tpcds_q66/duckdb:duckdb 26359863 25459099 1.04
tpcds_q67/duckdb:duckdb 132195328 128919886 1.03
tpcds_q68/duckdb:duckdb 26358090 25509029 1.03
tpcds_q69/duckdb:duckdb 26277981 25708017 1.02
tpcds_q70/duckdb:duckdb 15629571 15122457 1.03
tpcds_q71/duckdb:duckdb 13783714 13186558 1.05
tpcds_q72/duckdb:duckdb 🚨 46208608 41479344 1.11
tpcds_q73/duckdb:duckdb 11466845 10836240 1.06
tpcds_q74/duckdb:duckdb 150329758 146538611 1.03
tpcds_q75/duckdb:duckdb 43932081 43796582 1.00
tpcds_q76/duckdb:duckdb 12206755 12289090 0.99
tpcds_q77/duckdb:duckdb 13402432 13541291 0.99
tpcds_q78/duckdb:duckdb 67686564 62503430 1.08
tpcds_q79/duckdb:duckdb 19320158 18729205 1.03
tpcds_q80/duckdb:duckdb 29532962 26989317 1.09
tpcds_q81/duckdb:duckdb 39442464 39383522 1.00
tpcds_q82/duckdb:duckdb 9463042 8993316 1.05
tpcds_q83/duckdb:duckdb 🚨 11295663 9377783 1.20
tpcds_q84/duckdb:duckdb 14509118 14348751 1.01
tpcds_q85/duckdb:duckdb 26159813 24688881 1.06
tpcds_q86/duckdb:duckdb 11786817 10747539 1.10
tpcds_q87/duckdb:duckdb 34880693 34900818 1.00
tpcds_q88/duckdb:duckdb 26920396 26607768 1.01
tpcds_q89/duckdb:duckdb 15484476 14160184 1.09
tpcds_q90/duckdb:duckdb 5946342 5604980 1.06
tpcds_q91/duckdb:duckdb 13684649 12547717 1.09
tpcds_q92/duckdb:duckdb 8868270 8425275 1.05
tpcds_q93/duckdb:duckdb 23806864 22315681 1.07
tpcds_q94/duckdb:duckdb 13976469 13003854 1.07
tpcds_q95/duckdb:duckdb 🚨 128830053 112893943 1.14
tpcds_q96/duckdb:duckdb 5082714 4632477 1.10
tpcds_q97/duckdb:duckdb 30222648 31005472 0.97
tpcds_q98/duckdb:duckdb 14824065 13664497 1.08
tpcds_q99/duckdb:duckdb 17030809 16604821 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +2.1% +2.2% -0.0% +21.3% ➖ noise
1 datafusion:vortex-file-compressed +7.7% +2.2% +5.4% +18.6% ➖ noise
1 duckdb:duckdb +2.5% +2.2% +0.3% +22.8% ➖ noise
1 duckdb:vortex-compact -2.8% +2.2% -4.9% +19.5% ➖ noise
1 duckdb:vortex-file-compressed -0.8% +2.2% -2.9% +29.5% ➖ noise
2 datafusion:vortex-compact +0.7% -3.1% +3.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +1.5% -3.1% +4.7% +10.0% ➖ noise
2 duckdb:duckdb +0.0% -3.1% +3.1% +10.8% ➖ noise
2 duckdb:vortex-compact +0.6% -3.1% +3.8% +19.4% ➖ noise
2 duckdb:vortex-file-compressed -3.4% -3.1% -0.3% +28.7% ➖ noise
3 datafusion:vortex-compact -5.3% +2.4% -7.5% +14.2% ➖ noise
3 datafusion:vortex-file-compressed -0.5% +2.4% -2.8% +15.8% ➖ noise
3 duckdb:duckdb +4.6% +2.4% +2.1% +22.6% ➖ noise
3 duckdb:vortex-compact +4.1% +2.4% +1.7% +14.1% ➖ noise
3 duckdb:vortex-file-compressed +1.4% +2.4% -1.0% +15.0% ➖ noise
4 datafusion:vortex-compact -0.1% -0.2% +0.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.0% -0.2% +2.2% +10.0% ➖ noise
4 duckdb:duckdb +0.7% -0.2% +0.9% +10.0% ➖ noise
4 duckdb:vortex-compact +1.5% -0.2% +1.7% +12.8% ➖ noise
4 duckdb:vortex-file-compressed +5.0% -0.2% +5.2% +10.0% ➖ noise
5 datafusion:vortex-compact -3.3% -1.1% -2.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +6.4% -1.1% +7.5% +10.0% ➖ noise
5 duckdb:duckdb -0.8% -1.1% +0.3% +11.5% ➖ noise
5 duckdb:vortex-compact +2.6% -1.1% +3.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.3% -1.1% +1.4% +10.0% ➖ noise
6 datafusion:vortex-compact -3.2% +1.0% -4.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.6% +1.0% -0.4% +10.0% ➖ noise
6 duckdb:duckdb +5.7% +1.0% +4.6% +10.1% ➖ noise
6 duckdb:vortex-compact -1.3% +1.0% -2.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +3.8% +1.0% +2.8% +10.0% ➖ noise
7 datafusion:vortex-compact +1.8% +1.9% -0.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.0% +1.9% -1.9% +10.0% ➖ noise
7 duckdb:duckdb +3.4% +1.9% +1.5% +20.2% ➖ noise
7 duckdb:vortex-compact +1.1% +1.9% -0.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.5% +1.9% +2.6% +19.2% ➖ noise
8 datafusion:vortex-compact -0.1% +1.9% -2.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +2.2% +1.9% +0.3% +10.0% ➖ noise
8 duckdb:duckdb +0.5% +1.9% -1.5% +10.0% ➖ noise
8 duckdb:vortex-compact +6.1% +1.9% +4.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +3.3% +1.9% +1.3% +17.4% ➖ noise
9 datafusion:vortex-compact -0.6% +1.7% -2.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.6% +1.7% -3.2% +10.0% ➖ noise
9 duckdb:duckdb +3.2% +1.7% +1.5% +10.0% ➖ noise
9 duckdb:vortex-compact -0.3% +1.7% -1.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.4% +1.7% -3.0% +13.4% ➖ noise
10 datafusion:vortex-compact +2.8% +2.9% -0.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +5.3% +2.9% +2.2% +13.8% ➖ noise
10 duckdb:duckdb +5.8% +2.9% +2.7% +16.2% ➖ noise
10 duckdb:vortex-compact -0.2% +2.9% -3.0% +15.0% ➖ noise
10 duckdb:vortex-file-compressed -1.7% +2.9% -4.5% +10.0% ➖ noise
11 datafusion:vortex-compact -2.4% +1.8% -4.1% +10.6% ➖ noise
11 datafusion:vortex-file-compressed +0.4% +1.8% -1.4% +10.0% ➖ noise
11 duckdb:duckdb +1.7% +1.8% -0.0% +10.5% ➖ noise
11 duckdb:vortex-compact -7.2% +1.8% -8.8% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +3.3% +1.8% +1.5% +11.9% ➖ noise
12 datafusion:vortex-compact -3.3% +2.2% -5.4% +16.3% ➖ noise
12 datafusion:vortex-file-compressed -3.3% +2.2% -5.4% +22.4% ➖ noise
12 duckdb:duckdb +4.4% +2.2% +2.1% +16.0% ➖ noise
12 duckdb:vortex-compact +3.8% +2.2% +1.5% +12.4% ➖ noise
12 duckdb:vortex-file-compressed +1.4% +2.2% -0.7% +10.0% ➖ noise
13 datafusion:vortex-compact -1.2% -1.1% -0.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.5% -1.1% -0.4% +13.9% ➖ noise
13 duckdb:duckdb +4.9% -1.1% +6.1% +10.0% ➖ noise
13 duckdb:vortex-compact -0.1% -1.1% +1.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.8% -1.1% +1.9% +10.0% ➖ noise
14 datafusion:vortex-compact -0.6% -1.1% +0.5% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +5.8% -1.1% +7.0% +10.0% ➖ noise
14 duckdb:duckdb +0.5% -1.1% +1.6% +10.0% ➖ noise
14 duckdb:vortex-compact +1.8% -1.1% +2.9% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.5% -1.1% +3.6% +10.0% ➖ noise
15 datafusion:vortex-compact +3.6% -2.7% +6.5% +19.3% ➖ noise
15 datafusion:vortex-file-compressed -7.2% -2.7% -4.6% +12.6% ➖ noise
15 duckdb:duckdb +5.2% -2.7% +8.1% +12.2% ➖ noise
15 duckdb:vortex-compact +5.0% -2.7% +8.0% +10.5% ➖ noise
15 duckdb:vortex-file-compressed -1.8% -2.7% +1.0% +11.1% ➖ noise
16 datafusion:vortex-compact +0.0% -1.8% +1.8% +14.4% ➖ noise
16 datafusion:vortex-file-compressed +2.2% -1.8% +4.0% +12.3% ➖ noise
16 duckdb:duckdb +7.6% -1.8% +9.5% +16.3% ➖ noise
16 duckdb:vortex-compact +4.7% -1.8% +6.5% +14.8% ➖ noise
16 duckdb:vortex-file-compressed +2.0% -1.8% +3.9% +11.6% ➖ noise
17 datafusion:vortex-compact -0.8% -0.0% -0.8% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.4% -0.0% -1.4% +10.0% ➖ noise
17 duckdb:duckdb -0.6% -0.0% -0.6% +10.0% ➖ noise
17 duckdb:vortex-compact -1.1% -0.0% -1.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +4.0% -0.0% +4.1% +11.5% ➖ noise
18 datafusion:vortex-compact +0.3% -1.3% +1.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.8% -1.3% +3.1% +10.0% ➖ noise
18 duckdb:duckdb +3.5% -1.3% +4.9% +10.0% ➖ noise
18 duckdb:vortex-compact +1.4% -1.3% +2.7% +11.0% ➖ noise
18 duckdb:vortex-file-compressed -1.1% -1.3% +0.2% +10.2% ➖ noise
19 datafusion:vortex-compact +1.2% -1.2% +2.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +4.9% -1.2% +6.2% +12.8% ➖ noise
19 duckdb:duckdb +5.2% -1.2% +6.4% +11.0% ➖ noise
19 duckdb:vortex-compact -1.0% -1.2% +0.2% +11.0% ➖ noise
19 duckdb:vortex-file-compressed +3.0% -1.2% +4.2% +10.5% ➖ noise
20 datafusion:vortex-compact -2.3% +0.2% -2.5% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +11.4% +0.2% +11.2% +10.6% 🚨 regression
20 duckdb:duckdb +8.5% +0.2% +8.3% +13.4% ➖ noise
20 duckdb:vortex-compact +2.8% +0.2% +2.6% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -1.4% +0.2% -1.6% +10.0% ➖ noise
21 datafusion:vortex-compact +1.7% -0.1% +1.8% +14.9% ➖ noise
21 datafusion:vortex-file-compressed +11.7% -0.1% +11.8% +13.4% ➖ noise
21 duckdb:duckdb +8.4% -0.1% +8.5% +20.8% ➖ noise
21 duckdb:vortex-compact +2.8% -0.1% +2.9% +13.4% ➖ noise
21 duckdb:vortex-file-compressed -1.1% -0.1% -1.0% +11.7% ➖ noise
22 datafusion:vortex-compact -15.5% -2.3% -13.5% +22.9% ➖ noise
22 datafusion:vortex-file-compressed +25.1% -2.3% +28.1% +24.5% 🚨 regression
22 duckdb:duckdb +3.2% -2.3% +5.6% +13.3% ➖ noise
22 duckdb:vortex-compact +3.3% -2.3% +5.7% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +0.3% -2.3% +2.7% +10.0% ➖ noise
23 datafusion:vortex-compact -3.3% -0.1% -3.3% +10.2% ➖ noise
23 datafusion:vortex-file-compressed +6.8% -0.1% +6.9% +10.0% ➖ noise
23 duckdb:duckdb -5.6% -0.1% -5.5% +14.8% ➖ noise
23 duckdb:vortex-compact +12.6% -0.1% +12.7% +15.2% ➖ noise
23 duckdb:vortex-file-compressed +12.7% -0.1% +12.8% +19.7% ➖ noise
24 datafusion:vortex-compact -2.3% +1.7% -3.9% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +6.2% +1.7% +4.4% +10.0% ➖ noise
24 duckdb:duckdb -3.8% +1.7% -5.4% +10.0% ➖ noise
24 duckdb:vortex-compact -0.0% +1.7% -1.7% +12.7% ➖ noise
24 duckdb:vortex-file-compressed -4.1% +1.7% -5.7% +10.0% ➖ noise
25 datafusion:vortex-compact +6.0% -0.2% +6.2% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +1.3% -0.2% +1.5% +10.0% ➖ noise
25 duckdb:duckdb -3.9% -0.2% -3.7% +10.4% ➖ noise
25 duckdb:vortex-compact +1.2% -0.2% +1.4% +11.3% ➖ noise
25 duckdb:vortex-file-compressed +5.7% -0.2% +5.9% +10.0% ➖ noise
26 datafusion:vortex-compact -0.8% -3.3% +2.5% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +1.5% -3.3% +4.9% +15.5% ➖ noise
26 duckdb:duckdb +0.2% -3.3% +3.6% +12.5% ➖ noise
26 duckdb:vortex-compact -3.8% -3.3% -0.6% +12.9% ➖ noise
26 duckdb:vortex-file-compressed +0.3% -3.3% +3.7% +11.9% ➖ noise
27 datafusion:vortex-compact +3.3% +0.3% +3.0% +11.2% ➖ noise
27 datafusion:vortex-file-compressed -2.9% +0.3% -3.2% +10.5% ➖ noise
27 duckdb:duckdb -3.0% +0.3% -3.3% +17.8% ➖ noise
27 duckdb:vortex-compact -4.6% +0.3% -4.9% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +2.7% +0.3% +2.4% +18.3% ➖ noise
28 datafusion:vortex-compact -0.5% +0.4% -0.9% +11.9% ➖ noise
28 datafusion:vortex-file-compressed -3.8% +0.4% -4.2% +10.0% ➖ noise
28 duckdb:duckdb +3.0% +0.4% +2.5% +10.0% ➖ noise
28 duckdb:vortex-compact -2.3% +0.4% -2.7% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -4.0% +0.4% -4.4% +10.0% ➖ noise
29 datafusion:vortex-compact +0.5% -0.2% +0.8% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +6.8% -0.2% +7.0% +10.0% ➖ noise
29 duckdb:duckdb -3.2% -0.2% -3.0% +10.0% ➖ noise
29 duckdb:vortex-compact -2.0% -0.2% -1.8% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -2.9% -0.2% -2.7% +10.0% ➖ noise
30 datafusion:vortex-compact +2.2% +1.7% +0.6% +10.0% ➖ noise
30 datafusion:vortex-file-compressed +0.8% +1.7% -0.9% +10.0% ➖ noise
30 duckdb:duckdb +4.5% +1.7% +2.8% +10.8% ➖ noise
30 duckdb:vortex-compact +2.6% +1.7% +0.9% +12.3% ➖ noise
30 duckdb:vortex-file-compressed -4.4% +1.7% -6.0% +13.8% ➖ noise
31 datafusion:vortex-compact +1.5% +0.2% +1.3% +10.1% ➖ noise
31 datafusion:vortex-file-compressed +0.4% +0.2% +0.2% +10.0% ➖ noise
31 duckdb:duckdb -1.5% +0.2% -1.7% +10.0% ➖ noise
31 duckdb:vortex-compact +7.9% +0.2% +7.7% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -6.8% +0.2% -7.0% +13.7% ➖ noise
32 datafusion:vortex-compact +4.4% +4.7% -0.3% +13.4% ➖ noise
32 datafusion:vortex-file-compressed +4.1% +4.7% -0.6% +11.9% ➖ noise
32 duckdb:duckdb -0.9% +4.7% -5.4% +15.5% ➖ noise
32 duckdb:vortex-compact -1.9% +4.7% -6.3% +18.5% ➖ noise
32 duckdb:vortex-file-compressed -1.3% +4.7% -5.8% +12.4% ➖ noise
33 datafusion:vortex-compact +6.5% -0.2% +6.7% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +3.9% -0.2% +4.1% +10.0% ➖ noise
33 duckdb:duckdb -11.1% -0.2% -11.0% +10.6% ✅ faster
33 duckdb:vortex-compact -2.6% -0.2% -2.3% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -0.1% -0.2% +0.1% +10.0% ➖ noise
34 datafusion:vortex-compact +3.0% -3.0% +6.2% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +8.1% -3.0% +11.4% +11.9% ➖ noise
34 duckdb:duckdb +2.0% -3.0% +5.1% +10.9% ➖ noise
34 duckdb:vortex-compact +6.2% -3.0% +9.5% +11.0% ➖ noise
34 duckdb:vortex-file-compressed +7.0% -3.0% +10.2% +10.0% 🚨 regression
35 datafusion:vortex-compact +2.0% +3.8% -1.7% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +3.9% +3.8% +0.2% +10.0% ➖ noise
35 duckdb:duckdb -4.9% +3.8% -8.3% +15.8% ➖ noise
35 duckdb:vortex-compact +1.2% +3.8% -2.5% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -2.6% +3.8% -6.2% +13.2% ➖ noise
36 datafusion:vortex-compact -0.2% +2.0% -2.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +0.8% +2.0% -1.1% +11.1% ➖ noise
36 duckdb:duckdb +0.4% +2.0% -1.6% +10.0% ➖ noise
36 duckdb:vortex-compact +1.4% +2.0% -0.6% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -1.0% +2.0% -2.9% +10.0% ➖ noise
37 datafusion:vortex-compact +2.7% +4.5% -1.7% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -1.3% +4.5% -5.5% +10.1% ➖ noise
37 duckdb:duckdb -5.9% +4.5% -9.9% +13.9% ➖ noise
37 duckdb:vortex-compact -1.3% +4.5% -5.5% +11.2% ➖ noise
37 duckdb:vortex-file-compressed +1.0% +4.5% -3.3% +10.0% ➖ noise
38 datafusion:vortex-compact +5.6% +2.1% +3.4% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +5.9% +2.1% +3.7% +10.0% ➖ noise
38 duckdb:duckdb +8.3% +2.1% +6.1% +13.0% ➖ noise
38 duckdb:vortex-compact +2.2% +2.1% +0.1% +13.8% ➖ noise
38 duckdb:vortex-file-compressed -3.7% +2.1% -5.7% +11.9% ➖ noise
39 datafusion:vortex-compact -2.2% +0.8% -2.9% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -1.4% +0.8% -2.2% +11.1% ➖ noise
39 duckdb:duckdb +2.1% +0.8% +1.3% +16.8% ➖ noise
39 duckdb:vortex-compact -0.4% +0.8% -1.1% +16.9% ➖ noise
39 duckdb:vortex-file-compressed -12.9% +0.8% -13.6% +16.9% ➖ noise
40 datafusion:vortex-compact +2.6% +4.5% -1.9% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -2.1% +4.5% -6.4% +10.0% ➖ noise
40 duckdb:duckdb -0.1% +4.5% -4.4% +12.1% ➖ noise
40 duckdb:vortex-compact +2.9% +4.5% -1.5% +15.1% ➖ noise
40 duckdb:vortex-file-compressed +0.6% +4.5% -3.8% +13.6% ➖ noise
41 datafusion:vortex-compact +4.7% -2.2% +7.1% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -2.1% -2.2% +0.1% +10.0% ➖ noise
41 duckdb:duckdb +5.2% -2.2% +7.6% +10.5% ➖ noise
41 duckdb:vortex-compact +7.0% -2.2% +9.4% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -0.3% -2.2% +1.9% +10.0% ➖ noise
42 datafusion:vortex-compact +4.3% +1.1% +3.2% +13.3% ➖ noise
42 datafusion:vortex-file-compressed +3.9% +1.1% +2.8% +13.7% ➖ noise
42 duckdb:duckdb -2.3% +1.1% -3.4% +17.6% ➖ noise
42 duckdb:vortex-compact +3.4% +1.1% +2.3% +14.6% ➖ noise
42 duckdb:vortex-file-compressed -2.3% +1.1% -3.4% +16.7% ➖ noise
43 datafusion:vortex-compact -1.6% -4.5% +3.1% +13.5% ➖ noise
43 datafusion:vortex-file-compressed +0.7% -4.5% +5.5% +10.0% ➖ noise
43 duckdb:duckdb +1.2% -4.5% +5.9% +10.2% ➖ noise
43 duckdb:vortex-compact +7.0% -4.5% +12.1% +13.7% ➖ noise
43 duckdb:vortex-file-compressed +5.0% -4.5% +10.0% +19.5% ➖ noise
44 datafusion:vortex-compact +3.0% +4.1% -1.0% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -6.4% +4.1% -10.1% +12.5% ➖ noise
44 duckdb:duckdb -5.0% +4.1% -8.7% +12.7% ➖ noise
44 duckdb:vortex-compact -0.9% +4.1% -4.8% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +2.9% +4.1% -1.2% +10.0% ➖ noise
45 datafusion:vortex-compact +7.2% +0.8% +6.4% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -0.7% +0.8% -1.5% +10.0% ➖ noise
45 duckdb:duckdb -3.1% +0.8% -3.8% +10.9% ➖ noise
45 duckdb:vortex-compact +1.6% +0.8% +0.9% +10.7% ➖ noise
45 duckdb:vortex-file-compressed +4.7% +0.8% +3.9% +10.0% ➖ noise
46 datafusion:vortex-compact +2.3% -2.3% +4.6% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -0.4% -2.3% +1.9% +15.6% ➖ noise
46 duckdb:duckdb +6.1% -2.3% +8.6% +10.0% ➖ noise
46 duckdb:vortex-compact -0.6% -2.3% +1.7% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -0.1% -2.3% +2.2% +10.0% ➖ noise
47 datafusion:vortex-compact +0.0% +0.7% -0.6% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +2.6% +0.7% +1.9% +10.0% ➖ noise
47 duckdb:duckdb +1.3% +0.7% +0.6% +10.0% ➖ noise
47 duckdb:vortex-compact +2.4% +0.7% +1.7% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +1.4% +0.7% +0.7% +10.0% ➖ noise
48 datafusion:vortex-compact +3.5% -0.9% +4.5% +10.0% ➖ noise
48 datafusion:vortex-file-compressed +2.5% -0.9% +3.4% +10.0% ➖ noise
48 duckdb:duckdb +0.0% -0.9% +1.0% +10.7% ➖ noise
48 duckdb:vortex-compact +3.4% -0.9% +4.4% +12.8% ➖ noise
48 duckdb:vortex-file-compressed +1.2% -0.9% +2.2% +20.0% ➖ noise
49 datafusion:vortex-compact +2.3% -1.1% +3.5% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -3.1% -1.1% -2.0% +10.0% ➖ noise
49 duckdb:duckdb +3.6% -1.1% +4.8% +13.1% ➖ noise
49 duckdb:vortex-compact -2.0% -1.1% -0.9% +11.3% ➖ noise
49 duckdb:vortex-file-compressed +5.4% -1.1% +6.6% +25.6% ➖ noise
50 datafusion:vortex-compact +2.8% +1.6% +1.2% +14.9% ➖ noise
50 datafusion:vortex-file-compressed +1.5% +1.6% -0.1% +10.0% ➖ noise
50 duckdb:duckdb -1.1% +1.6% -2.7% +10.3% ➖ noise
50 duckdb:vortex-compact +3.9% +1.6% +2.3% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -0.8% +1.6% -2.4% +10.0% ➖ noise
51 datafusion:vortex-compact -1.1% -0.4% -0.6% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +7.3% -0.4% +7.7% +13.8% ➖ noise
51 duckdb:duckdb -0.3% -0.4% +0.1% +11.0% ➖ noise
51 duckdb:vortex-compact +1.0% -0.4% +1.4% +12.4% ➖ noise
51 duckdb:vortex-file-compressed +17.0% -0.4% +17.5% +24.0% ➖ noise
52 datafusion:vortex-compact +0.0% +0.4% -0.3% +20.1% ➖ noise
52 datafusion:vortex-file-compressed -2.0% +0.4% -2.4% +19.7% ➖ noise
52 duckdb:duckdb +9.7% +0.4% +9.3% +13.5% ➖ noise
52 duckdb:vortex-compact +8.2% +0.4% +7.8% +12.8% ➖ noise
52 duckdb:vortex-file-compressed -1.6% +0.4% -2.0% +13.2% ➖ noise
53 datafusion:vortex-compact -0.6% +3.7% -4.1% +13.3% ➖ noise
53 datafusion:vortex-file-compressed +2.6% +3.7% -1.1% +10.0% ➖ noise
53 duckdb:duckdb +5.8% +3.7% +2.1% +10.2% ➖ noise
53 duckdb:vortex-compact +4.0% +3.7% +0.4% +12.1% ➖ noise
53 duckdb:vortex-file-compressed +2.5% +3.7% -1.1% +10.0% ➖ noise
54 datafusion:vortex-compact +0.9% +1.5% -0.6% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -0.5% +1.5% -2.0% +10.0% ➖ noise
54 duckdb:duckdb +10.5% +1.5% +8.9% +12.4% ➖ noise
54 duckdb:vortex-compact -1.0% +1.5% -2.5% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +0.6% +1.5% -0.9% +10.0% ➖ noise
55 datafusion:vortex-compact +2.7% +1.9% +0.7% +10.0% ➖ noise
55 datafusion:vortex-file-compressed +2.7% +1.9% +0.8% +10.0% ➖ noise
55 duckdb:duckdb +7.1% +1.9% +5.1% +12.7% ➖ noise
55 duckdb:vortex-compact +3.7% +1.9% +1.8% +13.9% ➖ noise
55 duckdb:vortex-file-compressed +5.8% +1.9% +3.8% +24.4% ➖ noise
56 datafusion:vortex-compact +3.2% -1.7% +5.0% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -2.4% -1.7% -0.6% +10.0% ➖ noise
56 duckdb:duckdb +14.2% -1.7% +16.2% +10.0% 🚨 regression
56 duckdb:vortex-compact +7.2% -1.7% +9.1% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -7.0% -1.7% -5.4% +18.3% ➖ noise
57 datafusion:vortex-compact -3.8% -2.3% -1.5% +11.9% ➖ noise
57 datafusion:vortex-file-compressed +1.9% -2.3% +4.3% +11.6% ➖ noise
57 duckdb:duckdb +2.4% -2.3% +4.8% +10.2% ➖ noise
57 duckdb:vortex-compact +5.4% -2.3% +7.9% +11.7% ➖ noise
57 duckdb:vortex-file-compressed +0.4% -2.3% +2.8% +10.3% ➖ noise
58 datafusion:vortex-compact +6.7% -2.1% +9.0% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +2.0% -2.1% +4.2% +10.0% ➖ noise
58 duckdb:duckdb +9.0% -2.1% +11.3% +13.9% ➖ noise
58 duckdb:vortex-compact +10.2% -2.1% +12.6% +14.7% ➖ noise
58 duckdb:vortex-file-compressed +1.9% -2.1% +4.0% +10.0% ➖ noise
59 datafusion:vortex-compact +2.9% +0.1% +2.9% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +0.8% +0.1% +0.7% +10.0% ➖ noise
59 duckdb:duckdb +3.3% +0.1% +3.2% +10.0% ➖ noise
59 duckdb:vortex-compact +8.0% +0.1% +7.9% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -3.3% +0.1% -3.4% +11.3% ➖ noise
60 datafusion:vortex-compact +1.4% -0.0% +1.4% +11.3% ➖ noise
60 datafusion:vortex-file-compressed +1.0% -0.0% +1.0% +12.8% ➖ noise
60 duckdb:duckdb +6.9% -0.0% +7.0% +10.0% ➖ noise
60 duckdb:vortex-compact +3.3% -0.0% +3.4% +10.2% ➖ noise
60 duckdb:vortex-file-compressed +0.7% -0.0% +0.8% +10.0% ➖ noise
61 datafusion:vortex-compact +2.3% +1.1% +1.1% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -1.5% +1.1% -2.6% +11.1% ➖ noise
61 duckdb:duckdb -0.6% +1.1% -1.6% +10.0% ➖ noise
61 duckdb:vortex-compact +2.3% +1.1% +1.2% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -11.8% +1.1% -12.8% +11.9% ✅ faster
62 datafusion:vortex-compact -7.2% -3.5% -3.9% +28.4% ➖ noise
62 datafusion:vortex-file-compressed +20.3% -3.5% +24.7% +22.6% 🚨 regression
62 duckdb:duckdb +4.5% -3.5% +8.3% +18.2% ➖ noise
62 duckdb:vortex-compact +1.6% -3.5% +5.3% +15.2% ➖ noise
62 duckdb:vortex-file-compressed +3.1% -3.5% +6.9% +15.8% ➖ noise
63 datafusion:vortex-compact -0.1% +0.8% -0.9% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +1.6% +0.8% +0.8% +10.0% ➖ noise
63 duckdb:duckdb -0.3% +0.8% -1.2% +10.0% ➖ noise
63 duckdb:vortex-compact -0.8% +0.8% -1.6% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -0.2% +0.8% -1.0% +10.0% ➖ noise
64 datafusion:vortex-compact +1.2% +0.4% +0.8% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +1.1% +0.4% +0.7% +10.0% ➖ noise
64 duckdb:duckdb -0.3% +0.4% -0.6% +11.4% ➖ noise
64 duckdb:vortex-compact +2.1% +0.4% +1.7% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -0.1% +0.4% -0.5% +10.0% ➖ noise
65 datafusion:vortex-compact +1.5% -0.4% +1.9% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +3.0% -0.4% +3.4% +10.0% ➖ noise
65 duckdb:duckdb +4.7% -0.4% +5.1% +11.6% ➖ noise
65 duckdb:vortex-compact -4.6% -0.4% -4.3% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -0.0% -0.4% +0.3% +10.0% ➖ noise
66 datafusion:vortex-compact +4.2% +0.9% +3.3% +12.7% ➖ noise
66 datafusion:vortex-file-compressed +2.4% +0.9% +1.5% +12.3% ➖ noise
66 duckdb:duckdb +3.5% +0.9% +2.7% +13.4% ➖ noise
66 duckdb:vortex-compact +4.7% +0.9% +3.8% +18.0% ➖ noise
66 duckdb:vortex-file-compressed +0.6% +0.9% -0.3% +10.7% ➖ noise
67 datafusion:vortex-compact +1.7% +0.9% +0.8% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -4.3% +0.9% -5.2% +10.0% ➖ noise
67 duckdb:duckdb +2.5% +0.9% +1.6% +10.0% ➖ noise
67 duckdb:vortex-compact +1.7% +0.9% +0.8% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -2.1% +0.9% -3.0% +10.0% ➖ noise
68 datafusion:vortex-compact +0.6% +3.4% -2.7% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -1.9% +3.4% -5.1% +14.2% ➖ noise
68 duckdb:duckdb +3.3% +3.4% -0.1% +10.0% ➖ noise
68 duckdb:vortex-compact -0.5% +3.4% -3.7% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -5.8% +3.4% -8.9% +14.6% ➖ noise
69 datafusion:vortex-compact +1.9% +3.9% -1.9% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -0.7% +3.9% -4.4% +10.0% ➖ noise
69 duckdb:duckdb +2.2% +3.9% -1.6% +12.7% ➖ noise
69 duckdb:vortex-compact -2.5% +3.9% -6.2% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +1.6% +3.9% -2.2% +10.0% ➖ noise
70 datafusion:vortex-compact +4.6% +2.5% +2.0% +13.5% ➖ noise
70 datafusion:vortex-file-compressed -3.7% +2.5% -6.1% +10.6% ➖ noise
70 duckdb:duckdb +3.4% +2.5% +0.8% +10.6% ➖ noise
70 duckdb:vortex-compact -0.2% +2.5% -2.7% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +2.6% +2.5% +0.1% +10.0% ➖ noise
71 datafusion:vortex-compact -5.0% +2.2% -7.0% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +3.2% +2.2% +0.9% +10.0% ➖ noise
71 duckdb:duckdb +4.5% +2.2% +2.3% +14.9% ➖ noise
71 duckdb:vortex-compact +4.2% +2.2% +1.9% +10.2% ➖ noise
71 duckdb:vortex-file-compressed -0.3% +2.2% -2.5% +19.4% ➖ noise
72 datafusion:vortex-compact +1.7% +0.1% +1.5% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +2.0% +0.1% +1.8% +10.0% ➖ noise
72 duckdb:duckdb +11.4% +0.1% +11.2% +13.1% ➖ noise
72 duckdb:vortex-compact +2.0% +0.1% +1.9% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.0% +0.1% -0.1% +10.0% ➖ noise
73 datafusion:vortex-compact -0.0% -1.3% +1.3% +10.0% ➖ noise
73 datafusion:vortex-file-compressed +1.1% -1.3% +2.4% +10.0% ➖ noise
73 duckdb:duckdb +5.8% -1.3% +7.2% +14.3% ➖ noise
73 duckdb:vortex-compact +1.4% -1.3% +2.7% +13.0% ➖ noise
73 duckdb:vortex-file-compressed +6.9% -1.3% +8.3% +13.3% ➖ noise
74 datafusion:vortex-compact +1.4% -0.4% +1.8% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +3.7% -0.4% +4.1% +10.6% ➖ noise
74 duckdb:duckdb +2.6% -0.4% +3.0% +10.0% ➖ noise
74 duckdb:vortex-compact +27.3% -0.4% +27.8% +24.1% 🚨 regression
74 duckdb:vortex-file-compressed -2.3% -0.4% -1.9% +26.5% ➖ noise
75 datafusion:vortex-compact +0.5% -2.7% +3.3% +12.3% ➖ noise
75 datafusion:vortex-file-compressed -0.9% -2.7% +1.9% +11.0% ➖ noise
75 duckdb:duckdb +0.3% -2.7% +3.1% +11.5% ➖ noise
75 duckdb:vortex-compact -0.5% -2.7% +2.3% +15.4% ➖ noise
75 duckdb:vortex-file-compressed +5.2% -2.7% +8.2% +10.2% ➖ noise
76 datafusion:vortex-compact +0.4% -2.3% +2.8% +10.2% ➖ noise
76 datafusion:vortex-file-compressed -0.1% -2.3% +2.2% +10.0% ➖ noise
76 duckdb:duckdb -0.7% -2.3% +1.6% +14.8% ➖ noise
76 duckdb:vortex-compact +2.1% -2.3% +4.5% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -5.7% -2.3% -3.6% +25.3% ➖ noise
77 datafusion:vortex-compact -1.4% -0.3% -1.1% +13.7% ➖ noise
77 datafusion:vortex-file-compressed -0.7% -0.3% -0.4% +19.8% ➖ noise
77 duckdb:duckdb -1.0% -0.3% -0.7% +15.5% ➖ noise
77 duckdb:vortex-compact +1.6% -0.3% +1.9% +12.2% ➖ noise
77 duckdb:vortex-file-compressed -7.1% -0.3% -6.9% +10.3% ➖ noise
78 datafusion:vortex-compact +4.8% +0.3% +4.5% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +0.7% +0.3% +0.4% +10.0% ➖ noise
78 duckdb:duckdb +8.3% +0.3% +8.0% +10.0% ➖ noise
78 duckdb:vortex-compact +1.0% +0.3% +0.7% +11.2% ➖ noise
78 duckdb:vortex-file-compressed +0.3% +0.3% +0.0% +10.0% ➖ noise
79 datafusion:vortex-compact +1.0% +2.9% -1.9% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +2.5% +2.9% -0.4% +10.0% ➖ noise
79 duckdb:duckdb +3.2% +2.9% +0.2% +10.0% ➖ noise
79 duckdb:vortex-compact +3.8% +2.9% +0.9% +10.0% ➖ noise
79 duckdb:vortex-file-compressed +4.7% +2.9% +1.7% +16.4% ➖ noise
80 datafusion:vortex-compact +1.1% +0.4% +0.8% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +2.9% +0.4% +2.5% +10.0% ➖ noise
80 duckdb:duckdb +9.4% +0.4% +9.0% +12.8% ➖ noise
80 duckdb:vortex-compact +11.2% +0.4% +10.8% +16.0% ➖ noise
80 duckdb:vortex-file-compressed -5.2% +0.4% -5.5% +10.0% ➖ noise
81 datafusion:vortex-compact +2.2% +0.6% +1.5% +10.0% ➖ noise
81 datafusion:vortex-file-compressed -1.4% +0.6% -2.0% +10.0% ➖ noise
81 duckdb:duckdb +0.1% +0.6% -0.5% +10.0% ➖ noise
81 duckdb:vortex-compact +9.0% +0.6% +8.3% +10.0% ➖ noise
81 duckdb:vortex-file-compressed +1.6% +0.6% +1.0% +10.0% ➖ noise
82 datafusion:vortex-compact -2.6% -2.8% +0.2% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -1.2% -2.8% +1.6% +17.7% ➖ noise
82 duckdb:duckdb +5.2% -2.8% +8.3% +10.2% ➖ noise
82 duckdb:vortex-compact +5.9% -2.8% +8.9% +11.0% ➖ noise
82 duckdb:vortex-file-compressed +1.1% -2.8% +4.0% +10.0% ➖ noise
83 datafusion:vortex-compact -0.9% -3.2% +2.3% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -1.6% -3.2% +1.6% +10.0% ➖ noise
83 duckdb:duckdb +20.5% -3.2% +24.4% +14.5% 🚨 regression
83 duckdb:vortex-compact +13.8% -3.2% +17.6% +19.4% ➖ noise
83 duckdb:vortex-file-compressed +9.1% -3.2% +12.7% +11.0% 🚨 regression
84 datafusion:vortex-compact +3.5% +0.0% +3.4% +13.3% ➖ noise
84 datafusion:vortex-file-compressed -1.0% +0.0% -1.0% +10.0% ➖ noise
84 duckdb:duckdb +1.1% +0.0% +1.1% +13.2% ➖ noise
84 duckdb:vortex-compact +14.7% +0.0% +14.7% +10.0% 🚨 regression
84 duckdb:vortex-file-compressed +4.0% +0.0% +3.9% +10.0% ➖ noise
85 datafusion:vortex-compact +0.6% +1.5% -1.0% +11.8% ➖ noise
85 datafusion:vortex-file-compressed +2.5% +1.5% +1.0% +10.0% ➖ noise
85 duckdb:duckdb +6.0% +1.5% +4.4% +11.9% ➖ noise
85 duckdb:vortex-compact +8.8% +1.5% +7.2% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +2.8% +1.5% +1.2% +10.0% ➖ noise
86 datafusion:vortex-compact +11.1% +0.0% +11.1% +19.1% ➖ noise
86 datafusion:vortex-file-compressed -0.9% +0.0% -0.9% +17.0% ➖ noise
86 duckdb:duckdb +9.7% +0.0% +9.6% +12.9% ➖ noise
86 duckdb:vortex-compact +9.9% +0.0% +9.9% +15.7% ➖ noise
86 duckdb:vortex-file-compressed -1.4% +0.0% -1.4% +13.6% ➖ noise
87 datafusion:vortex-compact +4.7% +1.5% +3.1% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -0.3% +1.5% -1.8% +10.0% ➖ noise
87 duckdb:duckdb -0.1% +1.5% -1.6% +13.5% ➖ noise
87 duckdb:vortex-compact +3.6% +1.5% +2.0% +16.7% ➖ noise
87 duckdb:vortex-file-compressed +2.9% +1.5% +1.3% +10.0% ➖ noise
88 datafusion:vortex-compact +3.1% +0.1% +2.9% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +3.4% +0.1% +3.3% +10.0% ➖ noise
88 duckdb:duckdb +1.2% +0.1% +1.0% +14.2% ➖ noise
88 duckdb:vortex-compact +8.8% +0.1% +8.6% +11.9% ➖ noise
88 duckdb:vortex-file-compressed +2.0% +0.1% +1.9% +10.0% ➖ noise
89 datafusion:vortex-compact +0.8% -1.0% +1.8% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +5.0% -1.0% +6.1% +18.9% ➖ noise
89 duckdb:duckdb +9.4% -1.0% +10.4% +11.7% ➖ noise
89 duckdb:vortex-compact +2.1% -1.0% +3.1% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -1.7% -1.0% -0.7% +10.0% ➖ noise
90 datafusion:vortex-compact +3.2% +6.6% -3.2% +48.4% ➖ noise
90 datafusion:vortex-file-compressed +0.1% +6.6% -6.1% +10.5% ➖ noise
90 duckdb:duckdb +6.1% +6.6% -0.5% +11.1% ➖ noise
90 duckdb:vortex-compact +14.9% +6.6% +7.8% +14.9% ➖ noise
90 duckdb:vortex-file-compressed -0.3% +6.6% -6.5% +29.8% ➖ noise
91 datafusion:vortex-compact -1.2% +1.0% -2.1% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +4.6% +1.0% +3.6% +10.0% ➖ noise
91 duckdb:duckdb +9.1% +1.0% +8.0% +12.3% ➖ noise
91 duckdb:vortex-compact +11.0% +1.0% +9.9% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +0.1% +1.0% -0.9% +10.0% ➖ noise
92 datafusion:vortex-compact -1.1% +6.6% -7.3% +13.3% ➖ noise
92 datafusion:vortex-file-compressed +2.7% +6.6% -3.6% +11.9% ➖ noise
92 duckdb:duckdb +5.3% +6.6% -1.3% +13.1% ➖ noise
92 duckdb:vortex-compact +7.6% +6.6% +1.0% +19.0% ➖ noise
92 duckdb:vortex-file-compressed +11.3% +6.6% +4.4% +18.1% ➖ noise
93 datafusion:vortex-compact +3.7% +3.1% +0.6% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -1.9% +3.1% -4.8% +10.0% ➖ noise
93 duckdb:duckdb +6.7% +3.1% +3.5% +11.2% ➖ noise
93 duckdb:vortex-compact +24.4% +3.1% +20.7% +19.9% 🚨 regression
93 duckdb:vortex-file-compressed -1.0% +3.1% -4.0% +11.5% ➖ noise
94 datafusion:vortex-compact +1.4% +2.7% -1.3% +15.3% ➖ noise
94 datafusion:vortex-file-compressed -7.5% +2.7% -9.9% +14.6% ➖ noise
94 duckdb:duckdb +7.5% +2.7% +4.7% +13.0% ➖ noise
94 duckdb:vortex-compact +9.4% +2.7% +6.6% +16.8% ➖ noise
94 duckdb:vortex-file-compressed -0.2% +2.7% -2.7% +10.0% ➖ noise
95 datafusion:vortex-compact +3.0% +3.9% -0.9% +11.7% ➖ noise
95 datafusion:vortex-file-compressed +3.3% +3.9% -0.6% +10.0% ➖ noise
95 duckdb:duckdb +14.1% +3.9% +9.8% +17.1% ➖ noise
95 duckdb:vortex-compact +6.5% +3.9% +2.5% +15.0% ➖ noise
95 duckdb:vortex-file-compressed +1.5% +3.9% -2.3% +13.9% ➖ noise
96 datafusion:vortex-compact -6.2% +3.8% -9.6% +10.0% ✅ faster
96 datafusion:vortex-file-compressed +0.0% +3.8% -3.7% +10.9% ➖ noise
96 duckdb:duckdb +9.7% +3.8% +5.7% +17.6% ➖ noise
96 duckdb:vortex-compact +5.9% +3.8% +2.0% +17.4% ➖ noise
96 duckdb:vortex-file-compressed -4.0% +3.8% -7.6% +10.0% ➖ noise
97 datafusion:vortex-compact -5.8% +0.6% -6.4% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +2.1% +0.6% +1.5% +10.0% ➖ noise
97 duckdb:duckdb -2.5% +0.6% -3.1% +19.3% ➖ noise
97 duckdb:vortex-compact +2.1% +0.6% +1.5% +10.0% ➖ noise
97 duckdb:vortex-file-compressed +3.6% +0.6% +3.0% +14.9% ➖ noise
98 datafusion:vortex-compact +1.9% +4.7% -2.7% +18.8% ➖ noise
98 datafusion:vortex-file-compressed +1.4% +4.7% -3.1% +12.6% ➖ noise
98 duckdb:duckdb +8.5% +4.7% +3.6% +17.0% ➖ noise
98 duckdb:vortex-compact +9.2% +4.7% +4.3% +13.1% ➖ noise
98 duckdb:vortex-file-compressed -2.7% +4.7% -7.1% +14.6% ➖ noise
99 datafusion:vortex-compact +9.2% +17.3% -6.8% +23.0% ➖ noise
99 datafusion:vortex-file-compressed +0.9% +17.3% -13.9% +25.2% ➖ noise
99 duckdb:duckdb +2.6% +17.3% -12.5% +27.3% ➖ noise
99 duckdb:vortex-compact +6.8% +17.3% -8.9% +15.6% ➖ noise
99 duckdb:vortex-file-compressed +3.0% +17.3% -12.1% +27.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.2%
Vortex (geomean): 1.049x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish +3.7%


datafusion / vortex-file-compressed (1.045x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 32765359 33295688 0.98
fineweb_q01/datafusion:vortex-file-compressed 550585297 499241672 1.10
fineweb_q02/datafusion:vortex-file-compressed 525960323 422693441 1.24
fineweb_q03/datafusion:vortex-file-compressed 1363250907 1379518107 0.99
fineweb_q04/datafusion:vortex-file-compressed 1374179100 1352845917 1.02
fineweb_q05/datafusion:vortex-file-compressed 1374767297 1335813112 1.03
fineweb_q06/datafusion:vortex-file-compressed 1472172123 1478102099 1.00
fineweb_q07/datafusion:vortex-file-compressed 1368799583 1368926100 1.00
fineweb_q08/datafusion:vortex-file-compressed 545577798 509813059 1.07
datafusion / vortex-compact (1.066x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 42416039 35661822 1.19
fineweb_q01/datafusion:vortex-compact 620472296 552226907 1.12
fineweb_q02/datafusion:vortex-compact 561668218 574530418 0.98
fineweb_q03/datafusion:vortex-compact 1538733017 1490036024 1.03
fineweb_q04/datafusion:vortex-compact 1879412866 1707346218 1.10
fineweb_q05/datafusion:vortex-compact 1452213774 1457995214 1.00
fineweb_q06/datafusion:vortex-compact 1330537934 1284059616 1.04
fineweb_q07/datafusion:vortex-compact 1237084437 1139648632 1.09
fineweb_q08/datafusion:vortex-compact 386653131 362826256 1.07
datafusion / parquet (0.989x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 946199070 990692103 0.96
fineweb_q01/datafusion:parquet 1601959742 1668966641 0.96
fineweb_q02/datafusion:parquet 1791353798 1756600215 1.02
fineweb_q03/datafusion:parquet 1597352957 1653202538 0.97
fineweb_q04/datafusion:parquet 1678675231 1769062928 0.95
fineweb_q05/datafusion:parquet 1765171443 1812986261 0.97
fineweb_q06/datafusion:parquet 1818832095 1727935516 1.05
fineweb_q07/datafusion:parquet 1626243819 1695262255 0.96
fineweb_q08/datafusion:parquet 1753874476 1634918837 1.07
duckdb / vortex-file-compressed (1.094x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 90063134 75436630 1.19
fineweb_q01/duckdb:vortex-file-compressed 545483969 601483226 0.91
fineweb_q02/duckdb:vortex-file-compressed 518422587 452872695 1.14
fineweb_q03/duckdb:vortex-file-compressed 1602328566 1584115520 1.01
fineweb_q04/duckdb:vortex-file-compressed 1677156389 1537054359 1.09
fineweb_q05/duckdb:vortex-file-compressed 1602760254 1420781739 1.13
fineweb_q06/duckdb:vortex-file-compressed 1780842027 1601788648 1.11
fineweb_q07/duckdb:vortex-file-compressed 1972106111 1565089440 1.26
fineweb_q08/duckdb:vortex-file-compressed 674239252 648830354 1.04
duckdb / vortex-compact (0.993x ➖, 1↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 59653813 93531736 0.64
fineweb_q01/duckdb:vortex-compact 560240642 571432697 0.98
fineweb_q02/duckdb:vortex-compact 575327862 580648423 0.99
fineweb_q03/duckdb:vortex-compact 1794550958 1705415579 1.05
fineweb_q04/duckdb:vortex-compact 1924536137 1794854206 1.07
fineweb_q05/duckdb:vortex-compact 1698457296 1555774610 1.09
fineweb_q06/duckdb:vortex-compact 1546671598 1488267921 1.04
fineweb_q07/duckdb:vortex-compact 1461404189 1435410367 1.02
fineweb_q08/duckdb:vortex-compact 547876773 472181559 1.16
duckdb / parquet (1.005x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1288155553 1088970725 1.18
fineweb_q01/duckdb:parquet 1380062558 1336008818 1.03
fineweb_q02/duckdb:parquet 1360334443 1394896995 0.98
fineweb_q03/duckdb:parquet 3585371212 3620933997 0.99
fineweb_q04/duckdb:parquet 1885153828 2009845789 0.94
fineweb_q05/duckdb:parquet 1999285773 2123138643 0.94
fineweb_q06/duckdb:parquet 4133107808 4198420067 0.98
fineweb_q07/duckdb:parquet 2556693775 2549343265 1.00
fineweb_q08/duckdb:parquet 1089941746 1073758429 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +18.9% +6.3% +11.9% +156.8% ➖ noise
0 datafusion:vortex-file-compressed -1.6% +6.3% -7.4% +126.5% ➖ noise
0 duckdb:vortex-compact -36.2% +6.3% -40.0% +46.9% ✅ faster
0 duckdb:vortex-file-compressed +19.4% +6.3% +12.3% +52.8% ➖ noise
1 datafusion:vortex-compact +12.4% -0.4% +12.8% +41.2% ➖ noise
1 datafusion:vortex-file-compressed +10.3% -0.4% +10.8% +53.3% ➖ noise
1 duckdb:vortex-compact -2.0% -0.4% -1.5% +35.9% ➖ noise
1 duckdb:vortex-file-compressed -9.3% -0.4% -8.9% +30.0% ➖ noise
2 datafusion:vortex-compact -2.2% -0.3% -2.0% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +24.4% -0.3% +24.8% +30.0% ➖ noise
2 duckdb:vortex-compact -0.9% -0.3% -0.6% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +14.5% -0.3% +14.8% +30.0% ➖ noise
3 datafusion:vortex-compact +3.3% -2.2% +5.6% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -1.2% -2.2% +1.0% +30.0% ➖ noise
3 duckdb:vortex-compact +5.2% -2.2% +7.6% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +1.1% -2.2% +3.4% +30.0% ➖ noise
4 datafusion:vortex-compact +10.1% -5.7% +16.7% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +1.6% -5.7% +7.7% +30.0% ➖ noise
4 duckdb:vortex-compact +7.2% -5.7% +13.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +9.1% -5.7% +15.7% +30.0% ➖ noise
5 datafusion:vortex-compact -0.4% -4.2% +4.0% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +2.9% -4.2% +7.5% +30.0% ➖ noise
5 duckdb:vortex-compact +9.2% -4.2% +14.0% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +12.8% -4.2% +17.8% +30.0% ➖ noise
6 datafusion:vortex-compact +3.6% +1.8% +1.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -0.4% +1.8% -2.2% +30.0% ➖ noise
6 duckdb:vortex-compact +3.9% +1.8% +2.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +11.2% +1.8% +9.2% +30.0% ➖ noise
7 datafusion:vortex-compact +8.5% -1.9% +10.7% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -0.0% -1.9% +1.9% +30.0% ➖ noise
7 duckdb:vortex-compact +1.8% -1.9% +3.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +26.0% -1.9% +28.5% +30.0% ➖ noise
8 datafusion:vortex-compact +6.6% +4.4% +2.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +7.0% +4.4% +2.6% +30.0% ➖ noise
8 duckdb:vortex-compact +16.0% +4.4% +11.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +3.9% +4.4% -0.4% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Clickbench on NVME failed! Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Vortex (geomean): 0.985x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish -0.5%


datafusion / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 392178449 407188624 0.96
tpch_q02/datafusion:vortex-file-compressed 108209208 108858061 0.99
tpch_q03/datafusion:vortex-file-compressed 221382903 223710205 0.99
tpch_q04/datafusion:vortex-file-compressed 116990190 119458660 0.98
tpch_q05/datafusion:vortex-file-compressed 380380928 382873304 0.99
tpch_q06/datafusion:vortex-file-compressed 46185005 48029372 0.96
tpch_q07/datafusion:vortex-file-compressed 516171242 510173292 1.01
tpch_q08/datafusion:vortex-file-compressed 366843769 365627428 1.00
tpch_q09/datafusion:vortex-file-compressed 644152704 642249504 1.00
tpch_q10/datafusion:vortex-file-compressed 238594748 236337577 1.01
tpch_q11/datafusion:vortex-file-compressed 84897599 83302873 1.02
tpch_q12/datafusion:vortex-file-compressed 124545671 125842435 0.99
tpch_q13/datafusion:vortex-file-compressed 219726166 219533974 1.00
tpch_q14/datafusion:vortex-file-compressed 58916229 59267117 0.99
tpch_q15/datafusion:vortex-file-compressed 110747898 110204759 1.00
tpch_q16/datafusion:vortex-file-compressed 78839247 77689411 1.01
tpch_q17/datafusion:vortex-file-compressed 647986743 645983638 1.00
tpch_q18/datafusion:vortex-file-compressed 862886237 850375766 1.01
tpch_q19/datafusion:vortex-file-compressed 94285961 96657060 0.98
tpch_q20/datafusion:vortex-file-compressed 170699440 170654011 1.00
tpch_q21/datafusion:vortex-file-compressed 666896911 665654700 1.00
tpch_q22/datafusion:vortex-file-compressed 65840515 65526617 1.00
datafusion / vortex-compact (0.974x ➖, 2↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 439820599 447974274 0.98
tpch_q02/datafusion:vortex-compact 112614414 111309720 1.01
tpch_q03/datafusion:vortex-compact 221522700 221744662 1.00
tpch_q04/datafusion:vortex-compact 125598826 124144288 1.01
tpch_q05/datafusion:vortex-compact 384640031 382702669 1.01
tpch_q06/datafusion:vortex-compact 66258313 70624731 0.94
tpch_q07/datafusion:vortex-compact 🚀 531025860 601386610 0.88
tpch_q08/datafusion:vortex-compact 🚀 371200910 424141603 0.88
tpch_q09/datafusion:vortex-compact 653751214 651881665 1.00
tpch_q10/datafusion:vortex-compact 255102752 252954926 1.01
tpch_q11/datafusion:vortex-compact 87030716 86556843 1.01
tpch_q12/datafusion:vortex-compact 169179114 173545301 0.97
tpch_q13/datafusion:vortex-compact 269822273 272123933 0.99
tpch_q14/datafusion:vortex-compact 74627680 77901019 0.96
tpch_q15/datafusion:vortex-compact 166880379 165948736 1.01
tpch_q16/datafusion:vortex-compact 81121497 80711590 1.01
tpch_q17/datafusion:vortex-compact 649153084 672512748 0.97
tpch_q18/datafusion:vortex-compact 851577026 898987052 0.95
tpch_q19/datafusion:vortex-compact 134225293 139836785 0.96
tpch_q20/datafusion:vortex-compact 193792347 205764276 0.94
tpch_q21/datafusion:vortex-compact 671512191 707570990 0.95
tpch_q22/datafusion:vortex-compact 74462437 73268819 1.02
datafusion / parquet (0.996x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 481047627 503045965 0.96
tpch_q02/datafusion:parquet 178431607 189115652 0.94
tpch_q03/datafusion:parquet 292245491 310235385 0.94
tpch_q04/datafusion:parquet 133734146 134540448 0.99
tpch_q05/datafusion:parquet 455119664 448780628 1.01
tpch_q06/datafusion:parquet 132532723 128779833 1.03
tpch_q07/datafusion:parquet 623125897 634168029 0.98
tpch_q08/datafusion:parquet 481412940 476223217 1.01
tpch_q09/datafusion:parquet 773061420 762382644 1.01
tpch_q10/datafusion:parquet 509903419 509101186 1.00
tpch_q11/datafusion:parquet 125943552 123967969 1.02
tpch_q12/datafusion:parquet 209427261 207528215 1.01
tpch_q13/datafusion:parquet 343289934 338682177 1.01
tpch_q14/datafusion:parquet 167206291 168344007 0.99
tpch_q15/datafusion:parquet 264414200 266365011 0.99
tpch_q16/datafusion:parquet 129444335 132069769 0.98
tpch_q17/datafusion:parquet 705580554 696864288 1.01
tpch_q18/datafusion:parquet 903612226 913419687 0.99
tpch_q19/datafusion:parquet 298992678 292145072 1.02
tpch_q20/datafusion:parquet 304483722 301335492 1.01
tpch_q21/datafusion:parquet 724659034 722883396 1.00
tpch_q22/datafusion:parquet 212660600 216094793 0.98
datafusion / arrow (1.011x ➖, 0↑ 1↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 620340473 601460360 1.03
tpch_q02/datafusion:arrow 164974549 163749241 1.01
tpch_q03/datafusion:arrow 492351362 481662956 1.02
tpch_q04/datafusion:arrow 362946790 354429719 1.02
tpch_q05/datafusion:arrow 972422924 961202822 1.01
tpch_q06/datafusion:arrow 303799892 296584407 1.02
tpch_q07/datafusion:arrow 1212436379 1231599296 0.98
tpch_q08/datafusion:arrow 1204809298 1198591144 1.01
tpch_q09/datafusion:arrow 1389431169 1386048724 1.00
tpch_q10/datafusion:arrow 610153998 621496429 0.98
tpch_q11/datafusion:arrow 140585968 139074858 1.01
tpch_q12/datafusion:arrow 🚨 814052286 735293195 1.11
tpch_q13/datafusion:arrow 512742994 512681636 1.00
tpch_q14/datafusion:arrow 337876567 336476703 1.00
tpch_q15/datafusion:arrow 733008571 720837048 1.02
tpch_q16/datafusion:arrow 107736382 104147932 1.03
tpch_q17/datafusion:arrow 1365540080 1357899256 1.01
tpch_q18/datafusion:arrow 1921574692 1923713242 1.00
tpch_q19/datafusion:arrow 498611737 505082328 0.99
tpch_q20/datafusion:arrow 505528371 499315819 1.01
tpch_q21/datafusion:arrow 3039132683 3062105643 0.99
tpch_q22/datafusion:arrow 131781206 134469146 0.98
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 171624104 171926386 1.00
tpch_q02/duckdb:vortex-file-compressed 51309458 52177140 0.98
tpch_q03/duckdb:vortex-file-compressed 130382435 132913823 0.98
tpch_q04/duckdb:vortex-file-compressed 156315386 155393113 1.01
tpch_q05/duckdb:vortex-file-compressed 132125753 129740972 1.02
tpch_q06/duckdb:vortex-file-compressed 51181092 49184581 1.04
tpch_q07/duckdb:vortex-file-compressed 151385759 149807137 1.01
tpch_q08/duckdb:vortex-file-compressed 176984211 176023985 1.01
tpch_q09/duckdb:vortex-file-compressed 327353290 326248072 1.00
tpch_q10/duckdb:vortex-file-compressed 149673351 148085130 1.01
tpch_q11/duckdb:vortex-file-compressed 32701159 32666064 1.00
tpch_q12/duckdb:vortex-file-compressed 97984671 96215606 1.02
tpch_q13/duckdb:vortex-file-compressed 231860215 236974431 0.98
tpch_q14/duckdb:vortex-file-compressed 68958525 68971597 1.00
tpch_q15/duckdb:vortex-file-compressed 88895715 88797207 1.00
tpch_q16/duckdb:vortex-file-compressed 81207221 80819375 1.00
tpch_q17/duckdb:vortex-file-compressed 100055899 104793672 0.95
tpch_q18/duckdb:vortex-file-compressed 292915085 298254872 0.98
tpch_q19/duckdb:vortex-file-compressed 86083252 87387137 0.99
tpch_q20/duckdb:vortex-file-compressed 163463060 169585586 0.96
tpch_q21/duckdb:vortex-file-compressed 582097183 608978872 0.96
tpch_q22/duckdb:vortex-file-compressed 71826388 73476905 0.98
duckdb / vortex-compact (0.976x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 228781509 234299024 0.98
tpch_q02/duckdb:vortex-compact 58917018 58074624 1.01
tpch_q03/duckdb:vortex-compact 140454335 146193153 0.96
tpch_q04/duckdb:vortex-compact 175936963 177573548 0.99
tpch_q05/duckdb:vortex-compact 147480941 151128185 0.98
tpch_q06/duckdb:vortex-compact 83840703 87738553 0.96
tpch_q07/duckdb:vortex-compact 199238074 206236179 0.97
tpch_q08/duckdb:vortex-compact 191033334 195028554 0.98
tpch_q09/duckdb:vortex-compact 355365009 366832378 0.97
tpch_q10/duckdb:vortex-compact 180742213 185232983 0.98
tpch_q11/duckdb:vortex-compact 40503471 42262431 0.96
tpch_q12/duckdb:vortex-compact 203734792 206869854 0.98
tpch_q13/duckdb:vortex-compact 283036149 288553138 0.98
tpch_q14/duckdb:vortex-compact 100918429 103214457 0.98
tpch_q15/duckdb:vortex-compact 116861561 116869539 1.00
tpch_q16/duckdb:vortex-compact 83390193 86845477 0.96
tpch_q17/duckdb:vortex-compact 113718880 117193201 0.97
tpch_q18/duckdb:vortex-compact 287337288 300467384 0.96
tpch_q19/duckdb:vortex-compact 109034583 109791307 0.99
tpch_q20/duckdb:vortex-compact 204956094 211097812 0.97
tpch_q21/duckdb:vortex-compact 626941013 645109258 0.97
tpch_q22/duckdb:vortex-compact 86212945 87430948 0.99
duckdb / parquet (1.012x ➖, 0↑ 1↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 257591982 257089758 1.00
tpch_q02/duckdb:parquet 89579435 89799573 1.00
tpch_q03/duckdb:parquet 210704035 215343362 0.98
tpch_q04/duckdb:parquet 135082133 133631163 1.01
tpch_q05/duckdb:parquet 217371393 215209619 1.01
tpch_q06/duckdb:parquet 65878855 67496310 0.98
tpch_q07/duckdb:parquet 185135676 182877717 1.01
tpch_q08/duckdb:parquet 260961579 254240429 1.03
tpch_q09/duckdb:parquet 500319203 486997848 1.03
tpch_q10/duckdb:parquet 621275682 612821612 1.01
tpch_q11/duckdb:parquet 61251713 57162569 1.07
tpch_q12/duckdb:parquet 124122713 124265606 1.00
tpch_q13/duckdb:parquet 453493697 448037311 1.01
tpch_q14/duckdb:parquet 173390243 174249229 1.00
tpch_q15/duckdb:parquet 100052749 96307867 1.04
tpch_q16/duckdb:parquet 🚨 163946416 147132472 1.11
tpch_q17/duckdb:parquet 175751048 176456779 1.00
tpch_q18/duckdb:parquet 356639281 353855330 1.01
tpch_q19/duckdb:parquet 287344581 289405067 0.99
tpch_q20/duckdb:parquet 229843623 230920892 1.00
tpch_q21/duckdb:parquet 568902197 559124612 1.02
tpch_q22/duckdb:parquet 289434423 294658758 0.98
duckdb / duckdb (0.983x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 118052177 118662630 0.99
tpch_q02/duckdb:duckdb 49247971 46662290 1.06
tpch_q03/duckdb:duckdb 98974104 102026134 0.97
tpch_q04/duckdb:duckdb 134806413 138682769 0.97
tpch_q05/duckdb:duckdb 112024182 114337523 0.98
tpch_q06/duckdb:duckdb 37872861 37996008 1.00
tpch_q07/duckdb:duckdb 87358781 90758185 0.96
tpch_q08/duckdb:duckdb 112317105 113971654 0.99
tpch_q09/duckdb:duckdb 283307805 285210967 0.99
tpch_q10/duckdb:duckdb 210469946 211808533 0.99
tpch_q11/duckdb:duckdb 15814956 15869206 1.00
tpch_q12/duckdb:duckdb 86361463 87381102 0.99
tpch_q13/duckdb:duckdb 224783292 231174768 0.97
tpch_q14/duckdb:duckdb 70632071 73746116 0.96
tpch_q15/duckdb:duckdb 78277480 80406891 0.97
tpch_q16/duckdb:duckdb 74979174 77172434 0.97
tpch_q17/duckdb:duckdb 84842243 86508722 0.98
tpch_q18/duckdb:duckdb 213410630 220953726 0.97
tpch_q19/duckdb:duckdb 117259796 121947581 0.96
tpch_q20/duckdb:duckdb 112352622 113711731 0.99
tpch_q21/duckdb:duckdb 302992711 316092471 0.96
tpch_q22/duckdb:duckdb 70205858 68891596 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +3.1% -2.1% +5.4% +10.0% ➖ noise
1 datafusion:vortex-compact -1.8% -2.1% +0.3% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -3.7% -2.1% -1.6% +10.0% ➖ noise
1 duckdb:duckdb -0.5% -2.1% +1.6% +10.0% ➖ noise
1 duckdb:vortex-compact -2.4% -2.1% -0.2% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.2% -2.1% +2.0% +10.0% ➖ noise
2 datafusion:arrow +0.7% -3.0% +3.8% +10.0% ➖ noise
2 datafusion:vortex-compact +1.2% -3.0% +4.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.6% -3.0% +2.5% +10.0% ➖ noise
2 duckdb:duckdb +5.5% -3.0% +8.8% +10.0% ➖ noise
2 duckdb:vortex-compact +1.5% -3.0% +4.6% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.7% -3.0% +1.4% +10.0% ➖ noise
3 datafusion:arrow +2.2% -4.0% +6.5% +10.0% ➖ noise
3 datafusion:vortex-compact -0.1% -4.0% +4.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.0% -4.0% +3.1% +10.0% ➖ noise
3 duckdb:duckdb -3.0% -4.0% +1.0% +10.0% ➖ noise
3 duckdb:vortex-compact -3.9% -4.0% +0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.9% -4.0% +2.2% +10.0% ➖ noise
4 datafusion:arrow +2.4% +0.2% +2.2% +10.0% ➖ noise
4 datafusion:vortex-compact +1.2% +0.2% +0.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.1% +0.2% -2.3% +10.0% ➖ noise
4 duckdb:duckdb -2.8% +0.2% -3.0% +10.0% ➖ noise
4 duckdb:vortex-compact -0.9% +0.2% -1.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.6% +0.2% +0.4% +10.0% ➖ noise
5 datafusion:arrow +1.2% +1.2% -0.0% +10.0% ➖ noise
5 datafusion:vortex-compact +0.5% +1.2% -0.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -0.7% +1.2% -1.8% +10.0% ➖ noise
5 duckdb:duckdb -2.0% +1.2% -3.2% +10.0% ➖ noise
5 duckdb:vortex-compact -2.4% +1.2% -3.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.8% +1.2% +0.6% +10.0% ➖ noise
6 datafusion:arrow +2.4% +0.2% +2.2% +10.0% ➖ noise
6 datafusion:vortex-compact -6.2% +0.2% -6.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.8% +0.2% -4.1% +10.0% ➖ noise
6 duckdb:duckdb -0.3% +0.2% -0.5% +10.8% ➖ noise
6 duckdb:vortex-compact -4.4% +0.2% -4.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +4.1% +0.2% +3.8% +10.0% ➖ noise
7 datafusion:arrow -1.6% -0.3% -1.3% +10.0% ➖ noise
7 datafusion:vortex-compact -11.7% -0.3% -11.5% +10.0% ✅ faster
7 datafusion:vortex-file-compressed +1.2% -0.3% +1.4% +10.0% ➖ noise
7 duckdb:duckdb -3.7% -0.3% -3.5% +10.0% ➖ noise
7 duckdb:vortex-compact -3.4% -0.3% -3.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.1% -0.3% +1.3% +10.0% ➖ noise
8 datafusion:arrow +0.5% +1.9% -1.3% +10.0% ➖ noise
8 datafusion:vortex-compact -12.5% +1.9% -14.1% +10.0% ✅ faster
8 datafusion:vortex-file-compressed +0.3% +1.9% -1.5% +10.0% ➖ noise
8 duckdb:duckdb -1.5% +1.9% -3.3% +10.0% ➖ noise
8 duckdb:vortex-compact -2.0% +1.9% -3.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.5% +1.9% -1.3% +10.0% ➖ noise
9 datafusion:arrow +0.2% +2.1% -1.8% +10.0% ➖ noise
9 datafusion:vortex-compact +0.3% +2.1% -1.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.3% +2.1% -1.7% +10.0% ➖ noise
9 duckdb:duckdb -0.7% +2.1% -2.7% +10.0% ➖ noise
9 duckdb:vortex-compact -3.1% +2.1% -5.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.3% +2.1% -1.7% +10.0% ➖ noise
10 datafusion:arrow -1.8% +0.8% -2.6% +10.0% ➖ noise
10 datafusion:vortex-compact +0.8% +0.8% +0.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.0% +0.8% +0.2% +10.0% ➖ noise
10 duckdb:duckdb -0.6% +0.8% -1.4% +10.0% ➖ noise
10 duckdb:vortex-compact -2.4% +0.8% -3.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.1% +0.8% +0.3% +10.0% ➖ noise
11 datafusion:arrow +1.1% +4.3% -3.1% +10.9% ➖ noise
11 datafusion:vortex-compact +0.5% +4.3% -3.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.9% +4.3% -2.3% +10.0% ➖ noise
11 duckdb:duckdb -0.3% +4.3% -4.5% +12.7% ➖ noise
11 duckdb:vortex-compact -4.2% +4.3% -8.1% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +0.1% +4.3% -4.1% +10.2% ➖ noise
12 datafusion:arrow +10.7% +0.4% +10.3% +36.2% ➖ noise
12 datafusion:vortex-compact -2.5% +0.4% -2.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.0% +0.4% -1.4% +10.0% ➖ noise
12 duckdb:duckdb -1.2% +0.4% -1.6% +10.0% ➖ noise
12 duckdb:vortex-compact -1.5% +0.4% -1.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.8% +0.4% +1.4% +10.0% ➖ noise
13 datafusion:arrow +0.0% +1.3% -1.3% +10.0% ➖ noise
13 datafusion:vortex-compact -0.8% +1.3% -2.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.1% +1.3% -1.2% +10.0% ➖ noise
13 duckdb:duckdb -2.8% +1.3% -4.0% +10.0% ➖ noise
13 duckdb:vortex-compact -1.9% +1.3% -3.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.2% +1.3% -3.4% +10.0% ➖ noise
14 datafusion:arrow +0.4% -0.6% +1.0% +10.0% ➖ noise
14 datafusion:vortex-compact -4.2% -0.6% -3.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.6% -0.6% -0.0% +10.0% ➖ noise
14 duckdb:duckdb -4.2% -0.6% -3.7% +10.0% ➖ noise
14 duckdb:vortex-compact -2.2% -0.6% -1.6% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.0% -0.6% +0.6% +10.0% ➖ noise
15 datafusion:arrow +1.7% +1.6% +0.1% +10.0% ➖ noise
15 datafusion:vortex-compact +0.6% +1.6% -1.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.5% +1.6% -1.0% +10.0% ➖ noise
15 duckdb:duckdb -2.6% +1.6% -4.1% +10.0% ➖ noise
15 duckdb:vortex-compact -0.0% +1.6% -1.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.1% +1.6% -1.4% +10.0% ➖ noise
16 datafusion:arrow +3.4% +4.5% -1.0% +10.0% ➖ noise
16 datafusion:vortex-compact +0.5% +4.5% -3.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.5% +4.5% -2.9% +10.0% ➖ noise
16 duckdb:duckdb -2.8% +4.5% -7.0% +10.0% ➖ noise
16 duckdb:vortex-compact -4.0% +4.5% -8.1% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.5% +4.5% -3.9% +10.0% ➖ noise
17 datafusion:arrow +0.6% +0.4% +0.1% +10.0% ➖ noise
17 datafusion:vortex-compact -3.5% +0.4% -3.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.3% +0.4% -0.1% +10.0% ➖ noise
17 duckdb:duckdb -1.9% +0.4% -2.3% +10.0% ➖ noise
17 duckdb:vortex-compact -3.0% +0.4% -3.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -4.5% +0.4% -4.9% +10.0% ➖ noise
18 datafusion:arrow -0.1% -0.1% +0.0% +10.0% ➖ noise
18 datafusion:vortex-compact -5.3% -0.1% -5.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.5% -0.1% +1.6% +10.0% ➖ noise
18 duckdb:duckdb -3.4% -0.1% -3.3% +10.0% ➖ noise
18 duckdb:vortex-compact -4.4% -0.1% -4.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.8% -0.1% -1.6% +10.0% ➖ noise
19 datafusion:arrow -1.3% +0.8% -2.1% +10.0% ➖ noise
19 datafusion:vortex-compact -4.0% +0.8% -4.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -2.5% +0.8% -3.2% +10.0% ➖ noise
19 duckdb:duckdb -3.8% +0.8% -4.6% +10.0% ➖ noise
19 duckdb:vortex-compact -0.7% +0.8% -1.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -1.5% +0.8% -2.3% +10.0% ➖ noise
20 datafusion:arrow +1.2% +0.3% +1.0% +10.0% ➖ noise
20 datafusion:vortex-compact -5.8% +0.3% -6.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +0.0% +0.3% -0.3% +10.0% ➖ noise
20 duckdb:duckdb -1.2% +0.3% -1.5% +10.0% ➖ noise
20 duckdb:vortex-compact -2.9% +0.3% -3.2% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -3.6% +0.3% -3.9% +10.0% ➖ noise
21 datafusion:arrow -0.8% +1.0% -1.7% +10.0% ➖ noise
21 datafusion:vortex-compact -5.1% +1.0% -6.0% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +0.2% +1.0% -0.8% +10.0% ➖ noise
21 duckdb:duckdb -4.1% +1.0% -5.1% +10.0% ➖ noise
21 duckdb:vortex-compact -2.8% +1.0% -3.8% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -4.4% +1.0% -5.4% +10.0% ➖ noise
22 datafusion:arrow -2.0% -1.7% -0.3% +10.0% ➖ noise
22 datafusion:vortex-compact +1.6% -1.7% +3.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.5% -1.7% +2.2% +10.0% ➖ noise
22 duckdb:duckdb +1.9% -1.7% +3.7% +10.0% ➖ noise
22 duckdb:vortex-compact -1.4% -1.7% +0.3% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -2.2% -1.7% -0.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Vortex (geomean): 1.004x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.5%


duckdb / vortex-file-compressed (1.013x ➖, 0↑ 1↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12152587 12199644 1.00
statpopgen_q01/duckdb:vortex-file-compressed 🚨 28156849 22119540 1.27
statpopgen_q02/duckdb:vortex-file-compressed 1412724514 1423607705 0.99
statpopgen_q03/duckdb:vortex-file-compressed 3237792236 3253804446 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3141466835 3202719611 0.98
statpopgen_q05/duckdb:vortex-file-compressed 1514351304 1500678976 1.01
statpopgen_q06/duckdb:vortex-file-compressed 2187666769 2209593043 0.99
statpopgen_q07/duckdb:vortex-file-compressed 223146112 227371421 0.98
statpopgen_q08/duckdb:vortex-file-compressed 266629991 276327887 0.96
statpopgen_q09/duckdb:vortex-file-compressed 2999433933 3012917110 1.00
statpopgen_q10/duckdb:vortex-file-compressed 4831225160 4822639391 1.00
duckdb / vortex-compact (0.995x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 12002621 11903251 1.01
statpopgen_q01/duckdb:vortex-compact 170142933 170163478 1.00
statpopgen_q02/duckdb:vortex-compact 1837100626 1866713478 0.98
statpopgen_q03/duckdb:vortex-compact 3523670141 3535839121 1.00
statpopgen_q04/duckdb:vortex-compact 3607105446 3568343460 1.01
statpopgen_q05/duckdb:vortex-compact 1874762162 1921907329 0.98
statpopgen_q06/duckdb:vortex-compact 2702429912 2739160668 0.99
statpopgen_q07/duckdb:vortex-compact 912404474 902358991 1.01
statpopgen_q08/duckdb:vortex-compact 947495985 935727584 1.01
statpopgen_q09/duckdb:vortex-compact 3325539772 3408554384 0.98
statpopgen_q10/duckdb:vortex-compact 5438549523 5515004213 0.99
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 334111514 336066329 0.99
statpopgen_q01/duckdb:parquet 419371727 421828192 0.99
statpopgen_q02/duckdb:parquet 1002454120 1012547758 0.99
statpopgen_q03/duckdb:parquet 1505849938 1522086295 0.99
statpopgen_q04/duckdb:parquet 1517088257 1539405815 0.99
statpopgen_q05/duckdb:parquet 1009631844 1032293339 0.98
statpopgen_q06/duckdb:parquet 1512510511 1523644476 0.99
statpopgen_q07/duckdb:parquet 1353159144 1344779993 1.01
statpopgen_q08/duckdb:parquet 1351768721 1347064443 1.00
statpopgen_q09/duckdb:parquet 1407811672 1338884521 1.05
statpopgen_q10/duckdb:parquet 2681416532 2693851876 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +0.8% -0.6% +1.4% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -0.4% -0.6% +0.2% +14.4% ➖ noise
1 duckdb:vortex-compact -0.0% -0.6% +0.6% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +27.3% -0.6% +28.0% +195.8% ➖ noise
2 duckdb:vortex-compact -1.6% -1.0% -0.6% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.8% -1.0% +0.2% +10.0% ➖ noise
3 duckdb:vortex-compact -0.3% -1.1% +0.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.5% -1.1% +0.6% +10.0% ➖ noise
4 duckdb:vortex-compact +1.1% -1.4% +2.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.9% -1.4% -0.5% +10.0% ➖ noise
5 duckdb:vortex-compact -2.5% -2.2% -0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.9% -2.2% +3.2% +10.0% ➖ noise
6 duckdb:vortex-compact -1.3% -0.7% -0.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.0% -0.7% -0.3% +10.0% ➖ noise
7 duckdb:vortex-compact +1.1% +0.6% +0.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.9% +0.6% -2.5% +10.8% ➖ noise
8 duckdb:vortex-compact +1.3% +0.3% +0.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.5% +0.3% -3.8% +10.0% ➖ noise
9 duckdb:vortex-compact -2.4% +5.1% -7.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.4% +5.1% -5.3% +10.0% ➖ noise
10 duckdb:vortex-compact -1.4% -0.5% -0.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.2% -0.5% +0.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.0%
Vortex (geomean): 0.968x ➖
Parquet (geomean): 0.968x ➖
Shifts: Parquet (control) -3.2% · Median polish -1.2%


datafusion / vortex-file-compressed (0.986x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 244519462 260952142 0.94
tpch_q02/datafusion:vortex-file-compressed 394541330 382219391 1.03
tpch_q03/datafusion:vortex-file-compressed 401112672 391650479 1.02
tpch_q04/datafusion:vortex-file-compressed 228212179 234108802 0.97
tpch_q05/datafusion:vortex-file-compressed 395728168 385633363 1.03
tpch_q06/datafusion:vortex-file-compressed 334027517 336204450 0.99
tpch_q07/datafusion:vortex-file-compressed 378844386 403237844 0.94
tpch_q08/datafusion:vortex-file-compressed 551681281 549633787 1.00
tpch_q09/datafusion:vortex-file-compressed 399646377 349431332 1.14
tpch_q10/datafusion:vortex-file-compressed 495376664 460591105 1.08
tpch_q11/datafusion:vortex-file-compressed 274826806 264424625 1.04
tpch_q12/datafusion:vortex-file-compressed 450696459 492798027 0.91
tpch_q13/datafusion:vortex-file-compressed 144540880 164376668 0.88
tpch_q14/datafusion:vortex-file-compressed 272778308 267505290 1.02
tpch_q15/datafusion:vortex-file-compressed 462627652 495574248 0.93
tpch_q16/datafusion:vortex-file-compressed 183337005 206740899 0.89
tpch_q17/datafusion:vortex-file-compressed 323420403 352895339 0.92
tpch_q18/datafusion:vortex-file-compressed 342621974 329975850 1.04
tpch_q19/datafusion:vortex-file-compressed 442166818 445734146 0.99
tpch_q20/datafusion:vortex-file-compressed 429736028 452429782 0.95
tpch_q21/datafusion:vortex-file-compressed 524509572 538503911 0.97
tpch_q22/datafusion:vortex-file-compressed 110410733 105136494 1.05
datafusion / vortex-compact (0.938x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 252187012 272169975 0.93
tpch_q02/datafusion:vortex-compact 437414680 457395260 0.96
tpch_q03/datafusion:vortex-compact 344946947 407132915 0.85
tpch_q04/datafusion:vortex-compact 218769368 231532280 0.94
tpch_q05/datafusion:vortex-compact 345269925 372551413 0.93
tpch_q06/datafusion:vortex-compact 318650820 352963402 0.90
tpch_q07/datafusion:vortex-compact 352376327 385980511 0.91
tpch_q08/datafusion:vortex-compact 482041330 520949091 0.93
tpch_q09/datafusion:vortex-compact 375646547 386822039 0.97
tpch_q10/datafusion:vortex-compact 429735533 431184429 1.00
tpch_q11/datafusion:vortex-compact 247357666 263010211 0.94
tpch_q12/datafusion:vortex-compact 423767310 441189873 0.96
tpch_q13/datafusion:vortex-compact 104256361 126577689 0.82
tpch_q14/datafusion:vortex-compact 274115128 269820233 1.02
tpch_q15/datafusion:vortex-compact 447651459 491188439 0.91
tpch_q16/datafusion:vortex-compact 179287979 178548266 1.00
tpch_q17/datafusion:vortex-compact 352268511 373999472 0.94
tpch_q18/datafusion:vortex-compact 281345839 298184556 0.94
tpch_q19/datafusion:vortex-compact 453739431 472327265 0.96
tpch_q20/datafusion:vortex-compact 428334527 439625903 0.97
tpch_q21/datafusion:vortex-compact 496451987 549004394 0.90
tpch_q22/datafusion:vortex-compact 100837118 103187925 0.98
datafusion / parquet (0.990x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 227213934 206769655 1.10
tpch_q02/datafusion:parquet 415363277 417227576 1.00
tpch_q03/datafusion:parquet 286337830 282621230 1.01
tpch_q04/datafusion:parquet 161923284 145745241 1.11
tpch_q05/datafusion:parquet 564733593 450913545 1.25
tpch_q06/datafusion:parquet 140495543 134870061 1.04
tpch_q07/datafusion:parquet 521790467 461727676 1.13
tpch_q08/datafusion:parquet 611158744 627229137 0.97
tpch_q09/datafusion:parquet 492764073 475027347 1.04
tpch_q10/datafusion:parquet 520883913 523922946 0.99
tpch_q11/datafusion:parquet 326310227 326032418 1.00
tpch_q12/datafusion:parquet 228589955 247066756 0.93
tpch_q13/datafusion:parquet 420889956 444604450 0.95
tpch_q14/datafusion:parquet 162606606 204019731 0.80
tpch_q15/datafusion:parquet 282750246 301372988 0.94
tpch_q16/datafusion:parquet 171587858 186056281 0.92
tpch_q17/datafusion:parquet 331507302 363876736 0.91
tpch_q18/datafusion:parquet 431860544 420832086 1.03
tpch_q19/datafusion:parquet 312297595 394054107 0.79
tpch_q20/datafusion:parquet 305648817 344372797 0.89
tpch_q21/datafusion:parquet 504307805 496725547 1.02
tpch_q22/datafusion:parquet 117557328 108137205 1.09
duckdb / vortex-file-compressed (0.982x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 265745042 305170505 0.87
tpch_q02/duckdb:vortex-file-compressed 920475730 968466614 0.95
tpch_q03/duckdb:vortex-file-compressed 681736643 634220818 1.07
tpch_q04/duckdb:vortex-file-compressed 369672577 368974956 1.00
tpch_q05/duckdb:vortex-file-compressed 917618954 942310534 0.97
tpch_q06/duckdb:vortex-file-compressed 505331382 400411171 1.26
tpch_q07/duckdb:vortex-file-compressed 823236122 812802305 1.01
tpch_q08/duckdb:vortex-file-compressed 959761839 1001551119 0.96
tpch_q09/duckdb:vortex-file-compressed 864974378 940743064 0.92
tpch_q10/duckdb:vortex-file-compressed 710251084 745221752 0.95
tpch_q11/duckdb:vortex-file-compressed 491359143 496627852 0.99
tpch_q12/duckdb:vortex-file-compressed 525930922 488635031 1.08
tpch_q13/duckdb:vortex-file-compressed 470248206 447886034 1.05
tpch_q14/duckdb:vortex-file-compressed 518431356 459393862 1.13
tpch_q15/duckdb:vortex-file-compressed 303787414 303934646 1.00
tpch_q16/duckdb:vortex-file-compressed 381721688 392503459 0.97
tpch_q17/duckdb:vortex-file-compressed 686153780 874283199 0.78
tpch_q18/duckdb:vortex-file-compressed 567705832 557698695 1.02
tpch_q19/duckdb:vortex-file-compressed 399680247 495774959 0.81
tpch_q20/duckdb:vortex-file-compressed 790074223 789149636 1.00
tpch_q21/duckdb:vortex-file-compressed 1074918757 1052241057 1.02
tpch_q22/duckdb:vortex-file-compressed 329242940 370384694 0.89
duckdb / vortex-compact (0.966x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 289434856 263806842 1.10
tpch_q02/duckdb:vortex-compact 916629060 906729756 1.01
tpch_q03/duckdb:vortex-compact 571712351 643752494 0.89
tpch_q04/duckdb:vortex-compact 344304077 413924257 0.83
tpch_q05/duckdb:vortex-compact 862867549 928427058 0.93
tpch_q06/duckdb:vortex-compact 408398994 419266978 0.97
tpch_q07/duckdb:vortex-compact 801262116 774067395 1.04
tpch_q08/duckdb:vortex-compact 950705378 924634937 1.03
tpch_q09/duckdb:vortex-compact 913288037 899059882 1.02
tpch_q10/duckdb:vortex-compact 636257937 688857118 0.92
tpch_q11/duckdb:vortex-compact 447378332 469858391 0.95
tpch_q12/duckdb:vortex-compact 487851764 468050675 1.04
tpch_q13/duckdb:vortex-compact 431487401 433794064 0.99
tpch_q14/duckdb:vortex-compact 406057817 415447631 0.98
tpch_q15/duckdb:vortex-compact 295081458 301960041 0.98
tpch_q16/duckdb:vortex-compact 347773607 369511265 0.94
tpch_q17/duckdb:vortex-compact 609111109 631534389 0.96
tpch_q18/duckdb:vortex-compact 487816335 528587413 0.92
tpch_q19/duckdb:vortex-compact 481411378 443605646 1.09
tpch_q20/duckdb:vortex-compact 772584527 762889644 1.01
tpch_q21/duckdb:vortex-compact 994145380 1180456213 0.84
tpch_q22/duckdb:vortex-compact 338748315 393343794 0.86
duckdb / parquet (0.947x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 423386948 411777493 1.03
tpch_q02/duckdb:parquet 1061515196 1273426595 0.83
tpch_q03/duckdb:parquet 891037728 1025023384 0.87
tpch_q04/duckdb:parquet 592581388 621102181 0.95
tpch_q05/duckdb:parquet 1451990906 1523545529 0.95
tpch_q06/duckdb:parquet 392224116 410032302 0.96
tpch_q07/duckdb:parquet 1117309821 1233792921 0.91
tpch_q08/duckdb:parquet 1567177297 1625251958 0.96
tpch_q09/duckdb:parquet 1261361667 1395148585 0.90
tpch_q10/duckdb:parquet 1160539660 1214034482 0.96
tpch_q11/duckdb:parquet 763464581 878917735 0.87
tpch_q12/duckdb:parquet 636413062 682092653 0.93
tpch_q13/duckdb:parquet 853983281 880958654 0.97
tpch_q14/duckdb:parquet 621843772 683520246 0.91
tpch_q15/duckdb:parquet 492616187 497348312 0.99
tpch_q16/duckdb:parquet 590954905 650770927 0.91
tpch_q17/duckdb:parquet 699137102 683240913 1.02
tpch_q18/duckdb:parquet 838068968 854626475 0.98
tpch_q19/duckdb:parquet 806463818 790211253 1.02
tpch_q20/duckdb:parquet 1078678313 1087676227 0.99
tpch_q21/duckdb:parquet 1128606107 1192999232 0.95
tpch_q22/duckdb:parquet 535312958 534964442 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.3% +6.3% -12.8% +54.9% ➖ noise
1 datafusion:vortex-file-compressed -6.3% +6.3% -11.8% +54.4% ➖ noise
1 duckdb:vortex-compact +9.7% +6.3% +3.2% +31.8% ➖ noise
1 duckdb:vortex-file-compressed -12.9% +6.3% -18.1% +35.6% ➖ noise
2 datafusion:vortex-compact -4.4% -8.9% +5.0% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +3.2% -8.9% +13.3% +30.0% ➖ noise
2 duckdb:vortex-compact +1.1% -8.9% +11.0% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -5.0% -8.9% +4.3% +30.0% ➖ noise
3 datafusion:vortex-compact -15.3% -6.2% -9.7% +37.4% ➖ noise
3 datafusion:vortex-file-compressed +2.4% -6.2% +9.1% +43.0% ➖ noise
3 duckdb:vortex-compact -11.2% -6.2% -5.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +7.5% -6.2% +14.5% +30.0% ➖ noise
4 datafusion:vortex-compact -5.5% +3.0% -8.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -2.5% +3.0% -5.3% +30.0% ➖ noise
4 duckdb:vortex-compact -16.8% +3.0% -19.2% +31.3% ➖ noise
4 duckdb:vortex-file-compressed +0.2% +3.0% -2.7% +33.0% ➖ noise
5 datafusion:vortex-compact -7.3% +9.3% -15.2% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +2.6% +9.3% -6.1% +30.0% ➖ noise
5 duckdb:vortex-compact -7.1% +9.3% -14.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -2.6% +9.3% -10.9% +30.0% ➖ noise
6 datafusion:vortex-compact -9.7% -0.2% -9.6% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -0.6% -0.2% -0.5% +30.0% ➖ noise
6 duckdb:vortex-compact -2.6% -0.2% -2.4% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +26.2% -0.2% +26.4% +30.0% ➖ noise
7 datafusion:vortex-compact -8.7% +1.2% -9.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -6.0% +1.2% -7.1% +30.0% ➖ noise
7 duckdb:vortex-compact +3.5% +1.2% +2.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +1.3% +1.2% +0.1% +30.0% ➖ noise
8 datafusion:vortex-compact -7.5% -3.1% -4.5% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +0.4% -3.1% +3.6% +30.0% ➖ noise
8 duckdb:vortex-compact +2.8% -3.1% +6.1% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -4.2% -3.1% -1.1% +30.0% ➖ noise
9 datafusion:vortex-compact -2.9% -3.2% +0.3% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +14.4% -3.2% +18.1% +30.0% ➖ noise
9 duckdb:vortex-compact +1.6% -3.2% +4.9% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -8.1% -3.2% -5.1% +30.0% ➖ noise
10 datafusion:vortex-compact -0.3% -2.5% +2.2% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +7.6% -2.5% +10.3% +30.0% ➖ noise
10 duckdb:vortex-compact -7.6% -2.5% -5.3% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -4.7% -2.5% -2.2% +30.0% ➖ noise
11 datafusion:vortex-compact -6.0% -6.8% +0.9% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +3.9% -6.8% +11.5% +30.0% ➖ noise
11 duckdb:vortex-compact -4.8% -6.8% +2.1% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -1.1% -6.8% +6.1% +30.0% ➖ noise
12 datafusion:vortex-compact -3.9% -7.1% +3.4% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -8.5% -7.1% -1.6% +30.0% ➖ noise
12 duckdb:vortex-compact +4.2% -7.1% +12.2% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +7.6% -7.1% +15.8% +30.0% ➖ noise
13 datafusion:vortex-compact -17.6% -4.2% -14.0% +68.6% ➖ noise
13 datafusion:vortex-file-compressed -12.1% -4.2% -8.2% +40.4% ➖ noise
13 duckdb:vortex-compact -0.5% -4.2% +3.8% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +5.0% -4.2% +9.6% +30.0% ➖ noise
14 datafusion:vortex-compact +1.6% -14.8% +19.3% +40.7% ➖ noise
14 datafusion:vortex-file-compressed +2.0% -14.8% +19.8% +30.0% ➖ noise
14 duckdb:vortex-compact -2.3% -14.8% +14.8% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +12.9% -14.8% +32.5% +30.0% 🚨 regression
15 datafusion:vortex-compact -8.9% -3.6% -5.5% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -6.6% -3.6% -3.2% +30.0% ➖ noise
15 duckdb:vortex-compact -2.3% -3.6% +1.4% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -0.0% -3.6% +3.7% +30.0% ➖ noise
16 datafusion:vortex-compact +0.4% -8.5% +9.7% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -11.3% -8.5% -3.1% +30.0% ➖ noise
16 duckdb:vortex-compact -5.9% -8.5% +2.8% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -2.7% -8.5% +6.3% +30.0% ➖ noise
17 datafusion:vortex-compact -5.8% -3.4% -2.4% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -8.4% -3.4% -5.1% +30.0% ➖ noise
17 duckdb:vortex-compact -3.6% -3.4% -0.1% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -21.5% -3.4% -18.7% +30.0% ➖ noise
18 datafusion:vortex-compact -5.6% +0.3% -5.9% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +3.8% +0.3% +3.5% +30.0% ➖ noise
18 duckdb:vortex-compact -7.7% +0.3% -8.0% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +1.8% +0.3% +1.5% +30.0% ➖ noise
19 datafusion:vortex-compact -3.9% -10.1% +6.8% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -0.8% -10.1% +10.3% +30.0% ➖ noise
19 duckdb:vortex-compact +8.5% -10.1% +20.7% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -19.4% -10.1% -10.4% +30.0% ➖ noise
20 datafusion:vortex-compact -2.6% -6.2% +3.9% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -5.0% -6.2% +1.2% +30.0% ➖ noise
20 duckdb:vortex-compact +1.3% -6.2% +7.9% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +0.1% -6.2% +6.7% +30.0% ➖ noise
21 datafusion:vortex-compact -9.6% -2.0% -7.7% +33.6% ➖ noise
21 datafusion:vortex-file-compressed -2.6% -2.0% -0.6% +30.0% ➖ noise
21 duckdb:vortex-compact -15.8% -2.0% -14.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +2.2% -2.0% +4.2% +30.0% ➖ noise
22 datafusion:vortex-compact -2.3% +4.3% -6.3% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +5.0% +4.3% +0.7% +30.0% ➖ noise
22 duckdb:vortex-compact -13.9% +4.3% -17.4% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -11.1% +4.3% -14.8% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.0%
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.982x ➖
Shifts: Parquet (control) -1.8% · Median polish -1.9%


datafusion / vortex-file-compressed (1.038x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 667837523 648757667 1.03
tpch_q02/datafusion:vortex-file-compressed 734054604 737526943 1.00
tpch_q03/datafusion:vortex-file-compressed 746289072 791953607 0.94
tpch_q04/datafusion:vortex-file-compressed 612576957 585139964 1.05
tpch_q05/datafusion:vortex-file-compressed 939402451 952877556 0.99
tpch_q06/datafusion:vortex-file-compressed 610278396 641610110 0.95
tpch_q07/datafusion:vortex-file-compressed 935456332 970571904 0.96
tpch_q08/datafusion:vortex-file-compressed 1140335860 1204894038 0.95
tpch_q09/datafusion:vortex-file-compressed 1270715000 1286656253 0.99
tpch_q10/datafusion:vortex-file-compressed 1243962385 1003562789 1.24
tpch_q11/datafusion:vortex-file-compressed 578998412 492881099 1.17
tpch_q12/datafusion:vortex-file-compressed 935753383 910858773 1.03
tpch_q13/datafusion:vortex-file-compressed 449354416 433493216 1.04
tpch_q14/datafusion:vortex-file-compressed 664224948 572725947 1.16
tpch_q15/datafusion:vortex-file-compressed 1140690776 1094728433 1.04
tpch_q16/datafusion:vortex-file-compressed 374834944 386582219 0.97
tpch_q17/datafusion:vortex-file-compressed 1233593167 1183759414 1.04
tpch_q18/datafusion:vortex-file-compressed 1430679606 1222795148 1.17
tpch_q19/datafusion:vortex-file-compressed 959236623 744684616 1.29
tpch_q20/datafusion:vortex-file-compressed 1017239414 951225366 1.07
tpch_q21/datafusion:vortex-file-compressed 1599657807 1654132262 0.97
tpch_q22/datafusion:vortex-file-compressed 344478412 381585610 0.90
datafusion / vortex-compact (0.988x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 728468262 667154982 1.09
tpch_q02/datafusion:vortex-compact 672365583 575523271 1.17
tpch_q03/datafusion:vortex-compact 716493054 665980771 1.08
tpch_q04/datafusion:vortex-compact 533947962 540480890 0.99
tpch_q05/datafusion:vortex-compact 839233264 894553103 0.94
tpch_q06/datafusion:vortex-compact 564288460 650580766 0.87
tpch_q07/datafusion:vortex-compact 981533374 933417386 1.05
tpch_q08/datafusion:vortex-compact 1188556150 1143590817 1.04
tpch_q09/datafusion:vortex-compact 1174235199 1131767665 1.04
tpch_q10/datafusion:vortex-compact 829948606 895660542 0.93
tpch_q11/datafusion:vortex-compact 389764550 438025815 0.89
tpch_q12/datafusion:vortex-compact 806199793 810835872 0.99
tpch_q13/datafusion:vortex-compact 399437772 413277509 0.97
tpch_q14/datafusion:vortex-compact 578181386 666048061 0.87
tpch_q15/datafusion:vortex-compact 1038614258 1159120446 0.90
tpch_q16/datafusion:vortex-compact 345309965 301325060 1.15
tpch_q17/datafusion:vortex-compact 1148138275 1164470779 0.99
tpch_q18/datafusion:vortex-compact 1035647186 1048079477 0.99
tpch_q19/datafusion:vortex-compact 708087067 803592794 0.88
tpch_q20/datafusion:vortex-compact 813177061 859996028 0.95
tpch_q21/datafusion:vortex-compact 1379713973 1328160732 1.04
tpch_q22/datafusion:vortex-compact 366328172 353720261 1.04
datafusion / parquet (0.987x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 653819204 664521422 0.98
tpch_q02/datafusion:parquet 633812312 612188659 1.04
tpch_q03/datafusion:parquet 889478072 895203068 0.99
tpch_q04/datafusion:parquet 462113472 421108529 1.10
tpch_q05/datafusion:parquet 1040590931 1082286414 0.96
tpch_q06/datafusion:parquet 504456079 492773758 1.02
tpch_q07/datafusion:parquet 1174928460 1223851439 0.96
tpch_q08/datafusion:parquet 1416083363 1516116974 0.93
tpch_q09/datafusion:parquet 1643107665 1589066701 1.03
tpch_q10/datafusion:parquet 1901184548 1928687204 0.99
tpch_q11/datafusion:parquet 454800916 476391693 0.95
tpch_q12/datafusion:parquet 574152044 598812651 0.96
tpch_q13/datafusion:parquet 664771634 691994418 0.96
tpch_q14/datafusion:parquet 748278968 749387555 1.00
tpch_q15/datafusion:parquet 1169424427 1167480414 1.00
tpch_q16/datafusion:parquet 338366402 455437746 0.74
tpch_q17/datafusion:parquet 1370464369 1341019447 1.02
tpch_q18/datafusion:parquet 1329545348 1418332233 0.94
tpch_q19/datafusion:parquet 1013943096 964391033 1.05
tpch_q20/datafusion:parquet 1065663999 1081773906 0.99
tpch_q21/datafusion:parquet 1645212928 1597155591 1.03
tpch_q22/datafusion:parquet 848533983 759659543 1.12
duckdb / vortex-file-compressed (0.983x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 627819536 630719307 1.00
tpch_q02/duckdb:vortex-file-compressed 1217545814 1316246072 0.93
tpch_q03/duckdb:vortex-file-compressed 898294940 945148001 0.95
tpch_q04/duckdb:vortex-file-compressed 556912165 609987015 0.91
tpch_q05/duckdb:vortex-file-compressed 1187078858 1074483468 1.10
tpch_q06/duckdb:vortex-file-compressed 813842994 845924246 0.96
tpch_q07/duckdb:vortex-file-compressed 1192922036 1316427760 0.91
tpch_q08/duckdb:vortex-file-compressed 1436914904 1470359460 0.98
tpch_q09/duckdb:vortex-file-compressed 1414365192 1605468814 0.88
tpch_q10/duckdb:vortex-file-compressed 1181206975 1114376474 1.06
tpch_q11/duckdb:vortex-file-compressed 675515991 658259342 1.03
tpch_q12/duckdb:vortex-file-compressed 710052774 699581235 1.01
tpch_q13/duckdb:vortex-file-compressed 924146840 939646236 0.98
tpch_q14/duckdb:vortex-file-compressed 843350441 842530111 1.00
tpch_q15/duckdb:vortex-file-compressed 586525515 578598592 1.01
tpch_q16/duckdb:vortex-file-compressed 543053846 601087170 0.90
tpch_q17/duckdb:vortex-file-compressed 1050660733 961807312 1.09
tpch_q18/duckdb:vortex-file-compressed 908012169 888996212 1.02
tpch_q19/duckdb:vortex-file-compressed 858950213 898763587 0.96
tpch_q20/duckdb:vortex-file-compressed 1262600976 1223779340 1.03
tpch_q21/duckdb:vortex-file-compressed 2025706306 2067323025 0.98
tpch_q22/duckdb:vortex-file-compressed 637185838 667489332 0.95
duckdb / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 596606780 599251077 1.00
tpch_q02/duckdb:vortex-compact 1071208981 1076420504 1.00
tpch_q03/duckdb:vortex-compact 844173743 859939926 0.98
tpch_q04/duckdb:vortex-compact 495219174 478913507 1.03
tpch_q05/duckdb:vortex-compact 1012009946 1016361018 1.00
tpch_q06/duckdb:vortex-compact 726354354 738364106 0.98
tpch_q07/duckdb:vortex-compact 1070383396 1087774043 0.98
tpch_q08/duckdb:vortex-compact 1321009711 1325918102 1.00
tpch_q09/duckdb:vortex-compact 1277618496 1407961809 0.91
tpch_q10/duckdb:vortex-compact 1055938349 1072528265 0.98
tpch_q11/duckdb:vortex-compact 634751450 639122553 0.99
tpch_q12/duckdb:vortex-compact 697428442 634198363 1.10
tpch_q13/duckdb:vortex-compact 875455633 854910558 1.02
tpch_q14/duckdb:vortex-compact 858796081 856361304 1.00
tpch_q15/duckdb:vortex-compact 542069323 559158316 0.97
tpch_q16/duckdb:vortex-compact 469474050 422164104 1.11
tpch_q17/duckdb:vortex-compact 865742834 874136356 0.99
tpch_q18/duckdb:vortex-compact 824247772 819752025 1.01
tpch_q19/duckdb:vortex-compact 732667114 722109075 1.01
tpch_q20/duckdb:vortex-compact 1234903430 1258537238 0.98
tpch_q21/duckdb:vortex-compact 1645530965 1680632628 0.98
tpch_q22/duckdb:vortex-compact 603937489 634387846 0.95
duckdb / parquet (0.978x ➖, 0↑ 0↓)
name PR b0f2e4a (ns) base f418844 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 841575047 894161784 0.94
tpch_q02/duckdb:parquet 1449258337 1494240344 0.97
tpch_q03/duckdb:parquet 1631364436 1741639078 0.94
tpch_q04/duckdb:parquet 885691100 1000203291 0.89
tpch_q05/duckdb:parquet 2064421116 2139559140 0.96
tpch_q06/duckdb:parquet 720633004 722478331 1.00
tpch_q07/duckdb:parquet 1811836689 1751340835 1.03
tpch_q08/duckdb:parquet 2399461442 2572997313 0.93
tpch_q09/duckdb:parquet 2431215838 2626623088 0.93
tpch_q10/duckdb:parquet 3011009253 3120777543 0.96
tpch_q11/duckdb:parquet 957929656 1127732027 0.85
tpch_q12/duckdb:parquet 1163951191 1150199775 1.01
tpch_q13/duckdb:parquet 1199109232 1215885547 0.99
tpch_q14/duckdb:parquet 1219890110 1139593180 1.07
tpch_q15/duckdb:parquet 861401601 860985602 1.00
tpch_q16/duckdb:parquet 822168123 888000187 0.93
tpch_q17/duckdb:parquet 1356609986 1234548238 1.10
tpch_q18/duckdb:parquet 1397497597 1262202558 1.11
tpch_q19/duckdb:parquet 1511262586 1511860773 1.00
tpch_q20/duckdb:parquet 1766463506 1794179335 0.98
tpch_q21/duckdb:parquet 1792111697 1884979947 0.95
tpch_q22/duckdb:parquet 1071700569 1053915097 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +9.2% -3.8% +13.5% +36.3% ➖ noise
1 datafusion:vortex-file-compressed +2.9% -3.8% +7.0% +38.7% ➖ noise
1 duckdb:vortex-compact -0.4% -3.8% +3.5% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -0.5% -3.8% +3.4% +30.0% ➖ noise
2 datafusion:vortex-compact +16.8% +0.2% +16.6% +45.9% ➖ noise
2 datafusion:vortex-file-compressed -0.5% +0.2% -0.7% +47.6% ➖ noise
2 duckdb:vortex-compact -0.5% +0.2% -0.7% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -7.5% +0.2% -7.7% +33.9% ➖ noise
3 datafusion:vortex-compact +7.6% -3.5% +11.5% +41.5% ➖ noise
3 datafusion:vortex-file-compressed -5.8% -3.5% -2.3% +38.9% ➖ noise
3 duckdb:vortex-compact -1.8% -3.5% +1.8% +37.6% ➖ noise
3 duckdb:vortex-file-compressed -5.0% -3.5% -1.5% +31.9% ➖ noise
4 datafusion:vortex-compact -1.2% -1.4% +0.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +4.7% -1.4% +6.2% +30.0% ➖ noise
4 duckdb:vortex-compact +3.4% -1.4% +4.9% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -8.7% -1.4% -7.4% +30.0% ➖ noise
5 datafusion:vortex-compact -6.2% -3.7% -2.6% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -1.4% -3.7% +2.4% +30.0% ➖ noise
5 duckdb:vortex-compact -0.4% -3.7% +3.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +10.5% -3.7% +14.7% +30.0% ➖ noise
6 datafusion:vortex-compact -13.3% +1.0% -14.2% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -4.9% +1.0% -5.9% +30.0% ➖ noise
6 duckdb:vortex-compact -1.6% +1.0% -2.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -3.8% +1.0% -4.8% +30.0% ➖ noise
7 datafusion:vortex-compact +5.2% -0.3% +5.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -3.6% -0.3% -3.3% +30.0% ➖ noise
7 duckdb:vortex-compact -1.6% -0.3% -1.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -9.4% -0.3% -9.1% +30.0% ➖ noise
8 datafusion:vortex-compact +3.9% -6.7% +11.4% +47.7% ➖ noise
8 datafusion:vortex-file-compressed -5.4% -6.7% +1.4% +30.0% ➖ noise
8 duckdb:vortex-compact -0.4% -6.7% +6.8% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -2.3% -6.7% +4.7% +30.0% ➖ noise
9 datafusion:vortex-compact +3.8% -2.2% +6.1% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -1.2% -2.2% +1.0% +30.0% ➖ noise
9 duckdb:vortex-compact -9.3% -2.2% -7.2% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -11.9% -2.2% -9.9% +30.0% ➖ noise
10 datafusion:vortex-compact -7.3% -2.5% -5.0% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +24.0% -2.5% +27.1% +30.0% ➖ noise
10 duckdb:vortex-compact -1.5% -2.5% +1.0% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +6.0% -2.5% +8.7% +30.0% ➖ noise
11 datafusion:vortex-compact -11.0% -9.9% -1.2% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +17.5% -9.9% +30.4% +30.0% 🚨 regression
11 duckdb:vortex-compact -0.7% -9.9% +10.3% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +2.6% -9.9% +14.0% +30.0% ➖ noise
12 datafusion:vortex-compact -0.6% -1.5% +0.9% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +2.7% -1.5% +4.3% +30.0% ➖ noise
12 duckdb:vortex-compact +10.0% -1.5% +11.6% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +1.5% -1.5% +3.0% +30.0% ➖ noise
13 datafusion:vortex-compact -3.3% -2.7% -0.7% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +3.7% -2.7% +6.5% +30.0% ➖ noise
13 duckdb:vortex-compact +2.4% -2.7% +5.2% +39.3% ➖ noise
13 duckdb:vortex-file-compressed -1.6% -2.7% +1.0% +40.1% ➖ noise
14 datafusion:vortex-compact -13.2% +3.4% -16.0% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +16.0% +3.4% +12.2% +30.0% ➖ noise
14 duckdb:vortex-compact +0.3% +3.4% -3.0% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +0.1% +3.4% -3.2% +30.0% ➖ noise
15 datafusion:vortex-compact -10.4% +0.1% -10.5% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +4.2% +0.1% +4.1% +30.0% ➖ noise
15 duckdb:vortex-compact -3.1% +0.1% -3.2% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +1.4% +0.1% +1.3% +30.0% ➖ noise
16 datafusion:vortex-compact +14.6% -17.1% +38.2% +30.0% 🚨 regression
16 datafusion:vortex-file-compressed -3.0% -17.1% +16.9% +30.0% ➖ noise
16 duckdb:vortex-compact +11.2% -17.1% +34.1% +30.0% 🚨 regression
16 duckdb:vortex-file-compressed -9.7% -17.1% +8.9% +30.0% ➖ noise
17 datafusion:vortex-compact -1.4% +6.0% -7.0% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +4.2% +6.0% -1.7% +30.0% ➖ noise
17 duckdb:vortex-compact -1.0% +6.0% -6.5% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +9.2% +6.0% +3.1% +30.0% ➖ noise
18 datafusion:vortex-compact -1.2% +1.9% -3.0% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +17.0% +1.9% +14.8% +30.0% ➖ noise
18 duckdb:vortex-compact +0.5% +1.9% -1.3% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +2.1% +1.9% +0.3% +30.0% ➖ noise
19 datafusion:vortex-compact -11.9% +2.5% -14.0% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +28.8% +2.5% +25.6% +30.0% ➖ noise
19 duckdb:vortex-compact +1.5% +2.5% -1.0% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -4.4% +2.5% -6.8% +30.0% ➖ noise
20 datafusion:vortex-compact -5.4% -1.5% -4.0% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +6.9% -1.5% +8.6% +30.0% ➖ noise
20 duckdb:vortex-compact -1.9% -1.5% -0.4% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +3.2% -1.5% +4.8% +30.0% ➖ noise
21 datafusion:vortex-compact +3.9% -1.0% +5.0% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -3.3% -1.0% -2.3% +30.0% ➖ noise
21 duckdb:vortex-compact -2.1% -1.0% -1.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -2.0% -1.0% -1.0% +30.0% ➖ noise
22 datafusion:vortex-compact +3.6% +6.6% -2.8% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -9.7% +6.6% -15.3% +30.0% ➖ noise
22 duckdb:vortex-compact -4.8% +6.6% -10.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -4.5% +6.6% -10.4% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 1.262x ❌
Parquet (geomean): 1.138x ❌


unknown / unknown (1.193x ❌, 1↑ 47↓)
name PR a3e6376 (ns) base cc06c60 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2108144 2452507 0.86
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚨 1616878 1378111 1.17
random-access/feature-vectors/correlated/parquet-tokio-local-disk 9262020656 8597414030 1.08
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8897410413 8534829422 1.04
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8481449 7798277 1.09
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚨 8390943 7475189 1.12
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚨 6643747 5716889 1.16
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚨 7514635 6412367 1.17
random-access/feature-vectors/uniform/parquet-tokio-local-disk 🚨 9464779450 8410389828 1.13
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 9164921976 8443827809 1.09
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚨 17199755 13371183 1.29
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚨 15111161 13196299 1.15
random-access/lance-tokio-local-disk 🚨 909869 725583 1.25
random-access/lance-tokio-local-disk-footer 🚨 1715916 1231489 1.39
random-access/nested-lists/correlated/lance-tokio-local-disk 🚨 282125 247131 1.14
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚨 766887 610853 1.26
random-access/nested-lists/correlated/parquet-tokio-local-disk 🚨 145842203 132524239 1.10
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 141503447 132478285 1.07
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚨 750606 574337 1.31
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 794667 563064 1.41
random-access/nested-lists/uniform/lance-tokio-local-disk 🚨 1190057 1067931 1.11
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 🚨 1738141 1443145 1.20
random-access/nested-lists/uniform/parquet-tokio-local-disk 🚨 150807476 132147187 1.14
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 141518354 132109092 1.07
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚨 2608862 2077249 1.26
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚨 2444649 2069412 1.18
random-access/nested-structs/correlated/lance-tokio-local-disk 🚨 441114 399062 1.11
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 🚨 675679 582494 1.16
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 30935072 26991645 1.15
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 29616436 26563619 1.11
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚨 936918 717679 1.31
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 962734 745604 1.29
random-access/nested-structs/uniform/lance-tokio-local-disk 🚨 3052522 2649983 1.15
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 🚨 3399738 2876049 1.18
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 29475095 26422656 1.12
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 29930198 26414732 1.13
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚨 2123912 1549606 1.37
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚨 2002319 1642085 1.22
random-access/parquet-tokio-local-disk 🚨 217237249 174748798 1.24
random-access/parquet-tokio-local-disk-footer 🚨 208482811 175361201 1.19
random-access/taxi/correlated/lance-tokio-local-disk 🚨 1145452 911849 1.26
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚨 2056503 1516312 1.36
random-access/taxi/correlated/parquet-tokio-local-disk 🚨 316330572 261730692 1.21
random-access/taxi/correlated/parquet-tokio-local-disk-footer 🚨 317662529 261601034 1.21
random-access/taxi/correlated/vortex-tokio-local-disk 🚨 2433473 1802352 1.35
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚨 2447624 1809325 1.35
random-access/taxi/uniform/lance-tokio-local-disk 🚨 11765438 9703505 1.21
random-access/taxi/uniform/lance-tokio-local-disk-footer 🚨 12586108 10335316 1.22
random-access/taxi/uniform/parquet-tokio-local-disk 🚨 334646846 275709190 1.21
random-access/taxi/uniform/parquet-tokio-local-disk-footer 🚨 340425692 277521326 1.23
random-access/taxi/uniform/vortex-tokio-local-disk 🚨 5719883 4556933 1.26
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚨 5748817 4535548 1.27
random-access/vortex-tokio-local-disk 🚨 1604787 1268685 1.26
random-access/vortex-tokio-local-disk-footer 🚨 1658705 1287853 1.29

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 0.992x ➖
Parquet (geomean): 1.011x ➖


unknown / unknown (1.015x ➖, 2↑ 8↓)
name PR a3e6376 (ns) base cc06c60 (ns) ratio (PR/base)
compress time/Arade 1151476309 1135259905 1.01
compress time/Bimbo 6801417026 6749532528 1.01
compress time/CMSprovider 2872173870 2867976990 1.00
compress time/Euro2016 431658600 432559849 1.00
compress time/Food 364481538 371141674 0.98
compress time/HashTags 822754434 823627248 1.00
compress time/TPC-H l_comment canonical 1345042763 1316254717 1.02
compress time/TPC-H l_comment chunked 1317278996 1322223003 1.00
compress time/taxi 716350387 720125427 0.99
compress time/wide table cols=100 chunks=1 rows=1000 11779716 11004121 1.07
compress time/wide table cols=100 chunks=50 rows=1000 11921802 11559238 1.03
compress time/wide table cols=1000 chunks=1 rows=1000 128307087 129210307 0.99
compress time/wide table cols=1000 chunks=50 rows=1000 131336411 126696442 1.04
compress time/wide table cols=10000 chunks=1 rows=1000 1448089926 1385082007 1.05
compress time/wide table cols=10000 chunks=50 rows=1000 1456562816 1432374640 1.02
decompress time/Arade 27873754 27331498 1.02
decompress time/Bimbo 99452585 92879897 1.07
decompress time/CMSprovider 🚨 91423626 81223869 1.13
decompress time/Euro2016 19951774 19188760 1.04
decompress time/Food 9535698 9407333 1.01
decompress time/HashTags 71377461 69435076 1.03
decompress time/TPC-H l_comment canonical 42479457 39558258 1.07
decompress time/TPC-H l_comment chunked 40087997 39626546 1.01
decompress time/taxi 15665357 16423506 0.95
decompress time/wide table cols=100 chunks=1 rows=1000 2606893 2495708 1.04
decompress time/wide table cols=100 chunks=50 rows=1000 2785632 2566969 1.09
decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 25580844 22832315 1.12
decompress time/wide table cols=1000 chunks=50 rows=1000 24720026 22889748 1.08
decompress time/wide table cols=10000 chunks=1 rows=1000 267001424 246308363 1.08
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 269534937 243113311 1.11
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2976154917 2948314245 1.01
parquet_rs-zstd compress time/Bimbo 15671542680 15170580858 1.03
parquet_rs-zstd compress time/CMSprovider 8142788753 7545257989 1.08
parquet_rs-zstd compress time/Euro2016 1375242879 1361837922 1.01
parquet_rs-zstd compress time/Food 899905837 872807757 1.03
parquet_rs-zstd compress time/HashTags 2485577575 2307466014 1.08
parquet_rs-zstd compress time/TPC-H l_comment canonical 3171924324 3119689903 1.02
parquet_rs-zstd compress time/TPC-H l_comment chunked 3179757865 3096191052 1.03
parquet_rs-zstd compress time/taxi 1447040721 1379794264 1.05
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 8104253 6740033 1.20
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 7890232 6718017 1.17
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 88359528 80784499 1.09
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 85908044 80847563 1.06
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 904231816 864308213 1.05
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 889094043 879668801 1.01
parquet_rs-zstd decompress time/Arade 642746979 634266385 1.01
parquet_rs-zstd decompress time/Bimbo 1728532124 1731323710 1.00
parquet_rs-zstd decompress time/CMSprovider 1969581842 1925165943 1.02
parquet_rs-zstd decompress time/Euro2016 383997380 383375089 1.00
parquet_rs-zstd decompress time/Food 220456362 216582475 1.02
parquet_rs-zstd decompress time/HashTags 666087037 622153016 1.07
parquet_rs-zstd decompress time/TPC-H l_comment canonical 573103148 558174481 1.03
parquet_rs-zstd decompress time/TPC-H l_comment chunked 568735023 558576208 1.02
parquet_rs-zstd decompress time/taxi 244588303 247221951 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 🚨 3073930 2743707 1.12
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2942501 2720914 1.08
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 35294315 30922050 1.14
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 34447113 31510292 1.09
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 357679479 348222072 1.03
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 354565116 340661379 1.04
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163393980 163599156 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.00
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.98
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.93
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio compress time/Food 0 0 0.95
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.93
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.97
vortex:parquet-zstd ratio compress time/taxi 0 0 0.95
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 1 0.89
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚀 1 1 0.88
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.91
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.01
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.07
vortex:parquet-zstd ratio decompress time/CMSprovider 🚨 0 0 1.10
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.04
vortex:parquet-zstd ratio decompress time/Food 0 0 1.00
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.96
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.05
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.99
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.07
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@myrrc myrrc force-pushed the myrrc/duckdb-row-id-columns branch from a3e6376 to c54684f Compare April 27, 2026 09:38
@myrrc myrrc requested a review from joseph-isaacs April 27, 2026 09:39
Comment thread vortex-duckdb/cpp/table_function.cpp Outdated
Comment thread vortex-duckdb/src/duckdb/value.rs Outdated
Comment thread vortex-duckdb/src/datasource.rs Outdated
Comment thread vortex-duckdb/src/datasource.rs Outdated
@myrrc myrrc force-pushed the myrrc/duckdb-row-id-columns branch from c54684f to 32f5e43 Compare April 27, 2026 10:35
@myrrc myrrc enabled auto-merge (squash) April 27, 2026 10:35
@myrrc myrrc disabled auto-merge April 27, 2026 10:35
@myrrc myrrc force-pushed the myrrc/duckdb-row-id-columns branch from 32f5e43 to 5cb2217 Compare April 27, 2026 10:44
Signed-off-by: Mikhail Kot <to@myrrc.dev>
@myrrc myrrc force-pushed the myrrc/duckdb-row-id-columns branch from 5cb2217 to b0f2e4a Compare April 27, 2026 10:46
@myrrc myrrc enabled auto-merge (squash) April 27, 2026 10:49
@myrrc myrrc disabled auto-merge April 27, 2026 10:50
@myrrc myrrc added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 27, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 27, 2026
@myrrc myrrc marked this pull request as draft April 27, 2026 11:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants