Skip to content

deprecate: into_arrow#7577

Merged
joseph-isaacs merged 2 commits intodevelopfrom
ji/arrow-execute
Apr 20, 2026
Merged

deprecate: into_arrow#7577
joseph-isaacs merged 2 commits intodevelopfrom
ji/arrow-execute

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs commented Apr 20, 2026

deprecated

use execute_arrow

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the changelog/deprecation A change that introduces a series of API deprecations label Apr 20, 2026
@joseph-isaacs joseph-isaacs marked this pull request as ready for review April 20, 2026 19:45
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

# Conflicts:
#	vortex-array/src/arrays/filter/execute/varbinview.rs
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 20, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 20, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 20, 2026

Merging this PR will degrade performance by 10.24%

⚡ 3 improved benchmarks
❌ 1 regressed benchmark
✅ 1159 untouched benchmarks
⏩ 1462 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation case_when_all_false[1000] 92.9 µs 76.2 µs +21.95%
Simulation case_when_nary_early_dominant[1000] 138.7 µs 154.6 µs -10.24%
Simulation varbinview_zip_block_mask 3.7 ms 2.9 ms +27.63%
Simulation varbinview_zip_fragmented_mask 7.1 ms 6.4 ms +11.73%

Comparing ji/arrow-execute (0bec75e) with develop (91f1c2f)

Open in CodSpeed

Footnotes

  1. 1462 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 20, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 0bec75e 2 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done 0bec75e 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.046x ➖


datafusion / vortex-file-compressed (1.046x ➖, 0↑ 1↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 124136681 129389931 0.96
polarsignals_q01/datafusion:vortex-file-compressed 376409126 373778449 1.01
polarsignals_q02/datafusion:vortex-file-compressed 24443705 22740175 1.07
polarsignals_q03/datafusion:vortex-file-compressed 393616172 362942323 1.08
polarsignals_q04/datafusion:vortex-file-compressed 11282163 10522814 1.07
polarsignals_q05/datafusion:vortex-file-compressed 16299391 15146450 1.08
polarsignals_q06/datafusion:vortex-file-compressed 19706691 18469737 1.07
polarsignals_q07/datafusion:vortex-file-compressed 🚨 14053129 12679485 1.11
polarsignals_q08/datafusion:vortex-file-compressed 457052449 447128869 1.02
polarsignals_q09/datafusion:vortex-file-compressed 10023280 10017428 1.00

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.6%
Vortex (geomean): 0.986x ➖
Parquet (geomean): 1.010x ➖
Shifts: Parquet (control) +1.0% · Median polish -0.4%


datafusion / vortex-file-compressed (0.976x ➖, 1↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 48640475 55050434 0.88
tpch_q02/datafusion:vortex-file-compressed 27526295 28627685 0.96
tpch_q03/datafusion:vortex-file-compressed 26348754 26306139 1.00
tpch_q04/datafusion:vortex-file-compressed 18918325 18910057 1.00
tpch_q05/datafusion:vortex-file-compressed 49272338 51773902 0.95
tpch_q06/datafusion:vortex-file-compressed 10653799 10529065 1.01
tpch_q07/datafusion:vortex-file-compressed 60411516 61609666 0.98
tpch_q08/datafusion:vortex-file-compressed 38679882 39771584 0.97
tpch_q09/datafusion:vortex-file-compressed 52946433 54579985 0.97
tpch_q10/datafusion:vortex-file-compressed 41052756 43695669 0.94
tpch_q11/datafusion:vortex-file-compressed 15365755 15186775 1.01
tpch_q12/datafusion:vortex-file-compressed 23948550 24003948 1.00
tpch_q13/datafusion:vortex-file-compressed 27329313 26829004 1.02
tpch_q14/datafusion:vortex-file-compressed 15367871 15541068 0.99
tpch_q15/datafusion:vortex-file-compressed 22685594 23293070 0.97
tpch_q16/datafusion:vortex-file-compressed 21396444 21700276 0.99
tpch_q17/datafusion:vortex-file-compressed 61462649 66727452 0.92
tpch_q18/datafusion:vortex-file-compressed 79472220 81422410 0.98
tpch_q19/datafusion:vortex-file-compressed 22187393 22737042 0.98
tpch_q20/datafusion:vortex-file-compressed 28629606 29302991 0.98
tpch_q21/datafusion:vortex-file-compressed 69073307 72164331 0.96
tpch_q22/datafusion:vortex-file-compressed 14747210 14289201 1.03
datafusion / vortex-compact (0.967x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 57809987 61040124 0.95
tpch_q02/datafusion:vortex-compact 32767793 33588084 0.98
tpch_q03/datafusion:vortex-compact 28743963 30687813 0.94
tpch_q04/datafusion:vortex-compact 23535618 23444971 1.00
tpch_q05/datafusion:vortex-compact 53657496 56336457 0.95
tpch_q06/datafusion:vortex-compact 13925116 14996487 0.93
tpch_q07/datafusion:vortex-compact 69048224 70715797 0.98
tpch_q08/datafusion:vortex-compact 45600341 47675120 0.96
tpch_q09/datafusion:vortex-compact 60663130 61737526 0.98
tpch_q10/datafusion:vortex-compact 50111278 52452718 0.96
tpch_q11/datafusion:vortex-compact 17232766 17639695 0.98
tpch_q12/datafusion:vortex-compact 33596279 34428347 0.98
tpch_q13/datafusion:vortex-compact 34649758 35275873 0.98
tpch_q14/datafusion:vortex-compact 19720869 20982371 0.94
tpch_q15/datafusion:vortex-compact 33032408 33562621 0.98
tpch_q16/datafusion:vortex-compact 26010657 26413306 0.98
tpch_q17/datafusion:vortex-compact 64829244 69162462 0.94
tpch_q18/datafusion:vortex-compact 84211470 87350251 0.96
tpch_q19/datafusion:vortex-compact 34182989 34272552 1.00
tpch_q20/datafusion:vortex-compact 36702461 37315652 0.98
tpch_q21/datafusion:vortex-compact 80877006 84515415 0.96
tpch_q22/datafusion:vortex-compact 15044379 15378011 0.98
datafusion / parquet (1.019x ➖, 0↑ 2↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 121608433 92369616 1.32
tpch_q02/datafusion:parquet 65394245 63677128 1.03
tpch_q03/datafusion:parquet 73566878 74593445 0.99
tpch_q04/datafusion:parquet 46770981 46298092 1.01
tpch_q05/datafusion:parquet 98122709 96892170 1.01
tpch_q06/datafusion:parquet 42385487 42376211 1.00
tpch_q07/datafusion:parquet 106627355 108117861 0.99
tpch_q08/datafusion:parquet 101300399 100554772 1.01
tpch_q09/datafusion:parquet 133844356 132915204 1.01
tpch_q10/datafusion:parquet 116253385 113781352 1.02
tpch_q11/datafusion:parquet 43099762 42438902 1.02
tpch_q12/datafusion:parquet 88703286 88814707 1.00
tpch_q13/datafusion:parquet 203307319 198686471 1.02
tpch_q14/datafusion:parquet 46757956 45068105 1.04
tpch_q15/datafusion:parquet 60762576 61928303 0.98
tpch_q16/datafusion:parquet 45386969 45871043 0.99
tpch_q17/datafusion:parquet 130665679 129543888 1.01
tpch_q18/datafusion:parquet 159833792 167057861 0.96
tpch_q19/datafusion:parquet 🚨 90336469 81911098 1.10
tpch_q20/datafusion:parquet 70964835 72105005 0.98
tpch_q21/datafusion:parquet 140742173 139219482 1.01
tpch_q22/datafusion:parquet 31496147 32075541 0.98
datafusion / arrow (1.027x ➖, 1↑ 2↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 52258301 49983632 1.05
tpch_q02/datafusion:arrow 18545319 18829690 0.98
tpch_q03/datafusion:arrow 30355784 29702665 1.02
tpch_q04/datafusion:arrow 25911412 24580182 1.05
tpch_q05/datafusion:arrow 77324514 72777094 1.06
tpch_q06/datafusion:arrow 🚨 22209281 19410798 1.14
tpch_q07/datafusion:arrow 103921675 97263587 1.07
tpch_q08/datafusion:arrow 42591587 39406278 1.08
tpch_q09/datafusion:arrow 62438122 60562570 1.03
tpch_q10/datafusion:arrow 🚀 45911396 51090797 0.90
tpch_q11/datafusion:arrow 9087520 8874544 1.02
tpch_q12/datafusion:arrow 51798605 53253982 0.97
tpch_q13/datafusion:arrow 47544937 47066407 1.01
tpch_q14/datafusion:arrow 22171887 21894685 1.01
tpch_q15/datafusion:arrow 44198473 42146728 1.05
tpch_q16/datafusion:arrow 19422375 18661782 1.04
tpch_q17/datafusion:arrow 68293805 66655685 1.02
tpch_q18/datafusion:arrow 133058795 132822595 1.00
tpch_q19/datafusion:arrow 🚨 37789404 34266306 1.10
tpch_q20/datafusion:arrow 34976819 34229544 1.02
tpch_q21/datafusion:arrow 146959118 150530493 0.98
tpch_q22/datafusion:arrow 17330695 17546028 0.99
duckdb / vortex-file-compressed (0.993x ➖, 1↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31451126 31267788 1.01
tpch_q02/duckdb:vortex-file-compressed 25838217 25414303 1.02
tpch_q03/duckdb:vortex-file-compressed 31193598 30433592 1.02
tpch_q04/duckdb:vortex-file-compressed 29908998 30074257 0.99
tpch_q05/duckdb:vortex-file-compressed 34057177 33857353 1.01
tpch_q06/duckdb:vortex-file-compressed 10904104 10994252 0.99
tpch_q07/duckdb:vortex-file-compressed 37117930 37503443 0.99
tpch_q08/duckdb:vortex-file-compressed 41347097 41466838 1.00
tpch_q09/duckdb:vortex-file-compressed 🚀 71664361 79734255 0.90
tpch_q10/duckdb:vortex-file-compressed 35014187 37495194 0.93
tpch_q11/duckdb:vortex-file-compressed 15325745 14796578 1.04
tpch_q12/duckdb:vortex-file-compressed 22233061 21905065 1.01
tpch_q13/duckdb:vortex-file-compressed 35757052 35814451 1.00
tpch_q14/duckdb:vortex-file-compressed 21940712 20851665 1.05
tpch_q15/duckdb:vortex-file-compressed 16513454 16918778 0.98
tpch_q16/duckdb:vortex-file-compressed 28887450 29374589 0.98
tpch_q17/duckdb:vortex-file-compressed 25540035 25686458 0.99
tpch_q18/duckdb:vortex-file-compressed 51062979 51673842 0.99
tpch_q19/duckdb:vortex-file-compressed 29117747 29993946 0.97
tpch_q20/duckdb:vortex-file-compressed 35193284 35682452 0.99
tpch_q21/duckdb:vortex-file-compressed 108178518 108346485 1.00
tpch_q22/duckdb:vortex-file-compressed 17794890 17933460 0.99
duckdb / vortex-compact (1.007x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38839911 39375111 0.99
tpch_q02/duckdb:vortex-compact 36368385 35808903 1.02
tpch_q03/duckdb:vortex-compact 34035745 32760862 1.04
tpch_q04/duckdb:vortex-compact 34450588 35114577 0.98
tpch_q05/duckdb:vortex-compact 40040998 38703064 1.03
tpch_q06/duckdb:vortex-compact 14797509 15617538 0.95
tpch_q07/duckdb:vortex-compact 44400039 42910877 1.03
tpch_q08/duckdb:vortex-compact 45231590 44245566 1.02
tpch_q09/duckdb:vortex-compact 86967856 87588917 0.99
tpch_q10/duckdb:vortex-compact 40681826 40902600 0.99
tpch_q11/duckdb:vortex-compact 20409530 19845128 1.03
tpch_q12/duckdb:vortex-compact 35625574 35502991 1.00
tpch_q13/duckdb:vortex-compact 44548006 45540223 0.98
tpch_q14/duckdb:vortex-compact 30664431 29605587 1.04
tpch_q15/duckdb:vortex-compact 19766727 19166980 1.03
tpch_q16/duckdb:vortex-compact 34827718 35707116 0.98
tpch_q17/duckdb:vortex-compact 30639060 30536894 1.00
tpch_q18/duckdb:vortex-compact 51389092 50830799 1.01
tpch_q19/duckdb:vortex-compact 35687990 33940987 1.05
tpch_q20/duckdb:vortex-compact 43200249 43062891 1.00
tpch_q21/duckdb:vortex-compact 112990671 113698503 0.99
tpch_q22/duckdb:vortex-compact 20605762 20534227 1.00
duckdb / parquet (1.001x ➖, 2↑ 3↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 108187762 88460902 1.22
tpch_q02/duckdb:parquet 40226246 39692456 1.01
tpch_q03/duckdb:parquet 69863604 69686206 1.00
tpch_q04/duckdb:parquet 47421722 46216223 1.03
tpch_q05/duckdb:parquet 68290571 66594177 1.03
tpch_q06/duckdb:parquet 🚨 24348938 20150867 1.21
tpch_q07/duckdb:parquet 🚨 77021192 68877098 1.12
tpch_q08/duckdb:parquet 🚀 80864697 93529452 0.86
tpch_q09/duckdb:parquet 134434606 139156423 0.97
tpch_q10/duckdb:parquet 115839390 116785352 0.99
tpch_q11/duckdb:parquet 22555655 22618665 1.00
tpch_q12/duckdb:parquet 45376209 46083734 0.98
tpch_q13/duckdb:parquet 254582460 260599136 0.98
tpch_q14/duckdb:parquet 49989036 49261425 1.01
tpch_q15/duckdb:parquet 26937881 26583230 1.01
tpch_q16/duckdb:parquet 55495871 57574241 0.96
tpch_q17/duckdb:parquet 53362031 53672485 0.99
tpch_q18/duckdb:parquet 113586556 122963901 0.92
tpch_q19/duckdb:parquet 🚀 64244123 73518585 0.87
tpch_q20/duckdb:parquet 63582408 63798111 1.00
tpch_q21/duckdb:parquet 164407961 177591989 0.93
tpch_q22/duckdb:parquet 51859479 52690366 0.98
duckdb / duckdb (0.995x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16149358 15925484 1.01
tpch_q02/duckdb:duckdb 12839419 12997845 0.99
tpch_q03/duckdb:duckdb 19015820 19816279 0.96
tpch_q04/duckdb:duckdb 20002018 19418328 1.03
tpch_q05/duckdb:duckdb 19735539 20334413 0.97
tpch_q06/duckdb:duckdb 5332350 5403832 0.99
tpch_q07/duckdb:duckdb 22086625 21812049 1.01
tpch_q08/duckdb:duckdb 21199464 21988974 0.96
tpch_q09/duckdb:duckdb 54492290 57250584 0.95
tpch_q10/duckdb:duckdb 45234404 44898400 1.01
tpch_q11/duckdb:duckdb 6132250 6048643 1.01
tpch_q12/duckdb:duckdb 13960255 14329173 0.97
tpch_q13/duckdb:duckdb 37650886 37877549 0.99
tpch_q14/duckdb:duckdb 18254182 17498795 1.04
tpch_q15/duckdb:duckdb 12252803 12509862 0.98
tpch_q16/duckdb:duckdb 23625148 23305491 1.01
tpch_q17/duckdb:duckdb 13934396 13776277 1.01
tpch_q18/duckdb:duckdb 38060295 39228026 0.97
tpch_q19/duckdb:duckdb 27841232 27815356 1.00
tpch_q20/duckdb:duckdb 22526365 22998996 0.98
tpch_q21/duckdb:duckdb 57451630 56272704 1.02
tpch_q22/duckdb:duckdb 24954159 24603476 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +4.6% +26.9% -17.6% +21.6% ➖ noise
1 datafusion:vortex-compact -5.3% +26.9% -25.4% +18.5% ✅ faster
1 datafusion:vortex-file-compressed -11.6% +26.9% -30.4% +20.0% ✅ faster
1 duckdb:duckdb +1.4% +26.9% -20.1% +18.5% ✅ faster
1 duckdb:vortex-compact -1.4% +26.9% -22.3% +18.3% ✅ faster
1 duckdb:vortex-file-compressed +0.6% +26.9% -20.7% +22.0% ✅ faster
2 datafusion:arrow -1.5% +2.0% -3.5% +17.1% ➖ noise
2 datafusion:vortex-compact -2.4% +2.0% -4.4% +17.1% ➖ noise
2 datafusion:vortex-file-compressed -3.8% +2.0% -5.7% +17.1% ➖ noise
2 duckdb:duckdb -1.2% +2.0% -3.2% +17.1% ➖ noise
2 duckdb:vortex-compact +1.6% +2.0% -0.4% +17.1% ➖ noise
2 duckdb:vortex-file-compressed +1.7% +2.0% -0.3% +17.1% ➖ noise
3 datafusion:arrow +2.2% -0.6% +2.8% +17.1% ➖ noise
3 datafusion:vortex-compact -6.3% -0.6% -5.8% +17.1% ➖ noise
3 datafusion:vortex-file-compressed +0.2% -0.6% +0.7% +17.1% ➖ noise
3 duckdb:duckdb -4.0% -0.6% -3.5% +17.1% ➖ noise
3 duckdb:vortex-compact +3.9% -0.6% +4.5% +17.1% ➖ noise
3 duckdb:vortex-file-compressed +2.5% -0.6% +3.1% +17.1% ➖ noise
4 datafusion:arrow +5.4% +1.8% +3.5% +17.1% ➖ noise
4 datafusion:vortex-compact +0.4% +1.8% -1.4% +17.1% ➖ noise
4 datafusion:vortex-file-compressed +0.0% +1.8% -1.7% +17.1% ➖ noise
4 duckdb:duckdb +3.0% +1.8% +1.2% +17.1% ➖ noise
4 duckdb:vortex-compact -1.9% +1.8% -3.6% +17.1% ➖ noise
4 duckdb:vortex-file-compressed -0.5% +1.8% -2.3% +17.1% ➖ noise
5 datafusion:arrow +6.2% +1.9% +4.3% +17.1% ➖ noise
5 datafusion:vortex-compact -4.8% +1.9% -6.5% +17.1% ➖ noise
5 datafusion:vortex-file-compressed -4.8% +1.9% -6.6% +17.1% ➖ noise
5 duckdb:duckdb -2.9% +1.9% -4.8% +17.1% ➖ noise
5 duckdb:vortex-compact +3.5% +1.9% +1.5% +17.1% ➖ noise
5 duckdb:vortex-file-compressed +0.6% +1.9% -1.3% +17.1% ➖ noise
6 datafusion:arrow +14.4% +9.9% +4.1% +18.9% ➖ noise
6 datafusion:vortex-compact -7.1% +9.9% -15.5% +17.1% ✅ faster
6 datafusion:vortex-file-compressed +1.2% +9.9% -8.0% +17.6% ➖ noise
6 duckdb:duckdb -1.3% +9.9% -10.2% +17.1% ➖ noise
6 duckdb:vortex-compact -5.3% +9.9% -13.8% +17.1% ➖ noise
6 duckdb:vortex-file-compressed -0.8% +9.9% -9.8% +17.1% ➖ noise
7 datafusion:arrow +6.8% +5.0% +1.7% +17.1% ➖ noise
7 datafusion:vortex-compact -2.4% +5.0% -7.0% +17.1% ➖ noise
7 datafusion:vortex-file-compressed -1.9% +5.0% -6.6% +17.1% ➖ noise
7 duckdb:duckdb +1.3% +5.0% -3.6% +17.1% ➖ noise
7 duckdb:vortex-compact +3.5% +5.0% -1.5% +17.1% ➖ noise
7 duckdb:vortex-file-compressed -1.0% +5.0% -5.8% +17.1% ➖ noise
8 datafusion:arrow +8.1% -6.7% +15.8% +17.1% ➖ noise
8 datafusion:vortex-compact -4.4% -6.7% +2.5% +17.1% ➖ noise
8 datafusion:vortex-file-compressed -2.7% -6.7% +4.2% +17.1% ➖ noise
8 duckdb:duckdb -3.6% -6.7% +3.3% +17.1% ➖ noise
8 duckdb:vortex-compact +2.2% -6.7% +9.5% +17.1% ➖ noise
8 duckdb:vortex-file-compressed -0.3% -6.7% +6.8% +17.1% ➖ noise
9 datafusion:arrow +3.1% -1.4% +4.5% +17.1% ➖ noise
9 datafusion:vortex-compact -1.7% -1.4% -0.4% +17.1% ➖ noise
9 datafusion:vortex-file-compressed -3.0% -1.4% -1.6% +17.1% ➖ noise
9 duckdb:duckdb -4.8% -1.4% -3.5% +17.1% ➖ noise
9 duckdb:vortex-compact -0.7% -1.4% +0.7% +17.1% ➖ noise
9 duckdb:vortex-file-compressed -10.1% -1.4% -8.9% +17.1% ➖ noise
10 datafusion:arrow -10.1% +0.7% -10.7% +17.1% ➖ noise
10 datafusion:vortex-compact -4.5% +0.7% -5.1% +17.1% ➖ noise
10 datafusion:vortex-file-compressed -6.0% +0.7% -6.7% +17.1% ➖ noise
10 duckdb:duckdb +0.7% +0.7% +0.1% +17.1% ➖ noise
10 duckdb:vortex-compact -0.5% +0.7% -1.2% +17.1% ➖ noise
10 duckdb:vortex-file-compressed -6.6% +0.7% -7.2% +17.1% ➖ noise
11 datafusion:arrow +2.4% +0.6% +1.8% +17.1% ➖ noise
11 datafusion:vortex-compact -2.3% +0.6% -2.9% +17.1% ➖ noise
11 datafusion:vortex-file-compressed +1.2% +0.6% +0.5% +17.1% ➖ noise
11 duckdb:duckdb +1.4% +0.6% +0.7% +17.1% ➖ noise
11 duckdb:vortex-compact +2.8% +0.6% +2.2% +17.1% ➖ noise
11 duckdb:vortex-file-compressed +3.6% +0.6% +2.9% +17.1% ➖ noise
12 datafusion:arrow -2.7% -0.8% -1.9% +18.7% ➖ noise
12 datafusion:vortex-compact -2.4% -0.8% -1.6% +17.1% ➖ noise
12 datafusion:vortex-file-compressed -0.2% -0.8% +0.6% +17.1% ➖ noise
12 duckdb:duckdb -2.6% -0.8% -1.8% +17.1% ➖ noise
12 duckdb:vortex-compact +0.3% -0.8% +1.2% +17.1% ➖ noise
12 duckdb:vortex-file-compressed +1.5% -0.8% +2.3% +17.1% ➖ noise
13 datafusion:arrow +1.0% -0.0% +1.0% +17.1% ➖ noise
13 datafusion:vortex-compact -1.8% -0.0% -1.8% +17.1% ➖ noise
13 datafusion:vortex-file-compressed +1.9% -0.0% +1.9% +17.1% ➖ noise
13 duckdb:duckdb -0.6% -0.0% -0.6% +17.1% ➖ noise
13 duckdb:vortex-compact -2.2% -0.0% -2.2% +17.1% ➖ noise
13 duckdb:vortex-file-compressed -0.2% -0.0% -0.1% +17.1% ➖ noise
14 datafusion:arrow +1.3% +2.6% -1.3% +17.1% ➖ noise
14 datafusion:vortex-compact -6.0% +2.6% -8.4% +17.1% ➖ noise
14 datafusion:vortex-file-compressed -1.1% +2.6% -3.6% +17.1% ➖ noise
14 duckdb:duckdb +4.3% +2.6% +1.7% +17.1% ➖ noise
14 duckdb:vortex-compact +3.6% +2.6% +0.9% +17.1% ➖ noise
14 duckdb:vortex-file-compressed +5.2% +2.6% +2.5% +17.1% ➖ noise
15 datafusion:arrow +4.9% -0.3% +5.2% +17.1% ➖ noise
15 datafusion:vortex-compact -1.6% -0.3% -1.3% +17.1% ➖ noise
15 datafusion:vortex-file-compressed -2.6% -0.3% -2.3% +17.1% ➖ noise
15 duckdb:duckdb -2.1% -0.3% -1.8% +18.0% ➖ noise
15 duckdb:vortex-compact +3.1% -0.3% +3.4% +17.1% ➖ noise
15 duckdb:vortex-file-compressed -2.4% -0.3% -2.1% +17.1% ➖ noise
16 datafusion:arrow +4.1% -2.3% +6.6% +17.1% ➖ noise
16 datafusion:vortex-compact -1.5% -2.3% +0.8% +17.1% ➖ noise
16 datafusion:vortex-file-compressed -1.4% -2.3% +1.0% +17.1% ➖ noise
16 duckdb:duckdb +1.4% -2.3% +3.8% +17.1% ➖ noise
16 duckdb:vortex-compact -2.5% -2.3% -0.1% +17.1% ➖ noise
16 duckdb:vortex-file-compressed -1.7% -2.3% +0.7% +17.1% ➖ noise
17 datafusion:arrow +2.5% +0.1% +2.3% +17.1% ➖ noise
17 datafusion:vortex-compact -6.3% +0.1% -6.4% +17.1% ➖ noise
17 datafusion:vortex-file-compressed -7.9% +0.1% -8.0% +17.1% ➖ noise
17 duckdb:duckdb +1.1% +0.1% +1.0% +17.1% ➖ noise
17 duckdb:vortex-compact +0.3% +0.1% +0.2% +17.1% ➖ noise
17 duckdb:vortex-file-compressed -0.6% +0.1% -0.7% +17.1% ➖ noise
18 datafusion:arrow +0.2% -6.0% +6.6% +17.1% ➖ noise
18 datafusion:vortex-compact -3.6% -6.0% +2.5% +17.1% ➖ noise
18 datafusion:vortex-file-compressed -2.4% -6.0% +3.8% +17.1% ➖ noise
18 duckdb:duckdb -3.0% -6.0% +3.2% +17.1% ➖ noise
18 duckdb:vortex-compact +1.1% -6.0% +7.5% +17.1% ➖ noise
18 duckdb:vortex-file-compressed -1.2% -6.0% +5.1% +17.1% ➖ noise
19 datafusion:arrow +10.3% -1.8% +12.3% +17.1% ➖ noise
19 datafusion:vortex-compact -0.3% -1.8% +1.6% +17.1% ➖ noise
19 datafusion:vortex-file-compressed -2.4% -1.8% -0.6% +17.1% ➖ noise
19 duckdb:duckdb +0.1% -1.8% +2.0% +17.1% ➖ noise
19 duckdb:vortex-compact +5.1% -1.8% +7.1% +17.1% ➖ noise
19 duckdb:vortex-file-compressed -2.9% -1.8% -1.1% +17.1% ➖ noise
20 datafusion:arrow +2.2% -1.0% +3.2% +17.1% ➖ noise
20 datafusion:vortex-compact -1.6% -1.0% -0.7% +17.1% ➖ noise
20 datafusion:vortex-file-compressed -2.3% -1.0% -1.3% +17.1% ➖ noise
20 duckdb:duckdb -2.1% -1.0% -1.1% +17.1% ➖ noise
20 duckdb:vortex-compact +0.3% -1.0% +1.3% +17.1% ➖ noise
20 duckdb:vortex-file-compressed -1.4% -1.0% -0.4% +17.1% ➖ noise
21 datafusion:arrow -2.4% -3.3% +0.9% +17.1% ➖ noise
21 datafusion:vortex-compact -4.3% -3.3% -1.1% +17.1% ➖ noise
21 datafusion:vortex-file-compressed -4.3% -3.3% -1.1% +17.1% ➖ noise
21 duckdb:duckdb +2.1% -3.3% +5.5% +17.1% ➖ noise
21 duckdb:vortex-compact -0.6% -3.3% +2.7% +17.1% ➖ noise
21 duckdb:vortex-file-compressed -0.2% -3.3% +3.2% +17.1% ➖ noise
22 datafusion:arrow -1.2% -1.7% +0.5% +17.1% ➖ noise
22 datafusion:vortex-compact -2.2% -1.7% -0.5% +17.1% ➖ noise
22 datafusion:vortex-file-compressed +3.2% -1.7% +5.0% +17.1% ➖ noise
22 duckdb:duckdb +1.4% -1.7% +3.2% +17.1% ➖ noise
22 duckdb:vortex-compact +0.3% -1.7% +2.1% +17.1% ➖ noise
22 duckdb:vortex-file-compressed -0.8% -1.7% +0.9% +17.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.5%
Vortex (geomean): 1.006x ➖
Parquet (geomean): 1.032x ➖
Shifts: Parquet (control) +3.2% · Median polish +0.5%


datafusion / vortex-file-compressed (1.001x ➖, 0↑ 1↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 4043857 4016406 1.01
fineweb_q01/datafusion:vortex-file-compressed 22933027 22255940 1.03
fineweb_q02/datafusion:vortex-file-compressed 21123172 22885896 0.92
fineweb_q03/datafusion:vortex-file-compressed 75367907 77485411 0.97
fineweb_q04/datafusion:vortex-file-compressed 🚨 253476602 227466815 1.11
fineweb_q05/datafusion:vortex-file-compressed 216246413 214176261 1.01
fineweb_q06/datafusion:vortex-file-compressed 53858705 53770615 1.00
fineweb_q07/datafusion:vortex-file-compressed 60552582 58667554 1.03
fineweb_q08/datafusion:vortex-file-compressed 21021054 22500367 0.93
datafusion / vortex-compact (1.016x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4300497 4254563 1.01
fineweb_q01/datafusion:vortex-compact 159011260 159197007 1.00
fineweb_q02/datafusion:vortex-compact 162465521 162276410 1.00
fineweb_q03/datafusion:vortex-compact 1492513614 1470870537 1.01
fineweb_q04/datafusion:vortex-compact 1613256752 1605664090 1.00
fineweb_q05/datafusion:vortex-compact 1273077651 1254630087 1.01
fineweb_q06/datafusion:vortex-compact 733741776 692380170 1.06
fineweb_q07/datafusion:vortex-compact 736288136 731389732 1.01
fineweb_q08/datafusion:vortex-compact 18536195 17873356 1.04
datafusion / parquet (1.024x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7147244 6507168 1.10
fineweb_q01/datafusion:parquet 293649883 287826399 1.02
fineweb_q02/datafusion:parquet 288222935 288870054 1.00
fineweb_q03/datafusion:parquet 296649322 277848990 1.07
fineweb_q04/datafusion:parquet 306587890 294831386 1.04
fineweb_q05/datafusion:parquet 296718904 294013211 1.01
fineweb_q06/datafusion:parquet 288064646 292579710 0.98
fineweb_q07/datafusion:parquet 284010285 283818100 1.00
fineweb_q08/datafusion:parquet 279646411 279401630 1.00
duckdb / vortex-file-compressed (0.979x ➖, 1↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3409668 3128342 1.09
fineweb_q01/duckdb:vortex-file-compressed 21413215 22769230 0.94
fineweb_q02/duckdb:vortex-file-compressed 23966544 23558013 1.02
fineweb_q03/duckdb:vortex-file-compressed 🚀 134034980 160565267 0.83
fineweb_q04/duckdb:vortex-file-compressed 223505278 225317917 0.99
fineweb_q05/duckdb:vortex-file-compressed 212834381 211550023 1.01
fineweb_q06/duckdb:vortex-file-compressed 52697237 51156980 1.03
fineweb_q07/duckdb:vortex-file-compressed 54253696 55584753 0.98
fineweb_q08/duckdb:vortex-file-compressed 22991663 24269353 0.95
duckdb / vortex-compact (1.026x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4209443 3849799 1.09
fineweb_q01/duckdb:vortex-compact 101217690 100421285 1.01
fineweb_q02/duckdb:vortex-compact 111981225 114128235 0.98
fineweb_q03/duckdb:vortex-compact 872819022 861009511 1.01
fineweb_q04/duckdb:vortex-compact 904624381 901033013 1.00
fineweb_q05/duckdb:vortex-compact 832699146 804596417 1.03
fineweb_q06/duckdb:vortex-compact 476160331 458625927 1.04
fineweb_q07/duckdb:vortex-compact 503956468 480983643 1.05
fineweb_q08/duckdb:vortex-compact 20014906 19665756 1.02
duckdb / parquet (1.039x ➖, 0↑ 2↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 30296980 26689104 1.14
fineweb_q01/duckdb:parquet 81382503 81394094 1.00
fineweb_q02/duckdb:parquet 84986822 83222997 1.02
fineweb_q03/duckdb:parquet 313363944 306295031 1.02
fineweb_q04/duckdb:parquet 440296522 440054790 1.00
fineweb_q05/duckdb:parquet 411755623 409317164 1.01
fineweb_q06/duckdb:parquet 199089714 197326725 1.01
fineweb_q07/duckdb:parquet 210322200 206936334 1.02
fineweb_q08/duckdb:parquet 🚨 32944134 28455984 1.16
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +1.1% +11.7% -9.5% +51.5% ➖ noise
0 datafusion:vortex-file-compressed +0.7% +11.7% -9.8% +49.4% ➖ noise
0 duckdb:vortex-compact +9.3% +11.7% -2.1% +48.8% ➖ noise
0 duckdb:vortex-file-compressed +9.0% +11.7% -2.4% +82.5% ➖ noise
1 datafusion:vortex-compact -0.1% +1.0% -1.1% +10.3% ➖ noise
1 datafusion:vortex-file-compressed +3.0% +1.0% +2.0% +23.5% ➖ noise
1 duckdb:vortex-compact +0.8% +1.0% -0.2% +20.3% ➖ noise
1 duckdb:vortex-file-compressed -6.0% +1.0% -6.9% +62.8% ➖ noise
2 datafusion:vortex-compact +0.1% +0.9% -0.8% +10.3% ➖ noise
2 datafusion:vortex-file-compressed -7.7% +0.9% -8.6% +19.6% ➖ noise
2 duckdb:vortex-compact -1.9% +0.9% -2.8% +15.9% ➖ noise
2 duckdb:vortex-file-compressed +1.7% +0.9% +0.8% +10.3% ➖ noise
3 datafusion:vortex-compact +1.5% +4.5% -2.9% +10.3% ➖ noise
3 datafusion:vortex-file-compressed -2.7% +4.5% -6.9% +50.4% ➖ noise
3 duckdb:vortex-compact +1.4% +4.5% -3.0% +10.3% ➖ noise
3 duckdb:vortex-file-compressed -16.5% +4.5% -20.1% +21.3% ✅ faster
4 datafusion:vortex-compact +0.5% +2.0% -1.5% +10.3% ➖ noise
4 datafusion:vortex-file-compressed +11.4% +2.0% +9.2% +11.1% ➖ noise
4 duckdb:vortex-compact +0.4% +2.0% -1.6% +10.3% ➖ noise
4 duckdb:vortex-file-compressed -0.8% +2.0% -2.8% +10.3% ➖ noise
5 datafusion:vortex-compact +1.5% +0.8% +0.7% +10.3% ➖ noise
5 datafusion:vortex-file-compressed +1.0% +0.8% +0.2% +10.3% ➖ noise
5 duckdb:vortex-compact +3.5% +0.8% +2.7% +10.3% ➖ noise
5 duckdb:vortex-file-compressed +0.6% +0.8% -0.1% +10.3% ➖ noise
6 datafusion:vortex-compact +6.0% -0.3% +6.3% +10.3% ➖ noise
6 datafusion:vortex-file-compressed +0.2% -0.3% +0.5% +11.1% ➖ noise
6 duckdb:vortex-compact +3.8% -0.3% +4.2% +10.3% ➖ noise
6 duckdb:vortex-file-compressed +3.0% -0.3% +3.4% +10.3% ➖ noise
7 datafusion:vortex-compact +0.7% +0.8% -0.2% +10.3% ➖ noise
7 datafusion:vortex-file-compressed +3.2% +0.8% +2.3% +17.7% ➖ noise
7 duckdb:vortex-compact +4.8% +0.8% +3.9% +10.3% ➖ noise
7 duckdb:vortex-file-compressed -2.4% +0.8% -3.2% +18.7% ➖ noise
8 datafusion:vortex-compact +3.7% +7.6% -3.7% +13.7% ➖ noise
8 datafusion:vortex-file-compressed -6.6% +7.6% -13.2% +16.8% ➖ noise
8 duckdb:vortex-compact +1.8% +7.6% -5.5% +46.4% ➖ noise
8 duckdb:vortex-file-compressed -5.3% +7.6% -12.0% +52.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@joseph-isaacs joseph-isaacs enabled auto-merge (squash) April 20, 2026 19:58
@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Vortex (geomean): 0.926x ➖
Parquet (geomean): 0.936x ➖
Shifts: Parquet (control) -6.4% · Median polish -7.1%


datafusion / vortex-file-compressed (0.917x ➖, 26↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 19543582 22772552 0.86
tpcds_q02/datafusion:vortex-file-compressed 46334189 51140990 0.91
tpcds_q03/datafusion:vortex-file-compressed 16202889 17442840 0.93
tpcds_q04/datafusion:vortex-file-compressed 262863397 288498425 0.91
tpcds_q05/datafusion:vortex-file-compressed 🚀 42621899 48622165 0.88
tpcds_q06/datafusion:vortex-file-compressed 41426848 45672788 0.91
tpcds_q07/datafusion:vortex-file-compressed 🚀 43302275 48626469 0.89
tpcds_q08/datafusion:vortex-file-compressed 28991218 31909897 0.91
tpcds_q09/datafusion:vortex-file-compressed 45785705 49232601 0.93
tpcds_q10/datafusion:vortex-file-compressed 🚀 34552985 38458111 0.90
tpcds_q11/datafusion:vortex-file-compressed 🚀 145884837 164360395 0.89
tpcds_q12/datafusion:vortex-file-compressed 18952761 20469878 0.93
tpcds_q13/datafusion:vortex-file-compressed 46535858 50425791 0.92
tpcds_q14/datafusion:vortex-file-compressed 169052186 185333927 0.91
tpcds_q15/datafusion:vortex-file-compressed 29016992 32053770 0.91
tpcds_q16/datafusion:vortex-file-compressed 23907027 25459557 0.94
tpcds_q17/datafusion:vortex-file-compressed 58241182 63442562 0.92
tpcds_q18/datafusion:vortex-file-compressed 66642676 70106562 0.95
tpcds_q19/datafusion:vortex-file-compressed 23927980 25609388 0.93
tpcds_q20/datafusion:vortex-file-compressed 🚀 21722614 24492383 0.89
tpcds_q21/datafusion:vortex-file-compressed 🚀 124672650 140892059 0.88
tpcds_q22/datafusion:vortex-file-compressed 55220100 58031574 0.95
tpcds_q23/datafusion:vortex-file-compressed 127926026 139569557 0.92
tpcds_q24/datafusion:vortex-file-compressed 🚀 99251497 111225335 0.89
tpcds_q25/datafusion:vortex-file-compressed 59246827 65551916 0.90
tpcds_q26/datafusion:vortex-file-compressed 31729923 34855945 0.91
tpcds_q27/datafusion:vortex-file-compressed 🚀 102282234 119719376 0.85
tpcds_q28/datafusion:vortex-file-compressed 44674218 45186750 0.99
tpcds_q29/datafusion:vortex-file-compressed 58169478 63666989 0.91
tpcds_q30/datafusion:vortex-file-compressed 23985416 25649050 0.94
tpcds_q31/datafusion:vortex-file-compressed 🚀 79050367 90538213 0.87
tpcds_q32/datafusion:vortex-file-compressed 17687610 19160802 0.92
tpcds_q33/datafusion:vortex-file-compressed 29162890 29621460 0.98
tpcds_q34/datafusion:vortex-file-compressed 27124123 28602275 0.95
tpcds_q35/datafusion:vortex-file-compressed 43264752 46997037 0.92
tpcds_q36/datafusion:vortex-file-compressed 63807911 66303972 0.96
tpcds_q37/datafusion:vortex-file-compressed 🚀 29854570 33634730 0.89
tpcds_q38/datafusion:vortex-file-compressed 43987052 47929278 0.92
tpcds_q39/datafusion:vortex-file-compressed 🚀 126294487 142625457 0.89
tpcds_q40/datafusion:vortex-file-compressed 46802940 51264650 0.91
tpcds_q41/datafusion:vortex-file-compressed 🚀 15628449 18399008 0.85
tpcds_q42/datafusion:vortex-file-compressed 14739844 15407894 0.96
tpcds_q43/datafusion:vortex-file-compressed 30648075 32235605 0.95
tpcds_q44/datafusion:vortex-file-compressed 33961005 35939598 0.94
tpcds_q45/datafusion:vortex-file-compressed 29026534 31556297 0.92
tpcds_q46/datafusion:vortex-file-compressed 39600360 43866685 0.90
tpcds_q47/datafusion:vortex-file-compressed 🚀 183313021 209117598 0.88
tpcds_q48/datafusion:vortex-file-compressed 40049967 43224696 0.93
tpcds_q49/datafusion:vortex-file-compressed 🚀 58897334 65776969 0.90
tpcds_q50/datafusion:vortex-file-compressed 39661509 41033276 0.97
tpcds_q51/datafusion:vortex-file-compressed 82412067 89860997 0.92
tpcds_q52/datafusion:vortex-file-compressed 15197964 16865315 0.90
tpcds_q53/datafusion:vortex-file-compressed 🚀 19676102 22059850 0.89
tpcds_q54/datafusion:vortex-file-compressed 35121283 37193280 0.94
tpcds_q55/datafusion:vortex-file-compressed 🚀 14718778 16638071 0.88
tpcds_q56/datafusion:vortex-file-compressed 30810394 33065870 0.93
tpcds_q57/datafusion:vortex-file-compressed 113350396 124545153 0.91
tpcds_q58/datafusion:vortex-file-compressed 🚀 59052882 66045991 0.89
tpcds_q59/datafusion:vortex-file-compressed 62543723 68964797 0.91
tpcds_q60/datafusion:vortex-file-compressed 30286555 33044266 0.92
tpcds_q61/datafusion:vortex-file-compressed 🚀 39100904 43481478 0.90
tpcds_q62/datafusion:vortex-file-compressed 27623864 30383328 0.91
tpcds_q63/datafusion:vortex-file-compressed 20183773 21481805 0.94
tpcds_q64/datafusion:vortex-file-compressed 423088432 451709375 0.94
tpcds_q65/datafusion:vortex-file-compressed 41654870 44341379 0.94
tpcds_q66/datafusion:vortex-file-compressed 🚀 81379307 93253396 0.87
tpcds_q67/datafusion:vortex-file-compressed 106294187 117823370 0.90
tpcds_q68/datafusion:vortex-file-compressed 39333081 41592301 0.95
tpcds_q69/datafusion:vortex-file-compressed 32565802 35663396 0.91
tpcds_q70/datafusion:vortex-file-compressed 97380162 104763954 0.93
tpcds_q71/datafusion:vortex-file-compressed 25436023 27874130 0.91
tpcds_q72/datafusion:vortex-file-compressed 🚀 2361703246 2671400296 0.88
tpcds_q73/datafusion:vortex-file-compressed 25973775 27744974 0.94
tpcds_q74/datafusion:vortex-file-compressed 102548420 108271818 0.95
tpcds_q75/datafusion:vortex-file-compressed 102315765 111542545 0.92
tpcds_q76/datafusion:vortex-file-compressed 🚀 27493048 30750901 0.89
tpcds_q77/datafusion:vortex-file-compressed 40440754 42052962 0.96
tpcds_q78/datafusion:vortex-file-compressed 114905316 124254563 0.92
tpcds_q79/datafusion:vortex-file-compressed 31475468 33461954 0.94
tpcds_q80/datafusion:vortex-file-compressed 97995368 101068039 0.97
tpcds_q81/datafusion:vortex-file-compressed 🚀 26527306 29940776 0.89
tpcds_q82/datafusion:vortex-file-compressed 32276694 34706358 0.93
tpcds_q83/datafusion:vortex-file-compressed 38745219 41346922 0.94
tpcds_q84/datafusion:vortex-file-compressed 12192873 13110136 0.93
tpcds_q85/datafusion:vortex-file-compressed 87372496 93740237 0.93
tpcds_q86/datafusion:vortex-file-compressed 16120590 17397088 0.93
tpcds_q87/datafusion:vortex-file-compressed 🚀 44524634 50315956 0.88
tpcds_q88/datafusion:vortex-file-compressed 55511704 60840474 0.91
tpcds_q89/datafusion:vortex-file-compressed 32984913 33743295 0.98
tpcds_q90/datafusion:vortex-file-compressed 13765415 14990097 0.92
tpcds_q91/datafusion:vortex-file-compressed 🚀 20714914 23604030 0.88
tpcds_q92/datafusion:vortex-file-compressed 15940335 16927519 0.94
tpcds_q93/datafusion:vortex-file-compressed 30296541 33187077 0.91
tpcds_q94/datafusion:vortex-file-compressed 19716953 21598000 0.91
tpcds_q95/datafusion:vortex-file-compressed 50643655 55247461 0.92
tpcds_q96/datafusion:vortex-file-compressed 12426683 13392110 0.93
tpcds_q97/datafusion:vortex-file-compressed 26414769 28266096 0.93
tpcds_q98/datafusion:vortex-file-compressed 29296268 30705510 0.95
tpcds_q99/datafusion:vortex-file-compressed 🚀 40077714 45970435 0.87
datafusion / vortex-compact (0.927x ➖, 25↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚀 25876836 30315200 0.85
tpcds_q02/datafusion:vortex-compact 🚀 54124701 60735544 0.89
tpcds_q03/datafusion:vortex-compact 23390652 25977779 0.90
tpcds_q04/datafusion:vortex-compact 294429287 323194892 0.91
tpcds_q05/datafusion:vortex-compact 55217086 59641903 0.93
tpcds_q06/datafusion:vortex-compact 🚀 49633161 56845376 0.87
tpcds_q07/datafusion:vortex-compact 🚀 57286235 64260293 0.89
tpcds_q08/datafusion:vortex-compact 39018074 40137315 0.97
tpcds_q09/datafusion:vortex-compact 62948536 66192660 0.95
tpcds_q10/datafusion:vortex-compact 58360579 63156500 0.92
tpcds_q11/datafusion:vortex-compact 🚀 173020964 194629771 0.89
tpcds_q12/datafusion:vortex-compact 🚀 23239722 26651883 0.87
tpcds_q13/datafusion:vortex-compact 109295760 114884008 0.95
tpcds_q14/datafusion:vortex-compact 🚀 226300685 253013739 0.89
tpcds_q15/datafusion:vortex-compact 34034110 36333647 0.94
tpcds_q16/datafusion:vortex-compact 34362612 36768885 0.93
tpcds_q17/datafusion:vortex-compact 83590173 92046716 0.91
tpcds_q18/datafusion:vortex-compact 78937552 84834779 0.93
tpcds_q19/datafusion:vortex-compact 39287498 41041247 0.96
tpcds_q20/datafusion:vortex-compact 🚀 25163644 28172023 0.89
tpcds_q21/datafusion:vortex-compact 🚀 133092716 147942803 0.90
tpcds_q22/datafusion:vortex-compact 🚀 58215322 65992195 0.88
tpcds_q23/datafusion:vortex-compact 167359150 179217809 0.93
tpcds_q24/datafusion:vortex-compact 129190260 137943290 0.94
tpcds_q25/datafusion:vortex-compact 89819504 94501710 0.95
tpcds_q26/datafusion:vortex-compact 🚀 41315230 46398938 0.89
tpcds_q27/datafusion:vortex-compact 🚀 143512498 160618638 0.89
tpcds_q28/datafusion:vortex-compact 83726993 85141561 0.98
tpcds_q29/datafusion:vortex-compact 89792197 93196255 0.96
tpcds_q30/datafusion:vortex-compact 🚀 27637393 31862297 0.87
tpcds_q31/datafusion:vortex-compact 126332559 131905571 0.96
tpcds_q32/datafusion:vortex-compact 🚀 23179464 25818436 0.90
tpcds_q33/datafusion:vortex-compact 47002708 49097900 0.96
tpcds_q34/datafusion:vortex-compact 46542025 48236291 0.96
tpcds_q35/datafusion:vortex-compact 63746529 65995125 0.97
tpcds_q36/datafusion:vortex-compact 88138345 96253158 0.92
tpcds_q37/datafusion:vortex-compact 🚀 42518709 47791588 0.89
tpcds_q38/datafusion:vortex-compact 65075310 68716257 0.95
tpcds_q39/datafusion:vortex-compact 135096860 144166045 0.94
tpcds_q40/datafusion:vortex-compact 52293016 55421121 0.94
tpcds_q41/datafusion:vortex-compact 🚀 17949597 20918603 0.86
tpcds_q42/datafusion:vortex-compact 21642872 23483323 0.92
tpcds_q43/datafusion:vortex-compact 35262713 36791645 0.96
tpcds_q44/datafusion:vortex-compact 67590498 70053902 0.96
tpcds_q45/datafusion:vortex-compact 34152849 37081012 0.92
tpcds_q46/datafusion:vortex-compact 64188334 68888265 0.93
tpcds_q47/datafusion:vortex-compact 210603188 232581948 0.91
tpcds_q48/datafusion:vortex-compact 85200898 86223542 0.99
tpcds_q49/datafusion:vortex-compact 78663352 84476146 0.93
tpcds_q50/datafusion:vortex-compact 57669527 64050660 0.90
tpcds_q51/datafusion:vortex-compact 🚀 95940489 107934237 0.89
tpcds_q52/datafusion:vortex-compact 22629200 23433937 0.97
tpcds_q53/datafusion:vortex-compact 31673699 33542842 0.94
tpcds_q54/datafusion:vortex-compact 52480201 55681680 0.94
tpcds_q55/datafusion:vortex-compact 21016519 23223720 0.90
tpcds_q56/datafusion:vortex-compact 47235833 50967991 0.93
tpcds_q57/datafusion:vortex-compact 🚀 126315488 142237527 0.89
tpcds_q58/datafusion:vortex-compact 🚀 69849706 80040838 0.87
tpcds_q59/datafusion:vortex-compact 77390845 82081833 0.94
tpcds_q60/datafusion:vortex-compact 47020080 52225631 0.90
tpcds_q61/datafusion:vortex-compact 66707924 69374544 0.96
tpcds_q62/datafusion:vortex-compact 31942326 33668063 0.95
tpcds_q63/datafusion:vortex-compact 32509743 32824722 0.99
tpcds_q64/datafusion:vortex-compact 501802595 530404341 0.95
tpcds_q65/datafusion:vortex-compact 65424327 66493408 0.98
tpcds_q66/datafusion:vortex-compact 🚀 88335842 101961344 0.87
tpcds_q67/datafusion:vortex-compact 115657708 117654533 0.98
tpcds_q68/datafusion:vortex-compact 64969386 70691588 0.92
tpcds_q69/datafusion:vortex-compact 55740047 58948920 0.95
tpcds_q70/datafusion:vortex-compact 118092229 123461119 0.96
tpcds_q71/datafusion:vortex-compact 40374157 44367293 0.91
tpcds_q72/datafusion:vortex-compact 2410831485 2584948953 0.93
tpcds_q73/datafusion:vortex-compact 46103539 48519866 0.95
tpcds_q74/datafusion:vortex-compact 130967388 130307822 1.01
tpcds_q75/datafusion:vortex-compact 146527884 150874169 0.97
tpcds_q76/datafusion:vortex-compact 45929946 49291386 0.93
tpcds_q77/datafusion:vortex-compact 57236401 61951493 0.92
tpcds_q78/datafusion:vortex-compact 138445256 151353468 0.91
tpcds_q79/datafusion:vortex-compact 56006415 58965029 0.95
tpcds_q80/datafusion:vortex-compact 🚀 118516021 131712627 0.90
tpcds_q81/datafusion:vortex-compact 🚀 31935920 37082538 0.86
tpcds_q82/datafusion:vortex-compact 45279761 46932383 0.96
tpcds_q83/datafusion:vortex-compact 45093757 48950369 0.92
tpcds_q84/datafusion:vortex-compact 🚀 14762458 16769018 0.88
tpcds_q85/datafusion:vortex-compact 108455954 119240266 0.91
tpcds_q86/datafusion:vortex-compact 19668104 21633088 0.91
tpcds_q87/datafusion:vortex-compact 64646269 70264545 0.92
tpcds_q88/datafusion:vortex-compact 129078869 133041542 0.97
tpcds_q89/datafusion:vortex-compact 🚀 40827336 46242846 0.88
tpcds_q90/datafusion:vortex-compact 21370263 21821911 0.98
tpcds_q91/datafusion:vortex-compact 36490101 36886166 0.99
tpcds_q92/datafusion:vortex-compact 22143514 23989311 0.92
tpcds_q93/datafusion:vortex-compact 41139237 43614814 0.94
tpcds_q94/datafusion:vortex-compact 26341015 28520694 0.92
tpcds_q95/datafusion:vortex-compact 65375849 66128990 0.99
tpcds_q96/datafusion:vortex-compact 23821619 25730899 0.93
tpcds_q97/datafusion:vortex-compact 39926689 40865208 0.98
tpcds_q98/datafusion:vortex-compact 34046349 36608031 0.93
tpcds_q99/datafusion:vortex-compact 🚀 45245370 50925779 0.89
datafusion / parquet (0.921x ➖, 32↑ 1↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 29541263 31620424 0.93
tpcds_q02/datafusion:parquet 41100673 42864233 0.96
tpcds_q03/datafusion:parquet 🚀 13071870 15374217 0.85
tpcds_q04/datafusion:parquet 263039242 284751377 0.92
tpcds_q05/datafusion:parquet 40675726 43898175 0.93
tpcds_q06/datafusion:parquet 59455136 61332599 0.97
tpcds_q07/datafusion:parquet 76857403 84402963 0.91
tpcds_q08/datafusion:parquet 26041622 28014889 0.93
tpcds_q09/datafusion:parquet 46918377 45348099 1.03
tpcds_q10/datafusion:parquet 74484707 77433357 0.96
tpcds_q11/datafusion:parquet 154850867 165667454 0.93
tpcds_q12/datafusion:parquet 17370147 18593380 0.93
tpcds_q13/datafusion:parquet 75201547 78247625 0.96
tpcds_q14/datafusion:parquet 161696120 178285887 0.91
tpcds_q15/datafusion:parquet 20414466 22619112 0.90
tpcds_q16/datafusion:parquet 🚀 22914168 26527453 0.86
tpcds_q17/datafusion:parquet 🚀 60648914 68598683 0.88
tpcds_q18/datafusion:parquet 113348730 121163378 0.94
tpcds_q19/datafusion:parquet 22530435 23227553 0.97
tpcds_q20/datafusion:parquet 16905300 17586786 0.96
tpcds_q21/datafusion:parquet 18417323 20293407 0.91
tpcds_q22/datafusion:parquet 163408075 153749091 1.06
tpcds_q23/datafusion:parquet 🚀 140763803 157586206 0.89
tpcds_q24/datafusion:parquet 90146964 97520927 0.92
tpcds_q25/datafusion:parquet 🚀 64564385 74006582 0.87
tpcds_q26/datafusion:parquet 66388619 71488516 0.93
tpcds_q27/datafusion:parquet 🚀 144991397 161240726 0.90
tpcds_q28/datafusion:parquet 43968867 48616472 0.90
tpcds_q29/datafusion:parquet 66894390 69738305 0.96
tpcds_q30/datafusion:parquet 34248729 37505264 0.91
tpcds_q31/datafusion:parquet 🚀 64511888 72652263 0.89
tpcds_q32/datafusion:parquet 18288728 19776999 0.92
tpcds_q33/datafusion:parquet 26682274 28978372 0.92
tpcds_q34/datafusion:parquet 23699371 23804023 1.00
tpcds_q35/datafusion:parquet 🚀 69753976 77946423 0.89
tpcds_q36/datafusion:parquet 56047508 60674847 0.92
tpcds_q37/datafusion:parquet 18889049 20707608 0.91
tpcds_q38/datafusion:parquet 41484742 45433467 0.91
tpcds_q39/datafusion:parquet 🚀 69737165 86709889 0.80
tpcds_q40/datafusion:parquet 🚀 22755489 28101029 0.81
tpcds_q41/datafusion:parquet 🚀 13387039 15506373 0.86
tpcds_q42/datafusion:parquet 12021462 12759919 0.94
tpcds_q43/datafusion:parquet 🚀 16511223 18547718 0.89
tpcds_q44/datafusion:parquet 🚀 33003862 37952903 0.87
tpcds_q45/datafusion:parquet 🚀 28091946 31432420 0.89
tpcds_q46/datafusion:parquet 🚀 31921711 35489171 0.90
tpcds_q47/datafusion:parquet 🚀 124635044 140699307 0.89
tpcds_q48/datafusion:parquet 🚀 69691317 77525135 0.90
tpcds_q49/datafusion:parquet 55576145 61045821 0.91
tpcds_q50/datafusion:parquet 43070877 46307757 0.93
tpcds_q51/datafusion:parquet 85535349 91962908 0.93
tpcds_q52/datafusion:parquet 🚀 12106690 13647141 0.89
tpcds_q53/datafusion:parquet 17652464 19245143 0.92
tpcds_q54/datafusion:parquet 🚀 33519091 37325892 0.90
tpcds_q55/datafusion:parquet 11146038 12377101 0.90
tpcds_q56/datafusion:parquet 27610234 30430349 0.91
tpcds_q57/datafusion:parquet 🚀 92962703 104323850 0.89
tpcds_q58/datafusion:parquet 50223786 53059181 0.95
tpcds_q59/datafusion:parquet 🚀 51784124 57687701 0.90
tpcds_q60/datafusion:parquet 27821323 29480166 0.94
tpcds_q61/datafusion:parquet 🚀 42639044 47803079 0.89
tpcds_q62/datafusion:parquet 🚨 24746760 21221294 1.17
tpcds_q63/datafusion:parquet 17588835 18812298 0.93
tpcds_q64/datafusion:parquet 511575489 554111679 0.92
tpcds_q65/datafusion:parquet 37683124 40302525 0.94
tpcds_q66/datafusion:parquet 68385175 73384401 0.93
tpcds_q67/datafusion:parquet 139917839 153567793 0.91
tpcds_q68/datafusion:parquet 32946100 34023478 0.97
tpcds_q69/datafusion:parquet 🚀 67036179 74951965 0.89
tpcds_q70/datafusion:parquet 84042158 86520327 0.97
tpcds_q71/datafusion:parquet 22655748 23940218 0.95
tpcds_q72/datafusion:parquet 596777570 640678405 0.93
tpcds_q73/datafusion:parquet 22776391 23504644 0.97
tpcds_q74/datafusion:parquet 81673670 88523197 0.92
tpcds_q75/datafusion:parquet 102099392 104161719 0.98
tpcds_q76/datafusion:parquet 29685919 32094526 0.92
tpcds_q77/datafusion:parquet 37650390 41262767 0.91
tpcds_q78/datafusion:parquet 🚀 110159574 124191632 0.89
tpcds_q79/datafusion:parquet 27528849 29074041 0.95
tpcds_q80/datafusion:parquet 🚀 76322009 86423090 0.88
tpcds_q81/datafusion:parquet 🚀 31156003 34932083 0.89
tpcds_q82/datafusion:parquet 19312133 20941401 0.92
tpcds_q83/datafusion:parquet 36203609 39389454 0.92
tpcds_q84/datafusion:parquet 39915798 41394412 0.96
tpcds_q85/datafusion:parquet 147171478 161007659 0.91
tpcds_q86/datafusion:parquet 15934964 17065554 0.93
tpcds_q87/datafusion:parquet 🚀 40305155 45454522 0.89
tpcds_q88/datafusion:parquet 58481232 62549820 0.93
tpcds_q89/datafusion:parquet 21869458 22507393 0.97
tpcds_q90/datafusion:parquet 🚀 14453165 16848598 0.86
tpcds_q91/datafusion:parquet 58709381 64447877 0.91
tpcds_q92/datafusion:parquet 17981832 19497554 0.92
tpcds_q93/datafusion:parquet 🚀 31098348 35094326 0.89
tpcds_q94/datafusion:parquet 🚀 18775548 21420302 0.88
tpcds_q95/datafusion:parquet 57552389 60865119 0.95
tpcds_q96/datafusion:parquet 🚀 11334008 13014401 0.87
tpcds_q97/datafusion:parquet 31201247 32707625 0.95
tpcds_q98/datafusion:parquet 21787564 22032811 0.99
tpcds_q99/datafusion:parquet 🚀 24362541 27339128 0.89
duckdb / vortex-file-compressed (0.922x ➖, 28↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 22742663 23027755 0.99
tpcds_q02/duckdb:vortex-file-compressed 33569303 35418017 0.95
tpcds_q03/duckdb:vortex-file-compressed 31180127 34090450 0.91
tpcds_q04/duckdb:vortex-file-compressed 104569910 109367108 0.96
tpcds_q05/duckdb:vortex-file-compressed 38347285 38756723 0.99
tpcds_q06/duckdb:vortex-file-compressed 🚀 32141823 37310011 0.86
tpcds_q07/duckdb:vortex-file-compressed 🚀 19686930 24447269 0.81
tpcds_q08/duckdb:vortex-file-compressed 28507744 31141385 0.92
tpcds_q09/duckdb:vortex-file-compressed 38775463 41265750 0.94
tpcds_q10/duckdb:vortex-file-compressed 🚀 40776976 45709845 0.89
tpcds_q11/duckdb:vortex-file-compressed 62041024 66011624 0.94
tpcds_q12/duckdb:vortex-file-compressed 🚀 14626095 16412745 0.89
tpcds_q13/duckdb:vortex-file-compressed 32871648 34711219 0.95
tpcds_q14/duckdb:vortex-file-compressed 109109977 109340019 1.00
tpcds_q15/duckdb:vortex-file-compressed 🚀 25891961 29851064 0.87
tpcds_q16/duckdb:vortex-file-compressed 27762418 30032787 0.92
tpcds_q17/duckdb:vortex-file-compressed 43138838 46609581 0.93
tpcds_q18/duckdb:vortex-file-compressed 47447330 51534315 0.92
tpcds_q19/duckdb:vortex-file-compressed 32807458 35940680 0.91
tpcds_q20/duckdb:vortex-file-compressed 🚀 15155031 18347782 0.83
tpcds_q21/duckdb:vortex-file-compressed 17311575 18677828 0.93
tpcds_q22/duckdb:vortex-file-compressed 74416548 77742301 0.96
tpcds_q23/duckdb:vortex-file-compressed 107824428 107824540 1.00
tpcds_q24/duckdb:vortex-file-compressed 🚀 49221352 55857858 0.88
tpcds_q25/duckdb:vortex-file-compressed 🚀 47823693 54310329 0.88
tpcds_q26/duckdb:vortex-file-compressed 40047941 43382628 0.92
tpcds_q27/duckdb:vortex-file-compressed 47183989 52048192 0.91
tpcds_q28/duckdb:vortex-file-compressed 34984438 38460816 0.91
tpcds_q29/duckdb:vortex-file-compressed 42142608 44789152 0.94
tpcds_q30/duckdb:vortex-file-compressed 23856761 25391220 0.94
tpcds_q31/duckdb:vortex-file-compressed 37139776 39301248 0.95
tpcds_q32/duckdb:vortex-file-compressed 🚀 13763671 16457852 0.84
tpcds_q33/duckdb:vortex-file-compressed 24785952 27131086 0.91
tpcds_q34/duckdb:vortex-file-compressed 23235112 24594821 0.94
tpcds_q35/duckdb:vortex-file-compressed 🚀 65412180 72755830 0.90
tpcds_q36/duckdb:vortex-file-compressed 25151117 26969698 0.93
tpcds_q37/duckdb:vortex-file-compressed 🚀 16132808 18187389 0.89
tpcds_q38/duckdb:vortex-file-compressed 37652091 40050167 0.94
tpcds_q39/duckdb:vortex-file-compressed 34855523 36173639 0.96
tpcds_q40/duckdb:vortex-file-compressed 🚀 19751364 22363853 0.88
tpcds_q41/duckdb:vortex-file-compressed 🚀 12879142 15191452 0.85
tpcds_q42/duckdb:vortex-file-compressed 🚀 12795202 14975403 0.85
tpcds_q43/duckdb:vortex-file-compressed 23682374 23521253 1.01
tpcds_q44/duckdb:vortex-file-compressed 21628418 23063617 0.94
tpcds_q45/duckdb:vortex-file-compressed 29263904 32003943 0.91
tpcds_q46/duckdb:vortex-file-compressed 51435575 54489862 0.94
tpcds_q47/duckdb:vortex-file-compressed 🚀 46528772 52163630 0.89
tpcds_q48/duckdb:vortex-file-compressed 🚀 30226548 33991469 0.89
tpcds_q49/duckdb:vortex-file-compressed 35220645 36028631 0.98
tpcds_q50/duckdb:vortex-file-compressed 34332438 35912637 0.96
tpcds_q51/duckdb:vortex-file-compressed 98712332 104820683 0.94
tpcds_q52/duckdb:vortex-file-compressed 13320035 14692726 0.91
tpcds_q53/duckdb:vortex-file-compressed 🚀 22743936 27712484 0.82
tpcds_q54/duckdb:vortex-file-compressed 🚀 28229060 32287770 0.87
tpcds_q55/duckdb:vortex-file-compressed 13184315 14493525 0.91
tpcds_q56/duckdb:vortex-file-compressed 26167142 26607196 0.98
tpcds_q57/duckdb:vortex-file-compressed 40663461 40846940 1.00
tpcds_q58/duckdb:vortex-file-compressed 30592976 31302939 0.98
tpcds_q59/duckdb:vortex-file-compressed 68306418 68099876 1.00
tpcds_q60/duckdb:vortex-file-compressed 27197353 29539775 0.92
tpcds_q61/duckdb:vortex-file-compressed 36164134 36780651 0.98
tpcds_q62/duckdb:vortex-file-compressed 🚀 18123180 20141927 0.90
tpcds_q63/duckdb:vortex-file-compressed 21865125 23205215 0.94
tpcds_q64/duckdb:vortex-file-compressed 86007482 90877670 0.95
tpcds_q65/duckdb:vortex-file-compressed 22100232 22877018 0.97
tpcds_q66/duckdb:vortex-file-compressed 31184256 32242133 0.97
tpcds_q67/duckdb:vortex-file-compressed 138920583 146868816 0.95
tpcds_q68/duckdb:vortex-file-compressed 41249556 45227119 0.91
tpcds_q69/duckdb:vortex-file-compressed 42095462 45701483 0.92
tpcds_q70/duckdb:vortex-file-compressed 25847800 27525067 0.94
tpcds_q71/duckdb:vortex-file-compressed 🚀 21579574 24273358 0.89
tpcds_q72/duckdb:vortex-file-compressed 172653476 175076393 0.99
tpcds_q73/duckdb:vortex-file-compressed 24052218 25582724 0.94
tpcds_q74/duckdb:vortex-file-compressed 73267833 75190421 0.97
tpcds_q75/duckdb:vortex-file-compressed 57058065 63186241 0.90
tpcds_q76/duckdb:vortex-file-compressed 18857216 19762154 0.95
tpcds_q77/duckdb:vortex-file-compressed 25607286 27547428 0.93
tpcds_q78/duckdb:vortex-file-compressed 75584941 78507877 0.96
tpcds_q79/duckdb:vortex-file-compressed 33378136 35453296 0.94
tpcds_q80/duckdb:vortex-file-compressed 49180940 53485439 0.92
tpcds_q81/duckdb:vortex-file-compressed 🚀 28831940 33320303 0.87
tpcds_q82/duckdb:vortex-file-compressed 🚀 16281759 19372097 0.84
tpcds_q83/duckdb:vortex-file-compressed 24763118 27302537 0.91
tpcds_q84/duckdb:vortex-file-compressed 20533037 21476526 0.96
tpcds_q85/duckdb:vortex-file-compressed 🚀 44506009 50097427 0.89
tpcds_q86/duckdb:vortex-file-compressed 16841874 18139467 0.93
tpcds_q87/duckdb:vortex-file-compressed 41052643 43496821 0.94
tpcds_q88/duckdb:vortex-file-compressed 33934875 37503161 0.90
tpcds_q89/duckdb:vortex-file-compressed 🚀 22836861 25752999 0.89
tpcds_q90/duckdb:vortex-file-compressed 🚀 12614080 14371232 0.88
tpcds_q91/duckdb:vortex-file-compressed 🚀 30084184 35530473 0.85
tpcds_q92/duckdb:vortex-file-compressed 21785427 23879439 0.91
tpcds_q93/duckdb:vortex-file-compressed 🚀 27543122 31241089 0.88
tpcds_q94/duckdb:vortex-file-compressed 🚀 23160266 26292284 0.88
tpcds_q95/duckdb:vortex-file-compressed 149607616 161076586 0.93
tpcds_q96/duckdb:vortex-file-compressed 13803062 14652537 0.94
tpcds_q97/duckdb:vortex-file-compressed 36505058 38252033 0.95
tpcds_q98/duckdb:vortex-file-compressed 18401636 19395955 0.95
tpcds_q99/duckdb:vortex-file-compressed 27720343 29592804 0.94
duckdb / vortex-compact (0.939x ➖, 15↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 24375573 25221513 0.97
tpcds_q02/duckdb:vortex-compact 38035717 40327731 0.94
tpcds_q03/duckdb:vortex-compact 57505835 59878538 0.96
tpcds_q04/duckdb:vortex-compact 122241663 120704278 1.01
tpcds_q05/duckdb:vortex-compact 53481823 54762324 0.98
tpcds_q06/duckdb:vortex-compact 40357298 43880162 0.92
tpcds_q07/duckdb:vortex-compact 34206913 35224807 0.97
tpcds_q08/duckdb:vortex-compact 46326579 49678946 0.93
tpcds_q09/duckdb:vortex-compact 58822463 61447811 0.96
tpcds_q10/duckdb:vortex-compact 62254132 67838444 0.92
tpcds_q11/duckdb:vortex-compact 71622999 75069008 0.95
tpcds_q12/duckdb:vortex-compact 23448089 24856924 0.94
tpcds_q13/duckdb:vortex-compact 59555188 64531230 0.92
tpcds_q14/duckdb:vortex-compact 132597405 141350569 0.94
tpcds_q15/duckdb:vortex-compact 33527989 35065339 0.96
tpcds_q16/duckdb:vortex-compact 31945817 35215329 0.91
tpcds_q17/duckdb:vortex-compact 54983358 59411654 0.93
tpcds_q18/duckdb:vortex-compact 58514384 64384701 0.91
tpcds_q19/duckdb:vortex-compact 52432419 55804984 0.94
tpcds_q20/duckdb:vortex-compact 🚀 20664643 22963517 0.90
tpcds_q21/duckdb:vortex-compact 19024299 20648557 0.92
tpcds_q22/duckdb:vortex-compact 78121064 79706585 0.98
tpcds_q23/duckdb:vortex-compact 138818202 129596941 1.07
tpcds_q24/duckdb:vortex-compact 64555480 68930705 0.94
tpcds_q25/duckdb:vortex-compact 81305679 82256189 0.99
tpcds_q26/duckdb:vortex-compact 53266509 55647172 0.96
tpcds_q27/duckdb:vortex-compact 70123978 74167763 0.95
tpcds_q28/duckdb:vortex-compact 85348195 88075498 0.97
tpcds_q29/duckdb:vortex-compact 54407745 56228424 0.97
tpcds_q30/duckdb:vortex-compact 30138034 32470403 0.93
tpcds_q31/duckdb:vortex-compact 🚀 45222883 51040717 0.89
tpcds_q32/duckdb:vortex-compact 🚀 22386698 26226672 0.85
tpcds_q33/duckdb:vortex-compact 35513284 37779380 0.94
tpcds_q34/duckdb:vortex-compact 39286950 42279917 0.93
tpcds_q35/duckdb:vortex-compact 84400700 89100006 0.95
tpcds_q36/duckdb:vortex-compact 41645806 43524828 0.96
tpcds_q37/duckdb:vortex-compact 🚀 24536736 27384108 0.90
tpcds_q38/duckdb:vortex-compact 50817994 52554891 0.97
tpcds_q39/duckdb:vortex-compact 36886048 39350309 0.94
tpcds_q40/duckdb:vortex-compact 🚀 24420050 29792213 0.82
tpcds_q41/duckdb:vortex-compact 🚀 15736509 18443224 0.85
tpcds_q42/duckdb:vortex-compact 22003332 23567894 0.93
tpcds_q43/duckdb:vortex-compact 37434541 38502416 0.97
tpcds_q44/duckdb:vortex-compact 29387969 32112769 0.92
tpcds_q45/duckdb:vortex-compact 40721668 42504334 0.96
tpcds_q46/duckdb:vortex-compact 72665514 77213159 0.94
tpcds_q47/duckdb:vortex-compact 62612512 67393845 0.93
tpcds_q48/duckdb:vortex-compact 52407123 53257620 0.98
tpcds_q49/duckdb:vortex-compact 56763495 59982073 0.95
tpcds_q50/duckdb:vortex-compact 46881823 48426293 0.97
tpcds_q51/duckdb:vortex-compact 110100497 110441171 1.00
tpcds_q52/duckdb:vortex-compact 23105025 23433522 0.99
tpcds_q53/duckdb:vortex-compact 39844753 40997241 0.97
tpcds_q54/duckdb:vortex-compact 🚀 41599472 46527762 0.89
tpcds_q55/duckdb:vortex-compact 23371614 24069226 0.97
tpcds_q56/duckdb:vortex-compact 36926749 38359088 0.96
tpcds_q57/duckdb:vortex-compact 🚀 44305008 51971923 0.85
tpcds_q58/duckdb:vortex-compact 43875667 45171418 0.97
tpcds_q59/duckdb:vortex-compact 88856668 88250425 1.01
tpcds_q60/duckdb:vortex-compact 🚀 38039822 42865224 0.89
tpcds_q61/duckdb:vortex-compact 61236028 64885628 0.94
tpcds_q62/duckdb:vortex-compact 25354336 27298771 0.93
tpcds_q63/duckdb:vortex-compact 37646801 38948087 0.97
tpcds_q64/duckdb:vortex-compact 116691883 125149298 0.93
tpcds_q65/duckdb:vortex-compact 32664457 34870903 0.94
tpcds_q66/duckdb:vortex-compact 🚀 38809671 43921569 0.88
tpcds_q67/duckdb:vortex-compact 🚀 151240297 168209893 0.90
tpcds_q68/duckdb:vortex-compact 63582523 69744852 0.91
tpcds_q69/duckdb:vortex-compact 63511014 69473008 0.91
tpcds_q70/duckdb:vortex-compact 37394946 40045967 0.93
tpcds_q71/duckdb:vortex-compact 35908146 38502754 0.93
tpcds_q72/duckdb:vortex-compact 191134577 200680048 0.95
tpcds_q73/duckdb:vortex-compact 🚀 36910547 42140957 0.88
tpcds_q74/duckdb:vortex-compact 83216456 88824955 0.94
tpcds_q75/duckdb:vortex-compact 69844559 77282187 0.90
tpcds_q76/duckdb:vortex-compact 34803166 37138543 0.94
tpcds_q77/duckdb:vortex-compact 45880805 45320452 1.01
tpcds_q78/duckdb:vortex-compact 🚀 89091628 99381547 0.90
tpcds_q79/duckdb:vortex-compact 56409846 56954898 0.99
tpcds_q80/duckdb:vortex-compact 81735516 88685905 0.92
tpcds_q81/duckdb:vortex-compact 33800117 36031589 0.94
tpcds_q82/duckdb:vortex-compact 27066973 28340176 0.96
tpcds_q83/duckdb:vortex-compact 🚀 31992282 36561359 0.88
tpcds_q84/duckdb:vortex-compact 27025633 29982662 0.90
tpcds_q85/duckdb:vortex-compact 59665148 63558580 0.94
tpcds_q86/duckdb:vortex-compact 🚀 23254200 25885275 0.90
tpcds_q87/duckdb:vortex-compact 52972621 53769310 0.99
tpcds_q88/duckdb:vortex-compact 40057094 43650524 0.92
tpcds_q89/duckdb:vortex-compact 38555268 41217744 0.94
tpcds_q90/duckdb:vortex-compact 15171852 16674704 0.91
tpcds_q91/duckdb:vortex-compact 51072605 54474579 0.94
tpcds_q92/duckdb:vortex-compact 51028802 54106093 0.94
tpcds_q93/duckdb:vortex-compact 32288032 30770583 1.05
tpcds_q94/duckdb:vortex-compact 32092647 33874527 0.95
tpcds_q95/duckdb:vortex-compact 158100857 168989427 0.94
tpcds_q96/duckdb:vortex-compact 17471670 19010502 0.92
tpcds_q97/duckdb:vortex-compact 42788864 46295823 0.92
tpcds_q98/duckdb:vortex-compact 29848458 30689100 0.97
tpcds_q99/duckdb:vortex-compact 32588641 33162672 0.98
duckdb / parquet (0.952x ➖, 5↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 27281704 28348598 0.96
tpcds_q02/duckdb:parquet 23692231 22384632 1.06
tpcds_q03/duckdb:parquet 11496002 11867438 0.97
tpcds_q04/duckdb:parquet 165734087 172969994 0.96
tpcds_q05/duckdb:parquet 29946213 33168480 0.90
tpcds_q06/duckdb:parquet 28247775 29535949 0.96
tpcds_q07/duckdb:parquet 21070566 21815145 0.97
tpcds_q08/duckdb:parquet 26183276 28030908 0.93
tpcds_q09/duckdb:parquet 39116830 40381289 0.97
tpcds_q10/duckdb:parquet 33075898 35093263 0.94
tpcds_q11/duckdb:parquet 91878440 87909605 1.05
tpcds_q12/duckdb:parquet 14522085 15039736 0.97
tpcds_q13/duckdb:parquet 33746051 33230775 1.02
tpcds_q14/duckdb:parquet 100192921 103533353 0.97
tpcds_q15/duckdb:parquet 29546060 32052030 0.92
tpcds_q16/duckdb:parquet 21245216 22458579 0.95
tpcds_q17/duckdb:parquet 36627149 39857885 0.92
tpcds_q18/duckdb:parquet 45109199 47247227 0.95
tpcds_q19/duckdb:parquet 28545154 29576343 0.97
tpcds_q20/duckdb:parquet 15014857 15146036 0.99
tpcds_q21/duckdb:parquet 10855176 11079009 0.98
tpcds_q22/duckdb:parquet 65222209 70135328 0.93
tpcds_q23/duckdb:parquet 80982692 81505973 0.99
tpcds_q24/duckdb:parquet 45748021 45943950 1.00
tpcds_q25/duckdb:parquet 31628367 33554547 0.94
tpcds_q26/duckdb:parquet 36523819 37293802 0.98
tpcds_q27/duckdb:parquet 48726626 51376959 0.95
tpcds_q28/duckdb:parquet 37191682 39084846 0.95
tpcds_q29/duckdb:parquet 35608365 38476380 0.93
tpcds_q30/duckdb:parquet 34384297 36386505 0.94
tpcds_q31/duckdb:parquet 22815979 24148155 0.94
tpcds_q32/duckdb:parquet 11541526 11958114 0.97
tpcds_q33/duckdb:parquet 20368720 20904320 0.97
tpcds_q34/duckdb:parquet 20009693 20776417 0.96
tpcds_q35/duckdb:parquet 55795973 58463200 0.95
tpcds_q36/duckdb:parquet 19728202 20299789 0.97
tpcds_q37/duckdb:parquet 🚀 11921647 13363964 0.89
tpcds_q38/duckdb:parquet 🚀 32498522 39534855 0.82
tpcds_q39/duckdb:parquet 29007031 29541381 0.98
tpcds_q40/duckdb:parquet 17088112 17810651 0.96
tpcds_q41/duckdb:parquet 7315138 7652131 0.96
tpcds_q42/duckdb:parquet 9312130 10116146 0.92
tpcds_q43/duckdb:parquet 15056407 15994036 0.94
tpcds_q44/duckdb:parquet 22751864 23322796 0.98
tpcds_q45/duckdb:parquet 🚀 25825616 28728983 0.90
tpcds_q46/duckdb:parquet 45208938 49082251 0.92
tpcds_q47/duckdb:parquet 43010949 46646050 0.92
tpcds_q48/duckdb:parquet 29482139 31599495 0.93
tpcds_q49/duckdb:parquet 24536006 26657211 0.92
tpcds_q50/duckdb:parquet 23955771 26172310 0.92
tpcds_q51/duckdb:parquet 92738532 99004667 0.94
tpcds_q52/duckdb:parquet 10000095 10811929 0.92
tpcds_q53/duckdb:parquet 14844384 15400833 0.96
tpcds_q54/duckdb:parquet 25326743 25850828 0.98
tpcds_q55/duckdb:parquet 9693518 10633985 0.91
tpcds_q56/duckdb:parquet 20092351 21394430 0.94
tpcds_q57/duckdb:parquet 33142946 35522843 0.93
tpcds_q58/duckdb:parquet 21932988 22775645 0.96
tpcds_q59/duckdb:parquet 35417950 35254088 1.00
tpcds_q60/duckdb:parquet 21723085 22659382 0.96
tpcds_q61/duckdb:parquet 30961881 31625899 0.98
tpcds_q62/duckdb:parquet 11812481 12855776 0.92
tpcds_q63/duckdb:parquet 13931534 14760034 0.94
tpcds_q64/duckdb:parquet 77108508 79904073 0.97
tpcds_q65/duckdb:parquet 19382529 20571176 0.94
tpcds_q66/duckdb:parquet 🚀 27713095 31933712 0.87
tpcds_q67/duckdb:parquet 132935901 141849471 0.94
tpcds_q68/duckdb:parquet 36181506 38007194 0.95
tpcds_q69/duckdb:parquet 35242922 36257926 0.97
tpcds_q70/duckdb:parquet 18856380 19935765 0.95
tpcds_q71/duckdb:parquet 18746538 20231801 0.93
tpcds_q72/duckdb:parquet 164626379 167420376 0.98
tpcds_q73/duckdb:parquet 17858207 18136235 0.98
tpcds_q74/duckdb:parquet 125684726 133451317 0.94
tpcds_q75/duckdb:parquet 52044270 54972257 0.95
tpcds_q76/duckdb:parquet 19772070 20708210 0.95
tpcds_q77/duckdb:parquet 21060090 22678511 0.93
tpcds_q78/duckdb:parquet 73278582 76751538 0.95
tpcds_q79/duckdb:parquet 28110202 28770351 0.98
tpcds_q80/duckdb:parquet 41265001 43620465 0.95
tpcds_q81/duckdb:parquet 30175732 32070429 0.94
tpcds_q82/duckdb:parquet 12986162 13350886 0.97
tpcds_q83/duckdb:parquet 15516500 16704691 0.93
tpcds_q84/duckdb:parquet 18907721 19703524 0.96
tpcds_q85/duckdb:parquet 36830984 38500626 0.96
tpcds_q86/duckdb:parquet 12077451 12177661 0.99
tpcds_q87/duckdb:parquet 35067194 38829709 0.90
tpcds_q88/duckdb:parquet 48731255 49549965 0.98
tpcds_q89/duckdb:parquet 15627553 17004861 0.92
tpcds_q90/duckdb:parquet 🚀 7383450 8284727 0.89
tpcds_q91/duckdb:parquet 22485427 22694269 0.99
tpcds_q92/duckdb:parquet 11643106 12035607 0.97
tpcds_q93/duckdb:parquet 28433053 30286896 0.94
tpcds_q94/duckdb:parquet 16891802 17627631 0.96
tpcds_q95/duckdb:parquet 145255186 134565823 1.08
tpcds_q96/duckdb:parquet 8483676 9051492 0.94
tpcds_q97/duckdb:parquet 34752333 36501039 0.95
tpcds_q98/duckdb:parquet 16974480 17412419 0.97
tpcds_q99/duckdb:parquet 19520082 20525338 0.95
duckdb / duckdb (0.929x ➖, 25↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚀 20255507 22602318 0.90
tpcds_q02/duckdb:duckdb 19933532 19583680 1.02
tpcds_q03/duckdb:duckdb 🚀 7999775 9722127 0.82
tpcds_q04/duckdb:duckdb 175373363 181149036 0.97
tpcds_q05/duckdb:duckdb 19855038 20021004 0.99
tpcds_q06/duckdb:duckdb 22559622 24760914 0.91
tpcds_q07/duckdb:duckdb 🚀 37320782 41921871 0.89
tpcds_q08/duckdb:duckdb 120960811 122180025 0.99
tpcds_q09/duckdb:duckdb 19930935 20769145 0.96
tpcds_q10/duckdb:duckdb 23450316 24889939 0.94
tpcds_q11/duckdb:duckdb 🚀 86957512 98098240 0.89
tpcds_q12/duckdb:duckdb 12100269 11879457 1.02
tpcds_q13/duckdb:duckdb 24321202 25884704 0.94
tpcds_q14/duckdb:duckdb 91761410 95105760 0.96
tpcds_q15/duckdb:duckdb 🚀 23863991 26529305 0.90
tpcds_q16/duckdb:duckdb 18332341 19058913 0.96
tpcds_q17/duckdb:duckdb 23392818 23088331 1.01
tpcds_q18/duckdb:duckdb 44054854 48670402 0.91
tpcds_q19/duckdb:duckdb 17272932 18671565 0.93
tpcds_q20/duckdb:duckdb 🚀 11566165 13143961 0.88
tpcds_q21/duckdb:duckdb 7118104 7066165 1.01
tpcds_q22/duckdb:duckdb 🚀 60600038 70352994 0.86
tpcds_q23/duckdb:duckdb 76586263 74988096 1.02
tpcds_q24/duckdb:duckdb 24891880 25921129 0.96
tpcds_q25/duckdb:duckdb 17042302 18171808 0.94
tpcds_q26/duckdb:duckdb 26422333 29293350 0.90
tpcds_q27/duckdb:duckdb 37341470 41092359 0.91
tpcds_q28/duckdb:duckdb 21904067 22210940 0.99
tpcds_q29/duckdb:duckdb 21227072 22932520 0.93
tpcds_q30/duckdb:duckdb 28902543 30694225 0.94
tpcds_q31/duckdb:duckdb 🚀 46285694 53510033 0.86
tpcds_q32/duckdb:duckdb 7257488 7797662 0.93
tpcds_q33/duckdb:duckdb 🚀 12431837 14414106 0.86
tpcds_q34/duckdb:duckdb 🚀 14528592 16703065 0.87
tpcds_q35/duckdb:duckdb 34455289 35464169 0.97
tpcds_q36/duckdb:duckdb 67925484 75298161 0.90
tpcds_q37/duckdb:duckdb 🚀 7519742 8460654 0.89
tpcds_q38/duckdb:duckdb 31230902 31883814 0.98
tpcds_q39/duckdb:duckdb 🚀 24084957 27401973 0.88
tpcds_q40/duckdb:duckdb 🚀 13419059 15073884 0.89
tpcds_q41/duckdb:duckdb 8702438 9339495 0.93
tpcds_q42/duckdb:duckdb 6909819 7113621 0.97
tpcds_q43/duckdb:duckdb 11513527 11963642 0.96
tpcds_q44/duckdb:duckdb 13618424 14320171 0.95
tpcds_q45/duckdb:duckdb 17248813 18609896 0.93
tpcds_q46/duckdb:duckdb 🚀 36516074 41030444 0.89
tpcds_q47/duckdb:duckdb 41188674 42966497 0.96
tpcds_q48/duckdb:duckdb 21615259 23486614 0.92
tpcds_q49/duckdb:duckdb 16957644 18010980 0.94
tpcds_q50/duckdb:duckdb 14459184 15527206 0.93
tpcds_q51/duckdb:duckdb 90144051 94529396 0.95
tpcds_q52/duckdb:duckdb 7778519 7898193 0.98
tpcds_q53/duckdb:duckdb 13371619 14396031 0.93
tpcds_q54/duckdb:duckdb 17021273 18663494 0.91
tpcds_q55/duckdb:duckdb 7565885 7723601 0.98
tpcds_q56/duckdb:duckdb 13258492 14571727 0.91
tpcds_q57/duckdb:duckdb 32757310 33998290 0.96
tpcds_q58/duckdb:duckdb 12480009 13291277 0.94
tpcds_q59/duckdb:duckdb 35289354 37092224 0.95
tpcds_q60/duckdb:duckdb 14497867 15869247 0.91
tpcds_q61/duckdb:duckdb 14102670 15589573 0.90
tpcds_q62/duckdb:duckdb 9314939 10324558 0.90
tpcds_q63/duckdb:duckdb 12237683 13171551 0.93
tpcds_q64/duckdb:duckdb 55422247 58228306 0.95
tpcds_q65/duckdb:duckdb 🚀 31832528 37485727 0.85
tpcds_q66/duckdb:duckdb 24937914 27666347 0.90
tpcds_q67/duckdb:duckdb 128581597 137926766 0.93
tpcds_q68/duckdb:duckdb 25295951 27284236 0.93
tpcds_q69/duckdb:duckdb 25421750 26934481 0.94
tpcds_q70/duckdb:duckdb 🚀 14448510 16428684 0.88
tpcds_q71/duckdb:duckdb 12488732 13470671 0.93
tpcds_q72/duckdb:duckdb 42591430 43342507 0.98
tpcds_q73/duckdb:duckdb 10856541 11642084 0.93
tpcds_q74/duckdb:duckdb 143909365 150420965 0.96
tpcds_q75/duckdb:duckdb 41224551 45564342 0.90
tpcds_q76/duckdb:duckdb 🚀 12177194 13917800 0.87
tpcds_q77/duckdb:duckdb 13012465 13048872 1.00
tpcds_q78/duckdb:duckdb 63667671 66998363 0.95
tpcds_q79/duckdb:duckdb 18658213 19835810 0.94
tpcds_q80/duckdb:duckdb 27860924 30307833 0.92
tpcds_q81/duckdb:duckdb 🚀 35994106 41258349 0.87
tpcds_q82/duckdb:duckdb 8370752 9102714 0.92
tpcds_q83/duckdb:duckdb 🚀 9074191 10204830 0.89
tpcds_q84/duckdb:duckdb 13711154 14369897 0.95
tpcds_q85/duckdb:duckdb 🚀 23633009 26359545 0.90
tpcds_q86/duckdb:duckdb 10444896 11548327 0.90
tpcds_q87/duckdb:duckdb 34555613 34878095 0.99
tpcds_q88/duckdb:duckdb 25910728 27471001 0.94
tpcds_q89/duckdb:duckdb 14667898 15026334 0.98
tpcds_q90/duckdb:duckdb 🚀 5417551 6042329 0.90
tpcds_q91/duckdb:duckdb 🚀 12856986 15097598 0.85
tpcds_q92/duckdb:duckdb 🚀 8838233 9838919 0.90
tpcds_q93/duckdb:duckdb 22372948 24608889 0.91
tpcds_q94/duckdb:duckdb 13483384 13868986 0.97
tpcds_q95/duckdb:duckdb 🚀 106384250 119326147 0.89
tpcds_q96/duckdb:duckdb 🚀 4626964 5359925 0.86
tpcds_q97/duckdb:duckdb 30168630 30751564 0.98
tpcds_q98/duckdb:duckdb 13142255 14438542 0.91
tpcds_q99/duckdb:duckdb 16200304 17529793 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -14.6% -5.2% -10.0% +22.5% ➖ noise
1 datafusion:vortex-file-compressed -14.2% -5.2% -9.5% +20.3% ➖ noise
1 duckdb:duckdb -10.4% -5.2% -5.5% +25.0% ➖ noise
1 duckdb:vortex-compact -3.4% -5.2% +1.9% +20.5% ➖ noise
1 duckdb:vortex-file-compressed -1.2% -5.2% +4.2% +32.6% ➖ noise
2 datafusion:vortex-compact -10.9% +0.7% -11.5% +10.0% ✅ faster
2 datafusion:vortex-file-compressed -9.4% +0.7% -10.1% +10.0% ✅ faster
2 duckdb:duckdb +1.8% +0.7% +1.0% +12.2% ➖ noise
2 duckdb:vortex-compact -5.7% +0.7% -6.4% +28.6% ➖ noise
2 duckdb:vortex-file-compressed -5.2% +0.7% -5.9% +15.8% ➖ noise
3 datafusion:vortex-compact -10.0% -9.2% -0.8% +11.4% ➖ noise
3 datafusion:vortex-file-compressed -7.1% -9.2% +2.4% +10.6% ➖ noise
3 duckdb:duckdb -17.7% -9.2% -9.3% +14.7% ➖ noise
3 duckdb:vortex-compact -4.0% -9.2% +5.8% +12.6% ➖ noise
3 duckdb:vortex-file-compressed -8.5% -9.2% +0.8% +10.0% ➖ noise
4 datafusion:vortex-compact -8.9% -5.9% -3.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -8.9% -5.9% -3.2% +10.0% ➖ noise
4 duckdb:duckdb -3.2% -5.9% +2.9% +10.0% ➖ noise
4 duckdb:vortex-compact +1.3% -5.9% +7.6% +11.0% ➖ noise
4 duckdb:vortex-file-compressed -4.4% -5.9% +1.6% +10.4% ➖ noise
5 datafusion:vortex-compact -7.4% -8.5% +1.2% +15.0% ➖ noise
5 datafusion:vortex-file-compressed -12.3% -8.5% -4.2% +16.0% ➖ noise
5 duckdb:duckdb -0.8% -8.5% +8.4% +12.6% ➖ noise
5 duckdb:vortex-compact -2.3% -8.5% +6.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.1% -8.5% +8.2% +10.1% ➖ noise
6 datafusion:vortex-compact -12.7% -3.7% -9.3% +10.5% ➖ noise
6 datafusion:vortex-file-compressed -9.3% -3.7% -5.8% +10.0% ➖ noise
6 duckdb:duckdb -8.9% -3.7% -5.4% +13.4% ➖ noise
6 duckdb:vortex-compact -8.0% -3.7% -4.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -13.9% -3.7% -10.5% +10.0% ✅ faster
7 datafusion:vortex-compact -10.9% -6.2% -4.9% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -10.9% -6.2% -5.0% +10.0% ➖ noise
7 duckdb:duckdb -11.0% -6.2% -5.1% +18.4% ➖ noise
7 duckdb:vortex-compact -2.9% -6.2% +3.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -19.5% -6.2% -14.1% +29.4% ➖ noise
8 datafusion:vortex-compact -2.8% -6.8% +4.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -9.1% -6.8% -2.5% +10.0% ➖ noise
8 duckdb:duckdb -1.0% -6.8% +6.2% +10.0% ➖ noise
8 duckdb:vortex-compact -6.7% -6.8% +0.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -8.5% -6.8% -1.8% +10.0% ➖ noise
9 datafusion:vortex-compact -4.9% +0.1% -5.0% +10.9% ➖ noise
9 datafusion:vortex-file-compressed -7.0% +0.1% -7.1% +10.0% ➖ noise
9 duckdb:duckdb -4.0% +0.1% -4.1% +10.0% ➖ noise
9 duckdb:vortex-compact -4.3% +0.1% -4.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -6.0% +0.1% -6.1% +10.0% ➖ noise
10 datafusion:vortex-compact -7.6% -4.8% -3.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -10.2% -4.8% -5.6% +11.0% ➖ noise
10 duckdb:duckdb -5.8% -4.8% -1.1% +10.0% ➖ noise
10 duckdb:vortex-compact -8.2% -4.8% -3.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -10.8% -4.8% -6.3% +10.0% ➖ noise
11 datafusion:vortex-compact -11.1% -1.2% -10.1% +10.0% ✅ faster
11 datafusion:vortex-file-compressed -11.2% -1.2% -10.2% +10.0% ✅ faster
11 duckdb:duckdb -11.4% -1.2% -10.3% +11.8% ➖ noise
11 duckdb:vortex-compact -4.6% -1.2% -3.5% +11.8% ➖ noise
11 duckdb:vortex-file-compressed -6.0% -1.2% -4.9% +10.0% ➖ noise
12 datafusion:vortex-compact -12.8% -5.0% -8.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -7.4% -5.0% -2.5% +13.2% ➖ noise
12 duckdb:duckdb +1.9% -5.0% +7.2% +15.1% ➖ noise
12 duckdb:vortex-compact -5.7% -5.0% -0.7% +16.1% ➖ noise
12 duckdb:vortex-file-compressed -10.9% -5.0% -6.2% +10.0% ➖ noise
13 datafusion:vortex-compact -4.9% -1.2% -3.7% +10.8% ➖ noise
13 datafusion:vortex-file-compressed -7.7% -1.2% -6.6% +10.0% ➖ noise
13 duckdb:duckdb -6.0% -1.2% -4.9% +10.0% ➖ noise
13 duckdb:vortex-compact -7.7% -1.2% -6.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -5.3% -1.2% -4.1% +10.0% ➖ noise
14 datafusion:vortex-compact -10.6% -6.3% -4.5% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -8.8% -6.3% -2.6% +10.0% ➖ noise
14 duckdb:duckdb -3.5% -6.3% +3.0% +10.0% ➖ noise
14 duckdb:vortex-compact -6.2% -6.3% +0.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.2% -6.3% +6.5% +11.2% ➖ noise
15 datafusion:vortex-compact -6.3% -8.8% +2.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -9.5% -8.8% -0.8% +10.0% ➖ noise
15 duckdb:duckdb -10.0% -8.8% -1.4% +10.0% ➖ noise
15 duckdb:vortex-compact -4.4% -8.8% +4.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -13.3% -8.8% -4.9% +10.7% ➖ noise
16 datafusion:vortex-compact -6.5% -9.6% +3.4% +11.6% ➖ noise
16 datafusion:vortex-file-compressed -6.1% -9.6% +3.9% +10.0% ➖ noise
16 duckdb:duckdb -3.8% -9.6% +6.4% +13.7% ➖ noise
16 duckdb:vortex-compact -9.3% -9.6% +0.4% +10.5% ➖ noise
16 duckdb:vortex-file-compressed -7.6% -9.6% +2.3% +21.7% ➖ noise
17 datafusion:vortex-compact -9.2% -9.9% +0.8% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -8.2% -9.9% +1.8% +10.0% ➖ noise
17 duckdb:duckdb +1.3% -9.9% +12.4% +13.1% ➖ noise
17 duckdb:vortex-compact -7.5% -9.9% +2.7% +11.3% ➖ noise
17 duckdb:vortex-file-compressed -7.4% -9.9% +2.7% +10.0% ➖ noise
18 datafusion:vortex-compact -7.0% -5.5% -1.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -4.9% -5.5% +0.6% +10.0% ➖ noise
18 duckdb:duckdb -9.5% -5.5% -4.2% +10.0% ➖ noise
18 duckdb:vortex-compact -9.1% -5.5% -3.8% +10.4% ➖ noise
18 duckdb:vortex-file-compressed -7.9% -5.5% -2.6% +10.0% ➖ noise
19 datafusion:vortex-compact -4.3% -3.2% -1.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -6.6% -3.2% -3.4% +10.0% ➖ noise
19 duckdb:duckdb -7.5% -3.2% -4.4% +10.1% ➖ noise
19 duckdb:vortex-compact -6.0% -3.2% -2.9% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -8.7% -3.2% -5.7% +12.7% ➖ noise
20 datafusion:vortex-compact -10.7% -2.4% -8.5% +12.4% ➖ noise
20 datafusion:vortex-file-compressed -11.3% -2.4% -9.1% +10.0% ✅ faster
20 duckdb:duckdb -12.0% -2.4% -9.9% +11.1% ➖ noise
20 duckdb:vortex-compact -10.0% -2.4% -7.8% +12.2% ➖ noise
20 duckdb:vortex-file-compressed -17.4% -2.4% -15.4% +10.0% ✅ faster
21 datafusion:vortex-compact -10.0% -5.7% -4.6% +12.7% ➖ noise
21 datafusion:vortex-file-compressed -11.5% -5.7% -6.2% +13.1% ➖ noise
21 duckdb:duckdb +0.7% -5.7% +6.8% +17.9% ➖ noise
21 duckdb:vortex-compact -7.9% -5.7% -2.3% +17.0% ➖ noise
21 duckdb:vortex-file-compressed -7.3% -5.7% -1.7% +11.7% ➖ noise
22 datafusion:vortex-compact -11.8% -0.6% -11.3% +17.7% ➖ noise
22 datafusion:vortex-file-compressed -4.8% -0.6% -4.3% +26.8% ➖ noise
22 duckdb:duckdb -13.9% -0.6% -13.4% +17.1% ➖ noise
22 duckdb:vortex-compact -2.0% -0.6% -1.4% +16.2% ➖ noise
22 duckdb:vortex-file-compressed -4.3% -0.6% -3.7% +15.4% ➖ noise
23 datafusion:vortex-compact -6.6% -5.8% -0.9% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -8.3% -5.8% -2.7% +10.0% ➖ noise
23 duckdb:duckdb +2.1% -5.8% +8.4% +15.0% ➖ noise
23 duckdb:vortex-compact +7.1% -5.8% +13.7% +11.1% 🚨 regression
23 duckdb:vortex-file-compressed -0.0% -5.8% +6.1% +10.7% ➖ noise
24 datafusion:vortex-compact -6.3% -4.1% -2.4% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -10.8% -4.1% -7.0% +11.9% ➖ noise
24 duckdb:duckdb -4.0% -4.1% +0.1% +10.7% ➖ noise
24 duckdb:vortex-compact -6.3% -4.1% -2.4% +14.1% ➖ noise
24 duckdb:vortex-file-compressed -11.9% -4.1% -8.2% +17.0% ➖ noise
25 datafusion:vortex-compact -5.0% -9.3% +4.8% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -9.6% -9.3% -0.3% +10.0% ➖ noise
25 duckdb:duckdb -6.2% -9.3% +3.4% +10.8% ➖ noise
25 duckdb:vortex-compact -1.2% -9.3% +9.0% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -11.9% -9.3% -2.9% +10.0% ➖ noise
26 datafusion:vortex-compact -11.0% -4.6% -6.6% +10.8% ➖ noise
26 datafusion:vortex-file-compressed -9.0% -4.6% -4.5% +10.8% ➖ noise
26 duckdb:duckdb -9.8% -4.6% -5.4% +12.1% ➖ noise
26 duckdb:vortex-compact -4.3% -4.6% +0.4% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -7.7% -4.6% -3.2% +10.0% ➖ noise
27 datafusion:vortex-compact -10.7% -7.7% -3.2% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -14.6% -7.7% -7.5% +10.0% ➖ noise
27 duckdb:duckdb -9.1% -7.7% -1.6% +17.7% ➖ noise
27 duckdb:vortex-compact -5.5% -7.7% +2.4% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -9.3% -7.7% -1.8% +17.8% ➖ noise
28 datafusion:vortex-compact -1.7% -7.2% +6.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -1.1% -7.2% +6.6% +10.0% ➖ noise
28 duckdb:duckdb -1.4% -7.2% +6.3% +10.0% ➖ noise
28 duckdb:vortex-compact -3.1% -7.2% +4.5% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -9.0% -7.2% -1.9% +10.0% ➖ noise
29 datafusion:vortex-compact -3.7% -5.8% +2.3% +10.2% ➖ noise
29 datafusion:vortex-file-compressed -8.6% -5.8% -3.0% +10.9% ➖ noise
29 duckdb:duckdb -7.4% -5.8% -1.8% +10.0% ➖ noise
29 duckdb:vortex-compact -3.2% -5.8% +2.7% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -5.9% -5.8% -0.1% +10.0% ➖ noise
30 datafusion:vortex-compact -13.3% -7.1% -6.6% +13.9% ➖ noise
30 datafusion:vortex-file-compressed -6.5% -7.1% +0.7% +10.0% ➖ noise
30 duckdb:duckdb -5.8% -7.1% +1.4% +10.0% ➖ noise
30 duckdb:vortex-compact -7.2% -7.1% -0.1% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -6.0% -7.1% +1.1% +10.0% ➖ noise
31 datafusion:vortex-compact -4.2% -8.4% +4.6% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -12.7% -8.4% -4.7% +10.0% ➖ noise
31 duckdb:duckdb -13.5% -8.4% -5.6% +11.7% ➖ noise
31 duckdb:vortex-compact -11.4% -8.4% -3.3% +12.1% ➖ noise
31 duckdb:vortex-file-compressed -5.5% -8.4% +3.2% +15.6% ➖ noise
32 datafusion:vortex-compact -10.2% -5.5% -5.0% +16.7% ➖ noise
32 datafusion:vortex-file-compressed -7.7% -5.5% -2.3% +10.0% ➖ noise
32 duckdb:duckdb -6.9% -5.5% -1.5% +17.6% ➖ noise
32 duckdb:vortex-compact -14.6% -5.5% -9.6% +10.0% ✅ faster
32 duckdb:vortex-file-compressed -16.4% -5.5% -11.5% +10.3% ✅ faster
33 datafusion:vortex-compact -4.3% -5.3% +1.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -1.5% -5.3% +3.9% +10.0% ➖ noise
33 duckdb:duckdb -13.8% -5.3% -8.9% +10.0% ➖ noise
33 duckdb:vortex-compact -6.0% -5.3% -0.8% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -8.6% -5.3% -3.6% +10.0% ➖ noise
34 datafusion:vortex-compact -3.5% -2.1% -1.5% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -5.2% -2.1% -3.2% +10.0% ➖ noise
34 duckdb:duckdb -13.0% -2.1% -11.2% +10.0% ✅ faster
34 duckdb:vortex-compact -7.1% -2.1% -5.1% +18.6% ➖ noise
34 duckdb:vortex-file-compressed -5.5% -2.1% -3.5% +10.0% ➖ noise
35 datafusion:vortex-compact -3.4% -7.6% +4.5% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -7.9% -7.6% -0.4% +11.1% ➖ noise
35 duckdb:duckdb -2.8% -7.6% +5.1% +10.9% ➖ noise
35 duckdb:vortex-compact -5.3% -7.6% +2.5% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -10.1% -7.6% -2.7% +10.0% ➖ noise
36 datafusion:vortex-compact -8.4% -5.3% -3.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -3.8% -5.3% +1.6% +10.0% ➖ noise
36 duckdb:duckdb -9.8% -5.3% -4.8% +10.0% ➖ noise
36 duckdb:vortex-compact -4.3% -5.3% +1.0% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -6.7% -5.3% -1.6% +10.0% ➖ noise
37 datafusion:vortex-compact -11.0% -9.8% -1.4% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -11.2% -9.8% -1.6% +10.0% ➖ noise
37 duckdb:duckdb -11.1% -9.8% -1.5% +13.2% ➖ noise
37 duckdb:vortex-compact -10.4% -9.8% -0.7% +15.6% ➖ noise
37 duckdb:vortex-file-compressed -11.3% -9.8% -1.7% +10.0% ➖ noise
38 datafusion:vortex-compact -5.3% -13.4% +9.3% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -8.2% -13.4% +5.9% +10.0% ➖ noise
38 duckdb:duckdb -2.0% -13.4% +13.1% +12.0% 🚨 regression
38 duckdb:vortex-compact -3.3% -13.4% +11.6% +12.8% ➖ noise
38 duckdb:vortex-file-compressed -6.0% -13.4% +8.5% +10.0% ➖ noise
39 datafusion:vortex-compact -6.3% -11.1% +5.5% +16.2% ➖ noise
39 datafusion:vortex-file-compressed -11.5% -11.1% -0.4% +16.5% ➖ noise
39 duckdb:duckdb -12.1% -11.1% -1.1% +12.4% ➖ noise
39 duckdb:vortex-compact -6.3% -11.1% +5.5% +15.1% ➖ noise
39 duckdb:vortex-file-compressed -3.6% -11.1% +8.4% +14.0% ➖ noise
40 datafusion:vortex-compact -5.6% -11.9% +7.0% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -8.7% -11.9% +3.6% +10.0% ➖ noise
40 duckdb:duckdb -11.0% -11.9% +1.0% +15.5% ➖ noise
40 duckdb:vortex-compact -18.0% -11.9% -7.0% +14.1% ➖ noise
40 duckdb:vortex-file-compressed -11.7% -11.9% +0.2% +13.1% ➖ noise
41 datafusion:vortex-compact -14.2% -9.2% -5.5% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -15.1% -9.2% -6.5% +10.0% ➖ noise
41 duckdb:duckdb -6.8% -9.2% +2.6% +10.0% ➖ noise
41 duckdb:vortex-compact -14.7% -9.2% -6.1% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -15.2% -9.2% -6.7% +10.0% ➖ noise
42 datafusion:vortex-compact -7.8% -6.9% -1.0% +14.6% ➖ noise
42 datafusion:vortex-file-compressed -4.3% -6.9% +2.7% +12.2% ➖ noise
42 duckdb:duckdb -2.9% -6.9% +4.3% +13.5% ➖ noise
42 duckdb:vortex-compact -6.6% -6.9% +0.3% +11.3% ➖ noise
42 duckdb:vortex-file-compressed -14.6% -6.9% -8.3% +13.3% ➖ noise
43 datafusion:vortex-compact -4.2% -8.5% +4.7% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -4.9% -8.5% +3.9% +18.5% ➖ noise
43 duckdb:duckdb -3.8% -8.5% +5.1% +10.0% ➖ noise
43 duckdb:vortex-compact -2.8% -8.5% +6.2% +11.2% ➖ noise
43 duckdb:vortex-file-compressed +0.7% -8.5% +10.0% +10.0% ➖ noise
44 datafusion:vortex-compact -3.5% -7.9% +4.8% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -5.5% -7.9% +2.6% +10.0% ➖ noise
44 duckdb:duckdb -4.9% -7.9% +3.3% +10.5% ➖ noise
44 duckdb:vortex-compact -8.5% -7.9% -0.6% +10.9% ➖ noise
44 duckdb:vortex-file-compressed -6.2% -7.9% +1.8% +15.7% ➖ noise
45 datafusion:vortex-compact -7.9% -10.4% +2.8% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -8.0% -10.4% +2.6% +10.0% ➖ noise
45 duckdb:duckdb -7.3% -10.4% +3.4% +10.5% ➖ noise
45 duckdb:vortex-compact -4.2% -10.4% +6.9% +11.0% ➖ noise
45 duckdb:vortex-file-compressed -8.6% -10.4% +2.0% +12.8% ➖ noise
46 datafusion:vortex-compact -6.8% -9.0% +2.4% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -9.7% -9.0% -0.8% +10.0% ➖ noise
46 duckdb:duckdb -11.0% -9.0% -2.2% +13.2% ➖ noise
46 duckdb:vortex-compact -5.9% -9.0% +3.4% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -5.6% -9.0% +3.7% +10.5% ➖ noise
47 datafusion:vortex-compact -9.4% -9.6% +0.2% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -12.3% -9.6% -3.0% +10.0% ➖ noise
47 duckdb:duckdb -4.1% -9.6% +6.1% +10.0% ➖ noise
47 duckdb:vortex-compact -7.1% -9.6% +2.8% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -10.8% -9.6% -1.3% +10.0% ➖ noise
48 datafusion:vortex-compact -1.2% -8.4% +7.9% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -7.3% -8.4% +1.2% +10.0% ➖ noise
48 duckdb:duckdb -8.0% -8.4% +0.5% +10.0% ➖ noise
48 duckdb:vortex-compact -1.6% -8.4% +7.4% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -11.1% -8.4% -2.9% +13.4% ➖ noise
49 datafusion:vortex-compact -6.9% -8.5% +1.7% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -10.5% -8.5% -2.2% +10.0% ➖ noise
49 duckdb:duckdb -5.8% -8.5% +2.9% +13.6% ➖ noise
49 duckdb:vortex-compact -5.4% -8.5% +3.4% +11.0% ➖ noise
49 duckdb:vortex-file-compressed -2.2% -8.5% +6.8% +18.1% ➖ noise
50 datafusion:vortex-compact -10.0% -7.7% -2.4% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -3.3% -7.7% +4.8% +10.0% ➖ noise
50 duckdb:duckdb -6.9% -7.7% +0.9% +10.0% ➖ noise
50 duckdb:vortex-compact -3.2% -7.7% +4.9% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -4.4% -7.7% +3.6% +10.0% ➖ noise
51 datafusion:vortex-compact -11.1% -6.7% -4.8% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -8.3% -6.7% -1.7% +10.0% ➖ noise
51 duckdb:duckdb -4.6% -6.7% +2.2% +15.1% ➖ noise
51 duckdb:vortex-compact -0.3% -6.7% +6.8% +19.1% ➖ noise
51 duckdb:vortex-file-compressed -5.8% -6.7% +0.9% +14.8% ➖ noise
52 datafusion:vortex-compact -3.4% -9.4% +6.6% +10.8% ➖ noise
52 datafusion:vortex-file-compressed -9.9% -9.4% -0.5% +18.2% ➖ noise
52 duckdb:duckdb -1.5% -9.4% +8.7% +13.6% ➖ noise
52 duckdb:vortex-compact -1.4% -9.4% +8.8% +13.8% ➖ noise
52 duckdb:vortex-file-compressed -9.3% -9.4% +0.1% +10.0% ➖ noise
53 datafusion:vortex-compact -5.6% -6.0% +0.4% +10.0% ➖ noise
53 datafusion:vortex-file-compressed -10.8% -6.0% -5.1% +10.0% ➖ noise
53 duckdb:duckdb -7.1% -6.0% -1.2% +16.2% ➖ noise
53 duckdb:vortex-compact -2.8% -6.0% +3.4% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -17.9% -6.0% -12.7% +20.3% ➖ noise
54 datafusion:vortex-compact -5.7% -6.2% +0.5% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -5.6% -6.2% +0.7% +11.5% ➖ noise
54 duckdb:duckdb -8.8% -6.2% -2.8% +10.8% ➖ noise
54 duckdb:vortex-compact -10.6% -6.2% -4.7% +13.9% ➖ noise
54 duckdb:vortex-file-compressed -12.6% -6.2% -6.8% +11.4% ➖ noise
55 datafusion:vortex-compact -9.5% -9.4% -0.1% +11.1% ➖ noise
55 datafusion:vortex-file-compressed -11.5% -9.4% -2.4% +10.8% ➖ noise
55 duckdb:duckdb -2.0% -9.4% +8.1% +15.9% ➖ noise
55 duckdb:vortex-compact -2.9% -9.4% +7.2% +10.0% ➖ noise
55 duckdb:vortex-file-compressed -9.0% -9.4% +0.4% +12.4% ➖ noise
56 datafusion:vortex-compact -7.3% -7.7% +0.4% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -6.8% -7.7% +0.9% +10.0% ➖ noise
56 duckdb:duckdb -9.0% -7.7% -1.4% +10.5% ➖ noise
56 duckdb:vortex-compact -3.7% -7.7% +4.3% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -1.7% -7.7% +6.5% +10.1% ➖ noise
57 datafusion:vortex-compact -11.2% -8.8% -2.6% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -9.0% -8.8% -0.2% +10.0% ➖ noise
57 duckdb:duckdb -3.7% -8.8% +5.7% +16.8% ➖ noise
57 duckdb:vortex-compact -14.8% -8.8% -6.5% +13.2% ➖ noise
57 duckdb:vortex-file-compressed -0.4% -8.8% +9.2% +10.3% ➖ noise
58 datafusion:vortex-compact -12.7% -4.5% -8.6% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -10.6% -4.5% -6.4% +11.2% ➖ noise
58 duckdb:duckdb -6.1% -4.5% -1.7% +12.2% ➖ noise
58 duckdb:vortex-compact -2.9% -4.5% +1.7% +11.6% ➖ noise
58 duckdb:vortex-file-compressed -2.3% -4.5% +2.4% +11.2% ➖ noise
59 datafusion:vortex-compact -5.7% -5.0% -0.7% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -9.3% -5.0% -4.5% +10.0% ➖ noise
59 duckdb:duckdb -4.9% -5.0% +0.2% +10.0% ➖ noise
59 duckdb:vortex-compact +0.7% -5.0% +6.0% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +0.3% -5.0% +5.6% +19.6% ➖ noise
60 datafusion:vortex-compact -10.0% -4.9% -5.3% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -8.3% -4.9% -3.6% +12.3% ➖ noise
60 duckdb:duckdb -8.6% -4.9% -4.0% +12.6% ➖ noise
60 duckdb:vortex-compact -11.3% -4.9% -6.7% +14.6% ➖ noise
60 duckdb:vortex-file-compressed -7.9% -4.9% -3.2% +10.0% ➖ noise
61 datafusion:vortex-compact -3.8% -6.6% +2.9% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -10.1% -6.6% -3.8% +10.0% ➖ noise
61 duckdb:duckdb -9.5% -6.6% -3.2% +10.0% ➖ noise
61 duckdb:vortex-compact -5.6% -6.6% +1.0% +11.6% ➖ noise
61 duckdb:vortex-file-compressed -1.7% -6.6% +5.2% +12.2% ➖ noise
62 datafusion:vortex-compact -5.1% +3.5% -8.3% +15.4% ➖ noise
62 datafusion:vortex-file-compressed -9.1% +3.5% -12.2% +15.9% ➖ noise
62 duckdb:duckdb -9.8% +3.5% -12.8% +24.2% ➖ noise
62 duckdb:vortex-compact -7.1% +3.5% -10.3% +23.3% ➖ noise
62 duckdb:vortex-file-compressed -10.0% +3.5% -13.1% +16.9% ➖ noise
63 datafusion:vortex-compact -1.0% -6.1% +5.4% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -6.0% -6.1% +0.0% +10.0% ➖ noise
63 duckdb:duckdb -7.1% -6.1% -1.1% +10.0% ➖ noise
63 duckdb:vortex-compact -3.3% -6.1% +2.9% +11.2% ➖ noise
63 duckdb:vortex-file-compressed -5.8% -6.1% +0.3% +17.8% ➖ noise
64 datafusion:vortex-compact -5.4% -5.6% +0.2% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -6.3% -5.6% -0.8% +10.0% ➖ noise
64 duckdb:duckdb -4.8% -5.6% +0.8% +10.0% ➖ noise
64 duckdb:vortex-compact -6.8% -5.6% -1.2% +12.4% ➖ noise
64 duckdb:vortex-file-compressed -5.4% -5.6% +0.3% +10.0% ➖ noise
65 datafusion:vortex-compact -1.6% -6.1% +4.8% +10.2% ➖ noise
65 datafusion:vortex-file-compressed -6.1% -6.1% +0.1% +14.1% ➖ noise
65 duckdb:duckdb -15.1% -6.1% -9.5% +13.7% ➖ noise
65 duckdb:vortex-compact -6.3% -6.1% -0.2% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -3.4% -6.1% +2.9% +10.4% ➖ noise
66 datafusion:vortex-compact -13.4% -10.1% -3.7% +10.4% ➖ noise
66 datafusion:vortex-file-compressed -12.7% -10.1% -3.0% +10.0% ➖ noise
66 duckdb:duckdb -9.9% -10.1% +0.2% +10.0% ➖ noise
66 duckdb:vortex-compact -11.6% -10.1% -1.7% +10.8% ➖ noise
66 duckdb:vortex-file-compressed -3.3% -10.1% +7.6% +20.5% ➖ noise
67 datafusion:vortex-compact -1.7% -7.6% +6.4% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -9.8% -7.6% -2.4% +10.0% ➖ noise
67 duckdb:duckdb -6.8% -7.6% +0.9% +10.0% ➖ noise
67 duckdb:vortex-compact -10.1% -7.6% -2.7% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -5.4% -7.6% +2.4% +10.0% ➖ noise
68 datafusion:vortex-compact -8.1% -4.0% -4.3% +11.0% ➖ noise
68 datafusion:vortex-file-compressed -5.4% -4.0% -1.5% +10.0% ➖ noise
68 duckdb:duckdb -7.3% -4.0% -3.4% +11.0% ➖ noise
68 duckdb:vortex-compact -8.8% -4.0% -5.0% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -8.8% -4.0% -5.0% +14.8% ➖ noise
69 datafusion:vortex-compact -5.4% -6.8% +1.4% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -8.7% -6.8% -2.1% +10.0% ➖ noise
69 duckdb:duckdb -5.6% -6.8% +1.2% +17.7% ➖ noise
69 duckdb:vortex-compact -8.6% -6.8% -2.0% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -7.9% -6.8% -1.2% +10.0% ➖ noise
70 datafusion:vortex-compact -4.3% -4.1% -0.2% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -7.0% -4.1% -3.0% +11.1% ➖ noise
70 duckdb:duckdb -12.1% -4.1% -8.2% +12.6% ➖ noise
70 duckdb:vortex-compact -6.6% -4.1% -2.6% +10.0% ➖ noise
70 duckdb:vortex-file-compressed -6.1% -4.1% -2.0% +10.0% ➖ noise
71 datafusion:vortex-compact -9.0% -6.4% -2.8% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -8.7% -6.4% -2.6% +11.9% ➖ noise
71 duckdb:duckdb -7.3% -6.4% -1.0% +12.8% ➖ noise
71 duckdb:vortex-compact -6.7% -6.4% -0.4% +13.2% ➖ noise
71 duckdb:vortex-file-compressed -11.1% -6.4% -5.1% +32.9% ➖ noise
72 datafusion:vortex-compact -6.7% -4.3% -2.5% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -11.6% -4.3% -7.6% +10.0% ➖ noise
72 duckdb:duckdb -1.7% -4.3% +2.7% +11.0% ➖ noise
72 duckdb:vortex-compact -4.8% -4.3% -0.5% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -1.4% -4.3% +3.0% +10.0% ➖ noise
73 datafusion:vortex-compact -5.0% -2.3% -2.7% +11.9% ➖ noise
73 datafusion:vortex-file-compressed -6.4% -2.3% -4.2% +32.6% ➖ noise
73 duckdb:duckdb -6.7% -2.3% -4.5% +12.1% ➖ noise
73 duckdb:vortex-compact -12.4% -2.3% -10.3% +10.2% ✅ faster
73 duckdb:vortex-file-compressed -6.0% -2.3% -3.8% +13.8% ➖ noise
74 datafusion:vortex-compact +0.5% -6.8% +7.8% +10.8% ➖ noise
74 datafusion:vortex-file-compressed -5.3% -6.8% +1.6% +13.0% ➖ noise
74 duckdb:duckdb -4.3% -6.8% +2.6% +10.0% ➖ noise
74 duckdb:vortex-compact -6.3% -6.8% +0.5% +22.4% ➖ noise
74 duckdb:vortex-file-compressed -2.6% -6.8% +4.5% +17.7% ➖ noise
75 datafusion:vortex-compact -2.9% -3.7% +0.8% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -8.3% -3.7% -4.8% +10.0% ➖ noise
75 duckdb:duckdb -9.5% -3.7% -6.1% +10.0% ➖ noise
75 duckdb:vortex-compact -9.6% -3.7% -6.2% +10.0% ➖ noise
75 duckdb:vortex-file-compressed -9.7% -3.7% -6.3% +13.1% ➖ noise
76 datafusion:vortex-compact -6.8% -6.0% -0.8% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -10.6% -6.0% -4.9% +23.2% ➖ noise
76 duckdb:duckdb -12.5% -6.0% -6.9% +29.6% ➖ noise
76 duckdb:vortex-compact -6.3% -6.0% -0.3% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -4.6% -6.0% +1.5% +13.5% ➖ noise
77 datafusion:vortex-compact -7.6% -7.9% +0.4% +14.2% ➖ noise
77 datafusion:vortex-file-compressed -3.8% -7.9% +4.5% +10.0% ➖ noise
77 duckdb:duckdb -0.3% -7.9% +8.3% +16.5% ➖ noise
77 duckdb:vortex-compact +1.2% -7.9% +10.0% +10.0% ➖ noise
77 duckdb:vortex-file-compressed -7.0% -7.9% +1.0% +10.0% ➖ noise
78 datafusion:vortex-compact -8.5% -8.0% -0.6% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -7.5% -8.0% +0.5% +10.0% ➖ noise
78 duckdb:duckdb -5.0% -8.0% +3.3% +10.0% ➖ noise
78 duckdb:vortex-compact -10.4% -8.0% -2.6% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -3.7% -8.0% +4.6% +10.0% ➖ noise
79 datafusion:vortex-compact -5.0% -3.8% -1.2% +11.9% ➖ noise
79 datafusion:vortex-file-compressed -5.9% -3.8% -2.2% +10.5% ➖ noise
79 duckdb:duckdb -5.9% -3.8% -2.2% +14.4% ➖ noise
79 duckdb:vortex-compact -1.0% -3.8% +3.0% +10.5% ➖ noise
79 duckdb:vortex-file-compressed -5.9% -3.8% -2.1% +13.7% ➖ noise
80 datafusion:vortex-compact -10.0% -8.6% -1.6% +12.5% ➖ noise
80 datafusion:vortex-file-compressed -3.0% -8.6% +6.1% +11.7% ➖ noise
80 duckdb:duckdb -8.1% -8.6% +0.6% +15.6% ➖ noise
80 duckdb:vortex-compact -7.8% -8.6% +0.8% +11.9% ➖ noise
80 duckdb:vortex-file-compressed -8.0% -8.6% +0.6% +15.3% ➖ noise
81 datafusion:vortex-compact -13.9% -8.4% -6.0% +11.4% ➖ noise
81 datafusion:vortex-file-compressed -11.4% -8.4% -3.3% +15.0% ➖ noise
81 duckdb:duckdb -12.8% -8.4% -4.8% +12.7% ➖ noise
81 duckdb:vortex-compact -6.2% -8.4% +2.4% +19.4% ➖ noise
81 duckdb:vortex-file-compressed -13.5% -8.4% -5.5% +14.1% ➖ noise
82 datafusion:vortex-compact -3.5% -5.3% +1.9% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -7.0% -5.3% -1.8% +16.7% ➖ noise
82 duckdb:duckdb -8.0% -5.3% -2.9% +13.3% ➖ noise
82 duckdb:vortex-compact -4.5% -5.3% +0.8% +11.9% ➖ noise
82 duckdb:vortex-file-compressed -16.0% -5.3% -11.3% +24.4% ➖ noise
83 datafusion:vortex-compact -7.9% -7.6% -0.3% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -6.3% -7.6% +1.4% +10.0% ➖ noise
83 duckdb:duckdb -11.1% -7.6% -3.8% +10.1% ➖ noise
83 duckdb:vortex-compact -12.5% -7.6% -5.3% +10.0% ➖ noise
83 duckdb:vortex-file-compressed -9.3% -7.6% -1.8% +10.9% ➖ noise
84 datafusion:vortex-compact -12.0% -3.8% -8.5% +10.9% ➖ noise
84 datafusion:vortex-file-compressed -7.0% -3.8% -3.3% +10.0% ➖ noise
84 duckdb:duckdb -4.6% -3.8% -0.8% +10.0% ➖ noise
84 duckdb:vortex-compact -9.9% -3.8% -6.3% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -4.4% -3.8% -0.6% +10.0% ➖ noise
85 datafusion:vortex-compact -9.0% -6.5% -2.7% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -6.8% -6.5% -0.3% +10.0% ➖ noise
85 duckdb:duckdb -10.3% -6.5% -4.1% +10.0% ➖ noise
85 duckdb:vortex-compact -6.1% -6.5% +0.4% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -11.2% -6.5% -5.0% +10.0% ➖ noise
86 datafusion:vortex-compact -9.1% -3.8% -5.5% +13.5% ➖ noise
86 datafusion:vortex-file-compressed -7.3% -3.8% -3.7% +11.0% ➖ noise
86 duckdb:duckdb -9.6% -3.8% -6.0% +16.1% ➖ noise
86 duckdb:vortex-compact -10.2% -3.8% -6.6% +17.3% ➖ noise
86 duckdb:vortex-file-compressed -7.2% -3.8% -3.5% +12.2% ➖ noise
87 datafusion:vortex-compact -8.0% -10.5% +2.8% +12.3% ➖ noise
87 datafusion:vortex-file-compressed -11.5% -10.5% -1.1% +10.0% ➖ noise
87 duckdb:duckdb -0.9% -10.5% +10.7% +13.4% ➖ noise
87 duckdb:vortex-compact -1.5% -10.5% +10.1% +11.4% ➖ noise
87 duckdb:vortex-file-compressed -5.6% -10.5% +5.5% +15.5% ➖ noise
88 datafusion:vortex-compact -3.0% -4.1% +1.2% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -8.8% -4.1% -4.8% +10.0% ➖ noise
88 duckdb:duckdb -5.7% -4.1% -1.6% +10.0% ➖ noise
88 duckdb:vortex-compact -8.2% -4.1% -4.3% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -9.5% -4.1% -5.6% +10.0% ➖ noise
89 datafusion:vortex-compact -11.7% -5.5% -6.6% +13.3% ➖ noise
89 datafusion:vortex-file-compressed -2.2% -5.5% +3.4% +10.0% ➖ noise
89 duckdb:duckdb -2.4% -5.5% +3.3% +14.8% ➖ noise
89 duckdb:vortex-compact -6.5% -5.5% -1.0% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -11.3% -5.5% -6.2% +10.0% ➖ noise
90 datafusion:vortex-compact -2.1% -12.6% +12.0% +12.2% ➖ noise
90 datafusion:vortex-file-compressed -8.2% -12.6% +5.0% +10.0% ➖ noise
90 duckdb:duckdb -10.3% -12.6% +2.5% +10.2% ➖ noise
90 duckdb:vortex-compact -9.0% -12.6% +4.1% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -12.2% -12.6% +0.4% +10.0% ➖ noise
91 datafusion:vortex-compact -1.1% -5.0% +4.1% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -12.2% -5.0% -7.6% +10.0% ➖ noise
91 duckdb:duckdb -14.8% -5.0% -10.4% +16.0% ➖ noise
91 duckdb:vortex-compact -6.2% -5.0% -1.3% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -15.3% -5.0% -10.9% +10.0% ✅ faster
92 datafusion:vortex-compact -7.7% -5.5% -2.3% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -5.8% -5.5% -0.3% +12.6% ➖ noise
92 duckdb:duckdb -10.2% -5.5% -4.9% +14.0% ➖ noise
92 duckdb:vortex-compact -5.7% -5.5% -0.2% +21.5% ➖ noise
92 duckdb:vortex-file-compressed -8.8% -5.5% -3.4% +22.2% ➖ noise
93 datafusion:vortex-compact -5.7% -8.8% +3.4% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -8.7% -8.8% +0.1% +10.0% ➖ noise
93 duckdb:duckdb -9.1% -8.8% -0.3% +13.6% ➖ noise
93 duckdb:vortex-compact +4.9% -8.8% +15.0% +16.8% ➖ noise
93 duckdb:vortex-file-compressed -11.8% -8.8% -3.3% +15.0% ➖ noise
94 datafusion:vortex-compact -7.6% -8.4% +0.8% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -8.7% -8.4% -0.4% +14.0% ➖ noise
94 duckdb:duckdb -2.8% -8.4% +6.1% +13.5% ➖ noise
94 duckdb:vortex-compact -5.3% -8.4% +3.4% +16.7% ➖ noise
94 duckdb:vortex-file-compressed -11.9% -8.4% -3.9% +10.0% ➖ noise
95 datafusion:vortex-compact -1.1% +1.0% -2.1% +12.5% ➖ noise
95 datafusion:vortex-file-compressed -8.3% +1.0% -9.3% +14.2% ➖ noise
95 duckdb:duckdb -10.8% +1.0% -11.8% +18.9% ➖ noise
95 duckdb:vortex-compact -6.4% +1.0% -7.4% +15.4% ➖ noise
95 duckdb:vortex-file-compressed -7.1% +1.0% -8.1% +13.5% ➖ noise
96 datafusion:vortex-compact -7.4% -9.7% +2.5% +10.0% ➖ noise
96 datafusion:vortex-file-compressed -7.2% -9.7% +2.7% +10.0% ➖ noise
96 duckdb:duckdb -13.7% -9.7% -4.5% +12.6% ➖ noise
96 duckdb:vortex-compact -8.1% -9.7% +1.7% +12.5% ➖ noise
96 duckdb:vortex-file-compressed -5.8% -9.7% +4.3% +12.3% ➖ noise
97 datafusion:vortex-compact -2.3% -4.7% +2.5% +12.1% ➖ noise
97 datafusion:vortex-file-compressed -6.5% -4.7% -1.9% +11.2% ➖ noise
97 duckdb:duckdb -1.9% -4.7% +2.9% +16.1% ➖ noise
97 duckdb:vortex-compact -7.6% -4.7% -3.0% +11.1% ➖ noise
97 duckdb:vortex-file-compressed -4.6% -4.7% +0.1% +10.8% ➖ noise
98 datafusion:vortex-compact -7.0% -1.8% -5.3% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -4.6% -1.8% -2.8% +10.6% ➖ noise
98 duckdb:duckdb -9.0% -1.8% -7.3% +15.9% ➖ noise
98 duckdb:vortex-compact -2.7% -1.8% -0.9% +10.0% ➖ noise
98 duckdb:vortex-file-compressed -5.1% -1.8% -3.4% +20.0% ➖ noise
99 datafusion:vortex-compact -11.2% -7.9% -3.5% +17.0% ➖ noise
99 datafusion:vortex-file-compressed -12.8% -7.9% -5.3% +17.5% ➖ noise
99 duckdb:duckdb -7.6% -7.9% +0.4% +10.9% ➖ noise
99 duckdb:vortex-compact -1.7% -7.9% +6.7% +12.1% ➖ noise
99 duckdb:vortex-file-compressed -6.3% -7.9% +1.8% +15.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +6.6%
Vortex (geomean): 1.041x ➖
Parquet (geomean): 0.977x ➖
Shifts: Parquet (control) -2.3% · Median polish -1.1%


datafusion / vortex-file-compressed (1.134x ➖, 1↑ 3↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 25935345 42153637 0.62
fineweb_q01/datafusion:vortex-file-compressed 🚨 853883959 516174976 1.65
fineweb_q02/datafusion:vortex-file-compressed 🚨 949102632 566770052 1.67
fineweb_q03/datafusion:vortex-file-compressed 1564828548 1388888756 1.13
fineweb_q04/datafusion:vortex-file-compressed 1387032730 1370293553 1.01
fineweb_q05/datafusion:vortex-file-compressed 1372516128 1343875383 1.02
fineweb_q06/datafusion:vortex-file-compressed 🚨 1917122834 1466575024 1.31
fineweb_q07/datafusion:vortex-file-compressed 1417959847 1334578432 1.06
fineweb_q08/datafusion:vortex-file-compressed 601108336 534299064 1.13
datafusion / vortex-compact (1.164x ➖, 0↑ 3↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 68522859 37064585 1.85
fineweb_q01/datafusion:vortex-compact 🚨 838570011 556287361 1.51
fineweb_q02/datafusion:vortex-compact 🚨 971502802 668326912 1.45
fineweb_q03/datafusion:vortex-compact 1923437858 1875034918 1.03
fineweb_q04/datafusion:vortex-compact 2195356582 2347254122 0.94
fineweb_q05/datafusion:vortex-compact 1733859526 1748786037 0.99
fineweb_q06/datafusion:vortex-compact 1513543720 1596362927 0.95
fineweb_q07/datafusion:vortex-compact 1311732341 1306374414 1.00
fineweb_q08/datafusion:vortex-compact 414149639 388465742 1.07
datafusion / parquet (0.987x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1085428994 1135673638 0.96
fineweb_q01/datafusion:parquet 1613194625 1812318191 0.89
fineweb_q02/datafusion:parquet 1694913455 1935192801 0.88
fineweb_q03/datafusion:parquet 1801325375 1794958960 1.00
fineweb_q04/datafusion:parquet 1864195750 1839929075 1.01
fineweb_q05/datafusion:parquet 1869141491 1669499718 1.12
fineweb_q06/datafusion:parquet 1837195557 1797102517 1.02
fineweb_q07/datafusion:parquet 1963791424 1864601697 1.05
fineweb_q08/datafusion:parquet 1765240764 1819929835 0.97
duckdb / vortex-file-compressed (0.944x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 85570500 89300769 0.96
fineweb_q01/duckdb:vortex-file-compressed 658936178 631900868 1.04
fineweb_q02/duckdb:vortex-file-compressed 461471643 616784040 0.75
fineweb_q03/duckdb:vortex-file-compressed 1447320850 1649359249 0.88
fineweb_q04/duckdb:vortex-file-compressed 1510605638 1631797451 0.93
fineweb_q05/duckdb:vortex-file-compressed 1478282968 1501505701 0.98
fineweb_q06/duckdb:vortex-file-compressed 1634973445 1631863243 1.00
fineweb_q07/duckdb:vortex-file-compressed 1445403014 1428813554 1.01
fineweb_q08/duckdb:vortex-file-compressed 650969817 664835505 0.98
duckdb / vortex-compact (0.942x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 81908766 84895647 0.96
fineweb_q01/duckdb:vortex-compact 516630047 574664981 0.90
fineweb_q02/duckdb:vortex-compact 598626721 552826321 1.08
fineweb_q03/duckdb:vortex-compact 1566786341 1779703771 0.88
fineweb_q04/duckdb:vortex-compact 1650346216 1860532139 0.89
fineweb_q05/duckdb:vortex-compact 1497505592 1649003541 0.91
fineweb_q06/duckdb:vortex-compact 1565489813 1599527207 0.98
fineweb_q07/duckdb:vortex-compact 1406561368 1405369076 1.00
fineweb_q08/duckdb:vortex-compact 454897426 507451747 0.90
duckdb / parquet (0.967x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1082343181 1170521637 0.92
fineweb_q01/duckdb:parquet 1415968302 1354152117 1.05
fineweb_q02/duckdb:parquet 1334395532 1401577016 0.95
fineweb_q03/duckdb:parquet 3431480454 3678428964 0.93
fineweb_q04/duckdb:parquet 1847860196 1900536198 0.97
fineweb_q05/duckdb:parquet 2108799743 2255433523 0.93
fineweb_q06/duckdb:parquet 4320656155 4403337186 0.98
fineweb_q07/duckdb:parquet 2641001318 2672081011 0.99
fineweb_q08/duckdb:parquet 1163334449 1192978642 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +84.9% -6.0% +96.7% +195.2% ➖ noise
0 datafusion:vortex-file-compressed -38.5% -6.0% -34.6% +178.1% ➖ noise
0 duckdb:vortex-compact -3.5% -6.0% +2.6% +52.4% ➖ noise
0 duckdb:vortex-file-compressed -4.2% -6.0% +1.9% +37.8% ➖ noise
1 datafusion:vortex-compact +50.7% -3.5% +56.3% +85.7% ➖ noise
1 datafusion:vortex-file-compressed +65.4% -3.5% +71.5% +84.6% ➖ noise
1 duckdb:vortex-compact -10.1% -3.5% -6.8% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +4.3% -3.5% +8.1% +61.0% ➖ noise
2 datafusion:vortex-compact +45.4% -8.7% +59.2% +30.0% 🚨 regression
2 datafusion:vortex-file-compressed +67.5% -8.7% +83.4% +54.6% 🚨 regression
2 duckdb:vortex-compact +8.3% -8.7% +18.6% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -25.2% -8.7% -18.1% +40.9% ➖ noise
3 datafusion:vortex-compact +2.6% -3.2% +6.0% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +12.7% -3.2% +16.4% +30.0% ➖ noise
3 duckdb:vortex-compact -12.0% -3.2% -9.0% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -12.2% -3.2% -9.3% +32.6% ➖ noise
4 datafusion:vortex-compact -6.5% -0.7% -5.8% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +1.2% -0.7% +2.0% +30.0% ➖ noise
4 duckdb:vortex-compact -11.3% -0.7% -10.6% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -7.4% -0.7% -6.7% +30.0% ➖ noise
5 datafusion:vortex-compact -0.9% +2.3% -3.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +2.1% +2.3% -0.2% +30.0% ➖ noise
5 duckdb:vortex-compact -9.2% +2.3% -11.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -1.5% +2.3% -3.8% +30.0% ➖ noise
6 datafusion:vortex-compact -5.2% +0.2% -5.3% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +30.7% +0.2% +30.5% +30.0% 🚨 regression
6 duckdb:vortex-compact -2.1% +0.2% -2.3% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +0.2% +0.2% +0.0% +30.0% ➖ noise
7 datafusion:vortex-compact +0.4% +2.0% -1.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +6.2% +2.0% +4.1% +30.0% ➖ noise
7 duckdb:vortex-compact +0.1% +2.0% -1.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +1.2% +2.0% -0.8% +30.0% ➖ noise
8 datafusion:vortex-compact +6.6% -2.7% +9.6% +64.0% ➖ noise
8 datafusion:vortex-file-compressed +12.5% -2.7% +15.7% +30.0% ➖ noise
8 duckdb:vortex-compact -10.4% -2.7% -7.8% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -2.1% -2.7% +0.7% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.990x ➖
Parquet (geomean): 1.014x ➖


unknown / unknown (1.004x ➖, 1↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 1850059 1942202 0.95
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1105157 1076073 1.03
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8310295915 8476903982 0.98
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8326843476 8435145468 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7936675 8409094 0.94
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7446056 7589394 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk 1380907 1332709 1.04
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2131501 2035880 1.05
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8319415693 8391445319 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8330609041 8503837185 0.98
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13286071 13337415 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13134475 13179136 1.00
random-access/lance-tokio-local-disk 705038 702521 1.00
random-access/lance-tokio-local-disk-footer 1240120 1218345 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk 255696 254577 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 664392 632626 1.05
random-access/nested-lists/correlated/parquet-tokio-local-disk 129464235 127798166 1.01
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 129936686 127833432 1.02
random-access/nested-lists/correlated/vortex-tokio-local-disk 632053 630692 1.00
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 641249 614854 1.04
random-access/nested-lists/uniform/lance-tokio-local-disk 1118098 1093318 1.02
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1543466 1498457 1.03
random-access/nested-lists/uniform/parquet-tokio-local-disk 129775320 128043156 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 131067736 127930794 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk 2164259 2122932 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2157843 2116702 1.02
random-access/nested-structs/correlated/lance-tokio-local-disk 405218 403018 1.01
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 605673 597893 1.01
random-access/nested-structs/correlated/parquet-tokio-local-disk 26018428 25179651 1.03
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 26945538 25232243 1.07
random-access/nested-structs/correlated/vortex-tokio-local-disk 798752 789896 1.01
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 802704 793737 1.01
random-access/nested-structs/uniform/lance-tokio-local-disk 2746408 2725107 1.01
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2962357 2955918 1.00
random-access/nested-structs/uniform/parquet-tokio-local-disk 25916287 25113745 1.03
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 25849305 25113799 1.03
random-access/nested-structs/uniform/vortex-tokio-local-disk 1725540 1666470 1.04
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1698889 1629625 1.04
random-access/parquet-tokio-local-disk 178325449 176772161 1.01
random-access/parquet-tokio-local-disk-footer 177479674 173567173 1.02
random-access/taxi/correlated/lance-tokio-local-disk 920157 928381 0.99
random-access/taxi/correlated/lance-tokio-local-disk-footer 1514954 1524314 0.99
random-access/taxi/correlated/parquet-tokio-local-disk 264488665 259880061 1.02
random-access/taxi/correlated/parquet-tokio-local-disk-footer 264748748 261104479 1.01
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1629684 1831887 0.89
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1796048 1846545 0.97
random-access/taxi/uniform/lance-tokio-local-disk 8358724 8385157 1.00
random-access/taxi/uniform/lance-tokio-local-disk-footer 8938404 9412742 0.95
random-access/taxi/uniform/parquet-tokio-local-disk 278268722 274492337 1.01
random-access/taxi/uniform/parquet-tokio-local-disk-footer 278823688 274422088 1.02
random-access/taxi/uniform/vortex-tokio-local-disk 4561518 4609232 0.99
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4507732 4572367 0.99
random-access/vortex-tokio-local-disk 1245259 1339303 0.93
random-access/vortex-tokio-local-disk-footer 1265488 1315280 0.96

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Vortex (geomean): 1.001x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.1%


datafusion / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 394544043 395172391 1.00
tpch_q02/datafusion:vortex-file-compressed 106505812 106420609 1.00
tpch_q03/datafusion:vortex-file-compressed 206369701 206646711 1.00
tpch_q04/datafusion:vortex-file-compressed 106248869 107044648 0.99
tpch_q05/datafusion:vortex-file-compressed 363613225 363021192 1.00
tpch_q06/datafusion:vortex-file-compressed 43879262 43175155 1.02
tpch_q07/datafusion:vortex-file-compressed 542646648 544187125 1.00
tpch_q08/datafusion:vortex-file-compressed 344836793 349055304 0.99
tpch_q09/datafusion:vortex-file-compressed 628646499 632731008 0.99
tpch_q10/datafusion:vortex-file-compressed 243110796 243058532 1.00
tpch_q11/datafusion:vortex-file-compressed 80504813 78879192 1.02
tpch_q12/datafusion:vortex-file-compressed 115275206 116185929 0.99
tpch_q13/datafusion:vortex-file-compressed 209822059 212807332 0.99
tpch_q14/datafusion:vortex-file-compressed 53866454 55593959 0.97
tpch_q15/datafusion:vortex-file-compressed 103860014 103362520 1.00
tpch_q16/datafusion:vortex-file-compressed 71667344 71306370 1.01
tpch_q17/datafusion:vortex-file-compressed 616709433 619048535 1.00
tpch_q18/datafusion:vortex-file-compressed 819385513 819605255 1.00
tpch_q19/datafusion:vortex-file-compressed 88756911 89822285 0.99
tpch_q20/datafusion:vortex-file-compressed 163657314 164694221 0.99
tpch_q21/datafusion:vortex-file-compressed 655920993 658419117 1.00
tpch_q22/datafusion:vortex-file-compressed 60678083 56877702 1.07
datafusion / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 437269239 438948961 1.00
tpch_q02/datafusion:vortex-compact 111957932 114744916 0.98
tpch_q03/datafusion:vortex-compact 213014241 211035487 1.01
tpch_q04/datafusion:vortex-compact 117946140 119250914 0.99
tpch_q05/datafusion:vortex-compact 369994986 368960430 1.00
tpch_q06/datafusion:vortex-compact 63423462 63148813 1.00
tpch_q07/datafusion:vortex-compact 559560987 561356503 1.00
tpch_q08/datafusion:vortex-compact 352403851 351452202 1.00
tpch_q09/datafusion:vortex-compact 651041396 638652354 1.02
tpch_q10/datafusion:vortex-compact 270513217 269273708 1.00
tpch_q11/datafusion:vortex-compact 84012027 82658900 1.02
tpch_q12/datafusion:vortex-compact 165055598 167343217 0.99
tpch_q13/datafusion:vortex-compact 263991278 265468123 0.99
tpch_q14/datafusion:vortex-compact 72403474 72379831 1.00
tpch_q15/datafusion:vortex-compact 159088532 160535892 0.99
tpch_q16/datafusion:vortex-compact 77389011 78672220 0.98
tpch_q17/datafusion:vortex-compact 624373351 617330700 1.01
tpch_q18/datafusion:vortex-compact 827010273 822156078 1.01
tpch_q19/datafusion:vortex-compact 128768527 129342753 1.00
tpch_q20/datafusion:vortex-compact 192910636 192454954 1.00
tpch_q21/datafusion:vortex-compact 675529191 671608570 1.01
tpch_q22/datafusion:vortex-compact 68145432 68859802 0.99
datafusion / parquet (1.004x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 469265415 457648250 1.03
tpch_q02/datafusion:parquet 172296812 172319729 1.00
tpch_q03/datafusion:parquet 287399311 285871580 1.01
tpch_q04/datafusion:parquet 131873899 131429436 1.00
tpch_q05/datafusion:parquet 435974421 437453058 1.00
tpch_q06/datafusion:parquet 131706191 126493116 1.04
tpch_q07/datafusion:parquet 607121949 613181032 0.99
tpch_q08/datafusion:parquet 470409288 465621856 1.01
tpch_q09/datafusion:parquet 747523052 743189329 1.01
tpch_q10/datafusion:parquet 510209503 504861408 1.01
tpch_q11/datafusion:parquet 121231409 123790520 0.98
tpch_q12/datafusion:parquet 212843344 211494284 1.01
tpch_q13/datafusion:parquet 336011003 332221606 1.01
tpch_q14/datafusion:parquet 163034741 161108430 1.01
tpch_q15/datafusion:parquet 260702750 260836720 1.00
tpch_q16/datafusion:parquet 124154773 126344262 0.98
tpch_q17/datafusion:parquet 672758239 681913220 0.99
tpch_q18/datafusion:parquet 873704028 868713461 1.01
tpch_q19/datafusion:parquet 284001417 277217860 1.02
tpch_q20/datafusion:parquet 298608805 296342929 1.01
tpch_q21/datafusion:parquet 699650253 699518887 1.00
tpch_q22/datafusion:parquet 210787580 212969026 0.99
datafusion / arrow (1.003x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 603166236 599878710 1.01
tpch_q02/datafusion:arrow 162670334 160098982 1.02
tpch_q03/datafusion:arrow 461241249 462914981 1.00
tpch_q04/datafusion:arrow 334504632 330948513 1.01
tpch_q05/datafusion:arrow 905146293 896828675 1.01
tpch_q06/datafusion:arrow 282702157 284340806 0.99
tpch_q07/datafusion:arrow 1143472720 1155533693 0.99
tpch_q08/datafusion:arrow 1114001697 1120280185 0.99
tpch_q09/datafusion:arrow 1315151072 1321648859 1.00
tpch_q10/datafusion:arrow 589590093 595875841 0.99
tpch_q11/datafusion:arrow 138414486 134760308 1.03
tpch_q12/datafusion:arrow 742298571 783137329 0.95
tpch_q13/datafusion:arrow 509906483 509070670 1.00
tpch_q14/datafusion:arrow 313268074 308971250 1.01
tpch_q15/datafusion:arrow 677478008 675572175 1.00
tpch_q16/datafusion:arrow 103454135 101803438 1.02
tpch_q17/datafusion:arrow 1306123288 1293827062 1.01
tpch_q18/datafusion:arrow 1869310405 1859427457 1.01
tpch_q19/datafusion:arrow 497357963 488485317 1.02
tpch_q20/datafusion:arrow 480553381 479877855 1.00
tpch_q21/datafusion:arrow 2986472194 2975679444 1.00
tpch_q22/datafusion:arrow 128093290 126436181 1.01
duckdb / vortex-file-compressed (1.002x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 171520256 169259959 1.01
tpch_q02/duckdb:vortex-file-compressed 50142494 51526210 0.97
tpch_q03/duckdb:vortex-file-compressed 126542758 126397785 1.00
tpch_q04/duckdb:vortex-file-compressed 154554638 155513309 0.99
tpch_q05/duckdb:vortex-file-compressed 129479444 127885035 1.01
tpch_q06/duckdb:vortex-file-compressed 48377717 47481854 1.02
tpch_q07/duckdb:vortex-file-compressed 147245210 146337728 1.01
tpch_q08/duckdb:vortex-file-compressed 169656153 169681446 1.00
tpch_q09/duckdb:vortex-file-compressed 322960989 325409079 0.99
tpch_q10/duckdb:vortex-file-compressed 146289179 145083541 1.01
tpch_q11/duckdb:vortex-file-compressed 32322264 32763016 0.99
tpch_q12/duckdb:vortex-file-compressed 95764939 94043452 1.02
tpch_q13/duckdb:vortex-file-compressed 227866909 228806257 1.00
tpch_q14/duckdb:vortex-file-compressed 66257791 65318944 1.01
tpch_q15/duckdb:vortex-file-compressed 87670009 86669509 1.01
tpch_q16/duckdb:vortex-file-compressed 76250635 78839739 0.97
tpch_q17/duckdb:vortex-file-compressed 98565892 99038670 1.00
tpch_q18/duckdb:vortex-file-compressed 291287388 281806761 1.03
tpch_q19/duckdb:vortex-file-compressed 84253901 83829586 1.01
tpch_q20/duckdb:vortex-file-compressed 158319765 158843687 1.00
tpch_q21/duckdb:vortex-file-compressed 562925768 564296619 1.00
tpch_q22/duckdb:vortex-file-compressed 71148566 71411520 1.00
duckdb / vortex-compact (1.004x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 228166600 227540287 1.00
tpch_q02/duckdb:vortex-compact 56577835 56655679 1.00
tpch_q03/duckdb:vortex-compact 138172646 139233753 0.99
tpch_q04/duckdb:vortex-compact 170994591 170679719 1.00
tpch_q05/duckdb:vortex-compact 145012698 143366256 1.01
tpch_q06/duckdb:vortex-compact 85514086 84609150 1.01
tpch_q07/duckdb:vortex-compact 197635537 196538012 1.01
tpch_q08/duckdb:vortex-compact 187660016 184008851 1.02
tpch_q09/duckdb:vortex-compact 355678222 353046479 1.01
tpch_q10/duckdb:vortex-compact 177260708 175661948 1.01
tpch_q11/duckdb:vortex-compact 40361024 40360318 1.00
tpch_q12/duckdb:vortex-compact 202942840 200958767 1.01
tpch_q13/duckdb:vortex-compact 276962070 276366696 1.00
tpch_q14/duckdb:vortex-compact 97615354 100225067 0.97
tpch_q15/duckdb:vortex-compact 113047181 111886659 1.01
tpch_q16/duckdb:vortex-compact 83248072 82753592 1.01
tpch_q17/duckdb:vortex-compact 113832560 113646951 1.00
tpch_q18/duckdb:vortex-compact 287625661 287540165 1.00
tpch_q19/duckdb:vortex-compact 108443490 108122581 1.00
tpch_q20/duckdb:vortex-compact 202220287 204064244 0.99
tpch_q21/duckdb:vortex-compact 617354438 606360826 1.02
tpch_q22/duckdb:vortex-compact 85490204 83916626 1.02
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 255350071 258933028 0.99
tpch_q02/duckdb:parquet 100822827 93811930 1.07
tpch_q03/duckdb:parquet 206562523 206251783 1.00
tpch_q04/duckdb:parquet 131633925 130529509 1.01
tpch_q05/duckdb:parquet 214098744 214894439 1.00
tpch_q06/duckdb:parquet 66832701 64909514 1.03
tpch_q07/duckdb:parquet 179210870 179471161 1.00
tpch_q08/duckdb:parquet 250332449 253992248 0.99
tpch_q09/duckdb:parquet 476079527 497411898 0.96
tpch_q10/duckdb:parquet 607766902 611335836 0.99
tpch_q11/duckdb:parquet 56257449 58689000 0.96
tpch_q12/duckdb:parquet 122890572 123250240 1.00
tpch_q13/duckdb:parquet 436227482 445981892 0.98
tpch_q14/duckdb:parquet 174340212 177279444 0.98
tpch_q15/duckdb:parquet 97182981 94137148 1.03
tpch_q16/duckdb:parquet 161595084 162594224 0.99
tpch_q17/duckdb:parquet 174827152 177432500 0.99
tpch_q18/duckdb:parquet 353973787 351309114 1.01
tpch_q19/duckdb:parquet 285870009 284134857 1.01
tpch_q20/duckdb:parquet 230156370 230934520 1.00
tpch_q21/duckdb:parquet 554907856 551312592 1.01
tpch_q22/duckdb:parquet 289309322 289586839 1.00
duckdb / duckdb (0.993x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117129927 117139206 1.00
tpch_q02/duckdb:duckdb 45124326 48884857 0.92
tpch_q03/duckdb:duckdb 97149897 96490962 1.01
tpch_q04/duckdb:duckdb 131813431 132082786 1.00
tpch_q05/duckdb:duckdb 110805685 108868461 1.02
tpch_q06/duckdb:duckdb 37399802 37195833 1.01
tpch_q07/duckdb:duckdb 86381525 86382655 1.00
tpch_q08/duckdb:duckdb 110051086 110444043 1.00
tpch_q09/duckdb:duckdb 275837706 276798578 1.00
tpch_q10/duckdb:duckdb 203465419 204571418 0.99
tpch_q11/duckdb:duckdb 15323644 15598532 0.98
tpch_q12/duckdb:duckdb 85433600 85070583 1.00
tpch_q13/duckdb:duckdb 221822859 221580475 1.00
tpch_q14/duckdb:duckdb 70184935 70338200 1.00
tpch_q15/duckdb:duckdb 77945409 78490365 0.99
tpch_q16/duckdb:duckdb 72942511 72866138 1.00
tpch_q17/duckdb:duckdb 84502780 84384519 1.00
tpch_q18/duckdb:duckdb 213715189 211359651 1.01
tpch_q19/duckdb:duckdb 116612701 115627369 1.01
tpch_q20/duckdb:duckdb 111672377 112337718 0.99
tpch_q21/duckdb:duckdb 286519481 297134181 0.96
tpch_q22/duckdb:duckdb 67092392 70974088 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.5% +0.6% -0.0% +10.0% ➖ noise
1 datafusion:vortex-compact -0.4% +0.6% -0.9% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -0.2% +0.6% -0.7% +10.0% ➖ noise
1 duckdb:duckdb -0.0% +0.6% -0.6% +10.0% ➖ noise
1 duckdb:vortex-compact +0.3% +0.6% -0.3% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +1.3% +0.6% +0.8% +10.0% ➖ noise
2 datafusion:arrow +1.6% +3.7% -2.0% +10.0% ➖ noise
2 datafusion:vortex-compact -2.4% +3.7% -5.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.1% +3.7% -3.5% +10.0% ➖ noise
2 duckdb:duckdb -7.7% +3.7% -11.0% +10.0% ✅ faster
2 duckdb:vortex-compact -0.1% +3.7% -3.7% +13.9% ➖ noise
2 duckdb:vortex-file-compressed -2.7% +3.7% -6.1% +10.0% ➖ noise
3 datafusion:arrow -0.4% +0.3% -0.7% +10.0% ➖ noise
3 datafusion:vortex-compact +0.9% +0.3% +0.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -0.1% +0.3% -0.5% +10.0% ➖ noise
3 duckdb:duckdb +0.7% +0.3% +0.3% +10.0% ➖ noise
3 duckdb:vortex-compact -0.8% +0.3% -1.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.1% +0.3% -0.2% +10.0% ➖ noise
4 datafusion:arrow +1.1% +0.6% +0.5% +10.0% ➖ noise
4 datafusion:vortex-compact -1.1% +0.6% -1.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.7% +0.6% -1.3% +10.0% ➖ noise
4 duckdb:duckdb -0.2% +0.6% -0.8% +10.0% ➖ noise
4 duckdb:vortex-compact +0.2% +0.6% -0.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.6% +0.6% -1.2% +10.0% ➖ noise
5 datafusion:arrow +0.9% -0.4% +1.3% +10.0% ➖ noise
5 datafusion:vortex-compact +0.3% -0.4% +0.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.2% -0.4% +0.5% +10.0% ➖ noise
5 duckdb:duckdb +1.8% -0.4% +2.1% +10.0% ➖ noise
5 duckdb:vortex-compact +1.1% -0.4% +1.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.2% -0.4% +1.6% +10.0% ➖ noise
6 datafusion:arrow -0.6% +3.5% -4.0% +10.0% ➖ noise
6 datafusion:vortex-compact +0.4% +3.5% -3.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.6% +3.5% -1.8% +10.0% ➖ noise
6 duckdb:duckdb +0.5% +3.5% -2.9% +10.8% ➖ noise
6 duckdb:vortex-compact +1.1% +3.5% -2.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.9% +3.5% -1.6% +10.0% ➖ noise
7 datafusion:arrow -1.0% -0.6% -0.5% +10.0% ➖ noise
7 datafusion:vortex-compact -0.3% -0.6% +0.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.3% -0.6% +0.3% +10.0% ➖ noise
7 duckdb:duckdb -0.0% -0.6% +0.6% +10.0% ➖ noise
7 duckdb:vortex-compact +0.6% -0.6% +1.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.6% -0.6% +1.2% +10.0% ➖ noise
8 datafusion:arrow -0.6% -0.2% -0.3% +10.0% ➖ noise
8 datafusion:vortex-compact +0.3% -0.2% +0.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.2% -0.2% -1.0% +10.0% ➖ noise
8 duckdb:duckdb -0.4% -0.2% -0.1% +10.0% ➖ noise
8 duckdb:vortex-compact +2.0% -0.2% +2.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.0% -0.2% +0.2% +10.0% ➖ noise
9 datafusion:arrow -0.5% -1.9% +1.4% +10.0% ➖ noise
9 datafusion:vortex-compact +1.9% -1.9% +3.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.6% -1.9% +1.3% +10.0% ➖ noise
9 duckdb:duckdb -0.3% -1.9% +1.6% +10.0% ➖ noise
9 duckdb:vortex-compact +0.7% -1.9% +2.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.8% -1.9% +1.2% +10.0% ➖ noise
10 datafusion:arrow -1.1% +0.2% -1.3% +10.0% ➖ noise
10 datafusion:vortex-compact +0.5% +0.2% +0.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.0% +0.2% -0.2% +10.0% ➖ noise
10 duckdb:duckdb -0.5% +0.2% -0.8% +10.0% ➖ noise
10 duckdb:vortex-compact +0.9% +0.2% +0.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.8% +0.2% +0.6% +10.0% ➖ noise
11 datafusion:arrow +2.7% -3.1% +6.0% +10.0% ➖ noise
11 datafusion:vortex-compact +1.6% -3.1% +4.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.1% -3.1% +5.3% +10.0% ➖ noise
11 duckdb:duckdb -1.8% -3.1% +1.4% +11.7% ➖ noise
11 duckdb:vortex-compact +0.0% -3.1% +3.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.3% -3.1% +1.8% +10.2% ➖ noise
12 datafusion:arrow -5.2% +0.2% -5.4% +33.9% ➖ noise
12 datafusion:vortex-compact -1.4% +0.2% -1.5% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.8% +0.2% -1.0% +10.0% ➖ noise
12 duckdb:duckdb +0.4% +0.2% +0.3% +10.0% ➖ noise
12 duckdb:vortex-compact +1.0% +0.2% +0.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.8% +0.2% +1.7% +10.0% ➖ noise
13 datafusion:arrow +0.2% -0.5% +0.7% +10.0% ➖ noise
13 datafusion:vortex-compact -0.6% -0.5% -0.0% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.4% -0.5% -0.9% +10.0% ➖ noise
13 duckdb:duckdb +0.1% -0.5% +0.7% +10.0% ➖ noise
13 duckdb:vortex-compact +0.2% -0.5% +0.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.4% -0.5% +0.1% +10.0% ➖ noise
14 datafusion:arrow +1.4% -0.2% +1.6% +10.0% ➖ noise
14 datafusion:vortex-compact +0.0% -0.2% +0.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -3.1% -0.2% -2.9% +10.0% ➖ noise
14 duckdb:duckdb -0.2% -0.2% +0.0% +10.0% ➖ noise
14 duckdb:vortex-compact -2.6% -0.2% -2.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +1.4% -0.2% +1.7% +10.0% ➖ noise
15 datafusion:arrow +0.3% +1.6% -1.3% +10.0% ➖ noise
15 datafusion:vortex-compact -0.9% +1.6% -2.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.5% +1.6% -1.1% +10.0% ➖ noise
15 duckdb:duckdb -0.7% +1.6% -2.2% +10.0% ➖ noise
15 duckdb:vortex-compact +1.0% +1.6% -0.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +1.2% +1.6% -0.4% +10.0% ➖ noise
16 datafusion:arrow +1.6% -1.2% +2.8% +10.0% ➖ noise
16 datafusion:vortex-compact -1.6% -1.2% -0.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.5% -1.2% +1.7% +10.0% ➖ noise
16 duckdb:duckdb +0.1% -1.2% +1.3% +10.0% ➖ noise
16 duckdb:vortex-compact +0.6% -1.2% +1.8% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -3.3% -1.2% -2.1% +10.0% ➖ noise
17 datafusion:arrow +1.0% -1.4% +2.4% +10.0% ➖ noise
17 datafusion:vortex-compact +1.1% -1.4% +2.6% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.4% -1.4% +1.0% +10.0% ➖ noise
17 duckdb:duckdb +0.1% -1.4% +1.6% +10.0% ➖ noise
17 duckdb:vortex-compact +0.2% -1.4% +1.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.5% -1.4% +0.9% +10.0% ➖ noise
18 datafusion:arrow +0.5% +0.7% -0.1% +10.0% ➖ noise
18 datafusion:vortex-compact +0.6% +0.7% -0.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.0% +0.7% -0.7% +10.0% ➖ noise
18 duckdb:duckdb +1.1% +0.7% +0.4% +10.0% ➖ noise
18 duckdb:vortex-compact +0.0% +0.7% -0.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +3.4% +0.7% +2.7% +10.0% ➖ noise
19 datafusion:arrow +1.8% +1.5% +0.3% +10.0% ➖ noise
19 datafusion:vortex-compact -0.4% +1.5% -1.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -1.2% +1.5% -2.7% +10.0% ➖ noise
19 duckdb:duckdb +0.9% +1.5% -0.7% +10.0% ➖ noise
19 duckdb:vortex-compact +0.3% +1.5% -1.2% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +0.5% +1.5% -1.0% +10.0% ➖ noise
20 datafusion:arrow +0.1% +0.2% -0.1% +10.0% ➖ noise
20 datafusion:vortex-compact +0.2% +0.2% +0.0% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -0.6% +0.2% -0.8% +10.0% ➖ noise
20 duckdb:duckdb -0.6% +0.2% -0.8% +10.0% ➖ noise
20 duckdb:vortex-compact -0.9% +0.2% -1.1% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.3% +0.2% -0.5% +10.0% ➖ noise
21 datafusion:arrow +0.4% +0.3% +0.0% +10.0% ➖ noise
21 datafusion:vortex-compact +0.6% +0.3% +0.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -0.4% +0.3% -0.7% +10.0% ➖ noise
21 duckdb:duckdb -3.6% +0.3% -3.9% +10.0% ➖ noise
21 duckdb:vortex-compact +1.8% +0.3% +1.5% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -0.2% +0.3% -0.6% +10.0% ➖ noise
22 datafusion:arrow +1.3% -0.6% +1.9% +10.0% ➖ noise
22 datafusion:vortex-compact -1.0% -0.6% -0.5% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +6.7% -0.6% +7.3% +10.0% ➖ noise
22 duckdb:duckdb -5.5% -0.6% -4.9% +10.0% ➖ noise
22 duckdb:vortex-compact +1.9% -0.6% +2.5% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.4% -0.6% +0.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.3%
Vortex (geomean): 1.042x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish +1.0%


duckdb / vortex-file-compressed (1.064x ➖, 0↑ 1↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12253244 11496577 1.07
statpopgen_q01/duckdb:vortex-file-compressed 🚨 26604256 20069328 1.33
statpopgen_q02/duckdb:vortex-file-compressed 1394713494 1385801473 1.01
statpopgen_q03/duckdb:vortex-file-compressed 3186344748 3107478287 1.03
statpopgen_q04/duckdb:vortex-file-compressed 3175113010 3144238586 1.01
statpopgen_q05/duckdb:vortex-file-compressed 1541994763 1451459637 1.06
statpopgen_q06/duckdb:vortex-file-compressed 2280397414 2164200182 1.05
statpopgen_q07/duckdb:vortex-file-compressed 241793765 229344233 1.05
statpopgen_q08/duckdb:vortex-file-compressed 281601943 270769384 1.04
statpopgen_q09/duckdb:vortex-file-compressed 3088405529 2914633659 1.06
statpopgen_q10/duckdb:vortex-file-compressed 4899648979 4746101889 1.03
duckdb / vortex-compact (1.020x ➖, 0↑ 1↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 🚨 12430721 11250839 1.10
statpopgen_q01/duckdb:vortex-compact 170794116 165297096 1.03
statpopgen_q02/duckdb:vortex-compact 1879956130 1807284266 1.04
statpopgen_q03/duckdb:vortex-compact 3608982382 3457034620 1.04
statpopgen_q04/duckdb:vortex-compact 3609036602 3483738041 1.04
statpopgen_q05/duckdb:vortex-compact 1837838593 1815687533 1.01
statpopgen_q06/duckdb:vortex-compact 2669901493 2682594064 1.00
statpopgen_q07/duckdb:vortex-compact 888071719 900820732 0.99
statpopgen_q08/duckdb:vortex-compact 919859209 936875824 0.98
statpopgen_q09/duckdb:vortex-compact 3302810158 3307421876 1.00
statpopgen_q10/duckdb:vortex-compact 5395216608 5407040717 1.00
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 324903962 325736109 1.00
statpopgen_q01/duckdb:parquet 409642489 403737965 1.01
statpopgen_q02/duckdb:parquet 987917311 978805646 1.01
statpopgen_q03/duckdb:parquet 1492105841 1480194489 1.01
statpopgen_q04/duckdb:parquet 1502484591 1499743111 1.00
statpopgen_q05/duckdb:parquet 1004161516 1002747861 1.00
statpopgen_q06/duckdb:parquet 1484997497 1485841566 1.00
statpopgen_q07/duckdb:parquet 1281496144 1306816826 0.98
statpopgen_q08/duckdb:parquet 1285721937 1299736378 0.99
statpopgen_q09/duckdb:parquet 1373209433 1392696409 0.99
statpopgen_q10/duckdb:parquet 2661473278 2650531192 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +10.5% -0.3% +10.8% +10.0% 🚨 regression
0 duckdb:vortex-file-compressed +6.6% -0.3% +6.9% +12.0% ➖ noise
1 duckdb:vortex-compact +3.3% +1.5% +1.8% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +32.6% +1.5% +30.7% +199.0% ➖ noise
2 duckdb:vortex-compact +4.0% +0.9% +3.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.6% +0.9% -0.3% +10.0% ➖ noise
3 duckdb:vortex-compact +4.4% +0.8% +3.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +2.5% +0.8% +1.7% +10.0% ➖ noise
4 duckdb:vortex-compact +3.6% +0.2% +3.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.0% +0.2% +0.8% +10.0% ➖ noise
5 duckdb:vortex-compact +1.2% +0.1% +1.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +6.2% +0.1% +6.1% +10.0% ➖ noise
6 duckdb:vortex-compact -0.5% -0.1% -0.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +5.4% -0.1% +5.4% +10.0% ➖ noise
7 duckdb:vortex-compact -1.4% -1.9% +0.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +5.4% -1.9% +7.5% +10.0% ➖ noise
8 duckdb:vortex-compact -1.8% -1.1% -0.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +4.0% -1.1% +5.1% +10.0% ➖ noise
9 duckdb:vortex-compact -0.1% -1.4% +1.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +6.0% -1.4% +7.5% +10.0% ➖ noise
10 duckdb:vortex-compact -0.2% +0.4% -0.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +3.2% +0.4% +2.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.6%
Vortex (geomean): 1.044x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.5%


datafusion / vortex-file-compressed (0.994x ➖, 0↑ 1↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 214234698 208857685 1.03
tpch_q02/datafusion:vortex-file-compressed 458248868 490187735 0.93
tpch_q03/datafusion:vortex-file-compressed 441272615 426536944 1.03
tpch_q04/datafusion:vortex-file-compressed 🚨 265251572 193650507 1.37
tpch_q05/datafusion:vortex-file-compressed 432279832 415756746 1.04
tpch_q06/datafusion:vortex-file-compressed 277649956 265980971 1.04
tpch_q07/datafusion:vortex-file-compressed 374301459 404668076 0.92
tpch_q08/datafusion:vortex-file-compressed 593583279 521044256 1.14
tpch_q09/datafusion:vortex-file-compressed 399546864 359170617 1.11
tpch_q10/datafusion:vortex-file-compressed 442342296 390024402 1.13
tpch_q11/datafusion:vortex-file-compressed 358292660 291546109 1.23
tpch_q12/datafusion:vortex-file-compressed 411445457 357952282 1.15
tpch_q13/datafusion:vortex-file-compressed 175727545 216888921 0.81
tpch_q14/datafusion:vortex-file-compressed 195654846 218671482 0.89
tpch_q15/datafusion:vortex-file-compressed 332397971 447596553 0.74
tpch_q16/datafusion:vortex-file-compressed 194837939 217555389 0.90
tpch_q17/datafusion:vortex-file-compressed 362762340 373688372 0.97
tpch_q18/datafusion:vortex-file-compressed 316570978 385495796 0.82
tpch_q19/datafusion:vortex-file-compressed 410474366 433507168 0.95
tpch_q20/datafusion:vortex-file-compressed 362475242 411550059 0.88
tpch_q21/datafusion:vortex-file-compressed 478654102 550921667 0.87
tpch_q22/datafusion:vortex-file-compressed 164386760 143571127 1.14
datafusion / vortex-compact (1.088x ➖, 1↑ 3↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 265431365 283184468 0.94
tpch_q02/datafusion:vortex-compact 429313187 471867410 0.91
tpch_q03/datafusion:vortex-compact 395358222 442173412 0.89
tpch_q04/datafusion:vortex-compact 225361291 227520114 0.99
tpch_q05/datafusion:vortex-compact 409874539 410168153 1.00
tpch_q06/datafusion:vortex-compact 353577109 315182285 1.12
tpch_q07/datafusion:vortex-compact 504294684 430567599 1.17
tpch_q08/datafusion:vortex-compact 🚨 1192671627 523705110 2.28
tpch_q09/datafusion:vortex-compact 🚨 984154149 418545781 2.35
tpch_q10/datafusion:vortex-compact 🚨 838028986 453186963 1.85
tpch_q11/datafusion:vortex-compact 292054835 265875253 1.10
tpch_q12/datafusion:vortex-compact 457719751 485915703 0.94
tpch_q13/datafusion:vortex-compact 161338029 143642454 1.12
tpch_q14/datafusion:vortex-compact 301336538 291247149 1.03
tpch_q15/datafusion:vortex-compact 560367044 507764676 1.10
tpch_q16/datafusion:vortex-compact 210339433 218933014 0.96
tpch_q17/datafusion:vortex-compact 435854855 412195869 1.06
tpch_q18/datafusion:vortex-compact 302651768 363226244 0.83
tpch_q19/datafusion:vortex-compact 506853679 494738617 1.02
tpch_q20/datafusion:vortex-compact 457391546 486906837 0.94
tpch_q21/datafusion:vortex-compact 527106540 585856340 0.90
tpch_q22/datafusion:vortex-compact 🚀 138771805 207935696 0.67
datafusion / parquet (1.002x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 242283839 222978886 1.09
tpch_q02/datafusion:parquet 523039132 459219337 1.14
tpch_q03/datafusion:parquet 404831088 349312277 1.16
tpch_q04/datafusion:parquet 218020880 180495594 1.21
tpch_q05/datafusion:parquet 506961946 492377107 1.03
tpch_q06/datafusion:parquet 149512072 178595847 0.84
tpch_q07/datafusion:parquet 493841583 575536656 0.86
tpch_q08/datafusion:parquet 631139397 569403193 1.11
tpch_q09/datafusion:parquet 555945223 528559254 1.05
tpch_q10/datafusion:parquet 511671235 559834476 0.91
tpch_q11/datafusion:parquet 353795470 380377181 0.93
tpch_q12/datafusion:parquet 235915565 277979900 0.85
tpch_q13/datafusion:parquet 473729632 433491116 1.09
tpch_q14/datafusion:parquet 195304989 201280000 0.97
tpch_q15/datafusion:parquet 331922041 299752445 1.11
tpch_q16/datafusion:parquet 174371263 180850779 0.96
tpch_q17/datafusion:parquet 408460229 390362256 1.05
tpch_q18/datafusion:parquet 498969656 488959709 1.02
tpch_q19/datafusion:parquet 380211370 425522737 0.89
tpch_q20/datafusion:parquet 391006563 423091154 0.92
tpch_q21/datafusion:parquet 567616180 629137126 0.90
tpch_q22/datafusion:parquet 144037379 134467690 1.07
duckdb / vortex-file-compressed (1.035x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 252290577 256848786 0.98
tpch_q02/duckdb:vortex-file-compressed 1048014690 904753920 1.16
tpch_q03/duckdb:vortex-file-compressed 684698454 655465707 1.04
tpch_q04/duckdb:vortex-file-compressed 358683116 398432083 0.90
tpch_q05/duckdb:vortex-file-compressed 1014066937 934116071 1.09
tpch_q06/duckdb:vortex-file-compressed 406676278 441699280 0.92
tpch_q07/duckdb:vortex-file-compressed 918149364 829266179 1.11
tpch_q08/duckdb:vortex-file-compressed 1005520485 1074656141 0.94
tpch_q09/duckdb:vortex-file-compressed 949477654 922903869 1.03
tpch_q10/duckdb:vortex-file-compressed 809163250 802646448 1.01
tpch_q11/duckdb:vortex-file-compressed 524856932 537594289 0.98
tpch_q12/duckdb:vortex-file-compressed 546382103 488544477 1.12
tpch_q13/duckdb:vortex-file-compressed 529697892 490922244 1.08
tpch_q14/duckdb:vortex-file-compressed 506534270 526197134 0.96
tpch_q15/duckdb:vortex-file-compressed 271622909 289925528 0.94
tpch_q16/duckdb:vortex-file-compressed 412407242 372214377 1.11
tpch_q17/duckdb:vortex-file-compressed 738643632 689901120 1.07
tpch_q18/duckdb:vortex-file-compressed 621109942 558893053 1.11
tpch_q19/duckdb:vortex-file-compressed 463273122 467719026 0.99
tpch_q20/duckdb:vortex-file-compressed 963119182 801123280 1.20
tpch_q21/duckdb:vortex-file-compressed 1176202789 1047212152 1.12
tpch_q22/duckdb:vortex-file-compressed 354370531 360533390 0.98
duckdb / vortex-compact (1.062x ➖, 0↑ 1↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 304463052 276975529 1.10
tpch_q02/duckdb:vortex-compact 948850197 963310263 0.98
tpch_q03/duckdb:vortex-compact 710146414 673619234 1.05
tpch_q04/duckdb:vortex-compact 🚨 425092275 319976517 1.33
tpch_q05/duckdb:vortex-compact 879071961 900133397 0.98
tpch_q06/duckdb:vortex-compact 406394641 399718447 1.02
tpch_q07/duckdb:vortex-compact 858665614 766618162 1.12
tpch_q08/duckdb:vortex-compact 1093275126 945442671 1.16
tpch_q09/duckdb:vortex-compact 1013782435 866649709 1.17
tpch_q10/duckdb:vortex-compact 711122950 690317203 1.03
tpch_q11/duckdb:vortex-compact 520159898 487598757 1.07
tpch_q12/duckdb:vortex-compact 528511560 449203238 1.18
tpch_q13/duckdb:vortex-compact 483584988 446823633 1.08
tpch_q14/duckdb:vortex-compact 510920725 516497866 0.99
tpch_q15/duckdb:vortex-compact 277568839 289772889 0.96
tpch_q16/duckdb:vortex-compact 380506380 337692372 1.13
tpch_q17/duckdb:vortex-compact 599783368 726510106 0.83
tpch_q18/duckdb:vortex-compact 487136862 482303550 1.01
tpch_q19/duckdb:vortex-compact 410152619 416736232 0.98
tpch_q20/duckdb:vortex-compact 873548957 791968028 1.10
tpch_q21/duckdb:vortex-compact 1180175200 1031070688 1.14
tpch_q22/duckdb:vortex-compact 359234904 336843400 1.07
duckdb / parquet (0.994x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 454144124 541804668 0.84
tpch_q02/duckdb:parquet 1205096438 1222281592 0.99
tpch_q03/duckdb:parquet 989283009 1047251897 0.94
tpch_q04/duckdb:parquet 601935484 637650260 0.94
tpch_q05/duckdb:parquet 1490263293 1472870720 1.01
tpch_q06/duckdb:parquet 434871163 443956856 0.98
tpch_q07/duckdb:parquet 1336576784 1406551597 0.95
tpch_q08/duckdb:parquet 1872336673 1795068274 1.04
tpch_q09/duckdb:parquet 1458743802 1455073958 1.00
tpch_q10/duckdb:parquet 1299983053 1304557956 1.00
tpch_q11/duckdb:parquet 849350898 876642343 0.97
tpch_q12/duckdb:parquet 794138875 726274644 1.09
tpch_q13/duckdb:parquet 921618836 941630210 0.98
tpch_q14/duckdb:parquet 674350442 644231933 1.05
tpch_q15/duckdb:parquet 509928573 490892937 1.04
tpch_q16/duckdb:parquet 596784229 628963426 0.95
tpch_q17/duckdb:parquet 819560836 780611478 1.05
tpch_q18/duckdb:parquet 903894858 879377018 1.03
tpch_q19/duckdb:parquet 832608114 848205290 0.98
tpch_q20/duckdb:parquet 1123283542 1109476563 1.01
tpch_q21/duckdb:parquet 1184599002 1114577382 1.06
tpch_q22/duckdb:parquet 581656867 579241154 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -6.3% -4.6% -1.8% +74.3% ➖ noise
1 datafusion:vortex-file-compressed +2.6% -4.6% +7.5% +81.5% ➖ noise
1 duckdb:vortex-compact +9.9% -4.6% +15.2% +48.5% ➖ noise
1 duckdb:vortex-file-compressed -1.8% -4.6% +2.9% +46.3% ➖ noise
2 datafusion:vortex-compact -9.0% +6.0% -14.1% +31.2% ➖ noise
2 datafusion:vortex-file-compressed -6.5% +6.0% -11.8% +32.9% ➖ noise
2 duckdb:vortex-compact -1.5% +6.0% -7.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +15.8% +6.0% +9.3% +30.0% ➖ noise
3 datafusion:vortex-compact -10.6% +4.6% -14.5% +55.3% ➖ noise
3 datafusion:vortex-file-compressed +3.5% +4.6% -1.1% +58.9% ➖ noise
3 duckdb:vortex-compact +5.4% +4.6% +0.8% +39.4% ➖ noise
3 duckdb:vortex-file-compressed +4.5% +4.6% -0.2% +30.0% ➖ noise
4 datafusion:vortex-compact -0.9% +6.8% -7.2% +43.9% ➖ noise
4 datafusion:vortex-file-compressed +37.0% +6.8% +28.3% +37.2% ➖ noise
4 duckdb:vortex-compact +32.9% +6.8% +24.4% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -10.0% +6.8% -15.7% +30.0% ➖ noise
5 datafusion:vortex-compact -0.1% +2.1% -2.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +4.0% +2.1% +1.9% +30.0% ➖ noise
5 duckdb:vortex-compact -2.3% +2.1% -4.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +8.6% +2.1% +6.4% +30.0% ➖ noise
6 datafusion:vortex-compact +12.2% -9.4% +23.9% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +4.4% -9.4% +15.3% +30.0% ➖ noise
6 duckdb:vortex-compact +1.7% -9.4% +12.3% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -7.9% -9.4% +1.7% +30.0% ➖ noise
7 datafusion:vortex-compact +17.1% -9.7% +29.7% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -7.5% -9.7% +2.4% +30.0% ➖ noise
7 duckdb:vortex-compact +12.0% -9.7% +24.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +10.7% -9.7% +22.6% +30.0% ➖ noise
8 datafusion:vortex-compact +127.7% +7.5% +111.8% +35.7% 🚨 regression
8 datafusion:vortex-file-compressed +13.9% +7.5% +6.0% +30.0% ➖ noise
8 duckdb:vortex-compact +15.6% +7.5% +7.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -6.4% +7.5% -13.0% +30.0% ➖ noise
9 datafusion:vortex-compact +135.1% +2.7% +129.0% +30.3% 🚨 regression
9 datafusion:vortex-file-compressed +11.2% +2.7% +8.3% +30.0% ➖ noise
9 duckdb:vortex-compact +17.0% +2.7% +13.9% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +2.9% +2.7% +0.2% +30.0% ➖ noise
10 datafusion:vortex-compact +84.9% -4.6% +93.8% +39.5% 🚨 regression
10 datafusion:vortex-file-compressed +13.4% -4.6% +18.8% +30.0% ➖ noise
10 duckdb:vortex-compact +3.0% -4.6% +7.9% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +0.8% -4.6% +5.6% +30.0% ➖ noise
11 datafusion:vortex-compact +9.8% -5.1% +15.7% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +22.9% -5.1% +29.5% +30.0% ➖ noise
11 duckdb:vortex-compact +6.7% -5.1% +12.4% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -2.4% -5.1% +2.8% +30.0% ➖ noise
12 datafusion:vortex-compact -5.8% -3.7% -2.2% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +14.9% -3.7% +19.3% +30.0% ➖ noise
12 duckdb:vortex-compact +17.7% -3.7% +22.1% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +11.8% -3.7% +16.1% +30.0% ➖ noise
13 datafusion:vortex-compact +12.3% +3.4% +8.6% +58.0% ➖ noise
13 datafusion:vortex-file-compressed -19.0% +3.4% -21.7% +50.0% ➖ noise
13 duckdb:vortex-compact +8.2% +3.4% +4.6% +38.8% ➖ noise
13 duckdb:vortex-file-compressed +7.9% +3.4% +4.3% +30.0% ➖ noise
14 datafusion:vortex-compact +3.5% +0.8% +2.7% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -10.5% +0.8% -11.2% +40.2% ➖ noise
14 duckdb:vortex-compact -1.1% +0.8% -1.8% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -3.7% +0.8% -4.5% +32.2% ➖ noise
15 datafusion:vortex-compact +10.4% +7.3% +2.9% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -25.7% +7.3% -30.8% +30.0% ✅ faster
15 duckdb:vortex-compact -4.2% +7.3% -10.7% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -6.3% +7.3% -12.6% +30.0% ➖ noise
16 datafusion:vortex-compact -3.9% -4.4% +0.4% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -10.4% -4.4% -6.4% +30.0% ➖ noise
16 duckdb:vortex-compact +12.7% -4.4% +17.8% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +10.8% -4.4% +15.8% +30.0% ➖ noise
17 datafusion:vortex-compact +5.7% +4.8% +0.9% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -2.9% +4.8% -7.4% +30.0% ➖ noise
17 duckdb:vortex-compact -17.4% +4.8% -21.2% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +7.1% +4.8% +2.1% +30.0% ➖ noise
18 datafusion:vortex-compact -16.7% +2.4% -18.6% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -17.9% +2.4% -19.8% +30.0% ➖ noise
18 duckdb:vortex-compact +1.0% +2.4% -1.4% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +11.1% +2.4% +8.5% +30.0% ➖ noise
19 datafusion:vortex-compact +2.4% -6.3% +9.4% +47.9% ➖ noise
19 datafusion:vortex-file-compressed -5.3% -6.3% +1.1% +30.0% ➖ noise
19 duckdb:vortex-compact -1.6% -6.3% +5.1% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -1.0% -6.3% +5.8% +39.3% ➖ noise
20 datafusion:vortex-compact -6.1% -3.3% -2.9% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -11.9% -3.3% -8.9% +30.0% ➖ noise
20 duckdb:vortex-compact +10.3% -3.3% +14.0% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +20.2% -3.3% +24.3% +30.0% ➖ noise
21 datafusion:vortex-compact -10.0% -2.1% -8.1% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -13.1% -2.1% -11.3% +30.0% ➖ noise
21 duckdb:vortex-compact +14.5% -2.1% +16.9% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +12.3% -2.1% +14.7% +30.0% ➖ noise
22 datafusion:vortex-compact -33.3% +3.7% -35.7% +35.0% ✅ faster
22 datafusion:vortex-file-compressed +14.5% +3.7% +10.4% +34.4% ➖ noise
22 duckdb:vortex-compact +6.6% +3.7% +2.8% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -1.7% +3.7% -5.2% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Vortex (geomean): 1.032x ➖
Parquet (geomean): 1.020x ➖
Shifts: Parquet (control) +2.0% · Median polish +0.5%


datafusion / vortex-file-compressed (1.001x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1653189 1664264 0.99
clickbench_q01/datafusion:vortex-file-compressed 13451710 13070600 1.03
clickbench_q02/datafusion:vortex-file-compressed 31392608 30623885 1.03
clickbench_q03/datafusion:vortex-file-compressed 37064958 35162731 1.05
clickbench_q04/datafusion:vortex-file-compressed 275943946 273046079 1.01
clickbench_q05/datafusion:vortex-file-compressed 289879069 290595467 1.00
clickbench_q06/datafusion:vortex-file-compressed 1681515 1631648 1.03
clickbench_q07/datafusion:vortex-file-compressed 15803516 16097320 0.98
clickbench_q08/datafusion:vortex-file-compressed 346306899 341752070 1.01
clickbench_q09/datafusion:vortex-file-compressed 531452879 548104154 0.97
clickbench_q10/datafusion:vortex-file-compressed 69221538 67821427 1.02
clickbench_q11/datafusion:vortex-file-compressed 79041873 82551044 0.96
clickbench_q12/datafusion:vortex-file-compressed 256542485 257172091 1.00
clickbench_q13/datafusion:vortex-file-compressed 402902590 400772978 1.01
clickbench_q14/datafusion:vortex-file-compressed 246945228 245126303 1.01
clickbench_q15/datafusion:vortex-file-compressed 319744014 317294424 1.01
clickbench_q16/datafusion:vortex-file-compressed 624238598 632335481 0.99
clickbench_q17/datafusion:vortex-file-compressed 621673183 629385199 0.99
clickbench_q18/datafusion:vortex-file-compressed 1283973204 1257105563 1.02
clickbench_q19/datafusion:vortex-file-compressed 23793831 25176685 0.95
clickbench_q20/datafusion:vortex-file-compressed 335689327 335234773 1.00
clickbench_q21/datafusion:vortex-file-compressed 366175344 369710705 0.99
clickbench_q22/datafusion:vortex-file-compressed 444712268 444456574 1.00
clickbench_q23/datafusion:vortex-file-compressed 652685491 647795603 1.01
clickbench_q24/datafusion:vortex-file-compressed 42011567 42985119 0.98
clickbench_q25/datafusion:vortex-file-compressed 67202841 66099277 1.02
clickbench_q26/datafusion:vortex-file-compressed 44005972 44142384 1.00
clickbench_q27/datafusion:vortex-file-compressed 717084308 710710754 1.01
clickbench_q28/datafusion:vortex-file-compressed 6629194754 6590394166 1.01
clickbench_q29/datafusion:vortex-file-compressed 224799483 232821440 0.97
clickbench_q30/datafusion:vortex-file-compressed 215394635 214213568 1.01
clickbench_q31/datafusion:vortex-file-compressed 249208986 248718441 1.00
clickbench_q32/datafusion:vortex-file-compressed 1081532541 1085715876 1.00
clickbench_q33/datafusion:vortex-file-compressed 1258745343 1263904791 1.00
clickbench_q34/datafusion:vortex-file-compressed 1274890591 1262559887 1.01
clickbench_q35/datafusion:vortex-file-compressed 462225233 468758887 0.99
clickbench_q36/datafusion:vortex-file-compressed 69849827 68334308 1.02
clickbench_q37/datafusion:vortex-file-compressed 35060863 34830494 1.01
clickbench_q38/datafusion:vortex-file-compressed 19556625 19388799 1.01
clickbench_q39/datafusion:vortex-file-compressed 127484333 128922879 0.99
clickbench_q40/datafusion:vortex-file-compressed 15711199 16029209 0.98
clickbench_q41/datafusion:vortex-file-compressed 15191102 14628517 1.04
clickbench_q42/datafusion:vortex-file-compressed 17383148 17251663 1.01
datafusion / parquet (1.005x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1635249 1542277 1.06
clickbench_q01/datafusion:parquet 19273910 18981187 1.02
clickbench_q02/datafusion:parquet 47569824 50440538 0.94
clickbench_q03/datafusion:parquet 37293515 38017389 0.98
clickbench_q04/datafusion:parquet 291957215 296401955 0.99
clickbench_q05/datafusion:parquet 352041145 341723962 1.03
clickbench_q06/datafusion:parquet 1554043 1572344 0.99
clickbench_q07/datafusion:parquet 23368235 21997938 1.06
clickbench_q08/datafusion:parquet 366591466 367736118 1.00
clickbench_q09/datafusion:parquet 608756130 613746530 0.99
clickbench_q10/datafusion:parquet 112009637 108233846 1.03
clickbench_q11/datafusion:parquet 132009210 132755537 0.99
clickbench_q12/datafusion:parquet 346824267 341136931 1.02
clickbench_q13/datafusion:parquet 478281498 492000553 0.97
clickbench_q14/datafusion:parquet 343929062 339510288 1.01
clickbench_q15/datafusion:parquet 331574109 331536250 1.00
clickbench_q16/datafusion:parquet 651751978 652177051 1.00
clickbench_q17/datafusion:parquet 637850675 633858210 1.01
clickbench_q18/datafusion:parquet 1319485483 1288573536 1.02
clickbench_q19/datafusion:parquet 28658889 28573168 1.00
clickbench_q20/datafusion:parquet 609326559 609551176 1.00
clickbench_q21/datafusion:parquet 673461048 668720316 1.01
clickbench_q22/datafusion:parquet 981766783 976252189 1.01
clickbench_q23/datafusion:parquet 3756334361 3722641217 1.01
clickbench_q24/datafusion:parquet 84905290 84958280 1.00
clickbench_q25/datafusion:parquet 135286849 137012007 0.99
clickbench_q26/datafusion:parquet 85063119 84259075 1.01
clickbench_q27/datafusion:parquet 1035990428 1036836765 1.00
clickbench_q28/datafusion:parquet 6554114750 6530685288 1.00
clickbench_q29/datafusion:parquet 245615629 237868952 1.03
clickbench_q30/datafusion:parquet 327836586 326048514 1.01
clickbench_q31/datafusion:parquet 361299798 363398692 0.99
clickbench_q32/datafusion:parquet 1206351825 1249772864 0.97
clickbench_q33/datafusion:parquet 1469383403 1450310253 1.01
clickbench_q34/datafusion:parquet 1464290632 1479616719 0.99
clickbench_q35/datafusion:parquet 478481719 475435205 1.01
clickbench_q36/datafusion:parquet 140577660 140989183 1.00
clickbench_q37/datafusion:parquet 56655872 57195720 0.99
clickbench_q38/datafusion:parquet 85964551 82523096 1.04
clickbench_q39/datafusion:parquet 258184276 254997020 1.01
clickbench_q40/datafusion:parquet 30840219 29608988 1.04
clickbench_q41/datafusion:parquet 26460744 26949556 0.98
clickbench_q42/datafusion:parquet 28835986 28422805 1.01
duckdb / vortex-file-compressed (1.064x ➖, 4↑ 20↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 7040955 6092707 1.16
clickbench_q01/duckdb:vortex-file-compressed 🚨 16126164 13815068 1.17
clickbench_q02/duckdb:vortex-file-compressed 🚨 33030426 25958447 1.27
clickbench_q03/duckdb:vortex-file-compressed 🚨 37501539 29132809 1.29
clickbench_q04/duckdb:vortex-file-compressed 🚨 230854414 177834390 1.30
clickbench_q05/duckdb:vortex-file-compressed 🚨 223020492 175917831 1.27
clickbench_q06/duckdb:vortex-file-compressed 🚨 22229433 18715985 1.19
clickbench_q07/duckdb:vortex-file-compressed 🚨 17908529 15134789 1.18
clickbench_q08/duckdb:vortex-file-compressed 🚨 310995818 253554990 1.23
clickbench_q09/duckdb:vortex-file-compressed 🚨 400711160 330120281 1.21
clickbench_q10/duckdb:vortex-file-compressed 🚨 81595664 66506412 1.23
clickbench_q11/duckdb:vortex-file-compressed 🚨 90969855 76236970 1.19
clickbench_q12/duckdb:vortex-file-compressed 🚨 225909843 199979030 1.13
clickbench_q13/duckdb:vortex-file-compressed 🚨 463596339 389910722 1.19
clickbench_q14/duckdb:vortex-file-compressed 🚨 265299548 229809364 1.15
clickbench_q15/duckdb:vortex-file-compressed 🚨 271299802 233024447 1.16
clickbench_q16/duckdb:vortex-file-compressed 🚨 644541959 562694129 1.15
clickbench_q17/duckdb:vortex-file-compressed 🚨 503952365 456305837 1.10
clickbench_q18/duckdb:vortex-file-compressed 1047518312 958474118 1.09
clickbench_q19/duckdb:vortex-file-compressed 🚨 23667642 20872013 1.13
clickbench_q20/duckdb:vortex-file-compressed 355667518 347674640 1.02
clickbench_q21/duckdb:vortex-file-compressed 379395493 367360672 1.03
clickbench_q22/duckdb:vortex-file-compressed 523476952 580819127 0.90
clickbench_q23/duckdb:vortex-file-compressed 🚨 746335663 659651978 1.13
clickbench_q24/duckdb:vortex-file-compressed 41358980 42858500 0.97
clickbench_q25/duckdb:vortex-file-compressed 70101677 72924674 0.96
clickbench_q26/duckdb:vortex-file-compressed 🚀 44027531 52390969 0.84
clickbench_q27/duckdb:vortex-file-compressed 465586931 468569991 0.99
clickbench_q28/duckdb:vortex-file-compressed 2955991385 2950208608 1.00
clickbench_q29/duckdb:vortex-file-compressed 28268851 30483169 0.93
clickbench_q30/duckdb:vortex-file-compressed 188131031 190107774 0.99
clickbench_q31/duckdb:vortex-file-compressed 274247318 274619420 1.00
clickbench_q32/duckdb:vortex-file-compressed 1232204064 1214613634 1.01
clickbench_q33/duckdb:vortex-file-compressed 1202214405 1159112508 1.04
clickbench_q34/duckdb:vortex-file-compressed 1324311981 1214662284 1.09
clickbench_q35/duckdb:vortex-file-compressed 384661152 376204045 1.02
clickbench_q36/duckdb:vortex-file-compressed 🚀 28168893 32504956 0.87
clickbench_q37/duckdb:vortex-file-compressed 🚀 21506617 25144515 0.86
clickbench_q38/duckdb:vortex-file-compressed 23620084 25837458 0.91
clickbench_q39/duckdb:vortex-file-compressed 45327934 45174951 1.00
clickbench_q40/duckdb:vortex-file-compressed 🚀 21091030 25094975 0.84
clickbench_q41/duckdb:vortex-file-compressed 22211054 23263805 0.95
clickbench_q42/duckdb:vortex-file-compressed 22600208 24484309 0.92
duckdb / parquet (1.034x ➖, 0↑ 9↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 26263211 28552013 0.92
clickbench_q01/duckdb:parquet 26890679 28397639 0.95
clickbench_q02/duckdb:parquet 47849067 48188371 0.99
clickbench_q03/duckdb:parquet 38291061 37707653 1.02
clickbench_q04/duckdb:parquet 201346100 201983096 1.00
clickbench_q05/duckdb:parquet 263324009 259996373 1.01
clickbench_q06/duckdb:parquet 45382558 45639690 0.99
clickbench_q07/duckdb:parquet 28952522 29351985 0.99
clickbench_q08/duckdb:parquet 261896503 265510481 0.99
clickbench_q09/duckdb:parquet 392444062 393813738 1.00
clickbench_q10/duckdb:parquet 80561934 80960270 1.00
clickbench_q11/duckdb:parquet 97544321 97982786 1.00
clickbench_q12/duckdb:parquet 288590318 287135837 1.01
clickbench_q13/duckdb:parquet 474077212 473601141 1.00
clickbench_q14/duckdb:parquet 321726589 323978007 0.99
clickbench_q15/duckdb:parquet 256903125 257315795 1.00
clickbench_q16/duckdb:parquet 647244105 642736251 1.01
clickbench_q17/duckdb:parquet 540450667 538298099 1.00
clickbench_q18/duckdb:parquet 1065403389 1055346444 1.01
clickbench_q19/duckdb:parquet 25246733 25142261 1.00
clickbench_q20/duckdb:parquet 416827117 418157160 1.00
clickbench_q21/duckdb:parquet 543570870 548094227 0.99
clickbench_q22/duckdb:parquet 941598498 930796346 1.01
clickbench_q23/duckdb:parquet 306062306 310341104 0.99
clickbench_q24/duckdb:parquet 69579623 67372368 1.03
clickbench_q25/duckdb:parquet 156266682 156094117 1.00
clickbench_q26/duckdb:parquet 51999727 53131313 0.98
clickbench_q27/duckdb:parquet 638120199 638552840 1.00
clickbench_q28/duckdb:parquet 4813240864 4830006358 1.00
clickbench_q29/duckdb:parquet 40222680 41170413 0.98
clickbench_q30/duckdb:parquet 301782905 299451354 1.01
clickbench_q31/duckdb:parquet 360860773 356452318 1.01
clickbench_q32/duckdb:parquet 1214084356 1156891468 1.05
clickbench_q33/duckdb:parquet 🚨 1393699822 1244531076 1.12
clickbench_q34/duckdb:parquet 🚨 1669141137 1297279182 1.29
clickbench_q35/duckdb:parquet 🚨 409798415 362949878 1.13
clickbench_q36/duckdb:parquet 🚨 53670032 45097355 1.19
clickbench_q37/duckdb:parquet 🚨 35856608 31704564 1.13
clickbench_q38/duckdb:parquet 35934828 34129518 1.05
clickbench_q39/duckdb:parquet 🚨 88694036 79595824 1.11
clickbench_q40/duckdb:parquet 🚨 22326942 16784787 1.33
clickbench_q41/duckdb:parquet 🚨 21692495 17450361 1.24
clickbench_q42/duckdb:parquet 🚨 24482413 21892379 1.12
duckdb / duckdb (1.022x ➖, 1↑ 6↓)
name PR 0bec75e (ns) base b213af1 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17054628 17553084 0.97
clickbench_q01/duckdb:duckdb 31993732 33098086 0.97
clickbench_q02/duckdb:duckdb 44769704 44668384 1.00
clickbench_q03/duckdb:duckdb 46767754 47272839 0.99
clickbench_q04/duckdb:duckdb 189917710 195851019 0.97
clickbench_q05/duckdb:duckdb 263392314 261808377 1.01
clickbench_q06/duckdb:duckdb 29010566 28143185 1.03
clickbench_q07/duckdb:duckdb 35005692 35581767 0.98
clickbench_q08/duckdb:duckdb 249095737 244512876 1.02
clickbench_q09/duckdb:duckdb 367198078 366562093 1.00
clickbench_q10/duckdb:duckdb 98072308 96850050 1.01
clickbench_q11/duckdb:duckdb 106704966 105727429 1.01
clickbench_q12/duckdb:duckdb 235412502 238876966 0.99
clickbench_q13/duckdb:duckdb 476992527 473718307 1.01
clickbench_q14/duckdb:duckdb 277265027 278809715 0.99
clickbench_q15/duckdb:duckdb 218526156 218138717 1.00
clickbench_q16/duckdb:duckdb 665124695 658450719 1.01
clickbench_q17/duckdb:duckdb 565027505 575387066 0.98
clickbench_q18/duckdb:duckdb 1222048735 1263864732 0.97
clickbench_q19/duckdb:duckdb 34405068 34345563 1.00
clickbench_q20/duckdb:duckdb 965295947 1035698362 0.93
clickbench_q21/duckdb:duckdb 1022019999 1056261192 0.97
clickbench_q22/duckdb:duckdb 1149569765 1183275017 0.97
clickbench_q23/duckdb:duckdb 252805963 254294929 0.99
clickbench_q24/duckdb:duckdb 61107942 61159241 1.00
clickbench_q25/duckdb:duckdb 142630485 141790655 1.01
clickbench_q26/duckdb:duckdb 59722050 56062756 1.07
clickbench_q27/duckdb:duckdb 🚀 1077963990 1232515316 0.87
clickbench_q28/duckdb:duckdb 4649074485 4630798984 1.00
clickbench_q29/duckdb:duckdb 47964126 47654190 1.01
clickbench_q30/duckdb:duckdb 257731993 261799846 0.98
clickbench_q31/duckdb:duckdb 406055853 406889098 1.00
clickbench_q32/duckdb:duckdb 1563930789 1609210337 0.97
clickbench_q33/duckdb:duckdb 🚨 2608901038 2122578534 1.23
clickbench_q34/duckdb:duckdb 🚨 2772814356 2243406218 1.24
clickbench_q35/duckdb:duckdb 🚨 334686790 280677543 1.19
clickbench_q36/duckdb:duckdb 45079807 41675939 1.08
clickbench_q37/duckdb:duckdb 🚨 33325376 29545861 1.13
clickbench_q38/duckdb:duckdb 34970831 32208766 1.09
clickbench_q39/duckdb:duckdb 🚨 75022782 65740012 1.14
clickbench_q40/duckdb:duckdb 34631787 31534186 1.10
clickbench_q41/duckdb:duckdb 33823287 31417277 1.08
clickbench_q42/duckdb:duckdb 🚨 34260513 31014244 1.10
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -0.7% -1.2% +0.6% +744.9% ➖ noise
0 duckdb:duckdb -2.8% -1.2% -1.6% +280.9% ➖ noise
0 duckdb:vortex-file-compressed +15.6% -1.2% +17.0% +482.1% ➖ noise
1 datafusion:vortex-file-compressed +2.9% -1.9% +5.0% +23.1% ➖ noise
1 duckdb:duckdb -3.3% -1.9% -1.4% +50.2% ➖ noise
1 duckdb:vortex-file-compressed +16.7% -1.9% +19.0% +23.7% ➖ noise
2 datafusion:vortex-file-compressed +2.5% -3.2% +5.9% +15.5% ➖ noise
2 duckdb:duckdb +0.2% -3.2% +3.6% +15.7% ➖ noise
2 duckdb:vortex-file-compressed +27.2% -3.2% +31.5% +11.8% 🚨 regression
3 datafusion:vortex-file-compressed +5.4% -0.2% +5.6% +169.6% ➖ noise
3 duckdb:duckdb -1.1% -0.2% -0.9% +30.9% ➖ noise
3 duckdb:vortex-file-compressed +28.7% -0.2% +29.0% +115.4% ➖ noise
4 datafusion:vortex-file-compressed +1.1% -0.9% +2.0% +10.9% ➖ noise
4 duckdb:duckdb -3.0% -0.9% -2.1% +10.9% ➖ noise
4 duckdb:vortex-file-compressed +29.8% -0.9% +31.0% +10.9% 🚨 regression
5 datafusion:vortex-file-compressed -0.2% +2.1% -2.3% +10.9% ➖ noise
5 duckdb:duckdb +0.6% +2.1% -1.5% +10.9% ➖ noise
5 duckdb:vortex-file-compressed +26.8% +2.1% +24.1% +11.8% 🚨 regression
6 datafusion:vortex-file-compressed +3.1% -0.9% +4.0% +83.5% ➖ noise
6 duckdb:duckdb +3.1% -0.9% +4.0% +28.8% ➖ noise
6 duckdb:vortex-file-compressed +18.8% -0.9% +19.8% +16.2% 🚨 regression
7 datafusion:vortex-file-compressed -1.8% +2.4% -4.1% +10.9% ➖ noise
7 duckdb:duckdb -1.6% +2.4% -3.9% +10.9% ➖ noise
7 duckdb:vortex-file-compressed +18.3% +2.4% +15.6% +24.5% ➖ noise
8 datafusion:vortex-file-compressed +1.3% -0.8% +2.2% +10.9% ➖ noise
8 duckdb:duckdb +1.9% -0.8% +2.7% +10.9% ➖ noise
8 duckdb:vortex-file-compressed +22.7% -0.8% +23.7% +10.9% 🚨 regression
9 datafusion:vortex-file-compressed -3.0% -0.6% -2.5% +10.9% ➖ noise
9 duckdb:duckdb +0.2% -0.6% +0.8% +10.9% ➖ noise
9 duckdb:vortex-file-compressed +21.4% -0.6% +22.1% +10.9% 🚨 regression
10 datafusion:vortex-file-compressed +2.1% +1.5% +0.6% +10.9% ➖ noise
10 duckdb:duckdb +1.3% +1.5% -0.2% +10.9% ➖ noise
10 duckdb:vortex-file-compressed +22.7% +1.5% +20.9% +10.9% 🚨 regression
11 datafusion:vortex-file-compressed -4.3% -0.5% -3.8% +10.9% ➖ noise
11 duckdb:duckdb +0.9% -0.5% +1.4% +10.9% ➖ noise
11 duckdb:vortex-file-compressed +19.3% -0.5% +19.9% +10.9% 🚨 regression
12 datafusion:vortex-file-compressed -0.2% +1.1% -1.3% +10.9% ➖ noise
12 duckdb:duckdb -1.5% +1.1% -2.5% +10.9% ➖ noise
12 duckdb:vortex-file-compressed +13.0% +1.1% +11.8% +10.9% 🚨 regression
13 datafusion:vortex-file-compressed +0.5% -1.4% +1.9% +10.9% ➖ noise
13 duckdb:duckdb +0.7% -1.4% +2.1% +10.9% ➖ noise
13 duckdb:vortex-file-compressed +18.9% -1.4% +20.5% +10.9% 🚨 regression
14 datafusion:vortex-file-compressed +0.7% +0.3% +0.4% +10.9% ➖ noise
14 duckdb:duckdb -0.6% +0.3% -0.8% +10.9% ➖ noise
14 duckdb:vortex-file-compressed +15.4% +0.3% +15.1% +10.9% 🚨 regression
15 datafusion:vortex-file-compressed +0.8% -0.1% +0.8% +10.9% ➖ noise
15 duckdb:duckdb +0.2% -0.1% +0.3% +10.9% ➖ noise
15 duckdb:vortex-file-compressed +16.4% -0.1% +16.5% +10.9% 🚨 regression
16 datafusion:vortex-file-compressed -1.3% +0.3% -1.6% +10.9% ➖ noise
16 duckdb:duckdb +1.0% +0.3% +0.7% +10.9% ➖ noise
16 duckdb:vortex-file-compressed +14.5% +0.3% +14.2% +10.9% 🚨 regression
17 datafusion:vortex-file-compressed -1.2% +0.5% -1.7% +10.9% ➖ noise
17 duckdb:duckdb -1.8% +0.5% -2.3% +10.9% ➖ noise
17 duckdb:vortex-file-compressed +10.4% +0.5% +9.9% +10.9% ➖ noise
18 datafusion:vortex-file-compressed +2.1% +1.7% +0.5% +10.9% ➖ noise
18 duckdb:duckdb -3.3% +1.7% -4.9% +10.9% ➖ noise
18 duckdb:vortex-file-compressed +9.3% +1.7% +7.5% +10.9% ➖ noise
19 datafusion:vortex-file-compressed -5.5% +0.4% -5.8% +33.1% ➖ noise
19 duckdb:duckdb +0.2% +0.4% -0.2% +16.7% ➖ noise
19 duckdb:vortex-file-compressed +13.4% +0.4% +13.0% +18.9% ➖ noise
20 datafusion:vortex-file-compressed +0.1% -0.2% +0.3% +211.4% ➖ noise
20 duckdb:duckdb -6.8% -0.2% -6.6% +18.3% ➖ noise
20 duckdb:vortex-file-compressed +2.3% -0.2% +2.5% +107.9% ➖ noise
21 datafusion:vortex-file-compressed -1.0% -0.1% -0.9% +10.9% ➖ noise
21 duckdb:duckdb -3.2% -0.1% -3.2% +10.9% ➖ noise
21 duckdb:vortex-file-compressed +3.3% -0.1% +3.3% +10.9% ➖ noise
22 datafusion:vortex-file-compressed +0.1% +0.9% -0.8% +15.3% ➖ noise
22 duckdb:duckdb -2.8% +0.9% -3.7% +11.3% ➖ noise
22 duckdb:vortex-file-compressed -9.9% +0.9% -10.6% +21.1% ➖ noise
23 datafusion:vortex-file-compressed +0.8% -0.2% +1.0% +52.2% ➖ noise
23 duckdb:duckdb -0.6% -0.2% -0.3% +10.9% ➖ noise
23 duckdb:vortex-file-compressed +13.1% -0.2% +13.4% +67.4% ➖ noise
24 datafusion:vortex-file-compressed -2.3% +1.6% -3.8% +10.9% ➖ noise
24 duckdb:duckdb -0.1% +1.6% -1.7% +10.9% ➖ noise
24 duckdb:vortex-file-compressed -3.5% +1.6% -5.0% +23.8% ➖ noise
25 datafusion:vortex-file-compressed +1.7% -0.6% +2.3% +10.9% ➖ noise
25 duckdb:duckdb +0.6% -0.6% +1.2% +10.9% ➖ noise
25 duckdb:vortex-file-compressed -3.9% -0.6% -3.3% +16.3% ➖ noise
26 datafusion:vortex-file-compressed -0.3% -0.6% +0.3% +10.9% ➖ noise
26 duckdb:duckdb +6.5% -0.6% +7.2% +14.4% ➖ noise
26 duckdb:vortex-file-compressed -16.0% -0.6% -15.5% +18.6% ➖ noise
27 datafusion:vortex-file-compressed +0.9% -0.1% +1.0% +10.9% ➖ noise
27 duckdb:duckdb -12.5% -0.1% -12.5% +11.2% ✅ faster
27 duckdb:vortex-file-compressed -0.6% -0.1% -0.6% +10.9% ➖ noise
28 datafusion:vortex-file-compressed +0.6% +0.0% +0.6% +10.9% ➖ noise
28 duckdb:duckdb +0.4% +0.0% +0.4% +10.9% ➖ noise
28 duckdb:vortex-file-compressed +0.2% +0.0% +0.2% +10.9% ➖ noise
29 datafusion:vortex-file-compressed -3.4% +0.4% -3.9% +10.9% ➖ noise
29 duckdb:duckdb +0.7% +0.4% +0.2% +10.9% ➖ noise
29 duckdb:vortex-file-compressed -7.3% +0.4% -7.7% +13.7% ➖ noise
30 datafusion:vortex-file-compressed +0.6% +0.7% -0.1% +10.9% ➖ noise
30 duckdb:duckdb -1.6% +0.7% -2.2% +10.9% ➖ noise
30 duckdb:vortex-file-compressed -1.0% +0.7% -1.7% +10.9% ➖ noise
31 datafusion:vortex-file-compressed +0.2% +0.3% -0.1% +10.9% ➖ noise
31 duckdb:duckdb -0.2% +0.3% -0.5% +10.9% ➖ noise
31 duckdb:vortex-file-compressed -0.1% +0.3% -0.5% +10.9% ➖ noise
32 datafusion:vortex-file-compressed -0.4% +0.6% -1.0% +10.9% ➖ noise
32 duckdb:duckdb -2.8% +0.6% -3.4% +10.9% ➖ noise
32 duckdb:vortex-file-compressed +1.4% +0.6% +0.8% +10.9% ➖ noise
33 datafusion:vortex-file-compressed -0.4% +6.5% -6.5% +10.9% ➖ noise
33 duckdb:duckdb +22.9% +6.5% +15.4% +10.9% 🚨 regression
33 duckdb:vortex-file-compressed +3.7% +6.5% -2.6% +10.9% ➖ noise
34 datafusion:vortex-file-compressed +1.0% +12.8% -10.5% +10.9% ✅ faster
34 duckdb:duckdb +23.6% +12.8% +9.5% +10.9% ➖ noise
34 duckdb:vortex-file-compressed +9.0% +12.8% -3.4% +10.9% ➖ noise
35 datafusion:vortex-file-compressed -1.4% +6.6% -7.5% +10.9% ➖ noise
35 duckdb:duckdb +19.2% +6.6% +11.9% +10.9% 🚨 regression
35 duckdb:vortex-file-compressed +2.2% +6.6% -4.1% +10.9% ➖ noise
36 datafusion:vortex-file-compressed +2.2% +8.9% -6.2% +10.9% ➖ noise
36 duckdb:duckdb +8.2% +8.9% -0.7% +12.2% ➖ noise
36 duckdb:vortex-file-compressed -13.3% +8.9% -20.4% +12.4% ✅ faster
37 datafusion:vortex-file-compressed +0.7% +5.8% -4.9% +10.9% ➖ noise
37 duckdb:duckdb +12.8% +5.8% +6.6% +10.9% ➖ noise
37 duckdb:vortex-file-compressed -14.5% +5.8% -19.2% +10.9% ✅ faster
38 datafusion:vortex-file-compressed +0.9% +4.7% -3.7% +11.7% ➖ noise
38 duckdb:duckdb +8.6% +4.7% +3.7% +10.9% ➖ noise
38 duckdb:vortex-file-compressed -8.6% +4.7% -12.7% +10.9% ✅ faster
39 datafusion:vortex-file-compressed -1.1% +6.2% -6.9% +11.1% ➖ noise
39 duckdb:duckdb +14.1% +6.2% +7.4% +10.9% ➖ noise
39 duckdb:vortex-file-compressed +0.3% +6.2% -5.5% +14.4% ➖ noise
40 datafusion:vortex-file-compressed -2.0% +17.7% -16.7% +10.9% ✅ faster
40 duckdb:duckdb +9.8% +17.7% -6.7% +10.9% ➖ noise
40 duckdb:vortex-file-compressed -16.0% +17.7% -28.6% +10.9% ✅ faster
41 datafusion:vortex-file-compressed +3.8% +10.5% -6.0% +10.9% ➖ noise
41 duckdb:duckdb +7.7% +10.5% -2.6% +10.9% ➖ noise
41 duckdb:vortex-file-compressed -4.5% +10.5% -13.6% +10.9% ✅ faster
42 datafusion:vortex-file-compressed +0.8% +6.5% -5.4% +10.9% ➖ noise
42 duckdb:duckdb +10.5% +6.5% +3.7% +10.9% ➖ noise
42 duckdb:vortex-file-compressed -7.7% +6.5% -13.3% +10.9% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.001x ➖
Parquet (geomean): 1.004x ➖


unknown / unknown (1.006x ➖, 0↑ 4↓)
name PR 0bec75e (ns) base be2a14b (ns) ratio (PR/base)
compress time/Arade 1112372187 1136871403 0.98
compress time/Bimbo 6719899555 6680237101 1.01
compress time/CMSprovider 2909104872 2943302333 0.99
compress time/Euro2016 1539529584 1533438909 1.00
compress time/Food 402611460 385054789 1.05
compress time/HashTags 1805612838 1817364893 0.99
compress time/TPC-H l_comment canonical 1613144918 1608693349 1.00
compress time/TPC-H l_comment chunked 1609885195 1614818334 1.00
compress time/taxi 802080439 802696495 1.00
compress time/wide table cols=100 chunks=1 rows=1000 16816416 17786093 0.95
compress time/wide table cols=100 chunks=50 rows=1000 18909968 17743282 1.07
compress time/wide table cols=1000 chunks=1 rows=1000 184374283 186090376 0.99
compress time/wide table cols=1000 chunks=50 rows=1000 179021998 189616721 0.94
compress time/wide table cols=10000 chunks=1 rows=1000 1969262747 1987766066 0.99
compress time/wide table cols=10000 chunks=50 rows=1000 1972621468 1991353060 0.99
decompress time/Arade 🚨 31856788 27296596 1.17
decompress time/Bimbo 92260991 94217159 0.98
decompress time/CMSprovider 84711348 81570011 1.04
decompress time/Euro2016 19291265 19572506 0.99
decompress time/Food 9861391 9478017 1.04
decompress time/HashTags 74356754 72283716 1.03
decompress time/TPC-H l_comment canonical 39632278 39592591 1.00
decompress time/TPC-H l_comment chunked 39456875 39440037 1.00
decompress time/taxi 15973916 16729697 0.95
decompress time/wide table cols=100 chunks=1 rows=1000 2594761 2484814 1.04
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 2830583 2554044 1.11
decompress time/wide table cols=1000 chunks=1 rows=1000 24299611 23624183 1.03
decompress time/wide table cols=1000 chunks=50 rows=1000 24601323 23507522 1.05
decompress time/wide table cols=10000 chunks=1 rows=1000 268687043 255751054 1.05
decompress time/wide table cols=10000 chunks=50 rows=1000 260921554 261863581 1.00
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2859791598 2853485350 1.00
parquet_rs-zstd compress time/Bimbo 14597229909 14621629827 1.00
parquet_rs-zstd compress time/CMSprovider 7284606834 7300190657 1.00
parquet_rs-zstd compress time/Euro2016 1339808342 1330601718 1.01
parquet_rs-zstd compress time/Food 852888404 854884452 1.00
parquet_rs-zstd compress time/HashTags 2294167793 2244818232 1.02
parquet_rs-zstd compress time/TPC-H l_comment canonical 3060270393 3058308891 1.00
parquet_rs-zstd compress time/TPC-H l_comment chunked 3066530601 3101453453 0.99
parquet_rs-zstd compress time/taxi 1345551915 1339782273 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6671145 6487214 1.03
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 7150215 6417788 1.11
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 82309370 78798093 1.04
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 81523985 78803216 1.03
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 868867263 860663096 1.01
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 877784160 909116038 0.97
parquet_rs-zstd decompress time/Arade 635409256 632927799 1.00
parquet_rs-zstd decompress time/Bimbo 1689023826 1704981707 0.99
parquet_rs-zstd decompress time/CMSprovider 1932088735 1919917450 1.01
parquet_rs-zstd decompress time/Euro2016 381703780 379195869 1.01
parquet_rs-zstd decompress time/Food 217315362 214574743 1.01
parquet_rs-zstd decompress time/HashTags 626760811 611554594 1.02
parquet_rs-zstd decompress time/TPC-H l_comment canonical 553106489 562830045 0.98
parquet_rs-zstd decompress time/TPC-H l_comment chunked 554483662 566866769 0.98
parquet_rs-zstd decompress time/taxi 243876008 245323968 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2732557 2737867 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2750545 2652418 1.04
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31411775 30693397 1.02
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 31771248 30972128 1.03
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 341729188 331941235 1.03
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 339081127 341182769 0.99
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163394924 163599156 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.98
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.99
vortex:parquet-zstd ratio compress time/Euro2016 1 1 1.00
vortex:parquet-zstd ratio compress time/Food 0 0 1.05
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.97
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio compress time/taxi 0 0 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 0.92
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 0.96
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 2 2 0.95
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 2 2 0.91
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 2 2 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 2 2 1.03
vortex:parquet-zstd ratio decompress time/Arade 🚨 0 0 1.16
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio decompress time/Food 0 0 1.03
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.00
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 0 1.07
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@joseph-isaacs joseph-isaacs merged commit 6d4a7f8 into develop Apr 20, 2026
72 of 74 checks passed
@joseph-isaacs joseph-isaacs deleted the ji/arrow-execute branch April 20, 2026 20:16
@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.7%
Vortex (geomean): 0.973x ➖
Parquet (geomean): 0.930x ➖
Shifts: Parquet (control) -7.0% · Median polish -5.0%


datafusion / vortex-file-compressed (0.954x ➖, 0↑ 1↓)
name PR 0bec75e (ns) base dccfb24 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 663594308 685868889 0.97
tpch_q02/datafusion:vortex-file-compressed 628534708 749726254 0.84
tpch_q03/datafusion:vortex-file-compressed 864084864 948274382 0.91
tpch_q04/datafusion:vortex-file-compressed 640550377 709235869 0.90
tpch_q05/datafusion:vortex-file-compressed 1059558611 1069120906 0.99
tpch_q06/datafusion:vortex-file-compressed 633545010 662318233 0.96
tpch_q07/datafusion:vortex-file-compressed 1069167706 1057690617 1.01
tpch_q08/datafusion:vortex-file-compressed 1451361258 1247940046 1.16
tpch_q09/datafusion:vortex-file-compressed 1329041015 1427976667 0.93
tpch_q10/datafusion:vortex-file-compressed 1041461263 1214442470 0.86
tpch_q11/datafusion:vortex-file-compressed 465708313 581555362 0.80
tpch_q12/datafusion:vortex-file-compressed 881397896 1038556362 0.85
tpch_q13/datafusion:vortex-file-compressed 425198630 468424576 0.91
tpch_q14/datafusion:vortex-file-compressed 568442286 625011281 0.91
tpch_q15/datafusion:vortex-file-compressed 1161506518 1170581571 0.99
tpch_q16/datafusion:vortex-file-compressed 357859165 405215228 0.88
tpch_q17/datafusion:vortex-file-compressed 1089553056 1153516731 0.94
tpch_q18/datafusion:vortex-file-compressed 1329391573 1512350062 0.88
tpch_q19/datafusion:vortex-file-compressed 849291435 901203414 0.94
tpch_q20/datafusion:vortex-file-compressed 1129454868 1088533848 1.04
tpch_q21/datafusion:vortex-file-compressed 1765030657 1577352054 1.12
tpch_q22/datafusion:vortex-file-compressed 🚨 744263728 560352882 1.33
datafusion / vortex-compact (0.977x ➖, 1↑ 2↓)
name PR 0bec75e (ns) base dccfb24 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 674406507 688437256 0.98
tpch_q02/datafusion:vortex-compact 609980630 701186883 0.87
tpch_q03/datafusion:vortex-compact 736324965 712888142 1.03
tpch_q04/datafusion:vortex-compact 524939735 589309446 0.89
tpch_q05/datafusion:vortex-compact 831375376 958897377 0.87
tpch_q06/datafusion:vortex-compact 562103386 612207869 0.92
tpch_q07/datafusion:vortex-compact 1031212192 984880597 1.05
tpch_q08/datafusion:vortex-compact 1018995488 1053089703 0.97
tpch_q09/datafusion:vortex-compact 1159473829 1642315230 0.71
tpch_q10/datafusion:vortex-compact 834180920 900433404 0.93
tpch_q11/datafusion:vortex-compact 386051427 448138572 0.86
tpch_q12/datafusion:vortex-compact 🚨 1690956448 1040582419 1.63
tpch_q13/datafusion:vortex-compact 522451927 407014541 1.28
tpch_q14/datafusion:vortex-compact 🚨 937014614 678129809 1.38
tpch_q15/datafusion:vortex-compact 1268797580 1163812097 1.09
tpch_q16/datafusion:vortex-compact 393831741 320956388 1.23
tpch_q17/datafusion:vortex-compact 1111143819 1202929955 0.92
tpch_q18/datafusion:vortex-compact 1094784241 1103263680 0.99
tpch_q19/datafusion:vortex-compact 785119375 801945317 0.98
tpch_q20/datafusion:vortex-compact 994085162 1048515697 0.95
tpch_q21/datafusion:vortex-compact 1378709174 1571467503 0.88
tpch_q22/datafusion:vortex-compact 🚀 355205445 610472632 0.58
datafusion / parquet (0.915x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base dccfb24 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 659382293 716728620 0.92
tpch_q02/datafusion:parquet 783850381 1071332421 0.73
tpch_q03/datafusion:parquet 883268514 968916277 0.91
tpch_q04/datafusion:parquet 496083501 458843767 1.08
tpch_q05/datafusion:parquet 1107244086 1389548921 0.80
tpch_q06/datafusion:parquet 510893417 506575550 1.01
tpch_q07/datafusion:parquet 1236537551 1410595485 0.88
tpch_q08/datafusion:parquet 1611506299 1754676210 0.92
tpch_q09/datafusion:parquet 1730077264 1802074415 0.96
tpch_q10/datafusion:parquet 1993519752 2002706269 1.00
tpch_q11/datafusion:parquet 568621996 543487689 1.05
tpch_q12/datafusion:parquet 592113772 643842698 0.92
tpch_q13/datafusion:parquet 665195618 793862103 0.84
tpch_q14/datafusion:parquet 762546478 884616923 0.86
tpch_q15/datafusion:parquet 1144118746 1232652073 0.93
tpch_q16/datafusion:parquet 393457098 420783194 0.94
tpch_q17/datafusion:parquet 1323573226 1342268937 0.99
tpch_q18/datafusion:parquet 1348264530 1522273557 0.89
tpch_q19/datafusion:parquet 924289028 1268835583 0.73
tpch_q20/datafusion:parquet 1085074818 1140122656 0.95
tpch_q21/datafusion:parquet 1655130872 1740641462 0.95
tpch_q22/datafusion:parquet 755437201 756139353 1.00
duckdb / vortex-file-compressed (0.986x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base dccfb24 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 597144783 633518326 0.94
tpch_q02/duckdb:vortex-file-compressed 1141294497 1280294309 0.89
tpch_q03/duckdb:vortex-file-compressed 890349267 912910588 0.98
tpch_q04/duckdb:vortex-file-compressed 640918294 639044779 1.00
tpch_q05/duckdb:vortex-file-compressed 1040631643 1171975673 0.89
tpch_q06/duckdb:vortex-file-compressed 826595947 800654078 1.03
tpch_q07/duckdb:vortex-file-compressed 1198638815 1213509497 0.99
tpch_q08/duckdb:vortex-file-compressed 1469336670 1363115050 1.08
tpch_q09/duckdb:vortex-file-compressed 1310509043 1407022358 0.93
tpch_q10/duckdb:vortex-file-compressed 1070523709 1123480861 0.95
tpch_q11/duckdb:vortex-file-compressed 730461461 669807026 1.09
tpch_q12/duckdb:vortex-file-compressed 706828248 695774206 1.02
tpch_q13/duckdb:vortex-file-compressed 961169721 920956855 1.04
tpch_q14/duckdb:vortex-file-compressed 842750288 818691405 1.03
tpch_q15/duckdb:vortex-file-compressed 519859671 547581323 0.95
tpch_q16/duckdb:vortex-file-compressed 496326184 449309280 1.10
tpch_q17/duckdb:vortex-file-compressed 961189282 980969634 0.98
tpch_q18/duckdb:vortex-file-compressed 922668882 948517051 0.97
tpch_q19/duckdb:vortex-file-compressed 706910087 764618265 0.92
tpch_q20/duckdb:vortex-file-compressed 1231412646 1245807745 0.99
tpch_q21/duckdb:vortex-file-compressed 1990197196 1907484137 1.04
tpch_q22/duckdb:vortex-file-compressed 589330294 645385709 0.91
duckdb / vortex-compact (0.976x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base dccfb24 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 568547186 598571904 0.95
tpch_q02/duckdb:vortex-compact 1024602369 1054180895 0.97
tpch_q03/duckdb:vortex-compact 789350271 965772990 0.82
tpch_q04/duckdb:vortex-compact 489063541 482158756 1.01
tpch_q05/duckdb:vortex-compact 992253631 967223597 1.03
tpch_q06/duckdb:vortex-compact 699377724 722854552 0.97
tpch_q07/duckdb:vortex-compact 1048164604 1051004324 1.00
tpch_q08/duckdb:vortex-compact 1288457429 1357576191 0.95
tpch_q09/duckdb:vortex-compact 1346383604 1337686463 1.01
tpch_q10/duckdb:vortex-compact 1036132507 1035695677 1.00
tpch_q11/duckdb:vortex-compact 665159874 674300152 0.99
tpch_q12/duckdb:vortex-compact 671228002 650643105 1.03
tpch_q13/duckdb:vortex-compact 824936962 848932853 0.97
tpch_q14/duckdb:vortex-compact 807736186 799838000 1.01
tpch_q15/duckdb:vortex-compact 528237872 534676633 0.99
tpch_q16/duckdb:vortex-compact 463588864 455403230 1.02
tpch_q17/duckdb:vortex-compact 882220022 944882354 0.93
tpch_q18/duckdb:vortex-compact 748246126 805342639 0.93
tpch_q19/duckdb:vortex-compact 703503537 735238335 0.96
tpch_q20/duckdb:vortex-compact 1194940766 1127997251 1.06
tpch_q21/duckdb:vortex-compact 1641438782 1696874708 0.97
tpch_q22/duckdb:vortex-compact 594293903 623652189 0.95
duckdb / parquet (0.945x ➖, 0↑ 0↓)
name PR 0bec75e (ns) base dccfb24 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 789147938 772645292 1.02
tpch_q02/duckdb:parquet 1464302024 1581896631 0.93
tpch_q03/duckdb:parquet 1644105844 1517646101 1.08
tpch_q04/duckdb:parquet 959753140 1086883606 0.88
tpch_q05/duckdb:parquet 1963214117 2108907928 0.93
tpch_q06/duckdb:parquet 670469352 702882699 0.95
tpch_q07/duckdb:parquet 1634548631 1966791142 0.83
tpch_q08/duckdb:parquet 2392882993 2550496960 0.94
tpch_q09/duckdb:parquet 2444099114 2638302982 0.93
tpch_q10/duckdb:parquet 3054172008 2984422212 1.02
tpch_q11/duckdb:parquet 973152798 1161346005 0.84
tpch_q12/duckdb:parquet 1216261933 1316622076 0.92
tpch_q13/duckdb:parquet 1171755010 1270692550 0.92
tpch_q14/duckdb:parquet 1232307045 1298864634 0.95
tpch_q15/duckdb:parquet 856398168 916275908 0.93
tpch_q16/duckdb:parquet 843459910 910440412 0.93
tpch_q17/duckdb:parquet 1300667157 1280516272 1.02
tpch_q18/duckdb:parquet 1365002460 1370031870 1.00
tpch_q19/duckdb:parquet 1509926567 1585598933 0.95
tpch_q20/duckdb:parquet 1761231790 1899630713 0.93
tpch_q21/duckdb:parquet 1836686502 1792746703 1.02
tpch_q22/duckdb:parquet 1001961860 1110989779 0.90
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.0% -3.1% +1.1% +44.1% ➖ noise
1 datafusion:vortex-file-compressed -3.2% -3.1% -0.2% +54.7% ➖ noise
1 duckdb:vortex-compact -5.0% -3.1% -2.0% +35.4% ➖ noise
1 duckdb:vortex-file-compressed -5.7% -3.1% -2.8% +36.7% ➖ noise
2 datafusion:vortex-compact -13.0% -17.7% +5.7% +48.6% ➖ noise
2 datafusion:vortex-file-compressed -16.2% -17.7% +1.9% +48.1% ➖ noise
2 duckdb:vortex-compact -2.8% -17.7% +18.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -10.9% -17.7% +8.3% +30.7% ➖ noise
3 datafusion:vortex-compact +3.3% -0.6% +3.9% +43.2% ➖ noise
3 datafusion:vortex-file-compressed -8.9% -0.6% -8.3% +49.6% ➖ noise
3 duckdb:vortex-compact -18.3% -0.6% -17.8% +33.8% ➖ noise
3 duckdb:vortex-file-compressed -2.5% -0.6% -1.9% +43.7% ➖ noise
4 datafusion:vortex-compact -10.9% -2.3% -8.8% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -9.7% -2.3% -7.6% +32.1% ➖ noise
4 duckdb:vortex-compact +1.4% -2.3% +3.8% +35.2% ➖ noise
4 duckdb:vortex-file-compressed +0.3% -2.3% +2.6% +30.0% ➖ noise
5 datafusion:vortex-compact -13.3% -13.9% +0.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -0.9% -13.9% +15.1% +30.0% ➖ noise
5 duckdb:vortex-compact +2.6% -13.9% +19.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -11.2% -13.9% +3.1% +30.0% ➖ noise
6 datafusion:vortex-compact -8.2% -1.9% -6.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -4.3% -1.9% -2.5% +30.0% ➖ noise
6 duckdb:vortex-compact -3.2% -1.9% -1.4% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +3.2% -1.9% +5.3% +30.0% ➖ noise
7 datafusion:vortex-compact +4.7% -14.6% +22.7% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +1.1% -14.6% +18.4% +30.0% ➖ noise
7 duckdb:vortex-compact -0.3% -14.6% +16.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -1.2% -14.6% +15.7% +30.0% ➖ noise
8 datafusion:vortex-compact -3.2% -7.2% +4.2% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +16.3% -7.2% +25.3% +30.0% ➖ noise
8 duckdb:vortex-compact -5.1% -7.2% +2.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +7.8% -7.2% +16.1% +30.0% ➖ noise
9 datafusion:vortex-compact -29.4% -5.7% -25.1% +30.0% ✅ faster
9 datafusion:vortex-file-compressed -6.9% -5.7% -1.3% +30.0% ➖ noise
9 duckdb:vortex-compact +0.7% -5.7% +6.7% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -6.9% -5.7% -1.2% +30.0% ➖ noise
10 datafusion:vortex-compact -7.4% +0.9% -8.2% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -14.2% +0.9% -15.0% +30.0% ➖ noise
10 duckdb:vortex-compact +0.0% +0.9% -0.9% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -4.7% +0.9% -5.6% +30.0% ➖ noise
11 datafusion:vortex-compact -13.9% -6.4% -8.0% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -19.9% -6.4% -14.5% +30.0% ➖ noise
11 duckdb:vortex-compact -1.4% -6.4% +5.4% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +9.1% -6.4% +16.5% +30.0% ➖ noise
12 datafusion:vortex-compact +62.5% -7.8% +76.3% +30.0% 🚨 regression
12 datafusion:vortex-file-compressed -15.1% -7.8% -7.9% +30.0% ➖ noise
12 duckdb:vortex-compact +3.2% -7.8% +11.9% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +1.6% -7.8% +10.2% +30.0% ➖ noise
13 datafusion:vortex-compact +28.4% -12.1% +46.0% +38.4% 🚨 regression
13 datafusion:vortex-file-compressed -9.2% -12.1% +3.3% +30.0% ➖ noise
13 duckdb:vortex-compact -2.8% -12.1% +10.5% +41.7% ➖ noise
13 duckdb:vortex-file-compressed +4.4% -12.1% +18.7% +45.5% ➖ noise
14 datafusion:vortex-compact +38.2% -9.6% +52.8% +31.6% 🚨 regression
14 datafusion:vortex-file-compressed -9.1% -9.6% +0.6% +30.0% ➖ noise
14 duckdb:vortex-compact +1.0% -9.6% +11.7% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +2.9% -9.6% +13.8% +30.0% ➖ noise
15 datafusion:vortex-compact +9.0% -6.9% +17.0% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -0.8% -6.9% +6.5% +30.0% ➖ noise
15 duckdb:vortex-compact -1.2% -6.9% +6.1% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -5.1% -6.9% +1.9% +30.0% ➖ noise
16 datafusion:vortex-compact +22.7% -6.9% +31.8% +37.1% ➖ noise
16 datafusion:vortex-file-compressed -11.7% -6.9% -5.1% +37.3% ➖ noise
16 duckdb:vortex-compact +1.8% -6.9% +9.4% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +10.5% -6.9% +18.7% +30.0% ➖ noise
17 datafusion:vortex-compact -7.6% +0.1% -7.7% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -5.5% +0.1% -5.6% +30.0% ➖ noise
17 duckdb:vortex-compact -6.6% +0.1% -6.7% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -2.0% +0.1% -2.1% +30.0% ➖ noise
18 datafusion:vortex-compact -0.8% -6.1% +5.6% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -12.1% -6.1% -6.4% +30.0% ➖ noise
18 duckdb:vortex-compact -7.1% -6.1% -1.1% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -2.7% -6.1% +3.6% +30.0% ➖ noise
19 datafusion:vortex-compact -2.1% -16.7% +17.5% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -5.8% -16.7% +13.1% +30.0% ➖ noise
19 duckdb:vortex-compact -4.3% -16.7% +14.9% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -7.5% -16.7% +11.0% +30.0% ➖ noise
20 datafusion:vortex-compact -5.2% -6.1% +0.9% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +3.8% -6.1% +10.5% +30.0% ➖ noise
20 duckdb:vortex-compact +5.9% -6.1% +12.8% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -1.2% -6.1% +5.2% +30.0% ➖ noise
21 datafusion:vortex-compact -12.3% -1.3% -11.1% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +11.9% -1.3% +13.4% +30.0% ➖ noise
21 duckdb:vortex-compact -3.3% -1.3% -2.0% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +4.3% -1.3% +5.7% +30.0% ➖ noise
22 datafusion:vortex-compact -41.8% -5.1% -38.7% +35.8% ✅ faster
22 datafusion:vortex-file-compressed +32.8% -5.1% +39.9% +45.9% ➖ noise
22 duckdb:vortex-compact -4.7% -5.1% +0.4% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -8.7% -5.1% -3.8% +30.0% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/deprecation A change that introduces a series of API deprecations

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants