Skip to content

perf: faster execution ctx and no opt#7597

Merged
joseph-isaacs merged 1 commit intodevelopfrom
ji/faster-execute
Apr 22, 2026
Merged

perf: faster execution ctx and no opt#7597
joseph-isaacs merged 1 commit intodevelopfrom
ji/faster-execute

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs commented Apr 22, 2026

Makes the ExecutionCtx faster to create and destroy.
Remove unconditional optimize from execute

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Apr 22, 2026
@joseph-isaacs joseph-isaacs marked this pull request as ready for review April 22, 2026 17:56
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 22, 2026

Merging this PR will degrade performance by 15.29%

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 20 improved benchmarks
❌ 2 regressed benchmarks
✅ 1141 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_bool_canonical_into[(10, 1000)] 948.1 µs 779.1 µs +21.69%
Simulation chunked_bool_canonical_into[(100, 100)] 118.3 µs 100.1 µs +18.23%
Simulation chunked_opt_bool_canonical_into[(10, 1000)] 1,142.9 µs 915 µs +24.91%
Simulation chunked_opt_bool_canonical_into[(1000, 10)] 62.4 µs 55.9 µs +11.51%
Simulation chunked_opt_bool_into_canonical[(1000, 10)] 70 µs 61.9 µs +12.98%
Simulation chunked_opt_bool_into_canonical[(10, 1000)] 1.3 ms 1 ms +32.88%
Simulation chunked_opt_bool_into_canonical[(100, 100)] 277 µs 220.3 µs +25.77%
Simulation chunked_varbinview_opt_into_canonical[(100, 100)] 563.3 µs 503.7 µs +11.84%
Simulation chunked_varbinview_opt_canonical_into[(10, 1000)] 2.8 ms 2.3 ms +19.57%
Simulation chunked_varbinview_opt_into_canonical[(10, 1000)] 3 ms 2.4 ms +21.5%
Simulation chunked_varbinview_into_canonical[(10, 1000)] 1.9 ms 1.7 ms +13.64%
Simulation chunked_varbinview_opt_canonical_into[(100, 100)] 544.1 µs 490 µs +11.05%
Simulation chunked_opt_bool_canonical_into[(100, 100)] 252.1 µs 206.1 µs +22.35%
Simulation old_bp_prim_test_between[i64, 16384] 176.4 µs 202.8 µs -13.01%
Simulation new_bp_prim_test_between[i16, 32768] 134.5 µs 121.4 µs +10.77%
Simulation old_bp_prim_test_between[i64, 32768] 252.5 µs 298.1 µs -15.29%
Simulation decompress[u8, (1000, 16)] 19 µs 16.7 µs +13.87%
Simulation decompress[u16, (1000, 256)] 18 µs 16.3 µs +10.38%
Simulation decompress[u8, (1000, 256)] 16.6 µs 15 µs +10.73%
Simulation null_count_run_end[(10000, 256, 0.01)] 4.7 µs 4.2 µs +11.59%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing ji/faster-execute (4dc7602) with develop (bfb5dba)

Open in CodSpeed

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 22, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 22, 2026
@joseph-isaacs joseph-isaacs enabled auto-merge (squash) April 22, 2026 18:00
@joseph-isaacs joseph-isaacs merged commit f3e7b3c into develop Apr 22, 2026
86 of 91 checks passed
@joseph-isaacs joseph-isaacs deleted the ji/faster-execute branch April 22, 2026 18:01
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 22, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 4dc7602 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.038x ➖


datafusion / vortex-file-compressed (1.038x ➖, 0↑ 2↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 114152045 120188414 0.95
polarsignals_q01/datafusion:vortex-file-compressed 254824670 268531054 0.95
polarsignals_q02/datafusion:vortex-file-compressed 25036159 23772525 1.05
polarsignals_q03/datafusion:vortex-file-compressed 🚨 277370011 251165106 1.10
polarsignals_q04/datafusion:vortex-file-compressed 12911384 12548434 1.03
polarsignals_q05/datafusion:vortex-file-compressed 17699218 16467461 1.07
polarsignals_q06/datafusion:vortex-file-compressed 19470264 19260872 1.01
polarsignals_q07/datafusion:vortex-file-compressed 🚨 15908935 13888537 1.15
polarsignals_q08/datafusion:vortex-file-compressed 362632914 348255745 1.04
polarsignals_q09/datafusion:vortex-file-compressed 11634775 11214817 1.04

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Vortex (geomean): 1.010x ➖
Parquet (geomean): 1.030x ➖
Shifts: Parquet (control) +3.0% · Median polish +1.9%


datafusion / vortex-file-compressed (1.028x ➖, 0↑ 1↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5669006 5339579 1.06
fineweb_q01/datafusion:vortex-file-compressed 🚨 22838084 20540029 1.11
fineweb_q02/datafusion:vortex-file-compressed 22693657 23526405 0.96
fineweb_q03/datafusion:vortex-file-compressed 78517186 77276448 1.02
fineweb_q04/datafusion:vortex-file-compressed 231311029 230779870 1.00
fineweb_q05/datafusion:vortex-file-compressed 222119712 212396701 1.05
fineweb_q06/datafusion:vortex-file-compressed 52182701 52213689 1.00
fineweb_q07/datafusion:vortex-file-compressed 61401719 58615461 1.05
fineweb_q08/datafusion:vortex-file-compressed 21973307 21679243 1.01
datafusion / vortex-compact (1.032x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 6217667 5893614 1.05
fineweb_q01/datafusion:vortex-compact 134294924 124818483 1.08
fineweb_q02/datafusion:vortex-compact 127151647 128193806 0.99
fineweb_q03/datafusion:vortex-compact 1043534718 1043536568 1.00
fineweb_q04/datafusion:vortex-compact 1134064072 1106354367 1.03
fineweb_q05/datafusion:vortex-compact 944224410 945432423 1.00
fineweb_q06/datafusion:vortex-compact 530419998 514214946 1.03
fineweb_q07/datafusion:vortex-compact 569625292 534164467 1.07
fineweb_q08/datafusion:vortex-compact 18661652 17879515 1.04
datafusion / parquet (1.023x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7102209 6809827 1.04
fineweb_q01/datafusion:parquet 284728259 282885324 1.01
fineweb_q02/datafusion:parquet 294567496 289504070 1.02
fineweb_q03/datafusion:parquet 292561202 277236734 1.06
fineweb_q04/datafusion:parquet 300476437 293782817 1.02
fineweb_q05/datafusion:parquet 299130625 292577587 1.02
fineweb_q06/datafusion:parquet 290275776 294862399 0.98
fineweb_q07/datafusion:parquet 287996621 278364738 1.03
fineweb_q08/datafusion:parquet 279092179 271928239 1.03
duckdb / vortex-file-compressed (0.992x ➖, 1↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3329414 3414763 0.98
fineweb_q01/duckdb:vortex-file-compressed 23320210 21919823 1.06
fineweb_q02/duckdb:vortex-file-compressed 24761439 23628749 1.05
fineweb_q03/duckdb:vortex-file-compressed 🚀 126648567 154576976 0.82
fineweb_q04/duckdb:vortex-file-compressed 225781199 224263743 1.01
fineweb_q05/duckdb:vortex-file-compressed 211144542 212127602 1.00
fineweb_q06/duckdb:vortex-file-compressed 52724340 52508470 1.00
fineweb_q07/duckdb:vortex-file-compressed 54103823 55506988 0.97
fineweb_q08/duckdb:vortex-file-compressed 23328095 21936810 1.06
duckdb / vortex-compact (0.989x ➖, 1↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4021267 3963090 1.01
fineweb_q01/duckdb:vortex-compact 106788301 103662029 1.03
fineweb_q02/duckdb:vortex-compact 112090966 111576185 1.00
fineweb_q03/duckdb:vortex-compact 872359070 851179536 1.02
fineweb_q04/duckdb:vortex-compact 905696574 899409809 1.01
fineweb_q05/duckdb:vortex-compact 817348873 814135630 1.00
fineweb_q06/duckdb:vortex-compact 469965039 458955108 1.02
fineweb_q07/duckdb:vortex-compact 476055684 464924177 1.02
fineweb_q08/duckdb:vortex-compact 🚀 19277255 24320671 0.79
duckdb / parquet (1.037x ➖, 0↑ 1↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30991286 28748792 1.08
fineweb_q01/duckdb:parquet 84212730 83757471 1.01
fineweb_q02/duckdb:parquet 85031806 84055163 1.01
fineweb_q03/duckdb:parquet 312256968 307338750 1.02
fineweb_q04/duckdb:parquet 442126009 437282720 1.01
fineweb_q05/duckdb:parquet 411561075 407444909 1.01
fineweb_q06/duckdb:parquet 200966053 196918606 1.02
fineweb_q07/duckdb:parquet 210546793 208309227 1.01
fineweb_q08/duckdb:parquet 🚨 33716013 28461435 1.18
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +5.5% +6.0% -0.5% +47.9% ➖ noise
0 datafusion:vortex-file-compressed +6.2% +6.0% +0.1% +48.4% ➖ noise
0 duckdb:vortex-compact +1.5% +6.0% -4.3% +80.5% ➖ noise
0 duckdb:vortex-file-compressed -2.5% +6.0% -8.0% +83.2% ➖ noise
1 datafusion:vortex-compact +7.6% +0.6% +7.0% +13.0% ➖ noise
1 datafusion:vortex-file-compressed +11.2% +0.6% +10.5% +36.2% ➖ noise
1 duckdb:vortex-compact +3.0% +0.6% +2.4% +15.5% ➖ noise
1 duckdb:vortex-file-compressed +6.4% +0.6% +5.8% +62.3% ➖ noise
2 datafusion:vortex-compact -0.8% +1.5% -2.2% +11.2% ➖ noise
2 datafusion:vortex-file-compressed -3.5% +1.5% -4.9% +11.4% ➖ noise
2 duckdb:vortex-compact +0.5% +1.5% -1.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +4.8% +1.5% +3.3% +10.5% ➖ noise
3 datafusion:vortex-compact -0.0% +3.5% -3.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +1.6% +3.5% -1.9% +34.1% ➖ noise
3 duckdb:vortex-compact +2.5% +3.5% -1.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -18.1% +3.5% -20.9% +27.3% ➖ noise
4 datafusion:vortex-compact +2.5% +1.7% +0.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.2% +1.7% -1.4% +10.0% ➖ noise
4 duckdb:vortex-compact +0.7% +1.7% -1.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.7% +1.7% -1.0% +10.0% ➖ noise
5 datafusion:vortex-compact -0.1% +1.6% -1.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +4.6% +1.6% +2.9% +10.0% ➖ noise
5 duckdb:vortex-compact +0.4% +1.6% -1.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.5% +1.6% -2.1% +10.0% ➖ noise
6 datafusion:vortex-compact +3.2% +0.2% +2.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.1% +0.2% -0.3% +10.0% ➖ noise
6 duckdb:vortex-compact +2.4% +0.2% +2.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.4% +0.2% +0.2% +10.0% ➖ noise
7 datafusion:vortex-compact +6.6% +2.3% +4.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +4.8% +2.3% +2.4% +34.2% ➖ noise
7 duckdb:vortex-compact +2.4% +2.3% +0.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -2.5% +2.3% -4.7% +10.9% ➖ noise
8 datafusion:vortex-compact +4.4% +10.3% -5.3% +12.0% ➖ noise
8 datafusion:vortex-file-compressed +1.4% +10.3% -8.1% +15.2% ➖ noise
8 duckdb:vortex-compact -20.7% +10.3% -28.1% +33.9% ✅ faster
8 duckdb:vortex-file-compressed +6.3% +10.3% -3.6% +40.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.4%
Vortex (geomean): 1.097x ➖
Parquet (geomean): 1.052x ➖
Shifts: Parquet (control) +5.2% · Median polish +7.7%


datafusion / vortex-file-compressed (1.127x ❌, 0↑ 15↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 56467906 49979341 1.13
tpch_q02/datafusion:vortex-file-compressed 🚨 31370923 28062717 1.12
tpch_q03/datafusion:vortex-file-compressed 🚨 32592807 28867540 1.13
tpch_q04/datafusion:vortex-file-compressed 🚨 24402523 21316412 1.14
tpch_q05/datafusion:vortex-file-compressed 🚨 58797484 49472877 1.19
tpch_q06/datafusion:vortex-file-compressed 14317318 13363544 1.07
tpch_q07/datafusion:vortex-file-compressed 🚨 71151595 60960859 1.17
tpch_q08/datafusion:vortex-file-compressed 🚨 45962591 41447250 1.11
tpch_q09/datafusion:vortex-file-compressed 🚨 60144432 54612656 1.10
tpch_q10/datafusion:vortex-file-compressed 🚨 49783057 44247180 1.13
tpch_q11/datafusion:vortex-file-compressed 17590979 16012507 1.10
tpch_q12/datafusion:vortex-file-compressed 28395563 26556345 1.07
tpch_q13/datafusion:vortex-file-compressed 🚨 29170416 25650363 1.14
tpch_q14/datafusion:vortex-file-compressed 18939769 17259873 1.10
tpch_q15/datafusion:vortex-file-compressed 29779901 27366368 1.09
tpch_q16/datafusion:vortex-file-compressed 22757987 21128223 1.08
tpch_q17/datafusion:vortex-file-compressed 🚨 81448761 67731111 1.20
tpch_q18/datafusion:vortex-file-compressed 🚨 98323830 79834003 1.23
tpch_q19/datafusion:vortex-file-compressed 26425098 24995810 1.06
tpch_q20/datafusion:vortex-file-compressed 🚨 35694060 30579456 1.17
tpch_q21/datafusion:vortex-file-compressed 🚨 89142270 75429461 1.18
tpch_q22/datafusion:vortex-file-compressed 🚨 16180425 14430616 1.12
datafusion / vortex-compact (1.088x ➖, 0↑ 7↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 65926214 58580814 1.13
tpch_q02/datafusion:vortex-compact 34852088 31709997 1.10
tpch_q03/datafusion:vortex-compact 33793387 31735190 1.06
tpch_q04/datafusion:vortex-compact 26715397 24760494 1.08
tpch_q05/datafusion:vortex-compact 🚨 59314174 52839313 1.12
tpch_q06/datafusion:vortex-compact 15365842 15119871 1.02
tpch_q07/datafusion:vortex-compact 🚨 75055713 66463523 1.13
tpch_q08/datafusion:vortex-compact 50162368 46229186 1.09
tpch_q09/datafusion:vortex-compact 65494636 60227692 1.09
tpch_q10/datafusion:vortex-compact 🚨 56696375 49916420 1.14
tpch_q11/datafusion:vortex-compact 18655678 17034832 1.10
tpch_q12/datafusion:vortex-compact 🚨 36671730 33243719 1.10
tpch_q13/datafusion:vortex-compact 🚨 36468345 31716935 1.15
tpch_q14/datafusion:vortex-compact 🚨 22484521 20400249 1.10
tpch_q15/datafusion:vortex-compact 35794662 33015381 1.08
tpch_q16/datafusion:vortex-compact 26602618 24803441 1.07
tpch_q17/datafusion:vortex-compact 74581461 70346168 1.06
tpch_q18/datafusion:vortex-compact 91195671 85972495 1.06
tpch_q19/datafusion:vortex-compact 33496786 31732599 1.06
tpch_q20/datafusion:vortex-compact 38141601 35136541 1.09
tpch_q21/datafusion:vortex-compact 88169596 82628729 1.07
tpch_q22/datafusion:vortex-compact 16328238 15331292 1.07
datafusion / parquet (1.068x ➖, 1↑ 7↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 127848629 106632839 1.20
tpch_q02/datafusion:parquet 66017270 62788182 1.05
tpch_q03/datafusion:parquet 76683054 74004704 1.04
tpch_q04/datafusion:parquet 47340106 45992323 1.03
tpch_q05/datafusion:parquet 99477519 95334749 1.04
tpch_q06/datafusion:parquet 40946243 40964580 1.00
tpch_q07/datafusion:parquet 112932086 104782789 1.08
tpch_q08/datafusion:parquet 100346460 99485382 1.01
tpch_q09/datafusion:parquet 141615997 130284912 1.09
tpch_q10/datafusion:parquet 🚨 125006604 111285118 1.12
tpch_q11/datafusion:parquet 🚨 47910882 41437373 1.16
tpch_q12/datafusion:parquet 91015753 90322967 1.01
tpch_q13/datafusion:parquet 200731971 187906734 1.07
tpch_q14/datafusion:parquet 🚀 44167439 50449850 0.88
tpch_q15/datafusion:parquet 64686792 60838780 1.06
tpch_q16/datafusion:parquet 🚨 49368332 43767970 1.13
tpch_q17/datafusion:parquet 🚨 146368736 127411747 1.15
tpch_q18/datafusion:parquet 🚨 179187071 156287068 1.15
tpch_q19/datafusion:parquet 🚨 78029928 70527198 1.11
tpch_q20/datafusion:parquet 75727685 70645653 1.07
tpch_q21/datafusion:parquet 146839225 135815081 1.08
tpch_q22/datafusion:parquet 32491611 31128399 1.04
datafusion / arrow (1.064x ➖, 0↑ 4↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 54199850 52927415 1.02
tpch_q02/datafusion:arrow 19162051 18642898 1.03
tpch_q03/datafusion:arrow 31276674 29437669 1.06
tpch_q04/datafusion:arrow 27353669 25165171 1.09
tpch_q05/datafusion:arrow 80311461 73062565 1.10
tpch_q06/datafusion:arrow 🚨 22733768 19636665 1.16
tpch_q07/datafusion:arrow 108575766 99346972 1.09
tpch_q08/datafusion:arrow 🚨 44671495 40220830 1.11
tpch_q09/datafusion:arrow 65391346 68156740 0.96
tpch_q10/datafusion:arrow 52108945 48819419 1.07
tpch_q11/datafusion:arrow 9221938 8966757 1.03
tpch_q12/datafusion:arrow 🚨 56583759 50533983 1.12
tpch_q13/datafusion:arrow 47996969 47147369 1.02
tpch_q14/datafusion:arrow 22305965 21477715 1.04
tpch_q15/datafusion:arrow 44466399 41370599 1.07
tpch_q16/datafusion:arrow 19356077 18729331 1.03
tpch_q17/datafusion:arrow 71594363 66666612 1.07
tpch_q18/datafusion:arrow 140367299 132470500 1.06
tpch_q19/datafusion:arrow 38211448 36913196 1.04
tpch_q20/datafusion:arrow 🚨 38989699 34649483 1.13
tpch_q21/datafusion:arrow 160670626 148001225 1.09
tpch_q22/datafusion:arrow 18350591 17489270 1.05
duckdb / vortex-file-compressed (1.092x ➖, 0↑ 7↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32079033 31314996 1.02
tpch_q02/duckdb:vortex-file-compressed 26107964 25002672 1.04
tpch_q03/duckdb:vortex-file-compressed 31926480 29607208 1.08
tpch_q04/duckdb:vortex-file-compressed 31152797 30087128 1.04
tpch_q05/duckdb:vortex-file-compressed 36308537 33376426 1.09
tpch_q06/duckdb:vortex-file-compressed 11325241 10724127 1.06
tpch_q07/duckdb:vortex-file-compressed 40281176 37534577 1.07
tpch_q08/duckdb:vortex-file-compressed 40564843 39404630 1.03
tpch_q09/duckdb:vortex-file-compressed 🚨 81978449 70279665 1.17
tpch_q10/duckdb:vortex-file-compressed 37297231 34581245 1.08
tpch_q11/duckdb:vortex-file-compressed 16029361 14634434 1.10
tpch_q12/duckdb:vortex-file-compressed 23805813 22104216 1.08
tpch_q13/duckdb:vortex-file-compressed 🚨 40751790 35224501 1.16
tpch_q14/duckdb:vortex-file-compressed 🚨 24219300 21139118 1.15
tpch_q15/duckdb:vortex-file-compressed 🚨 18667139 16454700 1.13
tpch_q16/duckdb:vortex-file-compressed 30857087 28214723 1.09
tpch_q17/duckdb:vortex-file-compressed 27481216 25283367 1.09
tpch_q18/duckdb:vortex-file-compressed 53167053 50936484 1.04
tpch_q19/duckdb:vortex-file-compressed 31315537 29714713 1.05
tpch_q20/duckdb:vortex-file-compressed 🚨 38520655 33658792 1.14
tpch_q21/duckdb:vortex-file-compressed 🚨 125156451 106521780 1.17
tpch_q22/duckdb:vortex-file-compressed 🚨 19584054 16823649 1.16
duckdb / vortex-compact (1.081x ➖, 0↑ 6↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 41469879 38536938 1.08
tpch_q02/duckdb:vortex-compact 37894720 35149211 1.08
tpch_q03/duckdb:vortex-compact 🚨 36013534 32469028 1.11
tpch_q04/duckdb:vortex-compact 36731771 34224983 1.07
tpch_q05/duckdb:vortex-compact 40559538 37389334 1.08
tpch_q06/duckdb:vortex-compact 15781594 15225756 1.04
tpch_q07/duckdb:vortex-compact 🚨 46596607 42205764 1.10
tpch_q08/duckdb:vortex-compact 47827024 46314325 1.03
tpch_q09/duckdb:vortex-compact 90182353 83157526 1.08
tpch_q10/duckdb:vortex-compact 42605289 39659695 1.07
tpch_q11/duckdb:vortex-compact 21200364 19680309 1.08
tpch_q12/duckdb:vortex-compact 38320266 35157800 1.09
tpch_q13/duckdb:vortex-compact 47759969 44343228 1.08
tpch_q14/duckdb:vortex-compact 🚨 32955787 29762095 1.11
tpch_q15/duckdb:vortex-compact 🚨 21672710 19644787 1.10
tpch_q16/duckdb:vortex-compact 37214952 35082448 1.06
tpch_q17/duckdb:vortex-compact 🚨 33901845 30651488 1.11
tpch_q18/duckdb:vortex-compact 52421323 51577798 1.02
tpch_q19/duckdb:vortex-compact 37395225 34451934 1.09
tpch_q20/duckdb:vortex-compact 46628086 43065992 1.08
tpch_q21/duckdb:vortex-compact 🚨 125287087 109235994 1.15
tpch_q22/duckdb:vortex-compact 21666701 19913073 1.09
duckdb / parquet (1.035x ➖, 0↑ 1↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 75652088 81527173 0.93
tpch_q02/duckdb:parquet 40096439 38582243 1.04
tpch_q03/duckdb:parquet 70729935 68708592 1.03
tpch_q04/duckdb:parquet 47379047 46783720 1.01
tpch_q05/duckdb:parquet 67588041 65959349 1.02
tpch_q06/duckdb:parquet 20985568 19855745 1.06
tpch_q07/duckdb:parquet 73604725 68420383 1.08
tpch_q08/duckdb:parquet 🚨 99876891 79838491 1.25
tpch_q09/duckdb:parquet 153375426 154387186 0.99
tpch_q10/duckdb:parquet 125249097 114165645 1.10
tpch_q11/duckdb:parquet 22992893 22315685 1.03
tpch_q12/duckdb:parquet 45663045 45544389 1.00
tpch_q13/duckdb:parquet 260447116 247753514 1.05
tpch_q14/duckdb:parquet 53770169 52274907 1.03
tpch_q15/duckdb:parquet 24652330 25104633 0.98
tpch_q16/duckdb:parquet 57053663 55494603 1.03
tpch_q17/duckdb:parquet 55230553 55555644 0.99
tpch_q18/duckdb:parquet 117463570 110781512 1.06
tpch_q19/duckdb:parquet 66322189 65192353 1.02
tpch_q20/duckdb:parquet 64418574 63363355 1.02
tpch_q21/duckdb:parquet 172232063 164298785 1.05
tpch_q22/duckdb:parquet 52704292 51000658 1.03
duckdb / duckdb (1.074x ➖, 0↑ 4↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16928766 15909584 1.06
tpch_q02/duckdb:duckdb 🚨 13957429 12275317 1.14
tpch_q03/duckdb:duckdb 20577764 18717461 1.10
tpch_q04/duckdb:duckdb 20613717 19163291 1.08
tpch_q05/duckdb:duckdb 20483123 20111975 1.02
tpch_q06/duckdb:duckdb 5543346 5238535 1.06
tpch_q07/duckdb:duckdb 🚨 24963767 21034338 1.19
tpch_q08/duckdb:duckdb 21947647 20376086 1.08
tpch_q09/duckdb:duckdb 59451642 54142237 1.10
tpch_q10/duckdb:duckdb 43927722 43697329 1.01
tpch_q11/duckdb:duckdb 🚨 6408569 5639865 1.14
tpch_q12/duckdb:duckdb 14625450 13806804 1.06
tpch_q13/duckdb:duckdb 40388537 36987096 1.09
tpch_q14/duckdb:duckdb 🚨 19666951 17366633 1.13
tpch_q15/duckdb:duckdb 12520228 11715916 1.07
tpch_q16/duckdb:duckdb 24995154 23991915 1.04
tpch_q17/duckdb:duckdb 14565312 13474493 1.08
tpch_q18/duckdb:duckdb 40031018 38770628 1.03
tpch_q19/duckdb:duckdb 28023586 26903984 1.04
tpch_q20/duckdb:duckdb 23880107 22487982 1.06
tpch_q21/duckdb:duckdb 58756261 55688087 1.06
tpch_q22/duckdb:duckdb 25012751 24303904 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +2.4% +5.5% -2.9% +21.1% ➖ noise
1 datafusion:vortex-compact +12.5% +5.5% +6.7% +17.9% ➖ noise
1 datafusion:vortex-file-compressed +13.0% +5.5% +7.1% +18.6% ➖ noise
1 duckdb:duckdb +6.4% +5.5% +0.9% +18.1% ➖ noise
1 duckdb:vortex-compact +7.6% +5.5% +2.0% +17.8% ➖ noise
1 duckdb:vortex-file-compressed +2.4% +5.5% -2.9% +20.7% ➖ noise
2 datafusion:arrow +2.8% +4.5% -1.7% +10.0% ➖ noise
2 datafusion:vortex-compact +9.9% +4.5% +5.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +11.8% +4.5% +6.9% +10.0% ➖ noise
2 duckdb:duckdb +13.7% +4.5% +8.8% +10.0% ➖ noise
2 duckdb:vortex-compact +7.8% +4.5% +3.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +4.4% +4.5% -0.1% +10.0% ➖ noise
3 datafusion:arrow +6.2% +3.3% +2.9% +10.0% ➖ noise
3 datafusion:vortex-compact +6.5% +3.3% +3.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +12.9% +3.3% +9.3% +10.4% ➖ noise
3 duckdb:duckdb +9.9% +3.3% +6.4% +12.2% ➖ noise
3 duckdb:vortex-compact +10.9% +3.3% +7.4% +14.8% ➖ noise
3 duckdb:vortex-file-compressed +7.8% +3.3% +4.4% +12.6% ➖ noise
4 datafusion:arrow +8.7% +2.1% +6.5% +10.0% ➖ noise
4 datafusion:vortex-compact +7.9% +2.1% +5.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +14.5% +2.1% +12.1% +10.0% 🚨 regression
4 duckdb:duckdb +7.6% +2.1% +5.4% +10.0% ➖ noise
4 duckdb:vortex-compact +7.3% +2.1% +5.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.5% +2.1% +1.4% +10.0% ➖ noise
5 datafusion:arrow +9.9% +3.4% +6.3% +10.0% ➖ noise
5 datafusion:vortex-compact +12.3% +3.4% +8.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +18.8% +3.4% +14.9% +10.0% 🚨 regression
5 duckdb:duckdb +1.8% +3.4% -1.5% +10.2% ➖ noise
5 duckdb:vortex-compact +8.5% +3.4% +4.9% +10.4% ➖ noise
5 duckdb:vortex-file-compressed +8.8% +3.4% +5.2% +13.6% ➖ noise
6 datafusion:arrow +15.8% +2.8% +12.6% +14.4% ➖ noise
6 datafusion:vortex-compact +1.6% +2.8% -1.1% +15.3% ➖ noise
6 datafusion:vortex-file-compressed +7.1% +2.8% +4.2% +16.3% ➖ noise
6 duckdb:duckdb +5.8% +2.8% +3.0% +15.7% ➖ noise
6 duckdb:vortex-compact +3.7% +2.8% +0.8% +14.8% ➖ noise
6 duckdb:vortex-file-compressed +5.6% +2.8% +2.7% +16.1% ➖ noise
7 datafusion:arrow +9.3% +7.7% +1.5% +10.0% ➖ noise
7 datafusion:vortex-compact +12.9% +7.7% +4.9% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +16.7% +7.7% +8.4% +10.0% ➖ noise
7 duckdb:duckdb +18.7% +7.7% +10.2% +11.6% ➖ noise
7 duckdb:vortex-compact +10.4% +7.7% +2.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +7.3% +7.7% -0.3% +10.8% ➖ noise
8 datafusion:arrow +11.1% +12.3% -1.1% +10.0% ➖ noise
8 datafusion:vortex-compact +8.5% +12.3% -3.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +10.9% +12.3% -1.3% +10.0% ➖ noise
8 duckdb:duckdb +7.7% +12.3% -4.1% +10.0% ➖ noise
8 duckdb:vortex-compact +3.3% +12.3% -8.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.9% +12.3% -8.4% +10.1% ➖ noise
9 datafusion:arrow -4.1% +3.9% -7.7% +10.0% ➖ noise
9 datafusion:vortex-compact +8.7% +3.9% +4.6% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +10.1% +3.9% +6.0% +10.0% ➖ noise
9 duckdb:duckdb +9.8% +3.9% +5.7% +10.0% ➖ noise
9 duckdb:vortex-compact +8.4% +3.9% +4.4% +14.5% ➖ noise
9 duckdb:vortex-file-compressed +16.6% +3.9% +12.3% +10.4% 🚨 regression
10 datafusion:arrow +6.7% +11.0% -3.8% +10.0% ➖ noise
10 datafusion:vortex-compact +13.6% +11.0% +2.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +12.5% +11.0% +1.4% +10.0% ➖ noise
10 duckdb:duckdb +0.5% +11.0% -9.4% +12.3% ➖ noise
10 duckdb:vortex-compact +7.4% +11.0% -3.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +7.9% +11.0% -2.8% +10.0% ➖ noise
11 datafusion:arrow +2.8% +9.1% -5.8% +10.0% ➖ noise
11 datafusion:vortex-compact +9.5% +9.1% +0.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +9.9% +9.1% +0.7% +10.0% ➖ noise
11 duckdb:duckdb +13.6% +9.1% +4.1% +11.3% ➖ noise
11 duckdb:vortex-compact +7.7% +9.1% -1.3% +11.0% ➖ noise
11 duckdb:vortex-file-compressed +9.5% +9.1% +0.4% +10.0% ➖ noise
12 datafusion:arrow +12.0% +0.5% +11.4% +18.2% ➖ noise
12 datafusion:vortex-compact +10.3% +0.5% +9.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +6.9% +0.5% +6.4% +10.0% ➖ noise
12 duckdb:duckdb +5.9% +0.5% +5.4% +10.8% ➖ noise
12 duckdb:vortex-compact +9.0% +0.5% +8.4% +10.6% ➖ noise
12 duckdb:vortex-file-compressed +7.7% +0.5% +7.1% +10.6% ➖ noise
13 datafusion:arrow +1.8% +6.0% -3.9% +10.0% ➖ noise
13 datafusion:vortex-compact +15.0% +6.0% +8.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +13.7% +6.0% +7.3% +10.0% ➖ noise
13 duckdb:duckdb +9.2% +6.0% +3.0% +10.0% ➖ noise
13 duckdb:vortex-compact +7.7% +6.0% +1.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +15.7% +6.0% +9.2% +10.0% ➖ noise
14 datafusion:arrow +3.9% -5.1% +9.4% +27.8% ➖ noise
14 datafusion:vortex-compact +10.2% -5.1% +16.1% +12.6% 🚨 regression
14 datafusion:vortex-file-compressed +9.7% -5.1% +15.6% +11.3% 🚨 regression
14 duckdb:duckdb +13.2% -5.1% +19.3% +17.3% 🚨 regression
14 duckdb:vortex-compact +10.7% -5.1% +16.7% +11.9% 🚨 regression
14 duckdb:vortex-file-compressed +14.6% -5.1% +20.7% +12.4% 🚨 regression
15 datafusion:arrow +7.5% +2.2% +5.2% +10.0% ➖ noise
15 datafusion:vortex-compact +8.4% +2.2% +6.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +8.8% +2.2% +6.5% +10.4% ➖ noise
15 duckdb:duckdb +6.9% +2.2% +4.6% +12.4% ➖ noise
15 duckdb:vortex-compact +10.3% +2.2% +8.0% +11.9% ➖ noise
15 duckdb:vortex-file-compressed +13.4% +2.2% +11.0% +12.5% ➖ noise
16 datafusion:arrow +3.3% +7.7% -4.0% +10.0% ➖ noise
16 datafusion:vortex-compact +7.3% +7.7% -0.4% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +7.7% +7.7% +0.0% +10.0% ➖ noise
16 duckdb:duckdb +4.2% +7.7% -3.3% +10.0% ➖ noise
16 duckdb:vortex-compact +6.1% +7.7% -1.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +9.4% +7.7% +1.6% +10.0% ➖ noise
17 datafusion:arrow +7.4% +6.9% +0.5% +12.0% ➖ noise
17 datafusion:vortex-compact +6.0% +6.9% -0.8% +10.4% ➖ noise
17 datafusion:vortex-file-compressed +20.3% +6.9% +12.5% +10.9% 🚨 regression
17 duckdb:duckdb +8.1% +6.9% +1.1% +16.3% ➖ noise
17 duckdb:vortex-compact +10.6% +6.9% +3.5% +12.2% ➖ noise
17 duckdb:vortex-file-compressed +8.7% +6.9% +1.7% +14.3% ➖ noise
18 datafusion:arrow +6.0% +10.3% -3.9% +10.0% ➖ noise
18 datafusion:vortex-compact +6.1% +10.3% -3.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +23.2% +10.3% +11.7% +10.0% 🚨 regression
18 duckdb:duckdb +3.3% +10.3% -6.4% +10.0% ➖ noise
18 duckdb:vortex-compact +1.6% +10.3% -7.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +4.4% +10.3% -5.3% +10.0% ➖ noise
19 datafusion:arrow +3.5% +6.1% -2.4% +15.2% ➖ noise
19 datafusion:vortex-compact +5.6% +6.1% -0.5% +13.5% ➖ noise
19 datafusion:vortex-file-compressed +5.7% +6.1% -0.4% +12.9% ➖ noise
19 duckdb:duckdb +4.2% +6.1% -1.8% +14.8% ➖ noise
19 duckdb:vortex-compact +8.5% +6.1% +2.3% +14.3% ➖ noise
19 duckdb:vortex-file-compressed +5.4% +6.1% -0.7% +13.9% ➖ noise
20 datafusion:arrow +12.5% +4.4% +7.8% +10.0% ➖ noise
20 datafusion:vortex-compact +8.6% +4.4% +4.0% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +16.7% +4.4% +11.8% +10.6% 🚨 regression
20 duckdb:duckdb +6.2% +4.4% +1.7% +12.0% ➖ noise
20 duckdb:vortex-compact +8.3% +4.4% +3.7% +11.9% ➖ noise
20 duckdb:vortex-file-compressed +14.4% +4.4% +9.6% +10.0% ➖ noise
21 datafusion:arrow +8.6% +6.5% +2.0% +10.0% ➖ noise
21 datafusion:vortex-compact +6.7% +6.5% +0.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +18.2% +6.5% +11.0% +10.0% 🚨 regression
21 duckdb:duckdb +5.5% +6.5% -0.9% +10.0% ➖ noise
21 duckdb:vortex-compact +14.7% +6.5% +7.7% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +17.5% +6.5% +10.4% +10.0% 🚨 regression
22 datafusion:arrow +4.9% +3.9% +1.0% +10.0% ➖ noise
22 datafusion:vortex-compact +6.5% +3.9% +2.5% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +12.1% +3.9% +8.0% +10.0% ➖ noise
22 duckdb:duckdb +2.9% +3.9% -0.9% +10.0% ➖ noise
22 duckdb:vortex-compact +8.8% +3.9% +4.8% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +16.4% +3.9% +12.1% +10.0% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Vortex (geomean): 0.977x ➖
Parquet (geomean): 0.982x ➖
Shifts: Parquet (control) -1.8% · Median polish -2.0%


datafusion / vortex-file-compressed (0.966x ➖, 2↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 25734025 27107815 0.95
tpcds_q02/datafusion:vortex-file-compressed 49744468 49581921 1.00
tpcds_q03/datafusion:vortex-file-compressed 17146094 18214880 0.94
tpcds_q04/datafusion:vortex-file-compressed 266057836 278564120 0.96
tpcds_q05/datafusion:vortex-file-compressed 43200973 44545204 0.97
tpcds_q06/datafusion:vortex-file-compressed 41577373 44560986 0.93
tpcds_q07/datafusion:vortex-file-compressed 45645986 46596729 0.98
tpcds_q08/datafusion:vortex-file-compressed 30078545 31574250 0.95
tpcds_q09/datafusion:vortex-file-compressed 44867668 46896556 0.96
tpcds_q10/datafusion:vortex-file-compressed 39166047 41298085 0.95
tpcds_q11/datafusion:vortex-file-compressed 154148856 154665346 1.00
tpcds_q12/datafusion:vortex-file-compressed 21057790 22132761 0.95
tpcds_q13/datafusion:vortex-file-compressed 46026412 47865053 0.96
tpcds_q14/datafusion:vortex-file-compressed 176521761 179567475 0.98
tpcds_q15/datafusion:vortex-file-compressed 31437854 31482502 1.00
tpcds_q16/datafusion:vortex-file-compressed 31529159 31622625 1.00
tpcds_q17/datafusion:vortex-file-compressed 64808408 66311334 0.98
tpcds_q18/datafusion:vortex-file-compressed 69594745 73315298 0.95
tpcds_q19/datafusion:vortex-file-compressed 25549863 26511900 0.96
tpcds_q20/datafusion:vortex-file-compressed 23367817 23563838 0.99
tpcds_q21/datafusion:vortex-file-compressed 122697368 128631571 0.95
tpcds_q22/datafusion:vortex-file-compressed 53740880 58386911 0.92
tpcds_q23/datafusion:vortex-file-compressed 127905682 133776075 0.96
tpcds_q24/datafusion:vortex-file-compressed 100334635 103438327 0.97
tpcds_q25/datafusion:vortex-file-compressed 65238151 67871651 0.96
tpcds_q26/datafusion:vortex-file-compressed 34870915 37503988 0.93
tpcds_q27/datafusion:vortex-file-compressed 105814623 103148517 1.03
tpcds_q28/datafusion:vortex-file-compressed 42326157 41985564 1.01
tpcds_q29/datafusion:vortex-file-compressed 62890720 69148090 0.91
tpcds_q30/datafusion:vortex-file-compressed 23478272 23793540 0.99
tpcds_q31/datafusion:vortex-file-compressed 86684204 89204542 0.97
tpcds_q32/datafusion:vortex-file-compressed 20507118 21758397 0.94
tpcds_q33/datafusion:vortex-file-compressed 29540828 31233397 0.95
tpcds_q34/datafusion:vortex-file-compressed 27509624 29212387 0.94
tpcds_q35/datafusion:vortex-file-compressed 48835779 51063392 0.96
tpcds_q36/datafusion:vortex-file-compressed 62678664 65984188 0.95
tpcds_q37/datafusion:vortex-file-compressed 29846732 30655094 0.97
tpcds_q38/datafusion:vortex-file-compressed 49002457 52011129 0.94
tpcds_q39/datafusion:vortex-file-compressed 135711863 139566777 0.97
tpcds_q40/datafusion:vortex-file-compressed 46714945 49830705 0.94
tpcds_q41/datafusion:vortex-file-compressed 🚀 15606942 17688491 0.88
tpcds_q42/datafusion:vortex-file-compressed 16315372 17078340 0.96
tpcds_q43/datafusion:vortex-file-compressed 28612038 29950895 0.96
tpcds_q44/datafusion:vortex-file-compressed 35964971 37960957 0.95
tpcds_q45/datafusion:vortex-file-compressed 32047923 32667352 0.98
tpcds_q46/datafusion:vortex-file-compressed 40672060 43181549 0.94
tpcds_q47/datafusion:vortex-file-compressed 189759786 194402803 0.98
tpcds_q48/datafusion:vortex-file-compressed 39314573 41232336 0.95
tpcds_q49/datafusion:vortex-file-compressed 59558462 60807585 0.98
tpcds_q50/datafusion:vortex-file-compressed 41534181 43221712 0.96
tpcds_q51/datafusion:vortex-file-compressed 86554838 93195278 0.93
tpcds_q52/datafusion:vortex-file-compressed 🚀 16261173 18631976 0.87
tpcds_q53/datafusion:vortex-file-compressed 21526225 22786851 0.94
tpcds_q54/datafusion:vortex-file-compressed 37265405 38781226 0.96
tpcds_q55/datafusion:vortex-file-compressed 15948850 16275598 0.98
tpcds_q56/datafusion:vortex-file-compressed 30795207 33068423 0.93
tpcds_q57/datafusion:vortex-file-compressed 116621559 121904010 0.96
tpcds_q58/datafusion:vortex-file-compressed 64918333 65874115 0.99
tpcds_q59/datafusion:vortex-file-compressed 64591032 68311626 0.95
tpcds_q60/datafusion:vortex-file-compressed 31389356 33764450 0.93
tpcds_q61/datafusion:vortex-file-compressed 43959386 43679898 1.01
tpcds_q62/datafusion:vortex-file-compressed 28858399 29930319 0.96
tpcds_q63/datafusion:vortex-file-compressed 21414571 22653306 0.95
tpcds_q64/datafusion:vortex-file-compressed 432037730 439673639 0.98
tpcds_q65/datafusion:vortex-file-compressed 42642551 45386021 0.94
tpcds_q66/datafusion:vortex-file-compressed 82849370 84041555 0.99
tpcds_q67/datafusion:vortex-file-compressed 111267095 113381230 0.98
tpcds_q68/datafusion:vortex-file-compressed 38856043 40668475 0.96
tpcds_q69/datafusion:vortex-file-compressed 38987312 38654637 1.01
tpcds_q70/datafusion:vortex-file-compressed 103099746 103942288 0.99
tpcds_q71/datafusion:vortex-file-compressed 25003120 26448610 0.95
tpcds_q72/datafusion:vortex-file-compressed 2390140539 2401972500 1.00
tpcds_q73/datafusion:vortex-file-compressed 26560841 27391151 0.97
tpcds_q74/datafusion:vortex-file-compressed 101424674 103551481 0.98
tpcds_q75/datafusion:vortex-file-compressed 106339631 111820273 0.95
tpcds_q76/datafusion:vortex-file-compressed 27038245 27880216 0.97
tpcds_q77/datafusion:vortex-file-compressed 41009252 42314750 0.97
tpcds_q78/datafusion:vortex-file-compressed 124077387 127452399 0.97
tpcds_q79/datafusion:vortex-file-compressed 36163109 34615782 1.04
tpcds_q80/datafusion:vortex-file-compressed 95208790 97347192 0.98
tpcds_q81/datafusion:vortex-file-compressed 27499907 28624493 0.96
tpcds_q82/datafusion:vortex-file-compressed 30958731 32159551 0.96
tpcds_q83/datafusion:vortex-file-compressed 42364585 44064126 0.96
tpcds_q84/datafusion:vortex-file-compressed 13306271 13533599 0.98
tpcds_q85/datafusion:vortex-file-compressed 88884365 93215746 0.95
tpcds_q86/datafusion:vortex-file-compressed 17809191 18428444 0.97
tpcds_q87/datafusion:vortex-file-compressed 50442656 51506753 0.98
tpcds_q88/datafusion:vortex-file-compressed 56113671 60337938 0.93
tpcds_q89/datafusion:vortex-file-compressed 32223894 33534178 0.96
tpcds_q90/datafusion:vortex-file-compressed 16006735 15234266 1.05
tpcds_q91/datafusion:vortex-file-compressed 20769586 22178610 0.94
tpcds_q92/datafusion:vortex-file-compressed 19169407 20947235 0.92
tpcds_q93/datafusion:vortex-file-compressed 33633880 34128459 0.99
tpcds_q94/datafusion:vortex-file-compressed 26374116 25254295 1.04
tpcds_q95/datafusion:vortex-file-compressed 59284399 60566533 0.98
tpcds_q96/datafusion:vortex-file-compressed 14030818 13943116 1.01
tpcds_q97/datafusion:vortex-file-compressed 33783586 33161173 1.02
tpcds_q98/datafusion:vortex-file-compressed 27552906 28881131 0.95
tpcds_q99/datafusion:vortex-file-compressed 45346993 41337222 1.10
datafusion / vortex-compact (0.982x ➖, 1↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚀 27656864 31773289 0.87
tpcds_q02/datafusion:vortex-compact 53629267 54182866 0.99
tpcds_q03/datafusion:vortex-compact 22271767 24013985 0.93
tpcds_q04/datafusion:vortex-compact 294244034 304811165 0.97
tpcds_q05/datafusion:vortex-compact 51345073 50386655 1.02
tpcds_q06/datafusion:vortex-compact 45540859 46906394 0.97
tpcds_q07/datafusion:vortex-compact 53803828 56060946 0.96
tpcds_q08/datafusion:vortex-compact 39655443 38509676 1.03
tpcds_q09/datafusion:vortex-compact 63348518 63282417 1.00
tpcds_q10/datafusion:vortex-compact 51407207 54058030 0.95
tpcds_q11/datafusion:vortex-compact 166015622 176959192 0.94
tpcds_q12/datafusion:vortex-compact 25007319 25721729 0.97
tpcds_q13/datafusion:vortex-compact 95254485 97308495 0.98
tpcds_q14/datafusion:vortex-compact 202417390 210325771 0.96
tpcds_q15/datafusion:vortex-compact 33615675 34399528 0.98
tpcds_q16/datafusion:vortex-compact 33000481 34260614 0.96
tpcds_q17/datafusion:vortex-compact 75835923 79003114 0.96
tpcds_q18/datafusion:vortex-compact 79506327 80628498 0.99
tpcds_q19/datafusion:vortex-compact 32478293 33437909 0.97
tpcds_q20/datafusion:vortex-compact 26494716 26848451 0.99
tpcds_q21/datafusion:vortex-compact 131322841 134986344 0.97
tpcds_q22/datafusion:vortex-compact 58780178 60525252 0.97
tpcds_q23/datafusion:vortex-compact 147550049 150654503 0.98
tpcds_q24/datafusion:vortex-compact 113649925 120466447 0.94
tpcds_q25/datafusion:vortex-compact 80268519 81346883 0.99
tpcds_q26/datafusion:vortex-compact 46055060 47400451 0.97
tpcds_q27/datafusion:vortex-compact 125120310 128303677 0.98
tpcds_q28/datafusion:vortex-compact 77435338 78795290 0.98
tpcds_q29/datafusion:vortex-compact 77784482 80264638 0.97
tpcds_q30/datafusion:vortex-compact 28352487 28365484 1.00
tpcds_q31/datafusion:vortex-compact 110054665 113917903 0.97
tpcds_q32/datafusion:vortex-compact 26459976 27188260 0.97
tpcds_q33/datafusion:vortex-compact 38649423 37655418 1.03
tpcds_q34/datafusion:vortex-compact 35580842 36679525 0.97
tpcds_q35/datafusion:vortex-compact 55085758 56601841 0.97
tpcds_q36/datafusion:vortex-compact 79952192 83326605 0.96
tpcds_q37/datafusion:vortex-compact 46323276 45200974 1.02
tpcds_q38/datafusion:vortex-compact 56656377 58694442 0.97
tpcds_q39/datafusion:vortex-compact 141749013 137868606 1.03
tpcds_q40/datafusion:vortex-compact 51010732 52074214 0.98
tpcds_q41/datafusion:vortex-compact 18078132 18919023 0.96
tpcds_q42/datafusion:vortex-compact 20464965 20760094 0.99
tpcds_q43/datafusion:vortex-compact 34057519 33836975 1.01
tpcds_q44/datafusion:vortex-compact 55120109 52608838 1.05
tpcds_q45/datafusion:vortex-compact 37288710 37673019 0.99
tpcds_q46/datafusion:vortex-compact 52335385 51718740 1.01
tpcds_q47/datafusion:vortex-compact 203979521 205050697 0.99
tpcds_q48/datafusion:vortex-compact 74015469 77649276 0.95
tpcds_q49/datafusion:vortex-compact 70297819 69804746 1.01
tpcds_q50/datafusion:vortex-compact 49822907 51756826 0.96
tpcds_q51/datafusion:vortex-compact 96415183 98859816 0.98
tpcds_q52/datafusion:vortex-compact 20875693 20880193 1.00
tpcds_q53/datafusion:vortex-compact 28648465 29397145 0.97
tpcds_q54/datafusion:vortex-compact 44845960 45454634 0.99
tpcds_q55/datafusion:vortex-compact 19846890 21385932 0.93
tpcds_q56/datafusion:vortex-compact 37952799 38953672 0.97
tpcds_q57/datafusion:vortex-compact 127313704 130467808 0.98
tpcds_q58/datafusion:vortex-compact 71936031 74750428 0.96
tpcds_q59/datafusion:vortex-compact 74668675 76182047 0.98
tpcds_q60/datafusion:vortex-compact 38524749 39917212 0.97
tpcds_q61/datafusion:vortex-compact 56393753 57742057 0.98
tpcds_q62/datafusion:vortex-compact 31886987 31775969 1.00
tpcds_q63/datafusion:vortex-compact 29288814 28976398 1.01
tpcds_q64/datafusion:vortex-compact 473518494 483011813 0.98
tpcds_q65/datafusion:vortex-compact 56809440 57816062 0.98
tpcds_q66/datafusion:vortex-compact 89630765 86440724 1.04
tpcds_q67/datafusion:vortex-compact 116129365 114744356 1.01
tpcds_q68/datafusion:vortex-compact 54338131 52648349 1.03
tpcds_q69/datafusion:vortex-compact 49329779 50033000 0.99
tpcds_q70/datafusion:vortex-compact 107823508 114529479 0.94
tpcds_q71/datafusion:vortex-compact 33178989 33887980 0.98
tpcds_q72/datafusion:vortex-compact 2393066248 2451604666 0.98
tpcds_q73/datafusion:vortex-compact 35952845 36325672 0.99
tpcds_q74/datafusion:vortex-compact 113111437 121131662 0.93
tpcds_q75/datafusion:vortex-compact 130343319 134764048 0.97
tpcds_q76/datafusion:vortex-compact 35229538 37529307 0.94
tpcds_q77/datafusion:vortex-compact 53731700 54049164 0.99
tpcds_q78/datafusion:vortex-compact 137788948 141823705 0.97
tpcds_q79/datafusion:vortex-compact 42750493 43919684 0.97
tpcds_q80/datafusion:vortex-compact 108686528 108293791 1.00
tpcds_q81/datafusion:vortex-compact 33827667 32840264 1.03
tpcds_q82/datafusion:vortex-compact 45339236 45734023 0.99
tpcds_q83/datafusion:vortex-compact 45471729 48336389 0.94
tpcds_q84/datafusion:vortex-compact 16106984 16858166 0.96
tpcds_q85/datafusion:vortex-compact 125566574 116757686 1.08
tpcds_q86/datafusion:vortex-compact 21961043 21924507 1.00
tpcds_q87/datafusion:vortex-compact 62599313 59558348 1.05
tpcds_q88/datafusion:vortex-compact 79086077 79009433 1.00
tpcds_q89/datafusion:vortex-compact 37220816 38092536 0.98
tpcds_q90/datafusion:vortex-compact 15226485 16053773 0.95
tpcds_q91/datafusion:vortex-compact 37004806 36335188 1.02
tpcds_q92/datafusion:vortex-compact 25879321 25983867 1.00
tpcds_q93/datafusion:vortex-compact 39487647 38789483 1.02
tpcds_q94/datafusion:vortex-compact 26445194 26573743 1.00
tpcds_q95/datafusion:vortex-compact 61340223 65907528 0.93
tpcds_q96/datafusion:vortex-compact 17783200 18102185 0.98
tpcds_q97/datafusion:vortex-compact 39915861 38283475 1.04
tpcds_q98/datafusion:vortex-compact 32392605 33479178 0.97
tpcds_q99/datafusion:vortex-compact 45584404 45052842 1.01
datafusion / parquet (0.973x ➖, 1↑ 1↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30801298 32220694 0.96
tpcds_q02/datafusion:parquet 40980264 43437615 0.94
tpcds_q03/datafusion:parquet 13912302 15387462 0.90
tpcds_q04/datafusion:parquet 266768798 272487910 0.98
tpcds_q05/datafusion:parquet 39655847 43591942 0.91
tpcds_q06/datafusion:parquet 59006097 59468271 0.99
tpcds_q07/datafusion:parquet 80002266 81142814 0.99
tpcds_q08/datafusion:parquet 27253340 26806586 1.02
tpcds_q09/datafusion:parquet 45735185 45677245 1.00
tpcds_q10/datafusion:parquet 80582248 73907252 1.09
tpcds_q11/datafusion:parquet 147966375 154899206 0.96
tpcds_q12/datafusion:parquet 17658943 17379657 1.02
tpcds_q13/datafusion:parquet 76997554 75911026 1.01
tpcds_q14/datafusion:parquet 164696708 167825125 0.98
tpcds_q15/datafusion:parquet 21491084 22128298 0.97
tpcds_q16/datafusion:parquet 25015842 25825717 0.97
tpcds_q17/datafusion:parquet 62632719 66069296 0.95
tpcds_q18/datafusion:parquet 112793303 116283484 0.97
tpcds_q19/datafusion:parquet 22619444 22611905 1.00
tpcds_q20/datafusion:parquet 15774521 17463101 0.90
tpcds_q21/datafusion:parquet 18463747 19514735 0.95
tpcds_q22/datafusion:parquet 129187137 131121952 0.99
tpcds_q23/datafusion:parquet 142125319 150455161 0.94
tpcds_q24/datafusion:parquet 91904117 94351360 0.97
tpcds_q25/datafusion:parquet 65146853 64656309 1.01
tpcds_q26/datafusion:parquet 66950526 68012761 0.98
tpcds_q27/datafusion:parquet 145164071 152428207 0.95
tpcds_q28/datafusion:parquet 44070266 46051196 0.96
tpcds_q29/datafusion:parquet 63843313 66623450 0.96
tpcds_q30/datafusion:parquet 34112046 35125786 0.97
tpcds_q31/datafusion:parquet 64374906 66656805 0.97
tpcds_q32/datafusion:parquet 17751562 18744032 0.95
tpcds_q33/datafusion:parquet 27881276 27036653 1.03
tpcds_q34/datafusion:parquet 21121181 22652089 0.93
tpcds_q35/datafusion:parquet 68768338 70934926 0.97
tpcds_q36/datafusion:parquet 56605076 56047175 1.01
tpcds_q37/datafusion:parquet 18698839 19687054 0.95
tpcds_q38/datafusion:parquet 41052182 41746691 0.98
tpcds_q39/datafusion:parquet 71260661 73171321 0.97
tpcds_q40/datafusion:parquet 23120732 23533474 0.98
tpcds_q41/datafusion:parquet 13135286 13427420 0.98
tpcds_q42/datafusion:parquet 11731197 12100355 0.97
tpcds_q43/datafusion:parquet 16612885 17213382 0.97
tpcds_q44/datafusion:parquet 34611203 33789779 1.02
tpcds_q45/datafusion:parquet 28686770 28515465 1.01
tpcds_q46/datafusion:parquet 31313836 32097409 0.98
tpcds_q47/datafusion:parquet 123484813 127592535 0.97
tpcds_q48/datafusion:parquet 69353220 72471320 0.96
tpcds_q49/datafusion:parquet 53337989 56927044 0.94
tpcds_q50/datafusion:parquet 42982961 45047809 0.95
tpcds_q51/datafusion:parquet 84904503 89226324 0.95
tpcds_q52/datafusion:parquet 12190415 12172492 1.00
tpcds_q53/datafusion:parquet 17466909 18366309 0.95
tpcds_q54/datafusion:parquet 33477140 34589972 0.97
tpcds_q55/datafusion:parquet 12164134 11759602 1.03
tpcds_q56/datafusion:parquet 27163696 28094928 0.97
tpcds_q57/datafusion:parquet 97437285 101443321 0.96
tpcds_q58/datafusion:parquet 49942561 50371602 0.99
tpcds_q59/datafusion:parquet 51792057 55013791 0.94
tpcds_q60/datafusion:parquet 27511252 28476422 0.97
tpcds_q61/datafusion:parquet 42309269 42295774 1.00
tpcds_q62/datafusion:parquet 🚨 24424164 19913414 1.23
tpcds_q63/datafusion:parquet 17150369 18442432 0.93
tpcds_q64/datafusion:parquet 506841357 531471811 0.95
tpcds_q65/datafusion:parquet 38008417 38238785 0.99
tpcds_q66/datafusion:parquet 69219158 67127913 1.03
tpcds_q67/datafusion:parquet 145273194 142952552 1.02
tpcds_q68/datafusion:parquet 31872900 33212456 0.96
tpcds_q69/datafusion:parquet 67309470 70870288 0.95
tpcds_q70/datafusion:parquet 83613284 86609170 0.97
tpcds_q71/datafusion:parquet 22156287 22539909 0.98
tpcds_q72/datafusion:parquet 592736173 610619236 0.97
tpcds_q73/datafusion:parquet 20513788 21496308 0.95
tpcds_q74/datafusion:parquet 82602651 84214392 0.98
tpcds_q75/datafusion:parquet 97979631 101103324 0.97
tpcds_q76/datafusion:parquet 29624130 30486267 0.97
tpcds_q77/datafusion:parquet 37571220 39836773 0.94
tpcds_q78/datafusion:parquet 112254165 112438518 1.00
tpcds_q79/datafusion:parquet 26402482 28068884 0.94
tpcds_q80/datafusion:parquet 78779122 78298321 1.01
tpcds_q81/datafusion:parquet 32395561 33185701 0.98
tpcds_q82/datafusion:parquet 19688847 19742042 1.00
tpcds_q83/datafusion:parquet 35235878 38381032 0.92
tpcds_q84/datafusion:parquet 38612150 40211179 0.96
tpcds_q85/datafusion:parquet 149433992 151390298 0.99
tpcds_q86/datafusion:parquet 15168933 15805622 0.96
tpcds_q87/datafusion:parquet 40461166 41859996 0.97
tpcds_q88/datafusion:parquet 59464507 60069390 0.99
tpcds_q89/datafusion:parquet 21357081 21618600 0.99
tpcds_q90/datafusion:parquet 13865413 14284018 0.97
tpcds_q91/datafusion:parquet 57978866 61142724 0.95
tpcds_q92/datafusion:parquet 17927116 18463578 0.97
tpcds_q93/datafusion:parquet 30651614 32211611 0.95
tpcds_q94/datafusion:parquet 20913237 20497020 1.02
tpcds_q95/datafusion:parquet 55335488 58848636 0.94
tpcds_q96/datafusion:parquet 🚀 11333298 12933754 0.88
tpcds_q97/datafusion:parquet 29414558 30802741 0.95
tpcds_q98/datafusion:parquet 21418852 22038003 0.97
tpcds_q99/datafusion:parquet 23689712 25280261 0.94
duckdb / vortex-file-compressed (0.982x ➖, 3↑ 2↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21470438 21637019 0.99
tpcds_q02/duckdb:vortex-file-compressed 34738719 33675549 1.03
tpcds_q03/duckdb:vortex-file-compressed 32363073 32068453 1.01
tpcds_q04/duckdb:vortex-file-compressed 102765222 102717043 1.00
tpcds_q05/duckdb:vortex-file-compressed 36031119 38411676 0.94
tpcds_q06/duckdb:vortex-file-compressed 32294436 33795236 0.96
tpcds_q07/duckdb:vortex-file-compressed 19455733 19769678 0.98
tpcds_q08/duckdb:vortex-file-compressed 27724604 29511872 0.94
tpcds_q09/duckdb:vortex-file-compressed 39511252 37671636 1.05
tpcds_q10/duckdb:vortex-file-compressed 40828200 41520139 0.98
tpcds_q11/duckdb:vortex-file-compressed 58606637 61149802 0.96
tpcds_q12/duckdb:vortex-file-compressed 14602826 15264401 0.96
tpcds_q13/duckdb:vortex-file-compressed 33897718 34396555 0.99
tpcds_q14/duckdb:vortex-file-compressed 104305969 107440608 0.97
tpcds_q15/duckdb:vortex-file-compressed 26728114 27079102 0.99
tpcds_q16/duckdb:vortex-file-compressed 26392195 27510917 0.96
tpcds_q17/duckdb:vortex-file-compressed 43248585 45629709 0.95
tpcds_q18/duckdb:vortex-file-compressed 46241929 46831212 0.99
tpcds_q19/duckdb:vortex-file-compressed 32713219 33375935 0.98
tpcds_q20/duckdb:vortex-file-compressed 15918436 15793797 1.01
tpcds_q21/duckdb:vortex-file-compressed 16668787 17546594 0.95
tpcds_q22/duckdb:vortex-file-compressed 71135223 71720338 0.99
tpcds_q23/duckdb:vortex-file-compressed 104734032 109154344 0.96
tpcds_q24/duckdb:vortex-file-compressed 50448736 50264241 1.00
tpcds_q25/duckdb:vortex-file-compressed 48550475 51671099 0.94
tpcds_q26/duckdb:vortex-file-compressed 38920281 41237624 0.94
tpcds_q27/duckdb:vortex-file-compressed 47890213 48880023 0.98
tpcds_q28/duckdb:vortex-file-compressed 34634905 35240468 0.98
tpcds_q29/duckdb:vortex-file-compressed 40000886 42628799 0.94
tpcds_q30/duckdb:vortex-file-compressed 🚀 23136491 26337237 0.88
tpcds_q31/duckdb:vortex-file-compressed 37099345 36615472 1.01
tpcds_q32/duckdb:vortex-file-compressed 14050630 14599581 0.96
tpcds_q33/duckdb:vortex-file-compressed 24607181 25040853 0.98
tpcds_q34/duckdb:vortex-file-compressed 23037971 23689202 0.97
tpcds_q35/duckdb:vortex-file-compressed 63053315 63753873 0.99
tpcds_q36/duckdb:vortex-file-compressed 24140144 25159953 0.96
tpcds_q37/duckdb:vortex-file-compressed 15771004 16424328 0.96
tpcds_q38/duckdb:vortex-file-compressed 36155619 36011372 1.00
tpcds_q39/duckdb:vortex-file-compressed 34360129 35058197 0.98
tpcds_q40/duckdb:vortex-file-compressed 19403069 20491781 0.95
tpcds_q41/duckdb:vortex-file-compressed 12909234 13135895 0.98
tpcds_q42/duckdb:vortex-file-compressed 13221230 12551529 1.05
tpcds_q43/duckdb:vortex-file-compressed 22677412 21341983 1.06
tpcds_q44/duckdb:vortex-file-compressed 22507959 22835997 0.99
tpcds_q45/duckdb:vortex-file-compressed 28624669 29704725 0.96
tpcds_q46/duckdb:vortex-file-compressed 51021782 51177066 1.00
tpcds_q47/duckdb:vortex-file-compressed 46477713 47371719 0.98
tpcds_q48/duckdb:vortex-file-compressed 30560318 31634933 0.97
tpcds_q49/duckdb:vortex-file-compressed 33008579 33405318 0.99
tpcds_q50/duckdb:vortex-file-compressed 33713517 34015268 0.99
tpcds_q51/duckdb:vortex-file-compressed 98566104 102061971 0.97
tpcds_q52/duckdb:vortex-file-compressed 13290632 13022930 1.02
tpcds_q53/duckdb:vortex-file-compressed 22535862 22879753 0.98
tpcds_q54/duckdb:vortex-file-compressed 27864010 28963603 0.96
tpcds_q55/duckdb:vortex-file-compressed 🚀 13048834 14957854 0.87
tpcds_q56/duckdb:vortex-file-compressed 26483880 25376559 1.04
tpcds_q57/duckdb:vortex-file-compressed 38983098 38895412 1.00
tpcds_q58/duckdb:vortex-file-compressed 30397245 31426300 0.97
tpcds_q59/duckdb:vortex-file-compressed 67000392 68742049 0.97
tpcds_q60/duckdb:vortex-file-compressed 25925623 26364755 0.98
tpcds_q61/duckdb:vortex-file-compressed 🚨 36022442 31937308 1.13
tpcds_q62/duckdb:vortex-file-compressed 16530490 17508677 0.94
tpcds_q63/duckdb:vortex-file-compressed 🚀 20719072 23496248 0.88
tpcds_q64/duckdb:vortex-file-compressed 83277313 83393215 1.00
tpcds_q65/duckdb:vortex-file-compressed 22188779 22383180 0.99
tpcds_q66/duckdb:vortex-file-compressed 29108726 31399656 0.93
tpcds_q67/duckdb:vortex-file-compressed 134084892 141479564 0.95
tpcds_q68/duckdb:vortex-file-compressed 41241802 41714451 0.99
tpcds_q69/duckdb:vortex-file-compressed 41496344 42678533 0.97
tpcds_q70/duckdb:vortex-file-compressed 26062582 26378972 0.99
tpcds_q71/duckdb:vortex-file-compressed 20574482 22403563 0.92
tpcds_q72/duckdb:vortex-file-compressed 169838924 170573117 1.00
tpcds_q73/duckdb:vortex-file-compressed 23052466 24023141 0.96
tpcds_q74/duckdb:vortex-file-compressed 🚨 83281677 70993736 1.17
tpcds_q75/duckdb:vortex-file-compressed 57331141 56749140 1.01
tpcds_q76/duckdb:vortex-file-compressed 19980966 18463967 1.08
tpcds_q77/duckdb:vortex-file-compressed 26381615 27101119 0.97
tpcds_q78/duckdb:vortex-file-compressed 71989572 76944718 0.94
tpcds_q79/duckdb:vortex-file-compressed 32782654 33735163 0.97
tpcds_q80/duckdb:vortex-file-compressed 46800527 47811838 0.98
tpcds_q81/duckdb:vortex-file-compressed 27839314 29630663 0.94
tpcds_q82/duckdb:vortex-file-compressed 17111151 17250698 0.99
tpcds_q83/duckdb:vortex-file-compressed 25643684 24204076 1.06
tpcds_q84/duckdb:vortex-file-compressed 18838000 19669940 0.96
tpcds_q85/duckdb:vortex-file-compressed 46122071 44759906 1.03
tpcds_q86/duckdb:vortex-file-compressed 16060405 16862120 0.95
tpcds_q87/duckdb:vortex-file-compressed 40442113 40136387 1.01
tpcds_q88/duckdb:vortex-file-compressed 34957185 34040100 1.03
tpcds_q89/duckdb:vortex-file-compressed 22063582 22572051 0.98
tpcds_q90/duckdb:vortex-file-compressed 12976381 12980870 1.00
tpcds_q91/duckdb:vortex-file-compressed 32023707 33694002 0.95
tpcds_q92/duckdb:vortex-file-compressed 20241608 18933619 1.07
tpcds_q93/duckdb:vortex-file-compressed 27517183 29107134 0.95
tpcds_q94/duckdb:vortex-file-compressed 23119555 23853401 0.97
tpcds_q95/duckdb:vortex-file-compressed 147100690 139106723 1.06
tpcds_q96/duckdb:vortex-file-compressed 13118531 13688659 0.96
tpcds_q97/duckdb:vortex-file-compressed 37927670 39553046 0.96
tpcds_q98/duckdb:vortex-file-compressed 18250198 18886230 0.97
tpcds_q99/duckdb:vortex-file-compressed 27290571 28114396 0.97
duckdb / vortex-compact (0.978x ➖, 4↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 23065021 24071707 0.96
tpcds_q02/duckdb:vortex-compact 40055289 43645300 0.92
tpcds_q03/duckdb:vortex-compact 57961039 56276163 1.03
tpcds_q04/duckdb:vortex-compact 122320785 120280174 1.02
tpcds_q05/duckdb:vortex-compact 🚀 46284503 52073165 0.89
tpcds_q06/duckdb:vortex-compact 41556690 41129436 1.01
tpcds_q07/duckdb:vortex-compact 34439827 34678996 0.99
tpcds_q08/duckdb:vortex-compact 44408781 46401657 0.96
tpcds_q09/duckdb:vortex-compact 58694691 59514599 0.99
tpcds_q10/duckdb:vortex-compact 60112940 62979739 0.95
tpcds_q11/duckdb:vortex-compact 74610752 71790082 1.04
tpcds_q12/duckdb:vortex-compact 22164000 23449214 0.95
tpcds_q13/duckdb:vortex-compact 61173144 61771562 0.99
tpcds_q14/duckdb:vortex-compact 137941925 128865052 1.07
tpcds_q15/duckdb:vortex-compact 30660235 31205078 0.98
tpcds_q16/duckdb:vortex-compact 30836180 31588388 0.98
tpcds_q17/duckdb:vortex-compact 54728814 54714955 1.00
tpcds_q18/duckdb:vortex-compact 56896883 61408068 0.93
tpcds_q19/duckdb:vortex-compact 51362400 50463132 1.02
tpcds_q20/duckdb:vortex-compact 20333440 20912020 0.97
tpcds_q21/duckdb:vortex-compact 🚀 18878800 21694815 0.87
tpcds_q22/duckdb:vortex-compact 74168657 75577650 0.98
tpcds_q23/duckdb:vortex-compact 122290950 125291063 0.98
tpcds_q24/duckdb:vortex-compact 62674960 62043097 1.01
tpcds_q25/duckdb:vortex-compact 81459363 84666371 0.96
tpcds_q26/duckdb:vortex-compact 49626324 51415933 0.97
tpcds_q27/duckdb:vortex-compact 70361271 70507035 1.00
tpcds_q28/duckdb:vortex-compact 85139464 83713267 1.02
tpcds_q29/duckdb:vortex-compact 55827664 53609138 1.04
tpcds_q30/duckdb:vortex-compact 🚀 27784592 32542373 0.85
tpcds_q31/duckdb:vortex-compact 46538719 48625222 0.96
tpcds_q32/duckdb:vortex-compact 23428385 23161819 1.01
tpcds_q33/duckdb:vortex-compact 36299662 36888276 0.98
tpcds_q34/duckdb:vortex-compact 39463078 40232306 0.98
tpcds_q35/duckdb:vortex-compact 83438548 84308561 0.99
tpcds_q36/duckdb:vortex-compact 42298020 42816417 0.99
tpcds_q37/duckdb:vortex-compact 23825973 24492292 0.97
tpcds_q38/duckdb:vortex-compact 48268388 48228102 1.00
tpcds_q39/duckdb:vortex-compact 37090966 37766956 0.98
tpcds_q40/duckdb:vortex-compact 24087863 26253444 0.92
tpcds_q41/duckdb:vortex-compact 15266387 16566031 0.92
tpcds_q42/duckdb:vortex-compact 21813696 22839703 0.96
tpcds_q43/duckdb:vortex-compact 38017688 34810271 1.09
tpcds_q44/duckdb:vortex-compact 29241726 31213864 0.94
tpcds_q45/duckdb:vortex-compact 36360345 39970743 0.91
tpcds_q46/duckdb:vortex-compact 72044743 73855245 0.98
tpcds_q47/duckdb:vortex-compact 63307695 63853445 0.99
tpcds_q48/duckdb:vortex-compact 51320183 54591632 0.94
tpcds_q49/duckdb:vortex-compact 62628429 61392658 1.02
tpcds_q50/duckdb:vortex-compact 47990968 48211963 1.00
tpcds_q51/duckdb:vortex-compact 106124758 109166862 0.97
tpcds_q52/duckdb:vortex-compact 21822416 23464569 0.93
tpcds_q53/duckdb:vortex-compact 39515170 39552113 1.00
tpcds_q54/duckdb:vortex-compact 40553020 40960763 0.99
tpcds_q55/duckdb:vortex-compact 22926357 23863335 0.96
tpcds_q56/duckdb:vortex-compact 35994882 35692623 1.01
tpcds_q57/duckdb:vortex-compact 42890670 44389938 0.97
tpcds_q58/duckdb:vortex-compact 42311360 43439835 0.97
tpcds_q59/duckdb:vortex-compact 89696401 87745980 1.02
tpcds_q60/duckdb:vortex-compact 39926112 38876331 1.03
tpcds_q61/duckdb:vortex-compact 69588202 67021606 1.04
tpcds_q62/duckdb:vortex-compact 27118070 26973562 1.01
tpcds_q63/duckdb:vortex-compact 38019647 37762344 1.01
tpcds_q64/duckdb:vortex-compact 120213995 119281778 1.01
tpcds_q65/duckdb:vortex-compact 32572965 33810891 0.96
tpcds_q66/duckdb:vortex-compact 40617740 41223604 0.99
tpcds_q67/duckdb:vortex-compact 151555726 151267797 1.00
tpcds_q68/duckdb:vortex-compact 62220721 63963065 0.97
tpcds_q69/duckdb:vortex-compact 63791076 64153198 0.99
tpcds_q70/duckdb:vortex-compact 35843668 37885397 0.95
tpcds_q71/duckdb:vortex-compact 34796794 34267751 1.02
tpcds_q72/duckdb:vortex-compact 191773306 194358751 0.99
tpcds_q73/duckdb:vortex-compact 39969761 38017793 1.05
tpcds_q74/duckdb:vortex-compact 🚀 81279545 103352907 0.79
tpcds_q75/duckdb:vortex-compact 73910731 75824073 0.97
tpcds_q76/duckdb:vortex-compact 35703325 35603009 1.00
tpcds_q77/duckdb:vortex-compact 40704295 41434816 0.98
tpcds_q78/duckdb:vortex-compact 86501954 91364188 0.95
tpcds_q79/duckdb:vortex-compact 53220431 55477958 0.96
tpcds_q80/duckdb:vortex-compact 86090557 81948499 1.05
tpcds_q81/duckdb:vortex-compact 32404440 34339875 0.94
tpcds_q82/duckdb:vortex-compact 26652808 26723686 1.00
tpcds_q83/duckdb:vortex-compact 32034203 33218791 0.96
tpcds_q84/duckdb:vortex-compact 27166638 27947135 0.97
tpcds_q85/duckdb:vortex-compact 56735203 57669595 0.98
tpcds_q86/duckdb:vortex-compact 23376377 22922069 1.02
tpcds_q87/duckdb:vortex-compact 51432102 51942332 0.99
tpcds_q88/duckdb:vortex-compact 41239089 41968341 0.98
tpcds_q89/duckdb:vortex-compact 37655497 38021069 0.99
tpcds_q90/duckdb:vortex-compact 14965638 15822968 0.95
tpcds_q91/duckdb:vortex-compact 51655173 53133856 0.97
tpcds_q92/duckdb:vortex-compact 50566579 52842407 0.96
tpcds_q93/duckdb:vortex-compact 31324586 31241283 1.00
tpcds_q94/duckdb:vortex-compact 30002421 31318098 0.96
tpcds_q95/duckdb:vortex-compact 151630090 166119034 0.91
tpcds_q96/duckdb:vortex-compact 18821389 18816171 1.00
tpcds_q97/duckdb:vortex-compact 43218878 44328354 0.97
tpcds_q98/duckdb:vortex-compact 28536109 28755975 0.99
tpcds_q99/duckdb:vortex-compact 31034650 31587650 0.98
duckdb / parquet (0.991x ➖, 2↑ 1↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28184910 28517898 0.99
tpcds_q02/duckdb:parquet 22200548 22805453 0.97
tpcds_q03/duckdb:parquet 10889383 11011040 0.99
tpcds_q04/duckdb:parquet 163343692 164349286 0.99
tpcds_q05/duckdb:parquet 28733470 29038090 0.99
tpcds_q06/duckdb:parquet 26927698 27949183 0.96
tpcds_q07/duckdb:parquet 20369169 20811432 0.98
tpcds_q08/duckdb:parquet 26367537 26457677 1.00
tpcds_q09/duckdb:parquet 39659933 39720210 1.00
tpcds_q10/duckdb:parquet 33692069 32369867 1.04
tpcds_q11/duckdb:parquet 88517370 85770807 1.03
tpcds_q12/duckdb:parquet 14746349 14223420 1.04
tpcds_q13/duckdb:parquet 31996582 32517290 0.98
tpcds_q14/duckdb:parquet 98353588 99942123 0.98
tpcds_q15/duckdb:parquet 29685904 29058069 1.02
tpcds_q16/duckdb:parquet 20163007 21013885 0.96
tpcds_q17/duckdb:parquet 36643470 36254822 1.01
tpcds_q18/duckdb:parquet 43361118 44462975 0.98
tpcds_q19/duckdb:parquet 28338790 28097050 1.01
tpcds_q20/duckdb:parquet 15457453 15618044 0.99
tpcds_q21/duckdb:parquet 🚨 11280612 9899883 1.14
tpcds_q22/duckdb:parquet 🚀 63445803 72000306 0.88
tpcds_q23/duckdb:parquet 79531096 79618822 1.00
tpcds_q24/duckdb:parquet 43632223 42842947 1.02
tpcds_q25/duckdb:parquet 33044120 32499650 1.02
tpcds_q26/duckdb:parquet 36662498 35219276 1.04
tpcds_q27/duckdb:parquet 45304043 46916632 0.97
tpcds_q28/duckdb:parquet 37508487 37590905 1.00
tpcds_q29/duckdb:parquet 35626134 35001337 1.02
tpcds_q30/duckdb:parquet 34106305 34734889 0.98
tpcds_q31/duckdb:parquet 23437782 24448477 0.96
tpcds_q32/duckdb:parquet 🚀 10545524 11718280 0.90
tpcds_q33/duckdb:parquet 20299062 20380920 1.00
tpcds_q34/duckdb:parquet 19974617 20374068 0.98
tpcds_q35/duckdb:parquet 56694028 58170861 0.97
tpcds_q36/duckdb:parquet 19214516 20613672 0.93
tpcds_q37/duckdb:parquet 13146329 12152963 1.08
tpcds_q38/duckdb:parquet 34708086 33350203 1.04
tpcds_q39/duckdb:parquet 28391753 28674430 0.99
tpcds_q40/duckdb:parquet 17091706 17269632 0.99
tpcds_q41/duckdb:parquet 7374314 7583078 0.97
tpcds_q42/duckdb:parquet 9635328 9508426 1.01
tpcds_q43/duckdb:parquet 15146228 15254778 0.99
tpcds_q44/duckdb:parquet 22130841 22112363 1.00
tpcds_q45/duckdb:parquet 25688650 26749989 0.96
tpcds_q46/duckdb:parquet 45582153 43826520 1.04
tpcds_q47/duckdb:parquet 42832811 44639180 0.96
tpcds_q48/duckdb:parquet 28746003 29143196 0.99
tpcds_q49/duckdb:parquet 24653791 24036009 1.03
tpcds_q50/duckdb:parquet 23700695 23756045 1.00
tpcds_q51/duckdb:parquet 93359303 95438466 0.98
tpcds_q52/duckdb:parquet 9958458 10359056 0.96
tpcds_q53/duckdb:parquet 14617298 14911693 0.98
tpcds_q54/duckdb:parquet 25564423 25597631 1.00
tpcds_q55/duckdb:parquet 9794886 10442124 0.94
tpcds_q56/duckdb:parquet 20813040 20904975 1.00
tpcds_q57/duckdb:parquet 33647162 33468536 1.01
tpcds_q58/duckdb:parquet 21661164 21799561 0.99
tpcds_q59/duckdb:parquet 34804377 35272110 0.99
tpcds_q60/duckdb:parquet 21535274 21703340 0.99
tpcds_q61/duckdb:parquet 30389898 30114569 1.01
tpcds_q62/duckdb:parquet 12096669 11497574 1.05
tpcds_q63/duckdb:parquet 13868163 14048208 0.99
tpcds_q64/duckdb:parquet 73196325 72418244 1.01
tpcds_q65/duckdb:parquet 20382845 20517231 0.99
tpcds_q66/duckdb:parquet 30919095 28741501 1.08
tpcds_q67/duckdb:parquet 130463445 135198761 0.96
tpcds_q68/duckdb:parquet 36042964 36101628 1.00
tpcds_q69/duckdb:parquet 35735542 35426838 1.01
tpcds_q70/duckdb:parquet 19225410 18902427 1.02
tpcds_q71/duckdb:parquet 18563340 19100860 0.97
tpcds_q72/duckdb:parquet 164376819 164077069 1.00
tpcds_q73/duckdb:parquet 17272141 17553333 0.98
tpcds_q74/duckdb:parquet 125924362 128161547 0.98
tpcds_q75/duckdb:parquet 51914515 54547156 0.95
tpcds_q76/duckdb:parquet 18933247 20086416 0.94
tpcds_q77/duckdb:parquet 21117683 21870554 0.97
tpcds_q78/duckdb:parquet 74642160 74067397 1.01
tpcds_q79/duckdb:parquet 27669739 26418640 1.05
tpcds_q80/duckdb:parquet 39921332 40893903 0.98
tpcds_q81/duckdb:parquet 30304666 30359394 1.00
tpcds_q82/duckdb:parquet 13400512 13825884 0.97
tpcds_q83/duckdb:parquet 15593363 16607646 0.94
tpcds_q84/duckdb:parquet 19809854 18723396 1.06
tpcds_q85/duckdb:parquet 36481005 39420442 0.93
tpcds_q86/duckdb:parquet 11710651 12966150 0.90
tpcds_q87/duckdb:parquet 36203369 36331632 1.00
tpcds_q88/duckdb:parquet 48987342 48838049 1.00
tpcds_q89/duckdb:parquet 16961366 15802429 1.07
tpcds_q90/duckdb:parquet 7273753 7360223 0.99
tpcds_q91/duckdb:parquet 22146421 22767269 0.97
tpcds_q92/duckdb:parquet 11464341 11495196 1.00
tpcds_q93/duckdb:parquet 28310904 29133184 0.97
tpcds_q94/duckdb:parquet 15838882 15664145 1.01
tpcds_q95/duckdb:parquet 143677755 143787122 1.00
tpcds_q96/duckdb:parquet 8555712 8828602 0.97
tpcds_q97/duckdb:parquet 33862799 34652918 0.98
tpcds_q98/duckdb:parquet 16803144 17462650 0.96
tpcds_q99/duckdb:parquet 18973293 20291327 0.94
duckdb / duckdb (0.984x ➖, 2↑ 1↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20615718 20489948 1.01
tpcds_q02/duckdb:duckdb 17830210 17747351 1.00
tpcds_q03/duckdb:duckdb 8272708 8804468 0.94
tpcds_q04/duckdb:duckdb 164453748 174881505 0.94
tpcds_q05/duckdb:duckdb 19476166 19242764 1.01
tpcds_q06/duckdb:duckdb 23559536 22747249 1.04
tpcds_q07/duckdb:duckdb 37665567 38777021 0.97
tpcds_q08/duckdb:duckdb 120031647 120026417 1.00
tpcds_q09/duckdb:duckdb 19946857 19937894 1.00
tpcds_q10/duckdb:duckdb 23164974 23200500 1.00
tpcds_q11/duckdb:duckdb 85672509 87720370 0.98
tpcds_q12/duckdb:duckdb 10993513 11274719 0.98
tpcds_q13/duckdb:duckdb 24160585 23877241 1.01
tpcds_q14/duckdb:duckdb 91584643 90325524 1.01
tpcds_q15/duckdb:duckdb 22424350 24613864 0.91
tpcds_q16/duckdb:duckdb 16552986 17699132 0.94
tpcds_q17/duckdb:duckdb 21528785 21481602 1.00
tpcds_q18/duckdb:duckdb 42609553 45053882 0.95
tpcds_q19/duckdb:duckdb 15741769 16933592 0.93
tpcds_q20/duckdb:duckdb 11387549 12050086 0.95
tpcds_q21/duckdb:duckdb 🚀 6599769 7918832 0.83
tpcds_q22/duckdb:duckdb 61865733 65040256 0.95
tpcds_q23/duckdb:duckdb 74007406 79692622 0.93
tpcds_q24/duckdb:duckdb 24287973 24444611 0.99
tpcds_q25/duckdb:duckdb 17239613 16464125 1.05
tpcds_q26/duckdb:duckdb 24890163 26175544 0.95
tpcds_q27/duckdb:duckdb 38646312 38520212 1.00
tpcds_q28/duckdb:duckdb 21883214 22273172 0.98
tpcds_q29/duckdb:duckdb 20277197 20171771 1.01
tpcds_q30/duckdb:duckdb 29883817 28902946 1.03
tpcds_q31/duckdb:duckdb 45851575 48588421 0.94
tpcds_q32/duckdb:duckdb 7411819 7283181 1.02
tpcds_q33/duckdb:duckdb 12378087 12534214 0.99
tpcds_q34/duckdb:duckdb 14901501 14593423 1.02
tpcds_q35/duckdb:duckdb 32693165 31900427 1.02
tpcds_q36/duckdb:duckdb 69493268 69896260 0.99
tpcds_q37/duckdb:duckdb 7424326 7870267 0.94
tpcds_q38/duckdb:duckdb 30364865 30698326 0.99
tpcds_q39/duckdb:duckdb 🚨 28542906 25203315 1.13
tpcds_q40/duckdb:duckdb 13640524 13889917 0.98
tpcds_q41/duckdb:duckdb 8177285 7930276 1.03
tpcds_q42/duckdb:duckdb 6146850 6516530 0.94
tpcds_q43/duckdb:duckdb 11155067 11111972 1.00
tpcds_q44/duckdb:duckdb 13350275 12758454 1.05
tpcds_q45/duckdb:duckdb 17057858 17572163 0.97
tpcds_q46/duckdb:duckdb 35934702 37147958 0.97
tpcds_q47/duckdb:duckdb 40278747 39951765 1.01
tpcds_q48/duckdb:duckdb 23169600 23302886 0.99
tpcds_q49/duckdb:duckdb 16923113 16562587 1.02
tpcds_q50/duckdb:duckdb 14513621 14410952 1.01
tpcds_q51/duckdb:duckdb 89309848 93203634 0.96
tpcds_q52/duckdb:duckdb 7293542 7359698 0.99
tpcds_q53/duckdb:duckdb 12946423 13315269 0.97
tpcds_q54/duckdb:duckdb 16264881 16193354 1.00
tpcds_q55/duckdb:duckdb 7225310 7159651 1.01
tpcds_q56/duckdb:duckdb 13595047 13074869 1.04
tpcds_q57/duckdb:duckdb 30845073 33023337 0.93
tpcds_q58/duckdb:duckdb 12524752 13432513 0.93
tpcds_q59/duckdb:duckdb 35046274 35217626 1.00
tpcds_q60/duckdb:duckdb 15285428 14040043 1.09
tpcds_q61/duckdb:duckdb 14207496 14279531 0.99
tpcds_q62/duckdb:duckdb 9162506 9216703 0.99
tpcds_q63/duckdb:duckdb 12379517 12223839 1.01
tpcds_q64/duckdb:duckdb 56362259 55059038 1.02
tpcds_q65/duckdb:duckdb 34591477 35093002 0.99
tpcds_q66/duckdb:duckdb 24707443 25640860 0.96
tpcds_q67/duckdb:duckdb 127860463 129226609 0.99
tpcds_q68/duckdb:duckdb 24958722 25358849 0.98
tpcds_q69/duckdb:duckdb 24893046 24439309 1.02
tpcds_q70/duckdb:duckdb 14402047 14334231 1.00
tpcds_q71/duckdb:duckdb 12185661 12982064 0.94
tpcds_q72/duckdb:duckdb 40529867 40470152 1.00
tpcds_q73/duckdb:duckdb 10690917 10823414 0.99
tpcds_q74/duckdb:duckdb 143116539 143279945 1.00
tpcds_q75/duckdb:duckdb 40814075 42666188 0.96
tpcds_q76/duckdb:duckdb 11311410 11222032 1.01
tpcds_q77/duckdb:duckdb 12234929 12112001 1.01
tpcds_q78/duckdb:duckdb 62062276 63965733 0.97
tpcds_q79/duckdb:duckdb 18815855 18826530 1.00
tpcds_q80/duckdb:duckdb 26337799 27174876 0.97
tpcds_q81/duckdb:duckdb 37434207 38616514 0.97
tpcds_q82/duckdb:duckdb 8764606 8528313 1.03
tpcds_q83/duckdb:duckdb 9021553 9436664 0.96
tpcds_q84/duckdb:duckdb 13585065 13060708 1.04
tpcds_q85/duckdb:duckdb 23883015 23880024 1.00
tpcds_q86/duckdb:duckdb 10448201 11437521 0.91
tpcds_q87/duckdb:duckdb 33331676 34411741 0.97
tpcds_q88/duckdb:duckdb 25974113 26153703 0.99
tpcds_q89/duckdb:duckdb 14270626 14506850 0.98
tpcds_q90/duckdb:duckdb 5625302 5417793 1.04
tpcds_q91/duckdb:duckdb 12120349 13042515 0.93
tpcds_q92/duckdb:duckdb 8641307 9176476 0.94
tpcds_q93/duckdb:duckdb 21701887 21792677 1.00
tpcds_q94/duckdb:duckdb 13114531 12432339 1.05
tpcds_q95/duckdb:duckdb 🚀 106647892 127468392 0.84
tpcds_q96/duckdb:duckdb 4344078 4661640 0.93
tpcds_q97/duckdb:duckdb 28558508 30237199 0.94
tpcds_q98/duckdb:duckdb 13890489 13753530 1.01
tpcds_q99/duckdb:duckdb 15936773 16634064 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -13.0% -2.8% -10.4% +21.5% ➖ noise
1 datafusion:vortex-file-compressed -5.1% -2.8% -2.3% +18.8% ➖ noise
1 duckdb:duckdb +0.6% -2.8% +3.5% +22.0% ➖ noise
1 duckdb:vortex-compact -4.2% -2.8% -1.4% +20.1% ➖ noise
1 duckdb:vortex-file-compressed -0.8% -2.8% +2.1% +33.5% ➖ noise
2 datafusion:vortex-compact -1.0% -4.2% +3.3% +11.6% ➖ noise
2 datafusion:vortex-file-compressed +0.3% -4.2% +4.7% +10.9% ➖ noise
2 duckdb:duckdb +0.5% -4.2% +4.8% +13.2% ➖ noise
2 duckdb:vortex-compact -8.2% -4.2% -4.2% +18.9% ➖ noise
2 duckdb:vortex-file-compressed +3.2% -4.2% +7.6% +25.6% ➖ noise
3 datafusion:vortex-compact -7.3% -5.4% -1.9% +14.6% ➖ noise
3 datafusion:vortex-file-compressed -5.9% -5.4% -0.5% +10.4% ➖ noise
3 duckdb:duckdb -6.0% -5.4% -0.6% +12.3% ➖ noise
3 duckdb:vortex-compact +3.0% -5.4% +8.9% +10.2% ➖ noise
3 duckdb:vortex-file-compressed +0.9% -5.4% +6.7% +10.0% ➖ noise
4 datafusion:vortex-compact -3.5% -1.4% -2.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -4.5% -1.4% -3.2% +10.0% ➖ noise
4 duckdb:duckdb -6.0% -1.4% -4.7% +10.0% ➖ noise
4 duckdb:vortex-compact +1.7% -1.4% +3.1% +13.1% ➖ noise
4 duckdb:vortex-file-compressed +0.0% -1.4% +1.4% +10.0% ➖ noise
5 datafusion:vortex-compact +1.9% -5.1% +7.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -3.0% -5.1% +2.2% +10.0% ➖ noise
5 duckdb:duckdb +1.2% -5.1% +6.7% +14.8% ➖ noise
5 duckdb:vortex-compact -11.1% -5.1% -6.3% +18.4% ➖ noise
5 duckdb:vortex-file-compressed -6.2% -5.1% -1.1% +15.8% ➖ noise
6 datafusion:vortex-compact -2.9% -2.2% -0.7% +11.5% ➖ noise
6 datafusion:vortex-file-compressed -6.7% -2.2% -4.6% +12.1% ➖ noise
6 duckdb:duckdb +3.6% -2.2% +5.9% +12.8% ➖ noise
6 duckdb:vortex-compact +1.0% -2.2% +3.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -4.4% -2.2% -2.3% +10.0% ➖ noise
7 datafusion:vortex-compact -4.0% -1.8% -2.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -2.0% -1.8% -0.3% +10.0% ➖ noise
7 duckdb:duckdb -2.9% -1.8% -1.1% +18.4% ➖ noise
7 duckdb:vortex-compact -0.7% -1.8% +1.1% +12.8% ➖ noise
7 duckdb:vortex-file-compressed -1.6% -1.8% +0.2% +29.0% ➖ noise
8 datafusion:vortex-compact +3.0% +0.7% +2.3% +15.0% ➖ noise
8 datafusion:vortex-file-compressed -4.7% +0.7% -5.4% +10.6% ➖ noise
8 duckdb:duckdb +0.0% +0.7% -0.6% +10.0% ➖ noise
8 duckdb:vortex-compact -4.3% +0.7% -4.9% +10.1% ➖ noise
8 duckdb:vortex-file-compressed -6.1% +0.7% -6.7% +10.0% ➖ noise
9 datafusion:vortex-compact +0.1% -0.0% +0.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -4.3% -0.0% -4.3% +10.0% ➖ noise
9 duckdb:duckdb +0.0% -0.0% +0.1% +10.0% ➖ noise
9 duckdb:vortex-compact -1.4% -0.0% -1.4% +10.4% ➖ noise
9 duckdb:vortex-file-compressed +4.9% -0.0% +4.9% +12.3% ➖ noise
10 datafusion:vortex-compact -4.9% +6.5% -10.7% +11.1% ✅ faster
10 datafusion:vortex-file-compressed -5.2% +6.5% -11.0% +10.0% ✅ faster
10 duckdb:duckdb -0.2% +6.5% -6.3% +11.9% ➖ noise
10 duckdb:vortex-compact -4.6% +6.5% -10.4% +10.0% ✅ faster
10 duckdb:vortex-file-compressed -1.7% +6.5% -7.7% +10.0% ➖ noise
11 datafusion:vortex-compact -6.2% -0.7% -5.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.3% -0.7% +0.4% +10.0% ➖ noise
11 duckdb:duckdb -2.3% -0.7% -1.6% +10.0% ➖ noise
11 duckdb:vortex-compact +3.9% -0.7% +4.7% +11.6% ➖ noise
11 duckdb:vortex-file-compressed -4.2% -0.7% -3.5% +12.8% ➖ noise
12 datafusion:vortex-compact -2.8% +2.6% -5.3% +16.4% ➖ noise
12 datafusion:vortex-file-compressed -4.9% +2.6% -7.3% +13.2% ➖ noise
12 duckdb:duckdb -2.5% +2.6% -5.0% +16.6% ➖ noise
12 duckdb:vortex-compact -5.5% +2.6% -7.9% +14.3% ➖ noise
12 duckdb:vortex-file-compressed -4.3% +2.6% -6.8% +16.9% ➖ noise
13 datafusion:vortex-compact -2.1% -0.1% -2.0% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -3.8% -0.1% -3.7% +10.0% ➖ noise
13 duckdb:duckdb +1.2% -0.1% +1.3% +10.0% ➖ noise
13 duckdb:vortex-compact -1.0% -0.1% -0.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -1.5% -0.1% -1.4% +10.0% ➖ noise
14 datafusion:vortex-compact -3.8% -1.7% -2.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.7% -1.7% +0.0% +10.0% ➖ noise
14 duckdb:duckdb +1.4% -1.7% +3.2% +10.0% ➖ noise
14 duckdb:vortex-compact +7.0% -1.7% +8.9% +10.7% ➖ noise
14 duckdb:vortex-file-compressed -2.9% -1.7% -1.2% +10.0% ➖ noise
15 datafusion:vortex-compact -2.3% -0.4% -1.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.1% -0.4% +0.3% +12.3% ➖ noise
15 duckdb:duckdb -8.9% -0.4% -8.5% +11.3% ➖ noise
15 duckdb:vortex-compact -1.7% -0.4% -1.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.3% -0.4% -0.9% +10.0% ➖ noise
16 datafusion:vortex-compact -3.7% -3.6% -0.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -0.3% -3.6% +3.4% +18.5% ➖ noise
16 duckdb:duckdb -6.5% -3.6% -3.0% +13.0% ➖ noise
16 duckdb:vortex-compact -2.4% -3.6% +1.3% +10.1% ➖ noise
16 duckdb:vortex-file-compressed -4.1% -3.6% -0.5% +10.0% ➖ noise
17 datafusion:vortex-compact -4.0% -2.1% -1.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -2.3% -2.1% -0.2% +10.0% ➖ noise
17 duckdb:duckdb +0.2% -2.1% +2.4% +10.0% ➖ noise
17 duckdb:vortex-compact +0.0% -2.1% +2.2% +12.3% ➖ noise
17 duckdb:vortex-file-compressed -5.2% -2.1% -3.2% +10.0% ➖ noise
18 datafusion:vortex-compact -1.4% -2.7% +1.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -5.1% -2.7% -2.4% +10.0% ➖ noise
18 duckdb:duckdb -5.4% -2.7% -2.8% +12.0% ➖ noise
18 duckdb:vortex-compact -7.3% -2.7% -4.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.3% -2.7% +1.5% +10.7% ➖ noise
19 datafusion:vortex-compact -2.9% +0.4% -3.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -3.6% +0.4% -4.1% +11.0% ➖ noise
19 duckdb:duckdb -7.0% +0.4% -7.5% +10.2% ➖ noise
19 duckdb:vortex-compact +1.8% +0.4% +1.3% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -2.0% +0.4% -2.4% +10.0% ➖ noise
20 datafusion:vortex-compact -1.3% -5.4% +4.4% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -0.8% -5.4% +4.9% +15.3% ➖ noise
20 duckdb:duckdb -5.5% -5.4% -0.1% +13.5% ➖ noise
20 duckdb:vortex-compact -2.8% -5.4% +2.8% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.8% -5.4% +6.6% +11.5% ➖ noise
21 datafusion:vortex-compact -2.7% +3.8% -6.3% +10.3% ➖ noise
21 datafusion:vortex-file-compressed -4.6% +3.8% -8.1% +10.7% ➖ noise
21 duckdb:duckdb -16.7% +3.8% -19.7% +15.6% ✅ faster
21 duckdb:vortex-compact -13.0% +3.8% -16.2% +12.2% ✅ faster
21 duckdb:vortex-file-compressed -5.0% +3.8% -8.5% +12.6% ➖ noise
22 datafusion:vortex-compact -2.9% -6.8% +4.2% +10.7% ➖ noise
22 datafusion:vortex-file-compressed -8.0% -6.8% -1.2% +18.2% ➖ noise
22 duckdb:duckdb -4.9% -6.8% +2.1% +11.2% ➖ noise
22 duckdb:vortex-compact -1.9% -6.8% +5.3% +10.7% ➖ noise
22 duckdb:vortex-file-compressed -0.8% -6.8% +6.4% +13.5% ➖ noise
23 datafusion:vortex-compact -2.1% -2.9% +0.8% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -4.4% -2.9% -1.6% +10.0% ➖ noise
23 duckdb:duckdb -7.1% -2.9% -4.4% +14.2% ➖ noise
23 duckdb:vortex-compact -2.4% -2.9% +0.5% +16.9% ➖ noise
23 duckdb:vortex-file-compressed -4.0% -2.9% -1.2% +12.2% ➖ noise
24 datafusion:vortex-compact -5.7% -0.4% -5.3% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -3.0% -0.4% -2.6% +10.0% ➖ noise
24 duckdb:duckdb -0.6% -0.4% -0.2% +10.0% ➖ noise
24 duckdb:vortex-compact +1.0% -0.4% +1.4% +15.5% ➖ noise
24 duckdb:vortex-file-compressed +0.4% -0.4% +0.8% +12.0% ➖ noise
25 datafusion:vortex-compact -1.3% +1.2% -2.5% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -3.9% +1.2% -5.0% +10.0% ➖ noise
25 duckdb:duckdb +4.7% +1.2% +3.5% +12.7% ➖ noise
25 duckdb:vortex-compact -3.8% +1.2% -4.9% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -6.0% +1.2% -7.2% +10.0% ➖ noise
26 datafusion:vortex-compact -2.8% +1.2% -4.0% +11.3% ➖ noise
26 datafusion:vortex-file-compressed -7.0% +1.2% -8.1% +12.6% ➖ noise
26 duckdb:duckdb -4.9% +1.2% -6.1% +13.2% ➖ noise
26 duckdb:vortex-compact -3.5% +1.2% -4.7% +11.7% ➖ noise
26 duckdb:vortex-file-compressed -5.6% +1.2% -6.8% +16.9% ➖ noise
27 datafusion:vortex-compact -2.5% -4.1% +1.7% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +2.6% -4.1% +7.0% +12.5% ➖ noise
27 duckdb:duckdb +0.3% -4.1% +4.6% +18.3% ➖ noise
27 duckdb:vortex-compact -0.2% -4.1% +4.1% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -2.0% -4.1% +2.2% +15.6% ➖ noise
28 datafusion:vortex-compact -1.7% -2.3% +0.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.8% -2.3% +3.2% +10.0% ➖ noise
28 duckdb:duckdb -1.8% -2.3% +0.5% +10.0% ➖ noise
28 duckdb:vortex-compact +1.7% -2.3% +4.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -1.7% -2.3% +0.6% +10.0% ➖ noise
29 datafusion:vortex-compact -3.1% -1.2% -1.9% +11.1% ➖ noise
29 datafusion:vortex-file-compressed -9.0% -1.2% -7.9% +10.0% ➖ noise
29 duckdb:duckdb +0.5% -1.2% +1.8% +11.3% ➖ noise
29 duckdb:vortex-compact +4.1% -1.2% +5.4% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -6.2% -1.2% -5.0% +10.0% ➖ noise
30 datafusion:vortex-compact -0.0% -2.3% +2.4% +12.4% ➖ noise
30 datafusion:vortex-file-compressed -1.3% -2.3% +1.0% +15.9% ➖ noise
30 duckdb:duckdb +3.4% -2.3% +5.9% +10.5% ➖ noise
30 duckdb:vortex-compact -14.6% -2.3% -12.6% +12.6% ✅ faster
30 duckdb:vortex-file-compressed -12.2% -2.3% -10.0% +12.5% ➖ noise
31 datafusion:vortex-compact -3.4% -3.8% +0.4% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -2.8% -3.8% +1.0% +10.0% ➖ noise
31 duckdb:duckdb -5.6% -3.8% -1.9% +10.0% ➖ noise
31 duckdb:vortex-compact -4.3% -3.8% -0.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +1.3% -3.8% +5.3% +12.1% ➖ noise
32 datafusion:vortex-compact -2.7% -7.7% +5.4% +11.2% ➖ noise
32 datafusion:vortex-file-compressed -5.8% -7.7% +2.1% +10.0% ➖ noise
32 duckdb:duckdb +1.8% -7.7% +10.2% +15.7% ➖ noise
32 duckdb:vortex-compact +1.2% -7.7% +9.6% +11.1% ➖ noise
32 duckdb:vortex-file-compressed -3.8% -7.7% +4.2% +10.0% ➖ noise
33 datafusion:vortex-compact +2.6% +1.3% +1.3% +12.7% ➖ noise
33 datafusion:vortex-file-compressed -5.4% +1.3% -6.7% +11.9% ➖ noise
33 duckdb:duckdb -1.2% +1.3% -2.6% +14.3% ➖ noise
33 duckdb:vortex-compact -1.6% +1.3% -2.9% +12.0% ➖ noise
33 duckdb:vortex-file-compressed -1.7% +1.3% -3.0% +10.2% ➖ noise
34 datafusion:vortex-compact -3.0% -4.4% +1.5% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -5.8% -4.4% -1.5% +10.0% ➖ noise
34 duckdb:duckdb +2.1% -4.4% +6.8% +10.0% ➖ noise
34 duckdb:vortex-compact -1.9% -4.4% +2.6% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -2.7% -4.4% +1.7% +10.0% ➖ noise
35 datafusion:vortex-compact -2.7% -2.8% +0.1% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -4.4% -2.8% -1.6% +10.0% ➖ noise
35 duckdb:duckdb +2.5% -2.8% +5.4% +13.3% ➖ noise
35 duckdb:vortex-compact -1.0% -2.8% +1.8% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.1% -2.8% +1.7% +13.1% ➖ noise
36 datafusion:vortex-compact -4.0% -3.0% -1.1% +10.1% ➖ noise
36 datafusion:vortex-file-compressed -5.0% -3.0% -2.1% +10.0% ➖ noise
36 duckdb:duckdb -0.6% -3.0% +2.5% +10.0% ➖ noise
36 duckdb:vortex-compact -1.2% -3.0% +1.8% +10.1% ➖ noise
36 duckdb:vortex-file-compressed -4.1% -3.0% -1.1% +10.0% ➖ noise
37 datafusion:vortex-compact +2.5% +1.4% +1.1% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -2.6% +1.4% -3.9% +10.0% ➖ noise
37 duckdb:duckdb -5.7% +1.4% -6.9% +14.7% ➖ noise
37 duckdb:vortex-compact -2.7% +1.4% -4.0% +10.4% ➖ noise
37 duckdb:vortex-file-compressed -4.0% +1.4% -5.3% +10.0% ➖ noise
38 datafusion:vortex-compact -3.5% +1.2% -4.6% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -5.8% +1.2% -6.9% +10.0% ➖ noise
38 duckdb:duckdb -1.1% +1.2% -2.2% +10.6% ➖ noise
38 duckdb:vortex-compact +0.1% +1.2% -1.1% +11.9% ➖ noise
38 duckdb:vortex-file-compressed +0.4% +1.2% -0.8% +16.1% ➖ noise
39 datafusion:vortex-compact +2.8% -1.8% +4.7% +14.1% ➖ noise
39 datafusion:vortex-file-compressed -2.8% -1.8% -1.0% +18.3% ➖ noise
39 duckdb:duckdb +13.3% -1.8% +15.3% +25.0% ➖ noise
39 duckdb:vortex-compact -1.8% -1.8% +0.0% +18.5% ➖ noise
39 duckdb:vortex-file-compressed -2.0% -1.8% -0.2% +17.7% ➖ noise
40 datafusion:vortex-compact -2.0% -1.4% -0.7% +10.1% ➖ noise
40 datafusion:vortex-file-compressed -6.3% -1.4% -4.9% +10.0% ➖ noise
40 duckdb:duckdb -1.8% -1.4% -0.4% +14.9% ➖ noise
40 duckdb:vortex-compact -8.2% -1.4% -7.0% +11.3% ➖ noise
40 duckdb:vortex-file-compressed -5.3% -1.4% -4.0% +13.8% ➖ noise
41 datafusion:vortex-compact -4.4% -2.5% -2.0% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -11.8% -2.5% -9.5% +10.0% ✅ faster
41 duckdb:duckdb +3.1% -2.5% +5.7% +10.1% ➖ noise
41 duckdb:vortex-compact -7.8% -2.5% -5.5% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -1.7% -2.5% +0.8% +10.0% ➖ noise
42 datafusion:vortex-compact -1.4% -0.9% -0.5% +17.9% ➖ noise
42 datafusion:vortex-file-compressed -4.5% -0.9% -3.6% +24.8% ➖ noise
42 duckdb:duckdb -5.7% -0.9% -4.8% +13.7% ➖ noise
42 duckdb:vortex-compact -4.5% -0.9% -3.6% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +5.3% -0.9% +6.3% +10.9% ➖ noise
43 datafusion:vortex-compact +0.7% -2.1% +2.8% +11.8% ➖ noise
43 datafusion:vortex-file-compressed -4.5% -2.1% -2.4% +10.0% ➖ noise
43 duckdb:duckdb +0.4% -2.1% +2.6% +11.7% ➖ noise
43 duckdb:vortex-compact +9.2% -2.1% +11.6% +10.5% 🚨 regression
43 duckdb:vortex-file-compressed +6.3% -2.1% +8.5% +13.7% ➖ noise
44 datafusion:vortex-compact +4.8% +1.3% +3.5% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -5.3% +1.3% -6.4% +17.0% ➖ noise
44 duckdb:duckdb +4.6% +1.3% +3.3% +11.4% ➖ noise
44 duckdb:vortex-compact -6.3% +1.3% -7.5% +11.6% ➖ noise
44 duckdb:vortex-file-compressed -1.4% +1.3% -2.7% +10.3% ➖ noise
45 datafusion:vortex-compact -1.0% -1.7% +0.7% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -1.9% -1.7% -0.2% +13.5% ➖ noise
45 duckdb:duckdb -2.9% -1.7% -1.2% +11.5% ➖ noise
45 duckdb:vortex-compact -9.0% -1.7% -7.5% +11.0% ➖ noise
45 duckdb:vortex-file-compressed -3.6% -1.7% -2.0% +16.2% ➖ noise
46 datafusion:vortex-compact +1.2% +0.7% +0.5% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -5.8% +0.7% -6.5% +10.0% ➖ noise
46 duckdb:duckdb -3.3% +0.7% -4.0% +10.0% ➖ noise
46 duckdb:vortex-compact -2.5% +0.7% -3.2% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -0.3% +0.7% -1.0% +10.0% ➖ noise
47 datafusion:vortex-compact -0.5% -3.6% +3.2% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -2.4% -3.6% +1.3% +10.0% ➖ noise
47 duckdb:duckdb +0.8% -3.6% +4.6% +10.0% ➖ noise
47 duckdb:vortex-compact -0.9% -3.6% +2.9% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -1.9% -3.6% +1.8% +11.5% ➖ noise
48 datafusion:vortex-compact -4.7% -2.8% -1.9% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -4.7% -2.8% -1.9% +10.0% ➖ noise
48 duckdb:duckdb -0.6% -2.8% +2.3% +13.6% ➖ noise
48 duckdb:vortex-compact -6.0% -2.8% -3.2% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -3.4% -2.8% -0.6% +13.7% ➖ noise
49 datafusion:vortex-compact +0.7% -2.0% +2.7% +11.3% ➖ noise
49 datafusion:vortex-file-compressed -2.1% -2.0% -0.1% +10.0% ➖ noise
49 duckdb:duckdb +2.2% -2.0% +4.2% +14.1% ➖ noise
49 duckdb:vortex-compact +2.0% -2.0% +4.1% +13.4% ➖ noise
49 duckdb:vortex-file-compressed -1.2% -2.0% +0.8% +13.7% ➖ noise
50 datafusion:vortex-compact -3.7% -2.4% -1.3% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -3.9% -2.4% -1.5% +10.0% ➖ noise
50 duckdb:duckdb +0.7% -2.4% +3.2% +10.0% ➖ noise
50 duckdb:vortex-compact -0.5% -2.4% +2.0% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -0.9% -2.4% +1.6% +10.0% ➖ noise
51 datafusion:vortex-compact -2.5% -3.5% +1.1% +11.0% ➖ noise
51 datafusion:vortex-file-compressed -7.1% -3.5% -3.7% +10.0% ➖ noise
51 duckdb:duckdb -4.2% -3.5% -0.7% +21.6% ➖ noise
51 duckdb:vortex-compact -2.8% -3.5% +0.8% +16.4% ➖ noise
51 duckdb:vortex-file-compressed -3.4% -3.5% +0.1% +20.3% ➖ noise
52 datafusion:vortex-compact -0.0% -1.9% +1.9% +10.0% ➖ noise
52 datafusion:vortex-file-compressed -12.7% -1.9% -11.1% +10.7% ✅ faster
52 duckdb:duckdb -0.9% -1.9% +1.0% +14.7% ➖ noise
52 duckdb:vortex-compact -7.0% -1.9% -5.2% +10.0% ➖ noise
52 duckdb:vortex-file-compressed +2.1% -1.9% +4.0% +10.0% ➖ noise
53 datafusion:vortex-compact -2.5% -3.4% +0.9% +10.2% ➖ noise
53 datafusion:vortex-file-compressed -5.5% -3.4% -2.2% +10.0% ➖ noise
53 duckdb:duckdb -2.8% -3.4% +0.7% +10.0% ➖ noise
53 duckdb:vortex-compact -0.1% -3.4% +3.5% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -1.5% -3.4% +2.0% +10.0% ➖ noise
54 datafusion:vortex-compact -1.3% -1.7% +0.4% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -3.9% -1.7% -2.3% +10.0% ➖ noise
54 duckdb:duckdb +0.4% -1.7% +2.2% +10.6% ➖ noise
54 duckdb:vortex-compact -1.0% -1.7% +0.7% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -3.8% -1.7% -2.1% +10.0% ➖ noise
55 datafusion:vortex-compact -7.2% -1.5% -5.8% +16.5% ➖ noise
55 datafusion:vortex-file-compressed -2.0% -1.5% -0.5% +10.1% ➖ noise
55 duckdb:duckdb +0.9% -1.5% +2.5% +16.8% ➖ noise
55 duckdb:vortex-compact -3.9% -1.5% -2.5% +15.5% ➖ noise
55 duckdb:vortex-file-compressed -12.8% -1.5% -11.4% +12.2% ✅ faster
56 datafusion:vortex-compact -2.6% -1.9% -0.7% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -6.9% -1.9% -5.1% +10.0% ➖ noise
56 duckdb:duckdb +4.0% -1.9% +6.0% +10.0% ➖ noise
56 duckdb:vortex-compact +0.8% -1.9% +2.8% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +4.4% -1.9% +6.4% +16.4% ➖ noise
57 datafusion:vortex-compact -2.4% -1.7% -0.7% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -4.3% -1.7% -2.6% +10.0% ➖ noise
57 duckdb:duckdb -6.6% -1.7% -4.9% +10.0% ➖ noise
57 duckdb:vortex-compact -3.4% -1.7% -1.7% +15.1% ➖ noise
57 duckdb:vortex-file-compressed +0.2% -1.7% +2.0% +10.6% ➖ noise
58 datafusion:vortex-compact -3.8% -0.7% -3.0% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -1.5% -0.7% -0.7% +10.0% ➖ noise
58 duckdb:duckdb -6.8% -0.7% -6.1% +12.4% ➖ noise
58 duckdb:vortex-compact -2.6% -0.7% -1.9% +18.2% ➖ noise
58 duckdb:vortex-file-compressed -3.3% -0.7% -2.6% +10.6% ➖ noise
59 datafusion:vortex-compact -2.0% -3.6% +1.7% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -5.4% -3.6% -1.9% +10.0% ➖ noise
59 duckdb:duckdb -0.5% -3.6% +3.2% +10.0% ➖ noise
59 duckdb:vortex-compact +2.2% -3.6% +6.1% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -2.5% -3.6% +1.1% +10.0% ➖ noise
60 datafusion:vortex-compact -3.5% -2.1% -1.4% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -7.0% -2.1% -5.0% +11.4% ➖ noise
60 duckdb:duckdb +8.9% -2.1% +11.2% +12.2% ➖ noise
60 duckdb:vortex-compact +2.7% -2.1% +4.9% +11.7% ➖ noise
60 duckdb:vortex-file-compressed -1.7% -2.1% +0.4% +10.0% ➖ noise
61 datafusion:vortex-compact -2.3% +0.5% -2.8% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +0.6% +0.5% +0.2% +10.5% ➖ noise
61 duckdb:duckdb -0.5% +0.5% -1.0% +10.3% ➖ noise
61 duckdb:vortex-compact +3.8% +0.5% +3.3% +11.3% ➖ noise
61 duckdb:vortex-file-compressed +12.8% +0.5% +12.3% +13.5% ➖ noise
62 datafusion:vortex-compact +0.3% +13.6% -11.7% +13.8% ➖ noise
62 datafusion:vortex-file-compressed -3.6% +13.6% -15.1% +14.7% ✅ faster
62 duckdb:duckdb -0.6% +13.6% -12.5% +14.3% ➖ noise
62 duckdb:vortex-compact +0.5% +13.6% -11.5% +20.5% ➖ noise
62 duckdb:vortex-file-compressed -5.6% +13.6% -16.9% +16.3% ✅ faster
63 datafusion:vortex-compact +1.1% -4.2% +5.5% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -5.5% -4.2% -1.3% +10.0% ➖ noise
63 duckdb:duckdb +1.3% -4.2% +5.7% +10.0% ➖ noise
63 duckdb:vortex-compact +0.7% -4.2% +5.1% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -11.8% -4.2% -8.0% +14.1% ➖ noise
64 datafusion:vortex-compact -2.0% -1.8% -0.1% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -1.7% -1.8% +0.1% +10.0% ➖ noise
64 duckdb:duckdb +2.4% -1.8% +4.3% +10.0% ➖ noise
64 duckdb:vortex-compact +0.8% -1.8% +2.7% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -0.1% -1.8% +1.7% +10.0% ➖ noise
65 datafusion:vortex-compact -1.7% -0.6% -1.1% +12.8% ➖ noise
65 datafusion:vortex-file-compressed -6.0% -0.6% -5.5% +14.4% ➖ noise
65 duckdb:duckdb -1.4% -0.6% -0.8% +15.8% ➖ noise
65 duckdb:vortex-compact -3.7% -0.6% -3.1% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -0.9% -0.6% -0.2% +10.0% ➖ noise
66 datafusion:vortex-compact +3.7% +5.3% -1.5% +15.8% ➖ noise
66 datafusion:vortex-file-compressed -1.4% +5.3% -6.4% +11.1% ➖ noise
66 duckdb:duckdb -3.6% +5.3% -8.5% +21.9% ➖ noise
66 duckdb:vortex-compact -1.5% +5.3% -6.4% +16.5% ➖ noise
66 duckdb:vortex-file-compressed -7.3% +5.3% -12.0% +13.3% ✅ faster
67 datafusion:vortex-compact +1.2% -1.0% +2.2% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -1.9% -1.0% -0.9% +10.9% ➖ noise
67 duckdb:duckdb -1.1% -1.0% -0.1% +10.0% ➖ noise
67 duckdb:vortex-compact +0.2% -1.0% +1.2% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -5.2% -1.0% -4.3% +10.0% ➖ noise
68 datafusion:vortex-compact +3.2% -2.1% +5.4% +12.2% ➖ noise
68 datafusion:vortex-file-compressed -4.5% -2.1% -2.4% +10.0% ➖ noise
68 duckdb:duckdb -1.6% -2.1% +0.6% +10.0% ➖ noise
68 duckdb:vortex-compact -2.7% -2.1% -0.6% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -1.1% -2.1% +1.0% +10.0% ➖ noise
69 datafusion:vortex-compact -1.4% -2.1% +0.7% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +0.9% -2.1% +3.0% +10.0% ➖ noise
69 duckdb:duckdb +1.9% -2.1% +4.1% +10.2% ➖ noise
69 duckdb:vortex-compact -0.6% -2.1% +1.6% +11.8% ➖ noise
69 duckdb:vortex-file-compressed -2.8% -2.1% -0.7% +10.0% ➖ noise
70 datafusion:vortex-compact -5.9% -0.9% -5.0% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -0.8% -0.9% +0.1% +10.2% ➖ noise
70 duckdb:duckdb +0.5% -0.9% +1.4% +15.1% ➖ noise
70 duckdb:vortex-compact -5.4% -0.9% -4.5% +10.0% ➖ noise
70 duckdb:vortex-file-compressed -1.2% -0.9% -0.3% +20.9% ➖ noise
71 datafusion:vortex-compact -2.1% -2.3% +0.2% +14.5% ➖ noise
71 datafusion:vortex-file-compressed -5.5% -2.3% -3.3% +11.7% ➖ noise
71 duckdb:duckdb -6.1% -2.3% -4.0% +13.8% ➖ noise
71 duckdb:vortex-compact +1.5% -2.3% +3.9% +10.0% ➖ noise
71 duckdb:vortex-file-compressed -8.2% -2.3% -6.0% +12.3% ➖ noise
72 datafusion:vortex-compact -2.4% -1.4% -1.0% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -0.5% -1.4% +0.9% +10.0% ➖ noise
72 duckdb:duckdb +0.1% -1.4% +1.6% +10.1% ➖ noise
72 duckdb:vortex-compact -1.3% -1.4% +0.1% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.4% -1.4% +1.0% +10.0% ➖ noise
73 datafusion:vortex-compact -1.0% -3.1% +2.1% +25.6% ➖ noise
73 datafusion:vortex-file-compressed -3.0% -3.1% +0.1% +27.8% ➖ noise
73 duckdb:duckdb -1.2% -3.1% +1.9% +16.5% ➖ noise
73 duckdb:vortex-compact +5.1% -3.1% +8.5% +13.2% ➖ noise
73 duckdb:vortex-file-compressed -4.0% -3.1% -1.0% +13.2% ➖ noise
74 datafusion:vortex-compact -6.6% -1.8% -4.9% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -2.1% -1.8% -0.2% +16.9% ➖ noise
74 duckdb:duckdb -0.1% -1.8% +1.7% +10.0% ➖ noise
74 duckdb:vortex-compact -21.4% -1.8% -19.9% +19.0% ✅ faster
74 duckdb:vortex-file-compressed +17.3% -1.8% +19.5% +26.3% ➖ noise
75 datafusion:vortex-compact -3.3% -4.0% +0.7% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -4.9% -4.0% -1.0% +10.0% ➖ noise
75 duckdb:duckdb -4.3% -4.0% -0.4% +10.0% ➖ noise
75 duckdb:vortex-compact -2.5% -4.0% +1.5% +14.7% ➖ noise
75 duckdb:vortex-file-compressed +1.0% -4.0% +5.2% +13.7% ➖ noise
76 datafusion:vortex-compact -6.1% -4.3% -1.9% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -3.0% -4.3% +1.3% +18.3% ➖ noise
76 duckdb:duckdb +0.8% -4.3% +5.3% +17.7% ➖ noise
76 duckdb:vortex-compact +0.3% -4.3% +4.8% +10.0% ➖ noise
76 duckdb:vortex-file-compressed +8.2% -4.3% +13.1% +19.6% ➖ noise
77 datafusion:vortex-compact -0.6% -4.6% +4.2% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -3.1% -4.6% +1.6% +10.0% ➖ noise
77 duckdb:duckdb +1.0% -4.6% +5.9% +13.4% ➖ noise
77 duckdb:vortex-compact -1.8% -4.6% +2.9% +12.9% ➖ noise
77 duckdb:vortex-file-compressed -2.7% -4.6% +2.0% +15.1% ➖ noise
78 datafusion:vortex-compact -2.8% +0.3% -3.1% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -2.6% +0.3% -2.9% +10.0% ➖ noise
78 duckdb:duckdb -3.0% +0.3% -3.3% +10.0% ➖ noise
78 duckdb:vortex-compact -5.3% +0.3% -5.6% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -6.4% +0.3% -6.7% +10.0% ➖ noise
79 datafusion:vortex-compact -2.7% -0.7% -1.9% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +4.5% -0.7% +5.3% +11.7% ➖ noise
79 duckdb:duckdb -0.1% -0.7% +0.7% +10.0% ➖ noise
79 duckdb:vortex-compact -4.1% -0.7% -3.4% +10.1% ➖ noise
79 duckdb:vortex-file-compressed -2.8% -0.7% -2.1% +11.3% ➖ noise
80 datafusion:vortex-compact +0.4% -0.9% +1.3% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -2.2% -0.9% -1.3% +10.6% ➖ noise
80 duckdb:duckdb -3.1% -0.9% -2.2% +13.7% ➖ noise
80 duckdb:vortex-compact +5.1% -0.9% +6.0% +12.0% ➖ noise
80 duckdb:vortex-file-compressed -2.1% -0.9% -1.2% +10.7% ➖ noise
81 datafusion:vortex-compact +3.0% -1.3% +4.3% +10.0% ➖ noise
81 datafusion:vortex-file-compressed -3.9% -1.3% -2.7% +10.0% ➖ noise
81 duckdb:duckdb -3.1% -1.3% -1.8% +11.3% ➖ noise
81 duckdb:vortex-compact -5.6% -1.3% -4.4% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -6.0% -1.3% -4.8% +12.9% ➖ noise
82 datafusion:vortex-compact -0.9% -1.7% +0.8% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -3.7% -1.7% -2.1% +10.0% ➖ noise
82 duckdb:duckdb +2.8% -1.7% +4.5% +10.6% ➖ noise
82 duckdb:vortex-compact -0.3% -1.7% +1.4% +10.0% ➖ noise
82 duckdb:vortex-file-compressed -0.8% -1.7% +0.9% +10.0% ➖ noise
83 datafusion:vortex-compact -5.9% -7.2% +1.3% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -3.9% -7.2% +3.6% +10.0% ➖ noise
83 duckdb:duckdb -4.4% -7.2% +3.0% +12.9% ➖ noise
83 duckdb:vortex-compact -3.6% -7.2% +3.9% +17.9% ➖ noise
83 duckdb:vortex-file-compressed +5.9% -7.2% +14.1% +10.0% 🚨 regression
84 datafusion:vortex-compact -4.5% +0.8% -5.2% +12.0% ➖ noise
84 datafusion:vortex-file-compressed -1.7% +0.8% -2.5% +16.0% ➖ noise
84 duckdb:duckdb +4.0% +0.8% +3.2% +10.1% ➖ noise
84 duckdb:vortex-compact -2.8% +0.8% -3.6% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -4.2% +0.8% -5.0% +14.3% ➖ noise
85 datafusion:vortex-compact +7.5% -4.4% +12.5% +12.5% 🚨 regression
85 datafusion:vortex-file-compressed -4.6% -4.4% -0.2% +10.0% ➖ noise
85 duckdb:duckdb +0.0% -4.4% +4.6% +12.3% ➖ noise
85 duckdb:vortex-compact -1.6% -4.4% +2.9% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +3.0% -4.4% +7.8% +11.3% ➖ noise
86 datafusion:vortex-compact +0.2% -6.9% +7.6% +11.8% ➖ noise
86 datafusion:vortex-file-compressed -3.4% -6.9% +3.8% +10.0% ➖ noise
86 duckdb:duckdb -8.6% -6.9% -1.9% +18.1% ➖ noise
86 duckdb:vortex-compact +2.0% -6.9% +9.5% +12.8% ➖ noise
86 duckdb:vortex-file-compressed -4.8% -6.9% +2.3% +13.1% ➖ noise
87 datafusion:vortex-compact +5.1% -1.9% +7.1% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -2.1% -1.9% -0.2% +11.6% ➖ noise
87 duckdb:duckdb -3.1% -1.9% -1.3% +14.7% ➖ noise
87 duckdb:vortex-compact -1.0% -1.9% +0.9% +10.0% ➖ noise
87 duckdb:vortex-file-compressed +0.8% -1.9% +2.7% +10.0% ➖ noise
88 datafusion:vortex-compact +0.1% -0.4% +0.5% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -7.0% -0.4% -6.7% +10.0% ➖ noise
88 duckdb:duckdb -0.7% -0.4% -0.3% +11.3% ➖ noise
88 duckdb:vortex-compact -1.7% -0.4% -1.4% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +2.7% -0.4% +3.1% +10.0% ➖ noise
89 datafusion:vortex-compact -2.3% +3.0% -5.1% +13.9% ➖ noise
89 datafusion:vortex-file-compressed -3.9% +3.0% -6.7% +10.1% ➖ noise
89 duckdb:duckdb -1.6% +3.0% -4.5% +10.0% ➖ noise
89 duckdb:vortex-compact -1.0% +3.0% -3.8% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -2.3% +3.0% -5.1% +10.0% ➖ noise
90 datafusion:vortex-compact -5.2% -2.1% -3.2% +12.3% ➖ noise
90 datafusion:vortex-file-compressed +5.1% -2.1% +7.3% +10.0% ➖ noise
90 duckdb:duckdb +3.8% -2.1% +6.0% +11.2% ➖ noise
90 duckdb:vortex-compact -5.4% -2.1% -3.4% +11.3% ➖ noise
90 duckdb:vortex-file-compressed -0.0% -2.1% +2.1% +10.1% ➖ noise
91 datafusion:vortex-compact +1.8% -4.0% +6.0% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -6.4% -4.0% -2.5% +10.0% ➖ noise
91 duckdb:duckdb -7.1% -4.0% -3.2% +16.5% ➖ noise
91 duckdb:vortex-compact -2.8% -4.0% +1.2% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -5.0% -4.0% -1.0% +10.0% ➖ noise
92 datafusion:vortex-compact -0.4% -1.6% +1.2% +13.5% ➖ noise
92 datafusion:vortex-file-compressed -8.5% -1.6% -7.0% +11.5% ➖ noise
92 duckdb:duckdb -5.8% -1.6% -4.3% +11.4% ➖ noise
92 duckdb:vortex-compact -4.3% -1.6% -2.8% +17.3% ➖ noise
92 duckdb:vortex-file-compressed +6.9% -1.6% +8.6% +13.3% ➖ noise
93 datafusion:vortex-compact +1.8% -3.8% +5.9% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -1.4% -3.8% +2.5% +10.0% ➖ noise
93 duckdb:duckdb -0.4% -3.8% +3.6% +12.6% ➖ noise
93 duckdb:vortex-compact +0.3% -3.8% +4.3% +11.2% ➖ noise
93 duckdb:vortex-file-compressed -5.5% -3.8% -1.7% +11.6% ➖ noise
94 datafusion:vortex-compact -0.5% +1.6% -2.0% +10.0% ➖ noise
94 datafusion:vortex-file-compressed +4.4% +1.6% +2.8% +12.5% ➖ noise
94 duckdb:duckdb +5.5% +1.6% +3.9% +10.0% ➖ noise
94 duckdb:vortex-compact -4.2% +1.6% -5.7% +12.1% ➖ noise
94 duckdb:vortex-file-compressed -3.1% +1.6% -4.6% +10.0% ➖ noise
95 datafusion:vortex-compact -6.9% -3.1% -4.0% +10.1% ➖ noise
95 datafusion:vortex-file-compressed -2.1% -3.1% +1.0% +10.2% ➖ noise
95 duckdb:duckdb -16.3% -3.1% -13.7% +20.6% ➖ noise
95 duckdb:vortex-compact -8.7% -3.1% -5.8% +12.6% ➖ noise
95 duckdb:vortex-file-compressed +5.7% -3.1% +9.1% +12.0% ➖ noise
96 datafusion:vortex-compact -1.8% -7.8% +6.6% +10.1% ➖ noise
96 datafusion:vortex-file-compressed +0.6% -7.8% +9.2% +10.0% ➖ noise
96 duckdb:duckdb -6.8% -7.8% +1.1% +17.5% ➖ noise
96 duckdb:vortex-compact +0.0% -7.8% +8.5% +15.7% ➖ noise
96 duckdb:vortex-file-compressed -4.2% -7.8% +4.0% +18.1% ➖ noise
97 datafusion:vortex-compact +4.3% -3.4% +7.9% +10.8% ➖ noise
97 datafusion:vortex-file-compressed +1.9% -3.4% +5.5% +10.0% ➖ noise
97 duckdb:duckdb -5.6% -3.4% -2.2% +10.9% ➖ noise
97 duckdb:vortex-compact -2.5% -3.4% +0.9% +11.4% ➖ noise
97 duckdb:vortex-file-compressed -4.1% -3.4% -0.7% +13.0% ➖ noise
98 datafusion:vortex-compact -3.2% -3.3% +0.1% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -4.6% -3.3% -1.3% +10.4% ➖ noise
98 duckdb:duckdb +1.0% -3.3% +4.4% +13.3% ➖ noise
98 duckdb:vortex-compact -0.8% -3.3% +2.6% +10.0% ➖ noise
98 duckdb:vortex-file-compressed -3.4% -3.3% -0.1% +10.0% ➖ noise
99 datafusion:vortex-compact +1.2% -6.4% +8.1% +20.4% ➖ noise
99 datafusion:vortex-file-compressed +9.7% -6.4% +17.2% +23.3% ➖ noise
99 duckdb:duckdb -4.2% -6.4% +2.4% +26.9% ➖ noise
99 duckdb:vortex-compact -1.8% -6.4% +5.0% +30.0% ➖ noise
99 duckdb:vortex-file-compressed -2.9% -6.4% +3.7% +26.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.1%
Vortex (geomean): 1.152x ➖
Parquet (geomean): 1.086x ➖
Shifts: Parquet (control) +8.6% · Median polish +8.9%


datafusion / vortex-file-compressed (1.199x ➖, 0↑ 2↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 49434474 39228831 1.26
fineweb_q01/datafusion:vortex-file-compressed 🚨 1083537475 559158516 1.94
fineweb_q02/datafusion:vortex-file-compressed 🚨 905156298 613150956 1.48
fineweb_q03/datafusion:vortex-file-compressed 1659990526 1488342651 1.12
fineweb_q04/datafusion:vortex-file-compressed 1415347204 1396552812 1.01
fineweb_q05/datafusion:vortex-file-compressed 1518308241 1358065182 1.12
fineweb_q06/datafusion:vortex-file-compressed 1663693223 1540777229 1.08
fineweb_q07/datafusion:vortex-file-compressed 1351143046 1326531160 1.02
fineweb_q08/datafusion:vortex-file-compressed 540742021 527395268 1.03
datafusion / vortex-compact (1.151x ➖, 0↑ 2↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 42656259 34761586 1.23
fineweb_q01/datafusion:vortex-compact 610552959 604762754 1.01
fineweb_q02/datafusion:vortex-compact 526254026 524355844 1.00
fineweb_q03/datafusion:vortex-compact 1659731960 1456408706 1.14
fineweb_q04/datafusion:vortex-compact 1774298051 1815546024 0.98
fineweb_q05/datafusion:vortex-compact 1458244844 1452815731 1.00
fineweb_q06/datafusion:vortex-compact 🚨 1897553324 1354988327 1.40
fineweb_q07/datafusion:vortex-compact 1311003264 1190252514 1.10
fineweb_q08/datafusion:vortex-compact 🚨 632097395 381606044 1.66
datafusion / parquet (1.088x ➖, 0↑ 1↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1592843258 2039712867 0.78
fineweb_q01/datafusion:parquet 2032709790 2017705385 1.01
fineweb_q02/datafusion:parquet 1860750370 1751819489 1.06
fineweb_q03/datafusion:parquet 2089457613 1830046722 1.14
fineweb_q04/datafusion:parquet 2070465246 1789932797 1.16
fineweb_q05/datafusion:parquet 🚨 2588428221 1865896586 1.39
fineweb_q06/datafusion:parquet 2070033127 1853076604 1.12
fineweb_q07/datafusion:parquet 2376661101 2126716937 1.12
fineweb_q08/datafusion:parquet 2160346425 1924955745 1.12
duckdb / vortex-file-compressed (1.225x ➖, 0↑ 4↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 90196142 86724022 1.04
fineweb_q01/duckdb:vortex-file-compressed 724617402 703847971 1.03
fineweb_q02/duckdb:vortex-file-compressed 🚨 717330956 467745977 1.53
fineweb_q03/duckdb:vortex-file-compressed 🚨 1891752357 1411372148 1.34
fineweb_q04/duckdb:vortex-file-compressed 🚨 2236200360 1500018484 1.49
fineweb_q05/duckdb:vortex-file-compressed 🚨 1940824183 1451562375 1.34
fineweb_q06/duckdb:vortex-file-compressed 1810033297 1612945635 1.12
fineweb_q07/duckdb:vortex-file-compressed 1890853546 1538506884 1.23
fineweb_q08/duckdb:vortex-file-compressed 742207913 721889386 1.03
duckdb / vortex-compact (1.039x ➖, 1↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 97199172 86119286 1.13
fineweb_q01/duckdb:vortex-compact 705660911 577078836 1.22
fineweb_q02/duckdb:vortex-compact 🚀 586884557 844898069 0.69
fineweb_q03/duckdb:vortex-compact 1777100913 1687227987 1.05
fineweb_q04/duckdb:vortex-compact 1740169952 1741148360 1.00
fineweb_q05/duckdb:vortex-compact 1648611043 1586203593 1.04
fineweb_q06/duckdb:vortex-compact 1638943105 1515790680 1.08
fineweb_q07/duckdb:vortex-compact 1709906272 1339087926 1.28
fineweb_q08/duckdb:vortex-compact 577114295 590416133 0.98
duckdb / parquet (1.083x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1260524732 1251357901 1.01
fineweb_q01/duckdb:parquet 1557256488 1371732779 1.14
fineweb_q02/duckdb:parquet 1531153115 1338768125 1.14
fineweb_q03/duckdb:parquet 3997201575 3515238227 1.14
fineweb_q04/duckdb:parquet 1976143907 1935961087 1.02
fineweb_q05/duckdb:parquet 2122877524 2074591994 1.02
fineweb_q06/duckdb:parquet 4400740498 4197256841 1.05
fineweb_q07/duckdb:parquet 2733560755 2671949178 1.02
fineweb_q08/duckdb:parquet 1298060980 1058702952 1.23
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +22.7% -11.3% +38.4% +231.6% ➖ noise
0 datafusion:vortex-file-compressed +26.0% -11.3% +42.1% +197.5% ➖ noise
0 duckdb:vortex-compact +12.9% -11.3% +27.3% +79.7% ➖ noise
0 duckdb:vortex-file-compressed +4.0% -11.3% +17.3% +60.6% ➖ noise
1 datafusion:vortex-compact +1.0% +6.9% -5.6% +89.5% ➖ noise
1 datafusion:vortex-file-compressed +93.8% +6.9% +81.2% +75.7% 🚨 regression
1 duckdb:vortex-compact +22.3% +6.9% +14.3% +100.7% ➖ noise
1 duckdb:vortex-file-compressed +3.0% +6.9% -3.7% +50.7% ➖ noise
2 datafusion:vortex-compact +0.4% +10.2% -8.9% +44.0% ➖ noise
2 datafusion:vortex-file-compressed +47.6% +10.2% +33.9% +52.8% ➖ noise
2 duckdb:vortex-compact -30.5% +10.2% -37.0% +45.7% ✅ faster
2 duckdb:vortex-file-compressed +53.4% +10.2% +39.1% +33.7% 🚨 regression
3 datafusion:vortex-compact +14.0% +13.9% +0.0% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +11.5% +13.9% -2.1% +30.0% ➖ noise
3 duckdb:vortex-compact +5.3% +13.9% -7.6% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +34.0% +13.9% +17.6% +30.0% ➖ noise
4 datafusion:vortex-compact -2.3% +8.7% -10.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +1.3% +8.7% -6.7% +30.0% ➖ noise
4 duckdb:vortex-compact -0.1% +8.7% -8.0% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +49.1% +8.7% +37.2% +30.0% 🚨 regression
5 datafusion:vortex-compact +0.4% +19.1% -15.8% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +11.8% +19.1% -6.2% +30.0% ➖ noise
5 duckdb:vortex-compact +3.9% +19.1% -12.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +33.7% +19.1% +12.2% +30.0% ➖ noise
6 datafusion:vortex-compact +40.0% +8.2% +29.4% +31.1% ➖ noise
6 datafusion:vortex-file-compressed +8.0% +8.2% -0.2% +30.0% ➖ noise
6 duckdb:vortex-compact +8.1% +8.2% -0.1% +45.1% ➖ noise
6 duckdb:vortex-file-compressed +12.2% +8.2% +3.7% +30.0% ➖ noise
7 datafusion:vortex-compact +10.1% +6.9% +3.0% +32.8% ➖ noise
7 datafusion:vortex-file-compressed +1.9% +6.9% -4.7% +30.0% ➖ noise
7 duckdb:vortex-compact +27.7% +6.9% +19.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +22.9% +6.9% +14.9% +30.0% ➖ noise
8 datafusion:vortex-compact +65.6% +17.3% +41.2% +39.8% 🚨 regression
8 datafusion:vortex-file-compressed +2.5% +17.3% -12.6% +30.0% ➖ noise
8 duckdb:vortex-compact -2.3% +17.3% -16.7% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +2.8% +17.3% -12.4% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.885x ✅
Parquet (geomean): 0.939x ➖


unknown / unknown (0.909x ➖, 19↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2095761 2840412 0.74
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚀 1065695 1214066 0.88
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8479361232 8699537955 0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8301645463 8602494929 0.97
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 7887257 9185416 0.86
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 7075974 8089954 0.87
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚀 1299645 1525199 0.85
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚀 2002794 2338746 0.86
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8400198621 8696373645 0.97
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8457119905 8676316454 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12991992 14070667 0.92
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12983605 13874805 0.94
random-access/lance-tokio-local-disk 689956 747102 0.92
random-access/lance-tokio-local-disk-footer 1196431 1319446 0.91
random-access/nested-lists/correlated/lance-tokio-local-disk 256038 260442 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚀 622285 720556 0.86
random-access/nested-lists/correlated/parquet-tokio-local-disk 131283082 136801090 0.96
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 131512726 137652368 0.96
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 592830 716603 0.83
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 595550 722751 0.82
random-access/nested-lists/uniform/lance-tokio-local-disk 1070142 1147759 0.93
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1468360 1609744 0.91
random-access/nested-lists/uniform/parquet-tokio-local-disk 128483096 138664310 0.93
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 128425952 138353260 0.93
random-access/nested-lists/uniform/vortex-tokio-local-disk 2190049 2309362 0.95
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2186918 2266044 0.97
random-access/nested-structs/correlated/lance-tokio-local-disk 397973 431134 0.92
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 587489 644700 0.91
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚀 25396040 28804210 0.88
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚀 25706789 29042420 0.89
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 763739 874079 0.87
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 753706 805609 0.94
random-access/nested-structs/uniform/lance-tokio-local-disk 2629343 2819752 0.93
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2843747 3082283 0.92
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚀 25234814 29022892 0.87
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚀 25190266 28620960 0.88
random-access/nested-structs/uniform/vortex-tokio-local-disk 1670113 1754915 0.95
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1640596 1788514 0.92
random-access/parquet-tokio-local-disk 176994106 186470244 0.95
random-access/parquet-tokio-local-disk-footer 176730095 184835066 0.96
random-access/taxi/correlated/lance-tokio-local-disk 905732 978773 0.93
random-access/taxi/correlated/lance-tokio-local-disk-footer 1484036 1602865 0.93
random-access/taxi/correlated/parquet-tokio-local-disk 264620251 273077272 0.97
random-access/taxi/correlated/parquet-tokio-local-disk-footer 265640609 274767703 0.97
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1537398 2036571 0.75
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1727036 2071106 0.83
random-access/taxi/uniform/lance-tokio-local-disk 7951145 8439494 0.94
random-access/taxi/uniform/lance-tokio-local-disk-footer 8510281 9009256 0.94
random-access/taxi/uniform/parquet-tokio-local-disk 281013649 294301692 0.95
random-access/taxi/uniform/parquet-tokio-local-disk-footer 281187604 294829972 0.95
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4537934 5050566 0.90
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4499321 4900528 0.92
random-access/vortex-tokio-local-disk 🚀 1205641 1402996 0.86
random-access/vortex-tokio-local-disk-footer 🚀 1224635 1421981 0.86

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Vortex (geomean): 0.955x ➖
Parquet (geomean): 0.967x ➖
Shifts: Parquet (control) -3.3% · Median polish -4.4%


datafusion / vortex-file-compressed (0.949x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 392348450 406649933 0.96
tpch_q02/datafusion:vortex-file-compressed 110642806 116645337 0.95
tpch_q03/datafusion:vortex-file-compressed 211357369 226594049 0.93
tpch_q04/datafusion:vortex-file-compressed 111705079 120118427 0.93
tpch_q05/datafusion:vortex-file-compressed 367184533 395524293 0.93
tpch_q06/datafusion:vortex-file-compressed 45761620 48435874 0.94
tpch_q07/datafusion:vortex-file-compressed 546912381 580635131 0.94
tpch_q08/datafusion:vortex-file-compressed 352835119 374690048 0.94
tpch_q09/datafusion:vortex-file-compressed 633167083 670491518 0.94
tpch_q10/datafusion:vortex-file-compressed 250172264 265156487 0.94
tpch_q11/datafusion:vortex-file-compressed 82576189 85673856 0.96
tpch_q12/datafusion:vortex-file-compressed 119703321 126603573 0.95
tpch_q13/datafusion:vortex-file-compressed 212605427 224519081 0.95
tpch_q14/datafusion:vortex-file-compressed 58082110 60273859 0.96
tpch_q15/datafusion:vortex-file-compressed 109687787 114798128 0.96
tpch_q16/datafusion:vortex-file-compressed 75716695 78429162 0.97
tpch_q17/datafusion:vortex-file-compressed 620524132 659188927 0.94
tpch_q18/datafusion:vortex-file-compressed 831148458 876866066 0.95
tpch_q19/datafusion:vortex-file-compressed 93963717 94837044 0.99
tpch_q20/datafusion:vortex-file-compressed 168252174 177363007 0.95
tpch_q21/datafusion:vortex-file-compressed 657632914 710599335 0.93
tpch_q22/datafusion:vortex-file-compressed 65174259 68127464 0.96
datafusion / vortex-compact (0.953x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 438167956 452481948 0.97
tpch_q02/datafusion:vortex-compact 111665816 117358250 0.95
tpch_q03/datafusion:vortex-compact 215795124 226410170 0.95
tpch_q04/datafusion:vortex-compact 121875365 125956754 0.97
tpch_q05/datafusion:vortex-compact 371524154 397812262 0.93
tpch_q06/datafusion:vortex-compact 65303523 68228092 0.96
tpch_q07/datafusion:vortex-compact 565601320 590610369 0.96
tpch_q08/datafusion:vortex-compact 353351887 377273613 0.94
tpch_q09/datafusion:vortex-compact 644900190 675865499 0.95
tpch_q10/datafusion:vortex-compact 263336587 279941719 0.94
tpch_q11/datafusion:vortex-compact 81680409 87900310 0.93
tpch_q12/datafusion:vortex-compact 165949420 173444810 0.96
tpch_q13/datafusion:vortex-compact 261183189 275013788 0.95
tpch_q14/datafusion:vortex-compact 74259664 76159556 0.98
tpch_q15/datafusion:vortex-compact 162468285 169500415 0.96
tpch_q16/datafusion:vortex-compact 80202862 81688467 0.98
tpch_q17/datafusion:vortex-compact 622823633 660901757 0.94
tpch_q18/datafusion:vortex-compact 827795839 879463095 0.94
tpch_q19/datafusion:vortex-compact 130249613 135555095 0.96
tpch_q20/datafusion:vortex-compact 190875896 200230778 0.95
tpch_q21/datafusion:vortex-compact 666897173 715564825 0.93
tpch_q22/datafusion:vortex-compact 71907222 74876656 0.96
datafusion / parquet (0.955x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 481962115 492481226 0.98
tpch_q02/datafusion:parquet 170985645 182917162 0.93
tpch_q03/datafusion:parquet 289318637 301275765 0.96
tpch_q04/datafusion:parquet 131263775 139280111 0.94
tpch_q05/datafusion:parquet 433157728 465980290 0.93
tpch_q06/datafusion:parquet 133342065 132425961 1.01
tpch_q07/datafusion:parquet 606079201 640769834 0.95
tpch_q08/datafusion:parquet 464985996 500147036 0.93
tpch_q09/datafusion:parquet 742782867 784441784 0.95
tpch_q10/datafusion:parquet 491710424 514058382 0.96
tpch_q11/datafusion:parquet 120932712 130063943 0.93
tpch_q12/datafusion:parquet 214391952 212382919 1.01
tpch_q13/datafusion:parquet 328585969 345385748 0.95
tpch_q14/datafusion:parquet 163929530 167415056 0.98
tpch_q15/datafusion:parquet 256970553 266078613 0.97
tpch_q16/datafusion:parquet 126645456 134758323 0.94
tpch_q17/datafusion:parquet 671906389 716480112 0.94
tpch_q18/datafusion:parquet 882505292 933529386 0.95
tpch_q19/datafusion:parquet 282619468 298378075 0.95
tpch_q20/datafusion:parquet 291749153 305910968 0.95
tpch_q21/datafusion:parquet 697470013 744083896 0.94
tpch_q22/datafusion:parquet 209360008 211689129 0.99
datafusion / arrow (0.944x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 591725645 626267681 0.94
tpch_q02/datafusion:arrow 162891976 171126667 0.95
tpch_q03/datafusion:arrow 459239686 491292842 0.93
tpch_q04/datafusion:arrow 334273905 364559285 0.92
tpch_q05/datafusion:arrow 904446519 972036631 0.93
tpch_q06/datafusion:arrow 278303838 293453615 0.95
tpch_q07/datafusion:arrow 1141147861 1203866960 0.95
tpch_q08/datafusion:arrow 1118077358 1180267050 0.95
tpch_q09/datafusion:arrow 1329586096 1369306224 0.97
tpch_q10/datafusion:arrow 592202905 619572251 0.96
tpch_q11/datafusion:arrow 135721823 142281188 0.95
tpch_q12/datafusion:arrow 786013345 827570826 0.95
tpch_q13/datafusion:arrow 492896795 510611837 0.97
tpch_q14/datafusion:arrow 307535649 336941506 0.91
tpch_q15/datafusion:arrow 675952040 732389802 0.92
tpch_q16/datafusion:arrow 101775929 109659774 0.93
tpch_q17/datafusion:arrow 1303164168 1382103884 0.94
tpch_q18/datafusion:arrow 1836208621 1965716492 0.93
tpch_q19/datafusion:arrow 488428672 512527311 0.95
tpch_q20/datafusion:arrow 480916813 508619933 0.95
tpch_q21/datafusion:arrow 2982530122 3081129499 0.97
tpch_q22/datafusion:arrow 129601554 136777872 0.95
duckdb / vortex-file-compressed (0.954x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170525405 173421051 0.98
tpch_q02/duckdb:vortex-file-compressed 52178980 53464284 0.98
tpch_q03/duckdb:vortex-file-compressed 126914589 134676856 0.94
tpch_q04/duckdb:vortex-file-compressed 152779022 161192472 0.95
tpch_q05/duckdb:vortex-file-compressed 127480975 135797182 0.94
tpch_q06/duckdb:vortex-file-compressed 47269960 49667203 0.95
tpch_q07/duckdb:vortex-file-compressed 146231908 152149325 0.96
tpch_q08/duckdb:vortex-file-compressed 169632640 179152739 0.95
tpch_q09/duckdb:vortex-file-compressed 320530404 334359387 0.96
tpch_q10/duckdb:vortex-file-compressed 144154037 154453651 0.93
tpch_q11/duckdb:vortex-file-compressed 32827880 34692853 0.95
tpch_q12/duckdb:vortex-file-compressed 94173038 99457193 0.95
tpch_q13/duckdb:vortex-file-compressed 225615316 236176702 0.96
tpch_q14/duckdb:vortex-file-compressed 66269157 70430436 0.94
tpch_q15/duckdb:vortex-file-compressed 88195442 90722553 0.97
tpch_q16/duckdb:vortex-file-compressed 76722604 79852640 0.96
tpch_q17/duckdb:vortex-file-compressed 98405701 104067605 0.95
tpch_q18/duckdb:vortex-file-compressed 289021191 300798976 0.96
tpch_q19/duckdb:vortex-file-compressed 83491628 87242643 0.96
tpch_q20/duckdb:vortex-file-compressed 158343453 166202168 0.95
tpch_q21/duckdb:vortex-file-compressed 565146729 598591579 0.94
tpch_q22/duckdb:vortex-file-compressed 70986277 72665058 0.98
duckdb / vortex-compact (0.964x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229662102 233549136 0.98
tpch_q02/duckdb:vortex-compact 55628012 58212716 0.96
tpch_q03/duckdb:vortex-compact 138960897 143709120 0.97
tpch_q04/duckdb:vortex-compact 170356052 178127326 0.96
tpch_q05/duckdb:vortex-compact 140705327 148934821 0.94
tpch_q06/duckdb:vortex-compact 84320614 85692688 0.98
tpch_q07/duckdb:vortex-compact 197922898 205208578 0.96
tpch_q08/duckdb:vortex-compact 185891770 196135228 0.95
tpch_q09/duckdb:vortex-compact 352512527 363305952 0.97
tpch_q10/duckdb:vortex-compact 175448911 184397258 0.95
tpch_q11/duckdb:vortex-compact 40144684 42038104 0.95
tpch_q12/duckdb:vortex-compact 200778391 206232461 0.97
tpch_q13/duckdb:vortex-compact 276574072 286806693 0.96
tpch_q14/duckdb:vortex-compact 101032123 101043719 1.00
tpch_q15/duckdb:vortex-compact 110786884 116561460 0.95
tpch_q16/duckdb:vortex-compact 81319072 87159194 0.93
tpch_q17/duckdb:vortex-compact 111555969 115978831 0.96
tpch_q18/duckdb:vortex-compact 286189027 294517703 0.97
tpch_q19/duckdb:vortex-compact 106600304 109401327 0.97
tpch_q20/duckdb:vortex-compact 202252091 206142021 0.98
tpch_q21/duckdb:vortex-compact 608732451 638556565 0.95
tpch_q22/duckdb:vortex-compact 83762868 86945741 0.96
duckdb / parquet (0.978x ➖, 1↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 259359361 260084650 1.00
tpch_q02/duckdb:parquet 97617740 103178206 0.95
tpch_q03/duckdb:parquet 208339420 207378240 1.00
tpch_q04/duckdb:parquet 132416975 135604730 0.98
tpch_q05/duckdb:parquet 215646649 218928263 0.99
tpch_q06/duckdb:parquet 67386034 67774706 0.99
tpch_q07/duckdb:parquet 181069614 182266048 0.99
tpch_q08/duckdb:parquet 250261656 260267671 0.96
tpch_q09/duckdb:parquet 501076702 510239752 0.98
tpch_q10/duckdb:parquet 611451046 625282148 0.98
tpch_q11/duckdb:parquet 🚀 53683539 59796629 0.90
tpch_q12/duckdb:parquet 121704649 125014247 0.97
tpch_q13/duckdb:parquet 440209333 453317647 0.97
tpch_q14/duckdb:parquet 172791741 174912805 0.99
tpch_q15/duckdb:parquet 94241686 97274968 0.97
tpch_q16/duckdb:parquet 162304934 161474512 1.01
tpch_q17/duckdb:parquet 176148607 175318656 1.00
tpch_q18/duckdb:parquet 348915431 357027951 0.98
tpch_q19/duckdb:parquet 280192987 284054908 0.99
tpch_q20/duckdb:parquet 227364289 231490076 0.98
tpch_q21/duckdb:parquet 551455957 573603020 0.96
tpch_q22/duckdb:parquet 288359973 289180594 1.00
duckdb / duckdb (0.973x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116783394 117394393 0.99
tpch_q02/duckdb:duckdb 47101554 48892205 0.96
tpch_q03/duckdb:duckdb 96335201 98663198 0.98
tpch_q04/duckdb:duckdb 129514852 135818165 0.95
tpch_q05/duckdb:duckdb 107780762 112883329 0.95
tpch_q06/duckdb:duckdb 37305375 37529486 0.99
tpch_q07/duckdb:duckdb 86735639 88188979 0.98
tpch_q08/duckdb:duckdb 109111902 112806220 0.97
tpch_q09/duckdb:duckdb 276789041 280468536 0.99
tpch_q10/duckdb:duckdb 202438861 211641005 0.96
tpch_q11/duckdb:duckdb 15499061 16478791 0.94
tpch_q12/duckdb:duckdb 84615122 85782076 0.99
tpch_q13/duckdb:duckdb 222025939 226954989 0.98
tpch_q14/duckdb:duckdb 69686591 72455054 0.96
tpch_q15/duckdb:duckdb 76879350 78388174 0.98
tpch_q16/duckdb:duckdb 72870331 74639554 0.98
tpch_q17/duckdb:duckdb 85335751 85803137 0.99
tpch_q18/duckdb:duckdb 210328626 215448411 0.98
tpch_q19/duckdb:duckdb 116288878 117342598 0.99
tpch_q20/duckdb:duckdb 111511201 112629307 0.99
tpch_q21/duckdb:duckdb 289505182 304409882 0.95
tpch_q22/duckdb:duckdb 66223685 69429228 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -5.5% -1.2% -4.4% +10.0% ➖ noise
1 datafusion:vortex-compact -3.2% -1.2% -2.0% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -3.5% -1.2% -2.3% +10.0% ➖ noise
1 duckdb:duckdb -0.5% -1.2% +0.7% +10.0% ➖ noise
1 duckdb:vortex-compact -1.7% -1.2% -0.5% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -1.7% -1.2% -0.5% +10.0% ➖ noise
2 datafusion:arrow -4.8% -6.0% +1.2% +10.0% ➖ noise
2 datafusion:vortex-compact -4.9% -6.0% +1.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -5.1% -6.0% +0.9% +10.0% ➖ noise
2 duckdb:duckdb -3.7% -6.0% +2.4% +10.0% ➖ noise
2 duckdb:vortex-compact -4.4% -6.0% +1.6% +10.6% ➖ noise
2 duckdb:vortex-file-compressed -2.4% -6.0% +3.8% +10.0% ➖ noise
3 datafusion:arrow -6.5% -1.8% -4.8% +10.0% ➖ noise
3 datafusion:vortex-compact -4.7% -1.8% -3.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -6.7% -1.8% -5.0% +10.0% ➖ noise
3 duckdb:duckdb -2.4% -1.8% -0.6% +10.0% ➖ noise
3 duckdb:vortex-compact -3.3% -1.8% -1.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -5.8% -1.8% -4.1% +10.0% ➖ noise
4 datafusion:arrow -8.3% -4.1% -4.4% +10.0% ➖ noise
4 datafusion:vortex-compact -3.2% -4.1% +0.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -7.0% -4.1% -3.1% +10.0% ➖ noise
4 duckdb:duckdb -4.6% -4.1% -0.6% +10.0% ➖ noise
4 duckdb:vortex-compact -4.4% -4.1% -0.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -5.2% -4.1% -1.2% +10.0% ➖ noise
5 datafusion:arrow -7.0% -4.3% -2.8% +10.0% ➖ noise
5 datafusion:vortex-compact -6.6% -4.3% -2.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -7.2% -4.3% -3.0% +10.0% ➖ noise
5 duckdb:duckdb -4.5% -4.3% -0.2% +10.0% ➖ noise
5 duckdb:vortex-compact -5.5% -4.3% -1.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -6.1% -4.3% -1.9% +10.0% ➖ noise
6 datafusion:arrow -5.2% +0.1% -5.2% +10.0% ➖ noise
6 datafusion:vortex-compact -4.3% +0.1% -4.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -5.5% +0.1% -5.6% +10.0% ➖ noise
6 duckdb:duckdb -0.6% +0.1% -0.7% +10.3% ➖ noise
6 duckdb:vortex-compact -1.6% +0.1% -1.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -4.8% +0.1% -4.9% +10.0% ➖ noise
7 datafusion:arrow -5.2% -3.1% -2.2% +10.0% ➖ noise
7 datafusion:vortex-compact -4.2% -3.1% -1.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -5.8% -3.1% -2.8% +10.0% ➖ noise
7 duckdb:duckdb -1.6% -3.1% +1.5% +10.0% ➖ noise
7 duckdb:vortex-compact -3.6% -3.1% -0.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.9% -3.1% -0.9% +10.0% ➖ noise
8 datafusion:arrow -5.3% -5.5% +0.2% +10.0% ➖ noise
8 datafusion:vortex-compact -6.3% -5.5% -0.9% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -5.8% -5.5% -0.4% +10.0% ➖ noise
8 duckdb:duckdb -3.3% -5.5% +2.3% +10.0% ➖ noise
8 duckdb:vortex-compact -5.2% -5.5% +0.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -5.3% -5.5% +0.1% +10.0% ➖ noise
9 datafusion:arrow -2.9% -3.6% +0.7% +10.0% ➖ noise
9 datafusion:vortex-compact -4.6% -3.6% -1.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -5.6% -3.6% -2.1% +10.0% ➖ noise
9 duckdb:duckdb -1.3% -3.6% +2.3% +10.0% ➖ noise
9 duckdb:vortex-compact -3.0% -3.6% +0.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -4.1% -3.6% -0.6% +10.0% ➖ noise
10 datafusion:arrow -4.4% -3.3% -1.2% +10.0% ➖ noise
10 datafusion:vortex-compact -5.9% -3.3% -2.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -5.7% -3.3% -2.4% +10.0% ➖ noise
10 duckdb:duckdb -4.3% -3.3% -1.1% +10.0% ➖ noise
10 duckdb:vortex-compact -4.9% -3.3% -1.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -6.7% -3.3% -3.5% +10.0% ➖ noise
11 datafusion:arrow -4.6% -8.6% +4.4% +10.5% ➖ noise
11 datafusion:vortex-compact -7.1% -8.6% +1.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.6% -8.6% +5.5% +10.0% ➖ noise
11 duckdb:duckdb -5.9% -8.6% +2.9% +12.7% ➖ noise
11 duckdb:vortex-compact -4.5% -8.6% +4.5% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -5.4% -8.6% +3.6% +12.6% ➖ noise
12 datafusion:arrow -5.0% -0.9% -4.2% +30.3% ➖ noise
12 datafusion:vortex-compact -4.3% -0.9% -3.5% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -5.5% -0.9% -4.6% +10.0% ➖ noise
12 duckdb:duckdb -1.4% -0.9% -0.5% +10.0% ➖ noise
12 duckdb:vortex-compact -2.6% -0.9% -1.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -5.3% -0.9% -4.5% +10.0% ➖ noise
13 datafusion:arrow -3.5% -3.9% +0.4% +10.0% ➖ noise
13 datafusion:vortex-compact -5.0% -3.9% -1.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -5.3% -3.9% -1.5% +10.0% ➖ noise
13 duckdb:duckdb -2.2% -3.9% +1.8% +10.0% ➖ noise
13 duckdb:vortex-compact -3.6% -3.9% +0.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -4.5% -3.9% -0.6% +10.0% ➖ noise
14 datafusion:arrow -8.7% -1.6% -7.2% +10.0% ➖ noise
14 datafusion:vortex-compact -2.5% -1.6% -0.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -3.6% -1.6% -2.0% +10.0% ➖ noise
14 duckdb:duckdb -3.8% -1.6% -2.2% +10.0% ➖ noise
14 duckdb:vortex-compact -0.0% -1.6% +1.7% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -5.9% -1.6% -4.3% +10.0% ➖ noise
15 datafusion:arrow -7.7% -3.3% -4.6% +10.0% ➖ noise
15 datafusion:vortex-compact -4.1% -3.3% -0.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -4.5% -3.3% -1.2% +10.0% ➖ noise
15 duckdb:duckdb -1.9% -3.3% +1.4% +10.0% ➖ noise
15 duckdb:vortex-compact -5.0% -3.3% -1.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -2.8% -3.3% +0.5% +10.0% ➖ noise
16 datafusion:arrow -7.2% -2.8% -4.5% +10.0% ➖ noise
16 datafusion:vortex-compact -1.8% -2.8% +1.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -3.5% -2.8% -0.7% +10.0% ➖ noise
16 duckdb:duckdb -2.4% -2.8% +0.5% +10.0% ➖ noise
16 duckdb:vortex-compact -6.7% -2.8% -4.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -3.9% -2.8% -1.1% +10.0% ➖ noise
17 datafusion:arrow -5.7% -2.9% -2.9% +10.0% ➖ noise
17 datafusion:vortex-compact -5.8% -2.9% -2.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -5.9% -2.9% -3.0% +10.0% ➖ noise
17 duckdb:duckdb -0.5% -2.9% +2.5% +10.0% ➖ noise
17 duckdb:vortex-compact -3.8% -2.9% -0.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -5.4% -2.9% -2.6% +10.0% ➖ noise
18 datafusion:arrow -6.6% -3.9% -2.8% +10.0% ➖ noise
18 datafusion:vortex-compact -5.9% -3.9% -2.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -5.2% -3.9% -1.4% +10.0% ➖ noise
18 duckdb:duckdb -2.4% -3.9% +1.6% +10.0% ➖ noise
18 duckdb:vortex-compact -2.8% -3.9% +1.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -3.9% -3.9% -0.0% +10.0% ➖ noise
19 datafusion:arrow -4.7% -3.3% -1.4% +10.0% ➖ noise
19 datafusion:vortex-compact -3.9% -3.3% -0.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.9% -3.3% +2.5% +10.0% ➖ noise
19 duckdb:duckdb -0.9% -3.3% +2.5% +10.0% ➖ noise
19 duckdb:vortex-compact -2.6% -3.3% +0.8% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -4.3% -3.3% -1.0% +10.0% ➖ noise
20 datafusion:arrow -5.4% -3.2% -2.3% +10.0% ➖ noise
20 datafusion:vortex-compact -4.7% -3.2% -1.5% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -5.1% -3.2% -2.0% +10.0% ➖ noise
20 duckdb:duckdb -1.0% -3.2% +2.3% +10.0% ➖ noise
20 duckdb:vortex-compact -1.9% -3.2% +1.4% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -4.7% -3.2% -1.6% +10.0% ➖ noise
21 datafusion:arrow -3.2% -5.1% +2.0% +10.0% ➖ noise
21 datafusion:vortex-compact -6.8% -5.1% -1.8% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -7.5% -5.1% -2.5% +10.0% ➖ noise
21 duckdb:duckdb -4.9% -5.1% +0.2% +10.0% ➖ noise
21 duckdb:vortex-compact -4.7% -5.1% +0.4% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -5.6% -5.1% -0.5% +10.0% ➖ noise
22 datafusion:arrow -5.2% -0.7% -4.6% +10.0% ➖ noise
22 datafusion:vortex-compact -4.0% -0.7% -3.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -4.3% -0.7% -3.7% +10.0% ➖ noise
22 duckdb:duckdb -4.6% -0.7% -4.0% +10.0% ➖ noise
22 duckdb:vortex-compact -3.7% -0.7% -3.0% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -2.3% -0.7% -1.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Vortex (geomean): 1.004x ➖
Parquet (geomean): 1.016x ➖
Shifts: Parquet (control) +1.6% · Median polish +1.7%


duckdb / vortex-file-compressed (0.991x ➖, 1↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12047537 11877893 1.01
statpopgen_q01/duckdb:vortex-file-compressed 🚀 20961940 26410807 0.79
statpopgen_q02/duckdb:vortex-file-compressed 1403928947 1377933986 1.02
statpopgen_q03/duckdb:vortex-file-compressed 3170895381 3114783163 1.02
statpopgen_q04/duckdb:vortex-file-compressed 3145137823 3154771701 1.00
statpopgen_q05/duckdb:vortex-file-compressed 1496578826 1454236383 1.03
statpopgen_q06/duckdb:vortex-file-compressed 2172970334 2151915454 1.01
statpopgen_q07/duckdb:vortex-file-compressed 227774983 223584672 1.02
statpopgen_q08/duckdb:vortex-file-compressed 261691459 263025235 0.99
statpopgen_q09/duckdb:vortex-file-compressed 2979188725 2893165500 1.03
statpopgen_q10/duckdb:vortex-file-compressed 4780505642 4753842164 1.01
duckdb / vortex-compact (1.017x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11787276 11343005 1.04
statpopgen_q01/duckdb:vortex-compact 171880927 165902102 1.04
statpopgen_q02/duckdb:vortex-compact 1832962403 1806085880 1.01
statpopgen_q03/duckdb:vortex-compact 3531126610 3482392574 1.01
statpopgen_q04/duckdb:vortex-compact 3559500493 3481767199 1.02
statpopgen_q05/duckdb:vortex-compact 1835595030 1848710899 0.99
statpopgen_q06/duckdb:vortex-compact 2677004426 2660891506 1.01
statpopgen_q07/duckdb:vortex-compact 901296263 903562883 1.00
statpopgen_q08/duckdb:vortex-compact 933455467 927030731 1.01
statpopgen_q09/duckdb:vortex-compact 3418200702 3281020050 1.04
statpopgen_q10/duckdb:vortex-compact 5415883898 5310295332 1.02
duckdb / parquet (1.016x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 335256196 329024381 1.02
statpopgen_q01/duckdb:parquet 419589581 405561120 1.03
statpopgen_q02/duckdb:parquet 1009965949 993503418 1.02
statpopgen_q03/duckdb:parquet 1519026694 1505652547 1.01
statpopgen_q04/duckdb:parquet 1506796710 1498276171 1.01
statpopgen_q05/duckdb:parquet 1027952927 997296969 1.03
statpopgen_q06/duckdb:parquet 1519765523 1507823371 1.01
statpopgen_q07/duckdb:parquet 1319683267 1293782765 1.02
statpopgen_q08/duckdb:parquet 1317965768 1289218074 1.02
statpopgen_q09/duckdb:parquet 1383321899 1364451255 1.01
statpopgen_q10/duckdb:parquet 2653827400 2671077965 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +3.9% +1.9% +2.0% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +1.4% +1.9% -0.5% +11.7% ➖ noise
1 duckdb:vortex-compact +3.6% +3.5% +0.1% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -20.6% +3.5% -23.3% +196.4% ➖ noise
2 duckdb:vortex-compact +1.5% +1.7% -0.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.9% +1.7% +0.2% +10.0% ➖ noise
3 duckdb:vortex-compact +1.4% +0.9% +0.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.8% +0.9% +0.9% +10.0% ➖ noise
4 duckdb:vortex-compact +2.2% +0.6% +1.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.3% +0.6% -0.9% +10.0% ➖ noise
5 duckdb:vortex-compact -0.7% +3.1% -3.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.9% +3.1% -0.2% +10.0% ➖ noise
6 duckdb:vortex-compact +0.6% +0.8% -0.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.0% +0.8% +0.2% +10.0% ➖ noise
7 duckdb:vortex-compact -0.3% +2.0% -2.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.9% +2.0% -0.1% +10.0% ➖ noise
8 duckdb:vortex-compact +0.7% +2.2% -1.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.5% +2.2% -2.7% +10.0% ➖ noise
9 duckdb:vortex-compact +4.2% +1.4% +2.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +3.0% +1.4% +1.6% +10.0% ➖ noise
10 duckdb:vortex-compact +2.0% -0.6% +2.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.6% -0.6% +1.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.4%
Vortex (geomean): 1.019x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.4%


datafusion / vortex-file-compressed (1.008x ➖, 2↑ 1↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 2525153 1626627 1.55
clickbench_q01/datafusion:vortex-file-compressed 🚀 32668251 36945786 0.88
clickbench_q02/datafusion:vortex-file-compressed 49847692 51146363 0.97
clickbench_q03/datafusion:vortex-file-compressed 55678318 55006784 1.01
clickbench_q04/datafusion:vortex-file-compressed 291784822 295481287 0.99
clickbench_q05/datafusion:vortex-file-compressed 310630261 305922103 1.02
clickbench_q06/datafusion:vortex-file-compressed 1636060 1700348 0.96
clickbench_q07/datafusion:vortex-file-compressed 🚀 37496083 41894382 0.90
clickbench_q08/datafusion:vortex-file-compressed 364138835 368847913 0.99
clickbench_q09/datafusion:vortex-file-compressed 557832762 548154146 1.02
clickbench_q10/datafusion:vortex-file-compressed 87961526 89262590 0.99
clickbench_q11/datafusion:vortex-file-compressed 99336656 99901000 0.99
clickbench_q12/datafusion:vortex-file-compressed 275858184 272028200 1.01
clickbench_q13/datafusion:vortex-file-compressed 422138277 416237681 1.01
clickbench_q14/datafusion:vortex-file-compressed 258998604 262546147 0.99
clickbench_q15/datafusion:vortex-file-compressed 341717447 340662774 1.00
clickbench_q16/datafusion:vortex-file-compressed 654852170 646431845 1.01
clickbench_q17/datafusion:vortex-file-compressed 642013198 641832158 1.00
clickbench_q18/datafusion:vortex-file-compressed 1311358133 1293912699 1.01
clickbench_q19/datafusion:vortex-file-compressed 46981441 49856796 0.94
clickbench_q20/datafusion:vortex-file-compressed 351027704 347646922 1.01
clickbench_q21/datafusion:vortex-file-compressed 379889162 386126914 0.98
clickbench_q22/datafusion:vortex-file-compressed 452008233 458353112 0.99
clickbench_q23/datafusion:vortex-file-compressed 682039140 661629143 1.03
clickbench_q24/datafusion:vortex-file-compressed 57594977 55595468 1.04
clickbench_q25/datafusion:vortex-file-compressed 82870429 86733893 0.96
clickbench_q26/datafusion:vortex-file-compressed 54567806 52452551 1.04
clickbench_q27/datafusion:vortex-file-compressed 750753057 714721362 1.05
clickbench_q28/datafusion:vortex-file-compressed 6571085278 6708908417 0.98
clickbench_q29/datafusion:vortex-file-compressed 246636676 257530768 0.96
clickbench_q30/datafusion:vortex-file-compressed 230278864 233526653 0.99
clickbench_q31/datafusion:vortex-file-compressed 259482815 262332169 0.99
clickbench_q32/datafusion:vortex-file-compressed 1100517646 1104267940 1.00
clickbench_q33/datafusion:vortex-file-compressed 1271099568 1273350522 1.00
clickbench_q34/datafusion:vortex-file-compressed 1287925379 1273712307 1.01
clickbench_q35/datafusion:vortex-file-compressed 489964178 486918684 1.01
clickbench_q36/datafusion:vortex-file-compressed 74327771 72036876 1.03
clickbench_q37/datafusion:vortex-file-compressed 39067428 38099911 1.03
clickbench_q38/datafusion:vortex-file-compressed 22695425 22459566 1.01
clickbench_q39/datafusion:vortex-file-compressed 134742731 131670541 1.02
clickbench_q40/datafusion:vortex-file-compressed 20128314 19181908 1.05
clickbench_q41/datafusion:vortex-file-compressed 19542179 18807077 1.04
clickbench_q42/datafusion:vortex-file-compressed 21202960 20623895 1.03
datafusion / parquet (1.002x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1586425 1551382 1.02
clickbench_q01/datafusion:parquet 19483536 19403048 1.00
clickbench_q02/datafusion:parquet 46565358 46073379 1.01
clickbench_q03/datafusion:parquet 37563448 38276059 0.98
clickbench_q04/datafusion:parquet 289179573 298127924 0.97
clickbench_q05/datafusion:parquet 348380643 343447832 1.01
clickbench_q06/datafusion:parquet 1504893 1526024 0.99
clickbench_q07/datafusion:parquet 22427936 22156177 1.01
clickbench_q08/datafusion:parquet 365302241 363780121 1.00
clickbench_q09/datafusion:parquet 613463209 599811561 1.02
clickbench_q10/datafusion:parquet 105904587 110563172 0.96
clickbench_q11/datafusion:parquet 132226367 135010925 0.98
clickbench_q12/datafusion:parquet 342300850 340701402 1.00
clickbench_q13/datafusion:parquet 491276314 486467408 1.01
clickbench_q14/datafusion:parquet 344504705 340917736 1.01
clickbench_q15/datafusion:parquet 336539130 326824116 1.03
clickbench_q16/datafusion:parquet 660116291 645402033 1.02
clickbench_q17/datafusion:parquet 637251245 641830334 0.99
clickbench_q18/datafusion:parquet 1297493222 1288219701 1.01
clickbench_q19/datafusion:parquet 28435791 28884562 0.98
clickbench_q20/datafusion:parquet 599106314 598539452 1.00
clickbench_q21/datafusion:parquet 659138071 667986176 0.99
clickbench_q22/datafusion:parquet 969909338 966953089 1.00
clickbench_q23/datafusion:parquet 3682396276 3704042438 0.99
clickbench_q24/datafusion:parquet 81658409 83400559 0.98
clickbench_q25/datafusion:parquet 139442360 137147159 1.02
clickbench_q26/datafusion:parquet 83303238 82735886 1.01
clickbench_q27/datafusion:parquet 1043750353 1028239367 1.02
clickbench_q28/datafusion:parquet 6443972929 6557040336 0.98
clickbench_q29/datafusion:parquet 235084409 238811260 0.98
clickbench_q30/datafusion:parquet 331104349 328094178 1.01
clickbench_q31/datafusion:parquet 366173923 360408026 1.02
clickbench_q32/datafusion:parquet 1185635274 1198760920 0.99
clickbench_q33/datafusion:parquet 1456046438 1444431941 1.01
clickbench_q34/datafusion:parquet 1456930667 1466616020 0.99
clickbench_q35/datafusion:parquet 483457256 469790358 1.03
clickbench_q36/datafusion:parquet 138669614 135545671 1.02
clickbench_q37/datafusion:parquet 59234624 58776049 1.01
clickbench_q38/datafusion:parquet 85508731 82699523 1.03
clickbench_q39/datafusion:parquet 256574459 254975310 1.01
clickbench_q40/datafusion:parquet 29160898 29975434 0.97
clickbench_q41/datafusion:parquet 27019289 26657240 1.01
clickbench_q42/datafusion:parquet 28823023 28820315 1.00
duckdb / vortex-file-compressed (1.031x ➖, 0↑ 3↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6052520 5889363 1.03
clickbench_q01/duckdb:vortex-file-compressed 13231583 13730981 0.96
clickbench_q02/duckdb:vortex-file-compressed 26053201 26174130 1.00
clickbench_q03/duckdb:vortex-file-compressed 29166763 30021322 0.97
clickbench_q04/duckdb:vortex-file-compressed 180606627 177960779 1.01
clickbench_q05/duckdb:vortex-file-compressed 168974827 166923401 1.01
clickbench_q06/duckdb:vortex-file-compressed 18435558 17699630 1.04
clickbench_q07/duckdb:vortex-file-compressed 15947895 14850026 1.07
clickbench_q08/duckdb:vortex-file-compressed 255943949 254981943 1.00
clickbench_q09/duckdb:vortex-file-compressed 332019644 334455421 0.99
clickbench_q10/duckdb:vortex-file-compressed 66874632 67363223 0.99
clickbench_q11/duckdb:vortex-file-compressed 76091272 79151100 0.96
clickbench_q12/duckdb:vortex-file-compressed 189209830 188942199 1.00
clickbench_q13/duckdb:vortex-file-compressed 404568590 397186536 1.02
clickbench_q14/duckdb:vortex-file-compressed 223414095 222431085 1.00
clickbench_q15/duckdb:vortex-file-compressed 235572627 236181402 1.00
clickbench_q16/duckdb:vortex-file-compressed 580453582 593874792 0.98
clickbench_q17/duckdb:vortex-file-compressed 473884667 467254960 1.01
clickbench_q18/duckdb:vortex-file-compressed 963615750 956377959 1.01
clickbench_q19/duckdb:vortex-file-compressed 21355169 21836887 0.98
clickbench_q20/duckdb:vortex-file-compressed 337831212 342337436 0.99
clickbench_q21/duckdb:vortex-file-compressed 371493041 369872531 1.00
clickbench_q22/duckdb:vortex-file-compressed 578028424 570108818 1.01
clickbench_q23/duckdb:vortex-file-compressed 🚨 1078588596 518463088 2.08
clickbench_q24/duckdb:vortex-file-compressed 🚨 43283124 38886901 1.11
clickbench_q25/duckdb:vortex-file-compressed 76162023 72292674 1.05
clickbench_q26/duckdb:vortex-file-compressed 46038906 46631785 0.99
clickbench_q27/duckdb:vortex-file-compressed 476624904 473254644 1.01
clickbench_q28/duckdb:vortex-file-compressed 2963445362 2951218417 1.00
clickbench_q29/duckdb:vortex-file-compressed 🚨 31640357 28644414 1.10
clickbench_q30/duckdb:vortex-file-compressed 191700423 188493960 1.02
clickbench_q31/duckdb:vortex-file-compressed 278350869 277200259 1.00
clickbench_q32/duckdb:vortex-file-compressed 1225165927 1121382617 1.09
clickbench_q33/duckdb:vortex-file-compressed 1160615230 1151536443 1.01
clickbench_q34/duckdb:vortex-file-compressed 1219740845 1226663715 0.99
clickbench_q35/duckdb:vortex-file-compressed 377013477 388470905 0.97
clickbench_q36/duckdb:vortex-file-compressed 30513827 28224352 1.08
clickbench_q37/duckdb:vortex-file-compressed 21870175 20891509 1.05
clickbench_q38/duckdb:vortex-file-compressed 22608663 23220417 0.97
clickbench_q39/duckdb:vortex-file-compressed 42579640 39478295 1.08
clickbench_q40/duckdb:vortex-file-compressed 21176989 22615837 0.94
clickbench_q41/duckdb:vortex-file-compressed 21873601 21822879 1.00
clickbench_q42/duckdb:vortex-file-compressed 23178251 21459314 1.08
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 26087080 25473302 1.02
clickbench_q01/duckdb:parquet 27762098 28487314 0.97
clickbench_q02/duckdb:parquet 48240955 48064203 1.00
clickbench_q03/duckdb:parquet 37187409 38353756 0.97
clickbench_q04/duckdb:parquet 199820454 198657107 1.01
clickbench_q05/duckdb:parquet 261589296 263602191 0.99
clickbench_q06/duckdb:parquet 46197533 45674070 1.01
clickbench_q07/duckdb:parquet 29851632 29872198 1.00
clickbench_q08/duckdb:parquet 268806920 267009177 1.01
clickbench_q09/duckdb:parquet 395096325 395922758 1.00
clickbench_q10/duckdb:parquet 79870450 80166908 1.00
clickbench_q11/duckdb:parquet 97559640 97803696 1.00
clickbench_q12/duckdb:parquet 289193720 284511841 1.02
clickbench_q13/duckdb:parquet 481043415 480446631 1.00
clickbench_q14/duckdb:parquet 322861930 324322327 1.00
clickbench_q15/duckdb:parquet 257133496 255629467 1.01
clickbench_q16/duckdb:parquet 637803615 640681292 1.00
clickbench_q17/duckdb:parquet 527036313 534900569 0.99
clickbench_q18/duckdb:parquet 1051874283 1068431350 0.98
clickbench_q19/duckdb:parquet 25510799 26028448 0.98
clickbench_q20/duckdb:parquet 421247562 425386109 0.99
clickbench_q21/duckdb:parquet 536888694 547724490 0.98
clickbench_q22/duckdb:parquet 934694415 925817189 1.01
clickbench_q23/duckdb:parquet 309626093 311226330 0.99
clickbench_q24/duckdb:parquet 66915616 66833249 1.00
clickbench_q25/duckdb:parquet 155512620 155728942 1.00
clickbench_q26/duckdb:parquet 48668487 49154911 0.99
clickbench_q27/duckdb:parquet 641658741 644901529 0.99
clickbench_q28/duckdb:parquet 4830838809 4806977921 1.00
clickbench_q29/duckdb:parquet 40956218 40643522 1.01
clickbench_q30/duckdb:parquet 300510806 300177189 1.00
clickbench_q31/duckdb:parquet 358359787 359502465 1.00
clickbench_q32/duckdb:parquet 1193937440 1158196820 1.03
clickbench_q33/duckdb:parquet 1350728137 1259974464 1.07
clickbench_q34/duckdb:parquet 1393377849 1387408162 1.00
clickbench_q35/duckdb:parquet 359890700 363472334 0.99
clickbench_q36/duckdb:parquet 40461999 44682817 0.91
clickbench_q37/duckdb:parquet 33786687 30880859 1.09
clickbench_q38/duckdb:parquet 31815949 33955896 0.94
clickbench_q39/duckdb:parquet 87015768 80025079 1.09
clickbench_q40/duckdb:parquet 17996843 17274570 1.04
clickbench_q41/duckdb:parquet 18198049 18180418 1.00
clickbench_q42/duckdb:parquet 20260214 21508927 0.94
duckdb / duckdb (1.005x ➖, 0↑ 1↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17063034 17000633 1.00
clickbench_q01/duckdb:duckdb 32771471 32438585 1.01
clickbench_q02/duckdb:duckdb 45248622 44389866 1.02
clickbench_q03/duckdb:duckdb 46115165 46255182 1.00
clickbench_q04/duckdb:duckdb 183350550 186825878 0.98
clickbench_q05/duckdb:duckdb 267641606 264876659 1.01
clickbench_q06/duckdb:duckdb 34535507 35203096 0.98
clickbench_q07/duckdb:duckdb 35327219 34763060 1.02
clickbench_q08/duckdb:duckdb 249093248 247182112 1.01
clickbench_q09/duckdb:duckdb 361133872 366460031 0.99
clickbench_q10/duckdb:duckdb 97391432 97434511 1.00
clickbench_q11/duckdb:duckdb 105173720 106819818 0.98
clickbench_q12/duckdb:duckdb 237623031 236471713 1.00
clickbench_q13/duckdb:duckdb 485672629 498751300 0.97
clickbench_q14/duckdb:duckdb 271473822 281252456 0.97
clickbench_q15/duckdb:duckdb 216472320 217184948 1.00
clickbench_q16/duckdb:duckdb 655714726 668064209 0.98
clickbench_q17/duckdb:duckdb 568844671 575834291 0.99
clickbench_q18/duckdb:duckdb 1271293748 1249119297 1.02
clickbench_q19/duckdb:duckdb 33627788 33802150 0.99
clickbench_q20/duckdb:duckdb 1185479191 1102040147 1.08
clickbench_q21/duckdb:duckdb 1158190156 1196005980 0.97
clickbench_q22/duckdb:duckdb 1209439891 1134482675 1.07
clickbench_q23/duckdb:duckdb 255206704 247855694 1.03
clickbench_q24/duckdb:duckdb 60574697 60750193 1.00
clickbench_q25/duckdb:duckdb 142605734 141826638 1.01
clickbench_q26/duckdb:duckdb 58386860 59966486 0.97
clickbench_q27/duckdb:duckdb 1162404063 1167171313 1.00
clickbench_q28/duckdb:duckdb 4646719577 4582047010 1.01
clickbench_q29/duckdb:duckdb 48338946 48438077 1.00
clickbench_q30/duckdb:duckdb 264607070 261707471 1.01
clickbench_q31/duckdb:duckdb 424488241 462522003 0.92
clickbench_q32/duckdb:duckdb 1581997191 1669495903 0.95
clickbench_q33/duckdb:duckdb 🚨 2201696043 1952484334 1.13
clickbench_q34/duckdb:duckdb 2368806610 2266044112 1.05
clickbench_q35/duckdb:duckdb 280229050 284940671 0.98
clickbench_q36/duckdb:duckdb 41620668 39168155 1.06
clickbench_q37/duckdb:duckdb 31089769 31339938 0.99
clickbench_q38/duckdb:duckdb 31328903 30572501 1.02
clickbench_q39/duckdb:duckdb 65311245 61366682 1.06
clickbench_q40/duckdb:duckdb 31364916 30613282 1.02
clickbench_q41/duckdb:duckdb 30689929 30027774 1.02
clickbench_q42/duckdb:duckdb 31162595 31526741 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +55.2% +2.3% +51.7% +685.8% ➖ noise
0 duckdb:duckdb +0.4% +2.3% -1.9% +287.7% ➖ noise
0 duckdb:vortex-file-compressed +2.8% +2.3% +0.4% +500.6% ➖ noise
1 datafusion:vortex-file-compressed -11.6% -1.1% -10.6% +23.9% ➖ noise
1 duckdb:duckdb +1.0% -1.1% +2.1% +52.0% ➖ noise
1 duckdb:vortex-file-compressed -3.6% -1.1% -2.6% +24.3% ➖ noise
2 datafusion:vortex-file-compressed -2.5% +0.7% -3.2% +10.0% ➖ noise
2 duckdb:duckdb +1.9% +0.7% +1.2% +17.8% ➖ noise
2 duckdb:vortex-file-compressed -0.5% +0.7% -1.2% +11.2% ➖ noise
3 datafusion:vortex-file-compressed +1.2% -2.5% +3.8% +105.9% ➖ noise
3 duckdb:duckdb -0.3% -2.5% +2.2% +34.4% ➖ noise
3 duckdb:vortex-file-compressed -2.8% -2.5% -0.4% +115.8% ➖ noise
4 datafusion:vortex-file-compressed -1.3% -1.2% -0.0% +10.0% ➖ noise
4 duckdb:duckdb -1.9% -1.2% -0.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.5% -1.2% +2.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.5% +0.3% +1.2% +10.0% ➖ noise
5 duckdb:duckdb +1.0% +0.3% +0.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.2% +0.3% +0.9% +10.1% ➖ noise
6 datafusion:vortex-file-compressed -3.8% -0.1% -3.7% +39.1% ➖ noise
6 duckdb:duckdb -1.9% -0.1% -1.8% +28.0% ➖ noise
6 duckdb:vortex-file-compressed +4.2% -0.1% +4.3% +18.5% ➖ noise
7 datafusion:vortex-file-compressed -10.5% +0.6% -11.0% +14.2% ➖ noise
7 duckdb:duckdb +1.6% +0.6% +1.0% +12.4% ➖ noise
7 duckdb:vortex-file-compressed +7.4% +0.6% +6.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.3% +0.5% -1.8% +10.0% ➖ noise
8 duckdb:duckdb +0.8% +0.5% +0.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.4% +0.5% -0.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.8% +1.0% +0.7% +10.0% ➖ noise
9 duckdb:duckdb -1.5% +1.0% -2.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.7% +1.0% -1.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.5% -2.3% +0.9% +10.0% ➖ noise
10 duckdb:duckdb -0.0% -2.3% +2.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.7% -2.3% +1.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.6% -1.2% +0.6% +10.0% ➖ noise
11 duckdb:duckdb -1.5% -1.2% -0.4% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -3.9% -1.2% -2.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.4% +1.1% +0.3% +10.0% ➖ noise
12 duckdb:duckdb +0.5% +1.1% -0.6% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.1% +1.1% -0.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.4% +0.6% +0.9% +10.0% ➖ noise
13 duckdb:duckdb -2.6% +0.6% -3.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.9% +0.6% +1.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.4% +0.3% -1.6% +10.0% ➖ noise
14 duckdb:duckdb -3.5% +0.3% -3.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.4% +0.3% +0.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.3% +1.8% -1.4% +10.0% ➖ noise
15 duckdb:duckdb -0.3% +1.8% -2.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.3% +1.8% -2.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.3% +0.9% +0.4% +10.0% ➖ noise
16 duckdb:duckdb -1.8% +0.9% -2.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -2.3% +0.9% -3.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.0% -1.1% +1.1% +10.0% ➖ noise
17 duckdb:duckdb -1.2% -1.1% -0.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.4% -1.1% +2.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.3% -0.4% +1.8% +10.0% ➖ noise
18 duckdb:duckdb +1.8% -0.4% +2.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.8% -0.4% +1.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -5.8% -1.8% -4.1% +21.3% ➖ noise
19 duckdb:duckdb -0.5% -1.8% +1.3% +13.6% ➖ noise
19 duckdb:vortex-file-compressed -2.2% -1.8% -0.4% +16.3% ➖ noise
20 datafusion:vortex-file-compressed +1.0% -0.4% +1.4% +203.4% ➖ noise
20 duckdb:duckdb +7.6% -0.4% +8.0% +14.1% ➖ noise
20 duckdb:vortex-file-compressed -1.3% -0.4% -0.9% +108.4% ➖ noise
21 datafusion:vortex-file-compressed -1.6% -1.7% +0.0% +10.0% ➖ noise
21 duckdb:duckdb -3.2% -1.7% -1.5% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.4% -1.7% +2.1% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -1.4% +0.6% -2.0% +15.7% ➖ noise
22 duckdb:duckdb +6.6% +0.6% +5.9% +17.5% ➖ noise
22 duckdb:vortex-file-compressed +1.4% +0.6% +0.8% +16.1% ➖ noise
23 datafusion:vortex-file-compressed +3.1% -0.5% +3.7% +45.9% ➖ noise
23 duckdb:duckdb +3.0% -0.5% +3.5% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +108.0% -0.5% +109.2% +78.2% 🚨 regression
24 datafusion:vortex-file-compressed +3.6% -1.0% +4.6% +14.5% ➖ noise
24 duckdb:duckdb -0.3% -1.0% +0.7% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +11.3% -1.0% +12.4% +21.9% ➖ noise
25 datafusion:vortex-file-compressed -4.5% +0.8% -5.2% +10.0% ➖ noise
25 duckdb:duckdb +0.5% +0.8% -0.2% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +5.4% +0.8% +4.6% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +4.0% -0.2% +4.2% +15.4% ➖ noise
26 duckdb:duckdb -2.6% -0.2% -2.5% +14.8% ➖ noise
26 duckdb:vortex-file-compressed -1.3% -0.2% -1.1% +35.2% ➖ noise
27 datafusion:vortex-file-compressed +5.0% +0.5% +4.5% +10.0% ➖ noise
27 duckdb:duckdb -0.4% +0.5% -0.9% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +0.7% +0.5% +0.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -2.1% -0.6% -1.4% +10.0% ➖ noise
28 duckdb:duckdb +1.4% -0.6% +2.0% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.4% -0.6% +1.0% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -4.2% -0.4% -3.8% +10.0% ➖ noise
29 duckdb:duckdb -0.2% -0.4% +0.2% +10.9% ➖ noise
29 duckdb:vortex-file-compressed +10.5% -0.4% +10.9% +18.5% ➖ noise
30 datafusion:vortex-file-compressed -1.4% +0.5% -1.9% +10.0% ➖ noise
30 duckdb:duckdb +1.1% +0.5% +0.6% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +1.7% +0.5% +1.2% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -1.1% +0.6% -1.7% +10.0% ➖ noise
31 duckdb:duckdb -8.2% +0.6% -8.8% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.4% +0.6% -0.2% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -0.3% +1.0% -1.3% +10.0% ➖ noise
32 duckdb:duckdb -5.2% +1.0% -6.2% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +9.3% +1.0% +8.2% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -0.2% +4.0% -4.0% +10.0% ➖ noise
33 duckdb:duckdb +12.8% +4.0% +8.5% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +0.8% +4.0% -3.0% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +1.1% -0.1% +1.2% +10.0% ➖ noise
34 duckdb:duckdb +4.5% -0.1% +4.7% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -0.6% -0.1% -0.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.6% +0.9% -0.3% +10.0% ➖ noise
35 duckdb:duckdb -1.7% +0.9% -2.6% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -2.9% +0.9% -3.9% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +3.2% -3.7% +7.2% +10.0% ➖ noise
36 duckdb:duckdb +6.3% -3.7% +10.4% +10.5% ➖ noise
36 duckdb:vortex-file-compressed +8.1% -3.7% +12.3% +10.0% 🚨 regression
37 datafusion:vortex-file-compressed +2.5% +5.0% -2.3% +10.0% ➖ noise
37 duckdb:duckdb -0.8% +5.0% -5.5% +12.8% ➖ noise
37 duckdb:vortex-file-compressed +4.7% +5.0% -0.3% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +1.1% -1.6% +2.7% +10.7% ➖ noise
38 duckdb:duckdb +2.5% -1.6% +4.1% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -2.6% -1.6% -1.1% +10.8% ➖ noise
39 datafusion:vortex-file-compressed +2.3% +4.6% -2.2% +10.0% ➖ noise
39 duckdb:duckdb +6.4% +4.6% +1.7% +16.3% ➖ noise
39 duckdb:vortex-file-compressed +7.9% +4.6% +3.1% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +4.9% +0.7% +4.2% +10.3% ➖ noise
40 duckdb:duckdb +2.5% +0.7% +1.8% +10.4% ➖ noise
40 duckdb:vortex-file-compressed -6.4% +0.7% -7.0% +10.9% ➖ noise
41 datafusion:vortex-file-compressed +3.9% +0.7% +3.2% +10.0% ➖ noise
41 duckdb:duckdb +2.2% +0.7% +1.5% +10.5% ➖ noise
41 duckdb:vortex-file-compressed +0.2% +0.7% -0.5% +10.3% ➖ noise
42 datafusion:vortex-file-compressed +2.8% -2.9% +5.9% +10.0% ➖ noise
42 duckdb:duckdb -1.2% -2.9% +1.8% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +8.0% -2.9% +11.3% +12.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.6%
Vortex (geomean): 1.087x ➖
Parquet (geomean): 1.190x ➖
Shifts: Parquet (control) +19.0% · Median polish +3.6%


datafusion / vortex-file-compressed (1.053x ➖, 0↑ 4↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 289695758 259833208 1.11
tpch_q02/datafusion:vortex-file-compressed 517265217 470373225 1.10
tpch_q03/datafusion:vortex-file-compressed 414029581 452463271 0.92
tpch_q04/datafusion:vortex-file-compressed 245369695 259683472 0.94
tpch_q05/datafusion:vortex-file-compressed 424180722 417726411 1.02
tpch_q06/datafusion:vortex-file-compressed 342305728 377163349 0.91
tpch_q07/datafusion:vortex-file-compressed 409135918 403315430 1.01
tpch_q08/datafusion:vortex-file-compressed 590165562 655352653 0.90
tpch_q09/datafusion:vortex-file-compressed 438739192 493868193 0.89
tpch_q10/datafusion:vortex-file-compressed 552777365 624922317 0.88
tpch_q11/datafusion:vortex-file-compressed 279547388 287047600 0.97
tpch_q12/datafusion:vortex-file-compressed 547119459 494349443 1.11
tpch_q13/datafusion:vortex-file-compressed 🚨 214908999 149539156 1.44
tpch_q14/datafusion:vortex-file-compressed 283205071 368932574 0.77
tpch_q15/datafusion:vortex-file-compressed 468223642 521323397 0.90
tpch_q16/datafusion:vortex-file-compressed 206302737 238699987 0.86
tpch_q17/datafusion:vortex-file-compressed 374774475 493487009 0.76
tpch_q18/datafusion:vortex-file-compressed 462756532 386633640 1.20
tpch_q19/datafusion:vortex-file-compressed 🚨 692293090 458038546 1.51
tpch_q20/datafusion:vortex-file-compressed 🚨 944666390 470769769 2.01
tpch_q21/datafusion:vortex-file-compressed 🚨 1119614142 545380335 2.05
tpch_q22/datafusion:vortex-file-compressed 163417638 193373153 0.85
datafusion / vortex-compact (1.201x ➖, 1↑ 9↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 307559240 424131066 0.73
tpch_q02/datafusion:vortex-compact 993467435 1061725313 0.94
tpch_q03/datafusion:vortex-compact 405761038 383475969 1.06
tpch_q04/datafusion:vortex-compact 🚨 397691085 205024656 1.94
tpch_q05/datafusion:vortex-compact 🚨 805620482 438270847 1.84
tpch_q06/datafusion:vortex-compact 🚨 552174676 346509047 1.59
tpch_q07/datafusion:vortex-compact 🚨 592119830 443559881 1.33
tpch_q08/datafusion:vortex-compact 🚨 752780823 509079312 1.48
tpch_q09/datafusion:vortex-compact 🚨 512499968 390234054 1.31
tpch_q10/datafusion:vortex-compact 🚀 499930766 738094762 0.68
tpch_q11/datafusion:vortex-compact 303251387 280853459 1.08
tpch_q12/datafusion:vortex-compact 507684346 490494944 1.04
tpch_q13/datafusion:vortex-compact 169342193 158476793 1.07
tpch_q14/datafusion:vortex-compact 271265560 240089326 1.13
tpch_q15/datafusion:vortex-compact 471402144 381811452 1.23
tpch_q16/datafusion:vortex-compact 🚨 345616464 246165237 1.40
tpch_q17/datafusion:vortex-compact 🚨 435711688 330841074 1.32
tpch_q18/datafusion:vortex-compact 274042602 254342643 1.08
tpch_q19/datafusion:vortex-compact 410589445 412097374 1.00
tpch_q20/datafusion:vortex-compact 457124692 381938893 1.20
tpch_q21/datafusion:vortex-compact 🚨 705559718 450065760 1.57
tpch_q22/datafusion:vortex-compact 264884881 208015892 1.27
datafusion / parquet (1.304x ❌, 1↑ 10↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 253399812 353537850 0.72
tpch_q02/datafusion:parquet 471985586 444217902 1.06
tpch_q03/datafusion:parquet 405797008 537420421 0.76
tpch_q04/datafusion:parquet 216360171 240883918 0.90
tpch_q05/datafusion:parquet 508518934 569321029 0.89
tpch_q06/datafusion:parquet 189931012 172252414 1.10
tpch_q07/datafusion:parquet 523327784 595126729 0.88
tpch_q08/datafusion:parquet 🚀 591099399 1119322677 0.53
tpch_q09/datafusion:parquet 501996218 481579060 1.04
tpch_q10/datafusion:parquet 🚨 1139644529 535643848 2.13
tpch_q11/datafusion:parquet 🚨 875297218 330225647 2.65
tpch_q12/datafusion:parquet 🚨 473228916 270238314 1.75
tpch_q13/datafusion:parquet 🚨 715682192 424854217 1.68
tpch_q14/datafusion:parquet 🚨 424455993 175335707 2.42
tpch_q15/datafusion:parquet 🚨 643434521 291898564 2.20
tpch_q16/datafusion:parquet 🚨 516688767 190840468 2.71
tpch_q17/datafusion:parquet 🚨 558944510 375449318 1.49
tpch_q18/datafusion:parquet 🚨 690515435 435210617 1.59
tpch_q19/datafusion:parquet 🚨 859045469 365089405 2.35
tpch_q20/datafusion:parquet 383152815 380127363 1.01
tpch_q21/datafusion:parquet 664633425 562889619 1.18
tpch_q22/datafusion:parquet 140660195 160414143 0.88
duckdb / vortex-file-compressed (1.045x ➖, 0↑ 1↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 265368640 281328987 0.94
tpch_q02/duckdb:vortex-file-compressed 1230913354 947234477 1.30
tpch_q03/duckdb:vortex-file-compressed 803838652 731414367 1.10
tpch_q04/duckdb:vortex-file-compressed 407463037 429671228 0.95
tpch_q05/duckdb:vortex-file-compressed 1005726188 1026924288 0.98
tpch_q06/duckdb:vortex-file-compressed 🚨 628767613 441140852 1.43
tpch_q07/duckdb:vortex-file-compressed 839026125 913756933 0.92
tpch_q08/duckdb:vortex-file-compressed 1273350478 1103726235 1.15
tpch_q09/duckdb:vortex-file-compressed 861638575 867795322 0.99
tpch_q10/duckdb:vortex-file-compressed 736942761 821308678 0.90
tpch_q11/duckdb:vortex-file-compressed 648357840 551222529 1.18
tpch_q12/duckdb:vortex-file-compressed 598136713 540663837 1.11
tpch_q13/duckdb:vortex-file-compressed 538802829 478025491 1.13
tpch_q14/duckdb:vortex-file-compressed 521849685 546035966 0.96
tpch_q15/duckdb:vortex-file-compressed 308554343 301391085 1.02
tpch_q16/duckdb:vortex-file-compressed 377269645 398267780 0.95
tpch_q17/duckdb:vortex-file-compressed 774959400 757960565 1.02
tpch_q18/duckdb:vortex-file-compressed 599557961 668440948 0.90
tpch_q19/duckdb:vortex-file-compressed 478756177 477069709 1.00
tpch_q20/duckdb:vortex-file-compressed 1122018611 977253203 1.15
tpch_q21/duckdb:vortex-file-compressed 1093546925 1271215076 0.86
tpch_q22/duckdb:vortex-file-compressed 461354253 367831461 1.25
duckdb / vortex-compact (1.056x ➖, 0↑ 3↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 300891178 279028136 1.08
tpch_q02/duckdb:vortex-compact 1066254596 956013225 1.12
tpch_q03/duckdb:vortex-compact 687708778 839098581 0.82
tpch_q04/duckdb:vortex-compact 336075860 411858751 0.82
tpch_q05/duckdb:vortex-compact 876337603 899816902 0.97
tpch_q06/duckdb:vortex-compact 🚨 566325466 391257628 1.45
tpch_q07/duckdb:vortex-compact 775676515 803485338 0.97
tpch_q08/duckdb:vortex-compact 968113578 1017241284 0.95
tpch_q09/duckdb:vortex-compact 979824368 934743916 1.05
tpch_q10/duckdb:vortex-compact 768122897 649069722 1.18
tpch_q11/duckdb:vortex-compact 488526242 492772604 0.99
tpch_q12/duckdb:vortex-compact 480929765 456346300 1.05
tpch_q13/duckdb:vortex-compact 450889772 486569561 0.93
tpch_q14/duckdb:vortex-compact 475089032 500589200 0.95
tpch_q15/duckdb:vortex-compact 🚨 478815993 363828335 1.32
tpch_q16/duckdb:vortex-compact 412018871 381135526 1.08
tpch_q17/duckdb:vortex-compact 717700903 671538484 1.07
tpch_q18/duckdb:vortex-compact 588294700 575616157 1.02
tpch_q19/duckdb:vortex-compact 633637133 510790856 1.24
tpch_q20/duckdb:vortex-compact 🚨 1061662584 813283783 1.31
tpch_q21/duckdb:vortex-compact 1209562502 1097678970 1.10
tpch_q22/duckdb:vortex-compact 384050865 377915788 1.02
duckdb / parquet (1.086x ➖, 0↑ 0↓)
name PR 4dc7602 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 433359635 449744303 0.96
tpch_q02/duckdb:parquet 1407574955 1207604966 1.17
tpch_q03/duckdb:parquet 1200620304 1015845673 1.18
tpch_q04/duckdb:parquet 695304392 673931020 1.03
tpch_q05/duckdb:parquet 1912290167 1547732862 1.24
tpch_q06/duckdb:parquet 443104592 478548600 0.93
tpch_q07/duckdb:parquet 1300431849 1322309716 0.98
tpch_q08/duckdb:parquet 1940289152 1812049388 1.07
tpch_q09/duckdb:parquet 1736107962 1567553288 1.11
tpch_q10/duckdb:parquet 1491985572 1310081038 1.14
tpch_q11/duckdb:parquet 944165776 931572578 1.01
tpch_q12/duckdb:parquet 815567700 693670244 1.18
tpch_q13/duckdb:parquet 1108997512 941487179 1.18
tpch_q14/duckdb:parquet 908463580 741977347 1.22
tpch_q15/duckdb:parquet 580005636 544792238 1.06
tpch_q16/duckdb:parquet 670098073 632234732 1.06
tpch_q17/duckdb:parquet 905035572 847139625 1.07
tpch_q18/duckdb:parquet 869187700 950230471 0.91
tpch_q19/duckdb:parquet 1118765250 887386364 1.26
tpch_q20/duckdb:parquet 1212975303 1175816636 1.03
tpch_q21/duckdb:parquet 1358400699 1195476411 1.14
tpch_q22/duckdb:parquet 646227287 618508554 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -27.5% -16.9% -12.7% +97.4% ➖ noise
1 datafusion:vortex-file-compressed +11.5% -16.9% +34.2% +91.3% ➖ noise
1 duckdb:vortex-compact +7.8% -16.9% +29.8% +91.3% ➖ noise
1 duckdb:vortex-file-compressed -5.7% -16.9% +13.5% +91.3% ➖ noise
2 datafusion:vortex-compact -6.4% +11.3% -15.9% +91.3% ➖ noise
2 datafusion:vortex-file-compressed +10.0% +11.3% -1.2% +91.3% ➖ noise
2 duckdb:vortex-compact +11.5% +11.3% +0.2% +91.3% ➖ noise
2 duckdb:vortex-file-compressed +29.9% +11.3% +16.8% +91.3% ➖ noise
3 datafusion:vortex-compact +5.8% -5.5% +12.0% +91.3% ➖ noise
3 datafusion:vortex-file-compressed -8.5% -5.5% -3.1% +91.3% ➖ noise
3 duckdb:vortex-compact -18.0% -5.5% -13.2% +91.3% ➖ noise
3 duckdb:vortex-file-compressed +9.9% -5.5% +16.3% +91.3% ➖ noise
4 datafusion:vortex-compact +94.0% -3.7% +101.5% +91.3% 🚨 regression
4 datafusion:vortex-file-compressed -5.5% -3.7% -1.8% +91.3% ➖ noise
4 duckdb:vortex-compact -18.4% -3.7% -15.2% +91.3% ➖ noise
4 duckdb:vortex-file-compressed -5.2% -3.7% -1.5% +91.3% ➖ noise
5 datafusion:vortex-compact +83.8% +5.1% +75.0% +91.3% ➖ noise
5 datafusion:vortex-file-compressed +1.5% +5.1% -3.3% +91.3% ➖ noise
5 duckdb:vortex-compact -2.6% +5.1% -7.3% +91.3% ➖ noise
5 duckdb:vortex-file-compressed -2.1% +5.1% -6.8% +91.3% ➖ noise
6 datafusion:vortex-compact +59.4% +1.0% +57.7% +91.3% ➖ noise
6 datafusion:vortex-file-compressed -9.2% +1.0% -10.2% +91.3% ➖ noise
6 duckdb:vortex-compact +44.7% +1.0% +43.3% +91.3% ➖ noise
6 duckdb:vortex-file-compressed +42.5% +1.0% +41.1% +91.3% ➖ noise
7 datafusion:vortex-compact +33.5% -7.0% +43.5% +91.3% ➖ noise
7 datafusion:vortex-file-compressed +1.4% -7.0% +9.1% +91.3% ➖ noise
7 duckdb:vortex-compact -3.5% -7.0% +3.8% +91.3% ➖ noise
7 duckdb:vortex-file-compressed -8.2% -7.0% -1.3% +91.3% ➖ noise
8 datafusion:vortex-compact +47.9% -24.8% +96.6% +91.3% 🚨 regression
8 datafusion:vortex-file-compressed -9.9% -24.8% +19.8% +91.3% ➖ noise
8 duckdb:vortex-compact -4.8% -24.8% +26.6% +91.3% ➖ noise
8 duckdb:vortex-file-compressed +15.4% -24.8% +53.4% +91.3% ➖ noise
9 datafusion:vortex-compact +31.3% +7.4% +22.2% +91.3% ➖ noise
9 datafusion:vortex-file-compressed -11.2% +7.4% -17.3% +91.3% ➖ noise
9 duckdb:vortex-compact +4.8% +7.4% -2.4% +91.3% ➖ noise
9 duckdb:vortex-file-compressed -0.7% +7.4% -7.6% +91.3% ➖ noise
10 datafusion:vortex-compact -32.3% +55.7% -56.5% +91.3% ✅ faster
10 datafusion:vortex-file-compressed -11.5% +55.7% -43.2% +91.3% ➖ noise
10 duckdb:vortex-compact +18.3% +55.7% -24.0% +91.3% ➖ noise
10 duckdb:vortex-file-compressed -10.3% +55.7% -42.4% +91.3% ➖ noise
11 datafusion:vortex-compact +8.0% +63.9% -34.1% +91.3% ➖ noise
11 datafusion:vortex-file-compressed -2.6% +63.9% -40.6% +91.3% ➖ noise
11 duckdb:vortex-compact -0.9% +63.9% -39.5% +91.3% ➖ noise
11 duckdb:vortex-file-compressed +17.6% +63.9% -28.2% +91.3% ➖ noise
12 datafusion:vortex-compact +3.5% +43.5% -27.9% +91.3% ➖ noise
12 datafusion:vortex-file-compressed +10.7% +43.5% -22.9% +91.3% ➖ noise
12 duckdb:vortex-compact +5.4% +43.5% -26.6% +91.3% ➖ noise
12 duckdb:vortex-file-compressed +10.6% +43.5% -22.9% +91.3% ➖ noise
13 datafusion:vortex-compact +6.9% +40.9% -24.1% +91.3% ➖ noise
13 datafusion:vortex-file-compressed +43.7% +40.9% +2.0% +91.3% ➖ noise
13 duckdb:vortex-compact -7.3% +40.9% -34.2% +91.3% ➖ noise
13 duckdb:vortex-file-compressed +12.7% +40.9% -20.0% +91.3% ➖ noise
14 datafusion:vortex-compact +13.0% +72.2% -34.4% +91.3% ➖ noise
14 datafusion:vortex-file-compressed -23.2% +72.2% -55.4% +91.3% ✅ faster
14 duckdb:vortex-compact -5.1% +72.2% -44.9% +91.3% ➖ noise
14 duckdb:vortex-file-compressed -4.4% +72.2% -44.5% +91.3% ➖ noise
15 datafusion:vortex-compact +23.5% +53.2% -19.4% +91.3% ➖ noise
15 datafusion:vortex-file-compressed -10.2% +53.2% -41.4% +91.3% ➖ noise
15 duckdb:vortex-compact +31.6% +53.2% -14.1% +91.3% ➖ noise
15 duckdb:vortex-file-compressed +2.4% +53.2% -33.2% +91.3% ➖ noise
16 datafusion:vortex-compact +40.4% +69.4% -17.1% +91.3% ➖ noise
16 datafusion:vortex-file-compressed -13.6% +69.4% -49.0% +91.3% ✅ faster
16 duckdb:vortex-compact +8.1% +69.4% -36.2% +91.3% ➖ noise
16 duckdb:vortex-file-compressed -5.3% +69.4% -44.1% +91.3% ➖ noise
17 datafusion:vortex-compact +31.7% +26.1% +4.4% +91.3% ➖ noise
17 datafusion:vortex-file-compressed -24.1% +26.1% -39.8% +91.3% ➖ noise
17 duckdb:vortex-compact +6.9% +26.1% -15.3% +91.3% ➖ noise
17 duckdb:vortex-file-compressed +2.2% +26.1% -18.9% +91.3% ➖ noise
18 datafusion:vortex-compact +7.7% +20.5% -10.6% +91.3% ➖ noise
18 datafusion:vortex-file-compressed +19.7% +20.5% -0.6% +91.3% ➖ noise
18 duckdb:vortex-compact +2.2% +20.5% -15.2% +91.3% ➖ noise
18 duckdb:vortex-file-compressed -10.3% +20.5% -25.5% +91.3% ➖ noise
19 datafusion:vortex-compact -0.4% +72.2% -42.2% +91.3% ➖ noise
19 datafusion:vortex-file-compressed +51.1% +72.2% -12.2% +91.3% ➖ noise
19 duckdb:vortex-compact +24.1% +72.2% -28.0% +91.3% ➖ noise
19 duckdb:vortex-file-compressed +0.4% +72.2% -41.7% +91.3% ➖ noise
20 datafusion:vortex-compact +19.7% +2.0% +17.4% +91.3% ➖ noise
20 datafusion:vortex-file-compressed +100.7% +2.0% +96.8% +91.3% 🚨 regression
20 duckdb:vortex-compact +30.5% +2.0% +28.0% +91.3% ➖ noise
20 duckdb:vortex-file-compressed +14.8% +2.0% +12.6% +91.3% ➖ noise
21 datafusion:vortex-compact +56.8% +15.8% +35.3% +91.3% ➖ noise
21 datafusion:vortex-file-compressed +105.3% +15.8% +77.2% +91.3% ➖ noise
21 duckdb:vortex-compact +10.2% +15.8% -4.9% +91.3% ➖ noise
21 duckdb:vortex-file-compressed -14.0% +15.8% -25.7% +91.3% ➖ noise
22 datafusion:vortex-compact +27.3% -4.3% +33.0% +91.3% ➖ noise
22 datafusion:vortex-file-compressed -15.5% -4.3% -11.7% +91.3% ➖ noise
22 duckdb:vortex-compact +1.6% -4.3% +6.2% +91.3% ➖ noise
22 duckdb:vortex-file-compressed +25.4% -4.3% +31.0% +91.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 0.992x ➖
Parquet (geomean): 0.975x ➖


unknown / unknown (0.967x ➖, 13↑ 1↓)
name PR 4dc7602 (ns) base 8f7f6d3 (ns) ratio (PR/base)
compress time/Arade 1125694401 1199634895 0.94
compress time/Bimbo 🚀 6472269032 7196118155 0.90
compress time/CMSprovider 2858083602 3039168211 0.94
compress time/Euro2016 431256871 464605721 0.93
compress time/Food 🚀 386674443 441655259 0.88
compress time/HashTags 835191466 861173510 0.97
compress time/TPC-H l_comment canonical 1282345853 1387296934 0.92
compress time/TPC-H l_comment chunked 1306061904 1406379295 0.93
compress time/taxi 698594157 767516852 0.91
compress time/wide table cols=100 chunks=1 rows=1000 11624016 12454580 0.93
compress time/wide table cols=100 chunks=50 rows=1000 11904898 12850196 0.93
compress time/wide table cols=1000 chunks=1 rows=1000 122173593 132100243 0.92
compress time/wide table cols=1000 chunks=50 rows=1000 118516065 131345891 0.90
compress time/wide table cols=10000 chunks=1 rows=1000 1436021156 1471130537 0.98
compress time/wide table cols=10000 chunks=50 rows=1000 1404703442 1449694398 0.97
decompress time/Arade 31196963 29474615 1.06
decompress time/Bimbo 93089975 102908376 0.90
decompress time/CMSprovider 84577903 93835284 0.90
decompress time/Euro2016 19787283 20500669 0.97
decompress time/Food 9699461 10364422 0.94
decompress time/HashTags 74074056 77579899 0.95
decompress time/TPC-H l_comment canonical 39949579 40047744 1.00
decompress time/TPC-H l_comment chunked 39970267 41471072 0.96
decompress time/taxi 🚀 15891908 19683173 0.81
decompress time/wide table cols=100 chunks=1 rows=1000 2467309 2639765 0.93
decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2492823 2875629 0.87
decompress time/wide table cols=1000 chunks=1 rows=1000 23801444 24515496 0.97
decompress time/wide table cols=1000 chunks=50 rows=1000 23511081 25700369 0.91
decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 243360397 291933783 0.83
decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 250401101 287627833 0.87
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2862046377 2996216659 0.96
parquet_rs-zstd compress time/Bimbo 14445386547 15418650442 0.94
parquet_rs-zstd compress time/CMSprovider 7317428024 7905611618 0.93
parquet_rs-zstd compress time/Euro2016 1347875029 1398731918 0.96
parquet_rs-zstd compress time/Food 862535574 895094171 0.96
parquet_rs-zstd compress time/HashTags 2272747650 2452661671 0.93
parquet_rs-zstd compress time/TPC-H l_comment canonical 3055357201 3237306817 0.94
parquet_rs-zstd compress time/TPC-H l_comment chunked 3069206882 3245093309 0.95
parquet_rs-zstd compress time/taxi 1343874473 1420490640 0.95
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 6719173 7942686 0.85
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 6684449 7860384 0.85
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 81459993 84018858 0.97
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 81037471 85131455 0.95
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 878561834 889264292 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 878662389 878880238 1.00
parquet_rs-zstd decompress time/Arade 634251551 657662053 0.96
parquet_rs-zstd decompress time/Bimbo 1743162112 1776894992 0.98
parquet_rs-zstd decompress time/CMSprovider 1923360523 2039926581 0.94
parquet_rs-zstd decompress time/Euro2016 384361527 390206472 0.99
parquet_rs-zstd decompress time/Food 216760509 229274821 0.95
parquet_rs-zstd decompress time/HashTags 🚀 623926641 703078165 0.89
parquet_rs-zstd decompress time/TPC-H l_comment canonical 560060277 575765567 0.97
parquet_rs-zstd decompress time/TPC-H l_comment chunked 558752466 571006977 0.98
parquet_rs-zstd decompress time/taxi 247801555 251553850 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 🚀 2725409 3152257 0.86
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2666254 2959440 0.90
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 30747085 33083947 0.93
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 🚀 30902729 34451318 0.90
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 338418507 350307027 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 336480083 349548128 0.96
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163394012 163757340 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.98
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.96
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.96
vortex:parquet-zstd ratio compress time/Food 0 0 0.91
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.05
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.98
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio compress time/taxi 0 0 0.96
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚨 1 1 1.10
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.09
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.97
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.10
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.92
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.96
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio decompress time/Food 0 0 0.99
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.08
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio decompress time/taxi 🚀 0 0 0.82
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.08
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 0 0 0.86
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.90
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.4%
Vortex (geomean): 1.170x ➖
Parquet (geomean): 1.100x ➖
Shifts: Parquet (control) +10.0% · Median polish +9.2%


datafusion / vortex-file-compressed (1.336x ❌, 0↑ 13↓)
name PR 4dc7602 (ns) base 8f7f6d3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 905335222 728920322 1.24
tpch_q02/datafusion:vortex-file-compressed 🚨 1285853603 796113864 1.62
tpch_q03/datafusion:vortex-file-compressed 1185468926 1034351755 1.15
tpch_q04/datafusion:vortex-file-compressed 🚨 936640246 639099188 1.47
tpch_q05/datafusion:vortex-file-compressed 1194417631 1032812743 1.16
tpch_q06/datafusion:vortex-file-compressed 778039215 676305431 1.15
tpch_q07/datafusion:vortex-file-compressed 🚨 1471513079 1130896672 1.30
tpch_q08/datafusion:vortex-file-compressed 🚨 1944854381 1205779260 1.61
tpch_q09/datafusion:vortex-file-compressed 🚨 1891609029 1413550080 1.34
tpch_q10/datafusion:vortex-file-compressed 🚨 1366982744 983324424 1.39
tpch_q11/datafusion:vortex-file-compressed 🚨 701584499 514685346 1.36
tpch_q12/datafusion:vortex-file-compressed 🚨 1852032598 860824772 2.15
tpch_q13/datafusion:vortex-file-compressed 🚨 624712592 435025011 1.44
tpch_q14/datafusion:vortex-file-compressed 🚨 1035743543 622455636 1.66
tpch_q15/datafusion:vortex-file-compressed 1459194730 1218832672 1.20
tpch_q16/datafusion:vortex-file-compressed 555072061 452658586 1.23
tpch_q17/datafusion:vortex-file-compressed 1376869069 1363841270 1.01
tpch_q18/datafusion:vortex-file-compressed 1543157366 1407042419 1.10
tpch_q19/datafusion:vortex-file-compressed 🚨 1102803522 816588334 1.35
tpch_q20/datafusion:vortex-file-compressed 1256334043 1116942574 1.12
tpch_q21/datafusion:vortex-file-compressed 🚨 2563176048 1747074292 1.47
tpch_q22/datafusion:vortex-file-compressed 🚨 741583465 562884964 1.32
datafusion / vortex-compact (1.201x ➖, 0↑ 8↓)
name PR 4dc7602 (ns) base 8f7f6d3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 721335418 734112502 0.98
tpch_q02/datafusion:vortex-compact 610202233 544231911 1.12
tpch_q03/datafusion:vortex-compact 🚨 1036101736 776569946 1.33
tpch_q04/datafusion:vortex-compact 🚨 791767228 498452189 1.59
tpch_q05/datafusion:vortex-compact 🚨 1207945231 898583628 1.34
tpch_q06/datafusion:vortex-compact 🚨 812241322 580387223 1.40
tpch_q07/datafusion:vortex-compact 1233089505 1077096563 1.14
tpch_q08/datafusion:vortex-compact 🚨 1904085017 1212455919 1.57
tpch_q09/datafusion:vortex-compact 🚨 1961938031 1448575740 1.35
tpch_q10/datafusion:vortex-compact 1260014110 1168717301 1.08
tpch_q11/datafusion:vortex-compact 🚨 912257630 468785684 1.95
tpch_q12/datafusion:vortex-compact 982063614 836208631 1.17
tpch_q13/datafusion:vortex-compact 427356112 415939419 1.03
tpch_q14/datafusion:vortex-compact 608396451 580114069 1.05
tpch_q15/datafusion:vortex-compact 🚨 2621795795 1166368934 2.25
tpch_q16/datafusion:vortex-compact 348474356 287725254 1.21
tpch_q17/datafusion:vortex-compact 1314241146 1285703843 1.02
tpch_q18/datafusion:vortex-compact 1227270880 1260538938 0.97
tpch_q19/datafusion:vortex-compact 822030478 823222346 1.00
tpch_q20/datafusion:vortex-compact 982066252 1182461401 0.83
tpch_q21/datafusion:vortex-compact 1544815237 1768272137 0.87
tpch_q22/datafusion:vortex-compact 447019608 440545887 1.01
datafusion / parquet (1.139x ➖, 0↑ 4↓)
name PR 4dc7602 (ns) base 8f7f6d3 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 675985650 701395766 0.96
tpch_q02/datafusion:parquet 839629397 698241458 1.20
tpch_q03/datafusion:parquet 909143983 939754941 0.97
tpch_q04/datafusion:parquet 492741626 450522302 1.09
tpch_q05/datafusion:parquet 1254030154 1167007173 1.07
tpch_q06/datafusion:parquet 513473472 500197772 1.03
tpch_q07/datafusion:parquet 🚨 2166892320 1364860993 1.59
tpch_q08/datafusion:parquet 🚨 2492962968 1637879955 1.52
tpch_q09/datafusion:parquet 🚨 2795572605 1860418554 1.50
tpch_q10/datafusion:parquet 2577825854 2234211849 1.15
tpch_q11/datafusion:parquet 509629212 545934413 0.93
tpch_q12/datafusion:parquet 870852110 689495721 1.26
tpch_q13/datafusion:parquet 743523722 706816312 1.05
tpch_q14/datafusion:parquet 802995943 771537649 1.04
tpch_q15/datafusion:parquet 1252659675 1120521815 1.12
tpch_q16/datafusion:parquet 355228314 371332700 0.96
tpch_q17/datafusion:parquet 1561643216 1412693326 1.11
tpch_q18/datafusion:parquet 1873756458 1676801451 1.12
tpch_q19/datafusion:parquet 1124082179 993239203 1.13
tpch_q20/datafusion:parquet 🚨 1716830779 1160703435 1.48
tpch_q21/datafusion:parquet 1883859973 1627314174 1.16
tpch_q22/datafusion:parquet 683309318 724289215 0.94
duckdb / vortex-file-compressed (1.116x ➖, 0↑ 4↓)
name PR 4dc7602 (ns) base 8f7f6d3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 886060770 665796371 1.33
tpch_q02/duckdb:vortex-file-compressed 1528077258 1335120534 1.14
tpch_q03/duckdb:vortex-file-compressed 1017290416 1059495457 0.96
tpch_q04/duckdb:vortex-file-compressed 767588169 712683607 1.08
tpch_q05/duckdb:vortex-file-compressed 1486951200 1282841889 1.16
tpch_q06/duckdb:vortex-file-compressed 1045016022 828661598 1.26
tpch_q07/duckdb:vortex-file-compressed 1315192467 1289330262 1.02
tpch_q08/duckdb:vortex-file-compressed 1564900462 1643797375 0.95
tpch_q09/duckdb:vortex-file-compressed 1642777925 1661759612 0.99
tpch_q10/duckdb:vortex-file-compressed 1516659646 1223969427 1.24
tpch_q11/duckdb:vortex-file-compressed 🚨 1045127798 717274369 1.46
tpch_q12/duckdb:vortex-file-compressed 🚨 1253410018 853649446 1.47
tpch_q13/duckdb:vortex-file-compressed 1124650363 1115369821 1.01
tpch_q14/duckdb:vortex-file-compressed 834174212 973778692 0.86
tpch_q15/duckdb:vortex-file-compressed 🚨 966371071 628878068 1.54
tpch_q16/duckdb:vortex-file-compressed 527847473 575411512 0.92
tpch_q17/duckdb:vortex-file-compressed 1192284591 1034804636 1.15
tpch_q18/duckdb:vortex-file-compressed 1292042984 1091177187 1.18
tpch_q19/duckdb:vortex-file-compressed 914189908 904635544 1.01
tpch_q20/duckdb:vortex-file-compressed 1664821892 1532469869 1.09
tpch_q21/duckdb:vortex-file-compressed 2371889778 2296985355 1.03
tpch_q22/duckdb:vortex-file-compressed 720320309 708388427 1.02
duckdb / vortex-compact (1.045x ➖, 0↑ 1↓)
name PR 4dc7602 (ns) base 8f7f6d3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 643386610 688741149 0.93
tpch_q02/duckdb:vortex-compact 1447373194 1287563463 1.12
tpch_q03/duckdb:vortex-compact 🚨 1488358330 1026477585 1.45
tpch_q04/duckdb:vortex-compact 696003371 793517986 0.88
tpch_q05/duckdb:vortex-compact 1201811859 1223982463 0.98
tpch_q06/duckdb:vortex-compact 1132280109 938067827 1.21
tpch_q07/duckdb:vortex-compact 1339354029 1463510182 0.92
tpch_q08/duckdb:vortex-compact 1944537437 1640686698 1.19
tpch_q09/duckdb:vortex-compact 1722607745 1587705081 1.08
tpch_q10/duckdb:vortex-compact 1484696235 1242479077 1.19
tpch_q11/duckdb:vortex-compact 765060707 772901116 0.99
tpch_q12/duckdb:vortex-compact 774165476 816126866 0.95
tpch_q13/duckdb:vortex-compact 1046159303 938813938 1.11
tpch_q14/duckdb:vortex-compact 918128232 1123024219 0.82
tpch_q15/duckdb:vortex-compact 661366525 581295899 1.14
tpch_q16/duckdb:vortex-compact 653996990 524040203 1.25
tpch_q17/duckdb:vortex-compact 1186383228 1109787472 1.07
tpch_q18/duckdb:vortex-compact 763221309 1062638490 0.72
tpch_q19/duckdb:vortex-compact 879087008 873549614 1.01
tpch_q20/duckdb:vortex-compact 1309457534 1358959045 0.96
tpch_q21/duckdb:vortex-compact 2437656656 2376366116 1.03
tpch_q22/duckdb:vortex-compact 900602654 709699774 1.27
duckdb / parquet (1.061x ➖, 0↑ 1↓)
name PR 4dc7602 (ns) base 8f7f6d3 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 1210319179 799866933 1.51
tpch_q02/duckdb:parquet 1654671070 1683353324 0.98
tpch_q03/duckdb:parquet 2399820780 2206255133 1.09
tpch_q04/duckdb:parquet 1090534305 1097232398 0.99
tpch_q05/duckdb:parquet 2523504498 2248584060 1.12
tpch_q06/duckdb:parquet 856110225 759589446 1.13
tpch_q07/duckdb:parquet 2000682027 2047989584 0.98
tpch_q08/duckdb:parquet 2672882845 2865806794 0.93
tpch_q09/duckdb:parquet 3481969460 3259511188 1.07
tpch_q10/duckdb:parquet 3909724377 3371240199 1.16
tpch_q11/duckdb:parquet 1344577093 1114448456 1.21
tpch_q12/duckdb:parquet 1301672026 1725647009 0.75
tpch_q13/duckdb:parquet 1493693503 1393744120 1.07
tpch_q14/duckdb:parquet 1237579878 1251997296 0.99
tpch_q15/duckdb:parquet 1264073101 1028709928 1.23
tpch_q16/duckdb:parquet 906951386 1000979258 0.91
tpch_q17/duckdb:parquet 1480226084 1262522578 1.17
tpch_q18/duckdb:parquet 1515632256 1574028200 0.96
tpch_q19/duckdb:parquet 1896614259 1711919065 1.11
tpch_q20/duckdb:parquet 2292679955 2114700523 1.08
tpch_q21/duckdb:parquet 2342981198 2184135142 1.07
tpch_q22/duckdb:parquet 1185738451 1146463197 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.7% +20.8% -18.6% +52.8% ➖ noise
1 datafusion:vortex-file-compressed +24.2% +20.8% +2.8% +52.1% ➖ noise
1 duckdb:vortex-compact -6.6% +20.8% -22.6% +41.4% ➖ noise
1 duckdb:vortex-file-compressed +33.1% +20.8% +10.2% +41.5% ➖ noise
2 datafusion:vortex-compact +12.1% +8.7% +3.1% +52.6% ➖ noise
2 datafusion:vortex-file-compressed +61.5% +8.7% +48.6% +42.0% 🚨 regression
2 duckdb:vortex-compact +12.4% +8.7% +3.4% +43.3% ➖ noise
2 duckdb:vortex-file-compressed +14.5% +8.7% +5.3% +38.2% ➖ noise
3 datafusion:vortex-compact +33.4% +2.6% +30.1% +35.7% ➖ noise
3 datafusion:vortex-file-compressed +14.6% +2.6% +11.7% +44.7% ➖ noise
3 duckdb:vortex-compact +45.0% +2.6% +41.3% +49.1% ➖ noise
3 duckdb:vortex-file-compressed -4.0% +2.6% -6.4% +43.9% ➖ noise
4 datafusion:vortex-compact +58.8% +4.3% +52.4% +30.0% 🚨 regression
4 datafusion:vortex-file-compressed +46.6% +4.3% +40.6% +30.0% 🚨 regression
4 duckdb:vortex-compact -12.3% +4.3% -15.9% +36.7% ➖ noise
4 duckdb:vortex-file-compressed +7.7% +4.3% +3.3% +46.7% ➖ noise
5 datafusion:vortex-compact +34.4% +9.8% +22.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +15.6% +9.8% +5.3% +30.0% ➖ noise
5 duckdb:vortex-compact -1.8% +9.8% -10.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +15.9% +9.8% +5.6% +30.0% ➖ noise
6 datafusion:vortex-compact +39.9% +7.6% +30.1% +30.0% 🚨 regression
6 datafusion:vortex-file-compressed +15.0% +7.6% +7.0% +30.0% ➖ noise
6 duckdb:vortex-compact +20.7% +7.6% +12.2% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +26.1% +7.6% +17.2% +69.4% ➖ noise
7 datafusion:vortex-compact +14.5% +24.5% -8.1% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +30.1% +24.5% +4.5% +30.0% ➖ noise
7 duckdb:vortex-compact -8.5% +24.5% -26.5% +30.0% ✅ faster
7 duckdb:vortex-file-compressed +2.0% +24.5% -18.1% +30.0% ➖ noise
8 datafusion:vortex-compact +57.0% +19.1% +31.8% +30.0% 🚨 regression
8 datafusion:vortex-file-compressed +61.3% +19.1% +35.4% +34.0% 🚨 regression
8 duckdb:vortex-compact +18.5% +19.1% -0.5% +35.8% ➖ noise
8 duckdb:vortex-file-compressed -4.8% +19.1% -20.1% +30.0% ➖ noise
9 datafusion:vortex-compact +35.4% +26.7% +6.9% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +33.8% +26.7% +5.6% +30.8% ➖ noise
9 duckdb:vortex-compact +8.5% +26.7% -14.4% +38.1% ➖ noise
9 duckdb:vortex-file-compressed -1.1% +26.7% -22.0% +30.0% ➖ noise
10 datafusion:vortex-compact +7.8% +15.7% -6.8% +43.2% ➖ noise
10 datafusion:vortex-file-compressed +39.0% +15.7% +20.2% +38.2% ➖ noise
10 duckdb:vortex-compact +19.5% +15.7% +3.3% +46.5% ➖ noise
10 duckdb:vortex-file-compressed +23.9% +15.7% +7.1% +51.9% ➖ noise
11 datafusion:vortex-compact +94.6% +6.1% +83.4% +35.3% 🚨 regression
11 datafusion:vortex-file-compressed +36.3% +6.1% +28.4% +40.3% ➖ noise
11 duckdb:vortex-compact -1.0% +6.1% -6.7% +36.5% ➖ noise
11 duckdb:vortex-file-compressed +45.7% +6.1% +37.3% +40.5% ➖ noise
12 datafusion:vortex-compact +17.4% -2.4% +20.3% +56.4% ➖ noise
12 datafusion:vortex-file-compressed +115.1% -2.4% +120.4% +33.1% 🚨 regression
12 duckdb:vortex-compact -5.1% -2.4% -2.8% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +46.8% -2.4% +50.4% +41.5% 🚨 regression
13 datafusion:vortex-compact +2.7% +6.2% -3.2% +33.3% ➖ noise
13 datafusion:vortex-file-compressed +43.6% +6.2% +35.2% +57.0% ➖ noise
13 duckdb:vortex-compact +11.4% +6.2% +5.0% +65.5% ➖ noise
13 duckdb:vortex-file-compressed +0.8% +6.2% -5.0% +59.3% ➖ noise
14 datafusion:vortex-compact +4.9% +1.4% +3.4% +70.9% ➖ noise
14 datafusion:vortex-file-compressed +66.4% +1.4% +64.1% +30.0% 🚨 regression
14 duckdb:vortex-compact -18.2% +1.4% -19.4% +44.6% ➖ noise
14 duckdb:vortex-file-compressed -14.3% +1.4% -15.5% +30.0% ➖ noise
15 datafusion:vortex-compact +124.8% +17.2% +91.8% +101.1% ➖ noise
15 datafusion:vortex-file-compressed +19.7% +17.2% +2.1% +56.5% ➖ noise
15 duckdb:vortex-compact +13.8% +17.2% -2.9% +56.2% ➖ noise
15 duckdb:vortex-file-compressed +53.7% +17.2% +31.1% +70.0% ➖ noise
16 datafusion:vortex-compact +21.1% -6.9% +30.1% +33.4% ➖ noise
16 datafusion:vortex-file-compressed +22.6% -6.9% +31.7% +36.3% ➖ noise
16 duckdb:vortex-compact +24.8% -6.9% +34.0% +45.6% ➖ noise
16 duckdb:vortex-file-compressed -8.3% -6.9% -1.5% +90.4% ➖ noise
17 datafusion:vortex-compact +2.2% +13.8% -10.2% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +1.0% +13.8% -11.3% +30.0% ➖ noise
17 duckdb:vortex-compact +6.9% +13.8% -6.1% +39.5% ➖ noise
17 duckdb:vortex-file-compressed +15.2% +13.8% +1.2% +30.0% ➖ noise
18 datafusion:vortex-compact -2.6% +3.7% -6.1% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +9.7% +3.7% +5.7% +30.0% ➖ noise
18 duckdb:vortex-compact -28.2% +3.7% -30.8% +34.4% ✅ faster
18 duckdb:vortex-file-compressed +18.4% +3.7% +14.1% +30.3% ➖ noise
19 datafusion:vortex-compact -0.1% +12.0% -10.8% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +35.1% +12.0% +20.6% +30.0% ➖ noise
19 duckdb:vortex-compact +0.6% +12.0% -10.1% +30.9% ➖ noise
19 duckdb:vortex-file-compressed +1.1% +12.0% -9.8% +30.0% ➖ noise
20 datafusion:vortex-compact -16.9% +26.6% -34.4% +41.9% ✅ faster
20 datafusion:vortex-file-compressed +12.5% +26.6% -11.2% +37.3% ➖ noise
20 duckdb:vortex-compact -3.6% +26.6% -23.9% +38.2% ➖ noise
20 duckdb:vortex-file-compressed +8.6% +26.6% -14.2% +38.3% ➖ noise
21 datafusion:vortex-compact -12.6% +11.4% -21.6% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +46.7% +11.4% +31.7% +30.0% 🚨 regression
21 duckdb:vortex-compact +2.6% +11.4% -7.9% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +3.3% +11.4% -7.3% +30.0% ➖ noise
22 datafusion:vortex-compact +1.5% -1.2% +2.7% +31.6% ➖ noise
22 datafusion:vortex-file-compressed +31.7% -1.2% +33.4% +40.3% ➖ noise
22 duckdb:vortex-compact +26.9% -1.2% +28.5% +50.2% ➖ noise
22 duckdb:vortex-file-compressed +1.7% -1.2% +2.9% +30.0% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants