Skip to content

Masking List-typed array preserves zctl#8889

Merged
mhk197 merged 1 commit into
developfrom
mk/mask-validity-listview-preserves-zctl
Jul 21, 2026
Merged

Masking List-typed array preserves zctl#8889
mhk197 merged 1 commit into
developfrom
mk/mask-validity-listview-preserves-zctl

Conversation

@mhk197

@mhk197 mhk197 commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Masking a List array preserves its non-validity children, so zctl should be preserved as well.

@mhk197
mask listview preserves zctl
67efcce 
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
@mhk197 mhk197 added the changelog/fix A bug fix label Jul 21, 2026
@mhk197 mhk197 changed the title Masking List array preserves zctl Masking List-typed array preserves zctl Jul 21, 2026
@github-actions

github-actions Bot commented Jul 21, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 67efcce 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.3%
Engines: DataFusion No clear signal (+8.0%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): 1.014x ➖
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish +1.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.052x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
vortex_q00/datafusion:vortex-file-compressed 9860053 9472638 1.04
vortex_q01/datafusion:vortex-file-compressed 6319792 5947344 1.06
datafusion / parquet (0.974x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
vortex_q00/datafusion:parquet 19684604 20526611 0.96
vortex_q01/datafusion:parquet 4545076 4597130 0.99
duckdb / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
vortex_q00/duckdb:vortex-file-compressed 10197887 10002024 1.02
vortex_q01/duckdb:vortex-file-compressed 5938686 5833329 1.02
duckdb / parquet (1.012x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
vortex_q00/duckdb:parquet 23362454 23225002 1.01
vortex_q01/duckdb:parquet 9492882 9318548 1.02

No file size changes detected.

@mhk197 mhk197 added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 21, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 21, 2026
@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 0.973x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.973x ➖, 1↑ 1↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚨 116863662 105796849 1.10
polarsignals_q01/datafusion:vortex-file-compressed 256087545 282223298 0.91
polarsignals_q02/datafusion:vortex-file-compressed 22845968 25205986 0.91
polarsignals_q03/datafusion:vortex-file-compressed 263239611 270590535 0.97
polarsignals_q04/datafusion:vortex-file-compressed 9806346 9986253 0.98
polarsignals_q05/datafusion:vortex-file-compressed 15260282 16059655 0.95
polarsignals_q06/datafusion:vortex-file-compressed 21851917 21417373 1.02
polarsignals_q07/datafusion:vortex-file-compressed 14786902 14019202 1.05
polarsignals_q08/datafusion:vortex-file-compressed 387982095 396736468 0.98
polarsignals_q09/datafusion:vortex-file-compressed 🚀 11440548 13009175 0.88

No file size changes detected.

@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (+4.9%, environment too noisy confidence) · DuckDB No clear signal (-3.1%, low confidence)
Vortex (geomean): 1.037x ➖
Parquet (geomean): 1.029x ➖
Shifts: Parquet (control) +2.9% · Median polish +4.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.028x ➖, 0↑ 1↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 4852937 5267093 0.92
fineweb_q01/datafusion:vortex-file-compressed 34572299 33846745 1.02
fineweb_q02/datafusion:vortex-file-compressed 37475756 38340892 0.98
fineweb_q03/datafusion:vortex-file-compressed 57554179 58255068 0.99
fineweb_q04/datafusion:vortex-file-compressed 261043157 251115759 1.04
fineweb_q05/datafusion:vortex-file-compressed 197267881 185892926 1.06
fineweb_q06/datafusion:vortex-file-compressed 55672015 51908873 1.07
fineweb_q07/datafusion:vortex-file-compressed 🚨 61706048 53566557 1.15
fineweb_q08/datafusion:vortex-file-compressed 23613448 22865284 1.03
datafusion / parquet (0.979x ➖, 1↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 7231976 8131169 0.89
fineweb_q01/datafusion:parquet 282901220 291647520 0.97
fineweb_q02/datafusion:parquet 288818708 293835073 0.98
fineweb_q03/datafusion:parquet 297066230 280452278 1.06
fineweb_q04/datafusion:parquet 308531252 304208886 1.01
fineweb_q05/datafusion:parquet 294435708 305494098 0.96
fineweb_q06/datafusion:parquet 286484748 302297950 0.95
fineweb_q07/datafusion:parquet 288652483 285712989 1.01
fineweb_q08/datafusion:parquet 282613334 286508263 0.99
duckdb / vortex-file-compressed (1.046x ➖, 0↑ 2↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3285942 3487972 0.94
fineweb_q01/duckdb:vortex-file-compressed 36436569 34144794 1.07
fineweb_q02/duckdb:vortex-file-compressed 44524322 42216449 1.05
fineweb_q03/duckdb:vortex-file-compressed 113497319 105904896 1.07
fineweb_q04/duckdb:vortex-file-compressed 279198346 271047506 1.03
fineweb_q05/duckdb:vortex-file-compressed 🚨 213406017 192295392 1.11
fineweb_q06/duckdb:vortex-file-compressed 56981763 57492117 0.99
fineweb_q07/duckdb:vortex-file-compressed 59830757 58258280 1.03
fineweb_q08/duckdb:vortex-file-compressed 🚨 25442046 22363046 1.14
duckdb / parquet (1.080x ➖, 0↑ 1↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 35110684 33412941 1.05
fineweb_q01/duckdb:parquet 102525996 93231806 1.10
fineweb_q02/duckdb:parquet 🚨 98669466 89051336 1.11
fineweb_q03/duckdb:parquet 355407852 324851678 1.09
fineweb_q04/duckdb:parquet 496632359 455468741 1.09
fineweb_q05/duckdb:parquet 466973735 434521095 1.07
fineweb_q06/duckdb:parquet 229170119 213557027 1.07
fineweb_q07/duckdb:parquet 242024394 229128893 1.06
fineweb_q08/duckdb:parquet 41498497 38557621 1.08
File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (-0.6%, environment too noisy confidence) · DuckDB No clear signal (+6.4%, environment too noisy confidence)
Vortex (geomean): 1.063x ➖
Parquet (geomean): 1.033x ➖
Shifts: Parquet (control) +3.3% · Median polish +1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.011x ➖, 0↑ 0↓)
name PR 67efcce (ns) base f68d60d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51038270 52768034 0.97
tpch_q02/datafusion:vortex-file-compressed 22594883 22585349 1.00
tpch_q03/datafusion:vortex-file-compressed 30488186 29729284 1.03
tpch_q04/datafusion:vortex-file-compressed 19350380 19171378 1.01
tpch_q05/datafusion:vortex-file-compressed 46255955 45442961 1.02
tpch_q06/datafusion:vortex-file-compressed 10010499 9768528 1.02
tpch_q07/datafusion:vortex-file-compressed 51889874 51978913 1.00
tpch_q08/datafusion:vortex-file-compressed 38013610 38340654 0.99
tpch_q09/datafusion:vortex-file-compressed 50503366 51282992 0.98
tpch_q10/datafusion:vortex-file-compressed 32811357 32998073 0.99
tpch_q11/datafusion:vortex-file-compressed 16596709 15979340 1.04
tpch_q12/datafusion:vortex-file-compressed 23437298 22988649 1.02
tpch_q13/datafusion:vortex-file-compressed 26648246 26312754 1.01
tpch_q14/datafusion:vortex-file-compressed 14883658 14535552 1.02
tpch_q15/datafusion:vortex-file-compressed 22379944 22876509 0.98
tpch_q16/datafusion:vortex-file-compressed 20034540 18741669 1.07
tpch_q17/datafusion:vortex-file-compressed 64138929 65236864 0.98
tpch_q18/datafusion:vortex-file-compressed 77003603 74997222 1.03
tpch_q19/datafusion:vortex-file-compressed 19342478 18128768 1.07
tpch_q20/datafusion:vortex-file-compressed 29999805 29709352 1.01
tpch_q21/datafusion:vortex-file-compressed 69339544 68548249 1.01
tpch_q22/datafusion:vortex-file-compressed 11680409 11682005 1.00
datafusion / parquet (1.017x ➖, 0↑ 1↓)
name PR 67efcce (ns) base f68d60d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 130860707 107754184 1.21
tpch_q02/datafusion:parquet 60517285 60549403 1.00
tpch_q03/datafusion:parquet 80085623 74947664 1.07
tpch_q04/datafusion:parquet 43008797 46908189 0.92
tpch_q05/datafusion:parquet 92621563 94549518 0.98
tpch_q06/datafusion:parquet 39744669 41138469 0.97
tpch_q07/datafusion:parquet 100423264 106115022 0.95
tpch_q08/datafusion:parquet 96823590 93657491 1.03
tpch_q09/datafusion:parquet 120952550 122300652 0.99
tpch_q10/datafusion:parquet 116919496 113553821 1.03
tpch_q11/datafusion:parquet 40095034 39348506 1.02
tpch_q12/datafusion:parquet 79666132 74358090 1.07
tpch_q13/datafusion:parquet 191000835 192053175 0.99
tpch_q14/datafusion:parquet 46469497 42781614 1.09
tpch_q15/datafusion:parquet 61276249 57708223 1.06
tpch_q16/datafusion:parquet 42475931 41963397 1.01
tpch_q17/datafusion:parquet 140646933 136897210 1.03
tpch_q18/datafusion:parquet 157111004 156214249 1.01
tpch_q19/datafusion:parquet 66901305 70263714 0.95
tpch_q20/datafusion:parquet 72077806 70225003 1.03
tpch_q21/datafusion:parquet 138164833 139818000 0.99
tpch_q22/datafusion:parquet 43831944 43326611 1.01
datafusion / arrow (1.010x ➖, 0↑ 2↓)
name PR 67efcce (ns) base f68d60d (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 59657353 65750223 0.91
tpch_q02/datafusion:arrow 17105576 16688946 1.02
tpch_q03/datafusion:arrow 33218447 31175199 1.07
tpch_q04/datafusion:arrow 27715283 26337613 1.05
tpch_q05/datafusion:arrow 🚨 59331101 52945982 1.12
tpch_q06/datafusion:arrow 🚨 23420422 21174230 1.11
tpch_q07/datafusion:arrow 105894324 103826909 1.02
tpch_q08/datafusion:arrow 41761433 43443651 0.96
tpch_q09/datafusion:arrow 63937613 69074064 0.93
tpch_q10/datafusion:arrow 50111826 51228531 0.98
tpch_q11/datafusion:arrow 9334428 9171628 1.02
tpch_q12/datafusion:arrow 50023315 48511720 1.03
tpch_q13/datafusion:arrow 46540874 45323389 1.03
tpch_q14/datafusion:arrow 23405325 23206878 1.01
tpch_q15/datafusion:arrow 45272700 45683053 0.99
tpch_q16/datafusion:arrow 16497136 16482853 1.00
tpch_q17/datafusion:arrow 66818256 65710081 1.02
tpch_q18/datafusion:arrow 106301275 106718203 1.00
tpch_q19/datafusion:arrow 37074138 37703093 0.98
tpch_q20/datafusion:arrow 35670261 36765747 0.97
tpch_q21/datafusion:arrow 155872640 148218590 1.05
tpch_q22/datafusion:arrow 11604956 11814940 0.98
duckdb / vortex-file-compressed (1.117x ❌, 0↑ 11↓)
name PR 67efcce (ns) base f68d60d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 30170846 28013379 1.08
tpch_q02/duckdb:vortex-file-compressed 🚨 27658125 24702990 1.12
tpch_q03/duckdb:vortex-file-compressed 🚨 37552427 31373765 1.20
tpch_q04/duckdb:vortex-file-compressed 🚨 31544436 27275791 1.16
tpch_q05/duckdb:vortex-file-compressed 🚨 41132259 34479557 1.19
tpch_q06/duckdb:vortex-file-compressed 🚨 9463016 8233216 1.15
tpch_q07/duckdb:vortex-file-compressed 🚨 39977892 33400213 1.20
tpch_q08/duckdb:vortex-file-compressed 🚨 44505044 38184741 1.17
tpch_q09/duckdb:vortex-file-compressed 🚨 65696568 55184472 1.19
tpch_q10/duckdb:vortex-file-compressed 🚨 48136791 40128885 1.20
tpch_q11/duckdb:vortex-file-compressed 🚨 15617940 13633530 1.15
tpch_q12/duckdb:vortex-file-compressed 🚨 25185622 22880455 1.10
tpch_q13/duckdb:vortex-file-compressed 41917034 38921767 1.08
tpch_q14/duckdb:vortex-file-compressed 20787841 19342775 1.07
tpch_q15/duckdb:vortex-file-compressed 17427848 15978306 1.09
tpch_q16/duckdb:vortex-file-compressed 28384277 27024343 1.05
tpch_q17/duckdb:vortex-file-compressed 24717610 22573108 1.10
tpch_q18/duckdb:vortex-file-compressed 52391549 50431393 1.04
tpch_q19/duckdb:vortex-file-compressed 27579664 26040315 1.06
tpch_q20/duckdb:vortex-file-compressed 32172600 30069158 1.07
tpch_q21/duckdb:vortex-file-compressed 104846550 96676647 1.08
tpch_q22/duckdb:vortex-file-compressed 17258140 16085503 1.07
duckdb / parquet (1.050x ➖, 1↑ 4↓)
name PR 67efcce (ns) base f68d60d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77929961 77734130 1.00
tpch_q02/duckdb:parquet 39734333 39685016 1.00
tpch_q03/duckdb:parquet 71155297 71158662 1.00
tpch_q04/duckdb:parquet 49979439 49915367 1.00
tpch_q05/duckdb:parquet 69008877 69265674 1.00
tpch_q06/duckdb:parquet 23634234 22547472 1.05
tpch_q07/duckdb:parquet 80907420 75717651 1.07
tpch_q08/duckdb:parquet 88632753 84728681 1.05
tpch_q09/duckdb:parquet 146866296 146918031 1.00
tpch_q10/duckdb:parquet 139911059 130741799 1.07
tpch_q11/duckdb:parquet 24477561 22472906 1.09
tpch_q12/duckdb:parquet 🚀 50609457 59088740 0.86
tpch_q13/duckdb:parquet 🚨 288088509 249448468 1.15
tpch_q14/duckdb:parquet 55779678 51839042 1.08
tpch_q15/duckdb:parquet 28172155 26786111 1.05
tpch_q16/duckdb:parquet 🚨 64734946 58313556 1.11
tpch_q17/duckdb:parquet 59592216 55967097 1.06
tpch_q18/duckdb:parquet 128775830 120623254 1.07
tpch_q19/duckdb:parquet 77233299 70526571 1.10
tpch_q20/duckdb:parquet 🚨 72785312 65999287 1.10
tpch_q21/duckdb:parquet 🚨 206088062 175300799 1.18
tpch_q22/duckdb:parquet 58663323 55354953 1.06
File Size Changes (10 files changed, -43.9% overall, 0↑ 10↓)
File Scale Format Base HEAD Change %
customer_0.vortex 1.0 vortex-compact 7.40 MB 0 B 7.40 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem_0.vortex 1.0 vortex-compact 63.00 MB 0 B 63.00 MB -100.0%
lineitem_1.vortex 1.0 vortex-compact 63.03 MB 0 B 63.03 MB -100.0%
nation_0.vortex 1.0 vortex-compact 7.80 KB 0 B 7.80 KB -100.0%
orders_0.vortex 1.0 vortex-compact 31.73 MB 0 B 31.73 MB -100.0%
part_0.vortex 1.0 vortex-compact 3.55 MB 0 B 3.55 MB -100.0%
partsupp_0.vortex 1.0 vortex-compact 20.29 MB 0 B 20.29 MB -100.0%
region_0.vortex 1.0 vortex-compact 5.83 KB 0 B 5.83 KB -100.0%
supplier_0.vortex 1.0 vortex-compact 496.46 KB 0 B 496.46 KB -100.0%

Totals:

  • vortex-compact: 189.76 MB → 0 B (-100.0%)
  • vortex-file-compressed: 242.92 MB → 242.92 MB (0.0%)

@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): 0.989x ➖
Parquet (geomean): 0.986x ➖
Shifts: Parquet (control) -1.4% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.988x ➖, 2↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 22600119 23142070 0.98
tpcds_q02/datafusion:vortex-file-compressed 42800574 44343936 0.97
tpcds_q03/datafusion:vortex-file-compressed 15767238 15111870 1.04
tpcds_q04/datafusion:vortex-file-compressed 218604266 233834175 0.93
tpcds_q05/datafusion:vortex-file-compressed 43291271 43865966 0.99
tpcds_q06/datafusion:vortex-file-compressed 23523683 23914122 0.98
tpcds_q07/datafusion:vortex-file-compressed 40813286 42437621 0.96
tpcds_q08/datafusion:vortex-file-compressed 29163265 30784594 0.95
tpcds_q09/datafusion:vortex-file-compressed 33187737 32605251 1.02
tpcds_q10/datafusion:vortex-file-compressed 38097779 39018347 0.98
tpcds_q11/datafusion:vortex-file-compressed 129711230 130390436 0.99
tpcds_q12/datafusion:vortex-file-compressed 17695214 17277362 1.02
tpcds_q13/datafusion:vortex-file-compressed 44487230 41122439 1.08
tpcds_q14/datafusion:vortex-file-compressed 158766096 157298659 1.01
tpcds_q15/datafusion:vortex-file-compressed 27325741 25655712 1.07
tpcds_q16/datafusion:vortex-file-compressed 23641986 23424459 1.01
tpcds_q17/datafusion:vortex-file-compressed 58606953 59332044 0.99
tpcds_q18/datafusion:vortex-file-compressed 59073787 61905432 0.95
tpcds_q19/datafusion:vortex-file-compressed 22623570 22219172 1.02
tpcds_q20/datafusion:vortex-file-compressed 19157925 19325595 0.99
tpcds_q21/datafusion:vortex-file-compressed 35454263 36091015 0.98
tpcds_q22/datafusion:vortex-file-compressed 🚀 125471811 155241760 0.81
tpcds_q23/datafusion:vortex-file-compressed 154326159 156536094 0.99
tpcds_q24/datafusion:vortex-file-compressed 85861197 86407164 0.99
tpcds_q25/datafusion:vortex-file-compressed 61486075 63656603 0.97
tpcds_q26/datafusion:vortex-file-compressed 29783195 30311086 0.98
tpcds_q27/datafusion:vortex-file-compressed 92568306 94212874 0.98
tpcds_q28/datafusion:vortex-file-compressed 33259276 33029781 1.01
tpcds_q29/datafusion:vortex-file-compressed 🚀 57650032 64423748 0.89
tpcds_q30/datafusion:vortex-file-compressed 23159337 23344428 0.99
tpcds_q31/datafusion:vortex-file-compressed 70779268 71026235 1.00
tpcds_q32/datafusion:vortex-file-compressed 18239527 18394144 0.99
tpcds_q33/datafusion:vortex-file-compressed 28677048 29048127 0.99
tpcds_q34/datafusion:vortex-file-compressed 25425535 25000768 1.02
tpcds_q35/datafusion:vortex-file-compressed 43120837 43489628 0.99
tpcds_q36/datafusion:vortex-file-compressed 56023240 57890643 0.97
tpcds_q37/datafusion:vortex-file-compressed 20232462 19811795 1.02
tpcds_q38/datafusion:vortex-file-compressed 38972786 39326380 0.99
tpcds_q39/datafusion:vortex-file-compressed 105629327 108638283 0.97
tpcds_q40/datafusion:vortex-file-compressed 29664721 29530546 1.00
tpcds_q41/datafusion:vortex-file-compressed 21132765 20486030 1.03
tpcds_q42/datafusion:vortex-file-compressed 13526097 13643215 0.99
tpcds_q43/datafusion:vortex-file-compressed 18590375 19859316 0.94
tpcds_q44/datafusion:vortex-file-compressed 29723548 30952029 0.96
tpcds_q45/datafusion:vortex-file-compressed 24983632 25546807 0.98
tpcds_q46/datafusion:vortex-file-compressed 35514744 34809571 1.02
tpcds_q47/datafusion:vortex-file-compressed 143172610 140702488 1.02
tpcds_q48/datafusion:vortex-file-compressed 35928826 36134712 0.99
tpcds_q49/datafusion:vortex-file-compressed 57690404 57687994 1.00
tpcds_q50/datafusion:vortex-file-compressed 39578041 38470584 1.03
tpcds_q51/datafusion:vortex-file-compressed 86657571 88417510 0.98
tpcds_q52/datafusion:vortex-file-compressed 13918391 14059188 0.99
tpcds_q53/datafusion:vortex-file-compressed 22593907 22634098 1.00
tpcds_q54/datafusion:vortex-file-compressed 33276374 33619995 0.99
tpcds_q55/datafusion:vortex-file-compressed 13267256 13724344 0.97
tpcds_q56/datafusion:vortex-file-compressed 30063695 30512565 0.99
tpcds_q57/datafusion:vortex-file-compressed 91975604 94967739 0.97
tpcds_q58/datafusion:vortex-file-compressed 52378182 55091216 0.95
tpcds_q59/datafusion:vortex-file-compressed 59553869 60369681 0.99
tpcds_q60/datafusion:vortex-file-compressed 29282404 29664469 0.99
tpcds_q61/datafusion:vortex-file-compressed 39527762 40792469 0.97
tpcds_q62/datafusion:vortex-file-compressed 21008710 21000258 1.00
tpcds_q63/datafusion:vortex-file-compressed 22186898 22356707 0.99
tpcds_q64/datafusion:vortex-file-compressed 380652478 400593559 0.95
tpcds_q65/datafusion:vortex-file-compressed 53059479 52503040 1.01
tpcds_q66/datafusion:vortex-file-compressed 70941195 73950679 0.96
tpcds_q67/datafusion:vortex-file-compressed 154847008 151340746 1.02
tpcds_q68/datafusion:vortex-file-compressed 33365088 33680611 0.99
tpcds_q69/datafusion:vortex-file-compressed 34709406 36424015 0.95
tpcds_q70/datafusion:vortex-file-compressed 95620976 95933036 1.00
tpcds_q71/datafusion:vortex-file-compressed 22869584 23210558 0.99
tpcds_q72/datafusion:vortex-file-compressed 2102077055 2102609317 1.00
tpcds_q73/datafusion:vortex-file-compressed 23895908 24302274 0.98
tpcds_q74/datafusion:vortex-file-compressed 81710334 78809334 1.04
tpcds_q75/datafusion:vortex-file-compressed 105185425 109212424 0.96
tpcds_q76/datafusion:vortex-file-compressed 28260168 27621974 1.02
tpcds_q77/datafusion:vortex-file-compressed 36716761 36618666 1.00
tpcds_q78/datafusion:vortex-file-compressed 110664075 111228083 0.99
tpcds_q79/datafusion:vortex-file-compressed 29078263 29070979 1.00
tpcds_q80/datafusion:vortex-file-compressed 88975905 89894766 0.99
tpcds_q81/datafusion:vortex-file-compressed 23730655 25015941 0.95
tpcds_q82/datafusion:vortex-file-compressed 21537232 22124553 0.97
tpcds_q83/datafusion:vortex-file-compressed 34167782 36217866 0.94
tpcds_q84/datafusion:vortex-file-compressed 11848439 11959460 0.99
tpcds_q85/datafusion:vortex-file-compressed 89789545 86946782 1.03
tpcds_q86/datafusion:vortex-file-compressed 14997473 15215263 0.99
tpcds_q87/datafusion:vortex-file-compressed 40070989 39763441 1.01
tpcds_q88/datafusion:vortex-file-compressed 53804568 53190292 1.01
tpcds_q89/datafusion:vortex-file-compressed 25714861 26190146 0.98
tpcds_q90/datafusion:vortex-file-compressed 13169569 13538651 0.97
tpcds_q91/datafusion:vortex-file-compressed 17870637 18450489 0.97
tpcds_q92/datafusion:vortex-file-compressed 15566901 15925125 0.98
tpcds_q93/datafusion:vortex-file-compressed 31289334 31788359 0.98
tpcds_q94/datafusion:vortex-file-compressed 20197804 20215177 1.00
tpcds_q95/datafusion:vortex-file-compressed 55530123 55037451 1.01
tpcds_q96/datafusion:vortex-file-compressed 12864335 13146243 0.98
tpcds_q97/datafusion:vortex-file-compressed 28448541 28828141 0.99
tpcds_q98/datafusion:vortex-file-compressed 25784928 24597019 1.05
tpcds_q99/datafusion:vortex-file-compressed 25463147 25448130 1.00
datafusion / parquet (0.979x ➖, 3↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 23579427 24561836 0.96
tpcds_q02/datafusion:parquet 41237711 43505635 0.95
tpcds_q03/datafusion:parquet 13617703 14025132 0.97
tpcds_q04/datafusion:parquet 287790122 307970102 0.93
tpcds_q05/datafusion:parquet 45323408 48393475 0.94
tpcds_q06/datafusion:parquet 23214863 24208969 0.96
tpcds_q07/datafusion:parquet 76340786 79108286 0.97
tpcds_q08/datafusion:parquet 29996484 30041172 1.00
tpcds_q09/datafusion:parquet 42124993 38529234 1.09
tpcds_q10/datafusion:parquet 74243591 71044008 1.05
tpcds_q11/datafusion:parquet 154373875 148432703 1.04
tpcds_q12/datafusion:parquet 17981902 16947248 1.06
tpcds_q13/datafusion:parquet 74081814 75811839 0.98
tpcds_q14/datafusion:parquet 160274394 161132397 0.99
tpcds_q15/datafusion:parquet 20305129 21583554 0.94
tpcds_q16/datafusion:parquet 27284156 30308696 0.90
tpcds_q17/datafusion:parquet 59397731 65902257 0.90
tpcds_q18/datafusion:parquet 104056313 106233649 0.98
tpcds_q19/datafusion:parquet 23198202 22943318 1.01
tpcds_q20/datafusion:parquet 🚀 16108285 18088152 0.89
tpcds_q21/datafusion:parquet 18811247 18856676 1.00
tpcds_q22/datafusion:parquet 158085626 174523075 0.91
tpcds_q23/datafusion:parquet 148779253 148636127 1.00
tpcds_q24/datafusion:parquet 87945357 92228149 0.95
tpcds_q25/datafusion:parquet 62527885 61382888 1.02
tpcds_q26/datafusion:parquet 62222497 62704079 0.99
tpcds_q27/datafusion:parquet 136157847 135282188 1.01
tpcds_q28/datafusion:parquet 44913487 45658597 0.98
tpcds_q29/datafusion:parquet 62776908 64453259 0.97
tpcds_q30/datafusion:parquet 33381541 33237808 1.00
tpcds_q31/datafusion:parquet 64995783 65900429 0.99
tpcds_q32/datafusion:parquet 16306819 16589418 0.98
tpcds_q33/datafusion:parquet 26653109 27290267 0.98
tpcds_q34/datafusion:parquet 21280286 23388713 0.91
tpcds_q35/datafusion:parquet 74963053 72764433 1.03
tpcds_q36/datafusion:parquet 58023600 56742005 1.02
tpcds_q37/datafusion:parquet 19554213 19599868 1.00
tpcds_q38/datafusion:parquet 41641530 44547129 0.93
tpcds_q39/datafusion:parquet 74882654 75108467 1.00
tpcds_q40/datafusion:parquet 22924624 22164087 1.03
tpcds_q41/datafusion:parquet 13977388 14214291 0.98
tpcds_q42/datafusion:parquet 11446721 11559707 0.99
tpcds_q43/datafusion:parquet 16451925 17617026 0.93
tpcds_q44/datafusion:parquet 31983014 34196942 0.94
tpcds_q45/datafusion:parquet 28523627 28457258 1.00
tpcds_q46/datafusion:parquet 33196224 32612123 1.02
tpcds_q47/datafusion:parquet 128211441 128025957 1.00
tpcds_q48/datafusion:parquet 68422778 69245916 0.99
tpcds_q49/datafusion:parquet 57367394 57819129 0.99
tpcds_q50/datafusion:parquet 41665473 42268165 0.99
tpcds_q51/datafusion:parquet 89013158 90938964 0.98
tpcds_q52/datafusion:parquet 11882007 12591643 0.94
tpcds_q53/datafusion:parquet 18067156 18218489 0.99
tpcds_q54/datafusion:parquet 32629728 32382277 1.01
tpcds_q55/datafusion:parquet 11280403 11963021 0.94
tpcds_q56/datafusion:parquet 28484571 27865216 1.02
tpcds_q57/datafusion:parquet 97130646 97688439 0.99
tpcds_q58/datafusion:parquet 55794147 56644321 0.98
tpcds_q59/datafusion:parquet 61004995 62572223 0.97
tpcds_q60/datafusion:parquet 27192329 28772335 0.95
tpcds_q61/datafusion:parquet 45105235 43302361 1.04
tpcds_q62/datafusion:parquet 🚀 20505597 25521463 0.80
tpcds_q63/datafusion:parquet 17777343 18167546 0.98
tpcds_q64/datafusion:parquet 314742861 307191852 1.02
tpcds_q65/datafusion:parquet 37535612 39545423 0.95
tpcds_q66/datafusion:parquet 70109491 70863779 0.99
tpcds_q67/datafusion:parquet 153143579 147209373 1.04
tpcds_q68/datafusion:parquet 31940053 32169528 0.99
tpcds_q69/datafusion:parquet 68370683 66672126 1.03
tpcds_q70/datafusion:parquet 32402596 33809011 0.96
tpcds_q71/datafusion:parquet 23338858 23206143 1.01
tpcds_q72/datafusion:parquet 579814245 597930937 0.97
tpcds_q73/datafusion:parquet 21576411 22286858 0.97
tpcds_q74/datafusion:parquet 80216656 82180347 0.98
tpcds_q75/datafusion:parquet 104713810 109493556 0.96
tpcds_q76/datafusion:parquet 30396087 30456609 1.00
tpcds_q77/datafusion:parquet 40079057 37976759 1.06
tpcds_q78/datafusion:parquet 106488104 112340566 0.95
tpcds_q79/datafusion:parquet 26672761 26346775 1.01
tpcds_q80/datafusion:parquet 74221463 74998408 0.99
tpcds_q81/datafusion:parquet 29758376 30011808 0.99
tpcds_q82/datafusion:parquet 18872107 19051240 0.99
tpcds_q83/datafusion:parquet 41566740 42180172 0.99
tpcds_q84/datafusion:parquet 39663123 40381813 0.98
tpcds_q85/datafusion:parquet 146594015 146969207 1.00
tpcds_q86/datafusion:parquet 16076834 16572037 0.97
tpcds_q87/datafusion:parquet 42961999 43525852 0.99
tpcds_q88/datafusion:parquet 59097651 61914391 0.95
tpcds_q89/datafusion:parquet 22203376 22247481 1.00
tpcds_q90/datafusion:parquet 🚀 13771772 15529867 0.89
tpcds_q91/datafusion:parquet 59703090 62357657 0.96
tpcds_q92/datafusion:parquet 18175976 18323161 0.99
tpcds_q93/datafusion:parquet 30646917 31842387 0.96
tpcds_q94/datafusion:parquet 20071379 22006843 0.91
tpcds_q95/datafusion:parquet 60609311 61242371 0.99
tpcds_q96/datafusion:parquet 11983501 12082355 0.99
tpcds_q97/datafusion:parquet 29941051 30025601 1.00
tpcds_q98/datafusion:parquet 21345525 21835042 0.98
tpcds_q99/datafusion:parquet 25668100 27138486 0.95
duckdb / vortex-file-compressed (0.991x ➖, 1↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 23546050 21844605 1.08
tpcds_q02/duckdb:vortex-file-compressed 22705347 22347469 1.02
tpcds_q03/duckdb:vortex-file-compressed 19056833 19157454 0.99
tpcds_q04/duckdb:vortex-file-compressed 89718471 90357960 0.99
tpcds_q05/duckdb:vortex-file-compressed 33732795 35163868 0.96
tpcds_q06/duckdb:vortex-file-compressed 34217792 34439618 0.99
tpcds_q07/duckdb:vortex-file-compressed 28604402 28872017 0.99
tpcds_q08/duckdb:vortex-file-compressed 27742410 27227390 1.02
tpcds_q09/duckdb:vortex-file-compressed 16147332 16294751 0.99
tpcds_q10/duckdb:vortex-file-compressed 38506334 39148108 0.98
tpcds_q11/duckdb:vortex-file-compressed 71959415 73930578 0.97
tpcds_q12/duckdb:vortex-file-compressed 14201997 13977367 1.02
tpcds_q13/duckdb:vortex-file-compressed 34723652 34152528 1.02
tpcds_q14/duckdb:vortex-file-compressed 101535420 104141347 0.97
tpcds_q15/duckdb:vortex-file-compressed 27110223 27214233 1.00
tpcds_q16/duckdb:vortex-file-compressed 23385306 24015040 0.97
tpcds_q17/duckdb:vortex-file-compressed 48041956 47406102 1.01
tpcds_q18/duckdb:vortex-file-compressed 39605778 39486192 1.00
tpcds_q19/duckdb:vortex-file-compressed 35833867 34466673 1.04
tpcds_q20/duckdb:vortex-file-compressed 14704845 14048160 1.05
tpcds_q21/duckdb:vortex-file-compressed 15736832 15906579 0.99
tpcds_q22/duckdb:vortex-file-compressed 71017057 70382999 1.01
tpcds_q23/duckdb:vortex-file-compressed 88073374 90087675 0.98
tpcds_q24/duckdb:vortex-file-compressed 43216219 44593641 0.97
tpcds_q25/duckdb:vortex-file-compressed 35774330 36829524 0.97
tpcds_q26/duckdb:vortex-file-compressed 18908923 18958381 1.00
tpcds_q27/duckdb:vortex-file-compressed 30026527 28725991 1.05
tpcds_q28/duckdb:vortex-file-compressed 11519182 11572634 1.00
tpcds_q29/duckdb:vortex-file-compressed 45685656 45667240 1.00
tpcds_q30/duckdb:vortex-file-compressed 26436301 26631722 0.99
tpcds_q31/duckdb:vortex-file-compressed 32627194 32157868 1.01
tpcds_q32/duckdb:vortex-file-compressed 13114662 13478156 0.97
tpcds_q33/duckdb:vortex-file-compressed 24530350 25988179 0.94
tpcds_q34/duckdb:vortex-file-compressed 27321968 26957941 1.01
tpcds_q35/duckdb:vortex-file-compressed 66828339 67717875 0.99
tpcds_q36/duckdb:vortex-file-compressed 25361089 25021933 1.01
tpcds_q37/duckdb:vortex-file-compressed 18963952 19366670 0.98
tpcds_q38/duckdb:vortex-file-compressed 39301823 36020629 1.09
tpcds_q39/duckdb:vortex-file-compressed 29704620 29707191 1.00
tpcds_q40/duckdb:vortex-file-compressed 18415386 18082144 1.02
tpcds_q41/duckdb:vortex-file-compressed 12317790 12503655 0.99
tpcds_q42/duckdb:vortex-file-compressed 15311479 15583772 0.98
tpcds_q43/duckdb:vortex-file-compressed 18299801 18016588 1.02
tpcds_q44/duckdb:vortex-file-compressed 20703717 21463684 0.96
tpcds_q45/duckdb:vortex-file-compressed 31037533 30418405 1.02
tpcds_q46/duckdb:vortex-file-compressed 🚀 32279789 37635505 0.86
tpcds_q47/duckdb:vortex-file-compressed 53679675 52885163 1.02
tpcds_q48/duckdb:vortex-file-compressed 31203676 31852524 0.98
tpcds_q49/duckdb:vortex-file-compressed 33897550 35731726 0.95
tpcds_q50/duckdb:vortex-file-compressed 26668097 26973838 0.99
tpcds_q51/duckdb:vortex-file-compressed 105907062 111744698 0.95
tpcds_q52/duckdb:vortex-file-compressed 15100489 15220202 0.99
tpcds_q53/duckdb:vortex-file-compressed 24601244 24399965 1.01
tpcds_q54/duckdb:vortex-file-compressed 29414066 30263457 0.97
tpcds_q55/duckdb:vortex-file-compressed 14546908 14428813 1.01
tpcds_q56/duckdb:vortex-file-compressed 28708315 29517026 0.97
tpcds_q57/duckdb:vortex-file-compressed 34880886 36943068 0.94
tpcds_q58/duckdb:vortex-file-compressed 31034507 31596336 0.98
tpcds_q59/duckdb:vortex-file-compressed 38112855 38004923 1.00
tpcds_q60/duckdb:vortex-file-compressed 28487990 27581818 1.03
tpcds_q61/duckdb:vortex-file-compressed 31099737 31653750 0.98
tpcds_q62/duckdb:vortex-file-compressed 15038161 14569659 1.03
tpcds_q63/duckdb:vortex-file-compressed 21755791 21596609 1.01
tpcds_q64/duckdb:vortex-file-compressed 97770840 99699150 0.98
tpcds_q65/duckdb:vortex-file-compressed 22946496 22821486 1.01
tpcds_q66/duckdb:vortex-file-compressed 28949455 29492405 0.98
tpcds_q67/duckdb:vortex-file-compressed 137402185 142567726 0.96
tpcds_q68/duckdb:vortex-file-compressed 32557271 32085796 1.01
tpcds_q69/duckdb:vortex-file-compressed 43333342 44326177 0.98
tpcds_q70/duckdb:vortex-file-compressed 32612724 32254020 1.01
tpcds_q71/duckdb:vortex-file-compressed 22444072 23108197 0.97
tpcds_q72/duckdb:vortex-file-compressed 154627007 154718985 1.00
tpcds_q73/duckdb:vortex-file-compressed 27346553 27873692 0.98
tpcds_q74/duckdb:vortex-file-compressed 45570033 47214644 0.97
tpcds_q75/duckdb:vortex-file-compressed 49423910 49950404 0.99
tpcds_q76/duckdb:vortex-file-compressed 21004140 22424454 0.94
tpcds_q77/duckdb:vortex-file-compressed 23525122 25557690 0.92
tpcds_q78/duckdb:vortex-file-compressed 68987331 69738773 0.99
tpcds_q79/duckdb:vortex-file-compressed 27734338 26897187 1.03
tpcds_q80/duckdb:vortex-file-compressed 48009386 46036369 1.04
tpcds_q81/duckdb:vortex-file-compressed 29060174 30264121 0.96
tpcds_q82/duckdb:vortex-file-compressed 46260967 46066487 1.00
tpcds_q83/duckdb:vortex-file-compressed 27312386 28978735 0.94
tpcds_q84/duckdb:vortex-file-compressed 16487204 16783989 0.98
tpcds_q85/duckdb:vortex-file-compressed 43455157 44404173 0.98
tpcds_q86/duckdb:vortex-file-compressed 17385815 16704182 1.04
tpcds_q87/duckdb:vortex-file-compressed 42272919 40709041 1.04
tpcds_q88/duckdb:vortex-file-compressed 58478440 61048512 0.96
tpcds_q89/duckdb:vortex-file-compressed 22206826 22812387 0.97
tpcds_q90/duckdb:vortex-file-compressed 11372946 11734894 0.97
tpcds_q91/duckdb:vortex-file-compressed 23176172 22101060 1.05
tpcds_q92/duckdb:vortex-file-compressed 17275367 17933672 0.96
tpcds_q93/duckdb:vortex-file-compressed 27593461 27944713 0.99
tpcds_q94/duckdb:vortex-file-compressed 21002503 22101869 0.95
tpcds_q95/duckdb:vortex-file-compressed 122410287 123790140 0.99
tpcds_q96/duckdb:vortex-file-compressed 13728988 14076545 0.98
tpcds_q97/duckdb:vortex-file-compressed 37144881 39805160 0.93
tpcds_q98/duckdb:vortex-file-compressed 19721515 19697287 1.00
tpcds_q99/duckdb:vortex-file-compressed 18063340 18114699 1.00
duckdb / parquet (0.993x ➖, 0↑ 2↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29559495 29593059 1.00
tpcds_q02/duckdb:parquet 24424486 24399519 1.00
tpcds_q03/duckdb:parquet 12915046 12844155 1.01
tpcds_q04/duckdb:parquet 171174958 170968007 1.00
tpcds_q05/duckdb:parquet 30741192 31535106 0.97
tpcds_q06/duckdb:parquet 34155936 34692662 0.98
tpcds_q07/duckdb:parquet 24618891 24782515 0.99
tpcds_q08/duckdb:parquet 29824475 29586124 1.01
tpcds_q09/duckdb:parquet 44581658 44861750 0.99
tpcds_q10/duckdb:parquet 39194188 38730649 1.01
tpcds_q11/duckdb:parquet 91628259 95872430 0.96
tpcds_q12/duckdb:parquet 15846752 16256495 0.97
tpcds_q13/duckdb:parquet 35481149 35321136 1.00
tpcds_q14/duckdb:parquet 104613449 106220440 0.98
tpcds_q15/duckdb:parquet 31099457 31101961 1.00
tpcds_q16/duckdb:parquet 22828992 23177361 0.98
tpcds_q17/duckdb:parquet 38479467 39352234 0.98
tpcds_q18/duckdb:parquet 49054395 49616391 0.99
tpcds_q19/duckdb:parquet 31901703 32532863 0.98
tpcds_q20/duckdb:parquet 16981368 17274536 0.98
tpcds_q21/duckdb:parquet 11890017 12339474 0.96
tpcds_q22/duckdb:parquet 70741865 73346574 0.96
tpcds_q23/duckdb:parquet 81741719 83463812 0.98
tpcds_q24/duckdb:parquet 47563344 47848084 0.99
tpcds_q25/duckdb:parquet 36065033 36793960 0.98
tpcds_q26/duckdb:parquet 39291815 40253540 0.98
tpcds_q27/duckdb:parquet 53014254 54412802 0.97
tpcds_q28/duckdb:parquet 43349227 43392444 1.00
tpcds_q29/duckdb:parquet 38813492 37270896 1.04
tpcds_q30/duckdb:parquet 37457497 38199113 0.98
tpcds_q31/duckdb:parquet 27211925 29049072 0.94
tpcds_q32/duckdb:parquet 13148830 13227433 0.99
tpcds_q33/duckdb:parquet 24419579 23831157 1.02
tpcds_q34/duckdb:parquet 23016084 23251255 0.99
tpcds_q35/duckdb:parquet 60858831 61511418 0.99
tpcds_q36/duckdb:parquet 23267604 23844748 0.98
tpcds_q37/duckdb:parquet 13680972 15005307 0.91
tpcds_q38/duckdb:parquet 37150935 37263344 1.00
tpcds_q39/duckdb:parquet 32315330 32305980 1.00
tpcds_q40/duckdb:parquet 19880555 20138557 0.99
tpcds_q41/duckdb:parquet 8977909 8956115 1.00
tpcds_q42/duckdb:parquet 13247085 13000028 1.02
tpcds_q43/duckdb:parquet 17887787 17396946 1.03
tpcds_q44/duckdb:parquet 26323119 26248792 1.00
tpcds_q45/duckdb:parquet 29118087 29782866 0.98
tpcds_q46/duckdb:parquet 48174032 50511223 0.95
tpcds_q47/duckdb:parquet 50176720 51688942 0.97
tpcds_q48/duckdb:parquet 32796103 33155820 0.99
tpcds_q49/duckdb:parquet 28395750 29250986 0.97
tpcds_q50/duckdb:parquet 26209996 26820745 0.98
tpcds_q51/duckdb:parquet 🚨 115076782 104034769 1.11
tpcds_q52/duckdb:parquet 13716135 13817313 0.99
tpcds_q53/duckdb:parquet 17223861 17350777 0.99
tpcds_q54/duckdb:parquet 28567361 29573674 0.97
tpcds_q55/duckdb:parquet 🚨 14367376 12895944 1.11
tpcds_q56/duckdb:parquet 24371365 24414650 1.00
tpcds_q57/duckdb:parquet 38281137 38464544 1.00
tpcds_q58/duckdb:parquet 25955938 26457635 0.98
tpcds_q59/duckdb:parquet 36201946 36537960 0.99
tpcds_q60/duckdb:parquet 25362924 26777105 0.95
tpcds_q61/duckdb:parquet 33872765 34259166 0.99
tpcds_q62/duckdb:parquet 12962918 12906826 1.00
tpcds_q63/duckdb:parquet 15633477 15529605 1.01
tpcds_q64/duckdb:parquet 78591457 76685472 1.02
tpcds_q65/duckdb:parquet 22851754 22625647 1.01
tpcds_q66/duckdb:parquet 30461074 30985814 0.98
tpcds_q67/duckdb:parquet 138346128 140218002 0.99
tpcds_q68/duckdb:parquet 39786976 39346039 1.01
tpcds_q69/duckdb:parquet 40272518 39324824 1.02
tpcds_q70/duckdb:parquet 22517700 22574997 1.00
tpcds_q71/duckdb:parquet 22485365 23215905 0.97
tpcds_q72/duckdb:parquet 168068905 167597268 1.00
tpcds_q73/duckdb:parquet 20018532 21165703 0.95
tpcds_q74/duckdb:parquet 125447705 128861693 0.97
tpcds_q75/duckdb:parquet 57420763 59008425 0.97
tpcds_q76/duckdb:parquet 22594792 22329824 1.01
tpcds_q77/duckdb:parquet 24958500 25498409 0.98
tpcds_q78/duckdb:parquet 77885376 77644212 1.00
tpcds_q79/duckdb:parquet 30239317 30614643 0.99
tpcds_q80/duckdb:parquet 47268276 43619495 1.08
tpcds_q81/duckdb:parquet 35482596 35886282 0.99
tpcds_q82/duckdb:parquet 16453285 17566809 0.94
tpcds_q83/duckdb:parquet 18711954 18949599 0.99
tpcds_q84/duckdb:parquet 20832057 21016723 0.99
tpcds_q85/duckdb:parquet 42272163 42639778 0.99
tpcds_q86/duckdb:parquet 13700274 14552926 0.94
tpcds_q87/duckdb:parquet 39471789 39887983 0.99
tpcds_q88/duckdb:parquet 54347690 55179272 0.98
tpcds_q89/duckdb:parquet 20327138 18914550 1.07
tpcds_q90/duckdb:parquet 8714461 8558778 1.02
tpcds_q91/duckdb:parquet 26059156 25202550 1.03
tpcds_q92/duckdb:parquet 13239220 13260794 1.00
tpcds_q93/duckdb:parquet 32387840 31917471 1.01
tpcds_q94/duckdb:parquet 18268731 18928930 0.97
tpcds_q95/duckdb:parquet 148021582 142831610 1.04
tpcds_q96/duckdb:parquet 10708102 10513147 1.02
tpcds_q97/duckdb:parquet 38742850 38453908 1.01
tpcds_q98/duckdb:parquet 21783289 22073631 0.99
tpcds_q99/duckdb:parquet 20601046 20147097 1.02
File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-compact 47.43 KB 0 B 47.43 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 362.44 KB 0 B 362.44 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.04 MB 0 B 6.04 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.49 MB 0 B 59.49 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 638.84 KB 0 B 638.84 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 424.18 KB 0 B 424.18 KB -100.0%
date_dim.vortex 1.0 vortex-compact 140.28 KB 0 B 140.28 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 10.29 KB 0 B 10.29 KB -100.0%
income_band.vortex 1.0 vortex-compact 5.56 KB 0 B 5.56 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 0 B 16.07 MB -100.0%
item.vortex 1.0 vortex-compact 1000.32 KB 0 B 1000.32 KB -100.0%
promotion.vortex 1.0 vortex-compact 50.31 KB 0 B 50.31 KB -100.0%
reason.vortex 1.0 vortex-compact 5.96 KB 0 B 5.96 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 10.73 KB 0 B 10.73 KB -100.0%
store.vortex 1.0 vortex-compact 43.22 KB 0 B 43.22 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.36 MB 0 B 9.36 MB -100.0%
store_sales.vortex 1.0 vortex-compact 78.12 MB 0 B 78.12 MB -100.0%
time_dim.vortex 1.0 vortex-compact 96.59 KB 0 B 96.59 KB -100.0%
warehouse.vortex 1.0 vortex-compact 22.14 KB 0 B 22.14 KB -100.0%
web_page.vortex 1.0 vortex-compact 25.01 KB 0 B 25.01 KB -100.0%
web_returns.vortex 1.0 vortex-compact 3.00 MB 0 B 3.00 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.45 MB 0 B 29.45 MB -100.0%
web_site.vortex 1.0 vortex-compact 42.19 KB 0 B 42.19 KB -100.0%

Totals:

  • vortex-compact: 207.94 MB → 0 B (-100.0%)
  • vortex-file-compressed: 269.98 MB → 269.98 MB (0.0%)

@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -10.7%
Engines: DataFusion No clear signal (-5.9%, environment too noisy confidence) · DuckDB No clear signal (-15.3%, environment too noisy confidence)
Vortex (geomean): 0.962x ➖
Parquet (geomean): 1.077x ➖
Shifts: Parquet (control) +7.7% · Median polish +5.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.020x ➖, 2↑ 2↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 30059182 51184630 0.59
fineweb_q01/datafusion:vortex-file-compressed 🚀 468377708 758667254 0.62
fineweb_q02/datafusion:vortex-file-compressed 536243954 574565300 0.93
fineweb_q03/datafusion:vortex-file-compressed 1177498265 1090139711 1.08
fineweb_q04/datafusion:vortex-file-compressed 1316976440 1163901668 1.13
fineweb_q05/datafusion:vortex-file-compressed 1235879700 1081340807 1.14
fineweb_q06/datafusion:vortex-file-compressed 1551036408 1324828851 1.17
fineweb_q07/datafusion:vortex-file-compressed 🚨 1446168667 1105715370 1.31
fineweb_q08/datafusion:vortex-file-compressed 🚨 748039303 452535187 1.65
datafusion / parquet (1.084x ➖, 0↑ 1↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1079377582 989972103 1.09
fineweb_q01/datafusion:parquet 1823200445 1709423329 1.07
fineweb_q02/datafusion:parquet 🚨 2497674594 1696602358 1.47
fineweb_q03/datafusion:parquet 1982198703 1709736022 1.16
fineweb_q04/datafusion:parquet 1729407738 1994152677 0.87
fineweb_q05/datafusion:parquet 1853362390 1792204687 1.03
fineweb_q06/datafusion:parquet 1857695320 1698326817 1.09
fineweb_q07/datafusion:parquet 1722686488 1709873998 1.01
fineweb_q08/datafusion:parquet 1787535330 1694128644 1.06
duckdb / vortex-file-compressed (0.907x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 80441706 77990348 1.03
fineweb_q01/duckdb:vortex-file-compressed 573774237 536659165 1.07
fineweb_q02/duckdb:vortex-file-compressed 499253676 519689270 0.96
fineweb_q03/duckdb:vortex-file-compressed 1242496691 1524843403 0.81
fineweb_q04/duckdb:vortex-file-compressed 1312946019 1666233334 0.79
fineweb_q05/duckdb:vortex-file-compressed 1263467209 1459385537 0.87
fineweb_q06/duckdb:vortex-file-compressed 1453382551 1770714389 0.82
fineweb_q07/duckdb:vortex-file-compressed 1289060346 1503367291 0.86
fineweb_q08/duckdb:vortex-file-compressed 602196396 602012295 1.00
duckdb / parquet (1.071x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1275305321 1023822367 1.25
fineweb_q01/duckdb:parquet 1393891045 1272055121 1.10
fineweb_q02/duckdb:parquet 1385197009 1316883287 1.05
fineweb_q03/duckdb:parquet 3890527528 3563095121 1.09
fineweb_q04/duckdb:parquet 1921087413 1841733484 1.04
fineweb_q05/duckdb:parquet 2092061715 2073722571 1.01
fineweb_q06/duckdb:parquet 4469869427 4251823103 1.05
fineweb_q07/duckdb:parquet 2709894964 2552028596 1.06
fineweb_q08/duckdb:parquet 1081113040 1077884423 1.00

@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (-1.7%, low confidence) · DuckDB No clear signal (+3.5%, low confidence)
Vortex (geomean): 0.973x ➖
Parquet (geomean): 0.965x ➖
Shifts: Parquet (control) -3.5% · Median polish -3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.927x ➖, 4↑ 1↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 447143853 460607913 0.97
clickbench-sorted_q24/datafusion:vortex-file-compressed 20048008 21788915 0.92
clickbench-sorted_q26/datafusion:vortex-file-compressed 🚨 23413459 20770235 1.13
clickbench-sorted_q36/datafusion:vortex-file-compressed 🚀 56525280 66615199 0.85
clickbench-sorted_q37/datafusion:vortex-file-compressed 🚀 42364516 56107144 0.76
clickbench-sorted_q38/datafusion:vortex-file-compressed 🚀 38926792 44108936 0.88
clickbench-sorted_q39/datafusion:vortex-file-compressed 113992831 115447291 0.99
clickbench-sorted_q40/datafusion:vortex-file-compressed 22367872 22193177 1.01
clickbench-sorted_q41/datafusion:vortex-file-compressed 🚀 18450200 20983838 0.88
clickbench-sorted_q42/datafusion:vortex-file-compressed 13969547 14804002 0.94
datafusion / parquet (0.944x ➖, 1↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 4625930014 5085196126 0.91
clickbench-sorted_q24/datafusion:parquet 🚀 26789176 30381541 0.88
clickbench-sorted_q26/datafusion:parquet 27856198 29900708 0.93
clickbench-sorted_q36/datafusion:parquet 175569470 183554547 0.96
clickbench-sorted_q37/datafusion:parquet 110774333 117271036 0.94
clickbench-sorted_q38/datafusion:parquet 156053710 162365796 0.96
clickbench-sorted_q39/datafusion:parquet 292303234 309406781 0.94
clickbench-sorted_q40/datafusion:parquet 69260668 73725489 0.94
clickbench-sorted_q41/datafusion:parquet 60423774 63015512 0.96
clickbench-sorted_q42/datafusion:parquet 31728801 31246177 1.02
duckdb / vortex-file-compressed (1.021x ➖, 0↑ 1↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 152879273 164613986 0.93
clickbench-sorted_q24/duckdb:vortex-file-compressed 🚨 27946846 22628232 1.24
clickbench-sorted_q26/duckdb:vortex-file-compressed 44025414 41549602 1.06
clickbench-sorted_q36/duckdb:vortex-file-compressed 56601762 58383160 0.97
clickbench-sorted_q37/duckdb:vortex-file-compressed 44644010 45525846 0.98
clickbench-sorted_q38/duckdb:vortex-file-compressed 52141885 49343454 1.06
clickbench-sorted_q39/duckdb:vortex-file-compressed 106737275 107437433 0.99
clickbench-sorted_q40/duckdb:vortex-file-compressed 28943119 29141123 0.99
clickbench-sorted_q41/duckdb:vortex-file-compressed 28139805 27955701 1.01
clickbench-sorted_q42/duckdb:vortex-file-compressed 24368976 24119741 1.01
duckdb / parquet (0.986x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 192230648 194864183 0.99
clickbench-sorted_q24/duckdb:parquet 29042480 28985730 1.00
clickbench-sorted_q26/duckdb:parquet 25456733 25842960 0.99
clickbench-sorted_q36/duckdb:parquet 108558069 110414719 0.98
clickbench-sorted_q37/duckdb:parquet 94175910 92501619 1.02
clickbench-sorted_q38/duckdb:parquet 95134585 97132185 0.98
clickbench-sorted_q39/duckdb:parquet 177945686 182242593 0.98
clickbench-sorted_q40/duckdb:parquet 41964630 41761297 1.00
clickbench-sorted_q41/duckdb:parquet 41796382 41625047 1.00
clickbench-sorted_q42/duckdb:parquet 29220308 31558543 0.93
File Size Changes (201 files changed, -42.8% overall, 45↑ 156↓)
File Scale Format Base HEAD Change %
hits_016.vortex 1.0 vortex-file-compressed 180.59 MB 182.49 MB +1.90 MB +1.1%
hits_036.vortex 1.0 vortex-file-compressed 171.43 MB 173.22 MB +1.80 MB +1.0%
hits_074.vortex 1.0 vortex-file-compressed 198.22 MB 199.84 MB +1.62 MB +0.8%
hits_066.vortex 1.0 vortex-file-compressed 163.22 MB 164.55 MB +1.33 MB +0.8%
hits_035.vortex 1.0 vortex-file-compressed 102.39 MB 103.05 MB +676.78 KB +0.6%
hits_018.vortex 1.0 vortex-file-compressed 198.49 MB 199.61 MB +1.12 MB +0.6%
hits_011.vortex 1.0 vortex-file-compressed 198.30 MB 199.30 MB +1023.97 KB +0.5%
hits_007.vortex 1.0 vortex-file-compressed 199.14 MB 200.06 MB +942.20 KB +0.5%
hits_054.vortex 1.0 vortex-file-compressed 146.93 MB 147.60 MB +681.78 KB +0.5%
hits_002.vortex 1.0 vortex-file-compressed 160.81 MB 161.50 MB +709.25 KB +0.4%
hits_082.vortex 1.0 vortex-file-compressed 139.85 MB 140.34 MB +495.26 KB +0.3%
hits_044.vortex 1.0 vortex-file-compressed 200.11 MB 200.74 MB +642.75 KB +0.3%
hits_000.vortex 1.0 vortex-file-compressed 131.58 MB 131.96 MB +392.94 KB +0.3%
hits_058.vortex 1.0 vortex-file-compressed 154.82 MB 155.19 MB +371.84 KB +0.2%
hits_078.vortex 1.0 vortex-file-compressed 130.98 MB 131.28 MB +307.77 KB +0.2%
hits_042.vortex 1.0 vortex-file-compressed 201.63 MB 202.08 MB +464.12 KB +0.2%
hits_029.vortex 1.0 vortex-file-compressed 199.93 MB 200.36 MB +435.83 KB +0.2%
hits_048.vortex 1.0 vortex-file-compressed 199.48 MB 199.87 MB +395.27 KB +0.2%
hits_072.vortex 1.0 vortex-file-compressed 102.27 MB 102.47 MB +202.40 KB +0.2%
hits_015.vortex 1.0 vortex-file-compressed 131.22 MB 131.46 MB +246.23 KB +0.2%
hits_052.vortex 1.0 vortex-file-compressed 130.77 MB 131.00 MB +228.28 KB +0.2%
hits_088.vortex 1.0 vortex-file-compressed 171.98 MB 172.24 MB +261.63 KB +0.1%
hits_079.vortex 1.0 vortex-file-compressed 181.01 MB 181.23 MB +230.09 KB +0.1%
hits_099.vortex 1.0 vortex-file-compressed 171.20 MB 171.41 MB +216.87 KB +0.1%
hits_084.vortex 1.0 vortex-file-compressed 154.43 MB 154.61 MB +183.76 KB +0.1%
hits_009.vortex 1.0 vortex-file-compressed 101.23 MB 101.32 MB +94.34 KB +0.1%
hits_093.vortex 1.0 vortex-file-compressed 131.62 MB 131.72 MB +102.88 KB +0.1%
hits_001.vortex 1.0 vortex-file-compressed 189.15 MB 189.29 MB +140.50 KB +0.1%
hits_003.vortex 1.0 vortex-file-compressed 136.55 MB 136.65 MB +100.44 KB +0.1%
hits_032.vortex 1.0 vortex-file-compressed 154.57 MB 154.68 MB +113.50 KB +0.1%
hits_059.vortex 1.0 vortex-file-compressed 198.91 MB 199.04 MB +131.55 KB +0.1%
hits_097.vortex 1.0 vortex-file-compressed 192.86 MB 192.98 MB +126.40 KB +0.1%
hits_047.vortex 1.0 vortex-file-compressed 154.45 MB 154.54 MB +95.33 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.83 MB 140.90 MB +77.95 KB +0.1%
hits_045.vortex 1.0 vortex-file-compressed 140.03 MB 140.10 MB +77.44 KB +0.1%
hits_014.vortex 1.0 vortex-file-compressed 172.03 MB 172.12 MB +93.58 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 169.03 MB 169.11 MB +87.55 KB +0.1%
hits_023.vortex 1.0 vortex-file-compressed 195.40 MB 195.49 MB +87.55 KB +0.0%
hits_013.vortex 1.0 vortex-file-compressed 161.38 MB 161.45 MB +68.48 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.04 MB 147.09 MB +50.66 KB +0.0%
hits_038.vortex 1.0 vortex-file-compressed 190.13 MB 190.19 MB +58.18 KB +0.0%
hits_073.vortex 1.0 vortex-file-compressed 172.72 MB 172.77 MB +50.20 KB +0.0%
hits_081.vortex 1.0 vortex-file-compressed 200.08 MB 200.13 MB +51.48 KB +0.0%
hits_092.vortex 1.0 vortex-file-compressed 199.61 MB 199.63 MB +22.91 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 177.13 MB 177.14 MB +7.23 KB +0.0%
hits_095.vortex 1.0 vortex-file-compressed 154.42 MB 154.41 MB 2.45 KB -0.0%
hits_041.vortex 1.0 vortex-file-compressed 131.11 MB 131.11 MB 2.34 KB -0.0%
hits_077.vortex 1.0 vortex-file-compressed 172.40 MB 172.39 MB 3.62 KB -0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.07 MB 161.06 MB 3.78 KB -0.0%
hits_063.vortex 1.0 vortex-file-compressed 131.73 MB 131.72 MB 9.51 KB -0.0%
hits_061.vortex 1.0 vortex-file-compressed 160.85 MB 160.84 MB 12.16 KB -0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.64 MB 189.61 MB 23.83 KB -0.0%
hits_065.vortex 1.0 vortex-file-compressed 161.42 MB 161.40 MB 24.92 KB -0.0%
hits_053.vortex 1.0 vortex-file-compressed 189.95 MB 189.92 MB 34.80 KB -0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.52 MB 191.49 MB 36.30 KB -0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.12 MB 172.09 MB 35.80 KB -0.0%
hits_089.vortex 1.0 vortex-file-compressed 131.54 MB 131.51 MB 30.32 KB -0.0%
hits_012.vortex 1.0 vortex-file-compressed 191.06 MB 191.01 MB 51.00 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.11 MB 161.06 MB 43.47 KB -0.0%
hits_017.vortex 1.0 vortex-file-compressed 146.85 MB 146.81 MB 42.61 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.40 MB 126.35 MB 42.34 KB -0.0%
hits_096.vortex 1.0 vortex-file-compressed 199.49 MB 199.43 MB 67.45 KB -0.0%
hits_055.vortex 1.0 vortex-file-compressed 199.66 MB 199.59 MB 71.74 KB -0.0%
hits_060.vortex 1.0 vortex-file-compressed 193.24 MB 193.17 MB 69.89 KB -0.0%
hits_057.vortex 1.0 vortex-file-compressed 160.04 MB 159.97 MB 70.51 KB -0.0%
hits_026.vortex 1.0 vortex-file-compressed 131.37 MB 131.31 MB 61.11 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.87 MB 126.81 MB 61.62 KB -0.0%
hits_083.vortex 1.0 vortex-file-compressed 157.25 MB 157.18 MB 76.73 KB -0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.73 MB 135.66 MB 75.54 KB -0.1%
hits_090.vortex 1.0 vortex-file-compressed 192.65 MB 192.55 MB 110.43 KB -0.1%
hits_030.vortex 1.0 vortex-file-compressed 131.88 MB 131.80 MB 84.82 KB -0.1%
hits_020.vortex 1.0 vortex-file-compressed 160.44 MB 160.33 MB 110.12 KB -0.1%
hits_069.vortex 1.0 vortex-file-compressed 142.42 MB 142.32 MB 103.77 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.59 MB 137.46 MB 133.34 KB -0.1%
hits_021.vortex 1.0 vortex-file-compressed 154.41 MB 154.25 MB 165.63 KB -0.1%
hits_043.vortex 1.0 vortex-file-compressed 126.60 MB 126.47 MB 135.98 KB -0.1%
hits_004.vortex 1.0 vortex-file-compressed 131.50 MB 131.36 MB 147.05 KB -0.1%
hits_034.vortex 1.0 vortex-file-compressed 182.35 MB 182.15 MB 206.48 KB -0.1%
hits_067.vortex 1.0 vortex-file-compressed 131.97 MB 131.81 MB 163.09 KB -0.1%
hits_094.vortex 1.0 vortex-file-compressed 159.05 MB 158.84 MB 208.63 KB -0.1%
hits_040.vortex 1.0 vortex-file-compressed 143.36 MB 143.13 MB 230.75 KB -0.2%
hits_033.vortex 1.0 vortex-file-compressed 200.49 MB 200.14 MB 360.09 KB -0.2%
hits_051.vortex 1.0 vortex-file-compressed 172.31 MB 171.99 MB 326.98 KB -0.2%
hits_005.vortex 1.0 vortex-file-compressed 167.87 MB 167.55 MB 331.07 KB -0.2%
hits_062.vortex 1.0 vortex-file-compressed 170.85 MB 170.38 MB 478.84 KB -0.3%
hits_022.vortex 1.0 vortex-file-compressed 199.75 MB 199.07 MB 689.75 KB -0.3%
hits_046.vortex 1.0 vortex-file-compressed 101.74 MB 101.39 MB 358.53 KB -0.3%
hits_008.vortex 1.0 vortex-file-compressed 140.88 MB 140.34 MB 550.48 KB -0.4%
hits_085.vortex 1.0 vortex-file-compressed 199.68 MB 198.88 MB 817.27 KB -0.4%
hits_028.vortex 1.0 vortex-file-compressed 152.61 MB 151.89 MB 740.58 KB -0.5%
hits_068.vortex 1.0 vortex-file-compressed 161.27 MB 160.49 MB 799.21 KB -0.5%
hits_031.vortex 1.0 vortex-file-compressed 160.53 MB 159.67 MB 873.84 KB -0.5%
hits_086.vortex 1.0 vortex-file-compressed 193.68 MB 192.26 MB 1.43 MB -0.7%
hits_070.vortex 1.0 vortex-file-compressed 200.06 MB 198.53 MB 1.54 MB -0.8%
hits_024.vortex 1.0 vortex-file-compressed 160.48 MB 159.05 MB 1.43 MB -0.9%
hits_071.vortex 1.0 vortex-file-compressed 141.30 MB 140.04 MB 1.26 MB -0.9%
hits_076.vortex 1.0 vortex-file-compressed 161.06 MB 159.42 MB 1.64 MB -1.0%
hits_064.vortex 1.0 vortex-file-compressed 193.16 MB 191.05 MB 2.11 MB -1.1%
hits_027.vortex 1.0 vortex-file-compressed 192.28 MB 190.11 MB 2.17 MB -1.1%
hits_087.vortex 1.0 vortex-file-compressed 161.84 MB 159.84 MB 2.00 MB -1.2%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-compact 97.91 MB 0 B 97.91 MB -100.0%
hits_001.vortex 1.0 vortex-compact 139.02 MB 0 B 139.02 MB -100.0%
hits_002.vortex 1.0 vortex-compact 124.09 MB 0 B 124.09 MB -100.0%
hits_003.vortex 1.0 vortex-compact 104.54 MB 0 B 104.54 MB -100.0%
hits_004.vortex 1.0 vortex-compact 97.65 MB 0 B 97.65 MB -100.0%
hits_005.vortex 1.0 vortex-compact 115.94 MB 0 B 115.94 MB -100.0%
hits_006.vortex 1.0 vortex-compact 95.58 MB 0 B 95.58 MB -100.0%
hits_007.vortex 1.0 vortex-compact 153.64 MB 0 B 153.64 MB -100.0%
hits_008.vortex 1.0 vortex-compact 106.23 MB 0 B 106.23 MB -100.0%
hits_009.vortex 1.0 vortex-compact 75.23 MB 0 B 75.23 MB -100.0%
hits_010.vortex 1.0 vortex-compact 123.35 MB 0 B 123.35 MB -100.0%
hits_011.vortex 1.0 vortex-compact 153.03 MB 0 B 153.03 MB -100.0%
hits_012.vortex 1.0 vortex-compact 139.97 MB 0 B 139.97 MB -100.0%
hits_013.vortex 1.0 vortex-compact 125.28 MB 0 B 125.28 MB -100.0%
hits_014.vortex 1.0 vortex-compact 133.85 MB 0 B 133.85 MB -100.0%
hits_015.vortex 1.0 vortex-compact 97.51 MB 0 B 97.51 MB -100.0%
hits_016.vortex 1.0 vortex-compact 127.43 MB 0 B 127.43 MB -100.0%
hits_017.vortex 1.0 vortex-compact 112.19 MB 0 B 112.19 MB -100.0%
hits_018.vortex 1.0 vortex-compact 153.00 MB 0 B 153.00 MB -100.0%
hits_019.vortex 1.0 vortex-compact 106.70 MB 0 B 106.70 MB -100.0%
hits_020.vortex 1.0 vortex-compact 111.64 MB 0 B 111.64 MB -100.0%
hits_021.vortex 1.0 vortex-compact 110.62 MB 0 B 110.62 MB -100.0%
hits_022.vortex 1.0 vortex-compact 153.13 MB 0 B 153.13 MB -100.0%
hits_023.vortex 1.0 vortex-compact 142.64 MB 0 B 142.64 MB -100.0%
hits_024.vortex 1.0 vortex-compact 125.18 MB 0 B 125.18 MB -100.0%
hits_025.vortex 1.0 vortex-compact 133.48 MB 0 B 133.48 MB -100.0%
hits_026.vortex 1.0 vortex-compact 97.90 MB 0 B 97.90 MB -100.0%
hits_027.vortex 1.0 vortex-compact 139.34 MB 0 B 139.34 MB -100.0%
hits_028.vortex 1.0 vortex-compact 115.68 MB 0 B 115.68 MB -100.0%
hits_029.vortex 1.0 vortex-compact 153.55 MB 0 B 153.55 MB -100.0%
hits_030.vortex 1.0 vortex-compact 99.60 MB 0 B 99.60 MB -100.0%
hits_031.vortex 1.0 vortex-compact 111.74 MB 0 B 111.74 MB -100.0%
hits_032.vortex 1.0 vortex-compact 110.61 MB 0 B 110.61 MB -100.0%
hits_033.vortex 1.0 vortex-compact 153.63 MB 0 B 153.63 MB -100.0%
hits_034.vortex 1.0 vortex-compact 133.35 MB 0 B 133.35 MB -100.0%
hits_035.vortex 1.0 vortex-compact 75.94 MB 0 B 75.94 MB -100.0%
hits_036.vortex 1.0 vortex-compact 133.40 MB 0 B 133.40 MB -100.0%
hits_037.vortex 1.0 vortex-compact 133.00 MB 0 B 133.00 MB -100.0%
hits_038.vortex 1.0 vortex-compact 138.15 MB 0 B 138.15 MB -100.0%
hits_039.vortex 1.0 vortex-compact 124.91 MB 0 B 124.91 MB -100.0%
hits_040.vortex 1.0 vortex-compact 109.96 MB 0 B 109.96 MB -100.0%
hits_041.vortex 1.0 vortex-compact 98.07 MB 0 B 98.07 MB -100.0%
hits_042.vortex 1.0 vortex-compact 136.32 MB 0 B 136.32 MB -100.0%
hits_043.vortex 1.0 vortex-compact 94.15 MB 0 B 94.15 MB -100.0%
hits_044.vortex 1.0 vortex-compact 153.73 MB 0 B 153.73 MB -100.0%
hits_045.vortex 1.0 vortex-compact 106.09 MB 0 B 106.09 MB -100.0%
hits_046.vortex 1.0 vortex-compact 74.93 MB 0 B 74.93 MB -100.0%
hits_047.vortex 1.0 vortex-compact 110.48 MB 0 B 110.48 MB -100.0%
hits_048.vortex 1.0 vortex-compact 153.24 MB 0 B 153.24 MB -100.0%
hits_049.vortex 1.0 vortex-compact 140.49 MB 0 B 140.49 MB -100.0%
hits_050.vortex 1.0 vortex-compact 126.35 MB 0 B 126.35 MB -100.0%
hits_051.vortex 1.0 vortex-compact 134.00 MB 0 B 134.00 MB -100.0%
hits_052.vortex 1.0 vortex-compact 98.30 MB 0 B 98.30 MB -100.0%
hits_053.vortex 1.0 vortex-compact 139.05 MB 0 B 139.05 MB -100.0%
hits_054.vortex 1.0 vortex-compact 112.10 MB 0 B 112.10 MB -100.0%
hits_055.vortex 1.0 vortex-compact 153.17 MB 0 B 153.17 MB -100.0%
hits_056.vortex 1.0 vortex-compact 100.88 MB 0 B 100.88 MB -100.0%
hits_057.vortex 1.0 vortex-compact 111.88 MB 0 B 111.88 MB -100.0%
hits_058.vortex 1.0 vortex-compact 111.12 MB 0 B 111.12 MB -100.0%
hits_059.vortex 1.0 vortex-compact 152.91 MB 0 B 152.91 MB -100.0%
hits_060.vortex 1.0 vortex-compact 141.16 MB 0 B 141.16 MB -100.0%
hits_061.vortex 1.0 vortex-compact 124.66 MB 0 B 124.66 MB -100.0%
hits_062.vortex 1.0 vortex-compact 132.59 MB 0 B 132.59 MB -100.0%
hits_063.vortex 1.0 vortex-compact 98.19 MB 0 B 98.19 MB -100.0%
hits_064.vortex 1.0 vortex-compact 140.01 MB 0 B 140.01 MB -100.0%
hits_065.vortex 1.0 vortex-compact 125.36 MB 0 B 125.36 MB -100.0%
hits_066.vortex 1.0 vortex-compact 117.58 MB 0 B 117.58 MB -100.0%
hits_067.vortex 1.0 vortex-compact 98.08 MB 0 B 98.08 MB -100.0%
hits_068.vortex 1.0 vortex-compact 112.46 MB 0 B 112.46 MB -100.0%
hits_069.vortex 1.0 vortex-compact 99.46 MB 0 B 99.46 MB -100.0%
hits_070.vortex 1.0 vortex-compact 153.71 MB 0 B 153.71 MB -100.0%
hits_071.vortex 1.0 vortex-compact 106.21 MB 0 B 106.21 MB -100.0%
hits_072.vortex 1.0 vortex-compact 75.61 MB 0 B 75.61 MB -100.0%
hits_073.vortex 1.0 vortex-compact 134.19 MB 0 B 134.19 MB -100.0%
hits_074.vortex 1.0 vortex-compact 153.19 MB 0 B 153.19 MB -100.0%
hits_075.vortex 1.0 vortex-compact 139.65 MB 0 B 139.65 MB -100.0%
hits_076.vortex 1.0 vortex-compact 124.31 MB 0 B 124.31 MB -100.0%
hits_077.vortex 1.0 vortex-compact 134.60 MB 0 B 134.60 MB -100.0%
hits_078.vortex 1.0 vortex-compact 97.18 MB 0 B 97.18 MB -100.0%
hits_079.vortex 1.0 vortex-compact 128.16 MB 0 B 128.16 MB -100.0%
hits_080.vortex 1.0 vortex-compact 94.46 MB 0 B 94.46 MB -100.0%
hits_081.vortex 1.0 vortex-compact 153.69 MB 0 B 153.69 MB -100.0%
hits_082.vortex 1.0 vortex-compact 106.24 MB 0 B 106.24 MB -100.0%
hits_083.vortex 1.0 vortex-compact 109.94 MB 0 B 109.94 MB -100.0%
hits_084.vortex 1.0 vortex-compact 111.04 MB 0 B 111.04 MB -100.0%
hits_085.vortex 1.0 vortex-compact 153.48 MB 0 B 153.48 MB -100.0%
hits_086.vortex 1.0 vortex-compact 140.84 MB 0 B 140.84 MB -100.0%
hits_087.vortex 1.0 vortex-compact 125.51 MB 0 B 125.51 MB -100.0%
hits_088.vortex 1.0 vortex-compact 134.14 MB 0 B 134.14 MB -100.0%
hits_089.vortex 1.0 vortex-compact 99.02 MB 0 B 99.02 MB -100.0%
hits_090.vortex 1.0 vortex-compact 141.25 MB 0 B 141.25 MB -100.0%
hits_091.vortex 1.0 vortex-compact 111.61 MB 0 B 111.61 MB -100.0%
hits_092.vortex 1.0 vortex-compact 153.37 MB 0 B 153.37 MB -100.0%
hits_093.vortex 1.0 vortex-compact 98.60 MB 0 B 98.60 MB -100.0%
hits_094.vortex 1.0 vortex-compact 111.36 MB 0 B 111.36 MB -100.0%
hits_095.vortex 1.0 vortex-compact 110.61 MB 0 B 110.61 MB -100.0%
hits_096.vortex 1.0 vortex-compact 153.41 MB 0 B 153.41 MB -100.0%
hits_097.vortex 1.0 vortex-compact 140.16 MB 0 B 140.16 MB -100.0%
hits_098.vortex 1.0 vortex-compact 104.47 MB 0 B 104.47 MB -100.0%
hits_099.vortex 1.0 vortex-compact 132.96 MB 0 B 132.96 MB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 15.97 GB → 15.96 GB (-0.0%)

@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): 1.027x ➖
Parquet (geomean): 1.025x ➖
Shifts: Parquet (control) +2.5% · Median polish +2.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (1.027x ➖, 0↑ 1↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12709166 11999225 1.06
statpopgen_q01/duckdb:vortex-file-compressed 28508040 26988493 1.06
statpopgen_q02/duckdb:vortex-file-compressed 🚨 581555670 523367286 1.11
statpopgen_q03/duckdb:vortex-file-compressed 1064104866 1024056175 1.04
statpopgen_q04/duckdb:vortex-file-compressed 1084570127 1053289666 1.03
statpopgen_q05/duckdb:vortex-file-compressed 478936009 474729119 1.01
statpopgen_q06/duckdb:vortex-file-compressed 1499415354 1516911968 0.99
statpopgen_q07/duckdb:vortex-file-compressed 192939182 198328798 0.97
statpopgen_q08/duckdb:vortex-file-compressed 215451793 218317854 0.99
statpopgen_q09/duckdb:vortex-file-compressed 817849693 814779165 1.00
statpopgen_q10/duckdb:vortex-file-compressed 2655659091 2524593539 1.05
duckdb / parquet (1.025x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 333611469 346062313 0.96
statpopgen_q01/duckdb:parquet 419345722 433768303 0.97
statpopgen_q02/duckdb:parquet 794956954 801500402 0.99
statpopgen_q03/duckdb:parquet 1220448362 1244396092 0.98
statpopgen_q04/duckdb:parquet 1237420249 1221464135 1.01
statpopgen_q05/duckdb:parquet 910471606 854473509 1.07
statpopgen_q06/duckdb:parquet 1598752842 1470024606 1.09
statpopgen_q07/duckdb:parquet 949435440 914787311 1.04
statpopgen_q08/duckdb:parquet 982456218 938794621 1.05
statpopgen_q09/duckdb:parquet 1103183897 1059490678 1.04
statpopgen_q10/duckdb:parquet 2410065791 2216898555 1.09
File Size Changes (2 files changed, -32.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.66 MB 0 B 960.66 MB -100.0%

Totals:

  • vortex-compact: 960.92 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (0.0%)

@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): 1.015x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 430630821 450799364 0.96
tpch_q02/datafusion:vortex-file-compressed 101140788 102074205 0.99
tpch_q03/datafusion:vortex-file-compressed 196360429 194249944 1.01
tpch_q04/datafusion:vortex-file-compressed 96514151 95298391 1.01
tpch_q05/datafusion:vortex-file-compressed 339440467 331482238 1.02
tpch_q06/datafusion:vortex-file-compressed 39647065 38898760 1.02
tpch_q07/datafusion:vortex-file-compressed 454881694 446224991 1.02
tpch_q08/datafusion:vortex-file-compressed 336585028 335833306 1.00
tpch_q09/datafusion:vortex-file-compressed 601297426 593923094 1.01
tpch_q10/datafusion:vortex-file-compressed 230932870 222044413 1.04
tpch_q11/datafusion:vortex-file-compressed 78491044 77893763 1.01
tpch_q12/datafusion:vortex-file-compressed 113890867 112774266 1.01
tpch_q13/datafusion:vortex-file-compressed 197753076 192234467 1.03
tpch_q14/datafusion:vortex-file-compressed 51322931 51336163 1.00
tpch_q15/datafusion:vortex-file-compressed 104101231 100471938 1.04
tpch_q16/datafusion:vortex-file-compressed 79640453 74445997 1.07
tpch_q17/datafusion:vortex-file-compressed 587269382 575835375 1.02
tpch_q18/datafusion:vortex-file-compressed 843303627 823881981 1.02
tpch_q19/datafusion:vortex-file-compressed 77492186 75753124 1.02
tpch_q20/datafusion:vortex-file-compressed 161654264 155152518 1.04
tpch_q21/datafusion:vortex-file-compressed 602241406 589191941 1.02
tpch_q22/datafusion:vortex-file-compressed 58096272 55501739 1.05
datafusion / parquet (1.002x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 474026622 478946088 0.99
tpch_q02/datafusion:parquet 175261888 173136129 1.01
tpch_q03/datafusion:parquet 258036977 259905107 0.99
tpch_q04/datafusion:parquet 122170045 119037570 1.03
tpch_q05/datafusion:parquet 404699384 386647783 1.05
tpch_q06/datafusion:parquet 126351997 129768124 0.97
tpch_q07/datafusion:parquet 569068568 561282666 1.01
tpch_q08/datafusion:parquet 451789206 457713755 0.99
tpch_q09/datafusion:parquet 732052138 724686326 1.01
tpch_q10/datafusion:parquet 572289854 587687245 0.97
tpch_q11/datafusion:parquet 120484297 118871256 1.01
tpch_q12/datafusion:parquet 209918317 208941051 1.00
tpch_q13/datafusion:parquet 347645907 347989590 1.00
tpch_q14/datafusion:parquet 152105979 153950447 0.99
tpch_q15/datafusion:parquet 263964364 264021614 1.00
tpch_q16/datafusion:parquet 122784588 125794490 0.98
tpch_q17/datafusion:parquet 664679395 665481264 1.00
tpch_q18/datafusion:parquet 868448313 874013517 0.99
tpch_q19/datafusion:parquet 279123752 280757187 0.99
tpch_q20/datafusion:parquet 299795317 296422537 1.01
tpch_q21/datafusion:parquet 663721310 646352514 1.03
tpch_q22/datafusion:parquet 211156742 207096471 1.02
datafusion / arrow (0.970x ➖, 4↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 716512600 747481922 0.96
tpch_q02/datafusion:arrow 🚀 112442521 130071177 0.86
tpch_q03/datafusion:arrow 515319271 523126482 0.99
tpch_q04/datafusion:arrow 🚀 374691673 434758502 0.86
tpch_q05/datafusion:arrow 750254125 812846976 0.92
tpch_q06/datafusion:arrow 330336127 334036145 0.99
tpch_q07/datafusion:arrow 1163629613 1175569945 0.99
tpch_q08/datafusion:arrow 976914272 999598089 0.98
tpch_q09/datafusion:arrow 1091286479 1210366016 0.90
tpch_q10/datafusion:arrow 🚀 650046174 731611853 0.89
tpch_q11/datafusion:arrow 94108610 100941322 0.93
tpch_q12/datafusion:arrow 🚀 1289734789 1502168658 0.86
tpch_q13/datafusion:arrow 492992671 467400714 1.05
tpch_q14/datafusion:arrow 365224190 361558580 1.01
tpch_q15/datafusion:arrow 750051781 738717464 1.02
tpch_q16/datafusion:arrow 82752059 83046300 1.00
tpch_q17/datafusion:arrow 978486056 950728136 1.03
tpch_q18/datafusion:arrow 1865622345 1848093233 1.01
tpch_q19/datafusion:arrow 563324067 539653168 1.04
tpch_q20/datafusion:arrow 519946266 494619060 1.05
tpch_q21/datafusion:arrow 3138953832 3084994415 1.02
tpch_q22/datafusion:arrow 82262510 80830073 1.02
duckdb / vortex-file-compressed (1.012x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170465580 170853812 1.00
tpch_q02/duckdb:vortex-file-compressed 51886273 52521779 0.99
tpch_q03/duckdb:vortex-file-compressed 122176068 119920043 1.02
tpch_q04/duckdb:vortex-file-compressed 154853430 152502229 1.02
tpch_q05/duckdb:vortex-file-compressed 135537925 133657062 1.01
tpch_q06/duckdb:vortex-file-compressed 34602225 34642810 1.00
tpch_q07/duckdb:vortex-file-compressed 129903887 129149792 1.01
tpch_q08/duckdb:vortex-file-compressed 172105202 168184039 1.02
tpch_q09/duckdb:vortex-file-compressed 396083544 391210400 1.01
tpch_q10/duckdb:vortex-file-compressed 191460242 189131908 1.01
tpch_q11/duckdb:vortex-file-compressed 31423855 30097823 1.04
tpch_q12/duckdb:vortex-file-compressed 104926709 104732421 1.00
tpch_q13/duckdb:vortex-file-compressed 271688913 266957171 1.02
tpch_q14/duckdb:vortex-file-compressed 54938591 53643292 1.02
tpch_q15/duckdb:vortex-file-compressed 90282141 88020867 1.03
tpch_q16/duckdb:vortex-file-compressed 77999100 78047799 1.00
tpch_q17/duckdb:vortex-file-compressed 86999437 86067058 1.01
tpch_q18/duckdb:vortex-file-compressed 289370830 282011407 1.03
tpch_q19/duckdb:vortex-file-compressed 73179121 74229819 0.99
tpch_q20/duckdb:vortex-file-compressed 139423637 136606141 1.02
tpch_q21/duckdb:vortex-file-compressed 486564110 476654172 1.02
tpch_q22/duckdb:vortex-file-compressed 64230881 64141767 1.00
duckdb / parquet (1.006x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 265010395 263814290 1.00
tpch_q02/duckdb:parquet 101691894 104796018 0.97
tpch_q03/duckdb:parquet 216669692 214250226 1.01
tpch_q04/duckdb:parquet 140105863 138380209 1.01
tpch_q05/duckdb:parquet 227238598 224658931 1.01
tpch_q06/duckdb:parquet 74587318 74722580 1.00
tpch_q07/duckdb:parquet 191660186 188864829 1.01
tpch_q08/duckdb:parquet 273382739 267606060 1.02
tpch_q09/duckdb:parquet 518842175 505112493 1.03
tpch_q10/duckdb:parquet 634576536 620671659 1.02
tpch_q11/duckdb:parquet 65197721 66894682 0.97
tpch_q12/duckdb:parquet 134370233 132819176 1.01
tpch_q13/duckdb:parquet 450856042 449876869 1.00
tpch_q14/duckdb:parquet 181467892 180619797 1.00
tpch_q15/duckdb:parquet 103998334 102902228 1.01
tpch_q16/duckdb:parquet 164707701 167764712 0.98
tpch_q17/duckdb:parquet 184542014 185580504 0.99
tpch_q18/duckdb:parquet 366430370 359995425 1.02
tpch_q19/duckdb:parquet 290803333 285797637 1.02
tpch_q20/duckdb:parquet 234760315 235076821 1.00
tpch_q21/duckdb:parquet 575190121 560970862 1.03
tpch_q22/duckdb:parquet 304458764 305457823 1.00
File Size Changes (25 files changed, -44.0% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
customer_0.vortex 10.0 vortex-compact 74.00 MB 0 B 74.00 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem_0.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_1.vortex 10.0 vortex-compact 100.64 MB 0 B 100.64 MB -100.0%
lineitem_10.vortex 10.0 vortex-compact 100.83 MB 0 B 100.83 MB -100.0%
lineitem_11.vortex 10.0 vortex-compact 100.75 MB 0 B 100.75 MB -100.0%
lineitem_12.vortex 10.0 vortex-compact 100.62 MB 0 B 100.62 MB -100.0%
lineitem_2.vortex 10.0 vortex-compact 100.79 MB 0 B 100.79 MB -100.0%
lineitem_3.vortex 10.0 vortex-compact 100.85 MB 0 B 100.85 MB -100.0%
lineitem_4.vortex 10.0 vortex-compact 100.55 MB 0 B 100.55 MB -100.0%
lineitem_5.vortex 10.0 vortex-compact 100.70 MB 0 B 100.70 MB -100.0%
lineitem_6.vortex 10.0 vortex-compact 100.88 MB 0 B 100.88 MB -100.0%
lineitem_7.vortex 10.0 vortex-compact 100.79 MB 0 B 100.79 MB -100.0%
lineitem_8.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_9.vortex 10.0 vortex-compact 100.46 MB 0 B 100.46 MB -100.0%
nation_0.vortex 10.0 vortex-compact 7.80 KB 0 B 7.80 KB -100.0%
orders_0.vortex 10.0 vortex-compact 114.79 MB 0 B 114.79 MB -100.0%
orders_1.vortex 10.0 vortex-compact 114.76 MB 0 B 114.76 MB -100.0%
orders_2.vortex 10.0 vortex-compact 114.78 MB 0 B 114.78 MB -100.0%
part_0.vortex 10.0 vortex-compact 17.92 MB 0 B 17.92 MB -100.0%
part_1.vortex 10.0 vortex-compact 17.98 MB 0 B 17.98 MB -100.0%
partsupp_0.vortex 10.0 vortex-compact 101.84 MB 0 B 101.84 MB -100.0%
partsupp_1.vortex 10.0 vortex-compact 102.09 MB 0 B 102.09 MB -100.0%
region_0.vortex 10.0 vortex-compact 5.83 KB 0 B 5.83 KB -100.0%
supplier_0.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (+0.7%, environment too noisy confidence) · DuckDB No clear signal (+1.0%, low confidence)
Vortex (geomean): 1.033x ➖
Parquet (geomean): 1.024x ➖
Shifts: Parquet (control) +2.4% · Median polish +3.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.045x ➖, 0↑ 1↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1616460 1574330 1.03
clickbench_q01/datafusion:vortex-file-compressed 18495689 17421463 1.06
clickbench_q02/datafusion:vortex-file-compressed 36792389 35388011 1.04
clickbench_q03/datafusion:vortex-file-compressed 38742382 36399970 1.06
clickbench_q04/datafusion:vortex-file-compressed 240947076 229251944 1.05
clickbench_q05/datafusion:vortex-file-compressed 307351475 306609312 1.00
clickbench_q06/datafusion:vortex-file-compressed 1625878 1661367 0.98
clickbench_q07/datafusion:vortex-file-compressed 🚨 27378084 22740136 1.20
clickbench_q08/datafusion:vortex-file-compressed 339549875 332239463 1.02
clickbench_q09/datafusion:vortex-file-compressed 470183608 457820009 1.03
clickbench_q10/datafusion:vortex-file-compressed 74377430 74743157 1.00
clickbench_q11/datafusion:vortex-file-compressed 89917926 84794318 1.06
clickbench_q12/datafusion:vortex-file-compressed 265757952 255312569 1.04
clickbench_q13/datafusion:vortex-file-compressed 437948001 414690475 1.06
clickbench_q14/datafusion:vortex-file-compressed 271841781 255143692 1.07
clickbench_q15/datafusion:vortex-file-compressed 287103967 290694512 0.99
clickbench_q16/datafusion:vortex-file-compressed 671613293 637360206 1.05
clickbench_q17/datafusion:vortex-file-compressed 664269614 639865798 1.04
clickbench_q18/datafusion:vortex-file-compressed 1395269895 1342012627 1.04
clickbench_q19/datafusion:vortex-file-compressed 28355419 26460640 1.07
clickbench_q20/datafusion:vortex-file-compressed 270659877 262694678 1.03
clickbench_q21/datafusion:vortex-file-compressed 358724621 339202860 1.06
clickbench_q22/datafusion:vortex-file-compressed 456308254 447983133 1.02
clickbench_q23/datafusion:vortex-file-compressed 613740528 636796191 0.96
clickbench_q24/datafusion:vortex-file-compressed 46197127 44183508 1.05
clickbench_q25/datafusion:vortex-file-compressed 75948945 72765989 1.04
clickbench_q26/datafusion:vortex-file-compressed 45605479 41878426 1.09
clickbench_q27/datafusion:vortex-file-compressed 399691972 370672416 1.08
clickbench_q28/datafusion:vortex-file-compressed 2359827011 2315859083 1.02
clickbench_q29/datafusion:vortex-file-compressed 55452620 54537761 1.02
clickbench_q30/datafusion:vortex-file-compressed 231161239 220481002 1.05
clickbench_q31/datafusion:vortex-file-compressed 248477092 236558729 1.05
clickbench_q32/datafusion:vortex-file-compressed 1082460182 1036302023 1.04
clickbench_q33/datafusion:vortex-file-compressed 1414210471 1360457677 1.04
clickbench_q34/datafusion:vortex-file-compressed 1416016568 1366973761 1.04
clickbench_q35/datafusion:vortex-file-compressed 244579296 237148124 1.03
clickbench_q36/datafusion:vortex-file-compressed 57231927 54193849 1.06
clickbench_q37/datafusion:vortex-file-compressed 26475037 25041472 1.06
clickbench_q38/datafusion:vortex-file-compressed 16395744 15727860 1.04
clickbench_q39/datafusion:vortex-file-compressed 129564449 122676267 1.06
clickbench_q40/datafusion:vortex-file-compressed 12765911 11646112 1.10
clickbench_q41/datafusion:vortex-file-compressed 12794535 11741856 1.09
clickbench_q42/datafusion:vortex-file-compressed 11880843 11352138 1.05
datafusion / parquet (1.037x ➖, 0↑ 4↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1561218 1484891 1.05
clickbench_q01/datafusion:parquet 19154001 19332815 0.99
clickbench_q02/datafusion:parquet 42315804 43822931 0.97
clickbench_q03/datafusion:parquet 33948468 34673186 0.98
clickbench_q04/datafusion:parquet 271649226 260434040 1.04
clickbench_q05/datafusion:parquet 323146436 325257217 0.99
clickbench_q06/datafusion:parquet 1534306 1494738 1.03
clickbench_q07/datafusion:parquet 21981924 20574786 1.07
clickbench_q08/datafusion:parquet 🚨 358635360 326008585 1.10
clickbench_q09/datafusion:parquet 499466662 487415142 1.02
clickbench_q10/datafusion:parquet 95190416 90970787 1.05
clickbench_q11/datafusion:parquet 118652587 114067980 1.04
clickbench_q12/datafusion:parquet 312015064 293688562 1.06
clickbench_q13/datafusion:parquet 488045935 465094938 1.05
clickbench_q14/datafusion:parquet 313009436 313272296 1.00
clickbench_q15/datafusion:parquet 299452362 289226502 1.04
clickbench_q16/datafusion:parquet 678690625 652424980 1.04
clickbench_q17/datafusion:parquet 675448720 637462259 1.06
clickbench_q18/datafusion:parquet 1386784399 1446610432 0.96
clickbench_q19/datafusion:parquet 27629004 28347491 0.97
clickbench_q20/datafusion:parquet 560058072 559948964 1.00
clickbench_q21/datafusion:parquet 634460081 615898649 1.03
clickbench_q22/datafusion:parquet 933455995 899984241 1.04
clickbench_q23/datafusion:parquet 4137163679 4004842566 1.03
clickbench_q24/datafusion:parquet 🚨 60239006 52338623 1.15
clickbench_q25/datafusion:parquet 131121621 126312659 1.04
clickbench_q26/datafusion:parquet 55377090 53548286 1.03
clickbench_q27/datafusion:parquet 675817346 646489257 1.05
clickbench_q28/datafusion:parquet 2491816457 2420181675 1.03
clickbench_q29/datafusion:parquet 🚨 59357744 44981881 1.32
clickbench_q30/datafusion:parquet 322102070 313522220 1.03
clickbench_q31/datafusion:parquet 357003241 344313057 1.04
clickbench_q32/datafusion:parquet 1105094304 1106577293 1.00
clickbench_q33/datafusion:parquet 1525498674 1481500792 1.03
clickbench_q34/datafusion:parquet 1554285499 1494517962 1.04
clickbench_q35/datafusion:parquet 248511275 239112199 1.04
clickbench_q36/datafusion:parquet 105486983 109724974 0.96
clickbench_q37/datafusion:parquet 43835506 41976534 1.04
clickbench_q38/datafusion:parquet 60093270 58494255 1.03
clickbench_q39/datafusion:parquet 211080613 211257053 1.00
clickbench_q40/datafusion:parquet 🚨 25503338 22300642 1.14
clickbench_q41/datafusion:parquet 22832318 21397530 1.07
clickbench_q42/datafusion:parquet 22739386 22088036 1.03
duckdb / vortex-file-compressed (1.021x ➖, 0↑ 1↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 9681794 9396430 1.03
clickbench_q01/duckdb:vortex-file-compressed 16287501 15908105 1.02
clickbench_q02/duckdb:vortex-file-compressed 21587930 20853554 1.04
clickbench_q03/duckdb:vortex-file-compressed 26753991 27592267 0.97
clickbench_q04/duckdb:vortex-file-compressed 206486568 197049639 1.05
clickbench_q05/duckdb:vortex-file-compressed 185867804 178850775 1.04
clickbench_q06/duckdb:vortex-file-compressed 18519515 19067674 0.97
clickbench_q07/duckdb:vortex-file-compressed 21116803 19926872 1.06
clickbench_q08/duckdb:vortex-file-compressed 276208377 274153843 1.01
clickbench_q09/duckdb:vortex-file-compressed 353978231 352667772 1.00
clickbench_q10/duckdb:vortex-file-compressed 74220117 72899696 1.02
clickbench_q11/duckdb:vortex-file-compressed 85893822 84010239 1.02
clickbench_q12/duckdb:vortex-file-compressed 215712128 209430784 1.03
clickbench_q13/duckdb:vortex-file-compressed 425263466 403844738 1.05
clickbench_q14/duckdb:vortex-file-compressed 245665416 240689456 1.02
clickbench_q15/duckdb:vortex-file-compressed 262056199 255711479 1.02
clickbench_q16/duckdb:vortex-file-compressed 553357874 535048390 1.03
clickbench_q17/duckdb:vortex-file-compressed 444695991 435455262 1.02
clickbench_q18/duckdb:vortex-file-compressed 972528888 948254398 1.03
clickbench_q19/duckdb:vortex-file-compressed 20981319 21605089 0.97
clickbench_q20/duckdb:vortex-file-compressed 258774757 250155101 1.03
clickbench_q21/duckdb:vortex-file-compressed 344172197 326395015 1.05
clickbench_q22/duckdb:vortex-file-compressed 513262420 484003776 1.06
clickbench_q23/duckdb:vortex-file-compressed 162943954 160836374 1.01
clickbench_q24/duckdb:vortex-file-compressed 35532145 34405352 1.03
clickbench_q25/duckdb:vortex-file-compressed 81809613 78111677 1.05
clickbench_q26/duckdb:vortex-file-compressed 48091169 45008587 1.07
clickbench_q27/duckdb:vortex-file-compressed 225336967 212715735 1.06
clickbench_q28/duckdb:vortex-file-compressed 3042801642 3021694185 1.01
clickbench_q29/duckdb:vortex-file-compressed 27832583 26366025 1.06
clickbench_q30/duckdb:vortex-file-compressed 207102118 200468696 1.03
clickbench_q31/duckdb:vortex-file-compressed 305122255 298334083 1.02
clickbench_q32/duckdb:vortex-file-compressed 1155777441 1126842819 1.03
clickbench_q33/duckdb:vortex-file-compressed 1115922511 1143807773 0.98
clickbench_q34/duckdb:vortex-file-compressed 1219583794 1180762132 1.03
clickbench_q35/duckdb:vortex-file-compressed 377706750 371837091 1.02
clickbench_q36/duckdb:vortex-file-compressed 30805666 32948974 0.93
clickbench_q37/duckdb:vortex-file-compressed 22482692 23267480 0.97
clickbench_q38/duckdb:vortex-file-compressed 25078763 26167851 0.96
clickbench_q39/duckdb:vortex-file-compressed 45662047 45185360 1.01
clickbench_q40/duckdb:vortex-file-compressed 23193325 24259194 0.96
clickbench_q41/duckdb:vortex-file-compressed 21791649 21178243 1.03
clickbench_q42/duckdb:vortex-file-compressed 🚨 23518395 21019060 1.12
duckdb / parquet (1.011x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 24451388 24041481 1.02
clickbench_q01/duckdb:parquet 30692371 29543869 1.04
clickbench_q02/duckdb:parquet 50111874 51726372 0.97
clickbench_q03/duckdb:parquet 41493794 40870986 1.02
clickbench_q04/duckdb:parquet 208955655 205286820 1.02
clickbench_q05/duckdb:parquet 264644886 261756435 1.01
clickbench_q06/duckdb:parquet 48321575 48280796 1.00
clickbench_q07/duckdb:parquet 32282747 32780391 0.98
clickbench_q08/duckdb:parquet 281591892 274296643 1.03
clickbench_q09/duckdb:parquet 408756372 400830352 1.02
clickbench_q10/duckdb:parquet 84644245 85650849 0.99
clickbench_q11/duckdb:parquet 101708420 101344860 1.00
clickbench_q12/duckdb:parquet 287135125 281472924 1.02
clickbench_q13/duckdb:parquet 482307659 477650733 1.01
clickbench_q14/duckdb:parquet 320262028 315640397 1.01
clickbench_q15/duckdb:parquet 263309461 260142618 1.01
clickbench_q16/duckdb:parquet 613316503 600300331 1.02
clickbench_q17/duckdb:parquet 511717187 500555795 1.02
clickbench_q18/duckdb:parquet 1052753838 1029627243 1.02
clickbench_q19/duckdb:parquet 29332941 28847238 1.02
clickbench_q20/duckdb:parquet 417774553 423979334 0.99
clickbench_q21/duckdb:parquet 539413518 534792400 1.01
clickbench_q22/duckdb:parquet 916374935 926430451 0.99
clickbench_q23/duckdb:parquet 269710349 272636785 0.99
clickbench_q24/duckdb:parquet 72674714 71900258 1.01
clickbench_q25/duckdb:parquet 167387076 165249284 1.01
clickbench_q26/duckdb:parquet 55448973 55553878 1.00
clickbench_q27/duckdb:parquet 474849311 474832485 1.00
clickbench_q28/duckdb:parquet 4823303041 4784488470 1.01
clickbench_q29/duckdb:parquet 44126383 43334283 1.02
clickbench_q30/duckdb:parquet 320223355 310772391 1.03
clickbench_q31/duckdb:parquet 387590984 377195636 1.03
clickbench_q32/duckdb:parquet 1145324528 1116966746 1.03
clickbench_q33/duckdb:parquet 1138655304 1104643717 1.03
clickbench_q34/duckdb:parquet 1187250115 1161944721 1.02
clickbench_q35/duckdb:parquet 375003398 371438928 1.01
clickbench_q36/duckdb:parquet 51226327 47795448 1.07
clickbench_q37/duckdb:parquet 35365632 34665167 1.02
clickbench_q38/duckdb:parquet 36066604 37594490 0.96
clickbench_q39/duckdb:parquet 83898585 82104467 1.02
clickbench_q40/duckdb:parquet 21669509 21548145 1.01
clickbench_q41/duckdb:parquet 21885882 21661348 1.01
clickbench_q42/duckdb:parquet 23904681 24286832 0.98
File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.88 MB 0 B 58.88 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.67 MB 0 B 90.67 MB -100.0%
hits_10.vortex 1.0 vortex-compact 49.48 MB 0 B 49.48 MB -100.0%
hits_11.vortex 1.0 vortex-compact 56.11 MB 0 B 56.11 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_13.vortex 1.0 vortex-compact 69.24 MB 0 B 69.24 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.88 MB 0 B 74.88 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.41 MB 0 B 48.41 MB -100.0%
hits_16.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.79 MB 0 B 58.79 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.89 MB 0 B 64.89 MB -100.0%
hits_19.vortex 1.0 vortex-compact 49.73 MB 0 B 49.73 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.16 MB 0 B 129.16 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.36 MB 0 B 38.36 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.99 MB 0 B 51.99 MB -100.0%
hits_22.vortex 1.0 vortex-compact 46.22 MB 0 B 46.22 MB -100.0%
hits_23.vortex 1.0 vortex-compact 46.13 MB 0 B 46.13 MB -100.0%
hits_24.vortex 1.0 vortex-compact 45.11 MB 0 B 45.11 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.88 MB 0 B 73.88 MB -100.0%
hits_26.vortex 1.0 vortex-compact 71.99 MB 0 B 71.99 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.92 MB 0 B 70.92 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.68 MB 0 B 36.68 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.12 MB 0 B 95.12 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.57 MB 0 B 58.57 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.77 MB 0 B 55.77 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.61 MB 0 B 44.61 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.92 MB 0 B 35.92 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.24 MB 0 B 58.24 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.53 MB 0 B 75.53 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.21 MB 0 B 49.21 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.76 MB 0 B 54.76 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_39.vortex 1.0 vortex-compact 50.10 MB 0 B 50.10 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.94 MB 0 B 71.94 MB -100.0%
hits_40.vortex 1.0 vortex-compact 77.42 MB 0 B 77.42 MB -100.0%
hits_41.vortex 1.0 vortex-compact 166.05 MB 0 B 166.05 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.53 MB 0 B 164.53 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.21 MB 0 B 169.21 MB -100.0%
hits_44.vortex 1.0 vortex-compact 133.26 MB 0 B 133.26 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.80 MB 0 B 75.80 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.27 MB 0 B 42.27 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.22 MB 0 B 18.22 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.85 MB 0 B 17.85 MB -100.0%
hits_49.vortex 1.0 vortex-compact 51.00 MB 0 B 51.00 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.33 MB 0 B 63.33 MB -100.0%
hits_50.vortex 1.0 vortex-compact 114.20 MB 0 B 114.20 MB -100.0%
hits_51.vortex 1.0 vortex-compact 168.34 MB 0 B 168.34 MB -100.0%
hits_52.vortex 1.0 vortex-compact 65.08 MB 0 B 65.08 MB -100.0%
hits_53.vortex 1.0 vortex-compact 60.05 MB 0 B 60.05 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.57 MB 0 B 117.57 MB -100.0%
hits_55.vortex 1.0 vortex-compact 92.56 MB 0 B 92.56 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.58 MB 0 B 78.58 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.73 MB 0 B 83.73 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.68 MB 0 B 66.68 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.57 MB 0 B 63.57 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.92 MB 0 B 64.92 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.73 MB 0 B 57.73 MB -100.0%
hits_62.vortex 1.0 vortex-compact 75.45 MB 0 B 75.45 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.44 MB 0 B 46.44 MB -100.0%
hits_64.vortex 1.0 vortex-compact 54.09 MB 0 B 54.09 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.40 MB 0 B 129.40 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.52 MB 0 B 53.52 MB -100.0%
hits_67.vortex 1.0 vortex-compact 114.44 MB 0 B 114.44 MB -100.0%
hits_68.vortex 1.0 vortex-compact 76.67 MB 0 B 76.67 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.98 MB 0 B 80.98 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.19 MB 0 B 64.19 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.84 MB 0 B 61.84 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.96 MB 0 B 69.96 MB -100.0%
hits_72.vortex 1.0 vortex-compact 52.74 MB 0 B 52.74 MB -100.0%
hits_73.vortex 1.0 vortex-compact 71.07 MB 0 B 71.07 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.87 MB 0 B 71.87 MB -100.0%
hits_75.vortex 1.0 vortex-compact 45.12 MB 0 B 45.12 MB -100.0%
hits_76.vortex 1.0 vortex-compact 77.10 MB 0 B 77.10 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.50 MB 0 B 118.50 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.85 MB 0 B 97.85 MB -100.0%
hits_79.vortex 1.0 vortex-compact 86.17 MB 0 B 86.17 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.67 MB 0 B 68.67 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.95 MB 0 B 65.95 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.43 MB 0 B 67.43 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.62 MB 0 B 53.62 MB -100.0%
hits_84.vortex 1.0 vortex-compact 74.35 MB 0 B 74.35 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.86 MB 0 B 52.86 MB -100.0%
hits_86.vortex 1.0 vortex-compact 49.12 MB 0 B 49.12 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.86 MB 0 B 118.86 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.58 MB 0 B 73.58 MB -100.0%
hits_89.vortex 1.0 vortex-compact 114.10 MB 0 B 114.10 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.32 MB 0 B 66.32 MB -100.0%
hits_90.vortex 1.0 vortex-compact 82.09 MB 0 B 82.09 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.40 MB 0 B 94.40 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.92 MB 0 B 59.92 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.90 MB 0 B 90.90 MB -100.0%
hits_95.vortex 1.0 vortex-compact 58.20 MB 0 B 58.20 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.73 MB 0 B 91.73 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.58 MB 0 B 69.58 MB -100.0%
hits_98.vortex 1.0 vortex-compact 73.15 MB 0 B 73.15 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.65 MB 0 B 77.65 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 0 B (-100.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.1%
Engines: DataFusion No clear signal (+10.8%, environment too noisy confidence) · DuckDB No clear signal (-2.3%, environment too noisy confidence)
Vortex (geomean): 1.065x ➖
Parquet (geomean): 1.023x ➖
Shifts: Parquet (control) +2.3% · Median polish +5.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.075x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 297755849 268682592 1.11
tpch_q02/datafusion:vortex-file-compressed 540311231 422803376 1.28
tpch_q03/datafusion:vortex-file-compressed 474240553 386176618 1.23
tpch_q04/datafusion:vortex-file-compressed 228711158 205060572 1.12
tpch_q05/datafusion:vortex-file-compressed 379554783 348998178 1.09
tpch_q06/datafusion:vortex-file-compressed 299348262 296637148 1.01
tpch_q07/datafusion:vortex-file-compressed 385191699 391045068 0.99
tpch_q08/datafusion:vortex-file-compressed 497304811 467151821 1.06
tpch_q09/datafusion:vortex-file-compressed 405728726 360412875 1.13
tpch_q10/datafusion:vortex-file-compressed 536840021 426844777 1.26
tpch_q11/datafusion:vortex-file-compressed 308477514 296071997 1.04
tpch_q12/datafusion:vortex-file-compressed 405496841 351670910 1.15
tpch_q13/datafusion:vortex-file-compressed 209736887 197852290 1.06
tpch_q14/datafusion:vortex-file-compressed 242922895 229089099 1.06
tpch_q15/datafusion:vortex-file-compressed 447324626 418543610 1.07
tpch_q16/datafusion:vortex-file-compressed 202597237 188051995 1.08
tpch_q17/datafusion:vortex-file-compressed 341949085 307013291 1.11
tpch_q18/datafusion:vortex-file-compressed 283367364 272720110 1.04
tpch_q19/datafusion:vortex-file-compressed 433366988 528149189 0.82
tpch_q20/datafusion:vortex-file-compressed 398996328 382199576 1.04
tpch_q21/datafusion:vortex-file-compressed 501049740 502516923 1.00
tpch_q22/datafusion:vortex-file-compressed 147170077 144495476 1.02
datafusion / parquet (0.971x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 203692641 263487047 0.77
tpch_q02/datafusion:parquet 448780731 438897347 1.02
tpch_q03/datafusion:parquet 330063529 329565523 1.00
tpch_q04/datafusion:parquet 183396567 206571579 0.89
tpch_q05/datafusion:parquet 428223557 507686028 0.84
tpch_q06/datafusion:parquet 136928637 191147447 0.72
tpch_q07/datafusion:parquet 453331463 477470862 0.95
tpch_q08/datafusion:parquet 539352338 532846351 1.01
tpch_q09/datafusion:parquet 468414848 458943787 1.02
tpch_q10/datafusion:parquet 459784761 485256216 0.95
tpch_q11/datafusion:parquet 393764131 387646389 1.02
tpch_q12/datafusion:parquet 234257917 235988666 0.99
tpch_q13/datafusion:parquet 442822701 425648062 1.04
tpch_q14/datafusion:parquet 194898770 189473160 1.03
tpch_q15/datafusion:parquet 306744983 312211353 0.98
tpch_q16/datafusion:parquet 180013724 174833241 1.03
tpch_q17/datafusion:parquet 412216080 379024561 1.09
tpch_q18/datafusion:parquet 432769353 474482316 0.91
tpch_q19/datafusion:parquet 312421916 297355585 1.05
tpch_q20/datafusion:parquet 309279369 316540440 0.98
tpch_q21/datafusion:parquet 503552493 528750651 0.95
tpch_q22/datafusion:parquet 202345195 162813939 1.24
duckdb / vortex-file-compressed (1.054x ➖, 0↑ 1↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 305191584 273454187 1.12
tpch_q02/duckdb:vortex-file-compressed 918466808 971392504 0.95
tpch_q03/duckdb:vortex-file-compressed 620728039 626969185 0.99
tpch_q04/duckdb:vortex-file-compressed 🚨 480813627 363528494 1.32
tpch_q05/duckdb:vortex-file-compressed 834079269 775078521 1.08
tpch_q06/duckdb:vortex-file-compressed 381259121 316207021 1.21
tpch_q07/duckdb:vortex-file-compressed 891146911 829977270 1.07
tpch_q08/duckdb:vortex-file-compressed 1099199796 1038664113 1.06
tpch_q09/duckdb:vortex-file-compressed 914870683 858366807 1.07
tpch_q10/duckdb:vortex-file-compressed 689815578 698342766 0.99
tpch_q11/duckdb:vortex-file-compressed 529179615 478463295 1.11
tpch_q12/duckdb:vortex-file-compressed 680594496 575007448 1.18
tpch_q13/duckdb:vortex-file-compressed 384932599 391478569 0.98
tpch_q14/duckdb:vortex-file-compressed 387709742 393310678 0.99
tpch_q15/duckdb:vortex-file-compressed 293063943 264594493 1.11
tpch_q16/duckdb:vortex-file-compressed 332008199 333979931 0.99
tpch_q17/duckdb:vortex-file-compressed 651164977 644810387 1.01
tpch_q18/duckdb:vortex-file-compressed 584979408 526987299 1.11
tpch_q19/duckdb:vortex-file-compressed 456455834 453859059 1.01
tpch_q20/duckdb:vortex-file-compressed 800795763 759806413 1.05
tpch_q21/duckdb:vortex-file-compressed 1008634093 1046170854 0.96
tpch_q22/duckdb:vortex-file-compressed 244211704 261693719 0.93
duckdb / parquet (1.079x ➖, 0↑ 0↓)
name PR 67efcce (ns) base b7ee873 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 440286344 408682431 1.08
tpch_q02/duckdb:parquet 1014073871 1004681441 1.01
tpch_q03/duckdb:parquet 953339224 933681326 1.02
tpch_q04/duckdb:parquet 696237164 563514028 1.24
tpch_q05/duckdb:parquet 1186472521 1126098475 1.05
tpch_q06/duckdb:parquet 418863431 375516433 1.12
tpch_q07/duckdb:parquet 1099833109 1126014172 0.98
tpch_q08/duckdb:parquet 1458377150 1294352013 1.13
tpch_q09/duckdb:parquet 1314023569 1241593189 1.06
tpch_q10/duckdb:parquet 1238343453 1103845640 1.12
tpch_q11/duckdb:parquet 678478699 635163558 1.07
tpch_q12/duckdb:parquet 703582706 610794507 1.15
tpch_q13/duckdb:parquet 960365344 837053450 1.15
tpch_q14/duckdb:parquet 695696879 616573694 1.13
tpch_q15/duckdb:parquet 467921686 463335812 1.01
tpch_q16/duckdb:parquet 702979247 609447262 1.15
tpch_q17/duckdb:parquet 695455783 716701235 0.97
tpch_q18/duckdb:parquet 867979355 830839748 1.04
tpch_q19/duckdb:parquet 803313379 703913513 1.14
tpch_q20/duckdb:parquet 1126849215 985773542 1.14
tpch_q21/duckdb:parquet 1081645334 1013979929 1.07
tpch_q22/duckdb:parquet 541119464 562662373 0.96

@mhk197
mhk197 merged commit cbaa3d7 into develop Jul 21, 2026
99 of 100 checks passed
@mhk197
mhk197 deleted the mk/mask-validity-listview-preserves-zctl branch July 21, 2026 20:51
@mhk197 mhk197 mentioned this pull request Jul 23, 2026
Draft
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 robert3005 approved these changes

Assignees

No one assigned

Labels

changelog/fix A bug fix

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@mhk197 @robert3005