Skip to content

[bench] add join batching#20948

Closed
Dandandan wants to merge 1 commit intoapache:mainfrom
Dandandan:try_batch_join
Closed

[bench] add join batching#20948
Dandandan wants to merge 1 commit intoapache:mainfrom
Dandandan:try_batch_join

Conversation

@Dandandan
Copy link
Contributor

Which issue does this PR close?

  • Closes #.

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

@github-actions github-actions bot added the physical-plan Changes to the physical-plan crate label Mar 14, 2026
@Dandandan
Copy link
Contributor Author

run benchmarks

@adriangbot
Copy link

🤖 Benchmark running (GKE) | trigger
Linux bench-c4061274337-244-l589v 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing try_batch_join (6ef1fd9) to 9c3c01a (merge-base) diff using: clickbench_partitioned
Results will be posted here when complete

@adriangbot
Copy link

🤖 Benchmark running (GKE) | trigger
Linux bench-c4061274337-245-8wvxt 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing try_batch_join (6ef1fd9) to 9c3c01a (merge-base) diff using: tpcds
Results will be posted here when complete

@adriangbot
Copy link

🤖 Benchmark running (GKE) | trigger
Linux bench-c4061274337-246-cj8dn 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing try_batch_join (6ef1fd9) to 9c3c01a (merge-base) diff using: tpch
Results will be posted here when complete

@adriangbot
Copy link

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and try_batch_join
--------------------
Benchmark tpch_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Query     ┃                           HEAD ┃                 try_batch_join ┃    Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ QQuery 1  │ 46.61 / 47.38 ±0.71 / 48.47 ms │ 46.84 / 47.32 ±0.74 / 48.80 ms │ no change │
│ QQuery 2  │ 24.96 / 25.23 ±0.15 / 25.36 ms │ 25.56 / 25.98 ±0.36 / 26.64 ms │ no change │
│ QQuery 3  │ 33.77 / 33.92 ±0.10 / 34.07 ms │ 34.65 / 35.08 ±0.38 / 35.77 ms │ no change │
│ QQuery 4  │ 22.01 / 23.40 ±0.92 / 24.88 ms │ 22.60 / 23.18 ±0.55 / 23.86 ms │ no change │
│ QQuery 5  │ 50.74 / 52.56 ±1.87 / 55.07 ms │ 52.47 / 53.26 ±1.18 / 55.60 ms │ no change │
│ QQuery 6  │ 17.50 / 17.74 ±0.15 / 17.96 ms │ 17.87 / 18.16 ±0.22 / 18.46 ms │ no change │
│ QQuery 7  │ 58.31 / 59.09 ±0.65 / 60.10 ms │ 58.24 / 59.89 ±1.52 / 62.62 ms │ no change │
│ QQuery 8  │ 51.39 / 51.98 ±0.51 / 52.60 ms │ 53.02 / 53.59 ±0.30 / 53.89 ms │ no change │
│ QQuery 9  │ 57.43 / 58.23 ±0.84 / 59.36 ms │ 59.33 / 60.20 ±0.85 / 61.35 ms │ no change │
│ QQuery 10 │ 74.02 / 75.05 ±0.94 / 76.53 ms │ 74.86 / 75.97 ±1.20 / 77.53 ms │ no change │
│ QQuery 11 │ 16.91 / 17.14 ±0.17 / 17.33 ms │ 17.32 / 17.63 ±0.28 / 18.15 ms │ no change │
│ QQuery 12 │ 29.13 / 29.32 ±0.22 / 29.75 ms │ 29.42 / 30.01 ±0.55 / 31.01 ms │ no change │
│ QQuery 13 │ 40.36 / 41.01 ±0.51 / 41.59 ms │ 40.37 / 41.23 ±0.61 / 41.84 ms │ no change │
│ QQuery 14 │ 29.58 / 30.25 ±0.76 / 31.27 ms │ 29.85 / 30.48 ±0.75 / 31.83 ms │ no change │
│ QQuery 15 │ 36.39 / 37.44 ±1.05 / 39.41 ms │ 36.94 / 37.64 ±0.88 / 39.36 ms │ no change │
│ QQuery 16 │ 18.05 / 18.31 ±0.19 / 18.60 ms │ 18.78 / 19.04 ±0.26 / 19.52 ms │ no change │
│ QQuery 17 │ 76.76 / 79.61 ±3.82 / 86.84 ms │ 78.38 / 78.93 ±0.46 / 79.65 ms │ no change │
│ QQuery 18 │ 82.99 / 83.93 ±0.91 / 85.47 ms │ 84.06 / 85.79 ±0.96 / 86.93 ms │ no change │
│ QQuery 19 │ 38.68 / 39.25 ±0.39 / 39.86 ms │ 39.73 / 40.52 ±0.51 / 41.18 ms │ no change │
│ QQuery 20 │ 43.46 / 43.83 ±0.33 / 44.45 ms │ 44.16 / 44.79 ±0.52 / 45.55 ms │ no change │
│ QQuery 21 │ 68.58 / 70.81 ±1.42 / 72.76 ms │ 71.58 / 73.73 ±1.19 / 75.01 ms │ no change │
│ QQuery 22 │ 20.42 / 20.84 ±0.35 / 21.46 ms │ 20.51 / 21.80 ±1.32 / 24.11 ms │ no change │
└───────────┴────────────────────────────────┴────────────────────────────────┴───────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━┓
┃ Benchmark Summary             ┃          ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━┩
│ Total Time (HEAD)             │ 956.33ms │
│ Total Time (try_batch_join)   │ 974.22ms │
│ Average Time (HEAD)           │  43.47ms │
│ Average Time (try_batch_join) │  44.28ms │
│ Queries Faster                │        0 │
│ Queries Slower                │        0 │
│ Queries with No Change        │       22 │
│ Queries with Failure          │        0 │
└───────────────────────────────┴──────────┘

Resource Usage

tpch — base (merge-base)

Metric Value
Wall time 5.1s
Peak memory 4.0 GiB
Avg memory 3.5 GiB
CPU user 34.1s
CPU sys 3.1s
Disk read 0 B
Disk write 148.0 KiB

tpch — branch

Metric Value
Wall time 5.1s
Peak memory 4.0 GiB
Avg memory 3.5 GiB
CPU user 34.7s
CPU sys 3.5s
Disk read 0 B
Disk write 56.0 KiB

@adriangbot
Copy link

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and try_batch_join
--------------------
Benchmark tpcds_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┓
┃ Query     ┃                                     HEAD ┃                           try_batch_join ┃       Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━┩
│ QQuery 1  │           50.47 / 51.53 ±1.27 / 53.50 ms │           50.20 / 51.26 ±0.66 / 51.92 ms │    no change │
│ QQuery 2  │        158.86 / 160.02 ±0.94 / 161.39 ms │        162.09 / 164.15 ±1.35 / 165.75 ms │    no change │
│ QQuery 3  │        120.64 / 121.33 ±0.42 / 121.92 ms │        123.27 / 124.08 ±0.47 / 124.58 ms │    no change │
│ QQuery 4  │    1409.06 / 1434.64 ±15.30 / 1456.10 ms │    1435.49 / 1463.16 ±18.73 / 1485.93 ms │    no change │
│ QQuery 5  │        187.94 / 190.14 ±1.14 / 190.93 ms │        191.55 / 191.98 ±0.38 / 192.57 ms │    no change │
│ QQuery 6  │    1035.43 / 1048.56 ±21.16 / 1090.67 ms │    1025.73 / 1063.59 ±28.33 / 1110.54 ms │    no change │
│ QQuery 7  │        360.43 / 366.05 ±4.87 / 375.15 ms │        364.03 / 368.52 ±3.06 / 373.55 ms │    no change │
│ QQuery 8  │        124.23 / 125.88 ±1.21 / 127.56 ms │        129.23 / 130.46 ±1.30 / 132.63 ms │    no change │
│ QQuery 9  │        115.89 / 120.73 ±5.75 / 131.80 ms │        115.36 / 120.18 ±2.45 / 121.97 ms │    no change │
│ QQuery 10 │        118.42 / 119.35 ±0.71 / 120.29 ms │        118.73 / 119.86 ±0.60 / 120.51 ms │    no change │
│ QQuery 11 │    1011.89 / 1028.46 ±10.68 / 1042.01 ms │     1018.91 / 1026.06 ±8.18 / 1040.54 ms │    no change │
│ QQuery 12 │           48.57 / 50.31 ±1.09 / 51.83 ms │           47.64 / 49.92 ±1.21 / 50.95 ms │    no change │
│ QQuery 13 │        409.99 / 413.73 ±2.96 / 417.68 ms │        409.17 / 411.51 ±1.52 / 413.18 ms │    no change │
│ QQuery 14 │    1100.38 / 1120.83 ±10.74 / 1130.76 ms │     1112.33 / 1120.59 ±5.25 / 1126.38 ms │    no change │
│ QQuery 15 │           18.61 / 19.61 ±0.79 / 20.72 ms │           18.13 / 19.33 ±0.86 / 20.68 ms │    no change │
│ QQuery 16 │           47.13 / 48.58 ±1.04 / 50.11 ms │           48.04 / 49.09 ±1.04 / 50.71 ms │    no change │
│ QQuery 17 │        254.98 / 257.16 ±1.82 / 259.99 ms │        252.45 / 254.95 ±1.92 / 257.65 ms │    no change │
│ QQuery 18 │        136.36 / 137.45 ±1.32 / 139.63 ms │        133.58 / 135.35 ±1.99 / 138.86 ms │    no change │
│ QQuery 19 │        167.76 / 168.83 ±0.90 / 170.27 ms │        166.95 / 168.16 ±0.86 / 169.12 ms │    no change │
│ QQuery 20 │           17.17 / 17.33 ±0.14 / 17.56 ms │           16.30 / 16.62 ±0.25 / 16.87 ms │    no change │
│ QQuery 21 │           24.93 / 25.69 ±0.58 / 26.43 ms │           24.72 / 25.31 ±0.42 / 25.81 ms │    no change │
│ QQuery 22 │        528.96 / 533.06 ±3.68 / 538.26 ms │        524.68 / 528.69 ±2.98 / 533.74 ms │    no change │
│ QQuery 23 │       983.72 / 994.05 ±9.10 / 1006.26 ms │        973.64 / 982.98 ±5.50 / 990.90 ms │    no change │
│ QQuery 24 │        442.45 / 447.01 ±4.39 / 455.28 ms │        439.67 / 443.00 ±2.76 / 446.34 ms │    no change │
│ QQuery 25 │        370.07 / 372.57 ±1.93 / 375.79 ms │        365.74 / 368.42 ±2.33 / 372.55 ms │    no change │
│ QQuery 26 │           86.63 / 89.56 ±2.39 / 93.80 ms │           84.12 / 86.16 ±1.94 / 89.80 ms │    no change │
│ QQuery 27 │        357.23 / 361.38 ±4.26 / 366.92 ms │        357.95 / 359.72 ±2.01 / 363.59 ms │    no change │
│ QQuery 28 │        155.36 / 157.99 ±1.65 / 160.57 ms │        154.40 / 155.55 ±0.73 / 156.36 ms │    no change │
│ QQuery 29 │        316.26 / 318.13 ±1.31 / 320.35 ms │        312.61 / 314.20 ±1.23 / 316.37 ms │    no change │
│ QQuery 30 │           50.68 / 52.11 ±1.12 / 53.97 ms │           48.35 / 51.27 ±2.00 / 54.18 ms │    no change │
│ QQuery 31 │        187.54 / 188.72 ±1.24 / 191.10 ms │        191.35 / 192.90 ±1.34 / 194.61 ms │    no change │
│ QQuery 32 │           63.22 / 64.52 ±1.58 / 67.54 ms │           63.75 / 66.22 ±1.61 / 67.82 ms │    no change │
│ QQuery 33 │        152.95 / 155.14 ±1.84 / 158.49 ms │        153.61 / 155.58 ±1.26 / 157.45 ms │    no change │
│ QQuery 34 │        114.13 / 115.08 ±0.79 / 116.14 ms │        115.07 / 116.77 ±1.12 / 118.30 ms │    no change │
│ QQuery 35 │        120.71 / 121.74 ±1.42 / 124.49 ms │        118.71 / 121.90 ±1.89 / 124.44 ms │    no change │
│ QQuery 36 │        223.52 / 229.50 ±3.86 / 234.09 ms │        228.27 / 231.35 ±2.52 / 235.05 ms │    no change │
│ QQuery 37 │        190.08 / 194.71 ±2.50 / 197.29 ms │        188.29 / 191.98 ±2.45 / 195.17 ms │    no change │
│ QQuery 38 │          96.14 / 99.27 ±2.63 / 102.92 ms │          94.95 / 99.55 ±2.75 / 102.13 ms │    no change │
│ QQuery 39 │        144.10 / 144.76 ±0.75 / 146.23 ms │        144.17 / 145.75 ±2.24 / 150.19 ms │    no change │
│ QQuery 40 │        120.68 / 126.80 ±4.82 / 134.65 ms │        119.91 / 126.86 ±7.44 / 139.72 ms │    no change │
│ QQuery 41 │           19.05 / 20.28 ±0.95 / 21.84 ms │           18.33 / 19.86 ±1.02 / 20.87 ms │    no change │
│ QQuery 42 │        113.34 / 115.30 ±1.85 / 118.25 ms │        115.50 / 116.63 ±1.30 / 119.14 ms │    no change │
│ QQuery 43 │           89.35 / 91.45 ±1.54 / 93.74 ms │           92.16 / 92.69 ±0.33 / 93.11 ms │    no change │
│ QQuery 44 │           18.09 / 18.63 ±0.45 / 19.38 ms │           17.86 / 18.34 ±0.66 / 19.63 ms │    no change │
│ QQuery 45 │           58.05 / 58.22 ±0.19 / 58.56 ms │           57.77 / 58.39 ±0.60 / 59.42 ms │    no change │
│ QQuery 46 │        243.81 / 245.19 ±1.35 / 247.71 ms │        246.21 / 249.28 ±3.28 / 255.07 ms │    no change │
│ QQuery 47 │        780.30 / 784.44 ±3.48 / 790.67 ms │       780.41 / 792.86 ±12.18 / 810.39 ms │    no change │
│ QQuery 48 │        294.50 / 301.40 ±3.67 / 304.31 ms │        295.32 / 300.50 ±4.08 / 307.42 ms │    no change │
│ QQuery 49 │        265.18 / 269.60 ±2.38 / 272.16 ms │        264.61 / 266.76 ±1.66 / 269.08 ms │    no change │
│ QQuery 50 │        254.92 / 258.99 ±4.37 / 265.47 ms │        244.61 / 247.31 ±3.16 / 253.32 ms │    no change │
│ QQuery 51 │        196.69 / 198.66 ±1.44 / 200.88 ms │        197.03 / 200.62 ±2.57 / 203.97 ms │    no change │
│ QQuery 52 │        114.46 / 115.05 ±0.45 / 115.72 ms │        114.99 / 116.74 ±1.22 / 118.06 ms │    no change │
│ QQuery 53 │        109.93 / 111.38 ±1.20 / 113.16 ms │        112.01 / 112.45 ±0.28 / 112.87 ms │    no change │
│ QQuery 54 │        157.38 / 158.93 ±1.37 / 161.44 ms │        161.09 / 161.49 ±0.58 / 162.62 ms │    no change │
│ QQuery 55 │        111.96 / 113.42 ±1.39 / 115.28 ms │        113.30 / 115.14 ±1.16 / 116.55 ms │    no change │
│ QQuery 56 │        154.24 / 155.38 ±1.53 / 158.11 ms │        155.11 / 156.52 ±0.76 / 157.38 ms │    no change │
│ QQuery 57 │        194.82 / 197.46 ±1.59 / 199.12 ms │        196.53 / 200.49 ±2.22 / 203.12 ms │    no change │
│ QQuery 58 │        317.85 / 324.42 ±5.49 / 334.18 ms │        310.44 / 316.74 ±6.34 / 327.29 ms │    no change │
│ QQuery 59 │        214.40 / 217.08 ±1.63 / 219.42 ms │        216.65 / 218.78 ±2.14 / 222.10 ms │    no change │
│ QQuery 60 │        156.45 / 158.42 ±1.27 / 159.63 ms │        157.67 / 159.16 ±1.24 / 161.17 ms │    no change │
│ QQuery 61 │        178.77 / 182.57 ±2.23 / 184.87 ms │        180.37 / 182.57 ±1.43 / 184.80 ms │    no change │
│ QQuery 62 │       906.55 / 950.97 ±23.04 / 969.02 ms │     967.47 / 1017.38 ±33.52 / 1058.83 ms │ 1.07x slower │
│ QQuery 63 │        112.01 / 114.70 ±3.35 / 121.19 ms │        113.24 / 116.40 ±2.05 / 118.68 ms │    no change │
│ QQuery 64 │        727.05 / 737.01 ±7.87 / 749.00 ms │        725.87 / 734.98 ±7.35 / 745.08 ms │    no change │
│ QQuery 65 │        272.13 / 275.41 ±4.23 / 283.78 ms │        271.22 / 281.50 ±6.20 / 288.23 ms │    no change │
│ QQuery 66 │        260.86 / 268.68 ±7.36 / 278.34 ms │       242.26 / 265.52 ±16.57 / 285.79 ms │    no change │
│ QQuery 67 │        354.88 / 361.64 ±5.48 / 368.32 ms │        357.00 / 364.50 ±6.52 / 373.21 ms │    no change │
│ QQuery 68 │        291.83 / 293.80 ±2.29 / 297.23 ms │        296.48 / 298.87 ±2.54 / 303.46 ms │    no change │
│ QQuery 69 │        116.33 / 118.64 ±1.55 / 120.40 ms │        117.66 / 118.95 ±1.02 / 119.99 ms │    no change │
│ QQuery 70 │       349.89 / 363.21 ±10.73 / 382.25 ms │       363.80 / 375.32 ±10.23 / 388.12 ms │    no change │
│ QQuery 71 │        145.53 / 146.56 ±1.14 / 148.67 ms │        144.31 / 146.51 ±1.72 / 148.33 ms │    no change │
│ QQuery 72 │        734.02 / 739.41 ±5.66 / 748.51 ms │       732.88 / 747.72 ±10.94 / 760.85 ms │    no change │
│ QQuery 73 │        110.44 / 112.18 ±1.42 / 114.45 ms │        113.18 / 115.06 ±1.07 / 116.05 ms │    no change │
│ QQuery 74 │        638.26 / 644.48 ±4.62 / 649.56 ms │        670.86 / 674.28 ±3.82 / 681.23 ms │    no change │
│ QQuery 75 │        298.23 / 300.75 ±1.85 / 304.00 ms │        304.43 / 306.33 ±2.85 / 311.82 ms │    no change │
│ QQuery 76 │        138.26 / 140.09 ±1.10 / 141.19 ms │        139.19 / 140.75 ±1.03 / 142.43 ms │    no change │
│ QQuery 77 │        205.99 / 208.35 ±1.74 / 210.76 ms │        208.39 / 209.36 ±0.70 / 210.45 ms │    no change │
│ QQuery 78 │        367.75 / 373.73 ±4.61 / 378.17 ms │        371.95 / 375.85 ±3.31 / 381.19 ms │    no change │
│ QQuery 79 │        243.82 / 247.89 ±2.83 / 251.78 ms │        251.80 / 254.11 ±2.57 / 259.00 ms │    no change │
│ QQuery 80 │        345.75 / 347.83 ±1.26 / 349.15 ms │        347.75 / 351.08 ±2.70 / 354.89 ms │    no change │
│ QQuery 81 │           32.19 / 33.25 ±0.99 / 35.09 ms │           32.57 / 33.43 ±0.74 / 34.76 ms │    no change │
│ QQuery 82 │        214.61 / 217.31 ±1.77 / 219.34 ms │        214.68 / 217.06 ±1.93 / 220.05 ms │    no change │
│ QQuery 83 │           49.02 / 50.33 ±1.52 / 52.84 ms │           48.91 / 49.24 ±0.55 / 50.33 ms │    no change │
│ QQuery 84 │           52.85 / 54.35 ±1.18 / 56.32 ms │           53.24 / 54.17 ±0.86 / 55.51 ms │    no change │
│ QQuery 85 │        156.70 / 159.07 ±1.84 / 161.40 ms │        155.89 / 156.79 ±0.78 / 158.21 ms │    no change │
│ QQuery 86 │           42.53 / 44.00 ±0.87 / 45.03 ms │           43.64 / 44.81 ±1.20 / 47.09 ms │    no change │
│ QQuery 87 │          95.06 / 98.17 ±2.18 / 100.82 ms │         97.27 / 101.31 ±3.71 / 108.10 ms │    no change │
│ QQuery 88 │        116.85 / 118.26 ±1.17 / 120.43 ms │        119.03 / 119.90 ±0.86 / 121.54 ms │    no change │
│ QQuery 89 │        127.27 / 128.66 ±0.70 / 129.24 ms │        131.04 / 132.21 ±0.97 / 133.87 ms │    no change │
│ QQuery 90 │           29.88 / 30.46 ±0.34 / 30.81 ms │           29.76 / 30.55 ±0.67 / 31.59 ms │    no change │
│ QQuery 91 │           68.24 / 69.82 ±1.07 / 71.12 ms │           66.57 / 68.38 ±1.44 / 70.24 ms │    no change │
│ QQuery 92 │           62.48 / 64.08 ±1.31 / 65.96 ms │           64.48 / 65.66 ±0.83 / 66.77 ms │    no change │
│ QQuery 93 │        200.45 / 202.60 ±2.24 / 205.52 ms │        200.67 / 203.76 ±2.53 / 207.90 ms │    no change │
│ QQuery 94 │           67.50 / 68.60 ±0.92 / 69.71 ms │           68.87 / 69.75 ±0.50 / 70.20 ms │    no change │
│ QQuery 95 │        148.00 / 149.89 ±1.21 / 151.46 ms │        144.88 / 145.94 ±0.85 / 147.16 ms │    no change │
│ QQuery 96 │           80.76 / 81.66 ±1.15 / 83.89 ms │           84.58 / 85.69 ±0.79 / 86.89 ms │    no change │
│ QQuery 97 │        136.72 / 140.03 ±1.73 / 141.52 ms │        144.42 / 145.89 ±2.03 / 149.91 ms │    no change │
│ QQuery 98 │        156.63 / 159.56 ±1.54 / 161.03 ms │        155.63 / 158.60 ±2.24 / 161.55 ms │    no change │
│ QQuery 99 │ 10790.71 / 10847.77 ±29.94 / 10875.08 ms │ 10802.55 / 10856.80 ±48.20 / 10928.16 ms │    no change │
└───────────┴──────────────────────────────────────────┴──────────────────────────────────────────┴──────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary             ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)             │ 35351.81ms │
│ Total Time (try_batch_join)   │ 35550.69ms │
│ Average Time (HEAD)           │   357.09ms │
│ Average Time (try_batch_join) │   359.10ms │
│ Queries Faster                │          0 │
│ Queries Slower                │          1 │
│ Queries with No Change        │         98 │
│ Queries with Failure          │          0 │
└───────────────────────────────┴────────────┘

Resource Usage

tpcds — base (merge-base)

Metric Value
Wall time 177.1s
Peak memory 5.6 GiB
Avg memory 4.5 GiB
CPU user 280.9s
CPU sys 22.2s
Disk read 0 B
Disk write 636.1 MiB

tpcds — branch

Metric Value
Wall time 178.0s
Peak memory 5.0 GiB
Avg memory 4.3 GiB
CPU user 283.5s
CPU sys 21.9s
Disk read 0 B
Disk write 144.0 KiB

@adriangbot
Copy link

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and try_batch_join
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃                                   HEAD ┃                         try_batch_join ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0  │           1.62 / 4.85 ±6.28 / 17.41 ms │           1.60 / 4.87 ±6.38 / 17.64 ms │     no change │
│ QQuery 1  │         14.85 / 15.46 ±0.40 / 16.10 ms │         15.17 / 15.44 ±0.22 / 15.68 ms │     no change │
│ QQuery 2  │         56.06 / 56.32 ±0.27 / 56.81 ms │         56.97 / 57.27 ±0.24 / 57.60 ms │     no change │
│ QQuery 3  │         48.39 / 50.43 ±1.67 / 53.41 ms │         50.50 / 52.06 ±0.99 / 53.15 ms │     no change │
│ QQuery 4  │      305.18 / 312.01 ±9.32 / 330.31 ms │      303.61 / 307.07 ±2.09 / 309.15 ms │     no change │
│ QQuery 5  │      352.71 / 359.36 ±4.75 / 365.60 ms │      346.30 / 355.39 ±6.89 / 367.15 ms │     no change │
│ QQuery 6  │            5.36 / 6.08 ±0.84 / 7.62 ms │            5.89 / 6.50 ±0.40 / 7.09 ms │  1.07x slower │
│ QQuery 7  │         17.65 / 20.40 ±5.05 / 30.50 ms │         17.71 / 18.24 ±0.49 / 19.06 ms │ +1.12x faster │
│ QQuery 8  │     433.41 / 447.12 ±10.87 / 460.71 ms │      439.99 / 453.29 ±7.18 / 460.22 ms │     no change │
│ QQuery 9  │      671.45 / 675.93 ±2.32 / 678.20 ms │     667.36 / 681.08 ±11.24 / 701.02 ms │     no change │
│ QQuery 10 │        92.15 / 94.95 ±3.23 / 100.62 ms │        91.75 / 95.17 ±3.68 / 102.20 ms │     no change │
│ QQuery 11 │      106.25 / 108.06 ±1.33 / 109.87 ms │      106.25 / 107.89 ±1.99 / 111.59 ms │     no change │
│ QQuery 12 │      347.11 / 353.06 ±3.12 / 356.21 ms │      352.09 / 358.69 ±7.29 / 372.63 ms │     no change │
│ QQuery 13 │     455.57 / 472.27 ±11.41 / 486.09 ms │      466.77 / 479.18 ±9.00 / 492.23 ms │     no change │
│ QQuery 14 │      359.66 / 362.21 ±1.53 / 364.07 ms │      364.71 / 370.60 ±3.81 / 374.78 ms │     no change │
│ QQuery 15 │     378.39 / 392.34 ±14.67 / 419.80 ms │     368.57 / 382.37 ±12.03 / 403.28 ms │     no change │
│ QQuery 16 │     761.30 / 791.14 ±21.46 / 824.07 ms │     748.47 / 774.48 ±21.92 / 806.65 ms │     no change │
│ QQuery 17 │      752.31 / 757.49 ±3.91 / 762.22 ms │     764.62 / 807.12 ±32.58 / 863.95 ms │  1.07x slower │
│ QQuery 18 │  1425.09 / 1519.28 ±50.03 / 1567.36 ms │  1449.44 / 1503.97 ±36.00 / 1544.47 ms │     no change │
│ QQuery 19 │         35.01 / 36.88 ±1.17 / 38.23 ms │        36.59 / 48.99 ±23.81 / 96.61 ms │  1.33x slower │
│ QQuery 20 │     715.88 / 729.49 ±15.99 / 751.20 ms │     716.85 / 728.33 ±14.49 / 756.00 ms │     no change │
│ QQuery 21 │      755.83 / 761.30 ±2.78 / 763.30 ms │      758.80 / 765.14 ±4.17 / 768.95 ms │     no change │
│ QQuery 22 │   1129.22 / 1136.36 ±4.72 / 1142.44 ms │   1130.16 / 1134.63 ±3.67 / 1141.17 ms │     no change │
│ QQuery 23 │  3198.35 / 3220.68 ±17.65 / 3246.09 ms │  3166.51 / 3184.28 ±12.88 / 3204.57 ms │     no change │
│ QQuery 24 │      102.60 / 107.32 ±3.03 / 112.08 ms │      101.56 / 104.77 ±2.54 / 108.83 ms │     no change │
│ QQuery 25 │      140.63 / 144.03 ±2.32 / 146.71 ms │      138.70 / 140.53 ±1.37 / 142.18 ms │     no change │
│ QQuery 26 │      103.56 / 106.56 ±2.05 / 109.36 ms │      101.90 / 104.17 ±1.28 / 105.71 ms │     no change │
│ QQuery 27 │      847.58 / 852.68 ±5.09 / 861.67 ms │      852.05 / 854.73 ±3.17 / 860.52 ms │     no change │
│ QQuery 28 │  7698.77 / 7744.41 ±24.53 / 7766.11 ms │  7713.10 / 7760.33 ±24.87 / 7786.10 ms │     no change │
│ QQuery 29 │      330.17 / 334.48 ±6.34 / 347.03 ms │      329.79 / 334.99 ±7.23 / 349.22 ms │     no change │
│ QQuery 30 │      365.52 / 372.04 ±5.74 / 381.38 ms │      368.76 / 373.89 ±3.84 / 379.86 ms │     no change │
│ QQuery 31 │     363.90 / 372.15 ±15.25 / 402.63 ms │      367.05 / 382.52 ±9.68 / 395.67 ms │     no change │
│ QQuery 32 │ 1069.17 / 1155.45 ±115.71 / 1381.13 ms │ 1072.65 / 1241.25 ±107.22 / 1352.44 ms │  1.07x slower │
│ QQuery 33 │   1486.53 / 1497.38 ±9.13 / 1508.51 ms │  1479.46 / 1496.27 ±18.98 / 1529.45 ms │     no change │
│ QQuery 34 │  1485.67 / 1514.12 ±18.67 / 1541.08 ms │  1489.71 / 1518.18 ±19.27 / 1550.39 ms │     no change │
│ QQuery 35 │      402.42 / 406.89 ±5.43 / 416.23 ms │      409.90 / 416.37 ±3.49 / 420.10 ms │     no change │
│ QQuery 36 │      120.19 / 124.50 ±2.22 / 126.20 ms │      127.73 / 128.54 ±0.92 / 129.85 ms │     no change │
│ QQuery 37 │         49.09 / 50.94 ±1.10 / 52.18 ms │         50.47 / 53.45 ±2.43 / 56.95 ms │     no change │
│ QQuery 38 │         75.50 / 76.84 ±0.78 / 77.50 ms │         76.53 / 78.63 ±1.41 / 80.68 ms │     no change │
│ QQuery 39 │      220.54 / 223.97 ±3.69 / 230.29 ms │      225.88 / 232.96 ±6.95 / 241.98 ms │     no change │
│ QQuery 40 │         23.91 / 25.19 ±0.91 / 26.76 ms │         23.67 / 28.78 ±3.87 / 35.11 ms │  1.14x slower │
│ QQuery 41 │         20.46 / 22.28 ±1.62 / 24.58 ms │         21.27 / 22.55 ±0.91 / 23.81 ms │     no change │
│ QQuery 42 │         20.46 / 21.20 ±0.41 / 21.66 ms │         20.55 / 21.33 ±0.59 / 22.24 ms │     no change │
└───────────┴────────────────────────────────────────┴────────────────────────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary             ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)             │ 27835.88ms │
│ Total Time (try_batch_join)   │ 27986.28ms │
│ Average Time (HEAD)           │   647.35ms │
│ Average Time (try_batch_join) │   650.84ms │
│ Queries Faster                │          1 │
│ Queries Slower                │          5 │
│ Queries with No Change        │         37 │
│ Queries with Failure          │          0 │
└───────────────────────────────┴────────────┘

Resource Usage

clickbench_partitioned — base (merge-base)

Metric Value
Wall time 140.4s
Peak memory 39.3 GiB
Avg memory 32.1 GiB
CPU user 1316.1s
CPU sys 92.9s
Disk read 0 B
Disk write 3.8 GiB

clickbench_partitioned — branch

Metric Value
Wall time 141.0s
Peak memory 41.6 GiB
Avg memory 30.9 GiB
CPU user 1317.0s
CPU sys 97.6s
Disk read 0 B
Disk write 116.0 KiB

@Dandandan Dandandan closed this Mar 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

physical-plan Changes to the physical-plan crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants