Skip to content

Triggerable action to test IRON with a specific mlir-aie wheels version, including latest.#32

Merged
hunhoffe merged 15 commits intodevelfrom
test-wheels-specific
Nov 25, 2025
Merged

Triggerable action to test IRON with a specific mlir-aie wheels version, including latest.#32
hunhoffe merged 15 commits intodevelfrom
test-wheels-specific

Conversation

@hunhoffe
Copy link
Copy Markdown
Collaborator

@hunhoffe hunhoffe commented Nov 21, 2025

Triggerable action to test IRON with a specific mlir-aie wheels version, including latest. To be merged after: #27

Added

  • New github action, which tries to use existing actions whenever possible.

Changed

Removed

PR Merge Checklist

  1. The PR is rebased on the latest devel commit and pointing to devel.
  2. Your PR has been reviewed and approved.
  3. All checks are passing.

@github-actions
Copy link
Copy Markdown
Contributor

📊 Test Results for Test Example Applications

f39e60a (2025_11_21_22_42_29)

IRONCLAD

Tested on 2025_11_21_22_42_29 at commit f39e60a.

Test Checks TTFT (mean)TPS (mean)
llama_3.2_1b ✅ 5/5 4.04 4.69
📈 Trends (vs main branch) for Test Example Applications

f39e60a (2025_11_21_22_42_29)

IRONCLAD Trends

llama_3.2_1b

Commit/Date Num Tokens (max)Num Tokens (mean)Num Tokens (median)Num Tokens (min)Num Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)Total (max)Total (mean)Total (median)Total (min)Total (stddev)
f39e60a — 2025-11-21 22:37:5740.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)0.00 (n/a)4.72 (-0.84%)4.69 (-0.30%)4.70 (-0.21%)4.65 (-0.21%)0.03 (-27.79%)4.24 (+1.95%)4.04 (-1.17%)4.18 (+1.26%)3.61 (-8.68%)0.23 (+227.01%)12.57 (+0.79%)12.36 (-0.16%)12.48 (+0.69%)11.87 (-3.40%)0.25 (+268.11%)
d9a64c5 — 2025-11-21 21:53:4040.00 (n/a)40.00 (n/a)40.00 (n/a)40.00 (n/a)0.00 (n/a)4.76 (n/a)4.70 (n/a)4.71 (n/a)4.66 (n/a)0.04 (n/a)4.15 (n/a)4.09 (n/a)4.12 (n/a)3.95 (n/a)0.07 (n/a)12.47 (n/a)12.38 (n/a)12.39 (n/a)12.29 (n/a)0.07 (n/a)

@github-actions
Copy link
Copy Markdown
Contributor

📊 Test Results for Small Benchmark/Test Suite

f39e60a (2025_11_21_22_59_44)

IRONCLAD

Tested on 2025_11_21_22_59_44 at commit f39e60a.

Test Checks Latency (mean)Bandwidth (mean)GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0 ✅ 5/5 175.00 0.07 n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0 ✅ 5/5 194.80 0.06 n/a
axpy_4_cols_2_channels_2048_tile_512_3.0 ✅ 5/5 136.20 0.09 n/a
axpy_8_cols_2_channels_2048_tile_256_3.0 ✅ 5/5 177.20 0.07 n/a
dequant_1_cols_1_channels_2048_tile_2048 ✅ 5/5 178.20 0.03 n/a
dequant_1_cols_2_channels_2048_tile_1024 ✅ 5/5 133.40 0.04 n/a
dequant_2_cols_1_channels_2048_tile_1024 ✅ 5/5 131.60 0.04 n/a
dequant_2_cols_2_channels_2048_tile_512 ✅ 5/5 180.20 0.03 n/a
dequant_4_cols_1_channels_2048_tile_512 ✅ 5/5 210.20 0.02 n/a
dequant_4_cols_2_channels_2048_tile_256 ✅ 5/5 179.20 0.03 n/a
dequant_8_cols_1_channels_2048_tile_256 ✅ 5/5 147.40 0.03 n/a
dequant_8_cols_2_channels_2048_tile_128 ✅ 5/5 164.80 0.03 n/a
eltwise_add_1_cols_2_channels_2048_tile_2048 ✅ 5/5 164.80 0.07 n/a
eltwise_add_2_cols_2_channels_2048_tile_1024 ✅ 5/5 140.60 0.08 n/a
eltwise_add_4_cols_2_channels_2048_tile_512 ✅ 5/5 131.20 0.09 n/a
eltwise_add_8_cols_2_channels_2048_tile_256 ✅ 5/5 153.40 0.08 n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048 ✅ 5/5 203.80 0.06 n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024 ✅ 5/5 187.80 0.07 n/a
eltwise_mul_4_cols_2_channels_2048_tile_512 ✅ 5/5 126.40 0.09 n/a
eltwise_mul_8_cols_2_channels_2048_tile_256 ✅ 5/5 147.20 0.08 n/a
gelu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 163.20 0.05 n/a
gelu_1_cols_2_channels_2048_tile_1024 ✅ 5/5 141.60 0.06 n/a
gelu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 160.60 0.05 n/a
gelu_2_cols_2_channels_2048_tile_512 ✅ 5/5 127.20 0.06 n/a
gelu_4_cols_1_channels_2048_tile_512 ✅ 5/5 145.60 0.06 n/a
gelu_4_cols_2_channels_2048_tile_256 ✅ 5/5 188.40 0.04 n/a
gelu_8_cols_1_channels_2048_tile_256 ✅ 5/5 161.60 0.05 n/a
gelu_8_cols_2_channels_2048_tile_128 ✅ 5/5 195.00 0.04 n/a
gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0 ✅ 5/5 6631.40 3.54 2591.95
layer_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 220.20 0.06 n/a
layer_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 157.00 0.08 n/a
layer_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 207.00 0.06 n/a
layer_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 147.60 0.08 n/a
layer_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 142.00 0.09 n/a
layer_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 164.80 0.08 n/a
layer_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 163.40 0.08 n/a
layer_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 255.20 0.05 n/a
matrix_vector_mul_128x128_32_1col ✅ 5/5 754.40 0.04 0.04
matrix_vector_mul_2048x8192_1_1col ✅ 5/5 3084.00 10.89 10.88
matrix_vector_mul_2048x8192_1_2col ✅ 5/5 1883.80 17.84 17.83
matrix_vector_mul_2048x8192_1_4col ✅ 5/5 1563.40 21.52 21.51
matrix_vector_mul_2048x8192_1_8col ✅ 5/5 1904.20 17.79 17.78
matrix_vector_mul_8192x2048_4_1col ✅ 5/5 3142.00 10.72 10.71
matrix_vector_mul_8192x2048_4_2col ✅ 5/5 1916.20 17.54 17.53
matrix_vector_mul_8192x2048_4_4col ✅ 5/5 1709.00 19.75 19.73
matrix_vector_mul_8192x2048_4_8col ✅ 5/5 1949.00 17.46 17.45
mem_copy_16_cores_2_chans_2048_tile_128_False ✅ 5/5 207.80 0.04 n/a
mem_copy_1_cores_1_chans_2048_tile_2048_False ✅ 5/5 135.60 0.06 n/a
mem_copy_2_cores_1_chans_2048_tile_1024_False ✅ 5/5 144.60 0.05 n/a
mem_copy_2_cores_2_chans_2048_tile_1024_False ✅ 5/5 143.00 0.05 n/a
mem_copy_4_cores_1_chans_2048_tile_512_False ✅ 5/5 163.80 0.05 n/a
mem_copy_4_cores_2_chans_2048_tile_512_False ✅ 5/5 136.40 0.06 n/a
mem_copy_8_cores_1_chans_2048_tile_256_False ✅ 5/5 219.80 0.04 n/a
mem_copy_8_cores_2_chans_2048_tile_256_False ✅ 5/5 161.80 0.05 n/a
mha ✅ 5/5 n/a 1.49 761.65
relu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 144.20 0.05 n/a
relu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 151.80 0.05 n/a
relu_4_cols_1_channels_2048_tile_512 ✅ 5/5 171.20 0.05 n/a
relu_8_cols_1_channels_2048_tile_256 ✅ 5/5 184.80 0.04 n/a
rms_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 151.80 0.08 n/a
rms_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 171.00 0.07 n/a
rms_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 178.40 0.07 n/a
rms_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 130.20 0.09 n/a
rms_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 144.80 0.08 n/a
rms_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 155.20 0.07 n/a
rms_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 203.80 0.06 n/a
rms_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 224.20 0.06 n/a
rope_1_cols_2_channels_4096_tile_4096_0 ✅ 5/5 161.40 0.15 n/a
rope_2_cols_2_channels_4096_tile_2048_0 ✅ 5/5 134.60 0.17 n/a
rope_4_cols_2_channels_4096_tile_1024_0 ✅ 5/5 153.80 0.16 n/a
rope_8_cols_2_channels_4096_tile_512_0 ✅ 5/5 145.40 0.16 n/a
sigmoid_1_cols_1_channels_2048_tile_2048 ✅ 5/5 153.00 0.05 n/a
sigmoid_2_cols_1_channels_2048_tile_1024 ✅ 5/5 165.00 0.05 n/a
sigmoid_4_cols_1_channels_2048_tile_512 ✅ 5/5 150.80 0.05 n/a
sigmoid_8_cols_1_channels_2048_tile_256 ✅ 5/5 227.80 0.04 n/a
silu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 145.40 0.05 n/a
silu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 152.40 0.05 n/a
silu_4_cols_1_channels_2048_tile_512 ✅ 5/5 142.20 0.05 n/a
silu_8_cols_1_channels_2048_tile_256 ✅ 5/5 165.00 0.05 n/a
softmax_1_cols_2_channels_4096_tile_2048 ✅ 5/5 165.40 0.14 n/a
softmax_2_cols_2_channels_4096_tile_1024 ✅ 5/5 142.00 0.16 n/a
softmax_2_cols_2_channels_4096_tile_512 ✅ 5/5 180.20 0.14 n/a
swiglu ✅ 5/5 n/a n/a n/a
tanh_1_cols_1_channels_2048_tile_2048 ✅ 5/5 135.00 0.06 n/a
tanh_2_cols_1_channels_2048_tile_1024 ✅ 5/5 126.60 0.06 n/a
tanh_4_cols_1_channels_2048_tile_512 ✅ 5/5 178.00 0.05 n/a
tanh_8_cols_1_channels_2048_tile_256 ✅ 5/5 163.40 0.05 n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s ✅ 5/5 182.80 2.70 n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s ✅ 5/5 183.40 2.87 n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048 ✅ 5/5 172.60 0.07 n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024 ✅ 5/5 163.60 0.07 n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512 ✅ 5/5 174.80 0.07 n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256 ✅ 5/5 184.20 0.06 n/a
📈 Trends (vs main branch) for Small Benchmark/Test Suite

f39e60a (2025_11_21_22_59_44)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (-10.39%)0.07 (+7.12%)0.07 (+8.75%)0.05 (+12.44%)0.01 (-36.35%)225.00 (-11.07%)175.00 (-9.51%)160.00 (-8.05%)154.00 (+11.59%)26.84 (-39.08%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.06 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)253.00 (n/a)193.40 (n/a)174.00 (n/a)138.00 (n/a)44.06 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.09 (+2.29%)0.06 (-0.06%)0.06 (-8.74%)0.04 (-19.75%)0.02 (+19.85%)319.00 (+24.61%)194.80 (+3.95%)183.00 (+9.58%)131.00 (-2.24%)65.69 (+49.38%)
d9a64c5 — 2025-11-21 20:49:350.09 (n/a)0.06 (n/a)0.07 (n/a)0.04 (n/a)0.01 (n/a)256.00 (n/a)187.40 (n/a)167.00 (n/a)134.00 (n/a)43.98 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.09 (+13.01%)0.09 (+25.43%)0.09 (+37.30%)0.07 (+5.71%)0.01 (+40.65%)175.00 (-5.41%)136.20 (-19.69%)126.00 (-27.17%)123.00 (-11.51%)19.81 (+19.82%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)185.00 (n/a)169.60 (n/a)173.00 (n/a)139.00 (n/a)16.54 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.08 (+13.61%)0.07 (+5.08%)0.07 (+12.05%)0.05 (-8.61%)0.01 (+189.58%)209.00 (+9.42%)177.20 (-3.17%)166.00 (-10.75%)147.00 (-11.98%)25.11 (+187.29%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.00 (n/a)191.00 (n/a)183.00 (n/a)186.00 (n/a)167.00 (n/a)8.74 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.03 (-21.56%)0.03 (-4.82%)0.03 (-1.75%)0.03 (+13.99%)0.00 (-64.25%)193.00 (-12.27%)178.20 (+2.53%)171.00 (+1.79%)167.00 (+27.48%)11.75 (-59.66%)
d9a64c5 — 2025-11-21 20:49:350.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)220.00 (n/a)173.80 (n/a)168.00 (n/a)131.00 (n/a)29.14 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.04 (+15.45%)0.04 (+25.57%)0.04 (+20.59%)0.03 (+53.90%)0.00 (-54.09%)141.00 (-35.02%)133.40 (-21.81%)136.00 (-17.07%)123.00 (-13.38%)6.53 (-74.66%)
d9a64c5 — 2025-11-21 20:49:350.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)217.00 (n/a)170.60 (n/a)164.00 (n/a)142.00 (n/a)25.77 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.05 (+58.51%)0.04 (+35.07%)0.04 (+14.49%)0.03 (+55.13%)0.01 (+57.52%)156.00 (-35.54%)131.60 (-26.07%)138.00 (-12.66%)94.00 (-36.91%)20.71 (-39.26%)
d9a64c5 — 2025-11-21 20:49:350.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)242.00 (n/a)178.00 (n/a)158.00 (n/a)149.00 (n/a)34.10 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.03 (-7.84%)0.03 (-2.10%)0.03 (+12.34%)0.02 (-24.42%)0.01 (+54.70%)258.00 (+32.31%)180.20 (+5.13%)154.00 (-10.98%)153.00 (+8.51%)40.56 (+122.67%)
d9a64c5 — 2025-11-21 20:49:350.03 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)195.00 (n/a)171.40 (n/a)173.00 (n/a)141.00 (n/a)18.22 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.03 (-29.14%)0.02 (-36.86%)0.03 (-33.85%)0.02 (-45.70%)0.00 (+131.03%)256.00 (+84.17%)210.20 (+62.44%)192.00 (+51.18%)175.00 (+41.13%)35.46 (+509.65%)
d9a64c5 — 2025-11-21 20:49:350.04 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)139.00 (n/a)129.40 (n/a)127.00 (n/a)124.00 (n/a)5.82 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.03 (-12.75%)0.03 (-21.41%)0.03 (-22.94%)0.02 (-28.57%)0.00 (+30.95%)217.00 (+40.00%)179.20 (+28.55%)170.00 (+29.77%)149.00 (+14.62%)23.10 (+113.55%)
d9a64c5 — 2025-11-21 20:49:350.04 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.00 (n/a)155.00 (n/a)139.40 (n/a)131.00 (n/a)130.00 (n/a)10.82 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.04 (+28.03%)0.03 (+27.66%)0.03 (+27.52%)0.03 (+24.53%)0.00 (+58.36%)159.00 (-19.70%)147.40 (-21.51%)149.00 (-21.58%)132.00 (-21.89%)10.56 (+0.22%)
d9a64c5 — 2025-11-21 20:49:350.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)198.00 (n/a)187.80 (n/a)190.00 (n/a)169.00 (n/a)10.53 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.03 (+16.88%)0.03 (+21.41%)0.03 (+20.36%)0.03 (+21.02%)0.00 (+7.88%)176.00 (-17.37%)164.80 (-17.68%)167.00 (-16.92%)154.00 (-14.44%)8.52 (-23.43%)
d9a64c5 — 2025-11-21 20:49:350.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)213.00 (n/a)200.20 (n/a)201.00 (n/a)180.00 (n/a)11.12 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.08 (-5.84%)0.07 (-9.48%)0.07 (-6.49%)0.05 (-23.83%)0.01 (+44.24%)214.00 (+31.29%)164.80 (+12.11%)154.00 (+6.94%)137.00 (+6.20%)26.27 (+104.89%)
d9a64c5 — 2025-11-21 20:49:350.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)163.00 (n/a)147.00 (n/a)144.00 (n/a)129.00 (n/a)12.82 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.10 (-2.59%)0.08 (-6.30%)0.08 (-5.41%)0.07 (-8.75%)0.01 (+12.75%)160.00 (+9.59%)140.60 (+7.33%)148.00 (+5.71%)116.00 (+2.65%)18.56 (+28.72%)
d9a64c5 — 2025-11-21 20:49:350.10 (n/a)0.09 (n/a)0.08 (n/a)0.08 (n/a)0.01 (n/a)146.00 (n/a)131.00 (n/a)140.00 (n/a)113.00 (n/a)14.42 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.11 (+12.96%)0.09 (+20.07%)0.08 (+7.14%)0.08 (+87.59%)0.01 (-41.13%)145.00 (-46.69%)131.20 (-21.81%)140.00 (-6.67%)108.00 (-11.48%)13.79 (-74.11%)
d9a64c5 — 2025-11-21 20:49:350.09 (n/a)0.07 (n/a)0.08 (n/a)0.04 (n/a)0.02 (n/a)272.00 (n/a)167.80 (n/a)150.00 (n/a)122.00 (n/a)53.26 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.09 (+15.63%)0.08 (+41.90%)0.07 (+22.22%)0.06 (+174.18%)0.01 (-49.27%)182.00 (-63.53%)153.40 (-41.14%)162.00 (-18.18%)128.00 (-13.51%)20.43 (-84.30%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.05 (n/a)0.06 (n/a)0.02 (n/a)0.02 (n/a)499.00 (n/a)260.60 (n/a)198.00 (n/a)148.00 (n/a)130.14 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.09 (+6.25%)0.06 (-18.47%)0.05 (-26.82%)0.05 (-27.69%)0.02 (+142.13%)242.00 (+38.29%)203.80 (+28.18%)220.00 (+36.65%)128.00 (-5.88%)39.45 (+203.99%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.07 (n/a)0.07 (n/a)0.07 (n/a)0.01 (n/a)175.00 (n/a)159.00 (n/a)161.00 (n/a)136.00 (n/a)12.98 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.09 (+4.03%)0.07 (-4.58%)0.05 (-18.31%)0.05 (-14.96%)0.02 (+70.59%)234.00 (+17.59%)187.80 (+10.34%)213.00 (+22.41%)124.00 (-3.88%)47.51 (+99.26%)
d9a64c5 — 2025-11-21 20:49:350.09 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)199.00 (n/a)170.20 (n/a)174.00 (n/a)129.00 (n/a)23.84 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.09 (+24.00%)0.09 (+30.05%)0.09 (+29.36%)0.09 (+44.53%)0.00 (-82.45%)128.00 (-30.81%)126.40 (-23.39%)126.00 (-22.70%)125.00 (-19.35%)1.02 (-90.31%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.00 (n/a)185.00 (n/a)165.00 (n/a)163.00 (n/a)155.00 (n/a)10.53 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.10 (+38.79%)0.08 (+35.82%)0.08 (+25.17%)0.06 (+74.37%)0.01 (+1.00%)199.00 (-42.65%)147.20 (-29.64%)143.00 (-20.11%)116.00 (-27.95%)28.06 (-59.50%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.06 (n/a)0.06 (n/a)0.03 (n/a)0.01 (n/a)347.00 (n/a)209.20 (n/a)179.00 (n/a)161.00 (n/a)69.28 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (-4.76%)0.05 (-19.16%)0.05 (-23.46%)0.04 (-18.85%)0.01 (+36.83%)191.00 (+23.23%)163.20 (+25.15%)162.00 (+30.65%)126.00 (+5.00%)22.27 (+73.32%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.06 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)155.00 (n/a)130.40 (n/a)124.00 (n/a)120.00 (n/a)12.85 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (+1.80%)0.06 (+1.20%)0.05 (-2.00%)0.05 (-13.07%)0.01 (+49.00%)176.00 (+15.03%)141.60 (+0.57%)150.00 (+2.04%)111.00 (-1.77%)23.99 (+68.22%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)153.00 (n/a)140.80 (n/a)147.00 (n/a)113.00 (n/a)14.26 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (+12.61%)0.05 (+0.83%)0.05 (+5.10%)0.04 (-14.61%)0.01 (+57.16%)219.00 (+17.11%)160.60 (+2.03%)157.00 (-4.85%)111.00 (-11.20%)34.81 (+64.57%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)187.00 (n/a)157.40 (n/a)165.00 (n/a)125.00 (n/a)21.15 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (+3.48%)0.06 (+2.57%)0.06 (+0.00%)0.06 (+6.57%)0.00 (-6.52%)137.00 (-6.16%)127.20 (-2.60%)127.00 (+0.00%)115.00 (-3.36%)7.60 (-15.99%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.00 (n/a)146.00 (n/a)130.60 (n/a)127.00 (n/a)119.00 (n/a)9.05 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (+0.81%)0.06 (+1.56%)0.06 (-6.16%)0.05 (+44.85%)0.01 (-52.35%)165.00 (-30.96%)145.60 (-6.19%)146.00 (+6.57%)124.00 (-0.80%)13.46 (-68.48%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.06 (n/a)0.06 (n/a)0.03 (n/a)0.01 (n/a)239.00 (n/a)155.20 (n/a)137.00 (n/a)125.00 (n/a)42.69 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.05 (-12.67%)0.04 (-1.27%)0.04 (-14.65%)0.04 (+51.44%)0.01 (-56.40%)208.00 (-33.97%)188.40 (-6.36%)198.00 (+17.16%)150.00 (+14.50%)20.45 (-68.51%)
d9a64c5 — 2025-11-21 20:49:350.06 (n/a)0.04 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)315.00 (n/a)201.20 (n/a)169.00 (n/a)131.00 (n/a)64.95 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (+2.48%)0.05 (-2.51%)0.06 (+18.49%)0.04 (-12.81%)0.01 (+17.38%)203.00 (+14.69%)161.60 (+3.99%)146.00 (-15.61%)121.00 (-2.42%)31.51 (+35.18%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)177.00 (n/a)155.40 (n/a)173.00 (n/a)124.00 (n/a)23.31 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.05 (-15.91%)0.04 (-9.53%)0.04 (-9.14%)0.04 (+18.52%)0.00 (-58.81%)216.00 (-15.62%)195.00 (+7.03%)186.00 (+10.06%)176.00 (+18.92%)16.30 (-58.52%)
d9a64c5 — 2025-11-21 20:49:350.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)256.00 (n/a)182.20 (n/a)169.00 (n/a)148.00 (n/a)39.29 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:533.65 (-1.24%)3.54 (-0.71%)3.51 (-3.56%)3.43 (+1.99%)0.08 (-41.10%)2673.08 (-1.24%)2591.95 (-0.71%)2570.68 (-3.56%)2511.68 (+1.99%)57.37 (-41.10%)6840.00 (-1.95%)6631.40 (+0.62%)6683.00 (+3.69%)6427.00 (+1.26%)146.54 (-41.52%)
d9a64c5 — 2025-11-21 20:49:353.69 (n/a)3.56 (n/a)3.64 (n/a)3.36 (n/a)0.13 (n/a)2706.77 (n/a)2610.50 (n/a)2665.61 (n/a)2462.71 (n/a)97.41 (n/a)6976.00 (n/a)6590.40 (n/a)6445.00 (n/a)6347.00 (n/a)250.58 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (-34.25%)0.06 (-29.25%)0.06 (-27.18%)0.05 (-29.85%)0.01 (-34.14%)268.00 (+42.55%)220.20 (+41.15%)206.00 (+37.33%)181.00 (+52.10%)35.26 (+43.14%)
d9a64c5 — 2025-11-21 20:49:350.10 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)188.00 (n/a)156.00 (n/a)150.00 (n/a)119.00 (n/a)24.63 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.10 (+10.16%)0.08 (+0.45%)0.08 (-7.98%)0.07 (+10.56%)0.01 (+22.24%)180.00 (-9.55%)157.00 (-0.13%)163.00 (+8.67%)128.00 (-9.22%)21.00 (-1.26%)
d9a64c5 — 2025-11-21 20:49:350.09 (n/a)0.08 (n/a)0.08 (n/a)0.06 (n/a)0.01 (n/a)199.00 (n/a)157.20 (n/a)150.00 (n/a)141.00 (n/a)21.27 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.09 (+10.95%)0.06 (-14.29%)0.06 (-20.73%)0.04 (-26.67%)0.02 (+119.12%)285.00 (+36.36%)207.00 (+25.15%)193.00 (+26.14%)137.00 (-9.87%)59.88 (+172.32%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.08 (n/a)0.08 (n/a)0.06 (n/a)0.01 (n/a)209.00 (n/a)165.40 (n/a)153.00 (n/a)152.00 (n/a)21.99 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.09 (+8.15%)0.08 (+12.99%)0.08 (+16.44%)0.07 (+20.00%)0.01 (-26.81%)170.00 (-16.67%)147.60 (-12.25%)146.00 (-14.12%)135.00 (-7.53%)12.14 (-42.23%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)204.00 (n/a)168.20 (n/a)170.00 (n/a)146.00 (n/a)21.02 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.10 (-17.07%)0.09 (+2.48%)0.09 (+16.06%)0.08 (+19.75%)0.01 (-60.62%)162.00 (-16.49%)142.00 (-7.31%)137.00 (-13.84%)123.00 (+20.59%)14.10 (-60.72%)
d9a64c5 — 2025-11-21 20:49:350.12 (n/a)0.09 (n/a)0.08 (n/a)0.06 (n/a)0.02 (n/a)194.00 (n/a)153.20 (n/a)159.00 (n/a)102.00 (n/a)35.90 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.08 (+5.52%)0.08 (+6.25%)0.08 (-3.12%)0.06 (+71.58%)0.01 (-55.78%)190.00 (-41.72%)164.80 (-12.99%)160.00 (+3.23%)145.00 (-5.23%)16.51 (-75.83%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.07 (n/a)0.08 (n/a)0.04 (n/a)0.02 (n/a)326.00 (n/a)189.40 (n/a)155.00 (n/a)153.00 (n/a)68.32 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.08 (+1.37%)0.08 (+9.04%)0.08 (+7.10%)0.07 (+31.35%)0.01 (-45.35%)185.00 (-23.87%)163.40 (-11.00%)155.00 (-6.63%)146.00 (-1.35%)15.93 (-57.75%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)243.00 (n/a)183.60 (n/a)166.00 (n/a)148.00 (n/a)37.71 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (-13.29%)0.05 (-30.38%)0.04 (-46.58%)0.04 (-33.77%)0.01 (+30.80%)302.00 (+51.00%)255.20 (+48.72%)292.00 (+87.18%)173.00 (+15.33%)54.09 (+132.44%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.07 (n/a)0.08 (n/a)0.06 (n/a)0.01 (n/a)200.00 (n/a)171.60 (n/a)156.00 (n/a)150.00 (n/a)23.27 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.05 (+12.43%)0.04 (+7.80%)0.04 (+6.92%)0.04 (+4.36%)0.00 (+126.71%)0.05 (+12.43%)0.04 (+7.80%)0.04 (+6.92%)0.04 (+4.36%)0.00 (+126.71%)803.00 (-4.18%)754.40 (-7.12%)751.00 (-6.48%)708.00 (-11.06%)30.62 (+93.31%)
d9a64c5 — 2025-11-21 20:49:350.04 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)838.00 (n/a)812.20 (n/a)803.00 (n/a)796.00 (n/a)15.84 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:5311.04 (+1.35%)10.89 (+3.67%)10.92 (+1.79%)10.69 (+13.41%)0.14 (-74.68%)11.03 (+1.35%)10.88 (+3.67%)10.91 (+1.79%)10.69 (+13.41%)0.14 (-74.68%)3140.00 (-11.82%)3084.00 (-3.80%)3076.00 (-1.76%)3041.00 (-1.33%)38.94 (-78.19%)
d9a64c5 — 2025-11-21 20:49:3510.89 (n/a)10.50 (n/a)10.72 (n/a)9.43 (n/a)0.54 (n/a)10.89 (n/a)10.50 (n/a)10.72 (n/a)9.42 (n/a)0.54 (n/a)3561.00 (n/a)3205.80 (n/a)3131.00 (n/a)3082.00 (n/a)178.57 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:5318.25 (+4.02%)17.84 (+10.40%)18.01 (+9.17%)16.76 (+19.12%)0.55 (-51.96%)18.24 (+4.02%)17.83 (+10.40%)18.00 (+9.17%)16.75 (+19.12%)0.55 (-51.96%)2003.00 (-16.05%)1883.80 (-9.81%)1864.00 (-8.40%)1840.00 (-3.87%)60.67 (-61.76%)
d9a64c5 — 2025-11-21 20:49:3517.54 (n/a)16.16 (n/a)16.50 (n/a)14.07 (n/a)1.15 (n/a)17.53 (n/a)16.15 (n/a)16.49 (n/a)14.06 (n/a)1.15 (n/a)2386.00 (n/a)2088.80 (n/a)2035.00 (n/a)1914.00 (n/a)158.66 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:5322.46 (+17.46%)21.52 (+16.61%)21.96 (+16.68%)19.88 (+14.92%)0.95 (+42.07%)22.44 (+17.46%)21.51 (+16.61%)21.95 (+16.68%)19.87 (+14.92%)0.95 (+42.08%)1689.00 (-12.98%)1563.40 (-14.18%)1529.00 (-14.29%)1495.00 (-14.86%)71.79 (+5.19%)
d9a64c5 — 2025-11-21 20:49:3519.12 (n/a)18.45 (n/a)18.82 (n/a)17.30 (n/a)0.67 (n/a)19.11 (n/a)18.44 (n/a)18.81 (n/a)17.29 (n/a)0.67 (n/a)1941.00 (n/a)1821.80 (n/a)1784.00 (n/a)1756.00 (n/a)68.25 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:5319.33 (+5.87%)17.79 (+5.95%)18.44 (+14.88%)15.04 (-3.54%)1.62 (+38.55%)19.32 (+5.87%)17.78 (+5.95%)18.43 (+14.88%)15.03 (-3.54%)1.62 (+38.55%)2232.00 (+3.67%)1904.20 (-5.22%)1821.00 (-12.95%)1737.00 (-5.55%)186.23 (+36.36%)
d9a64c5 — 2025-11-21 20:49:3518.26 (n/a)16.79 (n/a)16.05 (n/a)15.59 (n/a)1.17 (n/a)18.25 (n/a)16.78 (n/a)16.04 (n/a)15.59 (n/a)1.17 (n/a)2153.00 (n/a)2009.00 (n/a)2092.00 (n/a)1839.00 (n/a)136.57 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:5311.03 (-2.69%)10.72 (-0.94%)10.96 (+1.60%)9.63 (-5.48%)0.54 (+39.00%)11.02 (-2.69%)10.71 (-0.94%)10.95 (+1.60%)9.62 (-5.48%)0.54 (+38.99%)3487.00 (+5.79%)3142.00 (+1.09%)3064.00 (-1.57%)3044.00 (+2.77%)172.83 (+51.46%)
d9a64c5 — 2025-11-21 20:49:3511.34 (n/a)10.82 (n/a)10.79 (n/a)10.19 (n/a)0.39 (n/a)11.33 (n/a)10.81 (n/a)10.78 (n/a)10.18 (n/a)0.39 (n/a)3296.00 (n/a)3108.00 (n/a)3113.00 (n/a)2962.00 (n/a)114.11 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:5318.04 (+8.33%)17.54 (+7.64%)17.60 (+5.97%)16.54 (+5.57%)0.54 (+28.20%)18.03 (+8.33%)17.53 (+7.64%)17.59 (+5.97%)16.53 (+5.57%)0.54 (+28.20%)2030.00 (-5.27%)1916.20 (-7.07%)1908.00 (-5.64%)1861.00 (-7.69%)61.31 (+12.68%)
d9a64c5 — 2025-11-21 20:49:3516.65 (n/a)16.29 (n/a)16.60 (n/a)15.67 (n/a)0.42 (n/a)16.64 (n/a)16.28 (n/a)16.59 (n/a)15.66 (n/a)0.42 (n/a)2143.00 (n/a)2062.00 (n/a)2022.00 (n/a)2016.00 (n/a)54.41 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:5321.80 (+3.70%)19.75 (-0.99%)19.09 (-5.57%)17.91 (-4.48%)1.42 (+74.34%)21.79 (+3.70%)19.73 (-0.98%)19.08 (-5.57%)17.90 (-4.48%)1.42 (+74.33%)1875.00 (+4.69%)1709.00 (+1.34%)1759.00 (+5.90%)1540.00 (-3.57%)121.11 (+74.28%)
d9a64c5 — 2025-11-21 20:49:3521.02 (n/a)19.94 (n/a)20.21 (n/a)18.75 (n/a)0.81 (n/a)21.01 (n/a)19.93 (n/a)20.20 (n/a)18.73 (n/a)0.81 (n/a)1791.00 (n/a)1686.40 (n/a)1661.00 (n/a)1597.00 (n/a)69.49 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:5319.40 (+0.46%)17.46 (+8.68%)18.51 (+15.33%)14.86 (+12.62%)1.97 (+0.41%)19.38 (+0.46%)17.45 (+8.68%)18.50 (+15.33%)14.85 (+12.62%)1.97 (+0.40%)2259.00 (-11.20%)1949.00 (-8.12%)1814.00 (-13.29%)1731.00 (-0.46%)229.21 (-11.13%)
d9a64c5 — 2025-11-21 20:49:3519.31 (n/a)16.06 (n/a)16.05 (n/a)13.20 (n/a)1.96 (n/a)19.30 (n/a)16.05 (n/a)16.04 (n/a)13.19 (n/a)1.96 (n/a)2544.00 (n/a)2121.20 (n/a)2092.00 (n/a)1739.00 (n/a)257.91 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.05 (+19.42%)0.04 (+1.90%)0.04 (+0.53%)0.02 (-38.06%)0.01 (+176.47%)360.00 (+61.43%)207.80 (+7.89%)189.00 (-0.53%)139.00 (-16.27%)78.36 (+299.14%)
d9a64c5 — 2025-11-21 20:49:350.05 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.00 (n/a)223.00 (n/a)192.60 (n/a)190.00 (n/a)166.00 (n/a)19.63 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (-16.99%)0.05 (-12.47%)0.05 (-7.32%)0.04 (-11.17%)0.00 (-29.61%)197.00 (+12.57%)171.00 (+13.70%)164.00 (+7.89%)153.00 (+20.47%)17.49 (-4.32%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)175.00 (n/a)150.40 (n/a)152.00 (n/a)127.00 (n/a)18.28 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (+5.56%)0.05 (-1.59%)0.05 (-1.39%)0.03 (-14.07%)0.01 (+25.03%)263.00 (+16.37%)166.00 (+4.53%)144.00 (+1.41%)126.00 (-5.26%)49.38 (+43.17%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)226.00 (n/a)158.80 (n/a)142.00 (n/a)133.00 (n/a)34.49 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (-1.79%)0.06 (+5.21%)0.05 (-2.80%)0.05 (+60.26%)0.01 (-46.00%)156.00 (-37.60%)135.60 (-11.37%)143.00 (+2.88%)112.00 (+1.82%)17.07 (-66.49%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)250.00 (n/a)153.00 (n/a)139.00 (n/a)110.00 (n/a)50.94 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (-15.32%)0.05 (-17.09%)0.05 (-23.81%)0.04 (-15.54%)0.01 (-18.18%)193.00 (+18.40%)160.80 (+20.36%)168.00 (+31.25%)124.00 (+18.10%)22.92 (+11.39%)
0999a9a — 2025-11-13 19:24:080.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)163.00 (n/a)133.60 (n/a)128.00 (n/a)105.00 (n/a)20.58 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (-23.02%)0.05 (-6.98%)0.05 (-2.13%)0.04 (-15.31%)0.01 (-33.29%)196.00 (+18.07%)147.00 (+6.52%)141.00 (+2.17%)126.00 (+29.90%)25.27 (+8.13%)
0999a9a — 2025-11-13 19:24:080.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)166.00 (n/a)138.00 (n/a)138.00 (n/a)97.00 (n/a)23.37 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (+31.86%)0.05 (+18.24%)0.05 (+10.07%)0.04 (+37.79%)0.01 (+9.80%)172.00 (-27.43%)144.60 (-16.32%)149.00 (-9.15%)113.00 (-24.16%)19.13 (-41.76%)
d9a64c5 — 2025-11-21 20:49:350.05 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)237.00 (n/a)172.80 (n/a)164.00 (n/a)149.00 (n/a)32.84 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (-10.26%)0.05 (+10.40%)0.06 (+20.74%)0.04 (+20.73%)0.01 (-36.60%)193.00 (-17.17%)143.00 (-13.33%)135.00 (-17.18%)117.00 (+11.43%)26.57 (-39.35%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)233.00 (n/a)165.00 (n/a)163.00 (n/a)105.00 (n/a)43.81 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.07 (+11.97%)0.05 (+3.09%)0.05 (+2.10%)0.03 (-11.35%)0.01 (+41.65%)229.00 (+12.81%)156.00 (-0.51%)143.00 (-2.05%)117.00 (-10.69%)38.21 (+48.71%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)203.00 (n/a)156.80 (n/a)146.00 (n/a)131.00 (n/a)25.69 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (+9.02%)0.05 (+5.59%)0.05 (+0.00%)0.04 (+3.63%)0.01 (+25.48%)193.00 (-3.50%)147.40 (-4.66%)147.00 (+0.00%)122.00 (-8.27%)25.24 (+7.48%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)154.60 (n/a)147.00 (n/a)133.00 (n/a)23.48 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.06 (-8.46%)0.05 (-9.50%)0.05 (-5.88%)0.03 (-30.13%)0.01 (+41.53%)229.00 (+43.12%)163.80 (+13.28%)153.00 (+6.25%)130.00 (+9.24%)34.08 (+131.96%)
d9a64c5 — 2025-11-21 20:49:350.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)160.00 (n/a)144.60 (n/a)144.00 (n/a)119.00 (n/a)14.69 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (+28.83%)0.06 (+17.92%)0.05 (+7.09%)0.05 (+32.88%)0.01 (+19.65%)146.00 (-24.74%)136.40 (-15.38%)141.00 (-6.62%)111.00 (-22.38%)12.88 (-31.42%)
d9a64c5 — 2025-11-21 20:49:350.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)194.00 (n/a)161.20 (n/a)151.00 (n/a)143.00 (n/a)18.78 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (-13.48%)0.05 (-17.79%)0.05 (-15.33%)0.03 (-25.09%)0.01 (+6.67%)267.00 (+33.50%)176.80 (+24.51%)150.00 (+18.11%)141.00 (+15.57%)47.41 (+61.41%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)142.00 (n/a)127.00 (n/a)122.00 (n/a)29.37 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (+13.38%)0.05 (+23.85%)0.05 (+37.91%)0.05 (+30.72%)0.00 (-56.85%)166.00 (-23.50%)153.40 (-20.60%)153.00 (-27.49%)142.00 (-11.80%)7.63 (-70.60%)
0999a9a — 2025-11-13 19:24:080.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)217.00 (n/a)193.20 (n/a)211.00 (n/a)161.00 (n/a)25.96 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.04 (-10.58%)0.04 (+2.91%)0.04 (-7.54%)0.02 (+15.76%)0.01 (-39.55%)311.00 (-13.61%)219.80 (-8.26%)199.00 (+8.15%)189.00 (+11.83%)46.14 (-39.86%)
d9a64c5 — 2025-11-21 20:49:350.05 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)360.00 (n/a)239.60 (n/a)184.00 (n/a)169.00 (n/a)76.72 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.05 (+16.00%)0.05 (+35.09%)0.05 (+28.93%)0.04 (+75.27%)0.00 (-62.16%)182.00 (-42.95%)161.80 (-30.14%)159.00 (-22.44%)150.00 (-13.79%)11.34 (-80.95%)
d9a64c5 — 2025-11-21 20:49:350.04 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)319.00 (n/a)231.60 (n/a)205.00 (n/a)174.00 (n/a)59.53 (n/a)

mha

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)
f39e60a — 2025-11-21 22:58:531.49 (+0.23%)1.49 (+0.25%)1.49 (+0.72%)1.48 (-0.08%)0.01 (+63.60%)764.26 (+0.23%)761.65 (+0.25%)763.97 (+0.72%)757.21 (-0.08%)3.09 (+63.58%)
d9a64c5 — 2025-11-21 20:49:351.49 (n/a)1.48 (n/a)1.48 (n/a)1.48 (n/a)0.00 (n/a)762.52 (n/a)759.74 (n/a)758.48 (n/a)757.79 (n/a)1.89 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (+26.79%)0.05 (+11.17%)0.05 (+2.80%)0.04 (+5.75%)0.01 (+75.00%)174.00 (-5.43%)144.20 (-8.73%)143.00 (-2.72%)112.00 (-21.13%)22.72 (+32.32%)
d9a64c5 — 2025-11-21 20:49:350.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)184.00 (n/a)158.00 (n/a)147.00 (n/a)142.00 (n/a)17.17 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.06 (-19.12%)0.05 (-16.14%)0.05 (-21.57%)0.05 (-6.59%)0.00 (-60.20%)167.00 (+7.05%)151.80 (+17.13%)153.00 (+27.50%)136.00 (+23.64%)10.42 (-47.60%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)156.00 (n/a)129.60 (n/a)120.00 (n/a)110.00 (n/a)19.89 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.06 (+16.41%)0.05 (+10.88%)0.05 (+11.52%)0.03 (+1.32%)0.01 (+19.35%)227.00 (-1.30%)171.20 (-9.32%)165.00 (-10.33%)128.00 (-14.09%)32.50 (+1.06%)
d9a64c5 — 2025-11-21 20:49:350.05 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)230.00 (n/a)188.80 (n/a)184.00 (n/a)149.00 (n/a)32.16 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.05 (-10.71%)0.04 (-8.62%)0.04 (-10.00%)0.03 (-13.72%)0.01 (+3.58%)226.00 (+15.90%)184.80 (+10.53%)200.00 (+11.11%)140.00 (+12.00%)34.79 (+31.13%)
d9a64c5 — 2025-11-21 20:49:350.06 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)195.00 (n/a)167.20 (n/a)180.00 (n/a)125.00 (n/a)26.53 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.09 (+9.68%)0.08 (+2.09%)0.08 (+6.25%)0.06 (-13.40%)0.01 (+130.20%)194.00 (+15.48%)151.80 (+0.00%)144.00 (-5.88%)124.00 (-8.82%)24.97 (+144.17%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.08 (n/a)0.07 (n/a)0.07 (n/a)0.01 (n/a)168.00 (n/a)151.80 (n/a)153.00 (n/a)136.00 (n/a)10.23 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.09 (+8.20%)0.07 (-1.38%)0.07 (-7.19%)0.05 (+3.24%)0.02 (+13.67%)247.00 (-3.14%)171.00 (+1.91%)167.00 (+7.74%)122.00 (-7.58%)43.52 (-2.39%)
d9a64c5 — 2025-11-21 20:49:350.09 (n/a)0.07 (n/a)0.07 (n/a)0.04 (n/a)0.01 (n/a)255.00 (n/a)167.80 (n/a)155.00 (n/a)132.00 (n/a)44.58 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.08 (-1.34%)0.07 (-5.59%)0.07 (+3.11%)0.05 (-18.99%)0.01 (+47.91%)237.00 (+23.44%)178.40 (+7.86%)161.00 (-3.01%)149.00 (+1.36%)32.10 (+90.25%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)192.00 (n/a)165.40 (n/a)166.00 (n/a)147.00 (n/a)16.87 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.10 (+0.86%)0.09 (+16.60%)0.09 (+14.84%)0.08 (+73.97%)0.01 (-58.32%)146.00 (-42.52%)130.20 (-19.33%)128.00 (-12.93%)116.00 (-0.85%)10.67 (-77.67%)
d9a64c5 — 2025-11-21 20:49:350.10 (n/a)0.08 (n/a)0.08 (n/a)0.05 (n/a)0.02 (n/a)254.00 (n/a)161.40 (n/a)147.00 (n/a)117.00 (n/a)47.77 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.09 (-3.31%)0.08 (+0.67%)0.08 (+2.04%)0.07 (-1.18%)0.01 (-7.93%)170.00 (+1.19%)144.80 (-0.82%)147.00 (-2.00%)121.00 (+3.42%)16.81 (-2.63%)
d9a64c5 — 2025-11-21 20:49:350.10 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)168.00 (n/a)146.00 (n/a)150.00 (n/a)117.00 (n/a)17.26 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.09 (+17.97%)0.07 (+16.52%)0.08 (+15.79%)0.06 (+43.24%)0.01 (-25.78%)185.00 (-30.19%)155.20 (-16.56%)152.00 (-13.64%)128.00 (-15.23%)18.24 (-56.34%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.06 (n/a)0.07 (n/a)0.04 (n/a)0.01 (n/a)265.00 (n/a)186.00 (n/a)176.00 (n/a)151.00 (n/a)41.77 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (+0.00%)0.06 (+0.24%)0.06 (-7.65%)0.04 (+8.56%)0.01 (-17.03%)257.00 (-7.89%)203.80 (-1.45%)196.00 (+8.29%)170.00 (+0.00%)31.06 (-23.53%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)279.00 (n/a)206.80 (n/a)181.00 (n/a)170.00 (n/a)40.61 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (-9.82%)0.06 (+4.43%)0.06 (+9.14%)0.03 (+34.38%)0.01 (-15.55%)349.00 (-25.59%)224.20 (-10.25%)186.00 (-8.37%)163.00 (+10.88%)71.31 (-37.16%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.05 (n/a)0.06 (n/a)0.02 (n/a)0.02 (n/a)469.00 (n/a)249.80 (n/a)203.00 (n/a)147.00 (n/a)113.47 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.18 (+14.96%)0.15 (+10.46%)0.15 (+19.74%)0.11 (-1.90%)0.02 (+18.96%)211.00 (+1.93%)161.40 (-8.92%)152.00 (-16.48%)127.00 (-13.01%)28.33 (+8.60%)
d9a64c5 — 2025-11-21 20:49:350.16 (n/a)0.13 (n/a)0.13 (n/a)0.11 (n/a)0.02 (n/a)207.00 (n/a)177.20 (n/a)182.00 (n/a)146.00 (n/a)26.09 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.19 (+29.27%)0.17 (+33.34%)0.17 (+40.15%)0.15 (+33.56%)0.01 (+9.39%)149.00 (-25.13%)134.60 (-25.22%)132.00 (-28.65%)123.00 (-22.64%)11.07 (-36.40%)
d9a64c5 — 2025-11-21 20:49:350.14 (n/a)0.13 (n/a)0.12 (n/a)0.12 (n/a)0.01 (n/a)199.00 (n/a)180.00 (n/a)185.00 (n/a)159.00 (n/a)17.41 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.19 (-1.69%)0.16 (-4.34%)0.16 (+2.16%)0.10 (-30.51%)0.03 (+75.49%)236.00 (+43.90%)153.80 (+9.70%)139.00 (-2.11%)118.00 (+1.72%)43.06 (+163.32%)
d9a64c5 — 2025-11-21 20:49:350.20 (n/a)0.17 (n/a)0.16 (n/a)0.14 (n/a)0.02 (n/a)164.00 (n/a)140.20 (n/a)142.00 (n/a)116.00 (n/a)16.35 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.18 (+4.65%)0.16 (+12.21%)0.16 (+10.27%)0.15 (+40.00%)0.01 (-49.84%)155.00 (-28.57%)145.40 (-12.62%)146.00 (-9.32%)129.00 (-4.44%)8.87 (-67.33%)
d9a64c5 — 2025-11-21 20:49:350.17 (n/a)0.14 (n/a)0.14 (n/a)0.11 (n/a)0.02 (n/a)217.00 (n/a)166.40 (n/a)161.00 (n/a)135.00 (n/a)27.14 (n/a)

sigmoid_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.06 (+3.94%)0.05 (+9.08%)0.06 (+16.91%)0.03 (-14.72%)0.01 (+59.31%)231.00 (+17.26%)153.00 (-5.32%)136.00 (-14.47%)127.00 (-3.79%)39.15 (+86.06%)
d9a64c5 — 2025-11-21 20:49:350.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)197.00 (n/a)161.60 (n/a)159.00 (n/a)132.00 (n/a)21.04 (n/a)

sigmoid_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.05 (-11.49%)0.05 (-8.33%)0.05 (-4.17%)0.04 (-1.69%)0.00 (-43.45%)177.00 (+1.72%)165.00 (+8.27%)168.00 (+4.35%)148.00 (+12.98%)11.01 (-33.62%)
d9a64c5 — 2025-11-21 20:49:350.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)174.00 (n/a)152.40 (n/a)161.00 (n/a)131.00 (n/a)16.58 (n/a)

sigmoid_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.06 (-13.53%)0.05 (-4.46%)0.05 (+1.37%)0.04 (+3.53%)0.00 (-43.18%)170.00 (-3.41%)150.80 (+3.01%)146.00 (-1.35%)133.00 (+15.65%)14.69 (-35.90%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)176.00 (n/a)146.40 (n/a)148.00 (n/a)115.00 (n/a)22.91 (n/a)

sigmoid_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.05 (+0.00%)0.04 (-16.72%)0.03 (-16.97%)0.02 (-36.69%)0.01 (+205.15%)308.00 (+57.95%)227.80 (+25.58%)218.00 (+20.44%)164.00 (+0.00%)50.46 (+386.85%)
d9a64c5 — 2025-11-21 20:49:350.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)195.00 (n/a)181.40 (n/a)181.00 (n/a)164.00 (n/a)10.37 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.06 (+4.76%)0.05 (+3.08%)0.05 (+2.03%)0.05 (+14.01%)0.00 (-18.30%)157.00 (-12.29%)145.40 (-3.45%)148.00 (-1.99%)126.00 (-4.55%)10.78 (-32.86%)
d9a64c5 — 2025-11-21 20:49:350.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)179.00 (n/a)150.60 (n/a)151.00 (n/a)132.00 (n/a)16.06 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (-3.70%)0.05 (-7.61%)0.05 (-15.75%)0.03 (-0.43%)0.01 (-5.80%)230.00 (+0.44%)152.40 (+7.32%)146.00 (+18.70%)108.00 (+3.85%)41.92 (-5.59%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.06 (n/a)0.06 (n/a)0.03 (n/a)0.01 (n/a)229.00 (n/a)142.00 (n/a)123.00 (n/a)104.00 (n/a)44.40 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.06 (-16.91%)0.05 (+6.32%)0.05 (+6.34%)0.05 (+52.70%)0.00 (-86.81%)148.00 (-34.51%)142.20 (-10.79%)142.00 (-5.96%)136.00 (+20.35%)3.92 (-89.77%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)226.00 (n/a)159.40 (n/a)151.00 (n/a)113.00 (n/a)38.32 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.06 (-2.44%)0.05 (-4.48%)0.05 (-8.92%)0.04 (+8.82%)0.01 (-9.87%)204.00 (-8.11%)165.00 (+3.64%)157.00 (+9.79%)123.00 (+2.50%)29.44 (-15.95%)
d9a64c5 — 2025-11-21 20:49:350.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)222.00 (n/a)159.20 (n/a)143.00 (n/a)120.00 (n/a)35.03 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.17 (+6.82%)0.14 (-2.02%)0.13 (-7.65%)0.12 (+6.91%)0.02 (+6.04%)188.00 (-6.47%)165.40 (+1.97%)170.00 (+8.28%)132.00 (-6.38%)18.59 (-11.13%)
d9a64c5 — 2025-11-21 20:49:350.16 (n/a)0.14 (n/a)0.15 (n/a)0.11 (n/a)0.02 (n/a)201.00 (n/a)162.20 (n/a)157.00 (n/a)141.00 (n/a)20.91 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.19 (-2.44%)0.16 (+13.33%)0.17 (+7.30%)0.14 (+54.55%)0.02 (-46.46%)165.00 (-35.29%)142.00 (-17.15%)137.00 (-6.80%)123.00 (+2.50%)17.89 (-64.61%)
d9a64c5 — 2025-11-21 20:49:350.19 (n/a)0.14 (n/a)0.16 (n/a)0.09 (n/a)0.04 (n/a)255.00 (n/a)171.40 (n/a)147.00 (n/a)120.00 (n/a)50.55 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.17 (-7.41%)0.14 (-15.74%)0.15 (-17.42%)0.08 (-13.01%)0.03 (-12.63%)292.00 (+14.96%)180.20 (+18.40%)155.00 (+21.09%)135.00 (+8.00%)57.27 (+12.46%)
d9a64c5 — 2025-11-21 20:49:350.18 (n/a)0.16 (n/a)0.18 (n/a)0.09 (n/a)0.04 (n/a)254.00 (n/a)152.20 (n/a)128.00 (n/a)125.00 (n/a)50.93 (n/a)

swiglu

No metrics available.

tanh_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.06 (+3.25%)0.06 (+27.94%)0.06 (+28.36%)0.05 (+64.63%)0.00 (-65.90%)147.00 (-39.26%)135.00 (-25.17%)134.00 (-22.09%)123.00 (-3.15%)7.77 (-80.01%)
d9a64c5 — 2025-11-21 20:49:350.06 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)242.00 (n/a)180.40 (n/a)172.00 (n/a)127.00 (n/a)38.88 (n/a)

tanh_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (+23.01%)0.06 (+58.42%)0.06 (+104.84%)0.05 (+108.97%)0.00 (-62.70%)145.00 (-52.15%)126.60 (-42.92%)124.00 (-51.18%)113.00 (-18.71%)10.44 (-84.53%)
d9a64c5 — 2025-11-21 20:49:350.05 (n/a)0.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)303.00 (n/a)221.80 (n/a)254.00 (n/a)139.00 (n/a)67.48 (n/a)

tanh_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.06 (-4.69%)0.05 (-4.30%)0.05 (+10.12%)0.03 (-16.59%)0.01 (+13.46%)229.00 (+19.90%)178.00 (+6.46%)168.00 (-9.19%)128.00 (+4.92%)39.04 (+44.41%)
d9a64c5 — 2025-11-21 20:49:350.06 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)191.00 (n/a)167.20 (n/a)185.00 (n/a)122.00 (n/a)27.04 (n/a)

tanh_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.05 (+31.43%)0.05 (+20.95%)0.05 (+13.77%)0.04 (+19.55%)0.00 (+75.76%)179.00 (-16.36%)163.40 (-17.06%)167.00 (-12.11%)140.00 (-23.91%)12.85 (+9.20%)
d9a64c5 — 2025-11-21 20:49:350.04 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)214.00 (n/a)197.00 (n/a)190.00 (n/a)184.00 (n/a)11.76 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:533.28 (+10.74%)2.70 (-0.12%)2.60 (-5.32%)2.49 (+8.16%)0.29 (+34.25%)196.00 (-7.55%)182.80 (+0.44%)188.00 (+5.62%)149.00 (-9.70%)17.24 (+8.20%)
d9a64c5 — 2025-11-21 20:49:352.96 (n/a)2.70 (n/a)2.74 (n/a)2.30 (n/a)0.22 (n/a)212.00 (n/a)182.00 (n/a)178.00 (n/a)165.00 (n/a)15.94 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:534.04 (+19.01%)2.87 (-1.50%)2.89 (-8.88%)1.86 (-13.74%)0.78 (+69.49%)262.00 (+15.93%)183.40 (+6.50%)169.00 (+9.74%)121.00 (-15.97%)50.88 (+66.66%)
d9a64c5 — 2025-11-21 20:49:353.39 (n/a)2.92 (n/a)3.17 (n/a)2.16 (n/a)0.46 (n/a)226.00 (n/a)172.20 (n/a)154.00 (n/a)144.00 (n/a)30.53 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.08 (-23.33%)0.07 (-20.11%)0.07 (-20.57%)0.06 (-20.92%)0.01 (-32.13%)196.00 (+26.45%)172.60 (+24.89%)175.00 (+25.90%)150.00 (+30.43%)15.11 (+13.44%)
d9a64c5 — 2025-11-21 20:49:350.10 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)155.00 (n/a)138.20 (n/a)139.00 (n/a)115.00 (n/a)13.32 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.08 (-17.02%)0.07 (-16.39%)0.07 (-15.06%)0.06 (-20.40%)0.01 (-5.71%)201.00 (+25.62%)163.60 (+20.12%)166.00 (+17.73%)141.00 (+20.51%)22.16 (+41.70%)
d9a64c5 — 2025-11-21 20:49:350.10 (n/a)0.09 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)160.00 (n/a)136.20 (n/a)141.00 (n/a)117.00 (n/a)15.64 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (-9.32%)0.07 (+0.81%)0.07 (-4.79%)0.06 (+24.75%)0.01 (-57.59%)198.00 (-19.84%)174.80 (-4.06%)167.00 (+5.03%)161.00 (+10.27%)14.37 (-62.55%)
d9a64c5 — 2025-11-21 20:49:350.08 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)247.00 (n/a)182.20 (n/a)159.00 (n/a)146.00 (n/a)38.37 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f39e60a — 2025-11-21 22:58:530.07 (+2.48%)0.06 (+2.33%)0.06 (+7.03%)0.06 (+0.97%)0.01 (-8.23%)206.00 (-0.96%)184.20 (-2.44%)185.00 (-6.57%)161.00 (-2.42%)15.46 (-11.07%)
d9a64c5 — 2025-11-21 20:49:350.07 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.01 (n/a)208.00 (n/a)188.80 (n/a)198.00 (n/a)165.00 (n/a)17.38 (n/a)

@hunhoffe hunhoffe marked this pull request as ready for review November 22, 2025 01:47
@github-actions
Copy link
Copy Markdown
Contributor

📊 Test Results for Small Benchmark/Test Suite

2172566 (2025_11_22_02_20_25)

IRONCLAD

Tested on 2025_11_22_02_20_25 at commit 2172566.

Test Checks Latency (mean)Bandwidth (mean)GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0 ✅ 5/5 139.00 0.09 n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0 ✅ 5/5 154.40 0.08 n/a
axpy_4_cols_2_channels_2048_tile_512_3.0 ✅ 5/5 133.40 0.09 n/a
axpy_8_cols_2_channels_2048_tile_256_3.0 ✅ 5/5 160.00 0.07 n/a
dequant_1_cols_1_channels_2048_tile_2048 ✅ 5/5 142.40 0.03 n/a
dequant_1_cols_2_channels_2048_tile_1024 ✅ 5/5 141.20 0.04 n/a
dequant_2_cols_1_channels_2048_tile_1024 ✅ 5/5 119.00 0.04 n/a
dequant_2_cols_2_channels_2048_tile_512 ✅ 5/5 133.20 0.04 n/a
dequant_4_cols_1_channels_2048_tile_512 ✅ 5/5 142.80 0.03 n/a
dequant_4_cols_2_channels_2048_tile_256 ✅ 5/5 178.40 0.03 n/a
dequant_8_cols_1_channels_2048_tile_256 ✅ 5/5 168.00 0.03 n/a
dequant_8_cols_2_channels_2048_tile_128 ✅ 5/5 214.60 0.02 n/a
eltwise_add_1_cols_2_channels_2048_tile_2048 ✅ 5/5 148.40 0.08 n/a
eltwise_add_2_cols_2_channels_2048_tile_1024 ✅ 5/5 139.60 0.08 n/a
eltwise_add_4_cols_2_channels_2048_tile_512 ✅ 5/5 124.60 0.09 n/a
eltwise_add_8_cols_2_channels_2048_tile_256 ✅ 5/5 158.00 0.07 n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048 ✅ 5/5 153.40 0.07 n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024 ✅ 5/5 132.20 0.09 n/a
eltwise_mul_4_cols_2_channels_2048_tile_512 ✅ 5/5 167.80 0.07 n/a
eltwise_mul_8_cols_2_channels_2048_tile_256 ✅ 5/5 207.00 0.06 n/a
gelu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 169.80 0.05 n/a
gelu_1_cols_2_channels_2048_tile_1024 ✅ 5/5 147.60 0.06 n/a
gelu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 146.20 0.06 n/a
gelu_2_cols_2_channels_2048_tile_512 ✅ 5/5 169.00 0.05 n/a
gelu_4_cols_1_channels_2048_tile_512 ✅ 5/5 166.00 0.05 n/a
gelu_4_cols_2_channels_2048_tile_256 ✅ 5/5 152.00 0.06 n/a
gelu_8_cols_1_channels_2048_tile_256 ✅ 5/5 153.40 0.05 n/a
gelu_8_cols_2_channels_2048_tile_128 ✅ 5/5 171.80 0.05 n/a
gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0 ✅ 5/5 6566.80 3.57 2617.22
layer_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 239.00 0.06 n/a
layer_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 175.00 0.07 n/a
layer_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 169.60 0.07 n/a
layer_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 151.40 0.08 n/a
layer_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 161.40 0.08 n/a
layer_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 224.40 0.06 n/a
layer_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 224.00 0.06 n/a
layer_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 220.40 0.06 n/a
matrix_vector_mul_128x128_32_1col ✅ 5/5 737.40 0.05 0.04
matrix_vector_mul_2048x8192_1_1col ✅ 5/5 3138.40 10.71 10.71
matrix_vector_mul_2048x8192_1_2col ✅ 5/5 2054.00 16.36 16.35
matrix_vector_mul_2048x8192_1_4col ✅ 5/5 1868.60 17.97 17.96
matrix_vector_mul_2048x8192_1_8col ✅ 5/5 2007.40 16.82 16.81
matrix_vector_mul_8192x2048_4_1col ✅ 5/5 3082.80 10.89 10.89
matrix_vector_mul_8192x2048_4_2col ✅ 5/5 2021.00 16.64 16.63
matrix_vector_mul_8192x2048_4_4col ✅ 5/5 1734.20 19.46 19.45
matrix_vector_mul_8192x2048_4_8col ✅ 5/5 2166.40 15.71 15.70
mem_copy_16_cores_2_chans_2048_tile_128_False ✅ 5/5 208.20 0.04 n/a
mem_copy_1_cores_1_chans_2048_tile_2048_False ✅ 5/5 176.00 0.04 n/a
mem_copy_2_cores_1_chans_2048_tile_1024_False ✅ 5/5 167.60 0.05 n/a
mem_copy_2_cores_2_chans_2048_tile_1024_False ✅ 5/5 172.40 0.04 n/a
mem_copy_4_cores_1_chans_2048_tile_512_False ✅ 5/5 193.20 0.04 n/a
mem_copy_4_cores_2_chans_2048_tile_512_False ✅ 5/5 154.00 0.05 n/a
mem_copy_8_cores_1_chans_2048_tile_256_False ✅ 5/5 205.60 0.04 n/a
mem_copy_8_cores_2_chans_2048_tile_256_False ✅ 5/5 159.80 0.05 n/a
mha ✅ 5/5 n/a 1.48 758.09
relu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 177.60 0.04 n/a
relu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 155.00 0.05 n/a
relu_4_cols_1_channels_2048_tile_512 ✅ 5/5 180.20 0.04 n/a
relu_8_cols_1_channels_2048_tile_256 ✅ 5/5 174.40 0.04 n/a
rms_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 177.80 0.06 n/a
rms_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 177.00 0.07 n/a
rms_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 174.80 0.07 n/a
rms_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 151.20 0.08 n/a
rms_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 138.80 0.08 n/a
rms_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 141.20 0.08 n/a
rms_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 157.40 0.08 n/a
rms_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 207.40 0.06 n/a
rope_1_cols_2_channels_4096_tile_4096_0 ✅ 5/5 124.80 0.18 n/a
rope_2_cols_2_channels_4096_tile_2048_0 ✅ 5/5 131.80 0.18 n/a
rope_4_cols_2_channels_4096_tile_1024_0 ✅ 5/5 197.40 0.12 n/a
rope_8_cols_2_channels_4096_tile_512_0 ✅ 5/5 148.60 0.16 n/a
sigmoid_1_cols_1_channels_2048_tile_2048 ✅ 5/5 189.00 0.04 n/a
sigmoid_2_cols_1_channels_2048_tile_1024 ✅ 5/5 152.80 0.05 n/a
sigmoid_4_cols_1_channels_2048_tile_512 ✅ 5/5 148.00 0.05 n/a
sigmoid_8_cols_1_channels_2048_tile_256 ✅ 5/5 175.20 0.05 n/a
silu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 175.60 0.05 n/a
silu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 141.00 0.06 n/a
silu_4_cols_1_channels_2048_tile_512 ✅ 5/5 174.80 0.05 n/a
silu_8_cols_1_channels_2048_tile_256 ✅ 5/5 172.20 0.05 n/a
softmax_1_cols_2_channels_4096_tile_2048 ✅ 5/5 176.40 0.13 n/a
softmax_2_cols_2_channels_4096_tile_1024 ✅ 5/5 161.80 0.15 n/a
softmax_2_cols_2_channels_4096_tile_512 ✅ 5/5 151.20 0.15 n/a
swiglu ✅ 5/5 n/a n/a n/a
tanh_1_cols_1_channels_2048_tile_2048 ✅ 5/5 175.60 0.05 n/a
tanh_2_cols_1_channels_2048_tile_1024 ✅ 5/5 167.60 0.05 n/a
tanh_4_cols_1_channels_2048_tile_512 ✅ 5/5 143.00 0.05 n/a
tanh_8_cols_1_channels_2048_tile_256 ✅ 5/5 179.20 0.04 n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s ✅ 5/5 188.60 2.63 n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s ✅ 5/5 161.60 3.05 n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048 ✅ 5/5 155.20 0.07 n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024 ✅ 5/5 175.80 0.07 n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512 ✅ 5/5 217.20 0.06 n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256 ✅ 5/5 164.20 0.07 n/a
📈 Trends (vs main branch) for Small Benchmark/Test Suite

2172566 (2025_11_22_02_20_25)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.12 (+17.53%)0.09 (+23.93%)0.08 (+4.64%)0.07 (+63.35%)0.02 (-10.44%)161.00 (-38.78%)139.00 (-22.95%)151.00 (-4.43%)97.00 (-14.91%)23.50 (-54.37%)
31ab24e — 2025-11-22 02:01:560.10 (n/a)0.07 (n/a)0.07 (n/a)0.04 (n/a)0.02 (n/a)263.00 (n/a)180.40 (n/a)158.00 (n/a)114.00 (n/a)51.51 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.11 (-6.86%)0.08 (+2.89%)0.07 (-4.97%)0.06 (+49.73%)0.02 (-30.11%)187.00 (-33.21%)154.40 (-9.92%)161.00 (+5.23%)102.00 (+7.37%)29.25 (-52.06%)
31ab24e — 2025-11-22 02:01:560.12 (n/a)0.08 (n/a)0.07 (n/a)0.04 (n/a)0.03 (n/a)280.00 (n/a)171.40 (n/a)153.00 (n/a)95.00 (n/a)61.01 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.10 (+22.03%)0.09 (+29.20%)0.09 (+22.31%)0.07 (+64.24%)0.01 (-25.10%)165.00 (-39.11%)133.40 (-25.56%)130.00 (-18.24%)118.00 (-18.06%)17.27 (-63.49%)
31ab24e — 2025-11-22 02:01:560.08 (n/a)0.07 (n/a)0.07 (n/a)0.04 (n/a)0.01 (n/a)271.00 (n/a)179.20 (n/a)159.00 (n/a)144.00 (n/a)47.30 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.08 (-21.48%)0.07 (-2.46%)0.08 (+13.16%)0.06 (+12.99%)0.01 (-66.78%)177.00 (-11.50%)160.00 (-0.99%)152.00 (-11.63%)149.00 (+27.35%)11.63 (-62.40%)
31ab24e — 2025-11-22 02:01:560.10 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.02 (n/a)200.00 (n/a)161.60 (n/a)172.00 (n/a)117.00 (n/a)30.92 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.04 (-4.13%)0.03 (+1.41%)0.03 (-5.59%)0.03 (+31.76%)0.00 (-37.70%)170.00 (-24.11%)142.40 (-5.07%)143.00 (+5.93%)121.00 (+4.31%)18.40 (-52.77%)
31ab24e — 2025-11-22 02:01:560.04 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)224.00 (n/a)150.00 (n/a)135.00 (n/a)116.00 (n/a)38.96 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.04 (+7.96%)0.04 (+3.11%)0.03 (-9.40%)0.03 (+50.32%)0.00 (-37.70%)155.00 (-33.48%)141.20 (-7.11%)149.00 (+10.37%)113.00 (-7.38%)15.37 (-62.88%)
31ab24e — 2025-11-22 02:01:560.04 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)233.00 (n/a)152.00 (n/a)135.00 (n/a)122.00 (n/a)41.40 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.05 (+29.79%)0.04 (+15.96%)0.04 (+0.00%)0.04 (+26.09%)0.01 (+18.61%)138.00 (-20.69%)119.00 (-14.02%)124.00 (+0.00%)94.00 (-22.95%)14.51 (-28.24%)
31ab24e — 2025-11-22 02:01:560.04 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.00 (n/a)174.00 (n/a)138.40 (n/a)124.00 (n/a)122.00 (n/a)20.21 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.05 (+17.02%)0.04 (-5.79%)0.03 (-13.89%)0.03 (-16.34%)0.01 (+234.93%)153.00 (+19.53%)133.20 (+9.18%)144.00 (+16.13%)94.00 (-14.55%)21.10 (+238.80%)
31ab24e — 2025-11-22 02:01:560.04 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)128.00 (n/a)122.00 (n/a)124.00 (n/a)110.00 (n/a)6.23 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.04 (-9.38%)0.03 (+6.96%)0.03 (+13.89%)0.03 (+51.27%)0.00 (-67.76%)158.00 (-33.89%)142.80 (-12.07%)144.00 (-12.20%)128.00 (+10.34%)10.50 (-76.09%)
31ab24e — 2025-11-22 02:01:560.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)239.00 (n/a)162.40 (n/a)164.00 (n/a)116.00 (n/a)43.89 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.03 (-2.72%)0.03 (-12.15%)0.03 (-0.67%)0.02 (-32.80%)0.01 (+197.72%)250.00 (+48.81%)178.40 (+18.46%)150.00 (+0.67%)147.00 (+2.80%)40.00 (+342.19%)
31ab24e — 2025-11-22 02:01:560.03 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)168.00 (n/a)150.60 (n/a)149.00 (n/a)143.00 (n/a)9.05 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.03 (-20.00%)0.03 (-11.69%)0.03 (-8.81%)0.02 (-11.17%)0.00 (-39.83%)206.00 (+12.57%)168.00 (+11.85%)159.00 (+9.66%)150.00 (+25.00%)20.27 (-15.24%)
31ab24e — 2025-11-22 02:01:560.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)183.00 (n/a)150.20 (n/a)145.00 (n/a)120.00 (n/a)23.91 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.03 (-13.48%)0.02 (-17.98%)0.02 (-21.33%)0.02 (-17.62%)0.00 (-18.87%)261.00 (+21.40%)214.60 (+21.79%)211.00 (+27.11%)178.00 (+15.58%)26.57 (+15.73%)
31ab24e — 2025-11-22 02:01:560.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)215.00 (n/a)176.20 (n/a)166.00 (n/a)154.00 (n/a)22.96 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.08 (+0.00%)0.08 (-2.36%)0.08 (-4.73%)0.07 (-2.47%)0.00 (+9.58%)162.00 (+2.53%)148.40 (+2.49%)148.00 (+4.96%)136.00 (+0.00%)9.07 (+12.17%)
31ab24e — 2025-11-22 02:01:560.08 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.00 (n/a)158.00 (n/a)144.80 (n/a)141.00 (n/a)136.00 (n/a)8.08 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.09 (+2.48%)0.08 (+3.09%)0.08 (+0.00%)0.07 (+35.00%)0.01 (-38.93%)160.00 (-25.93%)139.60 (-5.93%)137.00 (+0.00%)121.00 (-2.42%)14.88 (-56.73%)
31ab24e — 2025-11-22 02:01:560.09 (n/a)0.08 (n/a)0.08 (n/a)0.05 (n/a)0.01 (n/a)216.00 (n/a)148.40 (n/a)137.00 (n/a)124.00 (n/a)34.39 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.12 (+11.96%)0.09 (+4.18%)0.09 (-1.56%)0.08 (+20.39%)0.02 (+0.33%)152.00 (-16.94%)124.60 (-5.03%)128.00 (+1.59%)92.00 (-10.68%)20.93 (-26.60%)
31ab24e — 2025-11-22 02:01:560.11 (n/a)0.09 (n/a)0.09 (n/a)0.06 (n/a)0.02 (n/a)183.00 (n/a)131.20 (n/a)126.00 (n/a)103.00 (n/a)28.52 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.09 (+2.24%)0.07 (+7.95%)0.07 (-5.81%)0.06 (+80.21%)0.01 (-57.21%)187.00 (-44.51%)158.00 (-16.14%)155.00 (+6.16%)134.00 (-2.19%)17.01 (-77.46%)
31ab24e — 2025-11-22 02:01:560.08 (n/a)0.07 (n/a)0.08 (n/a)0.03 (n/a)0.02 (n/a)337.00 (n/a)188.40 (n/a)146.00 (n/a)137.00 (n/a)75.46 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.08 (-5.04%)0.07 (-2.92%)0.08 (+0.00%)0.07 (-8.19%)0.00 (+1.66%)171.00 (+8.92%)153.40 (+3.09%)151.00 (+0.00%)139.00 (+5.30%)10.40 (+18.90%)
31ab24e — 2025-11-22 02:01:560.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.00 (n/a)157.00 (n/a)148.80 (n/a)151.00 (n/a)132.00 (n/a)8.75 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.09 (-0.81%)0.09 (+25.16%)0.09 (+33.59%)0.08 (+55.07%)0.00 (-75.01%)138.00 (-35.51%)132.20 (-22.69%)131.00 (-25.14%)124.00 (+0.81%)5.04 (-83.38%)
31ab24e — 2025-11-22 02:01:560.09 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)214.00 (n/a)171.00 (n/a)175.00 (n/a)123.00 (n/a)30.30 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.07 (-33.97%)0.07 (-25.40%)0.07 (-31.18%)0.06 (-9.55%)0.00 (-77.45%)178.00 (+10.56%)167.80 (+30.89%)170.00 (+45.30%)156.00 (+51.46%)7.86 (-62.83%)
31ab24e — 2025-11-22 02:01:560.11 (n/a)0.09 (n/a)0.10 (n/a)0.07 (n/a)0.01 (n/a)161.00 (n/a)128.20 (n/a)117.00 (n/a)103.00 (n/a)21.14 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.07 (+6.17%)0.06 (-6.42%)0.07 (+4.73%)0.03 (-50.14%)0.01 (+1218.15%)361.00 (+100.56%)207.00 (+17.35%)169.00 (-4.52%)162.00 (-5.81%)77.16 (+2466.20%)
31ab24e — 2025-11-22 02:01:560.07 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.00 (n/a)180.00 (n/a)176.40 (n/a)177.00 (n/a)172.00 (n/a)3.01 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (-6.82%)0.05 (-6.02%)0.05 (-2.48%)0.04 (+4.05%)0.01 (-4.57%)222.00 (-3.90%)169.80 (+5.99%)161.00 (+2.55%)132.00 (+7.32%)36.60 (-4.75%)
31ab24e — 2025-11-22 02:01:560.07 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)231.00 (n/a)160.20 (n/a)157.00 (n/a)123.00 (n/a)38.42 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.07 (-9.76%)0.06 (-10.71%)0.07 (-4.84%)0.04 (-25.68%)0.01 (+25.50%)222.00 (+34.55%)147.60 (+15.31%)124.00 (+5.08%)123.00 (+10.81%)38.11 (+88.20%)
31ab24e — 2025-11-22 02:01:560.07 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)165.00 (n/a)128.00 (n/a)118.00 (n/a)111.00 (n/a)20.25 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.07 (-6.50%)0.06 (+1.05%)0.06 (+11.59%)0.05 (+17.26%)0.01 (-39.12%)168.00 (-14.72%)146.20 (-3.56%)138.00 (-10.39%)123.00 (+6.96%)17.76 (-41.59%)
31ab24e — 2025-11-22 02:01:560.07 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)197.00 (n/a)151.60 (n/a)154.00 (n/a)115.00 (n/a)30.40 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (-8.45%)0.05 (-11.80%)0.05 (-25.42%)0.04 (+0.52%)0.01 (-28.08%)194.00 (-0.51%)169.00 (+12.07%)177.00 (+34.09%)142.00 (+9.23%)20.77 (-20.74%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)195.00 (n/a)150.80 (n/a)132.00 (n/a)130.00 (n/a)26.21 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (+11.63%)0.05 (+9.81%)0.06 (+13.04%)0.03 (-5.71%)0.01 (+36.44%)280.00 (+6.06%)166.00 (-5.68%)138.00 (-11.54%)129.00 (-10.42%)57.33 (+29.18%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)264.00 (n/a)176.00 (n/a)156.00 (n/a)144.00 (n/a)44.38 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (+9.30%)0.06 (+18.34%)0.06 (+9.03%)0.04 (+83.50%)0.01 (-39.07%)200.00 (-45.50%)152.00 (-23.39%)144.00 (-8.28%)129.00 (-8.51%)24.91 (-70.63%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.05 (n/a)0.05 (n/a)0.02 (n/a)0.01 (n/a)367.00 (n/a)198.40 (n/a)157.00 (n/a)141.00 (n/a)84.80 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (-9.09%)0.05 (+7.30%)0.06 (+8.78%)0.04 (+9.60%)0.01 (-25.17%)198.00 (-8.76%)153.40 (-8.25%)148.00 (-8.07%)132.00 (+10.00%)24.08 (-24.16%)
31ab24e — 2025-11-22 02:01:560.07 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)217.00 (n/a)167.20 (n/a)161.00 (n/a)120.00 (n/a)31.75 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (-4.41%)0.05 (+0.62%)0.05 (+7.83%)0.04 (-6.37%)0.01 (+1.28%)204.00 (+6.81%)171.80 (-0.23%)166.00 (-7.26%)136.00 (+4.62%)25.77 (+19.06%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)191.00 (n/a)172.20 (n/a)179.00 (n/a)130.00 (n/a)21.65 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:343.66 (+0.23%)3.57 (-0.57%)3.57 (-1.58%)3.49 (+1.10%)0.07 (-2.72%)2684.35 (+0.23%)2617.22 (-0.57%)2616.49 (-1.58%)2556.15 (+1.10%)52.39 (-2.73%)6721.00 (-1.09%)6566.80 (+0.57%)6566.00 (+1.61%)6400.00 (-0.23%)131.36 (-4.22%)
31ab24e — 2025-11-22 02:01:563.65 (n/a)3.59 (n/a)3.63 (n/a)3.45 (n/a)0.07 (n/a)2678.08 (n/a)2632.13 (n/a)2658.60 (n/a)2528.31 (n/a)53.86 (n/a)6795.00 (n/a)6529.80 (n/a)6462.00 (n/a)6415.00 (n/a)137.14 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.08 (-16.03%)0.06 (-16.60%)0.07 (-4.89%)0.04 (-33.62%)0.02 (+28.82%)345.00 (+50.66%)239.00 (+29.61%)184.00 (+5.14%)156.00 (+19.08%)83.80 (+143.22%)
31ab24e — 2025-11-22 02:01:560.09 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)229.00 (n/a)184.40 (n/a)175.00 (n/a)131.00 (n/a)34.45 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.09 (+14.07%)0.07 (+10.97%)0.07 (+2.40%)0.05 (+20.63%)0.02 (+12.09%)252.00 (-17.11%)175.00 (-10.62%)167.00 (-2.34%)135.00 (-12.34%)43.16 (-22.51%)
31ab24e — 2025-11-22 02:01:560.08 (n/a)0.07 (n/a)0.07 (n/a)0.04 (n/a)0.01 (n/a)304.00 (n/a)195.80 (n/a)171.00 (n/a)154.00 (n/a)55.70 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.08 (-8.78%)0.07 (+0.66%)0.08 (+3.90%)0.05 (-2.97%)0.01 (-5.03%)236.00 (+3.06%)169.60 (-0.59%)154.00 (-3.75%)148.00 (+9.63%)33.31 (+6.34%)
31ab24e — 2025-11-22 02:01:560.09 (n/a)0.07 (n/a)0.08 (n/a)0.05 (n/a)0.01 (n/a)229.00 (n/a)170.60 (n/a)160.00 (n/a)135.00 (n/a)31.32 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.10 (+0.00%)0.08 (-3.02%)0.08 (-1.97%)0.07 (+1.78%)0.01 (+1.33%)169.00 (-1.74%)151.40 (+3.13%)152.00 (+2.01%)118.00 (+0.00%)18.27 (-0.64%)
31ab24e — 2025-11-22 02:01:560.10 (n/a)0.09 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)172.00 (n/a)146.80 (n/a)149.00 (n/a)118.00 (n/a)18.39 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.08 (-12.08%)0.08 (+11.45%)0.08 (+2.50%)0.07 (+111.17%)0.00 (-80.77%)179.00 (-52.65%)161.40 (-23.22%)160.00 (-2.44%)149.00 (+13.74%)9.97 (-89.28%)
31ab24e — 2025-11-22 02:01:560.09 (n/a)0.07 (n/a)0.07 (n/a)0.03 (n/a)0.02 (n/a)378.00 (n/a)210.20 (n/a)164.00 (n/a)131.00 (n/a)93.05 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.08 (-2.72%)0.06 (-19.91%)0.05 (-41.50%)0.04 (+8.28%)0.02 (-11.66%)290.00 (-7.64%)224.40 (+21.82%)253.00 (+70.95%)147.00 (+2.80%)53.18 (-18.93%)
31ab24e — 2025-11-22 02:01:560.09 (n/a)0.07 (n/a)0.08 (n/a)0.04 (n/a)0.02 (n/a)314.00 (n/a)184.20 (n/a)148.00 (n/a)143.00 (n/a)65.60 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.07 (-12.50%)0.06 (-20.61%)0.06 (-19.72%)0.04 (-38.14%)0.01 (+100.43%)312.00 (+61.66%)224.00 (+29.78%)213.00 (+24.56%)184.00 (+14.29%)45.74 (+284.62%)
31ab24e — 2025-11-22 02:01:560.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.00 (n/a)193.00 (n/a)172.60 (n/a)171.00 (n/a)161.00 (n/a)11.89 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (-25.52%)0.06 (-26.16%)0.06 (-26.11%)0.04 (-23.05%)0.01 (-28.12%)282.00 (+29.95%)220.40 (+35.05%)203.00 (+35.33%)192.00 (+34.27%)33.59 (+22.54%)
31ab24e — 2025-11-22 02:01:560.09 (n/a)0.08 (n/a)0.08 (n/a)0.06 (n/a)0.01 (n/a)217.00 (n/a)163.20 (n/a)150.00 (n/a)143.00 (n/a)27.41 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.05 (-14.37%)0.05 (-1.50%)0.04 (-3.32%)0.04 (+13.95%)0.00 (-74.36%)0.05 (-14.37%)0.04 (-1.50%)0.04 (-3.32%)0.04 (+13.95%)0.00 (-74.36%)760.00 (-12.24%)737.40 (+0.05%)754.00 (+3.43%)703.00 (+16.78%)23.93 (-73.67%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)866.00 (n/a)737.00 (n/a)729.00 (n/a)602.00 (n/a)90.88 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:3410.97 (-1.90%)10.71 (+0.02%)10.92 (-0.85%)9.90 (+6.04%)0.41 (-40.72%)10.97 (-1.90%)10.71 (+0.02%)10.91 (-0.85%)9.89 (+6.04%)0.41 (-40.72%)3393.00 (-5.70%)3138.40 (-0.33%)3076.00 (+0.85%)3060.00 (+1.93%)127.66 (-43.34%)
31ab24e — 2025-11-22 02:01:5611.18 (n/a)10.71 (n/a)11.01 (n/a)9.33 (n/a)0.69 (n/a)11.18 (n/a)10.71 (n/a)11.00 (n/a)9.33 (n/a)0.69 (n/a)3598.00 (n/a)3148.80 (n/a)3050.00 (n/a)3002.00 (n/a)225.32 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:3417.03 (-2.69%)16.36 (-4.00%)16.35 (-5.41%)15.55 (-3.71%)0.55 (+7.52%)17.02 (-2.69%)16.35 (-4.00%)16.34 (-5.41%)15.54 (-3.71%)0.55 (+7.52%)2159.00 (+3.85%)2054.00 (+4.19%)2053.00 (+5.72%)1971.00 (+2.76%)69.08 (+14.52%)
31ab24e — 2025-11-22 02:01:5617.51 (n/a)17.05 (n/a)17.29 (n/a)16.15 (n/a)0.51 (n/a)17.49 (n/a)17.04 (n/a)17.28 (n/a)16.14 (n/a)0.51 (n/a)2079.00 (n/a)1971.40 (n/a)1942.00 (n/a)1918.00 (n/a)60.32 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:3418.30 (-1.31%)17.97 (-1.89%)17.93 (-2.24%)17.60 (-2.20%)0.27 (+46.96%)18.29 (-1.31%)17.96 (-1.89%)17.91 (-2.24%)17.59 (-2.20%)0.27 (+46.94%)1908.00 (+2.25%)1868.60 (+1.94%)1873.00 (+2.29%)1835.00 (+1.33%)27.77 (+51.61%)
31ab24e — 2025-11-22 02:01:5618.54 (n/a)18.32 (n/a)18.34 (n/a)17.99 (n/a)0.18 (n/a)18.53 (n/a)18.31 (n/a)18.33 (n/a)17.98 (n/a)0.18 (n/a)1866.00 (n/a)1833.00 (n/a)1831.00 (n/a)1811.00 (n/a)18.32 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:3418.85 (+18.70%)16.82 (+13.54%)16.05 (+5.11%)15.67 (+14.47%)1.26 (+47.17%)18.84 (+18.70%)16.81 (+13.54%)16.04 (+5.11%)15.66 (+14.47%)1.26 (+47.16%)2143.00 (-12.64%)2007.40 (-11.75%)2092.00 (-4.87%)1781.00 (-15.75%)144.52 (+8.07%)
31ab24e — 2025-11-22 02:01:5615.88 (n/a)14.81 (n/a)15.27 (n/a)13.69 (n/a)0.86 (n/a)15.87 (n/a)14.80 (n/a)15.26 (n/a)13.68 (n/a)0.86 (n/a)2453.00 (n/a)2274.60 (n/a)2199.00 (n/a)2114.00 (n/a)133.73 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:3410.97 (-0.23%)10.89 (+0.36%)10.94 (+0.98%)10.70 (+0.10%)0.10 (-7.83%)10.96 (-0.23%)10.89 (+0.36%)10.93 (+0.98%)10.69 (+0.10%)0.10 (-7.80%)3138.00 (-0.10%)3082.80 (-0.36%)3069.00 (-0.97%)3061.00 (+0.23%)28.29 (-7.51%)
31ab24e — 2025-11-22 02:01:5610.99 (n/a)10.85 (n/a)10.83 (n/a)10.69 (n/a)0.11 (n/a)10.99 (n/a)10.85 (n/a)10.83 (n/a)10.68 (n/a)0.11 (n/a)3141.00 (n/a)3093.80 (n/a)3099.00 (n/a)3054.00 (n/a)30.59 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:3417.23 (+6.21%)16.64 (+6.92%)16.94 (+7.82%)15.50 (+10.02%)0.62 (-20.04%)17.22 (+6.21%)16.63 (+6.92%)16.93 (+7.82%)15.49 (+10.02%)0.62 (-20.03%)2166.00 (-9.11%)2021.00 (-6.58%)1982.00 (-7.25%)1949.00 (-5.85%)78.08 (-31.67%)
31ab24e — 2025-11-22 02:01:5616.22 (n/a)15.56 (n/a)15.71 (n/a)14.09 (n/a)0.77 (n/a)16.21 (n/a)15.55 (n/a)15.70 (n/a)14.08 (n/a)0.77 (n/a)2383.00 (n/a)2163.40 (n/a)2137.00 (n/a)2070.00 (n/a)114.27 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:3421.68 (+10.85%)19.46 (+10.20%)18.72 (+3.01%)18.07 (+26.48%)1.40 (-21.16%)21.66 (+10.85%)19.45 (+10.20%)18.70 (+3.01%)18.06 (+26.48%)1.40 (-21.16%)1858.00 (-20.94%)1734.20 (-9.85%)1794.00 (-2.92%)1549.00 (-9.78%)120.67 (-45.19%)
31ab24e — 2025-11-22 02:01:5619.55 (n/a)17.66 (n/a)18.17 (n/a)14.29 (n/a)1.78 (n/a)19.54 (n/a)17.65 (n/a)18.16 (n/a)14.28 (n/a)1.78 (n/a)2350.00 (n/a)1923.60 (n/a)1848.00 (n/a)1717.00 (n/a)220.16 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:3418.67 (+5.01%)15.71 (-2.47%)14.80 (-6.31%)13.51 (-6.44%)1.85 (+44.39%)18.66 (+5.01%)15.70 (-2.47%)14.79 (-6.31%)13.50 (-6.44%)1.85 (+44.39%)2485.00 (+6.88%)2166.40 (+3.25%)2268.00 (+6.73%)1798.00 (-4.77%)244.08 (+46.97%)
31ab24e — 2025-11-22 02:01:5617.78 (n/a)16.10 (n/a)15.80 (n/a)14.44 (n/a)1.28 (n/a)17.77 (n/a)16.09 (n/a)15.79 (n/a)14.43 (n/a)1.28 (n/a)2325.00 (n/a)2098.20 (n/a)2125.00 (n/a)1888.00 (n/a)166.07 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.04 (-25.27%)0.04 (-9.95%)0.04 (+0.48%)0.03 (-5.63%)0.00 (-54.03%)231.00 (+5.96%)208.20 (+8.78%)208.00 (-0.48%)182.00 (+33.82%)20.06 (-33.03%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)218.00 (n/a)191.40 (n/a)209.00 (n/a)136.00 (n/a)29.96 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (-16.99%)0.05 (-12.47%)0.05 (-7.32%)0.04 (-11.17%)0.00 (-29.61%)197.00 (+12.57%)171.00 (+13.70%)164.00 (+7.89%)153.00 (+20.47%)17.49 (-4.32%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)175.00 (n/a)150.40 (n/a)152.00 (n/a)127.00 (n/a)18.28 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (+5.56%)0.05 (-1.59%)0.05 (-1.39%)0.03 (-14.07%)0.01 (+25.03%)263.00 (+16.37%)166.00 (+4.53%)144.00 (+1.41%)126.00 (-5.26%)49.38 (+43.17%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)226.00 (n/a)158.80 (n/a)142.00 (n/a)133.00 (n/a)34.49 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.05 (-10.27%)0.04 (-5.43%)0.05 (-3.75%)0.03 (+14.93%)0.01 (-28.22%)221.00 (-12.99%)176.00 (+2.92%)160.00 (+3.90%)146.00 (+11.45%)29.60 (-32.54%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)254.00 (n/a)171.00 (n/a)154.00 (n/a)131.00 (n/a)43.88 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (-15.32%)0.05 (-17.09%)0.05 (-23.81%)0.04 (-15.54%)0.01 (-18.18%)193.00 (+18.40%)160.80 (+20.36%)168.00 (+31.25%)124.00 (+18.10%)22.92 (+11.39%)
0999a9a — 2025-11-13 19:24:080.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)163.00 (n/a)133.60 (n/a)128.00 (n/a)105.00 (n/a)20.58 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (-23.02%)0.05 (-6.98%)0.05 (-2.13%)0.04 (-15.31%)0.01 (-33.29%)196.00 (+18.07%)147.00 (+6.52%)141.00 (+2.17%)126.00 (+29.90%)25.27 (+8.13%)
0999a9a — 2025-11-13 19:24:080.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)166.00 (n/a)138.00 (n/a)138.00 (n/a)97.00 (n/a)23.37 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.05 (+5.63%)0.05 (+11.32%)0.05 (+3.73%)0.04 (+62.96%)0.01 (-38.24%)216.00 (-38.64%)167.60 (-16.70%)161.00 (-3.59%)142.00 (-5.33%)26.05 (-65.63%)
31ab24e — 2025-11-22 02:01:560.05 (n/a)0.04 (n/a)0.05 (n/a)0.02 (n/a)0.01 (n/a)352.00 (n/a)201.20 (n/a)167.00 (n/a)150.00 (n/a)75.80 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.05 (-12.10%)0.04 (-4.51%)0.05 (-1.20%)0.04 (-3.92%)0.00 (-31.51%)204.00 (+4.08%)172.40 (+4.11%)167.00 (+1.21%)157.00 (+13.77%)16.27 (-16.75%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)196.00 (n/a)165.60 (n/a)165.00 (n/a)138.00 (n/a)19.54 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.07 (+11.97%)0.05 (+3.09%)0.05 (+2.10%)0.03 (-11.35%)0.01 (+41.65%)229.00 (+12.81%)156.00 (-0.51%)143.00 (-2.05%)117.00 (-10.69%)38.21 (+48.71%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)203.00 (n/a)156.80 (n/a)146.00 (n/a)131.00 (n/a)25.69 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (+9.02%)0.05 (+5.59%)0.05 (+0.00%)0.04 (+3.63%)0.01 (+25.48%)193.00 (-3.50%)147.40 (-4.66%)147.00 (+0.00%)122.00 (-8.27%)25.24 (+7.48%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)154.60 (n/a)147.00 (n/a)133.00 (n/a)23.48 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.05 (+14.18%)0.04 (-3.26%)0.04 (-2.59%)0.03 (-23.48%)0.01 (+197.52%)247.00 (+30.69%)193.20 (+8.54%)193.00 (+2.66%)141.00 (-12.42%)44.18 (+237.68%)
31ab24e — 2025-11-22 02:01:560.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)189.00 (n/a)178.00 (n/a)188.00 (n/a)161.00 (n/a)13.08 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (+15.57%)0.05 (+27.20%)0.05 (+16.67%)0.04 (+47.57%)0.01 (-2.91%)185.00 (-32.23%)154.00 (-23.08%)162.00 (-14.29%)122.00 (-13.48%)24.84 (-44.42%)
31ab24e — 2025-11-22 02:01:560.05 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)273.00 (n/a)200.20 (n/a)189.00 (n/a)141.00 (n/a)44.70 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (-13.48%)0.05 (-17.79%)0.05 (-15.33%)0.03 (-25.09%)0.01 (+6.67%)267.00 (+33.50%)176.80 (+24.51%)150.00 (+18.11%)141.00 (+15.57%)47.41 (+61.41%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)142.00 (n/a)127.00 (n/a)122.00 (n/a)29.37 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (+13.38%)0.05 (+23.85%)0.05 (+37.91%)0.05 (+30.72%)0.00 (-56.85%)166.00 (-23.50%)153.40 (-20.60%)153.00 (-27.49%)142.00 (-11.80%)7.63 (-70.60%)
0999a9a — 2025-11-13 19:24:080.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)217.00 (n/a)193.20 (n/a)211.00 (n/a)161.00 (n/a)25.96 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.05 (+7.50%)0.04 (-3.04%)0.04 (+5.29%)0.03 (-31.06%)0.01 (+191.25%)293.00 (+45.05%)205.60 (+7.08%)189.00 (-5.03%)160.00 (-6.98%)45.77 (+313.01%)
31ab24e — 2025-11-22 02:01:560.04 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)202.00 (n/a)192.00 (n/a)199.00 (n/a)172.00 (n/a)11.08 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (+19.20%)0.05 (+33.46%)0.05 (+45.81%)0.04 (+40.00%)0.01 (-15.38%)195.00 (-28.57%)159.80 (-27.23%)155.00 (-31.42%)125.00 (-16.11%)23.34 (-50.18%)
31ab24e — 2025-11-22 02:01:560.05 (n/a)0.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)273.00 (n/a)219.60 (n/a)226.00 (n/a)149.00 (n/a)46.86 (n/a)

mha

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)
2172566 — 2025-11-22 02:19:341.48 (-0.05%)1.48 (+0.03%)1.48 (+0.11%)1.47 (-0.20%)0.00 (+42.36%)759.41 (-0.05%)758.09 (+0.03%)758.62 (+0.11%)754.97 (-0.20%)1.61 (+42.49%)
31ab24e — 2025-11-22 02:01:561.48 (n/a)1.48 (n/a)1.48 (n/a)1.48 (n/a)0.00 (n/a)759.78 (n/a)757.85 (n/a)757.77 (n/a)756.49 (n/a)1.13 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.05 (-9.94%)0.04 (+7.86%)0.05 (+14.29%)0.03 (+34.84%)0.00 (-54.57%)221.00 (-25.84%)177.60 (-12.43%)168.00 (-12.50%)161.00 (+11.03%)21.94 (-60.83%)
31ab24e — 2025-11-22 02:01:560.05 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)298.00 (n/a)202.80 (n/a)192.00 (n/a)145.00 (n/a)56.01 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.07 (-3.57%)0.05 (-8.77%)0.05 (-8.86%)0.04 (-10.99%)0.01 (-2.82%)191.00 (+12.35%)155.00 (+9.77%)158.00 (+9.72%)112.00 (+3.70%)25.53 (+9.06%)
31ab24e — 2025-11-22 02:01:560.07 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)170.00 (n/a)141.20 (n/a)144.00 (n/a)108.00 (n/a)23.41 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.05 (-16.97%)0.04 (-11.57%)0.04 (-11.05%)0.04 (-2.51%)0.00 (-44.96%)199.00 (+2.58%)180.20 (+12.06%)181.00 (+12.42%)165.00 (+20.44%)13.29 (-32.83%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)194.00 (n/a)160.80 (n/a)161.00 (n/a)137.00 (n/a)19.78 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (+13.97%)0.04 (-1.17%)0.04 (-10.17%)0.03 (-14.09%)0.01 (+70.90%)220.00 (+16.40%)174.40 (+2.83%)177.00 (+11.32%)136.00 (-12.26%)27.53 (+73.20%)
31ab24e — 2025-11-22 02:01:560.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)189.00 (n/a)169.60 (n/a)159.00 (n/a)155.00 (n/a)15.89 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.07 (-32.70%)0.06 (-24.03%)0.06 (-30.60%)0.06 (+13.44%)0.00 (-79.89%)186.00 (-11.85%)177.80 (+24.34%)183.00 (+44.09%)159.00 (+48.60%)9.87 (-73.97%)
31ab24e — 2025-11-22 02:01:560.11 (n/a)0.09 (n/a)0.09 (n/a)0.05 (n/a)0.02 (n/a)211.00 (n/a)143.00 (n/a)127.00 (n/a)107.00 (n/a)37.91 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.08 (-13.57%)0.07 (-14.75%)0.07 (-11.63%)0.05 (-21.30%)0.01 (+6.03%)216.00 (+27.06%)177.00 (+18.32%)172.00 (+13.16%)140.00 (+15.70%)25.63 (+60.10%)
31ab24e — 2025-11-22 02:01:560.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)170.00 (n/a)149.60 (n/a)152.00 (n/a)121.00 (n/a)16.01 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.09 (-5.30%)0.07 (-4.86%)0.08 (+5.63%)0.04 (-41.42%)0.02 (+89.66%)309.00 (+70.72%)174.80 (+14.40%)142.00 (-5.33%)132.00 (+5.60%)67.32 (+260.78%)
31ab24e — 2025-11-22 02:01:560.09 (n/a)0.08 (n/a)0.08 (n/a)0.06 (n/a)0.01 (n/a)181.00 (n/a)152.80 (n/a)150.00 (n/a)125.00 (n/a)18.66 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.09 (-8.87%)0.08 (-9.94%)0.09 (+0.78%)0.05 (-39.06%)0.02 (+122.96%)233.00 (+64.08%)151.20 (+16.67%)129.00 (-0.77%)124.00 (+9.73%)41.34 (+314.61%)
31ab24e — 2025-11-22 02:01:560.10 (n/a)0.09 (n/a)0.09 (n/a)0.08 (n/a)0.01 (n/a)142.00 (n/a)129.60 (n/a)130.00 (n/a)113.00 (n/a)9.97 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.09 (-1.61%)0.08 (-1.16%)0.09 (-0.75%)0.07 (-7.78%)0.01 (+23.23%)167.00 (+8.44%)138.80 (+1.61%)134.00 (+0.75%)124.00 (+1.64%)15.07 (+37.39%)
31ab24e — 2025-11-22 02:01:560.09 (n/a)0.08 (n/a)0.09 (n/a)0.07 (n/a)0.01 (n/a)154.00 (n/a)136.60 (n/a)133.00 (n/a)122.00 (n/a)10.97 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.09 (+3.79%)0.08 (+6.71%)0.08 (+4.86%)0.08 (+15.65%)0.00 (-46.15%)147.00 (-13.53%)141.20 (-6.74%)144.00 (-4.64%)132.00 (-3.65%)5.49 (-54.89%)
31ab24e — 2025-11-22 02:01:560.08 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)170.00 (n/a)151.40 (n/a)151.00 (n/a)137.00 (n/a)12.18 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.09 (+22.95%)0.08 (+13.48%)0.08 (+12.50%)0.06 (+23.86%)0.01 (+41.53%)197.00 (-19.26%)157.40 (-11.07%)144.00 (-11.11%)122.00 (-18.67%)31.51 (-7.60%)
31ab24e — 2025-11-22 02:01:560.08 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)244.00 (n/a)177.00 (n/a)162.00 (n/a)150.00 (n/a)34.11 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.08 (-0.69%)0.06 (-13.89%)0.06 (-10.67%)0.03 (-52.15%)0.02 (+243.99%)372.00 (+108.99%)207.40 (+29.46%)178.00 (+11.95%)145.00 (+0.69%)83.68 (+664.67%)
31ab24e — 2025-11-22 02:01:560.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.00 (n/a)178.00 (n/a)160.20 (n/a)159.00 (n/a)144.00 (n/a)10.94 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.22 (-0.95%)0.18 (+7.56%)0.18 (+12.10%)0.17 (+16.18%)0.02 (-32.88%)136.00 (-13.92%)124.80 (-8.24%)124.00 (-10.79%)105.00 (+0.96%)11.16 (-41.28%)
31ab24e — 2025-11-22 02:01:560.22 (n/a)0.17 (n/a)0.16 (n/a)0.14 (n/a)0.03 (n/a)158.00 (n/a)136.00 (n/a)139.00 (n/a)104.00 (n/a)19.01 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.20 (+11.30%)0.18 (+17.16%)0.18 (+23.62%)0.15 (+11.84%)0.02 (+4.56%)152.00 (-10.59%)131.80 (-14.75%)127.00 (-19.11%)115.00 (-10.16%)12.86 (-15.25%)
31ab24e — 2025-11-22 02:01:560.18 (n/a)0.15 (n/a)0.15 (n/a)0.13 (n/a)0.02 (n/a)170.00 (n/a)154.60 (n/a)157.00 (n/a)128.00 (n/a)15.17 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.18 (+5.56%)0.12 (-16.01%)0.11 (-20.98%)0.09 (-31.98%)0.03 (+157.70%)247.00 (+47.02%)197.40 (+26.21%)205.00 (+26.54%)126.00 (-5.26%)46.90 (+272.35%)
31ab24e — 2025-11-22 02:01:560.17 (n/a)0.15 (n/a)0.14 (n/a)0.14 (n/a)0.01 (n/a)168.00 (n/a)156.40 (n/a)162.00 (n/a)133.00 (n/a)12.60 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.17 (+19.08%)0.16 (+15.44%)0.16 (+13.10%)0.13 (+7.87%)0.02 (+58.90%)178.00 (-7.29%)148.60 (-12.90%)145.00 (-11.59%)131.00 (-16.03%)16.33 (+24.57%)
31ab24e — 2025-11-22 02:01:560.15 (n/a)0.13 (n/a)0.14 (n/a)0.12 (n/a)0.01 (n/a)192.00 (n/a)170.60 (n/a)164.00 (n/a)156.00 (n/a)13.11 (n/a)

sigmoid_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.05 (-16.44%)0.04 (-15.88%)0.04 (-15.17%)0.03 (-22.96%)0.01 (-14.40%)257.00 (+29.80%)189.00 (+19.32%)178.00 (+17.88%)146.00 (+19.67%)42.76 (+27.53%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)198.00 (n/a)158.40 (n/a)151.00 (n/a)122.00 (n/a)33.53 (n/a)

sigmoid_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.07 (+44.55%)0.05 (+19.75%)0.05 (+14.48%)0.03 (-7.27%)0.01 (+214.83%)220.00 (+7.84%)152.80 (-12.49%)145.00 (-12.65%)110.00 (-30.82%)37.66 (+136.55%)
31ab24e — 2025-11-22 02:01:560.05 (n/a)0.04 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)204.00 (n/a)174.60 (n/a)166.00 (n/a)159.00 (n/a)15.92 (n/a)

sigmoid_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.07 (+6.90%)0.05 (+0.62%)0.06 (+5.93%)0.04 (-17.79%)0.01 (+81.86%)208.00 (+21.64%)148.00 (+2.35%)135.00 (-5.59%)116.00 (-6.45%)32.16 (+111.37%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)171.00 (n/a)144.60 (n/a)143.00 (n/a)124.00 (n/a)15.21 (n/a)

sigmoid_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (-7.94%)0.05 (-10.86%)0.05 (-11.69%)0.02 (-44.30%)0.01 (+62.89%)307.00 (+79.53%)175.20 (+22.01%)154.00 (+13.24%)126.00 (+8.62%)67.34 (+220.05%)
31ab24e — 2025-11-22 02:01:560.07 (n/a)0.05 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)171.00 (n/a)143.60 (n/a)136.00 (n/a)116.00 (n/a)21.04 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (-13.74%)0.05 (-17.81%)0.05 (-24.70%)0.03 (+3.54%)0.01 (-35.17%)254.00 (-3.42%)175.60 (+15.68%)166.00 (+32.80%)131.00 (+15.93%)41.72 (-26.30%)
31ab24e — 2025-11-22 02:01:560.07 (n/a)0.06 (n/a)0.06 (n/a)0.03 (n/a)0.01 (n/a)263.00 (n/a)151.80 (n/a)125.00 (n/a)113.00 (n/a)56.61 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.07 (+5.41%)0.06 (-1.60%)0.05 (-2.13%)0.05 (-5.66%)0.01 (+42.66%)159.00 (+6.00%)141.00 (+2.47%)141.00 (+2.17%)111.00 (-5.13%)17.08 (+42.18%)
31ab24e — 2025-11-22 02:01:560.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)150.00 (n/a)137.60 (n/a)138.00 (n/a)117.00 (n/a)12.01 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (+30.40%)0.05 (+7.01%)0.04 (+1.16%)0.04 (+1.91%)0.01 (+96.16%)209.00 (-1.88%)174.80 (-4.69%)173.00 (-1.14%)125.00 (-23.31%)28.37 (+43.99%)
31ab24e — 2025-11-22 02:01:560.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)213.00 (n/a)183.40 (n/a)175.00 (n/a)163.00 (n/a)19.70 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (+8.96%)0.05 (+8.48%)0.05 (+18.18%)0.03 (+17.94%)0.01 (+23.34%)223.00 (-15.21%)172.20 (-7.02%)143.00 (-15.38%)134.00 (-8.22%)40.38 (-3.49%)
31ab24e — 2025-11-22 02:01:560.05 (n/a)0.04 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)263.00 (n/a)185.20 (n/a)169.00 (n/a)146.00 (n/a)41.83 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.17 (-9.49%)0.13 (-12.46%)0.12 (-13.98%)0.12 (-5.32%)0.02 (-13.98%)188.00 (+5.62%)176.40 (+13.95%)186.00 (+16.25%)137.00 (+10.48%)19.74 (-0.45%)
31ab24e — 2025-11-22 02:01:560.18 (n/a)0.15 (n/a)0.14 (n/a)0.13 (n/a)0.02 (n/a)178.00 (n/a)154.80 (n/a)160.00 (n/a)124.00 (n/a)19.83 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.18 (-0.81%)0.15 (-1.11%)0.16 (-8.45%)0.09 (+26.80%)0.03 (-24.53%)250.00 (-21.14%)161.80 (-5.27%)142.00 (+9.23%)124.00 (+0.81%)45.12 (-38.90%)
31ab24e — 2025-11-22 02:01:560.19 (n/a)0.15 (n/a)0.18 (n/a)0.07 (n/a)0.04 (n/a)317.00 (n/a)170.80 (n/a)130.00 (n/a)123.00 (n/a)73.85 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.19 (+0.81%)0.15 (+1.18%)0.14 (-3.14%)0.13 (+5.85%)0.02 (-8.98%)171.00 (-5.52%)151.20 (-1.56%)159.00 (+3.25%)123.00 (-0.81%)17.14 (-15.34%)
31ab24e — 2025-11-22 02:01:560.18 (n/a)0.15 (n/a)0.15 (n/a)0.13 (n/a)0.02 (n/a)181.00 (n/a)153.60 (n/a)154.00 (n/a)124.00 (n/a)20.24 (n/a)

swiglu

No metrics available.

tanh_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.07 (+28.04%)0.05 (-2.88%)0.04 (-15.14%)0.03 (-31.02%)0.02 (+360.49%)245.00 (+44.97%)175.60 (+13.73%)185.00 (+17.83%)107.00 (-21.90%)53.60 (+418.12%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.00 (n/a)169.00 (n/a)154.40 (n/a)157.00 (n/a)137.00 (n/a)10.35 (n/a)

tanh_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (+3.28%)0.05 (-12.97%)0.05 (-8.59%)0.04 (-26.34%)0.01 (+119.29%)205.00 (+35.76%)167.60 (+18.36%)163.00 (+9.40%)122.00 (-3.17%)30.46 (+190.64%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.00 (n/a)151.00 (n/a)141.60 (n/a)149.00 (n/a)126.00 (n/a)10.48 (n/a)

tanh_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.06 (+11.38%)0.05 (+15.28%)0.05 (+5.37%)0.05 (+26.09%)0.01 (+3.39%)161.00 (-20.69%)143.00 (-13.65%)149.00 (-5.10%)123.00 (-10.22%)16.41 (-28.09%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)203.00 (n/a)165.60 (n/a)157.00 (n/a)137.00 (n/a)22.82 (n/a)

tanh_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.05 (-12.75%)0.04 (-14.95%)0.04 (-20.42%)0.04 (-4.66%)0.00 (-22.80%)193.00 (+4.89%)179.20 (+17.12%)191.00 (+25.66%)149.00 (+14.62%)17.16 (-6.81%)
31ab24e — 2025-11-22 02:01:560.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)184.00 (n/a)153.00 (n/a)152.00 (n/a)130.00 (n/a)18.42 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:343.19 (+14.38%)2.63 (-0.94%)2.63 (-0.54%)2.22 (-14.09%)0.34 (+359.81%)220.00 (+16.40%)188.60 (+2.50%)186.00 (+0.54%)153.00 (-12.57%)23.38 (+369.49%)
31ab24e — 2025-11-22 02:01:562.79 (n/a)2.66 (n/a)2.64 (n/a)2.58 (n/a)0.07 (n/a)189.00 (n/a)184.00 (n/a)185.00 (n/a)175.00 (n/a)4.98 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:343.44 (+3.52%)3.05 (+11.98%)3.05 (+7.50%)2.63 (+34.41%)0.29 (-35.57%)186.00 (-25.60%)161.60 (-12.65%)160.00 (-6.98%)142.00 (-3.40%)15.68 (-55.24%)
31ab24e — 2025-11-22 02:01:563.32 (n/a)2.72 (n/a)2.84 (n/a)1.95 (n/a)0.45 (n/a)250.00 (n/a)185.00 (n/a)172.00 (n/a)147.00 (n/a)35.03 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.09 (-6.02%)0.07 (-17.01%)0.07 (-20.63%)0.06 (-27.22%)0.01 (+496.27%)180.00 (+37.40%)155.20 (+22.01%)160.00 (+25.98%)133.00 (+6.40%)17.45 (+755.64%)
31ab24e — 2025-11-22 02:01:560.09 (n/a)0.09 (n/a)0.09 (n/a)0.09 (n/a)0.00 (n/a)131.00 (n/a)127.20 (n/a)127.00 (n/a)125.00 (n/a)2.04 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.08 (-20.57%)0.07 (-27.50%)0.07 (-22.50%)0.04 (-50.20%)0.01 (+195.86%)255.00 (+100.79%)175.80 (+43.86%)160.00 (+29.03%)141.00 (+25.89%)41.12 (+680.47%)
31ab24e — 2025-11-22 02:01:560.10 (n/a)0.09 (n/a)0.09 (n/a)0.09 (n/a)0.00 (n/a)127.00 (n/a)122.20 (n/a)124.00 (n/a)112.00 (n/a)5.27 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.07 (-25.49%)0.06 (-25.00%)0.06 (-24.47%)0.03 (-25.36%)0.02 (-14.48%)343.00 (+33.98%)217.20 (+35.41%)188.00 (+32.39%)153.00 (+34.21%)70.27 (+42.38%)
31ab24e — 2025-11-22 02:01:560.10 (n/a)0.08 (n/a)0.08 (n/a)0.04 (n/a)0.02 (n/a)256.00 (n/a)160.40 (n/a)142.00 (n/a)114.00 (n/a)49.35 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
2172566 — 2025-11-22 02:19:340.08 (-9.09%)0.07 (+0.24%)0.08 (+12.25%)0.06 (-1.44%)0.01 (-5.41%)208.00 (+1.46%)164.20 (-0.24%)147.00 (-10.91%)143.00 (+10.00%)25.13 (+4.20%)
31ab24e — 2025-11-22 02:01:560.09 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)205.00 (n/a)164.60 (n/a)165.00 (n/a)130.00 (n/a)24.12 (n/a)

@github-actions
Copy link
Copy Markdown
Contributor

📊 Test Results for Test Example Applications

2172566 (2025_11_22_02_29_11)

IRONCLAD

Tested on 2025_11_22_02_29_11 at commit 2172566.

Test Checks TTFT (mean)TPS (mean)
llama_3.2_1b ✅ 5/5 3.97 4.69
📈 Trends (vs main branch) for Test Example Applications

2172566 (2025_11_22_02_29_11)

IRONCLAD Trends

llama_3.2_1b

Commit/Date Num Tokens (max)Num Tokens (mean)Num Tokens (median)Num Tokens (min)Num Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)Total (max)Total (mean)Total (median)Total (min)Total (stddev)
2172566 — 2025-11-22 02:24:4040.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)0.00 (n/a)4.80 (+0.84%)4.69 (-0.26%)4.73 (+0.42%)4.50 (-3.43%)0.10 (+183.17%)4.30 (+3.60%)3.97 (-3.01%)4.14 (+0.29%)3.60 (-8.98%)0.30 (+313.22%)12.84 (+3.00%)12.28 (-0.78%)12.36 (-0.25%)11.75 (-4.38%)0.40 (+488.01%)
d9a64c5 — 2025-11-21 21:53:4040.00 (n/a)40.00 (n/a)40.00 (n/a)40.00 (n/a)0.00 (n/a)4.76 (n/a)4.70 (n/a)4.71 (n/a)4.66 (n/a)0.04 (n/a)4.15 (n/a)4.09 (n/a)4.12 (n/a)3.95 (n/a)0.07 (n/a)12.47 (n/a)12.38 (n/a)12.39 (n/a)12.29 (n/a)0.07 (n/a)

@github-actions
Copy link
Copy Markdown
Contributor

📊 Test Results for Small Benchmark/Test Suite

79a467d (2025_11_25_18_05_52)

IRONCLAD

Tested on 2025_11_25_18_05_52 at commit 79a467d.

Test Checks Latency (mean)Bandwidth (mean)GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0 ✅ 5/5 157.60 0.07 n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0 ✅ 5/5 165.20 0.07 n/a
axpy_4_cols_2_channels_2048_tile_512_3.0 ✅ 5/5 191.20 0.06 n/a
axpy_8_cols_2_channels_2048_tile_256_3.0 ✅ 5/5 158.80 0.07 n/a
dequant_1_cols_1_channels_2048_tile_2048 ✅ 5/5 193.60 0.03 n/a
dequant_1_cols_2_channels_2048_tile_1024 ✅ 5/5 194.80 0.03 n/a
dequant_2_cols_1_channels_2048_tile_1024 ✅ 5/5 188.40 0.03 n/a
dequant_2_cols_2_channels_2048_tile_512 ✅ 5/5 196.60 0.03 n/a
dequant_4_cols_1_channels_2048_tile_512 ✅ 5/5 142.00 0.03 n/a
dequant_4_cols_2_channels_2048_tile_256 ✅ 5/5 166.80 0.03 n/a
dequant_8_cols_1_channels_2048_tile_256 ✅ 5/5 177.20 0.03 n/a
dequant_8_cols_2_channels_2048_tile_128 ✅ 5/5 220.80 0.02 n/a
eltwise_add_1_cols_2_channels_2048_tile_2048 ✅ 5/5 141.80 0.08 n/a
eltwise_add_2_cols_2_channels_2048_tile_1024 ✅ 5/5 160.60 0.07 n/a
eltwise_add_4_cols_2_channels_2048_tile_512 ✅ 5/5 142.00 0.08 n/a
eltwise_add_8_cols_2_channels_2048_tile_256 ✅ 5/5 196.60 0.06 n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048 ✅ 5/5 153.80 0.08 n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024 ✅ 5/5 144.60 0.08 n/a
eltwise_mul_4_cols_2_channels_2048_tile_512 ✅ 5/5 157.40 0.08 n/a
eltwise_mul_8_cols_2_channels_2048_tile_256 ✅ 5/5 180.20 0.07 n/a
gelu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 186.60 0.04 n/a
gelu_1_cols_2_channels_2048_tile_1024 ✅ 5/5 181.20 0.05 n/a
gelu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 189.40 0.05 n/a
gelu_2_cols_2_channels_2048_tile_512 ✅ 5/5 151.80 0.05 n/a
gelu_4_cols_1_channels_2048_tile_512 ✅ 5/5 161.00 0.05 n/a
gelu_4_cols_2_channels_2048_tile_256 ✅ 5/5 174.80 0.05 n/a
gelu_8_cols_1_channels_2048_tile_256 ✅ 5/5 168.00 0.05 n/a
gelu_8_cols_2_channels_2048_tile_128 ✅ 5/5 263.80 0.03 n/a
gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_0_ccolmaj_0 ✅ 5/5 6664.60 3.52 2581.00
gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_1_ccolmaj_0 ✅ 5/5 6997.40 3.35 2458.10
gemm_2048x2048x2048_64x64x32_8_cols_1_bcolmaj_0_ccolmaj_0 ✅ 5/5 7643.60 3.07 2253.36
layer_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 197.00 0.07 n/a
layer_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 155.80 0.08 n/a
layer_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 161.60 0.08 n/a
layer_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 144.00 0.09 n/a
layer_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 175.20 0.07 n/a
layer_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 187.40 0.07 n/a
layer_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 139.80 0.09 n/a
layer_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 205.40 0.06 n/a
matrix_vector_mul_128x128_32_1col ✅ 5/5 698.60 0.05 0.05
matrix_vector_mul_2048x8192_1_1col ✅ 5/5 3129.20 10.74 10.74
matrix_vector_mul_2048x8192_1_2col ✅ 5/5 2113.40 15.95 15.94
matrix_vector_mul_2048x8192_1_4col ✅ 5/5 1641.60 20.52 20.51
matrix_vector_mul_2048x8192_1_8col ✅ 5/5 2166.80 15.68 15.67
matrix_vector_mul_8192x2048_4_1col ✅ 5/5 3140.00 10.72 10.71
matrix_vector_mul_8192x2048_4_2col ✅ 5/5 2088.80 16.12 16.11
matrix_vector_mul_8192x2048_4_4col ✅ 5/5 1806.40 18.72 18.71
matrix_vector_mul_8192x2048_4_8col ✅ 5/5 2192.00 15.62 15.61
mem_copy_16_cores_2_chans_2048_tile_128_False ✅ 5/5 185.20 0.04 n/a
mem_copy_1_cores_1_chans_2048_tile_2048_False ✅ 5/5 121.80 0.06 n/a
mem_copy_2_cores_1_chans_2048_tile_1024_False ✅ 5/5 136.80 0.06 n/a
mem_copy_2_cores_2_chans_2048_tile_1024_False ✅ 5/5 173.60 0.05 n/a
mem_copy_4_cores_1_chans_2048_tile_512_False ✅ 5/5 143.80 0.05 n/a
mem_copy_4_cores_2_chans_2048_tile_512_False ✅ 5/5 138.60 0.06 n/a
mem_copy_8_cores_1_chans_2048_tile_256_False ✅ 5/5 170.00 0.05 n/a
mem_copy_8_cores_2_chans_2048_tile_256_False ✅ 5/5 154.20 0.05 n/a
mha ✅ 5/5 n/a 1.48 757.43
relu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 148.80 0.05 n/a
relu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 149.20 0.05 n/a
relu_4_cols_1_channels_2048_tile_512 ✅ 5/5 142.20 0.05 n/a
relu_8_cols_1_channels_2048_tile_256 ✅ 5/5 158.60 0.05 n/a
rms_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 151.00 0.08 n/a
rms_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 174.00 0.07 n/a
rms_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 167.60 0.07 n/a
rms_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 193.40 0.06 n/a
rms_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 180.00 0.07 n/a
rms_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 210.00 0.06 n/a
rms_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 252.40 0.05 n/a
rms_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 244.80 0.05 n/a
rope_1_cols_2_channels_4096_tile_4096_0 ✅ 5/5 180.20 0.13 n/a
rope_2_cols_2_channels_4096_tile_2048_0 ✅ 5/5 160.20 0.15 n/a
rope_4_cols_2_channels_4096_tile_1024_0 ✅ 5/5 178.00 0.13 n/a
rope_8_cols_2_channels_4096_tile_512_0 ✅ 5/5 194.40 0.12 n/a
sigmoid_1_cols_1_channels_2048_tile_2048 ✅ 5/5 133.00 0.06 n/a
sigmoid_2_cols_1_channels_2048_tile_1024 ✅ 5/5 155.60 0.05 n/a
sigmoid_4_cols_1_channels_2048_tile_512 ✅ 5/5 180.60 0.04 n/a
sigmoid_8_cols_1_channels_2048_tile_256 ✅ 5/5 210.40 0.04 n/a
silu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 176.40 0.05 n/a
silu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 182.80 0.04 n/a
silu_4_cols_1_channels_2048_tile_512 ✅ 5/5 171.60 0.05 n/a
silu_8_cols_1_channels_2048_tile_256 ✅ 5/5 194.60 0.04 n/a
softmax_1_cols_2_channels_4096_tile_2048 ✅ 5/5 155.40 0.15 n/a
softmax_2_cols_2_channels_4096_tile_1024 ✅ 5/5 147.20 0.16 n/a
softmax_2_cols_2_channels_4096_tile_512 ✅ 5/5 157.20 0.15 n/a
swiglu ✅ 5/5 n/a n/a n/a
tanh_1_cols_1_channels_2048_tile_2048 ✅ 5/5 178.20 0.04 n/a
tanh_2_cols_1_channels_2048_tile_1024 ✅ 5/5 167.60 0.05 n/a
tanh_4_cols_1_channels_2048_tile_512 ✅ 5/5 171.80 0.05 n/a
tanh_8_cols_1_channels_2048_tile_256 ✅ 5/5 135.40 0.06 n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s ✅ 5/5 181.00 2.75 n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s ✅ 5/5 175.00 2.80 n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048 ✅ 5/5 155.80 0.07 n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024 ✅ 5/5 165.80 0.07 n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512 ✅ 5/5 158.20 0.07 n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256 ✅ 5/5 173.20 0.07 n/a
📈 Trends (vs main branch) for Small Benchmark/Test Suite

79a467d (2025_11_25_18_05_52)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.09 (-4.58%)0.07 (-4.90%)0.07 (-10.62%)0.06 (+33.70%)0.01 (-48.68%)184.00 (-25.20%)157.60 (+0.13%)160.00 (+11.89%)131.00 (+4.80%)17.47 (-61.26%)
2621de6 — 2025-11-25 17:47:120.09 (n/a)0.08 (n/a)0.08 (n/a)0.05 (n/a)0.02 (n/a)246.00 (n/a)157.40 (n/a)143.00 (n/a)125.00 (n/a)45.08 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.09 (-16.67%)0.07 (-18.58%)0.08 (-21.71%)0.05 (-28.40%)0.01 (-8.96%)243.00 (+39.66%)165.20 (+24.59%)152.00 (+27.73%)132.00 (+20.00%)39.71 (+62.07%)
2621de6 — 2025-11-25 17:47:120.10 (n/a)0.09 (n/a)0.10 (n/a)0.07 (n/a)0.01 (n/a)174.00 (n/a)132.60 (n/a)119.00 (n/a)110.00 (n/a)24.50 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.08 (-21.77%)0.06 (-14.36%)0.06 (-15.64%)0.04 (-26.33%)0.01 (-22.13%)281.00 (+35.75%)191.20 (+17.16%)179.00 (+18.54%)147.00 (+27.83%)46.79 (+38.22%)
2621de6 — 2025-11-25 17:47:120.10 (n/a)0.07 (n/a)0.08 (n/a)0.06 (n/a)0.02 (n/a)207.00 (n/a)163.20 (n/a)151.00 (n/a)115.00 (n/a)33.85 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.08 (+39.31%)0.07 (+56.44%)0.08 (+56.16%)0.06 (+88.77%)0.01 (-14.91%)187.00 (-47.03%)158.80 (-37.87%)146.00 (-35.96%)145.00 (-28.22%)16.96 (-68.67%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)353.00 (n/a)255.60 (n/a)228.00 (n/a)202.00 (n/a)54.14 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.04 (+40.46%)0.03 (+26.26%)0.02 (-1.38%)0.02 (+37.50%)0.01 (+80.47%)248.00 (-27.27%)193.60 (-18.72%)217.00 (+1.40%)131.00 (-28.80%)48.15 (-11.80%)
2621de6 — 2025-11-25 17:47:120.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)341.00 (n/a)238.20 (n/a)214.00 (n/a)184.00 (n/a)54.59 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.03 (-17.72%)0.03 (-15.41%)0.03 (-6.25%)0.01 (-35.05%)0.01 (+20.77%)331.00 (+53.95%)194.80 (+24.55%)160.00 (+6.67%)158.00 (+21.54%)68.14 (+123.46%)
2621de6 — 2025-11-25 17:47:120.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)215.00 (n/a)156.40 (n/a)150.00 (n/a)130.00 (n/a)30.49 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.04 (+10.37%)0.03 (-6.17%)0.03 (+1.14%)0.02 (-33.57%)0.01 (+136.95%)277.00 (+50.54%)188.40 (+12.28%)175.00 (-1.13%)135.00 (-9.40%)49.26 (+234.10%)
2621de6 — 2025-11-25 17:47:120.03 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)184.00 (n/a)167.80 (n/a)177.00 (n/a)149.00 (n/a)14.74 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.04 (+23.97%)0.03 (+5.34%)0.03 (-2.70%)0.02 (-17.33%)0.01 (+58.25%)300.00 (+20.97%)196.60 (-0.10%)185.00 (+2.78%)121.00 (-19.33%)60.88 (+50.22%)
2621de6 — 2025-11-25 17:47:120.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)248.00 (n/a)196.80 (n/a)180.00 (n/a)150.00 (n/a)40.53 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.04 (+10.24%)0.03 (+16.57%)0.04 (+18.12%)0.03 (+21.88%)0.00 (+1.71%)160.00 (-17.95%)142.00 (-14.46%)138.00 (-15.34%)127.00 (-9.29%)14.04 (-24.42%)
2621de6 — 2025-11-25 17:47:120.03 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)195.00 (n/a)166.00 (n/a)163.00 (n/a)140.00 (n/a)18.58 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.03 (+6.71%)0.03 (+10.67%)0.03 (+11.90%)0.03 (+13.26%)0.00 (-9.65%)181.00 (-11.71%)166.80 (-9.84%)168.00 (-10.64%)149.00 (-6.29%)11.41 (-24.11%)
2621de6 — 2025-11-25 17:47:120.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)205.00 (n/a)185.00 (n/a)188.00 (n/a)159.00 (n/a)15.03 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.03 (+11.41%)0.03 (+3.48%)0.03 (-2.23%)0.02 (-10.53%)0.00 (+126.56%)228.00 (+11.76%)177.20 (-1.45%)179.00 (+2.29%)149.00 (-10.24%)28.94 (+120.08%)
2621de6 — 2025-11-25 17:47:120.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)204.00 (n/a)179.80 (n/a)175.00 (n/a)166.00 (n/a)13.15 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.03 (+1.68%)0.02 (-4.36%)0.03 (+5.85%)0.01 (-34.72%)0.00 (+212.47%)337.00 (+53.18%)220.80 (+10.18%)188.00 (-5.53%)179.00 (-1.65%)59.73 (+376.64%)
2621de6 — 2025-11-25 17:47:120.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)220.00 (n/a)200.40 (n/a)199.00 (n/a)182.00 (n/a)12.53 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.10 (+2.50%)0.08 (-3.83%)0.08 (-16.67%)0.07 (+13.25%)0.01 (-14.36%)166.00 (-11.70%)141.80 (+2.90%)150.00 (+20.00%)120.00 (-2.44%)17.92 (-28.99%)
2621de6 — 2025-11-25 17:47:120.09 (n/a)0.09 (n/a)0.09 (n/a)0.06 (n/a)0.01 (n/a)188.00 (n/a)137.80 (n/a)125.00 (n/a)123.00 (n/a)25.23 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.08 (-8.89%)0.07 (-17.75%)0.07 (-19.02%)0.06 (-26.49%)0.01 (+146.87%)185.00 (+36.03%)160.60 (+22.78%)163.00 (+23.48%)135.00 (+9.76%)16.64 (+267.08%)
2621de6 — 2025-11-25 17:47:120.09 (n/a)0.09 (n/a)0.09 (n/a)0.08 (n/a)0.00 (n/a)136.00 (n/a)130.80 (n/a)132.00 (n/a)123.00 (n/a)4.53 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.11 (+16.82%)0.08 (+12.15%)0.08 (-5.52%)0.07 (+44.51%)0.01 (-20.21%)164.00 (-30.80%)142.00 (-14.04%)145.00 (+5.84%)107.00 (-14.40%)19.84 (-53.46%)
2621de6 — 2025-11-25 17:47:120.09 (n/a)0.07 (n/a)0.08 (n/a)0.05 (n/a)0.02 (n/a)237.00 (n/a)165.20 (n/a)137.00 (n/a)125.00 (n/a)42.63 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.07 (-13.64%)0.06 (-14.52%)0.06 (-5.65%)0.04 (-33.81%)0.01 (+34.81%)278.00 (+51.09%)196.60 (+20.32%)177.00 (+5.99%)154.00 (+15.79%)43.12 (+149.53%)
2621de6 — 2025-11-25 17:47:120.09 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)184.00 (n/a)163.40 (n/a)167.00 (n/a)133.00 (n/a)17.28 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.09 (+15.38%)0.08 (+5.89%)0.08 (+6.90%)0.06 (-17.48%)0.01 (+230.60%)206.00 (+21.18%)153.80 (-3.27%)145.00 (-6.45%)130.00 (-13.33%)27.16 (+255.43%)
2621de6 — 2025-11-25 17:47:120.08 (n/a)0.07 (n/a)0.07 (n/a)0.07 (n/a)0.00 (n/a)170.00 (n/a)159.00 (n/a)155.00 (n/a)150.00 (n/a)7.64 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.09 (-8.21%)0.08 (+0.09%)0.08 (-1.38%)0.07 (+25.93%)0.01 (-60.17%)162.00 (-20.59%)144.60 (-2.95%)145.00 (+1.40%)134.00 (+8.94%)10.13 (-65.72%)
2621de6 — 2025-11-25 17:47:120.09 (n/a)0.08 (n/a)0.08 (n/a)0.06 (n/a)0.01 (n/a)204.00 (n/a)149.00 (n/a)143.00 (n/a)123.00 (n/a)29.55 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.10 (+0.84%)0.08 (-10.89%)0.09 (+4.76%)0.05 (-39.26%)0.02 (+181.73%)242.00 (+64.63%)157.40 (+20.15%)126.00 (-4.55%)119.00 (-0.83%)47.07 (+359.82%)
2621de6 — 2025-11-25 17:47:120.10 (n/a)0.09 (n/a)0.09 (n/a)0.08 (n/a)0.01 (n/a)147.00 (n/a)131.00 (n/a)132.00 (n/a)120.00 (n/a)10.24 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.08 (-27.34%)0.07 (-12.24%)0.06 (-15.47%)0.05 (+1.79%)0.01 (-54.10%)223.00 (-1.76%)180.20 (+7.52%)181.00 (+18.30%)139.00 (+37.62%)27.48 (-39.39%)
2621de6 — 2025-11-25 17:47:120.11 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.02 (n/a)227.00 (n/a)167.60 (n/a)153.00 (n/a)101.00 (n/a)45.33 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.05 (-14.65%)0.04 (-10.55%)0.05 (-7.73%)0.04 (+14.81%)0.00 (-50.02%)216.00 (-12.90%)186.60 (+7.99%)181.00 (+8.38%)157.00 (+17.16%)20.50 (-49.40%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)248.00 (n/a)172.80 (n/a)167.00 (n/a)134.00 (n/a)40.51 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.05 (-29.63%)0.05 (-22.26%)0.05 (-12.65%)0.04 (-25.36%)0.01 (-23.01%)209.00 (+33.97%)181.20 (+28.88%)166.00 (+14.48%)162.00 (+42.11%)21.94 (+48.92%)
2621de6 — 2025-11-25 17:47:120.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)156.00 (n/a)140.60 (n/a)145.00 (n/a)114.00 (n/a)14.73 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (-23.53%)0.05 (-21.57%)0.04 (-24.34%)0.03 (-26.72%)0.01 (-5.49%)262.00 (+36.46%)189.40 (+30.26%)189.00 (+32.17%)136.00 (+30.77%)46.37 (+65.74%)
2621de6 — 2025-11-25 17:47:120.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)192.00 (n/a)145.40 (n/a)143.00 (n/a)104.00 (n/a)27.98 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.07 (-3.39%)0.05 (+1.31%)0.05 (-11.73%)0.05 (+16.76%)0.01 (-28.45%)173.00 (-14.36%)151.80 (-3.56%)162.00 (+13.29%)118.00 (+3.51%)19.70 (-38.52%)
2621de6 — 2025-11-25 17:47:120.07 (n/a)0.05 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)202.00 (n/a)157.40 (n/a)143.00 (n/a)114.00 (n/a)32.05 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (-21.53%)0.05 (-21.66%)0.05 (-20.62%)0.05 (-15.17%)0.00 (-48.53%)178.00 (+17.88%)161.00 (+26.77%)160.00 (+25.98%)144.00 (+27.43%)10.99 (-21.65%)
2621de6 — 2025-11-25 17:47:120.07 (n/a)0.07 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)151.00 (n/a)127.00 (n/a)127.00 (n/a)113.00 (n/a)14.03 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (-8.63%)0.05 (+0.20%)0.05 (+11.76%)0.04 (-5.38%)0.01 (-11.26%)223.00 (+5.69%)174.80 (-0.46%)170.00 (-10.53%)139.00 (+9.45%)30.71 (+3.50%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)211.00 (n/a)175.60 (n/a)190.00 (n/a)127.00 (n/a)29.67 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (-7.48%)0.05 (-8.17%)0.05 (-11.93%)0.04 (-2.73%)0.00 (-22.15%)183.00 (+2.81%)168.00 (+8.53%)176.00 (+13.55%)147.00 (+8.09%)14.28 (-12.19%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)178.00 (n/a)154.80 (n/a)155.00 (n/a)136.00 (n/a)16.27 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.05 (+8.00%)0.03 (-14.21%)0.03 (-28.97%)0.02 (-36.87%)0.01 (+272.66%)358.00 (+58.41%)263.80 (+25.98%)290.00 (+40.78%)175.00 (-7.41%)71.95 (+416.24%)
2621de6 — 2025-11-25 17:47:120.04 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)226.00 (n/a)209.40 (n/a)206.00 (n/a)189.00 (n/a)13.94 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:593.72 (-0.32%)3.52 (-2.47%)3.55 (-3.12%)3.37 (-1.14%)0.12 (+11.41%)2723.50 (-0.32%)2581.00 (-2.47%)2601.04 (-3.12%)2468.37 (-1.14%)91.59 (+11.41%)6960.00 (+1.15%)6664.60 (+2.55%)6605.00 (+3.22%)6308.00 (+0.32%)234.88 (+12.90%)
2621de6 — 2025-11-25 17:47:123.73 (n/a)3.61 (n/a)3.66 (n/a)3.41 (n/a)0.11 (n/a)2732.17 (n/a)2646.26 (n/a)2684.77 (n/a)2496.71 (n/a)82.21 (n/a)6881.00 (n/a)6498.60 (n/a)6399.00 (n/a)6288.00 (n/a)208.04 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_1_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:593.46 (-1.34%)3.35 (-1.59%)3.39 (+0.39%)3.14 (-5.67%)0.11 (+66.59%)2538.02 (-1.34%)2458.10 (-1.59%)2486.23 (+0.39%)2298.31 (-5.67%)82.89 (+66.59%)7475.00 (+6.01%)6997.40 (+1.69%)6910.00 (-0.39%)6769.00 (+1.36%)246.32 (+80.87%)
2621de6 — 2025-11-25 17:47:123.51 (n/a)3.41 (n/a)3.38 (n/a)3.32 (n/a)0.07 (n/a)2572.61 (n/a)2497.77 (n/a)2476.56 (n/a)2436.52 (n/a)49.76 (n/a)7051.00 (n/a)6880.80 (n/a)6937.00 (n/a)6678.00 (n/a)136.19 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_1_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:593.38 (+0.85%)3.07 (-0.51%)2.98 (+0.98%)2.95 (+2.00%)0.16 (-22.73%)2477.27 (+0.85%)2253.36 (-0.51%)2187.40 (+0.98%)2160.45 (+2.00%)117.28 (-22.73%)7952.00 (-1.96%)7643.60 (+0.33%)7854.00 (-0.97%)6935.00 (-0.84%)374.81 (-24.74%)
2621de6 — 2025-11-25 17:47:123.35 (n/a)3.09 (n/a)2.96 (n/a)2.89 (n/a)0.21 (n/a)2456.37 (n/a)2264.85 (n/a)2166.17 (n/a)2118.09 (n/a)151.78 (n/a)8111.00 (n/a)7618.80 (n/a)7931.00 (n/a)6994.00 (n/a)498.05 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
31ab24e — 2025-11-22 02:01:563.65 (-1.06%)3.59 (+0.83%)3.63 (-0.26%)3.45 (+2.66%)0.07 (-44.71%)2678.08 (-1.06%)2632.13 (+0.83%)2658.60 (-0.26%)2528.31 (+2.66%)53.86 (-44.71%)6795.00 (-2.59%)6529.80 (-0.92%)6462.00 (+0.26%)6415.00 (+1.07%)137.14 (-45.27%)
d9a64c5 — 2025-11-21 20:49:353.69 (n/a)3.56 (n/a)3.64 (n/a)3.36 (n/a)0.13 (n/a)2706.77 (n/a)2610.50 (n/a)2665.61 (n/a)2462.71 (n/a)97.41 (n/a)6976.00 (n/a)6590.40 (n/a)6445.00 (n/a)6347.00 (n/a)250.58 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.09 (-12.12%)0.07 (-19.72%)0.07 (-16.85%)0.05 (-24.80%)0.02 (+9.62%)254.00 (+32.98%)197.00 (+28.09%)184.00 (+20.26%)132.00 (+13.79%)47.21 (+72.65%)
2621de6 — 2025-11-25 17:47:120.11 (n/a)0.08 (n/a)0.08 (n/a)0.06 (n/a)0.02 (n/a)191.00 (n/a)153.80 (n/a)153.00 (n/a)116.00 (n/a)27.35 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.09 (-5.19%)0.08 (+19.01%)0.08 (+32.30%)0.07 (+46.75%)0.01 (-61.09%)169.00 (-31.85%)155.80 (-19.94%)161.00 (-24.41%)135.00 (+5.47%)11.91 (-71.76%)
2621de6 — 2025-11-25 17:47:120.10 (n/a)0.07 (n/a)0.06 (n/a)0.05 (n/a)0.02 (n/a)248.00 (n/a)194.60 (n/a)213.00 (n/a)128.00 (n/a)42.16 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.08 (-16.89%)0.08 (-5.95%)0.07 (-14.02%)0.07 (+32.56%)0.00 (-78.09%)172.00 (-24.56%)161.60 (+1.00%)164.00 (+16.31%)148.00 (+20.33%)7.84 (-80.13%)
2621de6 — 2025-11-25 17:47:120.10 (n/a)0.08 (n/a)0.09 (n/a)0.05 (n/a)0.02 (n/a)228.00 (n/a)160.00 (n/a)141.00 (n/a)123.00 (n/a)39.44 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.11 (+25.00%)0.09 (+4.79%)0.09 (+6.72%)0.06 (-24.53%)0.02 (+253.91%)212.00 (+32.50%)144.00 (+0.14%)134.00 (-6.29%)108.00 (-20.00%)36.07 (+292.21%)
2621de6 — 2025-11-25 17:47:120.09 (n/a)0.09 (n/a)0.09 (n/a)0.08 (n/a)0.01 (n/a)160.00 (n/a)143.80 (n/a)143.00 (n/a)135.00 (n/a)9.20 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.10 (-8.94%)0.07 (-26.80%)0.07 (-28.82%)0.05 (-37.96%)0.02 (+52.45%)245.00 (+61.18%)175.20 (+41.75%)170.00 (+40.50%)123.00 (+9.82%)39.97 (+170.82%)
2621de6 — 2025-11-25 17:47:120.11 (n/a)0.10 (n/a)0.10 (n/a)0.08 (n/a)0.01 (n/a)152.00 (n/a)123.60 (n/a)121.00 (n/a)112.00 (n/a)14.76 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.09 (+2.11%)0.07 (-2.57%)0.07 (+2.84%)0.05 (-26.37%)0.02 (+75.73%)273.00 (+35.82%)187.40 (+6.96%)176.00 (-2.76%)142.00 (-2.07%)47.29 (+134.55%)
2621de6 — 2025-11-25 17:47:120.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)201.00 (n/a)175.20 (n/a)181.00 (n/a)145.00 (n/a)20.16 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.11 (+20.69%)0.09 (+15.75%)0.09 (+9.16%)0.06 (+7.37%)0.01 (+21.96%)190.00 (-6.86%)139.80 (-13.17%)131.00 (-8.39%)116.00 (-17.14%)25.77 (+0.77%)
2621de6 — 2025-11-25 17:47:120.09 (n/a)0.08 (n/a)0.09 (n/a)0.06 (n/a)0.01 (n/a)204.00 (n/a)161.00 (n/a)143.00 (n/a)140.00 (n/a)25.57 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.08 (+9.49%)0.06 (+14.45%)0.06 (+5.29%)0.04 (+26.52%)0.01 (-2.09%)279.00 (-20.96%)205.40 (-14.20%)208.00 (-5.02%)158.00 (-8.67%)42.15 (-31.72%)
2621de6 — 2025-11-25 17:47:120.07 (n/a)0.05 (n/a)0.06 (n/a)0.03 (n/a)0.01 (n/a)353.00 (n/a)239.40 (n/a)219.00 (n/a)173.00 (n/a)61.74 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.05 (+26.47%)0.05 (+29.03%)0.05 (+28.35%)0.05 (+29.91%)0.00 (-3.92%)0.05 (+26.47%)0.05 (+29.03%)0.05 (+28.35%)0.04 (+29.91%)0.00 (-3.93%)739.00 (-23.02%)698.60 (-22.55%)695.00 (-22.09%)680.00 (-20.93%)21.30 (-41.36%)
2621de6 — 2025-11-25 17:47:120.04 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.00 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.00 (n/a)960.00 (n/a)902.00 (n/a)892.00 (n/a)860.00 (n/a)36.33 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:5911.06 (+2.21%)10.74 (+2.33%)10.99 (+3.96%)10.22 (+2.86%)0.36 (+21.36%)11.05 (+2.21%)10.74 (+2.33%)10.99 (+3.96%)10.22 (+2.86%)0.36 (+21.36%)3284.00 (-2.78%)3129.20 (-2.24%)3054.00 (-3.81%)3036.00 (-2.16%)105.90 (+14.12%)
2621de6 — 2025-11-25 17:47:1210.82 (n/a)10.50 (n/a)10.57 (n/a)9.94 (n/a)0.29 (n/a)10.81 (n/a)10.49 (n/a)10.57 (n/a)9.93 (n/a)0.29 (n/a)3378.00 (n/a)3201.00 (n/a)3175.00 (n/a)3103.00 (n/a)92.79 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:5916.94 (-0.40%)15.95 (-0.38%)16.60 (+5.93%)14.59 (-3.39%)1.02 (+32.61%)16.93 (-0.40%)15.94 (-0.38%)16.59 (+5.93%)14.58 (-3.39%)1.02 (+32.61%)2302.00 (+3.51%)2113.40 (+0.57%)2022.00 (-5.60%)1982.00 (+0.41%)138.82 (+38.92%)
2621de6 — 2025-11-25 17:47:1217.01 (n/a)16.01 (n/a)15.67 (n/a)15.10 (n/a)0.77 (n/a)17.00 (n/a)16.00 (n/a)15.66 (n/a)15.09 (n/a)0.77 (n/a)2224.00 (n/a)2101.40 (n/a)2142.00 (n/a)1974.00 (n/a)99.93 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:5922.13 (+7.38%)20.52 (+6.83%)20.50 (+7.08%)19.01 (+6.96%)1.17 (+8.34%)22.12 (+7.38%)20.51 (+6.83%)20.48 (+7.08%)19.00 (+6.96%)1.16 (+8.35%)1766.00 (-6.51%)1641.60 (-6.39%)1638.00 (-6.61%)1517.00 (-6.88%)93.11 (-5.34%)
2621de6 — 2025-11-25 17:47:1220.61 (n/a)19.21 (n/a)19.14 (n/a)17.77 (n/a)1.08 (n/a)20.60 (n/a)19.19 (n/a)19.13 (n/a)17.76 (n/a)1.08 (n/a)1889.00 (n/a)1753.60 (n/a)1754.00 (n/a)1629.00 (n/a)98.36 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:5918.89 (-0.73%)15.68 (-14.11%)15.34 (-16.31%)13.69 (-20.27%)1.76 (+180.83%)18.88 (-0.73%)15.67 (-14.11%)15.33 (-16.31%)13.68 (-20.27%)1.76 (+180.83%)2452.00 (+25.42%)2166.80 (+17.65%)2189.00 (+19.49%)1777.00 (+0.74%)224.03 (+246.85%)
2621de6 — 2025-11-25 17:47:1219.03 (n/a)18.25 (n/a)18.33 (n/a)17.17 (n/a)0.63 (n/a)19.02 (n/a)18.24 (n/a)18.32 (n/a)17.16 (n/a)0.63 (n/a)1955.00 (n/a)1841.80 (n/a)1832.00 (n/a)1764.00 (n/a)64.59 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:5911.15 (+4.49%)10.72 (+4.60%)10.92 (+6.92%)9.77 (+1.66%)0.49 (+29.72%)11.15 (+4.49%)10.71 (+4.60%)10.91 (+6.93%)9.77 (+1.66%)0.49 (+29.72%)3436.00 (-1.63%)3140.00 (-4.31%)3076.00 (-6.48%)3010.00 (-4.29%)151.84 (+23.46%)
2621de6 — 2025-11-25 17:47:1210.68 (n/a)10.25 (n/a)10.21 (n/a)9.61 (n/a)0.38 (n/a)10.67 (n/a)10.24 (n/a)10.20 (n/a)9.61 (n/a)0.38 (n/a)3493.00 (n/a)3281.60 (n/a)3289.00 (n/a)3145.00 (n/a)122.99 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:5917.00 (+1.11%)16.12 (+1.18%)16.34 (+2.92%)14.57 (-5.51%)0.82 (+59.96%)16.99 (+1.11%)16.11 (+1.18%)16.33 (+2.92%)14.56 (-5.51%)0.82 (+59.97%)2305.00 (+5.83%)2088.80 (-1.00%)2055.00 (-2.84%)1975.00 (-1.10%)112.43 (+69.64%)
2621de6 — 2025-11-25 17:47:1216.81 (n/a)15.93 (n/a)15.87 (n/a)15.42 (n/a)0.51 (n/a)16.80 (n/a)15.92 (n/a)15.87 (n/a)15.41 (n/a)0.51 (n/a)2178.00 (n/a)2109.80 (n/a)2115.00 (n/a)1997.00 (n/a)66.28 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:5920.18 (-6.19%)18.72 (-9.39%)18.87 (-9.89%)15.90 (-17.91%)1.52 (+100.23%)20.16 (-6.19%)18.71 (-9.39%)18.86 (-9.89%)15.89 (-17.91%)1.52 (+100.22%)2111.00 (+21.81%)1806.40 (+11.01%)1779.00 (+10.98%)1664.00 (+6.60%)160.59 (+161.89%)
2621de6 — 2025-11-25 17:47:1221.51 (n/a)20.66 (n/a)20.95 (n/a)19.37 (n/a)0.76 (n/a)21.50 (n/a)20.65 (n/a)20.93 (n/a)19.36 (n/a)0.76 (n/a)1733.00 (n/a)1627.20 (n/a)1603.00 (n/a)1561.00 (n/a)61.32 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:5918.95 (+4.40%)15.62 (-7.15%)14.66 (-11.31%)13.40 (-18.40%)2.23 (+235.04%)18.94 (+4.40%)15.61 (-7.15%)14.65 (-11.31%)13.39 (-18.40%)2.23 (+235.05%)2506.00 (+22.54%)2192.00 (+9.65%)2291.00 (+12.75%)1772.00 (-4.22%)297.38 (+298.19%)
2621de6 — 2025-11-25 17:47:1218.15 (n/a)16.82 (n/a)16.52 (n/a)16.42 (n/a)0.67 (n/a)18.14 (n/a)16.81 (n/a)16.51 (n/a)16.41 (n/a)0.66 (n/a)2045.00 (n/a)1999.00 (n/a)2032.00 (n/a)1850.00 (n/a)74.68 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.05 (+29.29%)0.04 (+17.89%)0.04 (+7.25%)0.04 (+26.09%)0.01 (+52.24%)207.00 (-20.69%)185.20 (-14.65%)193.00 (-6.76%)140.00 (-22.65%)24.87 (-7.59%)
2621de6 — 2025-11-25 17:47:120.04 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.00 (n/a)261.00 (n/a)217.00 (n/a)207.00 (n/a)181.00 (n/a)26.91 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (-16.99%)0.05 (-12.47%)0.05 (-7.32%)0.04 (-11.17%)0.00 (-29.61%)197.00 (+12.57%)171.00 (+13.70%)164.00 (+7.89%)153.00 (+20.47%)17.49 (-4.32%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)175.00 (n/a)150.40 (n/a)152.00 (n/a)127.00 (n/a)18.28 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (+5.56%)0.05 (-1.59%)0.05 (-1.39%)0.03 (-14.07%)0.01 (+25.03%)263.00 (+16.37%)166.00 (+4.53%)144.00 (+1.41%)126.00 (-5.26%)49.38 (+43.17%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)226.00 (n/a)158.80 (n/a)142.00 (n/a)133.00 (n/a)34.49 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.08 (+29.47%)0.06 (+22.12%)0.06 (+22.95%)0.05 (+12.77%)0.01 (+93.15%)141.00 (-11.32%)121.80 (-17.03%)122.00 (-18.67%)95.00 (-22.76%)17.20 (+36.58%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.00 (n/a)159.00 (n/a)146.80 (n/a)150.00 (n/a)123.00 (n/a)12.59 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (-15.32%)0.05 (-17.09%)0.05 (-23.81%)0.04 (-15.54%)0.01 (-18.18%)193.00 (+18.40%)160.80 (+20.36%)168.00 (+31.25%)124.00 (+18.10%)22.92 (+11.39%)
0999a9a — 2025-11-13 19:24:080.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)163.00 (n/a)133.60 (n/a)128.00 (n/a)105.00 (n/a)20.58 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (-23.02%)0.05 (-6.98%)0.05 (-2.13%)0.04 (-15.31%)0.01 (-33.29%)196.00 (+18.07%)147.00 (+6.52%)141.00 (+2.17%)126.00 (+29.90%)25.27 (+8.13%)
0999a9a — 2025-11-13 19:24:080.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)166.00 (n/a)138.00 (n/a)138.00 (n/a)97.00 (n/a)23.37 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.07 (-1.77%)0.06 (+7.43%)0.06 (+14.73%)0.04 (-6.59%)0.01 (+4.15%)182.00 (+7.06%)136.80 (-6.43%)129.00 (-12.84%)113.00 (+1.80%)23.92 (+20.12%)
2621de6 — 2025-11-25 17:47:120.07 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)170.00 (n/a)146.20 (n/a)148.00 (n/a)111.00 (n/a)19.91 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (+5.88%)0.05 (-6.87%)0.04 (-16.09%)0.03 (+20.09%)0.01 (-5.14%)224.00 (-16.73%)173.60 (+4.83%)174.00 (+19.18%)119.00 (-5.56%)36.96 (-29.56%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)269.00 (n/a)165.60 (n/a)146.00 (n/a)126.00 (n/a)52.47 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.07 (+11.97%)0.05 (+3.09%)0.05 (+2.10%)0.03 (-11.35%)0.01 (+41.65%)229.00 (+12.81%)156.00 (-0.51%)143.00 (-2.05%)117.00 (-10.69%)38.21 (+48.71%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)203.00 (n/a)156.80 (n/a)146.00 (n/a)131.00 (n/a)25.69 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (+9.02%)0.05 (+5.59%)0.05 (+0.00%)0.04 (+3.63%)0.01 (+25.48%)193.00 (-3.50%)147.40 (-4.66%)147.00 (+0.00%)122.00 (-8.27%)25.24 (+7.48%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)154.60 (n/a)147.00 (n/a)133.00 (n/a)23.48 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (-1.59%)0.05 (+10.47%)0.05 (+12.23%)0.04 (+10.33%)0.01 (-14.72%)184.00 (-9.36%)143.80 (-10.24%)139.00 (-10.90%)126.00 (+1.61%)21.02 (-20.57%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)203.00 (n/a)160.20 (n/a)156.00 (n/a)124.00 (n/a)26.46 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (+13.60%)0.06 (+20.51%)0.06 (+27.91%)0.05 (+31.14%)0.01 (-10.63%)167.00 (-23.74%)138.60 (-17.89%)129.00 (-21.82%)125.00 (-11.97%)15.87 (-41.22%)
2621de6 — 2025-11-25 17:47:120.05 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)219.00 (n/a)168.80 (n/a)165.00 (n/a)142.00 (n/a)27.00 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (-13.48%)0.05 (-17.79%)0.05 (-15.33%)0.03 (-25.09%)0.01 (+6.67%)267.00 (+33.50%)176.80 (+24.51%)150.00 (+18.11%)141.00 (+15.57%)47.41 (+61.41%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)142.00 (n/a)127.00 (n/a)122.00 (n/a)29.37 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (+13.38%)0.05 (+23.85%)0.05 (+37.91%)0.05 (+30.72%)0.00 (-56.85%)166.00 (-23.50%)153.40 (-20.60%)153.00 (-27.49%)142.00 (-11.80%)7.63 (-70.60%)
0999a9a — 2025-11-13 19:24:080.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)217.00 (n/a)193.20 (n/a)211.00 (n/a)161.00 (n/a)25.96 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (+3.08%)0.05 (-4.97%)0.04 (-10.17%)0.04 (-3.50%)0.01 (+1.48%)200.00 (+3.63%)170.00 (+5.33%)177.00 (+11.32%)130.00 (-2.99%)25.45 (+2.91%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)193.00 (n/a)161.40 (n/a)159.00 (n/a)134.00 (n/a)24.73 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.05 (+2.84%)0.05 (+7.95%)0.05 (+13.82%)0.04 (+17.65%)0.00 (-42.20%)170.00 (-15.00%)154.20 (-8.32%)152.00 (-12.14%)141.00 (-2.76%)10.01 (-50.96%)
2621de6 — 2025-11-25 17:47:120.05 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)168.20 (n/a)173.00 (n/a)145.00 (n/a)20.41 (n/a)

mha

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)
79a467d — 2025-11-25 18:04:591.48 (-0.68%)1.48 (-0.27%)1.48 (-0.09%)1.48 (-0.10%)0.00 (-49.57%)758.83 (-0.68%)757.43 (-0.27%)757.93 (-0.09%)755.64 (-0.10%)1.35 (-49.59%)
2621de6 — 2025-11-25 17:47:121.49 (n/a)1.48 (n/a)1.48 (n/a)1.48 (n/a)0.01 (n/a)764.02 (n/a)759.47 (n/a)758.58 (n/a)756.41 (n/a)2.68 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (-26.81%)0.05 (+2.76%)0.05 (+18.75%)0.05 (+19.14%)0.00 (-75.36%)162.00 (-16.06%)148.80 (-7.23%)144.00 (-15.79%)138.00 (+36.63%)9.43 (-70.11%)
2621de6 — 2025-11-25 17:47:120.08 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)193.00 (n/a)160.40 (n/a)171.00 (n/a)101.00 (n/a)31.56 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (+4.00%)0.05 (+25.34%)0.05 (+12.93%)0.04 (+53.01%)0.01 (-45.64%)183.00 (-34.64%)149.20 (-25.70%)147.00 (-11.45%)125.00 (-3.85%)19.52 (-67.33%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.04 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)280.00 (n/a)200.80 (n/a)166.00 (n/a)130.00 (n/a)59.74 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (+1.56%)0.05 (+17.54%)0.05 (+22.54%)0.05 (+48.73%)0.00 (-60.69%)158.00 (-32.77%)142.20 (-18.18%)142.00 (-18.39%)128.00 (-1.54%)9.77 (-73.67%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)235.00 (n/a)173.80 (n/a)174.00 (n/a)130.00 (n/a)37.09 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (+15.50%)0.05 (+17.49%)0.05 (+13.29%)0.04 (+26.42%)0.01 (-9.99%)193.00 (-20.90%)158.60 (-16.00%)158.00 (-11.73%)129.00 (-13.42%)20.40 (-38.72%)
2621de6 — 2025-11-25 17:47:120.05 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)244.00 (n/a)188.80 (n/a)179.00 (n/a)149.00 (n/a)33.30 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.10 (+35.29%)0.08 (+19.07%)0.08 (+15.23%)0.06 (+8.51%)0.01 (+133.25%)188.00 (-7.84%)151.00 (-14.50%)151.00 (-13.22%)119.00 (-26.09%)23.77 (+57.36%)
2621de6 — 2025-11-25 17:47:120.07 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)204.00 (n/a)176.60 (n/a)174.00 (n/a)161.00 (n/a)15.11 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.09 (+37.60%)0.07 (+42.68%)0.08 (+77.85%)0.05 (+22.31%)0.02 (+56.71%)251.00 (-18.24%)174.00 (-28.34%)149.00 (-43.77%)125.00 (-27.33%)48.22 (-5.25%)
2621de6 — 2025-11-25 17:47:120.07 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)307.00 (n/a)242.80 (n/a)265.00 (n/a)172.00 (n/a)50.89 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.09 (+83.59%)0.07 (+64.28%)0.07 (+79.08%)0.05 (+28.51%)0.01 (+234.02%)228.00 (-22.18%)167.60 (-37.32%)153.00 (-44.16%)128.00 (-45.53%)33.94 (+44.45%)
2621de6 — 2025-11-25 17:47:120.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)293.00 (n/a)267.40 (n/a)274.00 (n/a)235.00 (n/a)23.50 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.08 (-1.36%)0.06 (-11.21%)0.06 (-9.24%)0.04 (-34.17%)0.01 (+132.97%)278.00 (+51.91%)193.40 (+18.07%)184.00 (+10.18%)147.00 (+1.38%)47.71 (+255.45%)
2621de6 — 2025-11-25 17:47:120.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)183.00 (n/a)163.80 (n/a)167.00 (n/a)145.00 (n/a)13.42 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.08 (+28.17%)0.07 (+31.55%)0.07 (+45.40%)0.04 (+8.75%)0.01 (+38.74%)263.00 (-8.04%)180.00 (-22.88%)174.00 (-31.23%)142.00 (-21.98%)43.58 (+5.06%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)286.00 (n/a)233.40 (n/a)253.00 (n/a)182.00 (n/a)41.48 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.07 (-13.29%)0.06 (-18.35%)0.05 (-26.61%)0.05 (-20.65%)0.01 (+1.23%)247.00 (+26.02%)210.00 (+23.09%)218.00 (+36.25%)173.00 (+15.33%)26.39 (+44.00%)
2621de6 — 2025-11-25 17:47:120.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)196.00 (n/a)170.60 (n/a)160.00 (n/a)150.00 (n/a)18.33 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.07 (+3.11%)0.05 (-13.65%)0.05 (-12.99%)0.03 (-20.29%)0.01 (+9.35%)340.00 (+25.46%)252.40 (+17.72%)254.00 (+14.93%)161.00 (-3.01%)56.65 (+33.07%)
2621de6 — 2025-11-25 17:47:120.07 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)271.00 (n/a)214.40 (n/a)221.00 (n/a)166.00 (n/a)42.57 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.07 (+6.43%)0.05 (+11.00%)0.05 (+23.15%)0.03 (-4.53%)0.01 (+4.19%)375.00 (+4.75%)244.80 (-9.67%)216.00 (-18.80%)171.00 (-6.04%)74.62 (+0.52%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)358.00 (n/a)271.00 (n/a)266.00 (n/a)182.00 (n/a)74.23 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.15 (-2.58%)0.13 (-6.83%)0.12 (-10.64%)0.11 (-8.74%)0.01 (+35.66%)206.00 (+9.57%)180.20 (+7.90%)188.00 (+11.90%)155.00 (+2.65%)18.36 (+50.08%)
2621de6 — 2025-11-25 17:47:120.15 (n/a)0.14 (n/a)0.14 (n/a)0.12 (n/a)0.01 (n/a)188.00 (n/a)167.00 (n/a)168.00 (n/a)151.00 (n/a)12.23 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.18 (-3.15%)0.15 (-12.11%)0.14 (-14.11%)0.12 (-20.00%)0.02 (+60.15%)190.00 (+25.00%)160.20 (+15.92%)163.00 (+16.43%)127.00 (+3.25%)25.69 (+107.96%)
2621de6 — 2025-11-25 17:47:120.19 (n/a)0.17 (n/a)0.16 (n/a)0.15 (n/a)0.02 (n/a)152.00 (n/a)138.20 (n/a)140.00 (n/a)123.00 (n/a)12.35 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.16 (-11.81%)0.13 (-10.95%)0.12 (-10.16%)0.12 (+2.53%)0.02 (-41.85%)198.00 (-2.46%)178.00 (+9.88%)187.00 (+11.31%)144.00 (+13.39%)20.35 (-32.79%)
2621de6 — 2025-11-25 17:47:120.18 (n/a)0.15 (n/a)0.14 (n/a)0.11 (n/a)0.03 (n/a)203.00 (n/a)162.00 (n/a)168.00 (n/a)127.00 (n/a)30.27 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.14 (-15.85%)0.12 (-13.89%)0.12 (-15.63%)0.10 (-12.27%)0.01 (-14.97%)220.00 (+13.99%)194.40 (+16.13%)192.00 (+18.52%)164.00 (+18.84%)22.71 (+17.15%)
2621de6 — 2025-11-25 17:47:120.17 (n/a)0.14 (n/a)0.14 (n/a)0.12 (n/a)0.02 (n/a)193.00 (n/a)167.40 (n/a)162.00 (n/a)138.00 (n/a)19.39 (n/a)

sigmoid_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.07 (+10.81%)0.06 (+6.37%)0.06 (+10.85%)0.05 (+8.55%)0.01 (+17.28%)152.00 (-7.88%)133.00 (-5.81%)129.00 (-9.79%)111.00 (-9.76%)15.17 (+0.05%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)165.00 (n/a)141.20 (n/a)143.00 (n/a)123.00 (n/a)15.16 (n/a)

sigmoid_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (-4.96%)0.05 (-6.09%)0.05 (-2.08%)0.03 (-32.91%)0.01 (+68.78%)237.00 (+49.06%)155.60 (+11.46%)144.00 (+2.13%)121.00 (+5.22%)42.49 (+168.18%)
2621de6 — 2025-11-25 17:47:120.07 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)159.00 (n/a)139.60 (n/a)141.00 (n/a)115.00 (n/a)15.84 (n/a)

sigmoid_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (-2.90%)0.04 (+0.72%)0.05 (+6.06%)0.03 (+1.57%)0.01 (-15.63%)254.00 (-1.55%)180.60 (-2.06%)165.00 (-5.71%)138.00 (+2.99%)39.75 (-11.13%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)258.00 (n/a)184.40 (n/a)175.00 (n/a)134.00 (n/a)44.72 (n/a)

sigmoid_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.05 (-11.32%)0.04 (-13.21%)0.04 (-6.15%)0.02 (-38.51%)0.01 (+56.76%)322.00 (+62.63%)210.40 (+20.92%)195.00 (+6.56%)159.00 (+12.77%)58.54 (+199.70%)
2621de6 — 2025-11-25 17:47:120.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)198.00 (n/a)174.00 (n/a)183.00 (n/a)141.00 (n/a)19.53 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (-5.15%)0.05 (+1.44%)0.05 (+8.33%)0.03 (-8.06%)0.01 (-10.31%)273.00 (+8.76%)176.40 (-1.45%)156.00 (-7.69%)136.00 (+5.43%)49.08 (+10.28%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)251.00 (n/a)179.00 (n/a)169.00 (n/a)129.00 (n/a)44.51 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.05 (-27.61%)0.04 (-8.60%)0.05 (+1.80%)0.03 (+5.53%)0.01 (-50.67%)253.00 (-5.24%)182.80 (+3.51%)167.00 (-1.76%)163.00 (+38.14%)35.16 (-33.90%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)267.00 (n/a)176.60 (n/a)170.00 (n/a)118.00 (n/a)53.19 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.05 (-17.12%)0.05 (-15.23%)0.05 (-1.32%)0.03 (-25.44%)0.01 (+2.50%)228.00 (+34.12%)171.60 (+19.33%)152.00 (+1.33%)146.00 (+20.66%)30.58 (+69.42%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)170.00 (n/a)143.80 (n/a)150.00 (n/a)121.00 (n/a)18.05 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.05 (-12.50%)0.04 (-11.19%)0.04 (-8.95%)0.03 (-17.87%)0.00 (+6.75%)235.00 (+21.76%)194.60 (+13.14%)190.00 (+9.83%)168.00 (+14.29%)22.50 (+53.38%)
2621de6 — 2025-11-25 17:47:120.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)193.00 (n/a)172.00 (n/a)173.00 (n/a)147.00 (n/a)14.67 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.18 (-6.92%)0.15 (-5.64%)0.14 (-9.64%)0.14 (-0.60%)0.02 (-15.12%)167.00 (+0.60%)155.40 (+5.71%)166.00 (+10.67%)130.00 (+7.44%)14.81 (-6.46%)
2621de6 — 2025-11-25 17:47:120.19 (n/a)0.16 (n/a)0.15 (n/a)0.14 (n/a)0.02 (n/a)166.00 (n/a)147.00 (n/a)150.00 (n/a)121.00 (n/a)15.84 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.18 (-10.94%)0.16 (+3.80%)0.15 (+0.65%)0.14 (+49.37%)0.01 (-63.15%)160.00 (-33.05%)147.20 (-9.47%)153.00 (-0.65%)128.00 (+12.28%)12.54 (-71.99%)
2621de6 — 2025-11-25 17:47:120.20 (n/a)0.15 (n/a)0.15 (n/a)0.10 (n/a)0.04 (n/a)239.00 (n/a)162.60 (n/a)154.00 (n/a)114.00 (n/a)44.78 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.16 (-12.93%)0.15 (-3.50%)0.15 (-2.60%)0.13 (+16.48%)0.01 (-62.88%)176.00 (-14.15%)157.20 (+1.29%)154.00 (+2.67%)147.00 (+14.84%)9.83 (-63.47%)
2621de6 — 2025-11-25 17:47:120.18 (n/a)0.15 (n/a)0.15 (n/a)0.11 (n/a)0.02 (n/a)205.00 (n/a)155.20 (n/a)150.00 (n/a)128.00 (n/a)26.90 (n/a)

swiglu

No metrics available.

tanh_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.05 (-23.65%)0.04 (-16.86%)0.05 (-6.13%)0.03 (-30.71%)0.01 (-17.97%)254.00 (+44.32%)178.20 (+21.39%)163.00 (+6.54%)148.00 (+30.97%)38.35 (+63.31%)
2621de6 — 2025-11-25 17:47:120.07 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)176.00 (n/a)146.80 (n/a)153.00 (n/a)113.00 (n/a)23.48 (n/a)

tanh_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (-18.66%)0.05 (-14.29%)0.05 (-19.48%)0.03 (-4.68%)0.01 (-30.22%)235.00 (+4.91%)167.60 (+13.86%)154.00 (+24.19%)134.00 (+22.94%)36.73 (-11.58%)
2621de6 — 2025-11-25 17:47:120.07 (n/a)0.06 (n/a)0.06 (n/a)0.03 (n/a)0.01 (n/a)224.00 (n/a)147.20 (n/a)124.00 (n/a)109.00 (n/a)41.54 (n/a)

tanh_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.06 (+0.00%)0.05 (-15.07%)0.05 (-12.74%)0.03 (-35.85%)0.01 (+71.35%)265.00 (+55.88%)171.80 (+23.78%)157.00 (+14.60%)123.00 (+0.00%)48.44 (+184.77%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)170.00 (n/a)138.80 (n/a)137.00 (n/a)123.00 (n/a)17.01 (n/a)

tanh_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.07 (+17.59%)0.06 (+9.68%)0.06 (+15.32%)0.04 (-8.29%)0.01 (+73.77%)193.00 (+9.04%)135.40 (-6.49%)124.00 (-13.29%)108.00 (-14.96%)29.64 (+68.42%)
2621de6 — 2025-11-25 17:47:120.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)177.00 (n/a)144.80 (n/a)143.00 (n/a)127.00 (n/a)17.60 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:593.28 (+4.03%)2.75 (-7.33%)2.76 (-5.65%)2.19 (-24.22%)0.36 (+264.44%)223.00 (+31.95%)181.00 (+9.70%)177.00 (+5.99%)149.00 (-3.87%)24.43 (+368.41%)
2621de6 — 2025-11-25 17:47:123.15 (n/a)2.96 (n/a)2.92 (n/a)2.89 (n/a)0.10 (n/a)169.00 (n/a)165.00 (n/a)167.00 (n/a)155.00 (n/a)5.22 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:593.01 (-22.22%)2.80 (-13.23%)2.73 (-15.64%)2.58 (-2.65%)0.18 (-57.10%)189.00 (+2.72%)175.00 (+13.78%)179.00 (+18.54%)162.00 (+28.57%)11.08 (-44.32%)
2621de6 — 2025-11-25 17:47:123.88 (n/a)3.23 (n/a)3.23 (n/a)2.65 (n/a)0.42 (n/a)184.00 (n/a)153.80 (n/a)151.00 (n/a)126.00 (n/a)19.90 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.09 (+10.16%)0.07 (+6.98%)0.07 (+3.85%)0.06 (+13.04%)0.01 (+22.07%)184.00 (-11.54%)155.80 (-6.26%)156.00 (-3.70%)128.00 (-9.22%)21.58 (-4.41%)
2621de6 — 2025-11-25 17:47:120.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)208.00 (n/a)166.20 (n/a)162.00 (n/a)141.00 (n/a)22.58 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.09 (-6.02%)0.07 (-7.41%)0.07 (-10.06%)0.06 (+5.26%)0.01 (-32.50%)190.00 (-5.00%)165.80 (+6.15%)169.00 (+11.18%)133.00 (+6.40%)19.75 (-30.99%)
2621de6 — 2025-11-25 17:47:120.09 (n/a)0.08 (n/a)0.08 (n/a)0.06 (n/a)0.01 (n/a)200.00 (n/a)156.20 (n/a)152.00 (n/a)125.00 (n/a)28.62 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.08 (-21.23%)0.07 (+5.91%)0.07 (+6.29%)0.07 (+101.75%)0.00 (-80.83%)171.00 (-50.43%)158.20 (-17.00%)159.00 (-5.92%)146.00 (+26.96%)8.93 (-88.84%)
2621de6 — 2025-11-25 17:47:120.10 (n/a)0.07 (n/a)0.07 (n/a)0.03 (n/a)0.02 (n/a)345.00 (n/a)190.60 (n/a)169.00 (n/a)115.00 (n/a)79.99 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
79a467d — 2025-11-25 18:04:590.08 (-12.24%)0.07 (+8.45%)0.06 (+3.95%)0.06 (+73.80%)0.01 (-65.82%)187.00 (-42.46%)173.20 (-15.10%)177.00 (-3.80%)147.00 (+13.95%)13.92 (-78.78%)
2621de6 — 2025-11-25 17:47:120.09 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.02 (n/a)325.00 (n/a)204.00 (n/a)184.00 (n/a)129.00 (n/a)65.60 (n/a)

@github-actions
Copy link
Copy Markdown
Contributor

📊 Test Results for Test Example Applications

79a467d (2025_11_25_18_22_29)

IRONCLAD

Tested on 2025_11_25_18_22_29 at commit 79a467d.

Test Checks TTFT (mean)TPS (mean)
llama_3.2_1b ✅ 5/5 4.17 4.61
📈 Trends (vs main branch) for Test Example Applications

79a467d (2025_11_25_18_22_29)

IRONCLAD Trends

llama_3.2_1b

Commit/Date Num Tokens (max)Num Tokens (mean)Num Tokens (median)Num Tokens (min)Num Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)Total (max)Total (mean)Total (median)Total (min)Total (stddev)
79a467d — 2025-11-25 18:17:5840.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)0.00 (n/a)4.69 (-2.49%)4.61 (-2.54%)4.62 (-1.70%)4.54 (-2.99%)0.05 (-1.64%)4.30 (+1.76%)4.17 (+0.92%)4.20 (+1.82%)3.97 (-2.16%)0.11 (+104.38%)12.83 (+2.49%)12.63 (+2.08%)12.66 (+1.89%)12.28 (+0.41%)0.19 (+66.67%)
2621de6 — 2025-11-25 18:09:4840.00 (n/a)40.00 (n/a)40.00 (n/a)40.00 (n/a)0.00 (n/a)4.81 (n/a)4.73 (n/a)4.70 (n/a)4.68 (n/a)0.05 (n/a)4.22 (n/a)4.13 (n/a)4.13 (n/a)4.05 (n/a)0.05 (n/a)12.51 (n/a)12.37 (n/a)12.42 (n/a)12.23 (n/a)0.11 (n/a)

@hunhoffe hunhoffe merged commit 9e98049 into devel Nov 25, 2025
4 checks passed
@hunhoffe hunhoffe deleted the test-wheels-specific branch November 25, 2025 20:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants