Llama: Runlist-based SwiGLU by andrej · Pull Request #11 · amd/IRON

andrej · 2025-11-13T17:57:25Z

Builds on #10.

Added

Introduce runlist-based SwiGLU

Changed

Use XRT runlist for run_runlist in AIE operations
Small fix to compilation steps

PR Merge Checklist

The PR is rebased on the latest devel commit and pointing to devel.
Your PR has been reviewed and approved.
All checks are passing.

To Do

Address Comment from Curt on original PR in internal repo:

Would it be better to have an abstract get_artifacts() method in the base class that child classes have to override?
Double check why output looks slightly different after this -- changes to RNG were the root cause of this
Double check all combinations of configuration options still work

andrej · 2025-11-13T21:40:58Z

Changed base to PR #10 to make the diff smaller and review easier. The idea is to merge #10 first, then merge this into devel.

applications/llama_3.2_1b/src/block/feed_forward.py

applications/llama_3.2_1b/src/operator/aie_elementwise_mul.py

applications/llama_3.2_1b/src/operator/aie_swiglu_decode.py

applications/llama_3.2_1b/src/operator/aie_gemm.py

kurtis-b-1

Had some minor comments and remarks about potential future PRs. But overall looks good to me.

This reverts commit ae64317.

github-actions · 2025-11-20T01:26:10Z

📊 Test Results for Small Benchmark/Test Suite

0df96f5 (2025_11_20_01_25_51)

IRONCLAD

Tested on 2025_11_20_01_25_51 at commit 0df96f5.

Test	Checks	Latency (mean)	Bandwidth (mean)	GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0	✅ 5/5	215.80	0.06	n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0	✅ 5/5	163.20	0.07	n/a
axpy_4_cols_2_channels_2048_tile_512_3.0	✅ 5/5	149.60	0.08	n/a
axpy_8_cols_2_channels_2048_tile_256_3.0	✅ 5/5	167.00	0.07	n/a
dequant_1_cols_1_channels_2048_tile_2048	✅ 5/5	214.00	0.02	n/a
dequant_1_cols_2_channels_2048_tile_1024	✅ 5/5	174.00	0.03	n/a
dequant_2_cols_1_channels_2048_tile_1024	✅ 5/5	171.60	0.03	n/a
dequant_2_cols_2_channels_2048_tile_512	✅ 5/5	137.40	0.04	n/a
dequant_4_cols_1_channels_2048_tile_512	✅ 5/5	155.20	0.03	n/a
dequant_4_cols_2_channels_2048_tile_256	✅ 5/5	164.20	0.03	n/a
dequant_8_cols_1_channels_2048_tile_256	✅ 5/5	174.80	0.03	n/a
dequant_8_cols_2_channels_2048_tile_128	✅ 5/5	171.40	0.03	n/a
eltwise_add_1_cols_2_channels_2048_tile_2048	✅ 5/5	143.60	0.08	n/a
eltwise_add_2_cols_2_channels_2048_tile_1024	✅ 5/5	146.00	0.08	n/a
eltwise_add_4_cols_2_channels_2048_tile_512	✅ 5/5	134.20	0.09	n/a
eltwise_add_8_cols_2_channels_2048_tile_256	✅ 5/5	192.80	0.07	n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048	✅ 5/5	144.80	0.09	n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024	✅ 5/5	139.80	0.08	n/a
eltwise_mul_4_cols_2_channels_2048_tile_512	✅ 5/5	136.80	0.08	n/a
eltwise_mul_8_cols_2_channels_2048_tile_256	✅ 5/5	152.40	0.08	n/a
gelu_1_cols_1_channels_2048_tile_2048	✅ 5/5	137.40	0.06	n/a
gelu_1_cols_2_channels_2048_tile_1024	✅ 5/5	129.00	0.06	n/a
gelu_2_cols_1_channels_2048_tile_1024	✅ 5/5	135.20	0.06	n/a
gelu_2_cols_2_channels_2048_tile_512	✅ 5/5	142.00	0.06	n/a
gelu_4_cols_1_channels_2048_tile_512	✅ 5/5	163.00	0.05	n/a
gelu_4_cols_2_channels_2048_tile_256	✅ 5/5	169.00	0.05	n/a
gelu_8_cols_1_channels_2048_tile_256	✅ 5/5	190.00	0.04	n/a
gelu_8_cols_2_channels_2048_tile_128	✅ 5/5	246.20	0.04	n/a
gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0	✅ 5/5	6689.80	3.51	2570.52
layer_norm_1_cols_1_channels_2048_tile_2048	✅ 5/5	212.60	0.06	n/a
layer_norm_1_cols_2_channels_2048_tile_1024	✅ 5/5	137.80	0.09	n/a
layer_norm_2_cols_1_channels_2048_tile_1024	✅ 5/5	155.80	0.08	n/a
layer_norm_2_cols_2_channels_2048_tile_512	✅ 5/5	145.20	0.09	n/a
layer_norm_4_cols_1_channels_2048_tile_512	✅ 5/5	160.60	0.08	n/a
layer_norm_4_cols_2_channels_2048_tile_256	✅ 5/5	161.40	0.08	n/a
layer_norm_8_cols_1_channels_2048_tile_256	✅ 5/5	157.60	0.08	n/a
layer_norm_8_cols_2_channels_2048_tile_128	✅ 5/5	169.80	0.08	n/a
matrix_vector_mul_128x128_32_1col	✅ 5/5	855.20	0.04	0.04
matrix_vector_mul_2048x8192_1_1col	✅ 5/5	3116.40	10.78	10.78
matrix_vector_mul_2048x8192_1_2col	✅ 5/5	2097.20	16.03	16.02
matrix_vector_mul_2048x8192_1_4col	✅ 5/5	1784.40	19.08	19.06
matrix_vector_mul_2048x8192_1_8col	✅ 5/5	2117.00	15.99	15.98
matrix_vector_mul_8192x2048_4_1col	✅ 5/5	3191.60	10.53	10.52
matrix_vector_mul_8192x2048_4_2col	✅ 5/5	2047.00	16.42	16.41
matrix_vector_mul_8192x2048_4_4col	✅ 5/5	1624.80	20.75	20.73
matrix_vector_mul_8192x2048_4_8col	✅ 5/5	1982.80	17.21	17.20
mem_copy_16_cores_2_chans_2048_tile_128_False	✅ 5/5	217.20	0.04	n/a
mem_copy_1_cores_1_chans_2048_tile_2048_False	✅ 5/5	129.20	0.06	n/a
mem_copy_2_cores_1_chans_2048_tile_1024_False	✅ 5/5	152.80	0.05	n/a
mem_copy_2_cores_2_chans_2048_tile_1024_False	✅ 5/5	162.00	0.05	n/a
mem_copy_4_cores_1_chans_2048_tile_512_False	✅ 5/5	147.40	0.05	n/a
mem_copy_4_cores_2_chans_2048_tile_512_False	✅ 5/5	148.00	0.05	n/a
mem_copy_8_cores_1_chans_2048_tile_256_False	✅ 5/5	161.20	0.05	n/a
mem_copy_8_cores_2_chans_2048_tile_256_False	✅ 5/5	178.00	0.04	n/a
mha	✅ 5/5	n/a	0.09	63.27
relu_1_cols_1_channels_2048_tile_2048	✅ 5/5	146.40	0.05	n/a
relu_2_cols_1_channels_2048_tile_1024	✅ 5/5	149.00	0.05	n/a
relu_4_cols_1_channels_2048_tile_512	✅ 5/5	197.40	0.04	n/a
relu_8_cols_1_channels_2048_tile_256	✅ 5/5	176.20	0.04	n/a
rms_norm_1_cols_1_channels_2048_tile_2048	✅ 5/5	188.20	0.06	n/a
rms_norm_1_cols_2_channels_2048_tile_1024	✅ 5/5	162.00	0.07	n/a
rms_norm_2_cols_1_channels_2048_tile_1024	✅ 5/5	213.20	0.06	n/a
rms_norm_2_cols_2_channels_2048_tile_512	✅ 5/5	175.60	0.07	n/a
rms_norm_4_cols_1_channels_2048_tile_512	✅ 5/5	155.20	0.08	n/a
rms_norm_4_cols_2_channels_2048_tile_256	✅ 5/5	178.60	0.07	n/a
rms_norm_8_cols_1_channels_2048_tile_256	✅ 5/5	190.60	0.07	n/a
rms_norm_8_cols_2_channels_2048_tile_128	✅ 5/5	190.20	0.07	n/a
rope_1_cols_2_channels_4096_tile_4096_0	✅ 5/5	181.60	0.14	n/a
rope_2_cols_2_channels_4096_tile_2048_0	✅ 5/5	146.00	0.16	n/a
rope_4_cols_2_channels_4096_tile_1024_0	✅ 5/5	163.00	0.15	n/a
rope_8_cols_2_channels_4096_tile_512_0	✅ 5/5	179.20	0.13	n/a
silu_1_cols_1_channels_2048_tile_2048	✅ 5/5	163.40	0.05	n/a
silu_2_cols_1_channels_2048_tile_1024	✅ 5/5	138.40	0.06	n/a
silu_4_cols_1_channels_2048_tile_512	✅ 5/5	147.80	0.05	n/a
silu_8_cols_1_channels_2048_tile_256	✅ 5/5	178.00	0.05	n/a
softmax_1_cols_2_channels_4096_tile_2048	✅ 5/5	142.60	0.16	n/a
softmax_2_cols_2_channels_4096_tile_1024	✅ 5/5	165.00	0.14	n/a
softmax_2_cols_2_channels_4096_tile_512	✅ 5/5	142.20	0.16	n/a
swiglu	✅ 5/5	n/a	n/a	n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s	✅ 5/5	164.40	2.99	n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s	✅ 5/5	185.60	2.71	n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048	✅ 5/5	139.00	0.09	n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024	✅ 5/5	163.80	0.07	n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512	✅ 5/5	137.40	0.09	n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256	✅ 5/5	171.00	0.07	n/a

📈 Trends (vs main branch) for Small Benchmark/Test Suite

0df96f5 (2025_11_20_01_25_51)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.08 (-16.79%)	0.06 (-12.88%)	0.06 (-9.78%)	0.03 (-28.45%)	0.02 (-17.56%)	362.00 (+39.77%)	215.80 (+16.15%)	184.00 (+10.84%)	137.00 (+20.18%)	77.40 (+40.72%)
`85aed8a` — 2025-11-19 20:26:05	0.10 (n/a)	0.07 (n/a)	0.07 (n/a)	0.04 (n/a)	0.02 (n/a)	259.00 (n/a)	185.80 (n/a)	166.00 (n/a)	114.00 (n/a)	55.00 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.08 (+16.08%)	0.07 (+22.15%)	0.07 (+8.92%)	0.06 (+47.80%)	0.01 (-46.90%)	182.00 (-32.34%)	163.20 (-21.31%)	157.00 (-8.19%)	143.00 (-13.86%)	14.63 (-68.69%)
`85aed8a` — 2025-11-19 20:26:05	0.07 (n/a)	0.06 (n/a)	0.07 (n/a)	0.04 (n/a)	0.01 (n/a)	269.00 (n/a)	207.40 (n/a)	171.00 (n/a)	166.00 (n/a)	46.74 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (+26.77%)	0.08 (+19.41%)	0.08 (+17.12%)	0.06 (+8.29%)	0.01 (+76.00%)	181.00 (-7.65%)	149.60 (-15.58%)	146.00 (-14.62%)	127.00 (-21.12%)	18.56 (+27.94%)
`85aed8a` — 2025-11-19 20:26:05	0.07 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	196.00 (n/a)	177.20 (n/a)	171.00 (n/a)	161.00 (n/a)	14.51 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (+13.95%)	0.07 (+6.15%)	0.07 (+5.49%)	0.05 (-11.76%)	0.01 (+79.70%)	221.00 (+13.33%)	167.00 (-3.80%)	164.00 (-5.20%)	129.00 (-12.24%)	30.22 (+83.02%)
`85aed8a` — 2025-11-19 20:26:05	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	195.00 (n/a)	173.60 (n/a)	173.00 (n/a)	147.00 (n/a)	16.51 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.03 (-9.70%)	0.02 (-15.81%)	0.02 (-22.47%)	0.02 (-5.26%)	0.00 (-10.84%)	247.00 (+5.56%)	214.00 (+18.49%)	227.00 (+28.98%)	165.00 (+10.74%)	28.58 (-0.40%)
`85aed8a` — 2025-11-19 20:26:05	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.00 (n/a)	234.00 (n/a)	180.60 (n/a)	176.00 (n/a)	149.00 (n/a)	28.70 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.03 (-14.29%)	0.03 (-3.67%)	0.03 (-7.83%)	0.03 (+26.67%)	0.00 (-59.89%)	195.00 (-21.05%)	174.00 (-0.57%)	166.00 (+8.50%)	154.00 (+16.67%)	15.45 (-63.04%)
`85aed8a` — 2025-11-19 20:26:05	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	247.00 (n/a)	175.00 (n/a)	153.00 (n/a)	132.00 (n/a)	41.81 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.03 (-19.48%)	0.03 (-15.18%)	0.03 (-12.58%)	0.02 (-9.59%)	0.00 (-36.48%)	219.00 (+10.61%)	171.60 (+16.42%)	159.00 (+14.39%)	154.00 (+24.19%)	24.14 (-11.19%)
`85aed8a` — 2025-11-19 20:26:05	0.04 (n/a)	0.03 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	198.00 (n/a)	147.40 (n/a)	139.00 (n/a)	124.00 (n/a)	27.18 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.04 (+42.34%)	0.04 (+28.21%)	0.03 (+20.28%)	0.03 (+31.33%)	0.00 (+87.85%)	150.00 (-23.86%)	137.40 (-21.58%)	143.00 (-16.86%)	111.00 (-29.75%)	14.01 (-1.08%)
`85aed8a` — 2025-11-19 20:26:05	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.00 (n/a)	197.00 (n/a)	175.20 (n/a)	172.00 (n/a)	158.00 (n/a)	14.16 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.04 (-1.60%)	0.03 (+2.41%)	0.03 (+12.77%)	0.02 (-25.54%)	0.01 (+56.48%)	231.00 (+34.30%)	155.20 (+1.04%)	141.00 (-11.32%)	125.00 (+1.63%)	38.64 (+126.49%)
`85aed8a` — 2025-11-19 20:26:05	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.00 (n/a)	172.00 (n/a)	153.60 (n/a)	159.00 (n/a)	123.00 (n/a)	17.06 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.04 (+36.36%)	0.03 (+17.65%)	0.03 (+6.98%)	0.02 (+2.53%)	0.01 (+208.32%)	198.00 (-2.46%)	164.20 (-12.19%)	172.00 (-6.52%)	121.00 (-26.67%)	30.83 (+121.35%)
`85aed8a` — 2025-11-19 20:26:05	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.00 (n/a)	203.00 (n/a)	187.00 (n/a)	184.00 (n/a)	165.00 (n/a)	13.93 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.04 (+5.60%)	0.03 (-1.70%)	0.03 (+0.67%)	0.02 (-24.91%)	0.01 (+46.55%)	265.00 (+33.17%)	174.80 (+5.94%)	150.00 (-0.66%)	125.00 (-5.30%)	48.85 (+85.96%)
`85aed8a` — 2025-11-19 20:26:05	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.00 (n/a)	199.00 (n/a)	165.00 (n/a)	151.00 (n/a)	132.00 (n/a)	26.27 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.03 (+5.73%)	0.03 (+9.65%)	0.03 (+10.30%)	0.03 (+16.32%)	0.00 (-28.26%)	190.00 (-14.03%)	171.40 (-9.50%)	165.00 (-9.34%)	157.00 (-5.42%)	13.12 (-41.11%)
`85aed8a` — 2025-11-19 20:26:05	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.00 (n/a)	221.00 (n/a)	189.40 (n/a)	182.00 (n/a)	166.00 (n/a)	22.29 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.08 (+4.44%)	0.08 (+22.92%)	0.08 (+32.64%)	0.08 (+42.00%)	0.00 (-71.59%)	150.00 (-29.58%)	143.60 (-20.40%)	144.00 (-24.61%)	135.00 (-4.26%)	5.08 (-80.77%)
`85aed8a` — 2025-11-19 20:26:05	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	213.00 (n/a)	180.40 (n/a)	191.00 (n/a)	141.00 (n/a)	26.44 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.10 (+8.77%)	0.08 (+8.88%)	0.08 (+18.31%)	0.06 (-5.56%)	0.01 (+21.08%)	198.00 (+5.88%)	146.00 (-7.12%)	142.00 (-15.48%)	114.00 (-8.06%)	29.61 (+19.72%)
`85aed8a` — 2025-11-19 20:26:05	0.09 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	187.00 (n/a)	157.20 (n/a)	168.00 (n/a)	124.00 (n/a)	24.73 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (+2.34%)	0.09 (+15.97%)	0.09 (+22.73%)	0.08 (+26.57%)	0.00 (-60.18%)	143.00 (-20.99%)	134.20 (-15.06%)	132.00 (-18.52%)	128.00 (-2.29%)	6.21 (-69.51%)
`85aed8a` — 2025-11-19 20:26:05	0.09 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	181.00 (n/a)	158.00 (n/a)	162.00 (n/a)	131.00 (n/a)	20.37 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.11 (+58.49%)	0.07 (+30.66%)	0.06 (+17.32%)	0.04 (+1.55%)	0.02 (+86.33%)	322.00 (-1.53%)	192.80 (-18.72%)	179.00 (-14.76%)	106.00 (-36.90%)	70.72 (+15.59%)
`85aed8a` — 2025-11-19 20:26:05	0.07 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	327.00 (n/a)	237.20 (n/a)	210.00 (n/a)	168.00 (n/a)	61.18 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.10 (+30.70%)	0.09 (+23.31%)	0.10 (+33.05%)	0.05 (-22.92%)	0.02 (+239.21%)	253.00 (+29.74%)	144.80 (-11.60%)	118.00 (-24.84%)	114.00 (-23.49%)	54.25 (+236.08%)
`85aed8a` — 2025-11-19 20:26:05	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	195.00 (n/a)	163.80 (n/a)	157.00 (n/a)	149.00 (n/a)	16.14 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.10 (+20.18%)	0.08 (+20.57%)	0.08 (+8.51%)	0.07 (+74.51%)	0.01 (-34.42%)	153.00 (-42.70%)	139.80 (-20.66%)	141.00 (-7.84%)	114.00 (-16.79%)	13.91 (-70.37%)
`85aed8a` — 2025-11-19 20:26:05	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.04 (n/a)	0.01 (n/a)	267.00 (n/a)	176.20 (n/a)	153.00 (n/a)	137.00 (n/a)	46.93 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (-3.88%)	0.08 (+22.80%)	0.09 (+14.18%)	0.07 (+67.32%)	0.00 (-74.28%)	153.00 (-40.23%)	136.80 (-24.84%)	134.00 (-12.42%)	129.00 (+4.03%)	8.42 (-84.34%)
`85aed8a` — 2025-11-19 20:26:05	0.09 (n/a)	0.07 (n/a)	0.07 (n/a)	0.04 (n/a)	0.02 (n/a)	256.00 (n/a)	182.00 (n/a)	153.00 (n/a)	124.00 (n/a)	53.80 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (+50.81%)	0.08 (+32.34%)	0.07 (+20.38%)	0.06 (+33.52%)	0.01 (+90.47%)	179.00 (-25.10%)	152.40 (-23.95%)	157.00 (-16.93%)	124.00 (-33.69%)	18.26 (-7.18%)
`85aed8a` — 2025-11-19 20:26:05	0.06 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.00 (n/a)	239.00 (n/a)	200.40 (n/a)	189.00 (n/a)	187.00 (n/a)	19.67 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.07 (-2.56%)	0.06 (+4.29%)	0.07 (+18.03%)	0.04 (-6.52%)	0.01 (+18.42%)	184.00 (+6.98%)	137.40 (-3.10%)	122.00 (-15.28%)	117.00 (+2.63%)	25.82 (+28.69%)
`85aed8a` — 2025-11-19 20:26:05	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	172.00 (n/a)	141.80 (n/a)	144.00 (n/a)	114.00 (n/a)	20.06 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.07 (+10.53%)	0.06 (+24.26%)	0.07 (+21.77%)	0.06 (+68.92%)	0.01 (-40.39%)	148.00 (-40.80%)	129.00 (-23.40%)	124.00 (-17.88%)	114.00 (-9.52%)	14.37 (-68.19%)
`85aed8a` — 2025-11-19 20:26:05	0.07 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	250.00 (n/a)	168.40 (n/a)	151.00 (n/a)	126.00 (n/a)	45.16 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.08 (+19.05%)	0.06 (+5.99%)	0.06 (-1.42%)	0.05 (+9.27%)	0.01 (+60.27%)	151.00 (-8.48%)	135.20 (-4.92%)	141.00 (+1.44%)	105.00 (-16.00%)	15.95 (+18.87%)
`85aed8a` — 2025-11-19 20:26:05	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	165.00 (n/a)	142.20 (n/a)	139.00 (n/a)	125.00 (n/a)	13.42 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.07 (+21.05%)	0.06 (+3.83%)	0.06 (+6.06%)	0.05 (-12.72%)	0.01 (+358.42%)	173.00 (+14.57%)	142.00 (-0.84%)	132.00 (-5.71%)	114.00 (-17.39%)	25.18 (+346.79%)
`85aed8a` — 2025-11-19 20:26:05	0.06 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.00 (n/a)	151.00 (n/a)	143.20 (n/a)	140.00 (n/a)	138.00 (n/a)	5.64 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.06 (+9.56%)	0.05 (+7.80%)	0.05 (+2.53%)	0.04 (+39.89%)	0.01 (-29.67%)	183.00 (-28.52%)	163.00 (-9.54%)	158.00 (-2.47%)	136.00 (-8.72%)	17.40 (-55.15%)
`85aed8a` — 2025-11-19 20:26:05	0.05 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	256.00 (n/a)	180.20 (n/a)	162.00 (n/a)	149.00 (n/a)	38.80 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.06 (-2.74%)	0.05 (-1.64%)	0.05 (-1.83%)	0.04 (+3.00%)	0.01 (-2.13%)	200.00 (-2.91%)	169.00 (+1.56%)	164.00 (+1.86%)	146.00 (+2.82%)	20.65 (-4.82%)
`85aed8a` — 2025-11-19 20:26:05	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	206.00 (n/a)	166.40 (n/a)	161.00 (n/a)	142.00 (n/a)	21.69 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.05 (+16.46%)	0.04 (+14.39%)	0.05 (+11.30%)	0.03 (+11.44%)	0.01 (+0.77%)	236.00 (-10.27%)	190.00 (-13.08%)	177.00 (-10.15%)	158.00 (-14.13%)	27.53 (-22.86%)
`85aed8a` — 2025-11-19 20:26:05	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	263.00 (n/a)	218.60 (n/a)	197.00 (n/a)	184.00 (n/a)	35.69 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.06 (+26.39%)	0.04 (+0.06%)	0.03 (-20.60%)	0.03 (+13.62%)	0.01 (+53.35%)	323.00 (-11.99%)	246.20 (+2.93%)	267.00 (+25.94%)	144.00 (-20.88%)	65.86 (+0.42%)
`85aed8a` — 2025-11-19 20:26:05	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	367.00 (n/a)	239.20 (n/a)	212.00 (n/a)	182.00 (n/a)	65.58 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	3.64 (-1.86%)	3.51 (-2.57%)	3.45 (-5.34%)	3.37 (+0.53%)	0.11 (-14.18%)	2667.68 (n/a)	2570.52 (n/a)	2526.82 (n/a)	2471.21 (n/a)	79.68 (n/a)	6952.00 (-0.53%)	6689.80 (+2.61%)	6799.00 (+5.64%)	6440.00 (+1.90%)	206.12 (-14.28%)
`85aed8a` — 2025-11-19 20:26:05	3.71 (n/a)	3.60 (n/a)	3.64 (n/a)	3.35 (n/a)	0.13 (n/a)	n/a (n/a)	n/a (n/a)	n/a (n/a)	n/a (n/a)	n/a (n/a)	6989.00 (n/a)	6519.80 (n/a)	6436.00 (n/a)	6320.00 (n/a)	240.46 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.08 (-20.51%)	0.06 (-26.00%)	0.07 (-11.11%)	0.04 (-41.95%)	0.02 (+61.14%)	298.00 (+72.25%)	212.60 (+43.65%)	171.00 (+12.50%)	156.00 (+25.81%)	60.23 (+253.71%)
`85aed8a` — 2025-11-19 20:26:05	0.10 (n/a)	0.08 (n/a)	0.08 (n/a)	0.07 (n/a)	0.01 (n/a)	173.00 (n/a)	148.00 (n/a)	152.00 (n/a)	124.00 (n/a)	17.03 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.11 (-7.83%)	0.09 (+1.64%)	0.08 (-15.17%)	0.08 (+58.17%)	0.01 (-59.25%)	153.00 (-36.78%)	137.80 (-9.22%)	145.00 (+17.89%)	115.00 (+8.49%)	13.89 (-72.38%)
`85aed8a` — 2025-11-19 20:26:05	0.12 (n/a)	0.09 (n/a)	0.10 (n/a)	0.05 (n/a)	0.02 (n/a)	242.00 (n/a)	151.80 (n/a)	123.00 (n/a)	106.00 (n/a)	50.28 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (+1.53%)	0.08 (-5.74%)	0.08 (-2.58%)	0.06 (-24.00%)	0.01 (+113.19%)	200.00 (+31.58%)	155.80 (+8.04%)	155.00 (+2.65%)	131.00 (-1.50%)	24.34 (+178.21%)
`85aed8a` — 2025-11-19 20:26:05	0.09 (n/a)	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.01 (n/a)	152.00 (n/a)	144.20 (n/a)	151.00 (n/a)	133.00 (n/a)	8.75 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (-17.78%)	0.09 (+5.91%)	0.09 (+13.87%)	0.07 (+39.65%)	0.01 (-69.44%)	169.00 (-28.39%)	145.20 (-12.64%)	137.00 (-12.18%)	135.00 (+21.62%)	12.94 (-73.29%)
`85aed8a` — 2025-11-19 20:26:05	0.11 (n/a)	0.08 (n/a)	0.08 (n/a)	0.05 (n/a)	0.02 (n/a)	236.00 (n/a)	166.20 (n/a)	156.00 (n/a)	111.00 (n/a)	48.44 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (-5.97%)	0.08 (-5.11%)	0.07 (-13.02%)	0.07 (+14.29%)	0.01 (-43.98%)	175.00 (-12.50%)	160.60 (+2.82%)	169.00 (+14.97%)	134.00 (+6.35%)	16.16 (-46.10%)
`85aed8a` — 2025-11-19 20:26:05	0.10 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	200.00 (n/a)	156.20 (n/a)	147.00 (n/a)	126.00 (n/a)	29.98 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (-15.44%)	0.08 (+4.69%)	0.07 (+4.22%)	0.07 (+36.61%)	0.01 (-60.48%)	183.00 (-26.80%)	161.40 (-10.03%)	166.00 (-4.05%)	136.00 (+18.26%)	15.69 (-66.06%)
`85aed8a` — 2025-11-19 20:26:05	0.11 (n/a)	0.07 (n/a)	0.07 (n/a)	0.05 (n/a)	0.02 (n/a)	250.00 (n/a)	179.40 (n/a)	173.00 (n/a)	115.00 (n/a)	46.23 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (+0.75%)	0.08 (-4.74%)	0.08 (-10.63%)	0.07 (-2.69%)	0.01 (+22.07%)	186.00 (+2.76%)	157.60 (+5.49%)	160.00 (+11.89%)	133.00 (-0.75%)	19.58 (+19.74%)
`85aed8a` — 2025-11-19 20:26:05	0.09 (n/a)	0.08 (n/a)	0.09 (n/a)	0.07 (n/a)	0.01 (n/a)	181.00 (n/a)	149.40 (n/a)	143.00 (n/a)	134.00 (n/a)	16.35 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.10 (+23.14%)	0.08 (+13.90%)	0.07 (+9.29%)	0.06 (+18.27%)	0.02 (+47.21%)	208.00 (-15.45%)	169.80 (-10.54%)	183.00 (-8.50%)	121.00 (-18.79%)	37.37 (+5.17%)
`85aed8a` — 2025-11-19 20:26:05	0.08 (n/a)	0.07 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	246.00 (n/a)	189.80 (n/a)	200.00 (n/a)	149.00 (n/a)	35.53 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.04 (-23.48%)	0.04 (-15.12%)	0.04 (-16.03%)	0.04 (-7.46%)	0.00 (-75.99%)	0.04 (-23.48%)	0.04 (-15.12%)	0.04 (-16.03%)	0.04 (-7.46%)	0.00 (-75.99%)	885.00 (+8.06%)	855.20 (+16.96%)	861.00 (+19.09%)	822.00 (+30.68%)	21.75 (-66.00%)
`85aed8a` — 2025-11-19 20:26:05	0.05 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.00 (n/a)	0.05 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.00 (n/a)	819.00 (n/a)	731.20 (n/a)	723.00 (n/a)	629.00 (n/a)	63.97 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	11.26 (+0.91%)	10.78 (-1.33%)	10.76 (-1.48%)	10.41 (-2.60%)	0.34 (+78.18%)	11.25 (+0.90%)	10.78 (-1.33%)	10.76 (-1.47%)	10.40 (-2.60%)	0.34 (+78.16%)	3226.00 (+2.67%)	3116.40 (+1.42%)	3119.00 (+1.50%)	2982.00 (-0.90%)	98.17 (+82.35%)
`85aed8a` — 2025-11-19 20:26:05	11.16 (n/a)	10.93 (n/a)	10.93 (n/a)	10.69 (n/a)	0.19 (n/a)	11.15 (n/a)	10.92 (n/a)	10.92 (n/a)	10.68 (n/a)	0.19 (n/a)	3142.00 (n/a)	3072.80 (n/a)	3073.00 (n/a)	3009.00 (n/a)	53.84 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	17.10 (-3.41%)	16.03 (-2.88%)	15.93 (-1.42%)	15.49 (+2.86%)	0.58 (-40.95%)	17.09 (-3.41%)	16.02 (-2.88%)	15.93 (-1.42%)	15.48 (+2.86%)	0.58 (-40.95%)	2168.00 (-2.78%)	2097.20 (+2.72%)	2107.00 (+1.44%)	1963.00 (+3.53%)	73.88 (-40.06%)
`85aed8a` — 2025-11-19 20:26:05	17.71 (n/a)	16.50 (n/a)	16.17 (n/a)	15.06 (n/a)	0.99 (n/a)	17.70 (n/a)	16.49 (n/a)	16.16 (n/a)	15.05 (n/a)	0.99 (n/a)	2230.00 (n/a)	2041.60 (n/a)	2077.00 (n/a)	1896.00 (n/a)	123.26 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	21.40 (+4.21%)	19.08 (-0.12%)	19.28 (+3.10%)	15.57 (-15.21%)	2.16 (+182.33%)	21.39 (+4.21%)	19.06 (-0.12%)	19.27 (+3.10%)	15.56 (-15.21%)	2.16 (+182.32%)	2157.00 (+17.93%)	1784.40 (+1.35%)	1741.00 (-3.01%)	1569.00 (-4.04%)	216.16 (+219.03%)
`85aed8a` — 2025-11-19 20:26:05	20.54 (n/a)	19.10 (n/a)	18.70 (n/a)	18.36 (n/a)	0.77 (n/a)	20.52 (n/a)	19.09 (n/a)	18.69 (n/a)	18.35 (n/a)	0.77 (n/a)	1829.00 (n/a)	1760.60 (n/a)	1795.00 (n/a)	1635.00 (n/a)	67.76 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	17.99 (-2.68%)	15.99 (-6.01%)	16.13 (-5.14%)	13.66 (-11.80%)	1.40 (+18.59%)	17.98 (-2.68%)	15.98 (-6.01%)	16.12 (-5.14%)	13.66 (-11.80%)	1.39 (+18.60%)	2457.00 (+13.38%)	2117.00 (+6.73%)	2081.00 (+5.42%)	1866.00 (+2.75%)	192.98 (+40.10%)
`85aed8a` — 2025-11-19 20:26:05	18.49 (n/a)	17.01 (n/a)	17.01 (n/a)	15.49 (n/a)	1.18 (n/a)	18.48 (n/a)	17.00 (n/a)	17.00 (n/a)	15.48 (n/a)	1.18 (n/a)	2167.00 (n/a)	1983.60 (n/a)	1974.00 (n/a)	1816.00 (n/a)	137.74 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	10.81 (-0.32%)	10.53 (-0.62%)	10.66 (+0.16%)	9.92 (-2.57%)	0.32 (+41.00%)	10.80 (-0.32%)	10.52 (-0.62%)	10.66 (+0.16%)	9.92 (-2.57%)	0.31 (+40.98%)	3383.00 (+2.64%)	3191.60 (+0.68%)	3149.00 (-0.16%)	3107.00 (+0.32%)	99.18 (+45.40%)
`85aed8a` — 2025-11-19 20:26:05	10.84 (n/a)	10.60 (n/a)	10.65 (n/a)	10.19 (n/a)	0.22 (n/a)	10.83 (n/a)	10.59 (n/a)	10.64 (n/a)	10.18 (n/a)	0.22 (n/a)	3296.00 (n/a)	3170.20 (n/a)	3154.00 (n/a)	3097.00 (n/a)	68.21 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	17.22 (+7.13%)	16.42 (+8.32%)	16.40 (+2.69%)	15.79 (+33.90%)	0.57 (-66.00%)	17.21 (+7.13%)	16.41 (+8.32%)	16.39 (+2.69%)	15.78 (+33.90%)	0.57 (-66.00%)	2127.00 (-25.32%)	2047.00 (-8.94%)	2047.00 (-2.62%)	1950.00 (-6.65%)	71.19 (-76.27%)
`85aed8a` — 2025-11-19 20:26:05	16.07 (n/a)	15.16 (n/a)	15.97 (n/a)	11.79 (n/a)	1.69 (n/a)	16.06 (n/a)	15.15 (n/a)	15.96 (n/a)	11.78 (n/a)	1.69 (n/a)	2848.00 (n/a)	2248.00 (n/a)	2102.00 (n/a)	2089.00 (n/a)	300.04 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	22.07 (+7.17%)	20.75 (+13.55%)	20.87 (+9.57%)	18.48 (+22.23%)	1.26 (-37.87%)	22.06 (+7.17%)	20.73 (+13.55%)	20.85 (+9.57%)	18.47 (+22.23%)	1.26 (-37.87%)	1817.00 (-18.19%)	1624.80 (-12.74%)	1609.00 (-8.74%)	1521.00 (-6.69%)	104.46 (-52.35%)
`85aed8a` — 2025-11-19 20:26:05	20.60 (n/a)	18.27 (n/a)	19.04 (n/a)	15.12 (n/a)	2.03 (n/a)	20.59 (n/a)	18.26 (n/a)	19.03 (n/a)	15.11 (n/a)	2.03 (n/a)	2221.00 (n/a)	1862.00 (n/a)	1763.00 (n/a)	1630.00 (n/a)	219.24 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	19.57 (+2.39%)	17.21 (-1.56%)	18.26 (+5.60%)	13.87 (-11.61%)	2.11 (+76.60%)	19.55 (+2.39%)	17.20 (-1.56%)	18.25 (+5.60%)	13.86 (-11.61%)	2.10 (+76.60%)	2421.00 (+13.13%)	1982.80 (+2.76%)	1839.00 (-5.30%)	1716.00 (-2.33%)	261.30 (+96.12%)
`85aed8a` — 2025-11-19 20:26:05	19.11 (n/a)	17.48 (n/a)	17.29 (n/a)	15.69 (n/a)	1.19 (n/a)	19.10 (n/a)	17.47 (n/a)	17.28 (n/a)	15.68 (n/a)	1.19 (n/a)	2140.00 (n/a)	1929.60 (n/a)	1942.00 (n/a)	1757.00 (n/a)	133.23 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.05 (+2.04%)	0.04 (-6.98%)	0.04 (-2.34%)	0.02 (-33.66%)	0.01 (+46.99%)	404.00 (+50.75%)	217.20 (+17.66%)	171.00 (+2.40%)	147.00 (-2.00%)	95.59 (+121.15%)
`85aed8a` — 2025-11-19 20:26:05	0.05 (n/a)	0.04 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	268.00 (n/a)	184.60 (n/a)	167.00 (n/a)	150.00 (n/a)	43.22 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.05 (-16.99%)	0.05 (-12.47%)	0.05 (-7.32%)	0.04 (-11.17%)	0.00 (-29.61%)	197.00 (+12.57%)	171.00 (+13.70%)	164.00 (+7.89%)	153.00 (+20.47%)	17.49 (-4.32%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	175.00 (n/a)	150.40 (n/a)	152.00 (n/a)	127.00 (n/a)	18.28 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (+5.56%)	0.05 (-1.59%)	0.05 (-1.39%)	0.03 (-14.07%)	0.01 (+25.03%)	263.00 (+16.37%)	166.00 (+4.53%)	144.00 (+1.41%)	126.00 (-5.26%)	49.38 (+43.17%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	226.00 (n/a)	158.80 (n/a)	142.00 (n/a)	133.00 (n/a)	34.49 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.08 (+24.24%)	0.06 (+9.40%)	0.06 (+9.23%)	0.05 (-9.09%)	0.01 (+127.55%)	165.00 (+10.00%)	129.20 (-6.65%)	130.00 (-8.45%)	99.00 (-19.51%)	21.39 (+101.15%)
`85aed8a` — 2025-11-19 20:26:05	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.00 (n/a)	150.00 (n/a)	138.40 (n/a)	142.00 (n/a)	123.00 (n/a)	10.63 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (-15.32%)	0.05 (-17.09%)	0.05 (-23.81%)	0.04 (-15.54%)	0.01 (-18.18%)	193.00 (+18.40%)	160.80 (+20.36%)	168.00 (+31.25%)	124.00 (+18.10%)	22.92 (+11.39%)
`0999a9a` — 2025-11-13 19:24:08	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	163.00 (n/a)	133.60 (n/a)	128.00 (n/a)	105.00 (n/a)	20.58 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (-23.02%)	0.05 (-6.98%)	0.05 (-2.13%)	0.04 (-15.31%)	0.01 (-33.29%)	196.00 (+18.07%)	147.00 (+6.52%)	141.00 (+2.17%)	126.00 (+29.90%)	25.27 (+8.13%)
`0999a9a` — 2025-11-13 19:24:08	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	166.00 (n/a)	138.00 (n/a)	138.00 (n/a)	97.00 (n/a)	23.37 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.06 (+0.00%)	0.05 (+11.46%)	0.06 (+14.71%)	0.03 (+0.42%)	0.01 (+10.81%)	236.00 (-0.42%)	152.80 (-9.26%)	136.00 (-12.82%)	124.00 (+0.00%)	41.89 (+11.59%)
`85aed8a` — 2025-11-19 20:26:05	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	237.00 (n/a)	168.40 (n/a)	156.00 (n/a)	124.00 (n/a)	37.54 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.07 (+29.81%)	0.05 (+14.09%)	0.05 (+10.69%)	0.03 (-0.45%)	0.01 (+88.52%)	220.00 (+0.46%)	162.00 (-8.58%)	159.00 (-9.66%)	104.00 (-22.96%)	40.36 (+46.94%)
`85aed8a` — 2025-11-19 20:26:05	0.06 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	219.00 (n/a)	177.20 (n/a)	176.00 (n/a)	135.00 (n/a)	27.47 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.07 (+11.97%)	0.05 (+3.09%)	0.05 (+2.10%)	0.03 (-11.35%)	0.01 (+41.65%)	229.00 (+12.81%)	156.00 (-0.51%)	143.00 (-2.05%)	117.00 (-10.69%)	38.21 (+48.71%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	203.00 (n/a)	156.80 (n/a)	146.00 (n/a)	131.00 (n/a)	25.69 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.06 (+9.02%)	0.05 (+5.59%)	0.05 (+0.00%)	0.04 (+3.63%)	0.01 (+25.48%)	193.00 (-3.50%)	147.40 (-4.66%)	147.00 (+0.00%)	122.00 (-8.27%)	25.24 (+7.48%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	200.00 (n/a)	154.60 (n/a)	147.00 (n/a)	133.00 (n/a)	23.48 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.05 (-14.79%)	0.05 (+1.84%)	0.05 (+3.47%)	0.05 (+9.94%)	0.00 (-66.71%)	161.00 (-9.04%)	147.40 (-3.41%)	144.00 (-3.36%)	142.00 (+17.36%)	7.14 (-64.78%)
`85aed8a` — 2025-11-19 20:26:05	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	177.00 (n/a)	152.60 (n/a)	149.00 (n/a)	121.00 (n/a)	20.28 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.06 (-16.81%)	0.05 (-12.48%)	0.05 (-8.16%)	0.05 (-7.78%)	0.01 (-30.86%)	167.00 (+8.44%)	148.00 (+13.32%)	147.00 (+8.89%)	119.00 (+20.20%)	17.23 (-8.00%)
`85aed8a` — 2025-11-19 20:26:05	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	154.00 (n/a)	130.60 (n/a)	135.00 (n/a)	99.00 (n/a)	18.73 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.05 (-13.48%)	0.05 (-17.79%)	0.05 (-15.33%)	0.03 (-25.09%)	0.01 (+6.67%)	267.00 (+33.50%)	176.80 (+24.51%)	150.00 (+18.11%)	141.00 (+15.57%)	47.41 (+61.41%)
`0999a9a` — 2025-11-13 19:24:08	0.06 (n/a)	0.06 (n/a)	0.06 (n/a)	0.04 (n/a)	0.01 (n/a)	200.00 (n/a)	142.00 (n/a)	127.00 (n/a)	122.00 (n/a)	29.37 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`003b49d` — 2025-11-14 19:30:54	0.05 (+13.38%)	0.05 (+23.85%)	0.05 (+37.91%)	0.05 (+30.72%)	0.00 (-56.85%)	166.00 (-23.50%)	153.40 (-20.60%)	153.00 (-27.49%)	142.00 (-11.80%)	7.63 (-70.60%)
`0999a9a` — 2025-11-13 19:24:08	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.01 (n/a)	217.00 (n/a)	193.20 (n/a)	211.00 (n/a)	161.00 (n/a)	25.96 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.05 (-9.66%)	0.05 (-0.37%)	0.05 (-8.70%)	0.04 (+45.98%)	0.00 (-67.04%)	174.00 (-31.50%)	161.20 (-4.62%)	161.00 (+9.52%)	145.00 (+10.69%)	10.91 (-75.55%)
`85aed8a` — 2025-11-19 20:26:05	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	254.00 (n/a)	169.00 (n/a)	147.00 (n/a)	131.00 (n/a)	44.60 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.06 (-16.79%)	0.04 (-19.66%)	0.04 (-21.08%)	0.04 (-21.95%)	0.01 (-10.41%)	205.00 (+28.12%)	178.00 (+24.82%)	185.00 (+26.71%)	137.00 (+20.18%)	22.47 (+32.98%)
`85aed8a` — 2025-11-19 20:26:05	0.07 (n/a)	0.05 (n/a)	0.05 (n/a)	0.05 (n/a)	0.01 (n/a)	160.00 (n/a)	142.60 (n/a)	146.00 (n/a)	114.00 (n/a)	16.89 (n/a)

mha

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	GFLOP/s (max)	GFLOP/s (mean)	GFLOP/s (median)	GFLOP/s (min)	GFLOP/s (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (+0.34%)	0.09 (+0.35%)	0.09 (+1.00%)	0.08 (-0.36%)	0.00 (+6.88%)	64.66 (+0.34%)	63.27 (+0.35%)	63.49 (+1.00%)	61.18 (-0.36%)	1.15 (+6.88%)
`85aed8a` — 2025-11-19 20:26:05	0.09 (n/a)	0.09 (n/a)	0.09 (n/a)	0.08 (n/a)	0.00 (n/a)	64.44 (n/a)	63.05 (n/a)	62.86 (n/a)	61.40 (n/a)	1.08 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.06 (-5.93%)	0.05 (+0.41%)	0.06 (+3.62%)	0.05 (+7.41%)	0.00 (-21.27%)	162.00 (-6.90%)	146.40 (-0.81%)	138.00 (-3.50%)	135.00 (+6.30%)	11.98 (-22.47%)
`85aed8a` — 2025-11-19 20:26:05	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	174.00 (n/a)	147.60 (n/a)	143.00 (n/a)	127.00 (n/a)	15.45 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.06 (-14.17%)	0.05 (-12.32%)	0.05 (-19.08%)	0.05 (+36.09%)	0.01 (-61.30%)	169.00 (-26.52%)	149.00 (+6.73%)	152.00 (+23.58%)	127.00 (+16.51%)	14.41 (-68.39%)
`85aed8a` — 2025-11-19 20:26:05	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.03 (n/a)	0.01 (n/a)	230.00 (n/a)	139.60 (n/a)	123.00 (n/a)	109.00 (n/a)	45.58 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.05 (-17.27%)	0.04 (-28.04%)	0.04 (-31.32%)	0.03 (-29.43%)	0.01 (+14.96%)	265.00 (+41.71%)	197.40 (+43.88%)	182.00 (+45.60%)	139.00 (+20.87%)	50.12 (+94.37%)
`85aed8a` — 2025-11-19 20:26:05	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.04 (n/a)	0.01 (n/a)	187.00 (n/a)	137.20 (n/a)	125.00 (n/a)	115.00 (n/a)	25.79 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.05 (-17.50%)	0.04 (-12.15%)	0.04 (-18.86%)	0.04 (+1.50%)	0.00 (-59.97%)	200.00 (-1.48%)	176.20 (+11.38%)	175.00 (+23.24%)	160.00 (+21.21%)	13.18 (-51.42%)
`85aed8a` — 2025-11-19 20:26:05	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	203.00 (n/a)	158.20 (n/a)	142.00 (n/a)	132.00 (n/a)	27.13 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.07 (-15.43%)	0.06 (-18.46%)	0.06 (-15.17%)	0.05 (-31.25%)	0.01 (+89.04%)	240.00 (+45.45%)	188.20 (+24.80%)	178.00 (+17.88%)	162.00 (+18.25%)	28.76 (+224.52%)
`85aed8a` — 2025-11-19 20:26:05	0.08 (n/a)	0.08 (n/a)	0.08 (n/a)	0.07 (n/a)	0.00 (n/a)	165.00 (n/a)	150.80 (n/a)	151.00 (n/a)	137.00 (n/a)	8.86 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (-9.52%)	0.07 (-4.65%)	0.07 (+4.46%)	0.06 (-9.47%)	0.01 (-12.59%)	190.00 (+10.47%)	162.00 (+4.79%)	157.00 (-4.27%)	126.00 (+10.53%)	23.11 (+10.79%)
`85aed8a` — 2025-11-19 20:26:05	0.10 (n/a)	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.01 (n/a)	172.00 (n/a)	154.60 (n/a)	164.00 (n/a)	114.00 (n/a)	20.86 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (-3.94%)	0.06 (-22.82%)	0.06 (-25.39%)	0.03 (-51.74%)	0.02 (+67.55%)	373.00 (+107.22%)	213.20 (+43.67%)	193.00 (+34.03%)	127.00 (+4.10%)	84.33 (+281.98%)
`85aed8a` — 2025-11-19 20:26:05	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	180.00 (n/a)	148.40 (n/a)	144.00 (n/a)	122.00 (n/a)	22.08 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.08 (-14.09%)	0.07 (-8.40%)	0.07 (-3.41%)	0.06 (-1.59%)	0.01 (-39.64%)	189.00 (+1.61%)	175.60 (+8.13%)	176.00 (+3.53%)	149.00 (+16.41%)	14.61 (-27.76%)
`85aed8a` — 2025-11-19 20:26:05	0.09 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	186.00 (n/a)	162.40 (n/a)	170.00 (n/a)	128.00 (n/a)	20.22 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.11 (+15.09%)	0.08 (-3.88%)	0.08 (-0.74%)	0.04 (-44.61%)	0.02 (+287.84%)	269.00 (+80.54%)	155.20 (+14.62%)	136.00 (+0.74%)	106.00 (-13.11%)	58.11 (+558.62%)
`85aed8a` — 2025-11-19 20:26:05	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.08 (n/a)	0.01 (n/a)	149.00 (n/a)	135.40 (n/a)	135.00 (n/a)	122.00 (n/a)	8.82 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (+14.52%)	0.07 (-7.98%)	0.07 (-6.75%)	0.05 (-31.60%)	0.02 (+176.23%)	250.00 (+46.20%)	178.60 (+14.78%)	163.00 (+7.24%)	124.00 (-12.68%)	45.00 (+255.46%)
`85aed8a` — 2025-11-19 20:26:05	0.08 (n/a)	0.07 (n/a)	0.08 (n/a)	0.07 (n/a)	0.01 (n/a)	171.00 (n/a)	155.60 (n/a)	152.00 (n/a)	142.00 (n/a)	12.66 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.09 (+3.91%)	0.07 (-2.08%)	0.08 (+19.01%)	0.03 (-40.18%)	0.02 (+119.62%)	336.00 (+67.16%)	190.60 (+14.68%)	142.00 (-15.98%)	128.00 (-3.76%)	79.10 (+248.72%)
`85aed8a` — 2025-11-19 20:26:05	0.09 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	201.00 (n/a)	166.20 (n/a)	169.00 (n/a)	133.00 (n/a)	22.68 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.08 (-5.59%)	0.07 (-2.77%)	0.07 (+6.96%)	0.03 (-44.57%)	0.02 (+96.72%)	341.00 (+80.42%)	190.20 (+12.68%)	158.00 (-6.51%)	143.00 (+5.93%)	75.60 (+300.15%)
`85aed8a` — 2025-11-19 20:26:05	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.06 (n/a)	0.01 (n/a)	189.00 (n/a)	168.80 (n/a)	169.00 (n/a)	135.00 (n/a)	18.89 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.18 (+17.46%)	0.14 (-1.39%)	0.13 (-11.80%)	0.08 (-26.72%)	0.03 (+93.03%)	277.00 (+36.45%)	181.60 (+6.95%)	178.00 (+13.38%)	126.00 (-14.86%)	51.78 (+131.43%)
`85aed8a` — 2025-11-19 20:26:05	0.15 (n/a)	0.14 (n/a)	0.15 (n/a)	0.11 (n/a)	0.02 (n/a)	203.00 (n/a)	169.80 (n/a)	157.00 (n/a)	148.00 (n/a)	22.37 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.17 (-8.33%)	0.16 (+5.42%)	0.16 (+9.66%)	0.14 (+5.99%)	0.01 (-38.74%)	167.00 (-5.65%)	146.00 (-6.17%)	145.00 (-8.81%)	132.00 (+9.09%)	12.52 (-36.35%)
`85aed8a` — 2025-11-19 20:26:05	0.19 (n/a)	0.15 (n/a)	0.14 (n/a)	0.13 (n/a)	0.02 (n/a)	177.00 (n/a)	155.60 (n/a)	159.00 (n/a)	121.00 (n/a)	19.67 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.18 (+12.80%)	0.15 (-2.34%)	0.13 (-12.21%)	0.11 (-16.74%)	0.03 (+156.37%)	215.00 (+20.11%)	163.00 (+6.26%)	172.00 (+13.91%)	125.00 (-11.35%)	34.04 (+154.98%)
`85aed8a` — 2025-11-19 20:26:05	0.16 (n/a)	0.15 (n/a)	0.15 (n/a)	0.13 (n/a)	0.01 (n/a)	179.00 (n/a)	153.40 (n/a)	151.00 (n/a)	141.00 (n/a)	13.35 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.15 (-20.81%)	0.13 (-11.32%)	0.13 (-5.26%)	0.09 (-20.58%)	0.02 (-20.41%)	243.00 (+25.91%)	179.20 (+12.99%)	171.00 (+5.56%)	149.00 (+26.27%)	33.12 (+34.16%)
`85aed8a` — 2025-11-19 20:26:05	0.19 (n/a)	0.15 (n/a)	0.14 (n/a)	0.12 (n/a)	0.03 (n/a)	193.00 (n/a)	158.60 (n/a)	162.00 (n/a)	118.00 (n/a)	24.69 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.07 (-0.88%)	0.05 (-12.85%)	0.05 (-17.22%)	0.03 (-33.07%)	0.01 (+52.09%)	257.00 (+49.42%)	163.40 (+21.04%)	151.00 (+20.80%)	113.00 (+0.89%)	49.64 (+136.33%)
`85aed8a` — 2025-11-19 20:26:05	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.04 (n/a)	0.01 (n/a)	172.00 (n/a)	135.00 (n/a)	125.00 (n/a)	112.00 (n/a)	21.00 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.07 (+8.74%)	0.06 (-1.30%)	0.06 (-2.21%)	0.05 (-4.79%)	0.01 (+48.30%)	167.00 (+5.03%)	138.40 (+2.67%)	136.00 (+2.26%)	103.00 (-8.04%)	21.06 (+40.27%)
`85aed8a` — 2025-11-19 20:26:05	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	159.00 (n/a)	134.80 (n/a)	133.00 (n/a)	112.00 (n/a)	15.01 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.06 (+1.65%)	0.05 (-1.15%)	0.06 (+2.99%)	0.04 (+2.15%)	0.01 (+14.10%)	186.00 (-2.11%)	147.80 (+1.65%)	134.00 (-2.90%)	121.00 (-1.63%)	24.87 (+6.92%)
`85aed8a` — 2025-11-19 20:26:05	0.06 (n/a)	0.05 (n/a)	0.06 (n/a)	0.04 (n/a)	0.01 (n/a)	190.00 (n/a)	145.40 (n/a)	138.00 (n/a)	123.00 (n/a)	23.26 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.06 (-5.56%)	0.05 (-14.13%)	0.04 (-22.35%)	0.03 (-0.43%)	0.01 (-1.02%)	231.00 (+0.43%)	178.00 (+16.34%)	179.00 (+28.78%)	126.00 (+5.88%)	38.89 (-1.05%)
`85aed8a` — 2025-11-19 20:26:05	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.03 (n/a)	0.01 (n/a)	230.00 (n/a)	153.00 (n/a)	139.00 (n/a)	119.00 (n/a)	39.31 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.18 (+3.10%)	0.16 (+21.47%)	0.16 (+22.30%)	0.14 (+57.05%)	0.01 (-62.76%)	163.00 (-36.33%)	142.60 (-23.00%)	139.00 (-18.24%)	129.00 (-3.01%)	11.98 (-76.40%)
`85aed8a` — 2025-11-19 20:26:05	0.17 (n/a)	0.13 (n/a)	0.13 (n/a)	0.09 (n/a)	0.03 (n/a)	256.00 (n/a)	185.20 (n/a)	170.00 (n/a)	133.00 (n/a)	50.74 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.20 (+1.74%)	0.14 (-8.15%)	0.13 (-16.57%)	0.12 (+4.66%)	0.03 (+3.53%)	193.00 (-4.46%)	165.00 (+8.84%)	175.00 (+19.86%)	115.00 (-1.71%)	28.17 (-4.66%)
`85aed8a` — 2025-11-19 20:26:05	0.20 (n/a)	0.16 (n/a)	0.16 (n/a)	0.11 (n/a)	0.03 (n/a)	202.00 (n/a)	151.60 (n/a)	146.00 (n/a)	117.00 (n/a)	29.55 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.19 (+6.50%)	0.16 (+8.19%)	0.18 (+15.50%)	0.13 (+4.95%)	0.02 (+17.35%)	182.00 (-4.71%)	142.20 (-7.18%)	129.00 (-13.42%)	123.00 (-6.11%)	22.69 (+4.26%)
`85aed8a` — 2025-11-19 20:26:05	0.17 (n/a)	0.15 (n/a)	0.15 (n/a)	0.12 (n/a)	0.02 (n/a)	191.00 (n/a)	153.20 (n/a)	149.00 (n/a)	131.00 (n/a)	21.77 (n/a)

swiglu

No metrics available.

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	3.26 (+1.33%)	2.99 (+8.33%)	2.91 (-8.93%)	2.65 (+41.85%)	0.23 (-59.63%)	184.00 (-29.50%)	164.40 (-11.61%)	168.00 (+9.80%)	150.00 (-1.32%)	12.69 (-71.19%)
`85aed8a` — 2025-11-19 20:26:05	3.21 (n/a)	2.76 (n/a)	3.19 (n/a)	1.87 (n/a)	0.56 (n/a)	261.00 (n/a)	186.00 (n/a)	153.00 (n/a)	152.00 (n/a)	44.05 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	3.34 (-7.53%)	2.71 (-16.75%)	2.50 (-29.23%)	2.12 (-12.61%)	0.47 (+1.72%)	230.00 (+14.43%)	185.60 (+20.83%)	195.00 (+41.30%)	146.00 (+8.15%)	31.40 (+23.90%)
`85aed8a` — 2025-11-19 20:26:05	3.62 (n/a)	3.25 (n/a)	3.54 (n/a)	2.43 (n/a)	0.46 (n/a)	201.00 (n/a)	153.60 (n/a)	138.00 (n/a)	135.00 (n/a)	25.34 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.11 (+25.47%)	0.09 (+28.77%)	0.09 (+36.36%)	0.05 (-1.75%)	0.02 (+76.75%)	228.00 (+1.79%)	139.00 (-18.62%)	121.00 (-26.67%)	106.00 (-20.30%)	45.21 (+47.81%)
`85aed8a` — 2025-11-19 20:26:05	0.09 (n/a)	0.07 (n/a)	0.07 (n/a)	0.05 (n/a)	0.01 (n/a)	224.00 (n/a)	170.80 (n/a)	165.00 (n/a)	133.00 (n/a)	30.58 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.11 (+14.29%)	0.07 (-11.92%)	0.07 (-27.49%)	0.05 (-8.81%)	0.02 (+34.81%)	227.00 (+9.66%)	163.80 (+16.50%)	171.00 (+37.90%)	105.00 (-12.50%)	41.33 (+24.00%)
`85aed8a` — 2025-11-19 20:26:05	0.10 (n/a)	0.08 (n/a)	0.09 (n/a)	0.06 (n/a)	0.01 (n/a)	207.00 (n/a)	140.60 (n/a)	124.00 (n/a)	120.00 (n/a)	33.33 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.10 (-0.90%)	0.09 (+2.42%)	0.09 (+8.46%)	0.06 (-12.90%)	0.01 (+31.01%)	186.00 (+14.81%)	137.40 (-0.72%)	130.00 (-7.80%)	111.00 (+0.91%)	26.50 (+57.63%)
`85aed8a` — 2025-11-19 20:26:05	0.10 (n/a)	0.08 (n/a)	0.08 (n/a)	0.07 (n/a)	0.01 (n/a)	162.00 (n/a)	138.40 (n/a)	141.00 (n/a)	110.00 (n/a)	16.81 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`0df96f5` — 2025-11-20 01:25:06	0.08 (-18.00%)	0.07 (-5.67%)	0.07 (-7.06%)	0.06 (+10.77%)	0.01 (-46.18%)	195.00 (-9.72%)	171.00 (+3.64%)	170.00 (+7.59%)	150.00 (+21.95%)	17.88 (-41.43%)
`85aed8a` — 2025-11-19 20:26:05	0.09 (n/a)	0.07 (n/a)	0.07 (n/a)	0.05 (n/a)	0.01 (n/a)	216.00 (n/a)	165.00 (n/a)	158.00 (n/a)	123.00 (n/a)	30.52 (n/a)

github-actions · 2025-11-20T01:35:55Z

📊 Test Results for Test Example Applications

0df96f5 (2025_11_20_01_35_39)

IRONCLAD

Tested on 2025_11_20_01_35_39 at commit 0df96f5.

Test	Checks	TTFT (mean)	TPS (mean)
llama_3.2_1b	✅ 5/5	6.82	4.51

📈 Trends (vs main branch) for Test Example Applications

0df96f5 (2025_11_20_01_35_39)

IRONCLAD Trends

llama_3.2_1b

Commit/Date	Num Tokens (max)	Num Tokens (mean)	Num Tokens (median)	Num Tokens (min)	Num Tokens (stddev)	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)	Total (max)	Total (mean)	Total (median)	Total (min)	Total (stddev)
`0df96f5` — 2025-11-20 01:30:59	40.00 (+0.00%)	40.00 (+0.00%)	40.00 (+0.00%)	40.00 (+0.00%)	0.00 (n/a)	4.58 (+40.49%)	4.51 (+39.50%)	4.53 (+40.25%)	4.42 (+38.12%)	0.07 (+199.49%)	6.92 (-60.06%)	6.82 (-57.89%)	6.84 (-58.74%)	6.69 (-55.79%)	0.07 (-91.44%)	15.65 (-46.91%)	15.48 (-45.25%)	15.49 (-46.03%)	15.35 (-43.39%)	0.11 (-88.05%)
`a7f0f07` — 2025-11-19 23:26:37	40.00 (n/a)	40.00 (n/a)	40.00 (n/a)	40.00 (n/a)	0.00 (n/a)	3.26 (n/a)	3.23 (n/a)	3.23 (n/a)	3.20 (n/a)	0.02 (n/a)	17.32 (n/a)	16.20 (n/a)	16.59 (n/a)	15.13 (n/a)	0.88 (n/a)	29.48 (n/a)	28.27 (n/a)	28.71 (n/a)	27.12 (n/a)	0.91 (n/a)

andrej changed the title ~~Swiglu runlist~~ Llama: Keep weights stationary in dedicated buffers Nov 13, 2025

andrej force-pushed the swiglu-runlist branch from b4674ca to a452b5c Compare November 13, 2025 19:07

andrej changed the title ~~Llama: Keep weights stationary in dedicated buffers~~ Llama: Runlist-based SwiGLU Nov 13, 2025

andrej changed the base branch from devel to weight-stationary November 13, 2025 21:40

andrej mentioned this pull request Nov 13, 2025

TTFT Performance Improvements #14

Closed

3 tasks

andrej force-pushed the weight-stationary branch from 926fbc7 to 7da11e8 Compare November 15, 2025 14:40

andrej force-pushed the swiglu-runlist branch 2 times, most recently from 1cd6cae to 7e18992 Compare November 16, 2025 22:06

andrej force-pushed the weight-stationary branch 2 times, most recently from 44d65c6 to 6c7123b Compare November 17, 2025 16:23

andrej force-pushed the swiglu-runlist branch from 7e18992 to c16e357 Compare November 17, 2025 16:24

kurtis-b-1 mentioned this pull request Nov 17, 2025

TTFT Performance Improvements #21

Closed

3 tasks

kurtis-b-1 self-requested a review November 17, 2025 23:39

andrej force-pushed the swiglu-runlist branch from c16e357 to 4221fdc Compare November 17, 2025 23:42

andrej force-pushed the weight-stationary branch from c4d57e6 to 119f525 Compare November 17, 2025 23:43

andrej mentioned this pull request Nov 17, 2025

llama_3.2_1b example error #22

Closed

andrej force-pushed the swiglu-runlist branch from 4221fdc to a7b950e Compare November 18, 2025 00:01

andrej force-pushed the weight-stationary branch from 119f525 to 2e04051 Compare November 18, 2025 16:15

andrej force-pushed the swiglu-runlist branch from a7b950e to 78397fe Compare November 18, 2025 16:38

amd deleted a comment from github-actions bot Nov 18, 2025