Repository navigation
2026.11.14.02
Unpack anywhere, then run setup.cmd (or zero-launcher.cmd once a model is there).
New since 2026.11.14.01 (results unchanged; the default path gives the same logits as before):
- The norm and the H8 rotation of its rows in one kernel, opt-in on Arc B-series cards:
ARC_H8_NORM=1. Each layer input used to be normalized with an f32 copy written out, then read back to be rotated for the int8 matrix products; now one kernel does both, with the same results bit for bit. On a Pro B60 those two steps take ~232 ms of the 27B's 4K prompt. (docs/xe2-tuning.md section 13.5) bench\long_prefill_probe.ps1: the prompt's profile at 64K / 131K / 262K tokens.