Repository navigation
2026.11.14.09
Unpack anywhere, then run setup.cmd (or zero-launcher.cmd once a model is there).
New since 2026.11.14.08:
- Faster prompts on Arc Pro B60 / B70: the XMX prompt GEMM now prefetches its weights one chunk ahead by default. A B60's sweep measured the 27B's 4K prompt 1,322 -> 1,529 tok/s and 512 tokens 737 -> 867, with the same logits (issue #4, thanks to manoreken2).
ARC_GEMM_XW_PF=0turns it off. - DeepSeek-V4.1-Flash over several GPUs (
--gpus N): its routed experts are split over the GPUs, and the rest runs whole on each. It has been checked on test models over 1-4 simulated GPUs (the same accuracy as one GPU). Speed on real cards: to be measured (issue #4). - Docs and website: every user's latest numbers (one to four B60s, Linux with direct GPU-to-GPU sums, a slow x4 link, the B70, the Arc 140T, long contexts up to 262K over four B60s).
iGPUs and every other model: the same logits bit for bit.