Repository navigation
2026.11.14.07
Unpack anywhere, then run setup.cmd (or zero-launcher.cmd once a model is there).
New since 2026.11.14.06 (every other model: the same logits bit for bit):
- DeepSeek-V4.1-Flash in Unsloth's UD-Q8_K_XL (
unsloth/DeepSeek-V4.1-Flash-1017-GGUF, issue #4): the engine now reads MXFP4 weights (its routed experts; decoded exactly into the engine's int8 form, on the expert file and expert cache paths) and MXFP8 rows (its Engram table, a type of Unsloth's llama.cpp fork). Its other matrices are BF16, taken as Q8_0 at load. Checked on a small model with exactly these types: KL 0.0052 against the f32 reference. One GPU with the experts in RAM; the real model needs ~600 GB of RAM and a ~300 GB expert file on disk, written at the first load.