Repository navigation
v1.1.64
EXL3 quants now run on an AMD Strix Halo or Gorgon Halo APU paired with an NVIDIA GPU. In v1.1.62 the pairing took GGUF quants only.
-
New: EXL3 on an AMD Halo APU + NVIDIA GPU (Linux, experimental): GLM-5.3-Flash's EXL3 quants now run on both GPUs at once, as the GGUF quants have since v1.1.62. The NVIDIA card runs attention, the cache, drafting and the most-used experts; the APU computes every other expert in place from the memory both share. Maya tunes itself: the first start measures the APU alone and the pair, and keeps the pair only where it is faster.
--mixed-gpus offturns it off. -
Steadier AMD + NVIDIA pairing: the APU side now shares the model's memory with the NVIDIA card in 1 GB pieces. The AMD driver's pauses of the APU side (seconds to minutes when Linux moved memory) became much rarer. GLM-5.3 (744B) still stays on the APU alone unless you start it with
--mixed-gpus on. -
Where the model lives on the pair: the experts the NVIDIA card does not hold stay in ordinary system RAM, shared by both GPUs, not in the APU's BIOS VRAM carve-out. There is one copy of the model, only activations cross between the GPUs, and no large BIOS VRAM reserve is needed (now in docs/SETTINGS.md).
-
Fix: DeepSeek decode on several GPUs (#956, @speja969 and @mgabor3141): since v1.1.58, DeepSeek on a layer split or
--tpcould keep its PCIe expert lane on when it gained nothing, which cost about 4-5% decode on the reporters' PCs. On several GPUs the lane now turns off again unless it measures faster, as in v1.1.57; one GPU is unchanged.DS4_STREAM_TIE=keep|offforces either rule. The first start after the update measures again. -
Qwen GGUFs with mixed expert formats: Maya now runs Qwen GGUF quants whose expert gate and up weights use different formats in a layer (for example unsloth's UD-IQ1_S of Qwen3.8-Flash-Next). Every other quant packs and answers exactly as before.
-
MiniMax: damaged model files are caught (#672, @tanutanu56): the setup now checks MiniMax GGUF files already in your model folder by their checksum, once, and says which file to download again if one does not match. Before, it checked their size only. If the router still meets broken numbers, the error now says where they come from instead of naming an impossible expert.
Full list: CHANGELOG.md.
Supported by @wjHunter, @os-groot, @davedgd, @jeanluchayes, @sugattor, @vikcious, @ThatSimpleTech, @router0mail and @davidfernengel.
Maya is free; if it helps you, you can sponsor it: https://github.com/sponsors/mw00