Skip to content

D3D12 backend v0.5.4 - llama.cpp upstream move to 7592b61d3

Choose a tag to compare

@koza-coder koza-coder released this 10 Nov 21:37

D3D12 backend v0.5.4 - llama.cpp upstream move to 7592b61

Windows x64, DirectX 12. On llama.cpp master 7592b61 (2026-11-10). Contains everything of v0.5.3.

What is new in v0.5.4

  • Upstream move: llama.cpp 6023692 (2026-11-05) -> 7592b61 (2026-11-10). 116 upstream commits. One merge conflict, in ggml/src/ggml-backend-reg.cpp (the backend load list); the upstream block is kept and our one ggml_backend_load_best line is added after Vulkan. Nothing else of the backend changed, so the shader cache is the one of v0.5.3.
  • vla-cli.exe is the v0.5.3 build (not rebuilt; it is a separate static exe). Robot models, DiffusionGemma and Clover work as in v0.5.3.

Speed on a Radeon AI PRO R9700 (DirectX 12)

Model Tool Result
Clover-35B-A3B-Preview Q4_K_M, DX12, -ngl 99 -lm none -fa 1 llama-bench (zip smoke) pp512 635.83 t/s, tg128 66.90 t/s (box hot, hotspot 89 C)
Clover-35B-A3B-Preview Q4_K_M llama-perplexity PPL 4.2676 (= v0.5.3)
diffusiongemma-26B-A4B-it Q4_K_M llama-diffusion-cli 450.53 ms/step
LLaDA-MoE-7B-A1B-Instruct Q4_K_M llama-diffusion-cli, block 32, 32 steps 52.05 ms/step

Warm A/B on the same box (exp1087, 3 repeats, Clover-35B-A3B Q4_K_M, DX12, -ngl 99 -lm none -fa 1): pp512 693.60 / 692.78 t/s (v0.5.4) against 689.69 / 693.89 t/s (v0.5.3), tg128 67.1 t/s in all four runs: no speed change; the lower smoke pp512 was heat.

Tested

  • Radeon AI PRO R9700: every shipped exe of this zip (llama-server, llama-mtmd-cli, llama-cli, llama-completion, llama-perplexity, llama-bench, test-backend-ops, llama-diffusion-cli, llama-clover-diffusion, vla-cli with all 5 robot models): 15/15 steps PASS, no NaN/Inf. Zip SHA-256 d7faca3b87587f9a3f7b6944825b12ffb8a0561ad076d74bbc95a4576415c4a8.
  • The .bat files were not run in the test; they call the tested exes. Other GPUs were not tested with this zip.