·
2 commits
to master
since this release
Automated Unsloth llama.cpp CUDA + ROCm + Vulkan + macOS + CPU prebuild for upstream b10840, merged with:
- DiffusionGemma (#24423, commit 168b21a)
- Add TML Inkling architecture (#25731, commit 1066edc)
- kimi-k3 : the MoonViT-3d vision tower and full-size loading fixes (unslothai/llama.cpp#70, commit 883f2c9)
- IQ1_XS, IQ1_XXS, IQ1_XXXS: three quant types below IQ1_S (unslothai/llama.cpp#61, commit 46cbf0e)
- sampling: index penalties by token id instead of scanning every candidate (unslothai/llama.cpp#95, commit 3db8cb5)
- model: add GLM-5-Next (GLM-5.3-Flash) (#27754, commit b9b8207)
- llama: batched readahead for lazily read gather tables (unslothai/llama.cpp#137, commit 4e1865e)
- ggml-cuda: avoid direct ROCm_Host compute on HIP integrated GPUs (port of ggml-org#25863) (unslothai/llama.cpp#158, commit abfc45b)
- ggml-cuda: use cudaMemcpyDefault in the ggml_cuda_cpy 2D fast path (unslothai/llama.cpp#157, commit 6c6da89)
- ggml-cuda: make GGML_CUDA_ENABLE_UNIFIED_MEMORY=0 actually disable it, and say so on HIP (unslothai/llama.cpp#149, commit b65a2dc)
- MTP for Qwen3.8-Flash-Next (unslothai/llama.cpp#144, commit a9e9c3c)
- llama: map each contiguous run of a context's tensors, not one span over all of them (unslothai/llama.cpp#152, commit b2b5ed9)
- mtmd: test that every projector is registered and uniquely named (unslothai/llama.cpp#176, commit 09ce1a4)