gpt-oss 20b gguf model fail to run

[VictorWangwz]

What is the issue?

The original model coudl run without problem, but the gguf model fail to run for below errors

May need an update of ggml dependencies like llama.cpp ggml-org/llama.cpp#15091

Note: Running gguf on llama.cpp without problem.

Relevant log output

Aug 06 03:40:33 ml-machine-1 ollama[2649079]: gguf_init_from_file_impl: tensor 'blk.0.ffn_down_exps.weight' has invalid ggml type 39 (NONE)
Aug 06 03:40:33 ml-machine-1 ollama[2649079]: gguf_init_from_file_impl: failed to read tensor info

OS

No response

GPU

No response

CPU

No response

Ollama version

No response

[a-makarov-kaspi]

Yep, ollama returns 500 error

Ollama 0.11.2 for mac OS

[ramkumarkb]

I can also confirm that the same error with the latest vesion - 0.11.3-rc0
I tried with the following GGUF models -

1. https://huggingface.co/unsloth/gpt-oss-20b-GGUF
2. https://huggingface.co/ggml-org/gpt-oss-20b-GGUF

[maksir]

maybe will help

[rbnhln]

Got the same error:

ollama  | gguf_init_from_file_impl: tensor 'blk.0.ffn_down_exps.weight' has invalid ggml type 39 (NONE)
ollama  | gguf_init_from_file_impl: failed to read tensor info
ollama  | llama_model_load: error loading model: llama_model_loader: failed to load model from /root/.ollama/models/blobs/sha256-b6f8d6dec25430529281f42096a0a38f9a73c4007650075047d54a1899f14fa5
ollama  | 
ollama  | llama_model_load_from_file_impl: failed to load model

Tried different models and sizes:

• unsloth/gpt-oss-20b-GGUF:Q2_K
• unsloth/gpt-oss-20b-GGUF:F16
• ggml-org/gpt-oss-20b-GGUF:latest
• lmstudio-community/gpt-oss-20b-GGUF:latest

ollama version: 0.11.2

The gpt-oss_20b model is running.

[discostur]

Same error here:

time=2025-08-06T11:14:32.565Z level=INFO source=sched.go:546 msg="updated VRAM based on existing loaded models" gpu=GPU-60d0c2c0-f953-d178-82f0-754b2f08821b library=cuda total="15.6 GiB" available="158.2 MiB"
time=2025-08-06T11:14:34.149Z level=INFO source=sched.go:786 msg="new model will fit in available VRAM in single GPU, loading" model=/root/.ollama/models/blobs/sha256-eacc290fd6b05f927d98e94c6acb9c315bdacfbcd7290c88ca4d088d77089174 gpu=GPU-60d0c2c0-f953-d178-82f0-754b2f08821b parallel=1 available=16594370560 required="1.9 GiB"
time=2025-08-06T11:14:34.362Z level=INFO source=server.go:135 msg="system memory" total="125.8 GiB" free="114.1 GiB" free_swap="0 B"
time=2025-08-06T11:14:34.363Z level=INFO source=server.go:175 msg=offload library=cuda layers.requested=-1 layers.model=25 layers.offload=25 layers.split="" memory.available="[15.5 GiB]" memory.gpu_overhead="0 B" memory.required.full="1.9 GiB" memory.required.partial="1.9 GiB" memory.required.kv="192.0 MiB" memory.required.allocations="[1.9 GiB]" memory.weights.total="1.0 GiB" memory.weights.repeating="454.3 MiB" memory.weights.nonrepeating="586.8 MiB" memory.graph.full="256.0 MiB" memory.graph.partial="256.0 MiB"
gguf_init_from_file_impl: tensor 'blk.0.ffn_down_exps.weight' has invalid ggml type 39 (NONE)
gguf_init_from_file_impl: failed to read tensor info
llama_model_load: error loading model: llama_model_loader: failed to load model from /root/.ollama/models/blobs/sha256-eacc290fd6b05f927d98e94c6acb9c315bdacfbcd7290c88ca4d088d77089174

llama_model_load_from_file_impl: failed to load model
time=2025-08-06T11:14:34.607Z level=INFO source=sched.go:453 msg="NewLlamaServer failed" model=/root/.ollama/models/blobs/sha256-eacc290fd6b05f927d98e94c6acb9c315bdacfbcd7290c88ca4d088d77089174 error="unable to load model: /root/.ollama/models/blobs/sha256-eacc290fd6b05f927d98e94c6acb9c315bdacfbcd7290c88ca4d088d77089174"

[kappa8219]

Some more:

root@open-webui-ollama-849869d898-dkg82:/# ollama pull hf.co/unsloth/gpt-oss-20b-GGUF:latest
pulling manifest 
pulling 7dd573dc3e0b: 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏  11 GB                         
pulling 51468a0fd901: 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 7.4 KB                         
pulling 264230288548: 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏  149 B                         
pulling eb1dfc8996e5: 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏  558 B                         
verifying sha256 digest 
writing manifest 
success 
root@open-webui-ollama-849869d898-dkg82:/# ollama run hf.co/unsloth/gpt-oss-20b-GGUF:latest
Error: 500 Internal Server Error: unable to load model: /root/.ollama/models/blobs/sha256-7dd573dc3e0ba2e7d6bf76e16d400cf69b6afc2ae58f213e4eb1d133c38e938b
root@open-webui-ollama-849869d898-dkg82:/# ollama -v
ollama version is 0.11.2

Maybe it is unsloth guys problem. Cause "original" works fine. Or inddeed some GGML lib problem.

[kappa8219]

Quite intriguing what would be the result of quantitazing of already prequantized model :)

[snowarch]

Yes.. Ollama always tends to screw up the GGUF models. I'm using the one from unsloth with llama.cpp and it works great.

[musica2016]

Same problem
Ollama versions is 0.11.3-rc0
System: ubuntu

[406747925]

same problem
ollama version is 0.11.3
CUDA Version: 12.4
tesla v100

[niehao100]

same problem
ollama version is 0.11.3
rocm version 1.15
RX7700xt

[billchurch]

I'm experiencing the same issue with the unsloth gpt-oss-20b model on my AMD setup. Here are my system details:

Environment:

• Ollama version: 0.11.3
• OS: Ubuntu 24.04 LTS (running in LXC container on Proxmox)
• Kernel: 6.8.12-11-pve
• CPU: AMD Ryzen AI 9 HX 370 w/ Radeon 890M
• GPU: AMD Radeon 890M (gfx1150) with 32GB VRAM allocated
• ROCm/HSA: Using HSA Runtime 5.7.1 (libhsa-runtime64-1)

Model tested:
hf.co/unsloth/gpt-oss-20b-GGUF:F16

Error reproduced:

$ ollama run hf.co/unsloth/gpt-oss-20b-GGUF:F16 "test"
Error: 500 Internal Server Error: unable to load model: /usr/share/ollama/.ollama/models/blobs/sha256-fcbc7ec4c2d1527c3da84b7049e59dc5af065876169216ec518bceab841e73f7

Relevant logs from journalctl:

gguf_init_from_file_impl: tensor 'blk.0.ffn_down_exps.weight' has invalid ggml type 39 (NONE)
gguf_init_from_file_impl: failed to read tensor info
llama_model_load: error loading model: llama_model_loader: failed to load model from /usr/share/ollama/.ollama/models/blobs/sha256-fcbc7ec4c2d1527c3da84b7049e59dc5af065876169216ec518bceab841e73f7
llama_model_load_from_file_impl: failed to load model

The error is identical to what others are reporting - the tensor blk.0.ffn_down_exps.weight has an invalid ggml type 39 (NONE). This happens on AMD ROCm setup as well, not just CUDA environments.

Other models like gpt-oss:20b, llama3.2:1b, phi3:mini, and gemma3n:e4b work perfectly fine with 100% GPU offloading on this same setup.

[srd00]

apparently the solution is to update llama.cpp https://huggingface.co/unsloth/gpt-oss-20b-GGUF/discussions/11