bug:error loading model architecture: unknown model architecture: 'Qwen3-VL-8B-Instruct'

[huangye123]

Git commit

🥲 加载模型失败

Failed to load model

error loading model: error loading model architecture: unknown model architecture: 'Qwen3-VL-8B-Instruct'

Operating systems

Windows

GGML backends

CUDA

Problem description & steps to reproduce

First Bad Commit

No response

Compile command

-

Relevant log output

-

[abc-nix]

#16207

[myf0920]

"How can I solve this? Is this feature not supported yet?"
(base) miaoyf@ccdcMac-Studio8 llama.cpp % python convert_hf_to_gguf.py /Users/miaoyf/models_2025/Qwen3-VL-8B-Instruct --outtype q8_0 --verbose --outfile /Users/miaoyf/models_2025/Qwen3-VL-8B-Instruct.q8_0.gguf
INFO: hf-to-gguf: Loading model: Qwen3-VL-8B-Instruct
WARNING: hf-to-gguf: Failed to load model config from /Users/miaoyf/models_2025/Qwen3-VL-8B-Instruct
The checkpoint you are trying to load has model type 'qwen3_vl' but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

You can update Transformers with the command pip install --upgrade transformers. If this does not work, and the checkpoint is very new, then there may not be a release version that supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command pip install git+https://github.com/huggingface/transformers.git

WARNING: hf-to-gguf: Trying to load config.json instead
INFO: hf-to-gguf: Model architecture: Qwen3VLForConditionalGeneration
ERROR: hf-to-gguf: Model Qwen3VLForConditionalGeneration is not supported

[taronaeo]

Please refer to #16207 for the work in progress. Closing as a duplicate.