Repository navigation
|
https://huggingface.co/PaddlePaddle/PaddleOCR-VL-1.6-GGUF/tree/main For example, with the paddle mentioned above, as far as I know, it requires a regular GGUF model and an MMProj model. I downloaded them and placed them in the same directory, but it seems that Llama doesn’t load the MMProj model at the same time. I’m not sure if this is a feature limitation or something else. I tried changing the names, but it didn’t seem to work. Seeking help, thank you. |
Replies: 2 comments
|
Thanks for the report — this was a bug. Llama expected the projector file to be named like After updating, remove the model and install it again — the projector will be downloaded and attached automatically. |
|
The projector filename fix shipped in Closing this as fixed, but let me know if it still doesn't work. |
Thanks for the report — this was a bug. Llama expected the projector file to be named like
mmproj-*.gguf, and this repo names itPaddleOCR-VL-1.6-GGUF-mmproj.gguf, so it was never picked up. It's fixed in the next release.After updating, remove the model and install it again — the projector will be downloaded and attached automatically.