Mutimodal HF model for audio return input audio is not supported

[ISGIND]

Following next post:

https://www.docker.com/blog/how-to-use-multimodel-ai-with-model-runner/

I'm trying to use this model from HF: hf.co/ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF:Q4_K_M, but instead of have a reply I got this error:

{
"error": {
"code": 500,
"message": "audio input is not supported - hint: if this is unexpected, you may need to provide the mmproj",
"type": "server_error"
}
}

Im trying to check if there's a way to add some mmproj but there is not sufficient info about this on DMR, if some one could help me.

Version 4.67.0 (222858)
Win 11
RTX 3090

[ilopezluna]

Thanks @ISGIND for raising the issue! When using Hugging Face models, we create the OCI artifact "on the fly," and during that process, multimodal projector files (mmproj) are missed. I’m going to look into this.