-
-
Notifications
You must be signed in to change notification settings - Fork 3.7k
Closed
Labels
Description
LocalAI version: 3.12.1
Environment, CPU architecture, OS, and Version: Linux
Describe the bug
I've noticed that because Qwen3.5-4B-GGUF and Qwen3.5-9B-GGUF share the same file mmproj/mmproj-F32.gguf but the files are different files, they get overwritten by LocalAI when you install them and so only the last file remains.
To Reproduce
- install unsloth/Qwen3.5-9B-GGUF
- Make sure 9B has
mmproj: llama-cpp/mmproj/mmproj-F32.gguf - Initiate a conversation with 9B
- Conversation works
- install unsloth/Qwen3.5-4B-GGUF
- Initiate a conversation with 9B
- Conversation fails
Expected behavior
Conversation works.
Logs
Additional context
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
Projects
Status
Done