LocalAI version: 3.12.1
Environment, CPU architecture, OS, and Version: Linux
Describe the bug
I've noticed that because Qwen3.5-4B-GGUF and Qwen3.5-9B-GGUF share the same file mmproj/mmproj-F32.gguf but the files are different files, they get overwritten by LocalAI when you install them and so only the last file remains.
To Reproduce
- install unsloth/Qwen3.5-9B-GGUF
- Make sure 9B has
mmproj: llama-cpp/mmproj/mmproj-F32.gguf
- Initiate a conversation with 9B
- Conversation works
- install unsloth/Qwen3.5-4B-GGUF
- Initiate a conversation with 9B
- Conversation fails
Expected behavior
Conversation works.
Logs
Additional context
LocalAI version: 3.12.1
Environment, CPU architecture, OS, and Version: Linux
Describe the bug
I've noticed that because Qwen3.5-4B-GGUF and Qwen3.5-9B-GGUF share the same file
mmproj/mmproj-F32.ggufbut the files are different files, they get overwritten by LocalAI when you install them and so only the last file remains.To Reproduce
mmproj: llama-cpp/mmproj/mmproj-F32.ggufExpected behavior
Conversation works.
Logs
Additional context