-
-
Notifications
You must be signed in to change notification settings - Fork 3.8k
acestep-cpp-turbo-4b with vulkan-acestep-cpp-development fails due to model directory and model path both containing the same directory #9005
Description
LocalAI version:
3.12.1
Environment, CPU architecture, OS, and Version:
ubuntu 24.04 x86_64
Describe the bug
I installed acestep-cpp-turbo-4b model and master vulkan acestep-cpp backend. When trying to use model, it says it failed and there is this message in the logs:
[GGUF] cannot open /models/acestep-cpp/acestep-cpp/acestep-v15-turbo-Q8_0.gguf" caller={caller.file="/build/pkg/model/process.go" caller.L=153 }
[Load] FATAL: cannot load /models/acestep-cpp/acestep-cpp/acestep-v15-turbo-Q8_0.gguf"
[acestep-cpp] FATAL: failed to load DiT from /models/acestep-cpp/acestep-cpp/acestep-v15-turbo-Q8_0.gguf"
I have looked at the filesystem and see that file there, but there is only one level of acestep-cpp folder:
acestep-cpp# ls
acestep-5Hz-lm-4B-Q8_0.gguf acestep-v15-turbo-Q8_0.gguf Qwen3-Embedding-0.6B-Q8_0.gguf vae-BF16.gguf
It seems there is some duplication somewhere between how the base directory is determined and the model path. The model path does include the acestep-cpp folder in the xml model config. I'd say, since the model path for the files is used like that for other models, the issue is likely how the base path is determined.
To Reproduce
install acestep-cpp-turbo-4b with vulkan-acestep-cpp-development on vulkan build of localai and try to use model.
Expected behavior
model loads and generates sound
Logs
Additional context