Skip to content

acestep-cpp-turbo-4b with vulkan-acestep-cpp-development fails due to model directory and model path both containing the same directory #9005

@eyecreate

Description

@eyecreate

LocalAI version:

3.12.1

Environment, CPU architecture, OS, and Version:

ubuntu 24.04 x86_64

Describe the bug

I installed acestep-cpp-turbo-4b model and master vulkan acestep-cpp backend. When trying to use model, it says it failed and there is this message in the logs:

[GGUF] cannot open /models/acestep-cpp/acestep-cpp/acestep-v15-turbo-Q8_0.gguf" caller={caller.file="/build/pkg/model/process.go"  caller.L=153 }
[Load] FATAL: cannot load /models/acestep-cpp/acestep-cpp/acestep-v15-turbo-Q8_0.gguf"
[acestep-cpp] FATAL: failed to load DiT from /models/acestep-cpp/acestep-cpp/acestep-v15-turbo-Q8_0.gguf"

I have looked at the filesystem and see that file there, but there is only one level of acestep-cpp folder:

acestep-cpp# ls
acestep-5Hz-lm-4B-Q8_0.gguf  acestep-v15-turbo-Q8_0.gguf  Qwen3-Embedding-0.6B-Q8_0.gguf  vae-BF16.gguf

It seems there is some duplication somewhere between how the base directory is determined and the model path. The model path does include the acestep-cpp folder in the xml model config. I'd say, since the model path for the files is used like that for other models, the issue is likely how the base path is determined.

To Reproduce

install acestep-cpp-turbo-4b with vulkan-acestep-cpp-development on vulkan build of localai and try to use model.

Expected behavior

model loads and generates sound

Logs

Additional context

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions