Skip to content

fix: add hipblaslt library#9541

Merged
mudler merged 1 commit into
mudler:masterfrom
eglia:fix-rocm
Apr 24, 2026
Merged

fix: add hipblaslt library#9541
mudler merged 1 commit into
mudler:masterfrom
eglia:fix-rocm

Conversation

@eglia
Copy link
Copy Markdown
Contributor

@eglia eglia commented Apr 24, 2026

Description
This PR adds the hiblaslt libraries, which are needed for rocm backends. Without this PR, running a rocm backend leads to this error:
/backends/rocm-llama-cpp/llama-cpp-fallback: error while loading shared libraries: libhipblaslt.so.0: cannot open shared object file: No such file or directory

This was probably introduced with the switch to rocm7.2

This PR fixes #9257

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

Signed-off-by: Andreas Egli <github@kharan.ch>
@mudler mudler merged commit 1d0de75 into mudler:master Apr 24, 2026
43 checks passed
@eglia eglia deleted the fix-rocm branch April 29, 2026 06:30
@localai-bot localai-bot added the bug Something isn't working label May 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

backend libraries not found but present, fallback used instead of grpc but grpc called from backend

3 participants