11:13:22 PM.431stderrrocBLAS error: Could not load /localai/v4/backends/rocm-llama-cpp/lib/rocblas/library/TensileLibrary.dat
11:13:22 PM.431stderr
11:13:22 PM.431stderrrocBLAS error: Could not initialize Tensile library
LocalAI version:
4.1.3/latest
Environment, CPU architecture, OS, and Version:
kvm64
Describe the bug
the files for the TensileLibrary.dat and related files for the gfx906 are missing
To Reproduce
start the chat for a GGUF model
Expected behavior
be able to load the library and run the model
Logs
n/a
Additional context
installed version of rocm = 7.2.1
attempted symlinking to the files from the rocm install
some improvment but still failed to load the TensileLibrary.dat file
also tried copying the file to no avail
the gfx906 card is supported, please include it
11:13:22 PM.431stderrrocBLAS error: Could not load /localai/v4/backends/rocm-llama-cpp/lib/rocblas/library/TensileLibrary.dat
11:13:22 PM.431stderr
11:13:22 PM.431stderrrocBLAS error: Could not initialize Tensile library
LocalAI version:
4.1.3/latest
Environment, CPU architecture, OS, and Version:
kvm64
Describe the bug
the files for the TensileLibrary.dat and related files for the gfx906 are missing
To Reproduce
start the chat for a GGUF model
Expected behavior
be able to load the library and run the model
Logs
n/a
Additional context
installed version of rocm = 7.2.1
attempted symlinking to the files from the rocm install
some improvment but still failed to load the TensileLibrary.dat file
also tried copying the file to no avail
the gfx906 card is supported, please include it