Skip to content

Tensile Library for gfx906 missing #9313

Description

@JLT032

11:13:22 PM.431stderrrocBLAS error: Could not load /localai/v4/backends/rocm-llama-cpp/lib/rocblas/library/TensileLibrary.dat
11:13:22 PM.431stderr
11:13:22 PM.431stderrrocBLAS error: Could not initialize Tensile library

LocalAI version:
4.1.3/latest

Environment, CPU architecture, OS, and Version:
kvm64

Describe the bug
the files for the TensileLibrary.dat and related files for the gfx906 are missing

To Reproduce
start the chat for a GGUF model

Expected behavior
be able to load the library and run the model

Logs
n/a

Additional context

installed version of rocm = 7.2.1

attempted symlinking to the files from the rocm install
some improvment but still failed to load the TensileLibrary.dat file
also tried copying the file to no avail

the gfx906 card is supported, please include it

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions