Skip to content

Missing ROCm Support for RDNA2 Device Models (6950 XT, 6900 XT, 6900, 6750 XT, 6650 XT) #2403

Description

@gchriswill

Platform

Windows

Lemonade Version

10.8.1

GPU / APU Model

PowerColor Red Devil AMD Radeon RX 6950 XT

Component

llama.cpp

Bug Description

std::string identify_rocm_arch_from_name(const std::string& device_name) in src/cpp/server/system_info.cpp is used to map an AMD GPU marketing name to its ROCm gfx architecture family. The RDNA2 detection branch (gfx103X) only includes four of the eight RX 6000 series model numbers:

device_lower.find("6800") || device_lower.find("6700") || device_lower.find("6600") || device_lower.find("6500") 

For the following RDNA2 dGPU models, std::string identify_rocm_arch_from_name(const std::string& device_name) returns an empty string instead of gfx103X:

Model
AMD Radeon RX 6950 XT
AMD Radeon RX 6900 XT
AMD Radeon RX 6900
AMD Radeon RX 6750 XT
AMD Radeon RX 6650 XT

Notes 📝:

I found this issue in version 10.8.0 due to the need for ROCm support for my dGPU model gfx1030.
Then the promising 10.8.1 with fix #2295 didn't worked for me.
After building the latest from main source, I still get the same "Unsupported GPU" when listing the backends.

Steps to Reproduce

  1. Have a PC with any of these AMD RDNA2 dGPUs: 6950 XT, 6900 XT, 6900, 6750 XT, 6650 XT
  2. Lemonade launches
  3. Check available backend list via app or cli
  4. Observe for ROCm "Unsupported GPU"

Expected vs Actual Behavior

std::string identify_rocm_arch_from_name(const std::string& device_name);

Device Models Expected Result Current Result
AMD Radeon RX 6950 XT "gfx103X" ""
AMD Radeon RX 6900 XT "gfx103X" ""
AMD Radeon RX 6900 "gfx103X" ""
AMD Radeon RX 6750 XT 'gfx103X" ""
AMD Radeon RX 6650 XT 'gfx103X" ""

Log Output

N/A

Additional Context

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingengine::llamacppllama.cpp backend (LlamaCppServer); GPU/CPU LLM inference (Vulkan, ROCm, Metal)runtime::rocmAMD ROCm runtime

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions