Idea
Evaluate the Strix Halo toolbox work that builds vLLM images from AMD's official per-arch ROCm release wheels for gfx1151, avoiding nightly ROCm drift while keeping text and vision paths on GPU.
Target Hardware
- Strix Halo / RDNA 3.5 / gfx1151
Sources
Why It Might Matter
gfx1151 support is highly sensitive to ROCm wheel provenance and ABI alignment. A stable official-release image path could make Strix Halo vLLM testing repeatable, reduce broken-nightly churn, and preserve GPU execution for vision paths that otherwise fall back or OOM.
Possible vLLM Work
- Compare this image strategy against the fork's current ROCm build/deployment assumptions.
- Verify the current official AMD gfx1151 torch/ROCm wheel set resolves with vLLM dependencies.
- Test text and vision model serving on Strix Halo and record throughput, memory use, and backend selection.
- Identify whether any upstream vLLM patches are needed versus image-only changes.
Duplicate Check
Searched randomvariable/vllm issues by title keywords, kyuz0/amd-strix-halo-vllm-toolboxes#76, ROCm gfx1151 vLLM image, and rocm7.14.0-torch2.11.0-vllm0.26.0; no existing equivalent issue was found.
Idea
Evaluate the Strix Halo toolbox work that builds vLLM images from AMD's official per-arch ROCm release wheels for gfx1151, avoiding nightly ROCm drift while keeping text and vision paths on GPU.
Target Hardware
Sources
Why It Might Matter
gfx1151 support is highly sensitive to ROCm wheel provenance and ABI alignment. A stable official-release image path could make Strix Halo vLLM testing repeatable, reduce broken-nightly churn, and preserve GPU execution for vision paths that otherwise fall back or OOM.
Possible vLLM Work
Duplicate Check
Searched randomvariable/vllm issues by title keywords,
kyuz0/amd-strix-halo-vllm-toolboxes#76,ROCm gfx1151 vLLM image, androcm7.14.0-torch2.11.0-vllm0.26.0; no existing equivalent issue was found.