Skip to content

Reproduce and resolve gfx1151 EngineCore model-load segfault #14

Description

@randomvariable

Objective

Reproduce and resolve the gfx1151 EngineCore libhsa-runtime64.so model-load segfault using a coherent supported ROCm stack.

Target hardware

  • AMD Strix Halo / RDNA 3.5 / gfx1151

References

Context

The fork already has equivalent integrated-GPU memory reporting, so this issue excludes that work. Focus is the hard model-load crash and whether it belongs to vLLM, torch, ROCm/HSA runtime, or an incoherent package mix.

Proposed work

  • Reproduce on the fork's coherent gfx1151 ROCm SDK/Torch environment.
  • Capture native backtrace, ROCm/HSA versions, loaded shared libraries, and the smallest model/config that crashes.
  • Differential-test known coherent release/nightly stacks and a direct torch allocation/load reproducer.
  • Fix vLLM only if evidence reaches a vLLM code path; otherwise produce an actionable upstream ROCm/torch report and pin the known-good stack.

Acceptance criteria

  • Minimal deterministic reproducer and symbolized crash evidence exist.
  • Root cause is assigned to the correct layer.
  • On the minimized model/config, EngineCore loads and returns the expected deterministic tokens without CPU fallback or segfault.
  • Peak unified memory, TTFT, and decode throughput are reported for later qualification.

Metadata

Metadata

Assignees

No one assigned

    Labels

    area/ideaOptimization idea candidate for evaluation

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions