Skip to content

rocm/strix halo: mtp path broken #425

Description

@kyuz0

The current main branch for rocm on gfx1151 gets stuck when trying to load MTP, this used to work last week.

⬢ [kyuz0@toolbx ~]$ ds4-server -m ~/ds4/DeepSeek-V4-Flash-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-chat-v2-imatrix.gguf \
  --mtp ~/ds4/DeepSeek-V4-Flash-MTP-Q4K-Q8_0-F32.gguf \
  --mtp-draft 1 \
  --ctx 100000
ds4: Linux rocm backend set oom_score_adj=1000
ds4: MTP support model loaded: /home/kyuz0/ds4/DeepSeek-V4-Flash-MTP-Q4K-Q8_0-F32.gguf (draft=1)
ds4: ROCm backend initialized on AMD Radeon 8060S Graphics (sm_115)
ds4: ROCm preparing model tensor mappings: 58.56 GiB
ds4: ROCm preparing model tensor mappings: 59.07 GiB
[STUCK]
Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions