Skip to content

chore(whisperx): drop ROCm/hipblas build target#9474

Merged
mudler merged 2 commits into
masterfrom
chore/drop-whisperx-rocm-hipblas
Apr 21, 2026
Merged

chore(whisperx): drop ROCm/hipblas build target#9474
mudler merged 2 commits into
masterfrom
chore/drop-whisperx-rocm-hipblas

Conversation

@mudler
Copy link
Copy Markdown
Owner

@mudler mudler commented Apr 21, 2026

whisperx has no upstream AMD GPU support and its core transcription path (faster-whisper -> ctranslate2) falls back to CPU on AMD since the PyPI ctranslate2 is CUDA-only. The torch rocm wheels would accelerate only the alignment/diarization stages, producing a misleadingly half-working image.

Drop the hipblas variant rather than shipping a partially accelerated build users can't distinguish from the real thing. AMD hosts now fall through the capability map to cpu-whisperx / cpu-whisperx-development.

Also removes the now-dangling rocm-whisperx assertion from pkg/system/capabilities_test.go and the ROCm mention from the whisperx row in docs/content/reference/compatibility-table.md.

Assisted-by: Claude Code:claude-opus-4-7

mudler and others added 2 commits April 21, 2026 15:32
whisperx has no upstream AMD GPU support and its core transcription path
(faster-whisper -> ctranslate2) falls back to CPU on AMD since the PyPI
ctranslate2 is CUDA-only. The torch rocm wheels would accelerate only the
alignment/diarization stages, producing a misleadingly half-working image.

Drop the hipblas variant rather than shipping a partially accelerated build
users can't distinguish from the real thing. AMD hosts now fall through
the capability map to cpu-whisperx / cpu-whisperx-development.

Also removes the now-dangling rocm-whisperx assertion from
pkg/system/capabilities_test.go and the ROCm mention from the whisperx
row in docs/content/reference/compatibility-table.md.

Assisted-by: Claude Code:claude-opus-4-7
@mudler mudler merged commit 39573ec into master Apr 21, 2026
45 checks passed
@mudler mudler deleted the chore/drop-whisperx-rocm-hipblas branch April 21, 2026 19:50
@localai-bot localai-bot added the enhancement New feature or request label May 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants