Skip to content

llama.cpp ROCm v0.0.1-experimental [Experimental RDNA Boosts]

Pre-release
Pre-release

Choose a tag to compare

View all tags
@github-actions github-actions released this 04 Sep 17:44
· 175 commits to custom-workflow since this release
v0.0.1-experimental
04dc4df

Release Information

  • Flavor: Experimental RDNA Boosts
  • Source Branch: experiment/rdna-boosts
  • Commit: 277ea9bd0fef76c6f366689f5c723e9711da7a3b
  • ROCm Core SDK: 10.0.0 (TheRock)
  • Target GPU Architectures: gfx900;gfx906;gfx908;gfx90a;gfx1030;gfx1100;gfx1101;gfx1102;gfx1200;gfx1201

Description

TurboQuant KV cache + Stew's RDNA Boosts (native-BF16 FA, WMMA, fused GDN, fused MoE) + ROCmFPX quantization family + DFlash2 speculative decoding.

Unified ROCm 10.0.0 (TheRock) release built for Windows and Linux.
Packages include required AMD ROCm runtime libraries (rocblas, hipblaslt, hipblas, amdhip64) for portable out-of-the-box execution.

  • Windows Scripts: llama-rocm-experimental-scripts-windows.zip (PowerShell quantization scripts for Windows)
  • Linux Scripts: llama-rocm-experimental-scripts-linux.zip (Bash quantization scripts for Linux)
Assets 6
Loading