Skip to content

llama.cpp ROCm v0.0.2-experimental [Experimental RDNA Boosts]

Pre-release
Pre-release

Choose a tag to compare

View all tags
@github-actions github-actions released this 08 Sep 06:16
· 148 commits to custom-workflow since this release
v0.0.2-experimental
55776c9

Release Information

  • Flavor: Experimental RDNA Boosts
  • Source Branch: experiment/rdna-boosts
  • Commit: 6b05c7e38228600dd467f2bcd9dbb69d21594c24
  • ROCm Core SDK: 10.0.0 (TheRock)
  • Target GPU Architectures: gfx900;gfx906;gfx908;gfx90a;gfx1030;gfx1100;gfx1101;gfx1102;gfx1200;gfx1201

Description

TurboQuant KV cache + Stew's RDNA Boosts (native-BF16 FA, WMMA, fused GDN, fused MoE) + ROCmFPX quantization family + DFlash2 speculative decoding.

Unified ROCm 10.0.0 (TheRock) release built for Windows and Linux.
Packages include required AMD ROCm runtime libraries (rocblas, hipblaslt, hipblas, amdhip64) for portable out-of-the-box execution.

  • Windows Scripts: llama-rocm-experimental-scripts-windows.zip (PowerShell quantization scripts for Windows)
  • Linux Scripts: llama-rocm-experimental-scripts-linux.zip (Bash quantization scripts for Linux)
Assets 6
Loading