Skip to content

ROCmFPX Server v1.0.0 for AMD Strix Halo

Choose a tag to compare

View all tags
@julianmb julianmb released this 17 Aug 03:40
· 93 commits to main since this release
v1.0.0
46e9e40

ROCmFPX Server v1.0.0 — Unified Model Serving Framework for AMD Strix Halo

Features:

  • Unified Model Zoo: Download, verify, and serve quantized models (Qwen 3.8 27B, Nemotron 3.5 30B, Ornith 35B, DeepSeek V4 Flash, Laguna S 2.1) directly from Hugging Face.
  • Single-Endpoint Architecture: Serves standard OpenAI /v1/chat/completions (with streaming SSE) + Lemonade-style management API /api/v1/{load, unload, pull, status, system-info} on port 8010.
  • Dual-Backend Acceleration: Automatic Vulkan0 (Mesa RADV Wave64 KHR_coopmat) + ROCm0 HIP execution.
  • Docker Compose Stack: 1-command deployment with Open WebUI integration.
  • MTP Speculation & TurboQuant KV Cache: Sub-linear memory scaling and up to 36 tok/s generation throughput.

Included Asset:

  • strix-halo-rocmfpx-engine-v1.0.0-linux-x86_64.tar.gz (SHA256: bbc7845db0c012b97f1c9b8a2733a7083c6f9a749a453866fbe1994151d3364f)
Assets 3
Loading