Skip to content

HaloFPX v1.5.0 — Ornith MTP refresh, flash-next quants, baked ROCm image

Choose a tag to compare

View all tags
@julianmb julianmb released this 04 Sep 11:17
· 32 commits to main since this release
v1.5.0
0be229a

what's new since v1.4.0 (25 commits):

  • ornith-1.5-35b now ships mtp enabled: official aug-24 refresh requantized and re-benched on strix halo — 105.6 tok/s effective, 87.98% draft acceptance (n4/p0.6)
  • qwen38-flash-next: two verified quants added — IQ4_XS (115.5G, paris-verified, insultated from hf) and ROCmFP4_FAST (113G) — plus per-variant hf repo support in the model manager
  • docker: the rocm 7.2.3 runtime subset is baked into the default image — the server starts out of the box with no host mounts, both backends available (fixes #4). image is ~8G.
  • engine behavior: spec-stateful mtp + prompt-cache concurrency, scaled context checkpoints on 128gb boxes
  • registry hardening: mandatory quant provenance on every variant, ornith mtp config pinned to measured evidence
  • glm-5.3-flash remains standalone (glm5nextrocm) until upstream pr ggml-org/llama.cpp#27754 lands and rocmfpx rebases

docker: ghcr.io/julianmb/halofpx:1.5.0 (and :latest) — builds automatically from this release.

Assets 2
Loading