Skip to content

History / Multi Turn Decode Performance Slowdown Resolution

Revisions

  • 2026-06-24 correction banners: int4 W4A4 not-yet-viable (downgrade Rank-1 framing); decode-stall is CPU big-core contention not NPU single-stream; GGUF-Q8 vs w8a8/.rkllm path rule. Cross-link ork-driver wiki.

    @mafischer mafischer committed Jun 24, 2026
  • docs(wiki): document multi-turn decode performance resolution

    @mafischer mafischer committed Jun 20, 2026