Skip to content

History / Exp 2026 06 23 Decode Profiling

Revisions

  • Add 2026-06-23 decode profiling: ~4 t/s GGUF-Q8_0 is bandwidth-bound, not a regression; chain-batching ROI is MoE/prefill not decode

    @mafischer mafischer committed Jun 23, 2026