v1.0.1

Wording and presentation fixes on top of 1.0.0. No sizing numbers change.

Use it

• Hosted: https://nvme101010.github.io/LLM-Inference-Estimator/
• Container: docker run --rm -p 8080:8080 ghcr.io/nvme101010/llm-inference-estimator:1.0.1 then open http://localhost:8080. Tags 1.0.1, 1.0 and latest.

What changed since 1.0.0

• First token, not first reply. The tile is now called "First token", which is what it measures. For a thinking model it also shows when the answer starts (first token plus the thinking budget at the per-user speed), and its goal line says plainly: "Meets the 2 s goal only if users see the thinking stream. If it is hidden, they wait for the answer." The tile turns orange in that case.
• Server-side caveat. The tile's hover text, the math section, the downloadable summary and the README say every speed figure is measured at the server in steady state and leaves out the network round trip, queueing before the engine admits a request, and tokenization, which can outweigh a short first token.
• Speed per user defined. The math section and the tile's hover text state that each decode step gives every active request one token, so everyone streams at the same rate: speed per user = 1 ÷ step time, output = users ÷ step time.

Model and board data as of October 2026. Estimates for planning, not a guarantee.