Skip to content

v2.22.2

Choose a tag to compare

@NathanL15 NathanL15 released this 11 Oct 00:38
· 10 commits to main since this release

A patch release: nothing the model reads changes.

  • Each eval trace records the server-log counts for its own run (requests,
    Rewind failures, busy-slot retries), and each model call its
    finish_reason. Until now those were only reported per arm.
  • The two exact tests are checked against SciPy 1.16's values. They matched
    to 1e-15 on every 2×2 table up to 12 runs per arm and every discordant
    pair up to 40 each; 21 arm-sized points are pinned in the tests.
  • Measured, nothing changed: Hex's token estimate against the real Qwen
    tokenizer over 134 reconstructed requests from the chat log runs a median
    3.5 % high (−2.7 % to +7.5 %), and the server's 3.6–5.4 % high, so both
    err on the safe side and exact counting would buy about 3 % of headroom.