Skip to content

v0.32.0 — Kimi K3 and the current high-end lineup

Choose a tag to compare

View all tags
@VickyXAI VickyXAI released this 20 Jul 22:24
v0.32.0
8590348
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Adds Kimi K3 and the models the gateway serves that we didn't, and rebuilds MODEL_TIERS against the live catalogue.

A retired model ID does not fail

That's why the tiers had rotted invisibly. The gateway silently aliases a dead ID onto something else:

  • nvidia/llama-4-maverick → 200 OK, body says "model": "nvidia/gpt-oss-120b"
  • moonshot/kimi-k2.6 → still returns a 402 price quote
  • only a wholly unknown ID 400s

So "the tier works" was never evidence the tier was correct. 8 dead IDs had accumulated across 6 tiers, quietly routing to models nobody chose.

What's new

  • Kimi K3 — $3/$15, 1M ctx, vision + reasoning + coding → balanced, reasoning, coding. Supersedes the retired k2.x line.
  • The current high end — gpt-5.6-sol/terra, claude-sonnet-5, claude-fable-5, grok-4.5/4.3/build-0.1, qwen3.7-max, deepseek-v4-pro (frontier-class reasoning at $0.435/$0.87), minimax-m3, glm-5.2/5.1.
  • Default model is now gpt-5.6-terra — newer line, 1M context, and half the price of the outgoing gpt-5.5 default.

What was broken

  • The free tier was 4/5 retired. Free calls were being served by models nobody picked. Rebuilt from the $0 models actually listed.
  • Listed ≠ alive. nvidia/mistral-large-3-675b is in the catalogue at $0 and hangs — no response, no error, >90s, reproduced twice. It had landed at free[0] on the first pass, where it would stall every mode:"free" call before the loop could fall through. Excluded.
  • The tool description advertised tiers that no longer existed — it told the model coding meant "GLM-5 first" when coding[0] had been claude-opus-4.8 for several releases.

Budget gate — verified, not assumed

The new $180/M and $168/M models raise whether the $20/M frontier reserve still covers the worst case. It does; the gateway quotes sublinearly — gpt-5.4-pro at 128k max_tokens quotes $2.42 against a $2.56 reserve. Headroom is only ~5%, so the constant was left alone rather than guessed at.

Verification

169/169 tests · typecheck · build · verify:prices 20/20 exact · stdio smoke test 19 tools · all 49 tier IDs validated against live GET /v1/models.

Assets 2
Loading