Skip to content

v0.4.0

Choose a tag to compare

@asher asher released this 25 Aug 04:07
· 66 commits to main since this release
Immutable release. Only release title and notes can be modified.
e495f05

What's Changed

  • feat(serve): hardening for concurrent requests under apc and speculation by @asher in #62
  • fix(serve): reply-content indent loss and float16 sampling/softcap hardening by @asher in #63
  • fix(serve): memory accounting and admission hardening; qualify mlx 0.32.1 by @asher in #64
  • serve: manage memory pressure across admission, decode, and cache tiers by @asher in #67
  • feat(dflash2): DFlash 2 drafter support for Qwen3.8-27B and Muse-Glimmer-30B by @asher in #65
  • fix(serve): eviction headroom leak and cpu-stream bus error by @asher in #69
  • fix(serve): evicted streamed models stayed resident by @asher in #70
  • fix(thinking): mlx-vlm 0.6.15 thinking-off regression + end-to-end thinking control plumbing by @asher in #71
  • fix(apc): lone-harvest patch matches the 0.6.15 harvest signature by @asher in #73
  • fix(serve): governor kernel floor + APC retirement/kv-quant/ring-copy fixes by @asher in #74

Full Changelog: v0.3.2...v0.4.0