Skip to content

v0.32.10

Pre-release
Pre-release

Choose a tag to compare

View all tags
@github-actions github-actions released this 12 Aug 22:36
· 1 commit to main since this release
v0.32.10-rc1
8831349
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • Models that don't set a repeat_penalty now default to 1.0 (off) instead of 1.1, matching other engines and speeding up speculative decoding; set a per-model parameter if an older model repeats itself.
  • Faster prefill on NVFP4 MLX models with a global scale, about 7–8% on Qwen3.6 and Muse Glimmer.
  • Fixed blob verification being skipped when an OCI manifest's config and layer share a digest.

New Contributors

Full Changelog: v0.32.8...v0.32.10-rc1

Contributors

vigneshakaviki
Assets 19
Loading