Skip to content

v0.3.1

Choose a tag to compare

View all tags
@asher asher released this 13 Aug 01:48
· 81 commits to main since this release
Immutable release. Only release title and notes can be modified.
v0.3.1
e298705
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • feat(kimi-k2): kimi-k2.5/2.7 support with vision by @asher in #50
  • feat(dtype): float16 activations for M1/M2 GPUs without native bfloat16 by @asher in #51
  • perf(deepseek4): fuse the compressor emit-path fp8 round-trip into one dispatch by @asher in #52
  • feat(apc): system-prompt anchor keeps shared prefixes warm across sibling requests by @asher in #53
  • feat(serve): the server now supports vision for streaming-experts (larger than RAM) models by @asher in #59

Full Changelog: v0.3.0...v0.3.1

Contributors

asher
Assets 3
Loading