Skip to content

Release v1.3.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 06 Sep 07:09
· 52 commits to main since this release
v1.3.0
a5f2dcc
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • Fix batched generation for unequal-length prompts by @IMvision12 in #415
  • Padding-aware true-batch decode for ragged generation (llama, qwen2, qwen3) by @IMvision12 in #416
  • Fix stochastic generation: non-deterministic by default + (steps, batch) sampling noise by @IMvision12 in #417
  • Guard degenerate sampler parameters (p ≤ 0, k ≤ 0, temperature ≤ 0) by @IMvision12 in #418
  • release 1.3.0 by @IMvision12 in #419

Full Changelog: v1.2.9...v1.3.0

Contributors

IMvision12
Assets 2
Loading