Skip to content

libtt v0.1.5

Latest
Latest

Choose a tag to compare

View all tags
@pcmoritz pcmoritz released this 31 Oct 10:02
· 53 commits to main since this release
v0.1.5
74cb166
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
  • Faster speculative decoding with multi-token GDN/causal-convolution updates and optimized vocabulary-wide cumsums and gathers.
  • Improved multi-device execution by reusing the active mesh and keeping more copies on-device.
  • Faster host transfers through device-side untilization, stream-ordered reads, and larger zero-copy uploads.
  • Fixed sharding, aliased custom-call, paged-cache, and unit-dimension gather issues.
  • Added chunked-attention support for page tables of any width.

Full changelog: v0.1.4...v0.1.5

Assets 2
Loading