Skip to content

libtt v0.1.4

Choose a tag to compare

@pcmoritz pcmoritz released this 28 Oct 18:12
· 27 commits to main since this release
5e1b047

v0.1.4 is a minor update to v0.1.3, focused on performance and correctness:

  • Keep conditionals inside device traces, avoiding host synchronization and extra copies.
  • Speed up sampling for small batches with large vocabularies.
  • Fix FP16 matrix multiplication with FP32 accumulation and correct padding handling, while removing unnecessary reshape overhead.
    Full changelog.