Repository navigation
libtt v0.1.4
v0.1.4 is a minor update to v0.1.3, focused on performance and correctness:
- Keep conditionals inside device traces, avoiding host synchronization and extra copies.
- Speed up sampling for small batches with large vocabularies.
- Fix FP16 matrix multiplication with FP32 accumulation and correct padding handling, while removing unnecessary reshape overhead.
Full changelog.