Skip to content

v1.4.0: Improved Support for Huggingface Transformers & LLMs

Latest
Latest
Compare
Choose a tag to compare
@VainF VainF released this 04 Jun 12:19
· 7 commits to master since this release
v1.4.0
b0f0a7c
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

What's Changed

  • Add support for Grouped Query Attention (GQA) in Huggingface transformers.
  • Include minimal examples for Large Language Models (LLaMA-2 & LLaMA-3).

Full Changelog: v1.3.7...v1.4.0

Assets 2
Loading