GitHub - peytontolbert/Griffin: Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

peytontolbert / Griffin Public

Notifications You must be signed in to change notification settings
Fork 1
Star 12

Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

12 stars 1 fork Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
griffin		griffin
tests		tests
README.md		README.md
dataset.py		dataset.py
eval.py		eval.py
example.py		example.py
train.py		train.py

Repository files navigation

https://arxiv.org/pdf/2402.19427.pdf

About

Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%