New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make Transformers official #170

Merged

cgarciae merged 2 commits into master from make-transformers-official

Mar 1, 2021

Collaborator

cgarciae commented Mar 1, 2021 •

edited

Loading

Adds the following modules to elegy.nn:

MultiHeadAttention
Transformer
TransformerDecoder
TransformerDecoderLayer
TransformerEncoder
TransformerEncoderLayer

cgarciae added 2 commits

March 1, 2021 16:50


          simple transformer test

4cdfd2f


          fix docs

bf5592f

cgarciae merged commit 4ed4c86 into master

cgarciae deleted the make-transformers-official branch

March 1, 2021 22:44

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet