GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!
-
Updated
Oct 29, 2022 - Python
GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!
Add a description, image, and links to the alibi topic page so that developers can more easily learn about it.
To associate your repository with the alibi topic, visit your repo's landing page and select "manage topics."