Skip to content

kyegomez/LongNet

Error
Looks like something went wrong!

About

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

discord.gg/qUtxnK2NMf

Topics

machine-learning artificial-intelligence transformer attention attention-is-all-you-need attention-mechanisms gpt3 gpt4 chatgpt context-length

Resources

Readme

License

Apache-2.0 license
Activity

Stars

706 stars

Watchers

17 watching

Forks

63 forks
Report repository

Releases 43

0.4.8 Latest
Aug 10, 2023
+ 42 releases

Packages

No packages published

Languages