Repository navigation
MeG #889
dustinwloring1988
started this conversation in
Show and tell
MeG
#889
Replies: 1 comment
|
Can you please share your script? |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I used the following paper and fitted it to work with nanochat's ReLU-squared MLP at layer 8 getting a little higher benchmark MeG (arXiv:2512.14395)
I will post more information if anyone is interested. Or if someone just wants the model an weights I can post on Huggingface.
All reactions