RuGPT3XL Colab Notebook Doesn't Work

[Marcus-Arcadius]

Keeps running into errors with installing deep speed, sparse attention ops and logits???

[amrzv]

Recently I've made pull request with fix for this notebook, the problem was in cuda version (11 needed).
You can support this pull request here.
Also, you can run it directry from my branch:

[Marcus-Arcadius]

Thanks mate, this ended up working me, your an amazing legend and keep up the fantastic work 😃

[Marcus-Arcadius]

@amrzv I am getting this error now when opening the saved notebook?

[amrzv]

@amrzv I am getting this error now when opening the saved notebook?

I've just ran notebooks and there were no errors

Try "Runtime -> Reset all runtimes" and running again.

[Marcus-Arcadius]

Thanks, it ended up working!