ERA-SESSION22 Training PyThia-160M from scratch on AWS Sagemaker

🤗Space Link

This is an implementation of Pythia-160M LitGPT by LightningAI.
Dataset used to train: RedPajama.

Tasks:

1. ✔️ Once done, share: screenshot of the logs showing your submission result and clearly showing PageMaker in the URL [800 pts]
2. ✔️ 4 sample predictions [200 pts]
3. ✔️ The model moved to HuggingFace Spaces as an app. [1000 pts]

Training Log on AWS Sagemaker:

Sample Results: