GitHub - Norod/TrainGPT2-127M-FromScratch: A trio of Google-Colab notebooks (ipynb) for training a GPT-2 (127M) model from scratch (useful for other / non-English languages) using gpt-2-simple

This repository has been archived by the owner on Jan 9, 2023. It is now read-only.

Norod / TrainGPT2-127M-FromScratch Public archive

A trio of Google-Colab notebooks (ipynb) for training a GPT-2 (127M) model from scratch (useful for other / non-English languages) using gpt-2-simple

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
TrainGPT2_FromScratch_02_encode_dataset.ipynb		TrainGPT2_FromScratch_02_encode_dataset.ipynb
TrainGPT2_FromScratch_03_Training.ipynb		TrainGPT2_FromScratch_03_Training.ipynb
Train_GPT2_FromScratch_01_Tokenizer.ipynb		Train_GPT2_FromScratch_01_Tokenizer.ipynb