Skip to content

Repository files navigation

I have made a GPT-2 clone, using PyTorch mainly i managed to immitate the learning capabilities of an earlier Chat GPT model, based on the 'Attention is All You Need' paper, the model is mainly based on the transformer architecture's post-processing part, which provides the answers to the question, the NLP side of the model being to computationally expensive for a personal device.

About

GPT-2 like implementation of a large language model, using the pyTorch library

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages