Skip to content

Implementation of the decoder part of the transformer architecture for a generative pre_trained transformer(GPT)

Notifications You must be signed in to change notification settings

achrefbenammar404/nanoGPT

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

Repository files navigation

nanoGPT

Guided by the course developed by Mr. Andrej Karpathy, I successfully created my inaugural babbling generative model. For this instance, I employed the mini_shakespeare dataset for training. The resultant model generated text—found in 'more.txt'—that, while nonsensical, exhibits a certain semblance to Shakespearean style, a testament to the model's capacity to mimic the distinguished playwright's linguistic patterns.

About

Implementation of the decoder part of the transformer architecture for a generative pre_trained transformer(GPT)

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages