Skip to content

Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle

License

Notifications You must be signed in to change notification settings

jeroenvlek/gpt-from-scratch-rs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

58 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Why?

I wanted to learn Candle, so I decided to port Andrej Karpathy's tutorial. It gives a good feel for the Candle API and it's meant for people who want to use Candle and see how certain things can be done, so do look into that src directory!

Blogpost on Perceptive Bits.

How

This project was developed using Candle 0.3.2 and Rust 1.75.0

You can run it with

run --package gpt-from-scratch-rs --bin gpt-from-scratch-rs -- --input-path /home/jvlek/dev/datasets/tinyshakespeare.txt

Where input-path points to a text file you want to train on. See the file src/args.rs for more arguments like number of epochs (note that you need to convert underscores to dashes).

About

Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages