I wanted to learn Candle, so I decided to port Andrej Karpathy's tutorial. It gives a good feel for the Candle API and it's meant for people who want to use Candle and see how certain things can be done, so do look into that src directory!
Blogpost on Perceptive Bits.
This project was developed using Candle 0.3.2 and Rust 1.75.0
You can run it with
run --package gpt-from-scratch-rs --bin gpt-from-scratch-rs -- --input-path /home/jvlek/dev/datasets/tinyshakespeare.txt
Where input-path points to a text file you want to train on. See the file src/args.rs for more arguments like number of epochs (note that you need to convert underscores to dashes).