Neural Networks from scratch

Going through Andrej Karpathy's NN from scratch series (~13 hours)

Look at my progress

installations

brew install graphviz

Building micrograd (currently doing)

What? A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

• Code
• Notes on the lectures

Building makemore

TODO

Source

• Neural Networks: Zero to Hero
• karpathy/nn-zero-to-hero: Neural Networks: Zero to Hero

Resources

• Neural networks - 3Blue1Brown