This is the code for "Synthetic Gradients Explained" by Siraj Raval on Youtube
This is the code for this video on Youtube by Siraj Raval on synthetic gradients. This is an optimization strategy DeepMind released that could overtake backpropagation.
- numpy
Use pip to install missing dependencies.
Both versions (backprop and synthetic gradient versions) have their own python file. Run them from command line using
python name_of_file.py
To run the notebook run this in the root directory
jupyter notebook
Install jupyter from here
Credits for the code go to trask. I've merely created a wrapper to get people started.