####Building a Neural Network from scratch 🎉 🐱
Here I have built a library called MiniFlow which will be my own version of TensorFlow!
TensorFlow is one of the most popular open source neural network libraries, built by the team at Google Brain over just the last few years.
So why building MiniFlow?
The goal of this lab is to demystify two concepts at the heart of neural networks - backpropagation and differentiable graphs.
-
Backpropagation is the process by which neural networks update the weights of the network over time. (You may have seen it in this video earlier.)
-
Differentiable graphs are graphs where the nodes are differentiable functions. They are also useful as visual aids for understanding and calculating complicated derivatives.
This is the fundamental abstraction of TensorFlow - it's a framework for creating differentiable graphs.
With graphs and backpropagation, we will be able to create our own nodes and properly compute the derivatives.
Even more importantly, we will be able to think and reason in terms of these graphs.