Skip to content
Branch: master
Find file History
Permalink
Type Name Latest commit message Commit time
..
Failed to load latest commit information.
README.md update neuro-evolution links Apr 26, 2017
perceptron.pdf some perceptron slides Apr 11, 2017

README.md

Neural Networks

p5.js examples

Additional Processing examples

Python examples

History

This short list thanks to Andrey Kurenkov's excellent 'Brief' History of Neural Nets and Deep Learning

Online Reading

Additional Reading

Linear Algebra Review

  • Vectors vs. Matrices
  • "Elementwise" operations
  • Matrix multiplication
  • Transpose
  • inputs and outputs
  • weights

Terminology

  • complex adaptive system
  • perceptron
  • activation function
  • weight
  • multi-layered perceptron
  • input layer, hidden layer, output layer
  • back-propagation
  • sigmoid
  • gradient descent
  • epoch
  • deep learning

Exercise ideas

  • Redo the three layer network example using an existing matrix library like math.js.
  • Instead of using the supervised learning for any of the above examples, can you train a neural network to find the right weights by using a genetic algorithm?
  • Visualize a neural network itself. You could start with just the simple perceptron or just go for drawing all the layers of the MNIST training example. How can you show the flow of information using color, geometry, etc.?
  • Add a feature that allows the MNIST example to save and reload a model.
  • Add a feature that allows users to add digits to the training or test set.
  • Try the 3 layer network with your own data.
You can’t perform that action at this time.