Skip to content
Deep Learning Illustrated (2019)
Jupyter Notebook Other
Branch: master
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
img add screenshot of apple sketches in Drive Jun 25, 2019
installation add warning on installing outside source dir Aug 21, 2019
notebooks add link to awkward GAN NB Jun 26, 2019
.gitignore Grant's updates Jun 13, 2018
Dockerfile revise comments Aug 8, 2019
LICENSE Initial commit Jun 13, 2018
README.md add "imprint" Aug 8, 2019
rundocker.bat Create rundocker.bat Jun 29, 2019
rundocker.sh Create rundocker.sh Jun 28, 2019

README.md

Deep Learning Illustrated (2019)

This repository is home to the code that accompanies Jon Krohn, Grant Beyleveld and Aglaé Bassens' book Deep Learning Illustrated. This visual, interactive guide to artificial neural networks was published on Pearson's Addison-Wesley imprint in 2019.

Installation

Step-by-step guides for running the code in this repository can be found in the installation directory. For installation difficulties, please consider visiting our book's Q&A forum instead of creating an Issue.

Notebooks

All of the code covered in the book can be found in the notebooks directory as Jupyter notebooks.

Below is the book's table of contents with links to all of the individual notebooks:

Part 1: Introducing Deep Learning

Chapter 1: Biological and Machine Vision

  • Biological Vision
  • Machine Vision
    • The Neocognitron
    • LeNet-5
    • The Traditional Machine Learning Approach
    • ImageNet and the ILSVRC
    • AlexNet
  • TensorFlow PlayGround
  • The Quick, Draw! Game

Chapter 2: Human and Machine Language

  • Deep Learning for Natural Language Processing
    • Deep Learning Networks Learn Representations Automatically
    • A Brief History of Deep Learning for NLP
  • Computational Representations of Language
    • One-Hot Representations of Words
    • Word Vectors
    • Word Vector Arithmetic
    • word2viz
    • Localist Versus Distributed Representations
  • Elements of Natural Human Language
  • Google Duplex

Chapter 3: Machine Art

  • A Boozy All-Nighter
  • Arithmetic on Fake Human Faces
  • Style Transfer: Converting Photos into Monet (and Vice Versa)
  • Make Your Own Sketches Photorealistic
  • Creating Photorealistic Images from Text
  • Image Processing Using Deep Learning

Chapter 4: Game-Playing Machines

  • Deep Learning, AI, and Other Beasts
    • Artificial Intelligence
    • Machine Learning
    • Representation Learning
    • Artificial Neural Networks
  • Three Categories of Machine Learning Problems
    • Supervised Learning
    • Unsupervised Learning
    • Reinforcement Learning
  • Deep Reinforcement Learning
  • Video Games
  • Board Games
    • AlphaGo
    • AlphaGo Zero
    • AlphaZero
  • Manipulation of Objects
  • Popular Reinforcement Learning Environments
    • OpenAI Gym
    • DeepMind Lab
    • Unity ML-Agents
  • Three Categories of AI
    • Artificial Narrow Intelligence
    • Artificial General Intelligence
    • Artificial Super Intelligence

Part II: Essential Theory Illustrated

Chapter 5: The (Code) Cart Ahead of the (Theory) Horse

  • Prerequisites
  • Installation
  • A Shallow Neural Network in Keras (shallow_net_in_keras.ipynb)
    • The MNIST Handwritten Digits (mnist_digit_pixel_by_pixel.ipynb)
    • A Schematic Diagram of the Network
    • Loading the Data
    • Reformatting the Data
    • Designing a Neural Network Architecture
    • Training a Deep Learning Model

Chapter 6: Artificial Neurons Detecting Hot Dogs

  • Biological Neuroanatomy 101
  • The Perceptron
    • The Hot Dog / Not Hot Dog Detector
    • The Most Important Equation in the Book
  • Modern Neurons and Activation Functions
  • Choosing a Neuron

Chapter 7: Artificial Neural Networks

  • The Input Layer
  • Dense Layers
  • A Hot Dog-Detecting Dense Network
    • Forward Propagation through the First Hidden Layer
    • Forward Propagation through Subsequent Layers
  • The Softmax Layer of a Fast Food-Classifying Network (softmax_demo.ipynb)
  • Revisiting our Shallow Neural Network

Chapter 8: Training Deep Networks

Chapter 9: Improving Deep Networks

Part III: Interactive Applications of Deep Learning

Chapter 10: Machine Vision

  • Convolutional Neural Networks
    • The Two-Dimensional Structure of Visual Imagery
    • Computational Complexity
    • Convolutional Layers
    • Multiple Filters
    • A Convolutional Example
    • Convolutional Filter Hyperparameters
    • Stride Length
    • Padding
  • Pooling Layers
  • LeNet-5 in Keras (lenet_in_keras.ipynb)
  • AlexNet (alexnet_in_keras.ipynb) and VGGNet (vggnet_in_keras.ipynb)
  • Residual Networks
    • Vanishing Gradients: The Bête Noire of Deep CNNs
    • Residual Connection
  • Applications of Machine Vision

Chapter 11: Natural Language Processing

Chapter 12: Generative Adversarial Networks

Chapter 13: Deep Reinforcement Learning

  • Essential Theory of Reinforcement Learning
    • The Cart-Pole Game
    • Markov Decision Processes
    • The Optimal Policy
  • Essential Theory of Deep Q-Learning Networks
    • Value Functions
    • Q-Value Functions
    • Estimating an Optimal Q-Value
  • Defining a DQN Agent (cartpole_dqn.ipynb)
    • Initialization Parameters
    • Building the Agent’s Neural Network Model
    • Remembering Gameplay
    • Training via Memory Replay
    • Selecting an Action to Take
    • Saving and Loading Model Parameters
  • Interacting with an OpenAI Gym Environment
  • Hyperparameter Optimization with SLM Lab
  • Agents Beyond DQN
    • Policy Gradients and the REINFORCE Algorithm
    • The Actor-Critic Algorithm

Part IV: You and AI

Chapter 14: Moving Forward with Your Own Deep Learning Projects

  • Ideas for Deep Learning Projects
  • Resources for Further Projects
    • Socially-Beneficial Projects
  • The Modeling Process, including Hyperparameter Tuning
    • Automation of Hyperparameter Search
  • Deep Learning Libraries
  • Software 2.0
  • Approaching Artificial General Intelligence

Book Cover

You can’t perform that action at this time.