Modification of deep learning course notebooks for usage with Keras 2 and Python 3.
Branch: master
Clone or download
Latest commit fd2d51c Jan 14, 2018

Modified notebooks and Python files for Keras 2 and Python 3 from the Deep Learning course v.1

The repository includes modified copies of the original Jupyter notebooks and Python files from the excellent (and really unique) deep learning course "Practical Deep Learning For Coders" Part 1 and Part 2, v.1, created by

The original files require Keras 1. One main goal has been to modify the original files to the minimum extent possible. The comments added to the modules generally start with "# -" when they are not just "# Keras 2".

The current version of the repository has been tested with Keras 2.1.2. The previous version, tested with Keras 2.0.6, is available here.

Part 1

Located in the nbs folder. Tested on Ubuntu 16.04 and Python 3.5, installed through Anaconda, using the Theano 1.0.1 backend.

Part 2

Located in the nbs2 folder. Tested on Ubuntu 16.04 and Python 3.5, installed through Anaconda, using the TensorFlow 1.3.0 backend. A few modules requiring PyTorch were also tested, using PyTorch 0.3.0.

The files keras.json.for_TensorFlow and keras.json.for_Theano provide a template for the appropriate keras.json file, based on which one of the two backends needs to be used by Keras.

An environment.yml file for creating a suitable conda environment is provided.

Notes and issues about Part 2

neural-style.ipynb: due to a function parameter change in Keras 2.1, the VGG16 provided by Keras 2.1 has been used instead of the original custom module

rossman.ipynb: section "Using 3rd place data" has been left out for lack of the required data

spelling_bee_RNN.ipynb and due to the changed implementation of the module in Keras 2.1, the attention part of the notebook doesn't work anymore

taxi_data_prep_and_mlp.ipynb: section "Uh oh ..." has been left out. Caveat: running all the notebook at once exhausted 128 GB RAM; I was able to run each section individually only after resetting the notebook kernel each time

tiramisu-keras.ipynb: in order to run the larger size model I had to reset the notebook kernel in order to free up enough GPU memory (almost 12 GB) and jump directly to the model

Left-out modules

neural-style-pytorch.ipynb (found no way to load the VGG weights; it looks like some version compatibility issue)