No description, website, or topics provided.
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
experiments Added missing permuted flag. May 12, 2016
paper camera ready Feb 28, 2017
results/iclr update attr model names in figures i guess Nov 4, 2016
.gitignore Initial commit Feb 15, 2016
README.md Update README.md Feb 3, 2017
extensions.py
memory.py Update memory task to deal with pop statistics Mar 17, 2016
penntreebank.py time steps Jul 20, 2016
penntreebank_evaluate.py changes for ptb evaluation Mar 28, 2016
penntreebank_inspect.py
plot_attr.py add debugging helper Sep 12, 2016
plotgradients.py add activation/gradient plotting script Feb 24, 2016
sequential_mnist.py
sequential_mnist_evaluate.py update Mar 14, 2016
text8.py facilitate dumping hidden states of pickled models Apr 12, 2016
util.py

README.md

This repository contains the code that was used for the Sequential MNIST, Penn Treebank and text8 experiments in the paper Recurrent Batch Normalization (http://arxiv.org/abs/1603.09025). For the Attentive Reader, see https://github.com/cooijmanstim/Attentive_reader/tree/bn.

The experiments directory contains shell scripts that demonstrate how to launch the experiments with the hyperparameters from the paper.

Depends on Theano, Blocks and Fuel.

Other implementations: