Working Theano implementation of Pixel RNN on MNIST.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
lib remove ops.py, update samples May 17, 2016
.gitignore
LICENSE Update samples and add license Jul 12, 2016
README.md Update samples and add license Jul 12, 2016
groundtruth.jpg Initial commit May 17, 2016
pixel_rnn.py Update samples and add license Jul 12, 2016
samples.jpg Update samples and add license Jul 12, 2016

README.md

Pixel RNN

Theano implementation of the Diagonal BiLSTM and Pixel CNN models from Pixel Recurrent Neural Networks (van der Oord et al.) on binarized MNIST.

Not yet implemented:

  • Residual connections
  • 256-way softmax output

The Diagonal BiLSTM gets a dev-set NLL of 82.12 after 100K iterations (at which point it still hasn't fully converged).

Samples from the Diagonal BiLSTM after 100K iterations:

Diagonal BiLSTM samples

Ground-truth binarized MNIST samples:

Ground-truth samples