A MATLAB implementation of Auto-Encoding Variational Bayes
Matlab
Switch branches/tags
Nothing to show
Clone or download
Latest commit ad49869 Jan 4, 2017
Permalink
Failed to load latest commit information.
data save Jun 6, 2016
demo save Jun 6, 2016
matconvnet @ d9c8a3f update modules Jun 6, 2016
models save Jun 6, 2016
training save Jun 6, 2016
utils save Jun 6, 2016
.gitignore add Jun 6, 2016
.gitmodules update modules Jun 6, 2016
README.md update readme Jan 4, 2017
init_model.m save Jun 6, 2016
load_data.m save Jun 6, 2016
plot_lb.m save Jun 6, 2016
startup.m save Jun 6, 2016
train_script.m save Jun 6, 2016
vae_mnist.m save Jun 6, 2016
writeup.pdf add writeup Jun 6, 2016

README.md

Variational Auto-Encoder in MATLAB

This is a re-implementation of Auto-Encoding Variational Bayes in MATLAB.

Installation

Data

I use the MNIST from: https://github.com/y0ast/VAE-Torch/tree/master/datasets.

Toolbox

Please install my fork of MatConvNet, where I implemented some new layers, including:

  • KLD.m: handles forward and backward propagation of KL Divergence
  • NLL.m: handles forward and backward propagation of Negative Log-Likelihood (works for multi-variate Bernoulli distribution)
  • LB.m: combine KLD and NLL into a lower bound
  • Sampler.m: sampling operation
  • Tanh.m: tanh non-linearity
  • Split.m: split one variable into multiple while keeping the same spatial size

Usage

Training

For training, please see train_script.m on how I trained models. I implemented four stochastic gradient descent algorithms:

  • SGD with momentum
  • ADAM
  • ADAGRAD
  • RMSPROP

Demo

For demo, I have four demo scripts for visualization under demo/, which are:

  • manifold_demo.m: visualize the manifold of a 2d latent space in image space.
  • sample_demo.m: sample from latent space and visualize in image space.
  • reconstruct_demo.m: visualize a reconstructed version of an input image.
  • walk_demo.m: randomly sample a list of images, and compare the morphing process done in both image space and latent space.

More

To learn about how VAE works under the hood, refer to the original paper or my writeup.