Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
George Dahl's gdbn: Pre-trained deep neural networks
Fetching latest commit…
Cannot retrieve the latest commit at this time.
|Failed to load latest commit information.|
[This fork of George Dahl's gdbn merely exists to make it available as a setuptools package on PyPI. The original version can be downloaded from http://www.cs.toronto.edu/~gdahl/] This package contains python code for pre-trained deep neural networks (sometimes called deep belief networks in an abuse of terminology that I too have been guilty of). RBM pre-training is supported and backpropagation. There are a handful of possible unit types. For training, minibatched stochastic gradient descent is implemented. This initial release has essentially no documentation other than what exists in the code itself (which is very little), but it is small enough so hopefully someone familiar with the algorithms and with python could use it. Of course such a person could probably write their own software. This initial release only has the barest essentials of features. My internal version has more features, but some of them have not been published yet and thus have been stripped away from the release version. After all the features I have implelmented in my internal code have been made public, I plan on doing a slightly better release, perhaps even with some documentation. Dependencies gnumpy (http://www.cs.toronto.edu/~tijmen/gnumpy.html) and one of cudamat (http://code.google.com/p/cudamat/) or npmat (http://www.cs.toronto.edu/~ilya/npmat.py), a non-gpu cudamat stand-in. Running the Example (mnistExample.py) Download the gzipped data from http://www.cs.toronto.edu/~gdahl/mnist.npz.gz and unzip it into the same folder as all of the code (or change the line f = num.load("mnist.npz") in mnistExample.py. Then you should be able to run the example with $ python mnistExample.py assuming you have obtained all the dependencies for