Skip to content
master
Go to file
Code

Latest commit

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
viz
 
 
 
 
 
 
 
 
 
 
 
 
 
 

README.md

BPL model for one-shot learning

Matlab source code for one-shot learning of handwritten characters with Bayesian Program Learning (BPL).

Citing this code

Please cite the following paper:

Lake, B. M., Salakhutdinov, R., and Tenenbaum, J. B. (2015). Human-level concept learning through probabilistic program induction. Science, 350(6266), 1332-1338.

Pre-requisites

Matlab Toolboxes
Optimization Toolbox
Statistics Toolbox (before R2015a) OR Statistics and Machine Learning Toolbox
Image Processing Toolbox
Curve Fitting Toolbox

The Lightspeed Matlab toolbox
(http://research.microsoft.com/en-us/um/people/minka/software/lightspeed/)
Please install and add the lightspeed functions to your Matlab path.

The Omniglot data set
(https://github.com/brendenlake/omniglot)
Place these two Omniglot files in the 'data/' directory:
matlab/data_background.mat
matlab/data_evaluation.mat

Using the code

Setting your path
First, you must add all of the sub-directories to your Matlab path. While in the main BPL directory type this command:

addpath(genpath(pwd));

Pre-processing stroke data
This only needs to be run once, and it can take up to 5 minutes to complete. From the 'data' directory, run:

omniglot_preprocess;

This will create the 'data_background_processed.mat' and the 'data_evaluation_processed.mat' files for accessing the Omniglot dataset with pre-processed stroke data.

Parsing demo
To run the model fitting demo, type

demo_fit;

One-shot classification
First, download the pre-computed models and unzip such that 'model_fits' and 'model_refits' are sub-directories of the 'classification' directory.
http://cims.nyu.edu/~brenden/supplemental/BPL_precomputed/model_fits.zip
http://cims.nyu.edu/~brenden/supplemental/BPL_precomputed/model_refits.zip

To run the model re-fitting demo, enter the 'classification' directory and type:

demo_refit;

To measure classification error rate with the pre-computed results, type:

run_classification;

One-shot exemplar generation

First, enter the 'generate_exemplars' directory and unzip 'model_fits.zip' so 'model_fits' is now a sub-directory. These are the pre-computed models that were used in the exemplar generation visual Turing tests.

To run the exemplar generation demo, from within the 'generate_exemplars' directory type:

demo_generate_exemplar;

Computing resources

Most experiments will require a multi-CPU cluster to run in a reasonable amount of time. Fitting motor programs to images of characters can be run in parallel.

The parsing and one-shot classification demos include a 'fast_mode' option (on by default) which allows for the demo to run quickly, skipping the expensive procedure of fitting the strokes to the details of the image. Use this mode with caution, as this mode is much cruder and was not used in the paper results.

Compatibility

Code was developed and tested on MATLAB R2013a and Lightspeed toolbox version 2.6.

About

Bayesian Program Learning model for one-shot learning

Resources

License

Releases

No releases published

Packages

No packages published

Languages

You can’t perform that action at this time.