Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add coffee break to allow for accumulation of statistics and reproduce ~100 errors on MNIST #6

Merged
merged 4 commits into from
Nov 29, 2014

Commits on Nov 28, 2014

  1. Change the way coffee breaks work and add statistics accumulator.

    This commit changes the way coffee breaks work -> each break now returns a dict in which statistics are recorded.
    These dicts can then be recoreded by the AccumulateStatistics break and saved to a hdf5 file.
    This is quite useful for monitoring training.
    stokasto committed Nov 28, 2014
    Configuration menu
    Copy the full SHA
    9acfb15 View commit details
    Browse the repository at this point in the history
  2. add a new tool: plot_statistics.jl

    it can be used to plot data that was written by the AccumulateStatistics break
    and even works during training.
    This is analogous to the plot_monitor.py script of pylearn2.
    stokasto committed Nov 28, 2014
    Configuration menu
    Copy the full SHA
    4ba6005 View commit details
    Browse the repository at this point in the history
  3. add an example script that reproduces the 105 errors on mnist fom Nit…

    …ishs dropout paper.
    
    This is a first quick sketch that gives the desired result of ~100 errors on MNIST
    using a fully connected network of 2 layers a 1200 units with dropout.
    NOTE: this is still missing the constraint on the L2 norm of the weights, will add them in a later comit.
    stokasto committed Nov 28, 2014
    Configuration menu
    Copy the full SHA
    09ae436 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2014

  1. add comments to dropout example, plot_statistics.jl now supports mult…

    …iple files for plotting
    stokasto committed Nov 29, 2014
    Configuration menu
    Copy the full SHA
    b7a6053 View commit details
    Browse the repository at this point in the history