Skip to content
No description, website, or topics provided.
Branch: master
Clone or download
Latest commit cedfc55 Jun 26, 2019
Type Name Latest commit message Commit time
Failed to load latest commit information.
.gitignore implement gradient noise Apr 29, 2018 Update Jun 26, 2019
evaluation_gaussian_noise_neural_network_tutorial.ipynb add tutorial jupyter notebook Jun 25, 2019 add ylim to plot May 1, 2018 update shell script Jun 25, 2019
tutorial_mnist.ipynb update jupyter notebook May 1, 2018

Evaluating the effect of adding Gradient noise on the learning performance of deep neural networks.

The aim of the project is to explain and reproduce the result of Adding Gradient Noise Improves Learning for Very Deep Networks (original paper).

This was done as a team project. I was mainly in charge of empirical evaluation.

getting started

# to run all the experiments

# to run a specific experiment
python3 --batch_size 1 --grad_noise --eta 0.01 --grad_clip --grad_clip_value 10.0 --init_weight_type "good" --exp_id "exp5_sgd_noise" --lr 0.1

The jupyter notebook tutorial


You can’t perform that action at this time.