Skip to content
No description, website, or topics provided.
Branch: master
Clone or download
Latest commit cedfc55 Jun 26, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.gitignore implement gradient noise Apr 29, 2018
README.md Update README.md Jun 26, 2019
evaluation_gaussian_noise_neural_network_tutorial.ipynb add tutorial jupyter notebook Jun 25, 2019
main.py add ylim to plot May 1, 2018
run.sh update shell script Jun 25, 2019
tutorial_mnist.ipynb update jupyter notebook May 1, 2018

README.md

Evaluating the effect of adding Gradient noise on the learning performance of deep neural networks.

The aim of the project is to explain and reproduce the result of Adding Gradient Noise Improves Learning for Very Deep Networks (original paper).

This was done as a team project. I was mainly in charge of empirical evaluation.

getting started

# to run all the experiments
bash run.sh

# to run a specific experiment
python3 main.py --batch_size 1 --grad_noise --eta 0.01 --grad_clip --grad_clip_value 10.0 --init_weight_type "good" --exp_id "exp5_sgd_noise" --lr 0.1

The jupyter notebook tutorial

link

You can’t perform that action at this time.