Repo to accompany paper "Implicit Self-Regularization in Deep Neural Networks..."
Switch branches/tags
Nothing to show
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
allennlp allen nlp cleaned up Sep 19, 2018
img even more pytorch modles Oct 11, 2018
.gitignore Initial commit Aug 28, 2018
AlexNet-Baseline-Ensemble.ipynb updated notebooks for first paper push Oct 1, 2018
AlexNet-Baseline-wDropout.ipynb updated notebooks Sep 23, 2018
AlexNet-Baseline.ipynb updated notebooks for first paper push Oct 1, 2018
AlexNet-Generalization-Gap.ipynb updated notebooks Sep 23, 2018
AlexNet-RankCollapse.ipynb updated code Sep 21, 2018
AlexNet-Regularized.ipynb updated notebooks Sep 23, 2018
AlexNet-pytorch-MPFit.ipynb initial alexnet notebooks Aug 28, 2018
AlexNet-pytorch.ipynb updated allennlp data Sep 18, 2018
All-pytorch-models-wCNNs-Slices.ipynb working on new experiments for blog Oct 9, 2018
All-pytorch-models-wCNNs.ipynb first push Aug 28, 2018
All-pytorch-models.ipynb pytorch models cleaned up Sep 2, 2018
All-pytorch-ranks.ipynb updated notebooks for first paper push Oct 1, 2018
Automated-MPFit.ipynb first push Aug 28, 2018
CalibrateLargeNPL.ipynb first push Aug 28, 2018
CalibratePowerLawFits.ipynb updated allennlp data Sep 18, 2018
EvenMore-pytorch-models-Accuracies-Copy1.ipynb working on new experiments for blog Oct 9, 2018
EvenMore-pytorch-models-Accuracies.ipynb working on new experiments for blog Oct 9, 2018
EvenMore-pytorch-models-OSMR.ipynb even more pytorch modles Oct 11, 2018
EvenMore-pytorch-models.ipynb word2vec matrix Sep 27, 2018
GaussianRMT.ipynb generate gaussian random matrix Sep 11, 2018
HeavyTailedUniversalityClasses.ipynb updated allennlp data Sep 18, 2018
Inception-pytorch.ipynb updated allennlp data Sep 18, 2018
Keras-PowerLaws.ipynb updated notebooks for first paper push Oct 1, 2018
Keras-Save-Load-Test.ipynb simple example how to load keras power laws Sep 27, 2018
LeNet5.ipynb generate gaussian random matrix Sep 11, 2018
MLP3-Basline.ipynb updated code Sep 21, 2018
Marchenko_Pastur_Plots.ipynb updated allennlp data Sep 18, 2018
PowerLawAccuracyTest.ipynb updated notebooks for first paper push Oct 1, 2018
README.md Update README.md Aug 28, 2018
RMT_Util.ipynb working on new experiments for blog Oct 9, 2018
Spiked-Covariance-Model.ipynb updated notebooks for first paper push Oct 1, 2018
WeightWatcherTest.ipynb updated notebooks for first paper push Oct 1, 2018
WeightWatchers.ipynb updated notebooks for first paper push Oct 1, 2018
WordEmbeddingMatrices.ipynb word2vec matrix Sep 27, 2018
accuracies accuracies of even mpore ImageNet models Sep 27, 2018

README.md

Implicit Self Regularization

Repo to accompany paper

Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning

Early Video Presentation

Why Deep Learning Works: Self Regularization in Neural Networks

https://www.youtube.com/watch?v=_Ni5UDrVwYU

Present at NERSC, June 2018