Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)

For inquiries, please contact papyan@stanford.edu

Features

Download 240 models from a GCP bucket:
- VGG11, ResNet18, DenseNet40
- MNIST, FashionMNIST, CIFAR10, CIFAR100
- Various sample sizes
Approximate spectrum using the method presented in https://arxiv.org/abs/1811.07062
Compute three-level hierarchical structure using the method proposed in this paper

See Jupyter notebook main.ipynb

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
README.md		README.md
hessian.py		hessian.py
main.ipynb		main.ipynb
models.py		models.py
network.py		network.py
requirements.txt		requirements.txt
subset_dataset.py		subset_dataset.py
utils.py		utils.py