Skip to content
No description, website, or topics provided.
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
artifacts/lenet
nnet
scripts
.gitignore
LICENSE
README.md

README.md

Compressibility and Generalization in Large-Scale Deep Learning

This repository contains everything necessary to reproduce the experiments in our paper: Compressibility and Generalization in Large-Scale Deep Learning (Wenda Zhou, Victor Veitch, Morgane Austern, Ryan P. Adams and Peter Orbanz).

LeNet-5 pruning

The directory compression_lenet contais the scripts which implement the training, pruning, quantization and evaluation of the LeNet-5 network.

MobileNet Pruning

The directory compression-mobilenet contains the scripts which implement the pruning, quantization, and evaluation of noise stability of our network. The typical compression pipeline would be to take an already trained network (such as those available here) and prune then quantize the network. Please see the readme for more details on compressing MobileNet.

CIFAR-10 randomization tests

The directory randomization-cifar contains the scripts which implement the training and pruning of a ResNet-56 on the CIFAR-10 dataset with a portion of the labels randomized.

You can’t perform that action at this time.