Skip to content
/ ModelDistillation-PyTorch Public

PyTorch implementation of "Distilling the Knowledge in a Neural Network" for model compression

59 stars 9 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

thaonguyen19/ModelDistillation-PyTorch

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
README.md
README.md
 
 
pytorch_resnet.py
pytorch_resnet.py
 
 
pytorch_utils.py
pytorch_utils.py
 
 
train_all.py
train_all.py
 
 

Repository files navigation

ModelDistillation-PyTorch

Attempt at transfering knowledge from ResNet18 to tiny ResNet architectures, following the training technique as described in "Distilling the Knowledge in a Neural Network" by Hinton et al. (https://arxiv.org/pdf/1503.02531.pdf), applied on ImageNet dataset.

About

PyTorch implementation of "Distilling the Knowledge in a Neural Network" for model compression

Resources

Readme
Activity

Stars

59 stars

Watchers

3 watching

Forks

9 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages