Implementation of the paper Distilling the Knowledge in a Neural Network
Results on MNIST
Test set size = 10000
| Model | Accuracy |
|---|---|
| Teacher model | 0.9847 |
| Distilled student model | 0.9810 |
Compression ratio = 2
-
Notifications
You must be signed in to change notification settings - Fork 1
NeelayS/Knowledge-Distillation
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Vanilla knowledge distillation in PyTorch
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published