Official Pytorch implementation of paper:
Knowledge Distillation with Adversarial Samples Supporting Decision Boundary (AAAI 2019).
Sporlight and poster are available on homepage
Python 3.6, Pytorch 0.4.1, Torchvision
Knowledge distillation (CIFAR-10)
python train_BSS_distillation.py
Distillation from ResNet 26 (teacher) to ResNet 10 (student) on CIFAR-10 dataset.
Pre-trained teacher network (ResNet 26) is included.
@inproceedings{BSSdistill,
title = {Knowledge Distillation with Adversarial Samples Supporting Decision Boundary},
author = {Byeongho Heo, Minsik Lee, Sangdoo Yun, Jin Young Choi},
booktitle = {AAAI Conference on Artificial Intelligence (AAAI)},
year = {2019}
}