This repository has been archived by the owner on Oct 31, 2023. It is now read-only.

why "Finetuning with distillation not yet supported"? #23

Closed

leviome opened this issue Apr 20, 2022 · 1 comment

leviome commented Apr 20, 2022

why not support finetuning with distillation, any conflicts?

Contributor

btgraham commented Apr 20, 2022

That code is copied from DeiT
https://github.com/facebookresearch/deit/blob/35cd4556c06929c59247b828d7dd778b44328fd4/main.py#L176
It should not be hard to implement, but I am not planning on trying it.

btgraham closed this as completed

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.