[ Pretrained Models ]

[IemProg]

Hi,

Thanks for the wonderful work. Could you please, share links to the default models used for finetunning experiments ?

Specifically, the pretrained models for finetunning experiments are they trained from scratch on ImageNet1K ?
- Because the official ones published for ViTs models are trained on ImageNet21K and finetunned on ImageNet1K ?

Thanks,

[yhlleo]

Hi @IemProg ,

In our experiments, the pretrained models are trained from scratch on ImageNet-1K.

In SwinTransformer, the authors also released the models trained from scratch on ImageNet-1K. In T2T, they used only ImageNet-1K dataset.