If the weights of vit-base trained with dropout available?

[Cascol-Chen]

Thank you for your great work and codes.

I see that vit-base can be trained with or without dropout but currently most available checkpoints are trained without dropout. I wonder if those trained with dropout could be available.

[andsteing]

There are various checkpoints with and without dropout available from the paper How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers. See the following Colab to select different checkpoints:

https://colab.sandbox.google.com/github/google-research/vision_transformer/blob/main/vit_jax_augreg.ipynb