DINO vs MAE

[fabienbaradel]

Hi,
Thanks for your amazing work. The study is very interesting. You are using DINO as feature extractor in your work, and I was just wondering if you tried using MAE or a different method? And do you have the same/similar results?
Thanks for your time,

[ShirAmir]

Hi!

Thanks for finding interest in our work!
We did similar PCA visualizations for those in the paper with the ViT backbone of CLIP, and got similar results to those of the supervised ViT (relatively noisy maps, last layer first principal components tend to distinguish between classes). We did not apply these visualizations on MAE, feel free to try it out and submit a pull request 🙂