Skip to content

Latest commit

 

History

History
66 lines (44 loc) · 8.48 KB

model_zoo_ssl.md

File metadata and controls

66 lines (44 loc) · 8.48 KB

Self-supervised Learning Model Zoo

Pretrained models

MAE

Pretrained on ImageNet dataset.

Config Epochs Download
mae_vit_base_patch16_8xb64_400e 400 model
mae_vit_base_patch16_8xb64_1600e 1600 model
mae_vit_large_patch16_8xb32_1600e 1600 model

DINO

Pretrained on ImageNet dataset.

Config Epochs Download
dino_deit_small_p16_8xb32_100e 100 model - log

MoBY

Pretrained on ImageNet dataset.

Config Epochs Download
moby_deit_small_p16_4xb128_300e 300 model - log

MoCo V2

Pretrained on ImageNet dataset.

Config Epochs Download
mocov2_resnet50_8xb32_200e 200 model - log

SwAV

Pretrained on ImageNet dataset.

Config Epochs Download
swav_resnet50_8xb32_200e 200 model - log

Benchmarks

For detailed usage of benchmark tools, please refer to benchmark README.md.

ImageNet Linear Evaluation

Algorithm Linear Eval Config Pretrained Config Top-1 (%) Download
SwAV swav_resnet50_8xb2048_20e_feature swav_resnet50_8xb32_200e 73.618 log
DINO dino_deit_small_p16_8xb2048_20e_feature dino_deit_small_p16_8xb32_100e 71.248 log
MoBY moby_deit_small_p16_8xb2048_30e_feature moby_deit_small_p16_4xb128_300e 72.214 log
MoCo-v2 mocov2_resnet50_8xb2048_40e_feature mocov2_resnet50_8xb32_200e 66.8 log

ImageNet Finetuning

Algorithm Fintune Config Pretrained Config Top-1 (%) Download
MAE mae_vit_base_patch16_8xb64_100e_lrdecay075_fintune mae_vit_base_patch16_8xb64_400e 83.13 fintune model - log
mae_vit_base_patch16_8xb64_100e_lrdecay065_fintune mae_vit_base_patch16_8xb64_1600e 83.49 fintune model - log
mae_vit_large_patch16_8xb16_50e_lrdecay075_fintune mae_vit_large_patch16_8xb32_1600e 85.49 fintune model - log