Skip to content

yczhan/ACoMIM

Repository files navigation

ACoMIM

"ATTENTION-GUIDED CONTRASTIVE MASKED IMAGE MODELING FOR TRANSFORMER-BASED SELF-SUPERVISED LEARNING" ICIP 2023

The code will be available soon Our codes & required packages are based on BEiT, Thanks!

Example: Pre-training and fine-tuning on ImageNet-1K

bash /code/ACoMIM/tools/dist_ptft.sh /code/ACoMIM/configs/selfsup/beit/vitb_M3V3attnbox300.py /code/ACoMIM/configs/finetune_cls/beit/IN_vanilla_vitb_abs_ft.py 8

About

ATTENTION-GUIDED CONTRASTIVE MASKED IMAGE MODELING FOR TRANSFORMER-BASED SELF-SUPERVISED LEARNING

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published