Are ResNet strikes back scripts available?

[elias-ramzi]

Hi!

Thank you for the great repo!

I have used timm in the past but I am new to the training utilities provided in this repo.

I wanted to reproduce and experiment with the training recipies from the ResNet strikes back paper (https://arxiv.org/pdf/2110.00476.pdf).
I was wondering if there is a script somewhere with which I could launch the training procedure A3.

Thanks for your help!
Elias

[elias-ramzi]

I will try with the following:

./distributed_train.sh 4 \
imagenet/ \
--model resnet50 \
--input-size 160 \
--aa rand-m6-mstd0.5-inc1 \
--mixup 0.1 \
--cutmix 1.0 \
--remode pixel \
--reprob 0.0 \
--crop-pct 0.95 \
--smoothing 0.0 \
--bce-loss \
--bce-target-thresh 0.2 \
--opt lamb \
--weight-decay .02 \
--sched cosine \
--epochs 100 \
--warmup-epochs 5 \
--lr 8e-3 \
--warmup-lr 1e-4 \
-b 2048 \
-j 10 \
--amp \
--channels-last \
--seed 42

I am not sure however for the following args

• --input-size there is another args img-size but I am not sure it is used.
• --aa.
• --bce-target-thresh and --smoothing.
• --warmup-lr.

I am also not sure if I can use different train / test resolution.

[rwightman]

--img-size is for the default square shape will expand to input_size of (3, img_size, img_size), --input-size is for specifying the full C H W ie --input-size 3 320 240

warmup-lr is the initial lr (starting point of the linear warmup phase to the target --lr )

There are other posted command lines for the a3 and a1 hparams in past issues or discussions, should be pretty easy to search... ex: #1106

[elias-ramzi]

Hi thanks for the quick reply.
I am sorry I didn't come across those other thread..