Change batch size

[salehnia]

Dear Author,
I changed batch size from 16 to 2 and LR from 0.02 to 0.0025 because i want to run your code on one GPU, so How i should change steps and iteration to have same result? please help me for that.

Thanks

[er-muyue]

Taking the 10-shot task as an example, we train our model with 2500 x 16 samples. If you change the batch-size to 2, you only need to ensure that the total number of samples is similar, i.e. ~ 2500x16/2 iterations. Any I suggest the LR-decay step is 2500x16/2*0.8, where 0.8 is just an empirical suggestion (see this code-line).