Cant achieve the best miou when batchsize=4

[cocolord]

I cannt achieve the most miou proposed in original paper while i didnt change the hyperparameter except tuning the bs from 8 to 4. How to achieve the best miou? Is that related to batchsize?

[lzrobots]

Yes you need batch size 8. How much did you get with bs=4?

[cocolord]

I tried Naive Deit and i have 77.64 miou after 80000iter.

[cocolord]

Basically 1% miou fall behond. But I dont have 8 cards, Is there any ways to train better result based on four cards?

[lzrobots]

not bad. you can increase the crop size

[zbhit123]

I have four 2080Ti cards, 12G memory each
Can i run this code ? tks !!!@cocolord

[cocolord]

I have four 2080Ti cards, 12G memory each
Can i run this code ? tks !!!@cocolord

you can infer with the small vit or deit model