Question about DDP

[ioyy900205]

Hello Dear Author, Thank you for providing such detailed code.
I have a troubling question, has there been a comparison of the accuracy of the trained models in DP mode and DDP mode?
And has the author compared the difference between full precision and half precision training in DDP mode?
Because my experimental results are that DP mode accuracy is much higher than DDP, and the difference between DDP half precision and DDP full precision is not much.