[PyTorch] Use FP16 tols for distributed tests with TF32 compute#1831

timmoon10 merged 6 commits intoNVIDIA:mainNVIDIA/TransformerEngine:mainfrom

timmoon10:debug-distributed-teststimmoon10/TransformerEngine:debug-distributed-testsCopy head branch name to clipboard