NaN or Inf found in input tensor.

[ph0316]

Hello, sorry to bother you again. I recently encountered a new error in training, do you know why?

The number of wrong epoch is different each time.

[Nitrogens]

I have met the same problem, too~

[wyf0912]

Hi, thanks for your interest in our work.

Maybe you could try the following work to alleviate this problem

https://arxiv.org/pdf/2212.04319.pdf

Besides, a trivial way may be that you could try to use a smaller learning rate.