-
Notifications
You must be signed in to change notification settings - Fork 89
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Nan loss for quantization #18
Comments
Same issue, using PyTorch 1.1.0 |
Change PyTorch version to 1.0.1 may solve the NaN loss issue. |
@stgzr Thanks! I would have a try. And this seems strange to me. What's the difference between Pytorch 1.1.0 and 1.0.1 that could lead to this Nan loss? |
The same problem, have you solved it? Finding help. |
Try changing the learning rate, decrease it or increase it by factor of 10 and see |
I'm running the code for 8-bit quantization but found that the training loss always gets NAN while I didn't make a slight modification to the original code. Wondering why this could happen and hoping for your clarification.
The text was updated successfully, but these errors were encountered: