Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Little difference between with/without JSD loss #6

Closed
xiangyu19 opened this issue Feb 27, 2020 · 1 comment
Closed

Little difference between with/without JSD loss #6

xiangyu19 opened this issue Feb 27, 2020 · 1 comment

Comments

@xiangyu19
Copy link

Thanks for your impressive contribution so much. I have one question when training this model.
When I set the no_jsd to True/False (cifar 100) using python cifar.py to get table 4, I got a 36.073(published 39.8) for no_jsd=True and 35.895(published 35.9). Do you have any idea why I got such a huge difference when setting the no_jsd to True?

@hendrycks
Copy link
Contributor

hendrycks commented Feb 27, 2020

It may be noise; I should say we did not run with the exact code used in this repository, but it should be representative enough. I expect that the perturbation stability and calibration is quite improved by the JSD loss. If you found it didn't help with corrupution robustness, perturbation stability, or calibration on CIFAR-10 and CIFAR-100, then there is a bug. If you suspect a bug let us know.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants