Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Baseline not converge #4

Closed
uiyo opened this issue Mar 25, 2020 · 1 comment
Closed

Baseline not converge #4

uiyo opened this issue Mar 25, 2020 · 1 comment

Comments

@uiyo
Copy link

uiyo commented Mar 25, 2020

I run the baseline model with the default setting, but it seems not converged (cifar10), loss is huge, around 6600000. Is this normal, or just mine this? If it is normal, why is this? Based on my research, traditional langevin dynamics can easily converge with restricted number of steps, such as 50. I'm quite curious why the author set the number of this sampling process to 1000, with a relatively small learning rate.

Thanks for your excellent work, the anneal model converges well, by the way, i just try to figure out why this method works. Can you please tell us?

@uiyo uiyo closed this as completed Mar 25, 2020
@uiyo
Copy link
Author

uiyo commented Mar 25, 2020

seems langevin sampling is not applied in the training phase, we are talking different model. My mistake, appology.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant