Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exploding target in distillation #5

Open
HReynaud opened this issue Feb 13, 2023 · 0 comments
Open

Exploding target in distillation #5

HReynaud opened this issue Feb 13, 2023 · 0 comments

Comments

@HReynaud
Copy link

Hello @Hramchenko ! Thank you for your work on this repo.

I am trying to implement the distillation for v-parametrization and used your code. I am having an issue with this line, because sigma_s can be very small (ex: 1e-2) which causes eps_2 to become very large and thus v_2 too, while it should remain close to the [-1,1] range.

Would you have any insights on that ? Did you derive the equations yourself ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant