New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Coefficients of loss #26

Open

ChicyChen opened this issue Aug 11, 2023 · 0 comments

ChicyChen commented Aug 11, 2023

Hi, in the code the std loss is averaged by 2 (not the same as the paper) while the cov loss is not (same as the paper). Then, is the coefficient of mse vs. std vs. cov loss still 25.0 & 25.0 & 1.0 (same as the paper), but not 25.0 & 50.0 & 1?

vicreg/main_vicreg.py

Line 211 in 4e12602

cov_loss = off_diagonal(cov_x).pow_(2).sum().div(

Thanks a lot!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment