-
Notifications
You must be signed in to change notification settings - Fork 59
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Loss curves #5
Comments
Hi Tom, Thanks for your interest. I didn't plot the loss curve, but I think I still have (pre)-training logs on my server. Which experiment are you looking for? -Yuan |
Thanks for the reply! I am looking for the pre-training run(s), i.e. the one trained on Librispeech + AudioSet. |
Bump! I just wanted to have some comparison in order to know what I should expect. Thanks in advance! |
Hi there, I think this is our log (gen&dis objective, 400 masking patches, full AS + Librispeech). Unfortunately, I don't think we logged the generation loss but just the discrimination loss. The columns are defined at Line 147 in 35ae7ab
For your question
Could it be possible due to you add L_g and L_d together? Otherwise, the L_g on the training set should always drop. -Yuan |
Hey, great work!
I just wanted to ask whether you might have the loss curves of your runs so that I can compare with my experiments a little bit?
The text was updated successfully, but these errors were encountered: