New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
About how to perform fine-tunning #7
Comments
Hmm sorry but I didn't quite do this type of research. Btw what do you mean by performance drops? Drops against the student/teacher? |
Yes, the fine-tunning models against the student/teacher model you provided. Your model is so good at rejecting noise. If speech is with complicated background noise, it is very likely to be rejected. The hurdle is, I can not train the teacher model myself, because I do not have the 527-label-type data. Do you have any idea on training the tearcher model ? |
Yeah, I tried. Sadly, not good after tunning |
Seems weird to me to be honest. Also, the loss during my training usually does not decrease by large. Generally I start at ~0.61 and final loss is around ~0.5 |
Hi sir could you share how to do this |
Just as described in the Readme. |
Hi,
Do you have any idea about fine-tunning the pretrained model(such sre) to a more complicated scenario using a small related data set? I tried to use the teacher model to label the new data set, and train few epochs with a very small learning rate. Howerver, the performance drops drastically. Quit sad.
The text was updated successfully, but these errors were encountered: