Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

about Implementation #2

Open
WWWJL opened this issue Jun 10, 2021 · 8 comments
Open

about Implementation #2

WWWJL opened this issue Jun 10, 2021 · 8 comments

Comments

@WWWJL
Copy link

WWWJL commented Jun 10, 2021

Hello,I am very interested in your work.and I want to ask some questions, why is the implementation of the code inconsistent with the description in the paper, such as training parameters, learning rate strategy, etc.

@wjtan99
Copy link
Contributor

wjtan99 commented Jun 20, 2021

The hyperparameters are changing all the time. The published parameters may not be same as the ones we used in the paper.

@WWWJL
Copy link
Author

WWWJL commented Jun 20, 2021 via email

@liurs1990
Copy link
Collaborator

@WWWJL Is the loss value descending when you train the quality branch? How do you test the quality score and does it work with our pertained model?

@WWWJL
Copy link
Author

WWWJL commented Jun 20, 2021 via email

@WWWJL
Copy link
Author

WWWJL commented Jun 20, 2021 via email

@liurs1990
Copy link
Collaborator

@WWWJL Does the quality score work with our pretrained model?

@WWWJL
Copy link
Author

WWWJL commented Sep 10, 2021

@WWWJL Does the quality score work with our pretrained model?

yes, the quality score work with your pretrained model work!As I said above, the reproduced quality model I trained always has a score of 1 on the test set, and the average value of the quality score of each batch is printed during the training process, which is close to 1.

@we11d0ne
Copy link

we11d0ne commented Jun 4, 2024

质量分数是否适用于我们的预训练模型?

是的,质量分数适用于您的预训练模型工作!如上所述,我训练的重现质量模型在测试集上总是得分为 1,并且在训练过程中打印出每批质量得分的平均值,接近 1。
i have the same mistake , i also have trained the quality model and the quality score is all 1, have you solved the question?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants