Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A little question about the training #15

Closed
ilingen opened this issue Oct 27, 2022 · 2 comments
Closed

A little question about the training #15

ilingen opened this issue Oct 27, 2022 · 2 comments

Comments

@ilingen
Copy link

ilingen commented Oct 27, 2022

Hi, thank u for your excellent work. Please forgive me for asking a simple question.
These days, I am training a unsup-bert model. I set random seed=0 and get a standard result with avg score 78.54, which is same as the paper reported (78.54±0.15), both the results are lower than your provided model (78.87).
So I wonder if you have updated the training strategy or provide the best model for us.

@kongds
Copy link
Owner

kongds commented Oct 27, 2022

Thank you for your interest in our work.

We provide our best checkpoint from 10 random runs for unsupervised settings . And we also report the best and worst performance of 10 random runs in paper Section 6.2.
image

@ilingen
Copy link
Author

ilingen commented Oct 27, 2022

Thanks for your reply. I am going to close the issue.

@ilingen ilingen closed this as completed Oct 27, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants