Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The range value of dist@k #85

Open
anpro948 opened this issue Nov 25, 2023 · 0 comments
Open

The range value of dist@k #85

anpro948 opened this issue Nov 25, 2023 · 0 comments

Comments

@anpro948
Copy link

I modified a file to use a BERT model for the conv_model on the redial dataset, and I obtained a dist@k score > 1 (this result is more higher than the scores reported in the papers below, which raises some doubts). Is this normal? It seems that the range values for dist@k, similar to bleu@k, should both fall within the [0,1] range. When I compared it with other papers, the dist@k for the redial dataset mostly seemed to fall within the [0,1] range. Since I don't have a clear understanding of the dist@k code, could someone help me with this?

My results:
image

Paper: (https://arxiv.org/pdf/2007.04032.pdf), (https://arxiv.org/pdf/2206.09363.pdf)
image
image

Bert Model:
image

Dist@k score: I add a hyp_token = hyp.split()
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant