Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CIDEr score above 1 #4

Closed
Crista23 opened this issue May 6, 2018 · 2 comments
Closed

CIDEr score above 1 #4

Crista23 opened this issue May 6, 2018 · 2 comments

Comments

@Crista23
Copy link

Crista23 commented May 6, 2018

When testing CIDEr with one reference sentence for each candidate sentence, I get a CIDEr score of 7.24. Since CIDEr computes the average cosine similarity between a candidate and a reference, is it normal for CIDEr values to be above 1? Thank you!

@vrama91
Copy link
Owner

vrama91 commented May 6, 2018

Yes, it is normal for CIDEr-D values to be greater than 1, infact the maximum value is 10, because the cosine similarity is multiplied by 10 (See Eqn. 4 in https://arxiv.org/pdf/1411.5726.pdf).

@vrama91 vrama91 closed this as completed May 6, 2018
@liujqian
Copy link

Why are both the CIDEr score and the CIDEr-D score implementations multiplied by 10 in the end? I can get both metrics above one. Is there any implementation error for the original CIDEr score?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants