-
Notifications
You must be signed in to change notification settings - Fork 23
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Integer relevance score #8
Comments
Hi and thank you! :) In Information Retrieval, relevance score judgments can be binary or graded. Moreover, if I recall correctly, the choice of requiring integers was taken for similarity with Do you need Best, Elias |
Thank make sense! No no, it was just something I was wondering about :) |
Following up on this, I'd now need Best, Stefano |
Hi Stefano, I apologize if my question sounds stupid: are your relevance judgments truly continuous, or are they discrete but defined with floats? In the latter case, you should always be able to convert them to integers by simply re-scaling them. If that's not the case, you could, for example, round your floats at the 4th decimal position, multiply them by 10^4, and then cast them to integers. If this still does not solve your problem, could you please provide more information about your use case so I can better help you find a solution? I do not plan to change the implementation of Qrels at the moment. Best, Elias |
Hi,
Thank you for this nice library.
Is there a fundamental reason why relevance score need to be integers in Qrels?
Thanks.
The text was updated successfully, but these errors were encountered: