-
Notifications
You must be signed in to change notification settings - Fork 61
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feature/metrics/stable metrics #382
Conversation
In the failed test called
If I change the |
@dapladoc changing tolerance is okay |
@AlekseySh @DaloroAT hey guys. It looks like this PR is ready to be reviewed. As I described above the main idea is to sort |
@DaloroAT What do you think? Does bringing the additional logic worth the benefits of metrics' stability? |
@dapladoc let's implement what we've decided offline:
|
@dapladoc hey! just a reminder :) |
Let me close it for now due to inactivity. Metrics code has also been significantly modified. So, anyway, the PR has to be reworked. |
Introduce permutation stable version of the retrieval metrics. The idea is to sort
gt_tops
for which distances are the same, i.e. ifdistances_tops
andgt_tops
arethen we need to obtain
The code for the retrieval metrics itself doesn't change.