Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Precision and Recall Value not matching the Confusion Matrix #2693

Closed
1 task done
Adi11cr7 opened this issue May 18, 2023 · 3 comments
Closed
1 task done

Precision and Recall Value not matching the Confusion Matrix #2693

Adi11cr7 opened this issue May 18, 2023 · 3 comments
Labels
question Further information is requested Stale

Comments

@Adi11cr7
Copy link

Search before asking

Question

I ran validation on my test set and got the following results with P=0.72 and R=0.594: whereas if I calculate the precision and recall from the confusion matrix I am getting P=0.976 and R=0.55. I used conf=0.1 and iou=0.1. What is the reason for this.
Screenshot 2023-05-18 161743

confusion_matrix

Additional

No response

@Adi11cr7 Adi11cr7 added the question Further information is requested label May 18, 2023
@Adi11cr7
Copy link
Author

@glenn-jocher You mentioned here that mAP is an absolute metric. But my mAP@.5 increases if I reduce the confidence threshold

@glenn-jocher
Copy link
Member

@Adi11cr7 ah yes, this is because true mAP must be computed at conf=0.0.

We compute at conf=0.001 for faster speed and minimal difference, but technically any values higher than conf=0.0 are invalid.

@github-actions
Copy link

👋 Hello there! We wanted to give you a friendly reminder that this issue has not had any recent activity and may be closed soon, but don't worry - you can always reopen it if needed. If you still have any questions or concerns, please feel free to let us know how we can help.

For additional resources and information, please see the links below:

Feel free to inform us of any other issues you discover or feature requests that come to mind in the future. Pull Requests (PRs) are also always welcomed!

Thank you for your contributions to YOLO 🚀 and Vision AI ⭐

@github-actions github-actions bot added the Stale label Jun 18, 2023
@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Jun 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested Stale
Projects
None yet
Development

No branches or pull requests

2 participants