Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More robust Accuracy module #3155

Merged
merged 7 commits into from
Jul 3, 2020
Merged

Conversation

Johnson-Wang
Copy link
Collaborator

  1. Make mmdet.models.Accuracy class more robust to empty predictions.
  2. Add score threshold for Accuracy calculation
  3. Add unittest for Accuracy module
  4. change accuracy to pos_recall in FSAF and use Accuracy module to calculate it.

@hellock hellock requested a review from yhcao6 June 30, 2020 07:42
topk (int | tuple[int], optional): If the predictions in ``topk``
matches the target, the predictions will be regarded as
correct ones. Defaults to 1.
thresh (float, optional): If not None, threshold for pred with scores
under this value being incorrect. Default to None.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This sentence is a little confusing. Is it better to say this?
If not None, predictions with scores under this threshold are to be considered incorrect

"""Module to calculate the accuracy

Args:
topk (tuple, optional): The criterion used to calculate the
accuracy. Defaults to (1,).
thresh (float, optional): If not None, threshold for prediction
scores under this value being incorrect. Default to None.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need to also modify here.

@hellock hellock merged commit 741b638 into open-mmlab:master Jul 3, 2020
mike112223 pushed a commit to mike112223/mmdetection that referenced this pull request Aug 25, 2020
* change accuracy to positive recall in FSAF

* use mmdet accuracy module to calculate pos recall in fsaf

* Change label to long in unittest

* revise docstring according to comments

* revise docstring according to comments
FANGAreNotGnu added a commit to FANGAreNotGnu/mmdetection that referenced this pull request Oct 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants