Claswise mAP

[bond9779]

How to get the classwise mAP of a given dataset?

The below command gives the overall mAP:
python3 tools/test.py --config/<config_name> checkpoint/<checkpoint_file_name> --eval bbox segm --show/--out

But is there a way to get the classwise mAP from this?

[bond9779]

@hellock

[ZwwWayne]

Hi @bond9779 ,

Please check and use the file https://github.com/open-mmlab/mmdetection/blob/master/tools/coco_error_analysis.py.
It could help you to get the classwise mAP of COCO dataset.
You may also use it as a template for the customized dataset.

Feel free to ask if you have further questions.

[bond9779]

Thanks for the prompt reply @ZwwWayne :)
I will check the link provided by you

[ZwwWayne]

Thanks for the prompt reply @ZwwWayne :)
I will check the link provided by you

Hi @bond9779 , I tried to run the script by myself and find that it does not show the class-wise mAP but shows other details that might help you to analyze.

So I added some code in the script and proposed a PR. You can check this link #1549
It can show the class-wise mAP for both segm and bbox now by simply adding --with_ap option in the running command.

Hope it could help.

[ZwwWayne]

The PR #1549 is approved, so current master branch support to view classwise mAP.

I am going to close this issue, feel free to reopen it if you have any further questions.

[Cli98]

The PR #1549 is approved, so current master branch support to view classwise mAP.

I am going to close this issue, feel free to reopen it if you have any further questions.

Why u need to PR this? coco provided this function.