Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

parameter in calc_mAP #28

Open
chaobinzhang opened this issue Nov 9, 2021 · 3 comments
Open

parameter in calc_mAP #28

chaobinzhang opened this issue Nov 9, 2021 · 3 comments

Comments

@chaobinzhang
Copy link

hello
@junting @Siyu-C
I am sorry to bother you.
I have a problem with calc_mAP.py.
In line 39, the parameter: capacity=0(capacity: Maximum number of labeled boxes allowed for each example. Default is 0 where there is no limit.) whether has a special role or it will not affect the final mAP?
Thanks!!!!

@Siyu-C
Copy link
Owner

Siyu-C commented Nov 9, 2021

Hi @chaobinzhang , we follow official AVA evaluation and set this parameter to 50 when reading detections (see here). If this is set to 0, i.e. no limit, the performance should slightly increase, but it would be unfair.

@chaobinzhang
Copy link
Author

by the way, the number 50 is only suitable for AVA, right? If I use other datasets, Are there still restrictions on parameters? Where can I find this parameter restriction?

@Siyu-C
Copy link
Owner

Siyu-C commented Nov 9, 2021

For another dataset, it is the best to find its official evaluator implementation if there is one, or refer to settings of other works which include the same dataset.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants