Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request: Add parallel metric calculation. #53

Open
ternaus opened this issue Oct 12, 2019 · 1 comment
Open

Feature request: Add parallel metric calculation. #53

ternaus opened this issue Oct 12, 2019 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@ternaus
Copy link
Contributor

ternaus commented Oct 12, 2019

At the moment mAP calculation is slow. We can calculate values for different thresholds and classes in parallel.

@ternaus ternaus added the enhancement New feature or request label Oct 12, 2019
@ternaus ternaus self-assigned this Oct 12, 2019
@pyaf
Copy link

pyaf commented Oct 13, 2019

Hey @ternaus, I'd love to work on this.

Here's how I plan to implement this:

  1. Parallelly compute the per class mAPs for each IoU threshold and save them in a temp file. (temp files are necessary because parallel processes can't use global variables of the master process, I'm all in for ideas, let me know if you there's a better way to do this.)
  2. Once all parallel processes are finished, read the temp files and calculate and print the overall mAP and remove the temp files.
  3. We can also save all the class-wise computed APs for each threshold in a JSON file, something like this

Let me know your thoughts.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants