New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add MMEval support for COCO detection evaluation #1556

Open

ice-tong wants to merge 1 commit into tensorpack:master from ice-tong:coco_det_mmeval

ice-tong commented Dec 28, 2022

Hi, thanks for this nice work!

This PR wants to provide a new evaluation tool for examples/FasterRCNN: MMEval

MMEval is a unified evaluation library for multiple machine-learning libraries, the link to the home page is: https://github.com/open-mmlab/mmeval

The coco_det_mmeval.py support multi-gpus and multi-node evaluation with MPI4PY:

# run evaluation
python tensorpack_mmeval.py --load <model_path>

# launch multi-gpus evaluation by mpirun
mpirun -np 8 python tensorpack_mmeval.py --load <model_path>

We tested this evaluation script on COCO-MaskRCNN-R50C41x and got the same evaluation results as the TensorPack report.

Related refer: https://github.com/open-mmlab/mmeval/tree/main/examples/tensorpack


          Add MMEval support for COCO detection evaluation

775bf2e

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment