Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Coco detection metrics in object detection tf v.2.2.0 #8856

Open
1 task done
tazu786 opened this issue Jul 13, 2020 · 2 comments
Open
1 task done

Coco detection metrics in object detection tf v.2.2.0 #8856

tazu786 opened this issue Jul 13, 2020 · 2 comments

Comments

@tazu786
Copy link

tazu786 commented Jul 13, 2020

Prerequisites

Please answer the following question for yourself before submitting an issue.

  • I checked to make sure that this feature has not been requested already.

1. The entire URL of the file you are using

https://github.com/tensorflow/models/blob/master/research/object_detection/colab_tutorials/eager_few_shot_od_training_tf2_colab.ipynb

2. Describe the feature you request

I request the implementation of the coco_detection_metrics in the above colab.

3. Additional context

The new colab for few-shot-training you provide is a great improvement on how to easily use the OD api. Having the coco metrics other than only the loss would be great.

4. Are you willing to contribute it? (Yes or No)

No

@tazu786 tazu786 added models:research models that come under research directory type:feature labels Jul 13, 2020
@pn12
Copy link

pn12 commented Jul 28, 2020

Add below in your code to include coco evaluation metrics -

from object_detection.protos import eval_pb2
eval_config = eval_pb2.EvalConfig()
eval_config.metrics_set.extend(['coco_detection_metrics'])

for the precision , recall and iou at different thresholds

I have referred this doc - https://github.com/tensorflow/models/blob/da23acba8ecb8c0e7c9a83cdb9f10092895c9dcc/research/object_detection/g3doc/evaluation_protocols.md
for the same.

@tazu786
Copy link
Author

tazu786 commented Jul 28, 2020

thank you @pn12! I kind of have the same issue using model_main_tf2.py with the config file. How can I apply those lines in that case too?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

6 participants