Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

In COCO, I Get a very low AP score, how can I fix it? #8

Open
sixone-Jiang opened this issue Mar 15, 2023 · 8 comments
Open

In COCO, I Get a very low AP score, how can I fix it? #8

sixone-Jiang opened this issue Mar 15, 2023 · 8 comments

Comments

@sixone-Jiang
Copy link

I get less than 3 AP in COCO, but I get the AP that similar to you in VOC; I check my output log find that many object in COCO get 0 AP; how can I fix it?

@sixone-Jiang
Copy link
Author

[03/13 11:19:10 fewx.evaluation.coco_evaluation]: Evaluation results for Non VOC 60 categories =======> AP : 0.00
[03/13 11:19:10 fewx.evaluation.coco_evaluation]: Evaluation results for Non VOC 60 categories =======> AP50: 0.00
[03/13 11:19:10 fewx.evaluation.coco_evaluation]: Evaluation results for Non VOC 60 categories =======> AP75: 0.00
[03/13 11:19:10 fewx.evaluation.coco_evaluation]: Evaluation results for Non VOC 60 categories =======> APs : 0.00
[03/13 11:19:10 fewx.evaluation.coco_evaluation]: Evaluation results for Non VOC 60 categories =======> APm : 0.00
[03/13 11:19:10 fewx.evaluation.coco_evaluation]: Evaluation results for Non VOC 60 categories =======> APl : 0.00

@Jaraxxus-Me
Copy link
Owner

How about the novel classes? The test only counts novel classes

@sixone-Jiang
Copy link
Author

In COCO, all novel classes get 0 AP, but in VOC, I can get similar AP like you. May be I split the datasets wrong?

@Jaraxxus-Me
Copy link
Owner

Could be, you can check the steps in data generation phase

@Jaraxxus-Me
Copy link
Owner

Also check the ID mapper is correct for the VOC classes in COCO

@sixone-Jiang
Copy link
Author

Thanks for your reply! At your reminder, I thought that non_voc60 should get 0AP in the testing stage; After the pre-training model you provided is fine-tuned, the category of nonVoc will not be recognized.

@sixone-Jiang
Copy link
Author

image

@Q12seven
Copy link

image

May I ask if this result is obtained after fine-tuning? I can't fine-tune the code once it's running

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants