Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Different AP Results for pre-trained VCOCO models #18

Closed
cancam opened this issue Jun 30, 2021 · 2 comments
Closed

Different AP Results for pre-trained VCOCO models #18

cancam opened this issue Jun 30, 2021 · 2 comments

Comments

@cancam
Copy link

cancam commented Jun 30, 2021

Hi folks,

First of all, thank you for sharing this repository. I would like to ask a specific question about the evaluation results of provided pre-trained V-COCO models. I followed the instructions you provided (for constructing annotation files for V-COCO and obtaining pickle files) to get the results. However, comparing with the V-COCO results in the table, I got different average role ap results. For instance, I am providing the output of R-50 QPIC, scenario 1 Role AP result in the attached screenshot. I am wondering possible reasons for the issue, could you please provide assistance about this?

qpic_resnet50_sc1_roleap

@tamtamz
Copy link

tamtamz commented Jul 1, 2021

Please see #7.

@cancam
Copy link
Author

cancam commented Jul 10, 2021

Thank you for your help. I can reproduce the results in the paper now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants