New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Wired results: obtain the similar reported result without training... #30
Comments
Our reported 22.12 mAP for HAKE-HICO-DET (PaStaNet* in paper) is composed of multiple components: The result of the Instance-level PaStaNet* is fused with the result from TIN and our image-level PaStaNet*, then applied with Non-Interactive Suppression (NIS) trained on HAKE. |
Well, !!! The result of 'test_pastanet/HOI_iter_1.ckpt' is:
I think this is an approximation of randomly initialized model in my experiment. Is it because I possibly make some mistakes? Or Somethings (e.g. parts knowledge) that you provided have been optimized?
Here, do you mean Instance-level PaStaNet* achieve 19.52 under radomly initialized model? Btw, compared to your result, TIN might be useless because we directly achieve around 18.2 without Non-Interactive Suppression based on TIN code. One of very useful parts is re-weighting and it is also very simple. |
I run the code with python3. So I change the pickle format like this,
Other part is unchanged. I can also upload the code to github. You might find out the problem if your randomly initialized model is worse much than 22.00. Thanks. |
|
Thanks for your reply.
oh, thx. I have noticed the HO_weight is different from TIN.
So, you still include Image-level PaStaNet* in the final result? Would you mind provide the full result? I mean the Rare category and UnRare category. The full is 19.52, the rare is ? I'm still confused about the performance of Anyway. Thanks for your information very much. |
It achieves 17.29 mAP on the Rare set and 20.19 mAP on the Un-rare set. |
Thanks for your released code. However, I faces a strage problem that the HAKE-Action seems do not need to train. I run the code using the command:
Then, I test the model 'test_pastanet/HOI_iter_10.ckpt'.
Unbelievably! The result is:
Have you ever tested your code like this? This result is ....... I'm trying to test snapshot 1. I do not change the code.
The text was updated successfully, but these errors were encountered: