-
Notifications
You must be signed in to change notification settings - Fork 9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
> Can't reproduce the result? #10
Comments
The performance may vary depending on the environment, seed, and others. |
Thank for your reply.I used the pre-trained model that you have updated to test,but the result is : Step: 0 The result is worse than your paper.I think the envirment is not detemined with the test result.And the enviroment that I test your pre-trained model is in Google Colab.Is the pre-trained model you offerd newest? |
The environment, in fact, affects the performance. |
Thank you for your quick reply.I will make the environment same to your requirements and test the model again. |
Hello. And my environment is: Name Version Build Channel | | | | |_libgcc_mutex 0.1 main | | | | | And my cuda versionis 10.2: I don't know the reason that casue the problem.Maybe you change something that you ignored,but you forgot. I hope you can help me solve this problem.Because it' s very important for me.I'm waiting for your reply. |
Hello.Can you tell me why the average result is 1.5 lower than your paper?Because it's very important for me. |
Sorry, but I have no idea about what causes the performance difference, as I cannot look into the exact status of your environment. |
Thank you for your reply.I have updated the newest code and the newest model.But the results don't change.Maybe you use some tricks that you ignored。 |
I'm sorry. |
Thank you for your reply. |
Hi @xumh-9 , have you reproduced the result in paper? I tried many times, but I cannot get the result as good as pretrained model, even tried different random seeds. |
Thanks for your reply.I test the best model that you have updated. I have changed the parameter as you said.But I can't reproduce the result.The result that I test is as follows:
Step: 0
Test_acc: 0.8905
average_mAP: 0.4038
mAP@0.1: 0.6551
mAP@0.2: 0.5836
mAP@0.3: 0.5052
mAP@0.4: 0.4158
mAP@0.5: 0.3245
mAP@0.6: 0.2266
mAP@0.7: 0.1161
Do you know the reason?
Originally posted by @xumh-9 in #9 (comment)
The text was updated successfully, but these errors were encountered: