Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Poor reproduction results #40

Closed
liangjxiong opened this issue Mar 21, 2024 · 4 comments
Closed

Poor reproduction results #40

liangjxiong opened this issue Mar 21, 2024 · 4 comments

Comments

@liangjxiong
Copy link

Hello! I am very interested in your work and it has greatly inspired me. This is an outstanding job. I encountered difficulties in reproducing the results of my paper and urgently need your help. The experimental results of the paper are presented in the VIGOR dataset: Percentage top1:61.48, top5:87.54, top10:91.88, and top1%: 99.56. The results I validated using the trained model you provided are: Percentage top1: 57.56677121946583, top5: 83.97870924817032, top10: 89.24246744606026, top1%: 99.41070240471439, time: 5480.254483938217. I haven't changed any parameters, R @ 1 has a significant difference, what should I do? Hope for your reply! Thank you!

@ssfkfffddj
Copy link

Hello, what is the accuracy of the first stage of your training?

@liangjxiong
Copy link
Author

Hello! I didn't train. I am only using the weights you provided to validate the model.

@ssfkfffddj
Copy link

Thanks for your reply.And I'm not the Author.

@Jeff-Zilence
Copy link
Owner

Not sure what is going on here. I will need more details of your evaluation code to figure out. Alternatively, you can run the run_VIGOR.sh to reproduce the results. Please do not change the hyperparameters including the batch size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants