-
Notifications
You must be signed in to change notification settings - Fork 12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
different results #5
Comments
I can't reproduce the results of hand pose estimation using the provided checkpoint as well. I got even worse results when trained from scratch. Could @stevenlsw please help explain how to reproduce the performance claimed in the paper? Thanks in advance. |
Hi, @fuqichen1998, can you provide more training and testing logs as well as result details. Thanks! |
Hi @stevenlsw , thanks for your reply! Below is the score output of the results generated using the checkpoint provided:
and below is the content of the option.txt:
and below is the content of object_results.txt
I can also provide the logs about training the model by myself and its score. |
Thanks for the info. I am not fully sure the linked model is the right one. I am in travel now. I upload my local saved checkpoints https://drive.google.com/file/d/1Y4fICIY63MA4J1FiY8QfBAF_AKzMEjDn. Could you please @fuqichen1998 help me to take some evaluation. Thanks in advance. |
The new checkpoint gives the same results as reported in the paper, thanks @stevenlsw. But after training the model from scratch multiple times, I can't achieve, or even get close to, the performance of the new checkpoint. Is there any difference in the training of the released checkpoint? |
Thanks so much for testing. The only difference in the provided checkpoint is that we are incorporating more pseudo labels from Something-v2 dataset as training data. |
Got it, thanks for your reply! |
Hi @stevenlsw, after several rounds of training, I could not reach the performance you reported training solely on the HO3D dataset. Could you please provide the instruction to reproduce the performance reported in the paper? Semi-Hand-Object/utils/options.py Line 36 in 1aaf6ee
|
Hi @fuqichen1998. Could you share the evaluation of groundtruth json to me? Thanks in advance. |
@dncfjy we don't have it, it's hidden in the backend of the official HO3D challenge evaluation portal. |
@fuqichen1998 Now the channel uploaded for the result prediction I do not see on the web page. Can you share a link with me? Thank you very much. |
When I run the code as written in the readme.md, the result is different from trained model.
Why is it different and how to get trained model?
The text was updated successfully, but these errors were encountered: