Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

wrong number of predictions for msra? #12

Closed
kmonachopoulos opened this issue Apr 29, 2022 · 2 comments
Closed

wrong number of predictions for msra? #12

kmonachopoulos opened this issue Apr 29, 2022 · 2 comments

Comments

@kmonachopoulos
Copy link

kmonachopoulos commented Apr 29, 2022

I am using the test.py script to generate the predictions so I can later evaluate the model using the https://github.com/xinghaochen/awesome-hand-pose-estimation framework.

For msra the total number of predictions in the generated txt file is 8496 while the expected number of predictions in the https://github.com/xinghaochen/awesome-hand-pose-estimation is 76375.

Therefore i am getting an error while trying to generate the scores :

ValueError: operands could not be broadcast together with shapes (76375,21,3) (8496,21,3)

Shouldn't the test.py script generate a bigger list of predictions for this dataset? Or am I doing something wrong?

@kmonachopoulos
Copy link
Author

Actually, I realised that test.py extracts predictions on 1 subject (17 gestures x 500 frames per gesture = 8500) where it is expected from awsome-hand-pose-estimation framework that the evaluation will take place on the whole dataset (9 subjects x 17 hand gestures x 500 frames per gesture = 76500).

What should I change in test.py to extract the estimated joints for the whole MSRA dataset?

@kmonachopoulos
Copy link
Author

There are scripts in the github page that can be used to estimate the MSE individually for each subject. No need to use awsome-hand-pose-estimation for evaluation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant