Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Documentation request: loading MANO hands and SMPL body model together #18

Closed
jutanke opened this issue Jan 7, 2021 · 2 comments
Closed

Comments

@jutanke
Copy link

jutanke commented Jan 7, 2021

I am trying to load the reconstructed hands together with the SMPL mesh/vertices. While loading the SMPL vertices (red) and pose keypoints (yellow) and projecting into a given camera works fine I have some trouble with the hands.
The hand keypoints and the reconstructed hand mesh (blue: left, green: right) seem to be placed at different position than the mesh:

image
image

Applying the rotation and translation provided in mano_params_l.txt/mano_params_r.txt also does not seem to produce the right results.

image

The camera calibrations for body and hands seem to be identical.

Could you provide a sample of loading SMPL and MANO in the same coordinate frame?

@jutanke
Copy link
Author

jutanke commented Jan 7, 2021

This has actually been asked already: #5

@zhixuany Is there an update wrt jointly tracked body and hands or does the dataset - as of now - still treats body and hands separately? Some samples in the paper seem to be with tracked body + hands, for example:
image

@zhixuany
Copy link
Owner

zhixuany commented Jan 8, 2021

We allocate different time sessions to capture body movement and hand gestures separately, in order to highlight each. Thus, we did not process hand in sequence focus on body movement, though we made that particular images in the paper showing body and hand mesh together.

@zhixuany zhixuany closed this as completed Jan 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants