Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

about other code(SPIN) #13

Closed
zhangzhenyu-zzy opened this issue Nov 24, 2021 · 3 comments
Closed

about other code(SPIN) #13

zhangzhenyu-zzy opened this issue Nov 24, 2021 · 3 comments

Comments

@zhangzhenyu-zzy
Copy link

Hello, I want to add up3d dataset to your spin code framework for training, but I find that after I add it, 2D joint points cannot correspond. Do you need special settings?

@nkolot
Copy link
Owner

nkolot commented Nov 24, 2021

The joint order for ProHMR is almost the same as in SPIN (25 first from OpenPose and then 19 instead of 24 extra joints). These correspond to the first 44 joints from SPIN (we discard the last 5). What is the problem you are encountering?

@zhangzhenyu-zzy
Copy link
Author

The joint order for ProHMR is almost the same as in SPIN (25 first from OpenPose and then 19 instead of 24 extra joints). These correspond to the first 44 joints from SPIN (we discard the last 5). What is the problem you are encountering?

Hello, in looking at the code of graphcmr, I found that in addition to the 24 joint points regressed from smpl, you also regressed an additional 14 joint points. Why not use the No. 1 and No. 2 joint points in smpl to correspond to the hip joint points in the data set, but use the additional No. 29 and No. 30? Can I replace the corresponding order with No. 1 joint point and No. 2 joint point in smpl? In addition, I have the same question about the joint point on the neck. Can I use No. 12 (neck) to replace the original No. 31?

@nkolot
Copy link
Owner

nkolot commented Dec 5, 2021

The locations of the hip joints are very different. The hips in the SMPL model are higher and closer to the middle of the body whereas in most of the other datasets there are near the boundary. Similarly for the neck joints. This is why we did not use the default joints provided by SMPL. You can visualize the joint locations for a given mesh and see the differences yourself.

@nkolot nkolot closed this as completed Dec 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants