How to get the position of SMPLX 3d joints by PyMAF-X

[huanngzh]

Thank you very much for your amazing work. I would like to ask a question about how to get the position of SMPLX 3d joints by PyMAF-X.

The output of PyMAF-X includes smplx_verts, pose, betas, joints3d, smplx_params and so on. But I found that the joints3d is inconsistent with SMPLX joints definition. Maybe I can align it to SMPLX joints? I haven't got the idea.I tried to build smplx model from the smplx_params, but failed for some shape-invalid problems. For example, the shape of body pose is [24, 3, 3], but SMPLX expects [x, 21, 3]. (The NUM_BODY_JOINTS equals to 21).

So could you give me some advice to get SMPLX 3d joints? Looking forward to your reply.

[HongwenZhang]

Hi, you can modify to code to return SMPL or SMPLX joints:
https://github.com/HongwenZhang/PyMAF/blob/smplx/models/smpl.py#L401
https://github.com/HongwenZhang/PyMAF/blob/smplx/models/smpl.py#L419

[Hzz-xs]

I see 49 joints3d and 19 joints2d. How can I find their corresponding body parts

[Travvy88]

@huanngzh Hi! Do you find solution for convert data to SMPLX format?

[huanngzh]

@Travvy88 After I ran the dataset with pymafx, I found that the joints output of pymafx is the custom smpl+2hands+face. It is very time-consuming to run again from the beginning. So I use the smplx vertices in the output results and use the smplx joint regressor to obtain the joint data defined by smplx. But maybe the result will be a bit biased.

If you haven't run the code, you can modify the code accoding to @HongwenZhang 's reply:

Hi, you can modify to code to return SMPL or SMPLX joints: https://github.com/HongwenZhang/PyMAF/blob/smplx/models/smpl.py#L401 https://github.com/HongwenZhang/PyMAF/blob/smplx/models/smpl.py#L419

[z-z-zhao]

@Travvy88 After I ran the dataset with pymafx, I found that the joints output of pymafx is the custom smpl+2hands+face. It is very time-consuming to run again from the beginning. So I use the smplx vertices in the output results and use the smplx joint regressor to obtain the joint data defined by smplx. But maybe the result will be a bit biased.

If you haven't run the code, you can modify the code accoding to @HongwenZhang 's reply:

Hi, you can modify to code to return SMPL or SMPLX joints: https://github.com/HongwenZhang/PyMAF/blob/smplx/models/smpl.py#L401 https://github.com/HongwenZhang/PyMAF/blob/smplx/models/smpl.py#L419

@huanngzh How to use SMPLx joint regressor?I'm very much obliged to you.