Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

inaccurate MANO annotation #30

Closed
ZhengdiYu opened this issue May 10, 2022 · 3 comments
Closed

inaccurate MANO annotation #30

ZhengdiYu opened this issue May 10, 2022 · 3 comments

Comments

@ZhengdiYu
Copy link

This is the rendering results of 00005896.jpg of training set. Is this normal?
image

@lixiny
Copy link

lixiny commented May 14, 2022

I also witnessed a slightly offset on the mask/depth rendering, but it is not as much as your illustration.
Here is my results. ( 00005896.jpg )
截屏2022-05-14 15 53 14
img, rendered depth from verts, depth + joints, masks.

@ZhengdiYu
Copy link
Author

What kind of rendering method are you using? And what is your MANO model? I use (https://github.com/hassony2/manopth) to get a mesh in camera coordinate system by:

        uv_root, scale = mano[:, 58:60], mano[:, 60:]
        focal, pp = get_focal_pp(K)
        xyz_root = recover_root(uv_root, scale, focal, pp)

        mano_pose = torch.FloatTensor(pose).to(DEVICE)#.view(-1, 3)
        shape = torch.FloatTensor(shape).to(DEVICE)#.view(1, -1)

        assert mano_pose.size() == torch.Size((1, 48)), mano_pose.size()
        assert shape.size() == torch.Size((1, 10)), shape.size()
        output = mano_layer['r'](mano_pose, th_betas=shape) # already root-aligned in manolayer
        joints = output[1][0].cpu().detach().numpy()
        mesh = output[0][0].cpu().detach().numpy()

        trans = xyz_root[0] - joints[9]
        trans = trans[None]
        mesh = mesh + trans
        joints = joints + trans

        # milimeter
        #mesh = (output.vertices[0] * 1000).cpu().detach().numpy() # smplx
        mesh = (mesh * 1000)

@ZhengdiYu
Copy link
Author

ZhengdiYu commented May 14, 2022

For most of cases, there are offsets. And of some of them, the offsets are acceptable:
image

image
image
image

@zimmerm zimmerm closed this as completed Dec 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants