Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test code on KPT method #3

Open
ChanglongJiangGit opened this issue Oct 27, 2023 · 2 comments
Open

Test code on KPT method #3

ChanglongJiangGit opened this issue Oct 27, 2023 · 2 comments

Comments

@ChanglongJiangGit
Copy link

Thanks for your excellent job!
In your table 3 , you tested KPT method under MCP alignment with and without scale alignment. Can you share your testing code of this?

@walsvid
Copy link
Collaborator

walsvid commented Dec 29, 2023

Hi, @ChanglongJiangGit, we modified the public code of KPT to align the definition of evaluation. Since it was modified based on KPT, this part of the code is not in this codebase. According to the definition of evaluation metrics, this part of the modification is not complicated. If you need more help we can provide guidance on how to modify the code. cc @PengfeiRen96

@ChanglongJiangGit
Copy link
Author

Thanks for your response!
When we modified the code ourselves, we found that the order of hand joint point coordinates defined by MANO was different from the order defined by the interhand2.6M data set. In MANO, the root joint coordinate is 0 and MCP is 9, but corresponding to interhand2.6m, the root joint is 20 and MCP is 11. So we calculated the result after coordinate transformation, similar code is:
pred_joint_coord_cam[self.joint_type['right']] = pred_joint_coord_cam[self.joint_type['right']] - pred_joint_coord_cam[11,None,:]
gt_joint_coord[self.joint_type['right']] = gt_joint_coord[self.joint_type['right']] - gt_joint_coord[11,None,:]
length_right_gt = np.linalg.norm(gt_joint_coord[11] - gt_joint_coord[20], axis=-1)
scale_right = (length_right_gt / (length_right_pred))
Then scale through this scale parameter. Is this code correct?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants