Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about pose of dataset #52

Closed
yjhong89 opened this issue Apr 28, 2022 · 6 comments
Closed

Questions about pose of dataset #52

yjhong89 opened this issue Apr 28, 2022 · 6 comments

Comments

@yjhong89
Copy link

Hi. Thanks for great work!

I have few questsions of dataset.

  1. Is there any other dataset for training rather than 'Multi-Pie' and '300W-LP'?
  2. How get ground-truth pose data (camera extrinsic, rotation/translation) for '300W-LP' datasets? Isn't it wild images ?
  • I have not downloaded 'Multi-Pie' dataset, but I think this dataset might have gt pose data

Thank you.

Best regards,
YJHong.

@jiaxiangshang
Copy link
Owner

For Q1: Facescape dataset, multi-view dataset is expensive and indoor setting
For Q2: We do not use the gt pose, we predict pose and leveraging multi-view geometry consistency.
I do not think so, they have not

@yjhong89
Copy link
Author

@jiaxiangshang
Thanks for replying.

For Q2, then how predict pose vector (rotation, translation) ? Is there any code reference that you would recommend ?

@jiaxiangshang
Copy link
Owner

the mgcnet predict the pose actually, you can also see DECA, Deep3DFace......

@yjhong89
Copy link
Author

@jiaxiangshang
Thank you.

These are things that I understand so far.

  • We need rotation/translation/depth information to leverage multiview-geometry consistency.
  • Since ground-truth rotation/translation/depth information doesn't exist for 300W-LP, and MPIE, estimated pose vectors from 3dmm module (DECA, MGCNET, Deep3DFace) are used for multiview-geometry ? (below Equation)
    image

@jiaxiangshang
Copy link
Owner

Yes, that is the main idea of MGCNet... :)

@yjhong89
Copy link
Author

@jiaxiangshang Thank you! It is very clear!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants