-
Notifications
You must be signed in to change notification settings - Fork 395
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Cant create a female mesh #37
Comments
Hi, Basically the model is not trained for the female SMPL shape space. The 10D beta values mean different things in the female, male, and the neutral model. This code base is trained with neutral model, therefore you can't just copy over the beta of neutral model and use it for female. If you just want a more female shape, which sounded like what the person was asking for, the pose is the same in all gendered models, so you can transfer the pose but use the default female shape. So basically
Again these approaches will not give you the female or male body shape in the picture, because the model was not trained on gendered models. If you want to train a model that works with female or male model, you would have to train the model again, but only with female/male images or either have to have the gender annotated for each training image which is not very practical. This is why I used the neutral model. Hope this helps, Angjoo |
Actually, if you really want, it would be a good idea to use the pose returned by HMR as the initialization to run the code for SMPLify: http://smplify.is.tue.mpg.de/ In SMPLify you can select the gender, and optimize for the pose and the shape of the person in the image, given that you provide detected 2D keypoints. Starting from HMR's pose will be a good initialization for the optimization. Best, Angjoo |
@akanazawa , I did not quite get what you mean by initializing SMPLify by HMR's pose. I know that SMPLify consumes output from DeepCut on a picture, a picture itself, and can be told what gender to use. What exactly do you call an HMR pose and won't there be a mismatch in different joint systems. Or am I missing something? :) |
Hi, So SMPLify is an iterative optimization approach, it requires some initialization to start the optimization. Hope this clears things up! Best, Angjoo |
@akanazawa, thanks a lot, I will try this out;) |
I have tried looking for shape space as told by you in #15 but I couldn't understand. Would you please elaborate on how to use female SMPL here?
The text was updated successfully, but these errors were encountered: