Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize Object Pose with a PhongShader instead of SilhouetteShader #30

Closed
filipetrocadoferreira opened this issue Feb 7, 2020 · 4 comments
Labels
enhancement New feature or request question Further information is requested

Comments

@filipetrocadoferreira
Copy link

I'm trying to optimize a mesh pose using a target image and the rendered. Because I'm working in synthetic domain I thought that I could use PhongShader instead of Silouette proxy.

However, right in first iteration weights explode. Is there a simple justification for this? Or maybe I'm doing something wrong?

@jcjohnson
Copy link
Contributor

Can you post a bit of code that reproduces the problem? That will make it easier for us to help.

@nikhilaravi nikhilaravi added the enhancement New feature or request label Feb 10, 2020
@nikhilaravi
Copy link
Contributor

@filipetrocadoferreira I can take a look at this and get back to you. You may need to increase the faces_per_pixel for the PhongShader.

@nikhilaravi nikhilaravi added the question Further information is requested label Feb 11, 2020
@filipetrocadoferreira
Copy link
Author

filipetrocadoferreira commented Feb 12, 2020

I was having a hard time spliting the code to show here
So, I tried camera pose optimization tutorial and changed the SilhouetteShader with a Phong, and it worked.

In my problem, I estimate Rotation (R) from a neural network but after the first backpropagation, all values go to nan, despite loss being finite.

EDIT: Conclusion: The problem is not the shader, it has to be something else. You can close this. Thanks for the attention.

@nikhilaravi
Copy link
Contributor

@filipetrocadoferreira ok great!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants