Novel view

[ggfresh]

Awesome project! Where could I set the camera params for rendering novel view?

[evonneng]

Hi, thanks!! For the camera params, you could change the K and Rt matrix that is getting passed into the renderer.

So for instance, I am just loading in some default camera parameters as per this line here:

audio2photoreal/visualize/render_codes.py

Line 89 in 548aeeb

self.default_inputs = th.load(f"assets/render_defaults_{person}.pth")

And passing in the parameters to the model here

audio2photoreal/visualize/render_codes.py

Line 121 in 548aeeb

preds = self.model(**default_inputs_copy)

This is where these things get ingested.

audio2photoreal/visualize/ca_body/models/mesh_vae_drivable.py

Lines 283 to 285 in 548aeeb

	K: Optional[th.Tensor] = None,
	Rt: Optional[th.Tensor] = None,
	image_bg: Optional[th.Tensor] = None,

Since different parts of the body decoder use either the K or the Rt, you will need to set both. Hope this helps!

[alexanderrichard]

Closing this issue as it seems resolved. Please reopen if you have more questions.