Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about the input of shallow nerf network #18

Closed
shoutOutYangJie opened this issue Jan 4, 2022 · 1 comment
Closed

Question about the input of shallow nerf network #18

shoutOutYangJie opened this issue Jan 4, 2022 · 1 comment

Comments

@shoutOutYangJie
Copy link

shoutOutYangJie commented Jan 4, 2022

I know nerf is a view-dependent synthesis method due to a direction input.
However, in your code. I find you don't use it. Why can cips3d still work? just input the world coordinate can achieve new view synthesis? why?

@shoutOutYangJie shoutOutYangJie changed the title Question aboUT Question about the input of shallow nerf network Jan 5, 2022
@PeterouZh
Copy link
Owner

As stated in the original NeRF paper, the direction input helps NeRF recreate specular reflection. Without the direction, NeRF can still represent 3D scenes but may decrease the model's ability.

I don't use direction as input because I empirically found that the input direction will cause the face identity to be inconsistent under multiple views.

Although we did not input the direction, we can still obtain multi-view images by changing the camera's pose. Imagine that you are observing a stationary object that is in the world coordinate from different positions (your eyes are equivalent to a camera).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants