Skip to content
This repository has been archived by the owner on Dec 13, 2023. It is now read-only.

A confusion about the order of sin and cos in the IPE part #41

Open
YZsZY opened this issue Dec 1, 2022 · 3 comments
Open

A confusion about the order of sin and cos in the IPE part #41

YZsZY opened this issue Dec 1, 2022 · 3 comments

Comments

@YZsZY
Copy link

YZsZY commented Dec 1, 2022

jnp.concatenate([y, y + 0.5 * jnp.pi], axis=-1),

Hello author! I recently tried to reproduce the mip-nerf by myself, and found a doubt about the IPE part.

In NeRF it is coded in the order of [(sinx,cosx),...], while Mip-NeRF seems to put the sinx-related ones together, followed by the cosx-related ones,[(sinx , ...),(cosx , ...)], as the following equation shows:

image

So I'm curious, have you tried coding in the same order as in NeRF, or does the current coding layout work better? Thank you so much! I just noticed this while writing the code, so I wanted to ask for some advice

@jonbarron
Copy link
Contributor

The order of features in an MLP shouldn't matter. This change is arbitrary and was just done because it's slightly easier to compute and implement.

@YZsZY
Copy link
Author

YZsZY commented Dec 6, 2022

Sorry for the late reply, I tried it myself and there is really no difference in the order, thank you(^▽^)

@YZsZY
Copy link
Author

YZsZY commented Dec 6, 2022

In the meantime, I'd like to ask you another question. I've recently encountered a situation in the outdoor dataset when reproducing Mip-NeRF 360 that the rendered images always have severe burrs and noise, it can be seen visually in the depth image:
gnome-shell-screenshot-BZ65V1
But when I use NeRF as the body of the network, although the effect is not as good as Mip-NeRF, but you can see that there is no serious burr situation:
image
So I don't know if the cone ray modeling is causing this noise.(Both inverse depth sampling and linear sampling encounter severe noise conditions)
So I would like to ask you if you have encountered this situation or can give some advice on the cause of the noise?
Sorry to bother you, looking forward to your better work! (^▽^)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants