Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

why are there weird red margins of my loaded images? #2318

Closed
elenacliu opened this issue Aug 8, 2023 · 6 comments
Closed

why are there weird red margins of my loaded images? #2318

elenacliu opened this issue Aug 8, 2023 · 6 comments

Comments

@elenacliu
Copy link
Contributor

Describe the bug
When I load the images, they have red margins.

To Reproduce
Steps to reproduce the behavior:
I just install the latest version of nerfstudio (commitid 9b6010e), and pip install -e . to install it.

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
If applicable, add screenshots to help explain your problem.
image

Additional context
Add any other context about the problem here.

@brentyi
Copy link
Collaborator

brentyi commented Aug 10, 2023

Hm, I'm seeing something similar:
image

@tancik
Copy link
Contributor

tancik commented Aug 10, 2023

I believe those are the poses used for eval.

@elenacliu
Copy link
Contributor Author

I use the instant-ngp data parser, so all of the images are used for eval by default?
When I use nerfstudio data parser, only a few images have red margins.

@tancik
Copy link
Contributor

tancik commented Aug 10, 2023

@FrederikWarburg any idea what's going on?

@FrederikWarburg
Copy link
Contributor

Hi!

I had a look at this. It seems like InstantNGP(DataParser) is using all frames for training and for eval. def _generate_dataparser_outputs(self, split="train"): takes split as input, but the variable is unused. Therefore, the viewer first plots all the training images without a border (aka all images), and then, on top of the training images, plots the eval images with a red border (aka also all images).

So, I guess we could

  1. add train/eval split to the InstantNGP(DataParser)
  2. maybe remove InstantNGP(DataParser) as it seems to be almost the same as Nerfstudio(DataParser). I guess the main difference is get_focal_lengths, but could easily be added to Nerfstudio(DataParser)

In short, I don't think the problem is the recent commit, but rather that using InstantNGP(DataParser) reuses all training as eval images. Wouldn't mind doing any of these changes, so let me know what you think is the best way forward?

@elenacliu
Copy link
Contributor Author

elenacliu commented Aug 11, 2023

@FrederikWarburg thank you for your reply. I may prefer the first way, because many of my scripts just use instant-ngp-data, and I don't need so many complex preprocess in other dataparsers.

upd: I have fixed the issue in pr #2335

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants