Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

generalize mask collation to other image-like data #1959

Merged
merged 4 commits into from
May 23, 2023

Conversation

decrispell
Copy link
Contributor

@decrispell decrispell commented May 19, 2023

Variable resolution image collation currently looks for the special keys "image" and "mask" only.
This change is a generalization that looks for "image", and then treats any other keys with the same first two dimensions as "image" as auxiliary data to be collated accordingly.

@SauravMaheshkar SauravMaheshkar added the python Pull requests that update Python code label May 19, 2023
@decrispell
Copy link
Contributor Author

A little more context - This change was added to make it easier to incorporate additional image-like auxiliary data (e.g. depth, semantic maps, etc.). Rather than looking for special keys (currently only "mask"), just assume any data with the same dimensions as the image should be treated like "mask" is currently.

I think another option would be to have a way to somehow "register" image-like data keys, but this seemed like a less disruptive change.

Please let me know if there is an existing way to go about this that I'm missing.

Copy link
Contributor

@tancik tancik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM for now, I think long-term we should think about how to give the user more control over what is and isn't loaded / the ability to load data at different scales

@tancik tancik merged commit ccdcc39 into nerfstudio-project:main May 23, 2023
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
python Pull requests that update Python code
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants