Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model3D Gaussian Splatting #7406

Merged
merged 2 commits into from Feb 14, 2024

Conversation

dylanebert
Copy link
Contributor

Description

  • Adds support for viewing gaussian splatting scenes using gsplat.js
  • This is done by adding a Canvas3DGS svelte component that mirrors Canvas3D, then using a conditional on the file extension

Considerations

  • If .ply support is later added for meshes, then inferring mesh vs. splat from the extension alone may not be sufficient.

Closes: #7405

cc @abidlabs @hysts

@gradio-pr-bot
Copy link
Contributor

gradio-pr-bot commented Feb 12, 2024

🪼 branch checks and previews

Name Status URL
Spaces ready! Spaces preview
Website ready! Website preview
Storybook ready! Storybook preview
🦄 Changes detected! Details

Install Gradio from this PR

pip install https://gradio-builds.s3.amazonaws.com/a450f26f19911068487c3389cbcc8e1f10104549/gradio-4.18.0-py3-none-any.whl

Install Gradio Python Client from this PR

pip install "gradio-client @ git+https://github.com/gradio-app/gradio@a450f26f19911068487c3389cbcc8e1f10104549#subdirectory=client/python"

@gradio-pr-bot
Copy link
Contributor

gradio-pr-bot commented Feb 12, 2024

🦄 change detected

This Pull Request includes changes to the following packages.

Package Version
@gradio/model3d minor
gradio minor

With the following changelog entry.

Model3D Gaussian Splatting

⚠️ The changeset file for this pull request has been modified manually, so the changeset generation bot has been disabled. To go back into automatic mode, delete the changeset file.

Something isn't right?

  • Maintainers can change the version label to modify the version bump.
  • If the bot has failed to detect any changes, or if this pull request needs to update multiple packages to different versions or requires a more comprehensive changelog entry, maintainers can update the changelog file directly.

@hannahblair hannahblair self-requested a review February 13, 2024 16:02
@pngwn
Copy link
Member

pngwn commented Feb 13, 2024

Hmm, is this really something we want in core? This feel specialised enough to be its own custom component.

demo/model3D/files/luigi.ply Outdated Show resolved Hide resolved
js/model3D/shared/Model3D.svelte Outdated Show resolved Hide resolved
js/model3D/shared/Model3DUpload.svelte Outdated Show resolved Hide resolved
@pngwn
Copy link
Member

pngwn commented Feb 14, 2024

@dylanebert I think we are good to move ahead with this.

add gsplat implementation

run formatting

move example .splat and .ply to url

add changeset

dispose of renderer on unmount

notebook
@dylanebert
Copy link
Contributor Author

I believe all comments have now been addressed :)

Copy link
Member

@pngwn pngwn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great! Thanks @dylanebert for adding this and addressing all of those comments!

@pngwn pngwn merged commit 3e886d8 into gradio-app:main Feb 14, 2024
8 checks passed
@pngwn pngwn mentioned this pull request Feb 14, 2024
@abidlabs abidlabs mentioned this pull request Feb 14, 2024
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Model3D Gaussian Splatting Support
3 participants