Repository navigation
Replies: 1 comment
|
yes we could add support for this without much trouble. fortunately the 3dgut data layout doesn't change, so it can work much like AA. the big challenge will be getting a standard PLY header comment so we can identify scenes trained with 3dgut (same issue as AA). |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hi, I have been looking into 3DGUT and the use of Unscented Transform for projecting gaussian splats, especially for non linear camera models (fisheye, distorted pinhole or rolling shutter).
Do you think this could be a realistic direction for the the engine renderer?
From what I understand, the first step could be to replace only the projection step, while keeping the rest of the pipeline unchanged (as long as the shader still outputs the same 2D cov, screen pos and depth).
If this is too specific to add directly to the engine, would it make sense to expose an API to provide a custom GSplat projection shader, similar in spirit to
gsplatModifyVS, so users could experiment with their own projection models?I would be happy to help test this on the WebGPU renderer if that is useful
All reactions