Left and Right eye Occlusion view in Unity

[ga28299]

Hi there,
Thank you for creating this plugin. I want to get the left and right eye view in the game view in unity. How do I do that? Currently I select the GaussianSplattingVR scene then add the Gaussia Splatting Camera script using add component > add the render and depth material parameters to get the one camera view of the splats.

[Peamon]

In the GaussianSplattingVR scene you already have a camera.
Just plug you XR device press play and change the Game view render mode in unity for "Occlusion Mesh".

The option is above statistic panel in this image : https://github.com/clarte53/GaussianSplattingVRViewerUnity/blob/master/performance_vr.png

[ga28299]

Hey thanks for the quick reply. Is there any way I can get the occluded view without connecting a XR device? Also my inspector after selecting the GaussianSplattingVR scene looks different from the one in the images shared. Here is how it looks:

[Peamon]

No you cannot have this view without a headset connected.

Your screen looks ok, it start like this, then you can check the 'point_cloud.ply' button to load the file but if you don't have a headset connected you will not see the gaussian splatting.

If you want to see something start with the GaussianSplattingCam scene that is a scene without headset.

[seblanc]

I'm facing the same issue, I would like to load by default a *.ply file, and make sure it is placed at the right location. Otherwise, I always end up with the wrong position/rotation of my gaussian splat.

Is there a way to display it in the scene inspector?

[Peamon]

You cannot display it in the inspector but you can deactivate "isXR" on GaussianSplattingCamera Script attached to the camera and press Play without headset connected. With this you can see the gaussian in the game view, move it in inspector and copy paste the transform.

[seblanc]

Thanks for your advice Peamon.
In GaussianSplattingCamera.cs, isXr is already equal to false:
10: public bool isXr = false;
I tested the game with isXr = false and with true, without any VR headset connected, but no Gaussian Splat is visible in the "Game" view.
Am I doing something wrong?

[Peamon]

First if you don't have done that, you have to download and copy "defaultmodel.bytes" file see Starting in the README.md

Then you need to check that "defaultmodel.bytes" is correctly referenced :

Then you have to uncheck the "isXR" on main camera :

Then you have to press Play and check the "defaultmodel.ply" checkbox (in red) and then move the object (in blue)

[Peamon]

To Load your own "ply" file when the application start you just have to add a new GameObject and put the script GaussianSplattingModel on it, like this :

[seblanc]

This is awesome, it works like a charm. Although the quality is much lower than my original splat file when visualized in other viewers, is there a way to improve the quality?

[Peamon]

check the "tex factor" parameter on GaussianSplattingCamera Script put it to 1

[tateAtBricksimple]

To Load your own "ply" file when the application start you just have to add a new GameObject and put the script GaussianSplattingModel on it, like this :

Hi, I'm attempting the same. (Adding my own splat into the GaussianSplattingVR scene by creating an empty object, giving it the GaussianSplattingModel script and assigning my .ply file path to it) but the splat does not load when I hit Play. Does the model have to placed in a specific directory or is there another step that I missed? Thank you.

[seblanc]

Hi,
In my project, the *.ply is located at the root directory (same level as the Asset folder). I'm not sure this makes a difference though. Have you tried loading another splat file to check if this not the issue?

[tateAtBricksimple]

Moved, the first .ply to the root along with a different one, the UI now populates with both, but selecting either of them does not load them. I did notice in the 'Grabable Gaussian Model' object that gets instantiated that the Model File Path is showing as ".\filename.ply". Removing the .ply's from the root has the default model appear again and that one works. I exported both .ply's from poly.cam using their Splat PLY option. I re-exported using their standard PLY but that did not work either.

[seblanc]

If the original (demo) splat ply works, it looks like your custom splat have a problem. Could it be that the origin is not well placed, thus rendering the splat in a totally different location? You can use https://playcanvas.com/supersplat/editor/ to edit your splat file and export it again.

[Peamon]

It’s also important that the splat file use spherical harmonics of degree 3. The plug-in assume that. A evolution is needed to use sh degree 1 or 2.Envoyé de mon iPhoneLe 16 août 2024 à 07:32, seblanc ***@***.***> a écrit : If the original (demo) splat ply works, it looks like your custom splat have a problem. Could it be that the origin is not well placed, thus rendering the splat in a totally different location? You can use https://playcanvas.com/supersplat/editor/ to edit your splat file and export it again. —Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you commented.Message ID: ***@***.***>

[tateAtBricksimple]

Thanks seblanc, I didn't know about this tool. No luck though. Imported the splat, the origin was right in the middle, exported and still no dice. For my .ply, how can see if my file uses spherical harmonics of degree 3?