Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GaussianSplat Asset for Unity with configurable quality vs size options #3

Merged
merged 36 commits into from
Sep 14, 2023
Merged

GaussianSplat Asset for Unity with configurable quality vs size options #3

merged 36 commits into from
Sep 14, 2023

Conversation

aras-p
Copy link
Owner

@aras-p aras-p commented Sep 13, 2023 •
edited
Loading

  • Does not render/load the PLY file directly, but rather works on "Gaussian Splat" asset.
  • The asset has controls over size vs quality, see blog post
  • Now renders outside of play mode too

@aras-p
Editor: tweak FolderPicker drawer to be usable outside of SerializedP…
8773aee 
…roperty
@aras-p
Initial work towards GaussianSplatAsset
d286e30
@aras-p
Rework the whole thing to operate on a GaussianSplatAsset instead of …
97fa21f 
…direct ply file

The data is put into a bunch of textures, with intent that we
can change their formats sometime really soon, to take up
less space
@aras-p
Asset textures are now saved as .exr files
d7666da
@aras-p
Semi-automated tool to validate against some template images
29de1cd
@aras-p
Morton reorder splats when creating the asset
1fb898a
@aras-p
Calculate chunk data bounds
1481e98
@aras-p
Make all data be in 0..1 range relative to chunk bounds
16dc219
@aras-p
Store rotations as "smallest three plus index" format
bc4c869 
Would be suitable for e.g. 10.10.10.2 if only Unity supported that for texture importer :/
@aras-p
Calculate RMSE/PSNR in the validator
c11bc45
@aras-p
Parallelize some asset data prep parts, fixed overall bounds calc
978d5f2
@aras-p
Make asset inspector deal with null textures
c73f7d0
@aras-p
Instead of writing out .exrs, write raw data bytes with a tiny custom…
2adc1a3 
… importer

I was hoping that this would allow working around the issue that texture
importer in Unity does not allow to pick RGB10A2 format.

But turns out... Unity (at least 2022.3) just flat out refuses to allow
you to use RGB10A2 format, even if the enum exists.
@aras-p
Add format options for RGB565, BC7, BC1
bd86fae
@aras-p
Fixup data display visualization
f207805
@aras-p
Fix RGB565 packing
7d9ab98
@aras-p
Order data within textures in 16x16 tiles, within tile in morton order
0733b77
@aras-p
Opacity tends to be clustered close to 0 or close to 1, so transform …
7ca88cb 
…that to be slightly more evenly spread

PSNR +1.5 when color+op is RGBA8 (44.8->46.4), +4.0 when color+op is BC7 (30.3->34.3)
@aras-p
Transform scale to be more uniformly distributed
61c71b9
@aras-p
Add data options for 11.10.11 and 10.10.10.2 encodings within 4 byte …
a2a7f35 
…uint
@aras-p
Tweak compression quality presets and indicate input/output size in t…
3b0f2b8 
…he asset creator tool UI
@aras-p
Tweak validator a bit
5389c6f
@aras-p
Use float4 temporary data for everything while cooking
ba4e107 
Fixes Unity saying "nope can't use RGB Float" when on Metal
@aras-p
Default to medium quality, better guard against null assets
2f94c70
@aras-p
Use DXC compiler when on Metal/Vulkan
daa2238 
On Metal quite a bit faster!
@aras-p
Update scene
b845670
@aras-p
Validator: guard against missing ref image
36c0e98
@aras-p
Store the same min/max for all SH bands inside each chunk
26cb53d 
Saves 336 bytes per chunk, quality pretty much the same
@aras-p
Burst settings json for Mac
f94a818
@aras-p
Make splats render outside of play mode too
ec0b31b
@aras-p
Merge branch 'main' into splat-asset
cd69845 
# Conflicts:
#	readme.md
@aras-p aras-p merged commit 51b4100 into main Sep 14, 2023
dylanebert pushed a commit to dylanebert/UnityGaussianSplatting that referenced this pull request Oct 13, 2023
@aras-p
Merge pull request aras-p#3 from aras-p/splat-asset
2630267 
GaussianSplat Asset for Unity with configurable quality vs size options
@aras-p aras-p deleted the splat-asset branch October 17, 2023 11:03
@zhenglin1991 zhenglin1991 mentioned this pull request Oct 30, 2023
Closed
HIHHIYAYAYOO pushed a commit to HIHHIYAYAYOO/UnityGaussianSplatting that referenced this pull request Nov 30, 2023
@aras-p
Merge pull request aras-p#3 from aras-p/splat-asset
0a3e636 
GaussianSplat Asset for Unity with configurable quality vs size options
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
1 participant
@aras-p