hi, i got a question .. i choosed the very low quality and it was supposed to be around 70 MB, but the final export from unity went to 400 MB .. even thou I cut out quite a lot of scene .. any idea? thx
Hello, Would you happen to know what coordinate axis is used in the .ply files? trying to get this in maya but i think the orientations are screwed and flipped, also not sure if the scale info is comming through correctly. Would you also happen to know the procedure to getting the correct base color values and opacity values of the harmonics using the ply f_dc_0 f_rest_0 values? havent found the correct formula yet, not a scientist here, just a 3d guy. ty
The axis conventions are different in all the splat files I've seen, so kinda needs manual rotation/placement and sometimes scaling too. f_dc_0/1/2 is the 0 coefficient of spherical harmonics, if you want "just the color" (RGB) then multiply those values by 0.2820948 and add 0.5. Opacity is non-linear, and needs sigmoid function applied to get 0..1 opacity value, i.e. 1.0/(1.0+exp(-value))
@@nearaz Thanks mate, thanks for confirming, i found those yesterday although i'm facing rgb values ranging from -0.1 to 1.5 after applying that formula. i clamped them now but still a bit weird. Thanks again.
It was 45 photos, 1500x2000 pixels each. I plopped them into poly.cam, no idea whether they do any additional resizing. Or what settings they use to create the Gaussian scene.
@@OlliHuttunen78 ah no, the PLY from polycam is 135MB (half a million splats). Then I do additional chunking/quantization, VQ the spherical harmonics and do BC7 compression on the color/opacity data in my unity plugin thingy. And then that becomes 7.5MB. But the quality loss is not noticeable unless you know where exactly to look :)
@@nearaz Thats apretty neat method! Is this a some sort of compression feature that you have programmed in to this Unity plugin or how can you run it to the PLY files?
@@OlliHuttunen78 I wrote about what I do here aras-p.info/blog/2023/09/13/Making-Gaussian-Splats-smaller/ and here aras-p.info/blog/2023/09/27/Making-Gaussian-Splats-more-smaller/ and yes there's a bunch of code to do all that, more or less all in this one file: github.com/aras-p/UnityGaussianSplatting/blob/main/Assets/GaussianSplatting/Scripts/Editor/GaussianSplatAssetCreator.cs Maybe I should make a C++ library or something, so that it can be used outside of Unity too :)
History is being made :)
hi, i got a question .. i choosed the very low quality and it was supposed to be around 70 MB, but the final export from unity went to 400 MB .. even thou I cut out quite a lot of scene .. any idea? thx
Hello, Would you happen to know what coordinate axis is used in the .ply files? trying to get this in maya but i think the orientations are screwed and flipped, also not sure if the scale info is comming through correctly.
Would you also happen to know the procedure to getting the correct base color values and opacity values of the harmonics using the ply f_dc_0 f_rest_0 values? havent found the correct formula yet, not a scientist here, just a 3d guy. ty
The axis conventions are different in all the splat files I've seen, so kinda needs manual rotation/placement and sometimes scaling too.
f_dc_0/1/2 is the 0 coefficient of spherical harmonics, if you want "just the color" (RGB) then multiply those values by 0.2820948 and add 0.5.
Opacity is non-linear, and needs sigmoid function applied to get 0..1 opacity value, i.e. 1.0/(1.0+exp(-value))
@@nearaz Thanks mate, thanks for confirming, i found those yesterday although i'm facing rgb values ranging from -0.1 to 1.5 after applying that formula. i clamped them now but still a bit weird. Thanks again.
Impressive! What was the resolution of the original images? Huge compression and still that quality! Well Done!
It was 45 photos, 1500x2000 pixels each. I plopped them into poly.cam, no idea whether they do any additional resizing. Or what settings they use to create the Gaussian scene.
@@nearaz Ok. So was the PLY file size 7.6Mb when you downloaded it from Polycam or did you do some compression to it?
@@OlliHuttunen78 ah no, the PLY from polycam is 135MB (half a million splats). Then I do additional chunking/quantization, VQ the spherical harmonics and do BC7 compression on the color/opacity data in my unity plugin thingy. And then that becomes 7.5MB. But the quality loss is not noticeable unless you know where exactly to look :)
@@nearaz Thats apretty neat method! Is this a some sort of compression feature that you have programmed in to this Unity plugin or how can you run it to the PLY files?
@@OlliHuttunen78 I wrote about what I do here aras-p.info/blog/2023/09/13/Making-Gaussian-Splats-smaller/ and here aras-p.info/blog/2023/09/27/Making-Gaussian-Splats-more-smaller/ and yes there's a bunch of code to do all that, more or less all in this one file: github.com/aras-p/UnityGaussianSplatting/blob/main/Assets/GaussianSplatting/Scripts/Editor/GaussianSplatAssetCreator.cs Maybe I should make a C++ library or something, so that it can be used outside of Unity too :)
newbee
Awesome bro! What's the fps in this demo?
This is a very simple scene (about 300 thousand splats), and on RTX 3080Ti at 1080p resolution runs at about 250 FPS.
Hi, that is super impressive! I want to ask you some things. How can I contact you?