Man I love that Olli really focuses on GS and not everything random. It makes your expertise in this matter that much deeper than any other youtube channel I've watched on this matter
Thanks Olli, I've been trying to make video edits using gaussian splats recently, so this is awesome. Right now I'm using Polycam -> UE5 -> Davinci Resolve, but i will check this out!
Thanks Olli, I've liked and subscribed :) Been experimenting with photogrammetry for about seven years and heard of neRF a few years ago. Now with the advancements of GS and development of tools like the one you're showcasing in this video, I'm ready to finally start experimenting with GS and neRF!
Thank you for the tutorial! Question, does in teed to be a RTX Card? I have the 3070 ti and the Jawset crushes on start telling "No suitable display device found"
Hey Olli great video! Do you know if Postshot works with 360 camera footage directly or do you still need to break the 360 footage down into single frames before import into Postshot?
Postshot does not yet support 360 images. But there are several requests for it on postshot's discord. Perhaps Jascha who is the developer of this software will add this feature in it in the future.
Hi Olli, thanks for the video! Question: Seems you are running PS on a MAC using parallels or a similar virtual machine, right? How can PS run without a Nvidia GPU?
No. I am using PC with Windows 11 and I have Nvidias RTX 3070. Although It would be nice to see how Postshot would run on those Apple Silicon M3 or M4 chips. Hope that someone creates a solution soon for MAC also.
Hi Olli, huge big up for the work you bring up on your channel! This software seems to be game changer for Gaussian Splatting but, i have a question : is there any possibility to convert the PLY you extract into a 3d mesh? Maybe with reality capture?
Thank you. I doubt that a splat PLY file could easily be converted to a 3D mesh file. But it would be great and practical. And if it could still be done without uploading the file to the cloud service.
Hinolli, Great Video. How long does the training take on your machine and are the results the same as with the older method? I mean quality wise. Does it provide a plug-in for AE or is there another kind of link between the Programms. Thanks… Kai
If I let the training progress go to the 30K iterations, it can take from 25 minutes to 30 minutes. I have an RTX 3070 graphics card with 8Mb vram memory. So the time is practically the same as before with Inria's original source code. The After Effect plugin comes with the Postshot installation. It's very simple. You can launch the Postshot application through it.
Hi Olli, Have you tried the latest version is 0.2? Did you have any problems with that. I download it today and I’m getting lots of crashes when loading image sequences. It only worked one out of 10 for me and then it crashed while doing the camera tracking. 😕
Thanks a lot for the video Olli! I have to try it out, now the only thing missing is a webview that lets one upload and embed models on a website! is there already a solution for that?
Yes. You should try Spline. In Spline editor you can import PLY file and create your own web viewer with that. And it is very easy to embed your web pages.
Unfotunately you cannot do FBX model out from Gaussian Splatting models. GS models are like volume models. They are formed from point clouds. They are not surface models which are formed from polygons. FBX are surface models.
@@OlliHuttunen78 But I've seen some scene in UE5 and they look like 3d scenes with textures. I export .ply to Blender 3.6 just nativley it's looks like points and then to c4d in alembic to create volume mesh. But do not understand how to transfer textures. As I understand there is no textures, but some plates (splats) maybe I can bake it somehow to UV ?
but there is no UV... Unreal and Unity run it like ply format? Donwloading UE to check this out. I just trying to generate AI 360 images from AI tool ComfyUI and then make Nurf from it to get 3d model ... ))
There is one way. If you make your model in Luma AI service. It will mainly now create a Gaussian Splatting model. But it generates also the surface model out from it. You can download it in GLP and open it in blender with textures. But it will loose all transparent and reflective qualities that you might have on your model. And the mesh structure is quite bad. It is very broken and might have lot if holes in it. But it is one way.
THIS IS INCREDIBLE! I've been very closely watching the development of gaussian splats since I first heard about them late summer last year. I somehow missed this video (because I've seen your others). I'm aware of at least one dev working to capture volumes of actions, and exporting animated splats (it's actually volumetric video - or 6DOF video). Are you aware of any devs or tools/plugins that can take a series of videos from cameras arranged to capture a volume and able to export an animated splat that you can view in a vr headset? ALSO - are there any viewers that you're aware of that are available for public consumption to allow for viewing these static splats (much less viewing the animated ones)?
It varies a lot. Depending on if you let the training progress to the end up to the 30K iteration step, the PLY files can be over 900Mb, but if you calculate some single object from which you crop the environment off, the file size can be something more convenient than, for example, 25Mb.
I tried to generate 3dgs with postshot and I am not satisfied with the processing speed and the result. I used a recording of a path through the forest about 50 m long. I used the photos I took with the Pix4d photogrammetry software. I uploaded about 500 photos for processing. The spread was supposed to last 9 hours. I stopped the process.Later I only took 50 photos and I was done in 2 hours, but I got a huge cloud of points rather blurry. My cpu is i9 11th generation and gpu rtx 3070ti, RAM 64GB
Yes it is with Spline service. You can upload PLY file into spline and create your own web viewer with it. Of course it is not as simple to create as in Luma AI but you have much more control how users can rotate and watch your model and it is very simple to link or embed to your webpages.
Sure. You can import as many images you want. But it of course takes more time to process them. Check out my other videp where I explained this more detailed: th-cam.com/video/pfCZeJHfjVs/w-d-xo.htmlsi=NYBmOa7HF6j4YQ63
Not very well. There is only one unofficial addon in github wich can read Gaussian Splatting PLY in Blender. It is very slow and runs with cycles engine.
Installation comes with the after effects plugin. Go check the effects in AE and search effect called postshot. Then you just load with it the .psth file that you have trained in Postshot program.
I've tried to install the Beta-Version of postshot; it crashed at the installation. I don't know why.... I've tried it many times, but it crashed...so sad...what am i doing wrong??
Man I love that Olli really focuses on GS and not everything random. It makes your expertise in this matter that much deeper than any other youtube channel I've watched on this matter
I was waiting for something like this, thanks for the video !
I'm amazed by this software and want to install it when I get home 🙌🏼👍🏻
I am blown away. How have I missed the conversation on this topic? Great video.
Top notch, as always. Thank you Olli! Greetings to Finland.
Thank you for your consistently great work and contribution to the community Olli
Thanks Olli, I've been trying to make video edits using gaussian splats recently, so this is awesome.
Right now I'm using Polycam -> UE5 -> Davinci Resolve, but i will check this out!
Thanks a lot Olli for this video! I know what I'm going to do this evening.
V-Ray 7 can now use and render G-splats which in an incredible way to get sight context into your 3D scenes
Thanks Olli, I've liked and subscribed :)
Been experimenting with photogrammetry for about seven years and heard of neRF a few years ago. Now with the advancements of GS and development of tools like the one you're showcasing in this video, I'm ready to finally start experimenting with GS and neRF!
This software is amazing and very easy to use! It saved me a lot of work time. Thank you so much for your videos, they are helping me a lot!
Just came across your channel, love your work.
Thank you for the tutorial!
Question, does in teed to be a RTX Card? I have the 3070 ti and the Jawset crushes on start telling "No suitable display device found"
Kitos Olli. once again you bring us geat value and insperation!1
thanks man! that was very helpful. keep going! :)
Hey Olli great video! Do you know if Postshot works with 360 camera footage directly or do you still need to break the 360 footage down into single frames before import into Postshot?
Postshot does not yet support 360 images. But there are several requests for it on postshot's discord. Perhaps Jascha who is the developer of this software will add this feature in it in the future.
@@OlliHuttunen78 Great. Thanks for the update Olli! Much appreciated.....keep up making great and insightful vids:)
Thanks for the video, the new era of 3d models is aweson, i gonna to create a loot of things em medical care
Hi Olli, thanks for the video! Question: Seems you are running PS on a MAC using parallels or a similar virtual machine, right? How can PS run without a Nvidia GPU?
No. I am using PC with Windows 11 and I have Nvidias RTX 3070. Although It would be nice to see how Postshot would run on those Apple Silicon M3 or M4 chips. Hope that someone creates a solution soon for MAC also.
@ thanks for the quick reply! I also hope for a MAC solution…
great stuff!
Great video!
Thanks for sharing!
You should be able to embed hotspot within the render. Point and click advertisements.
Hi Olli, huge big up for the work you bring up on your channel! This software seems to be game changer for Gaussian Splatting but, i have a question : is there any possibility to convert the PLY you extract into a 3d mesh? Maybe with reality capture?
Thank you. I doubt that a splat PLY file could easily be converted to a 3D mesh file. But it would be great and practical. And if it could still be done without uploading the file to the cloud service.
Hi!! Nice Video! One question, can I export a splat .ply using Postshot?
Yes you can.
Hinolli,
Great Video. How long does the training take on your machine and are the results the same as with the older method? I mean quality wise.
Does it provide a plug-in for AE or is there another kind of link between the Programms.
Thanks…
Kai
If I let the training progress go to the 30K iterations, it can take from 25 minutes to 30 minutes. I have an RTX 3070 graphics card with 8Mb vram memory. So the time is practically the same as before with Inria's original source code. The After Effect plugin comes with the Postshot installation. It's very simple. You can launch the Postshot application through it.
Hi Olli,
Have you tried the latest version is 0.2? Did you have any problems with that. I download it today and I’m getting lots of crashes when loading image sequences. It only worked one out of 10 for me and then it crashed while doing the camera tracking. 😕
Thanks a lot for the video Olli! I have to try it out, now the only thing missing is a webview that lets one upload and embed models on a website! is there already a solution for that?
Yes. You should try Spline. In Spline editor you can import PLY file and create your own web viewer with that. And it is very easy to embed your web pages.
Wow, such good news 🎉❤
Can not figure out how to make textured FBX mesh at the end...
Unfotunately you cannot do FBX model out from Gaussian Splatting models. GS models are like volume models. They are formed from point clouds. They are not surface models which are formed from polygons. FBX are surface models.
@@OlliHuttunen78 But I've seen some scene in UE5 and they look like 3d scenes with textures. I export .ply to Blender 3.6 just nativley it's looks like points and then to c4d in alembic to create volume mesh. But do not understand how to transfer textures. As I understand there is no textures, but some plates (splats) maybe I can bake it somehow to UV ?
but there is no UV... Unreal and Unity run it like ply format? Donwloading UE to check this out. I just trying to generate AI 360 images from AI tool ComfyUI and then make Nurf from it to get 3d model ... ))
There is one way. If you make your model in Luma AI service. It will mainly now create a Gaussian Splatting model. But it generates also the surface model out from it. You can download it in GLP and open it in blender with textures. But it will loose all transparent and reflective qualities that you might have on your model. And the mesh structure is quite bad. It is very broken and might have lot if holes in it. But it is one way.
thank you for your videos! :)
THIS IS INCREDIBLE! I've been very closely watching the development of gaussian splats since I first heard about them late summer last year. I somehow missed this video (because I've seen your others). I'm aware of at least one dev working to capture volumes of actions, and exporting animated splats (it's actually volumetric video - or 6DOF video). Are you aware of any devs or tools/plugins that can take a series of videos from cameras arranged to capture a volume and able to export an animated splat that you can view in a vr headset?
ALSO - are there any viewers that you're aware of that are available for public consumption to allow for viewing these static splats (much less viewing the animated ones)?
Thank you Olli!!!
This is very timely
How big are the ply files on average?
It varies a lot. Depending on if you let the training progress to the end up to the 30K iteration step, the PLY files can be over 900Mb, but if you calculate some single object from which you crop the environment off, the file size can be something more convenient than, for example, 25Mb.
But how is pbr working on gaussians??
Could you have put the text behind rhe bench in that After Effects scene?
💯👏🏻👏🏻👏🏻😲🙌🏼👍🏻🍾🥂🌟🎉✨️thanks
What is the best method or tech, or software to relight a scene?
About how much VRAM does it use for a given resolution? Have you /when have you run into a VRAM limit?
I tried to generate 3dgs with postshot and I am not satisfied with the processing speed and the result. I used a recording of a path through the forest about 50 m long. I used the photos I took with the Pix4d photogrammetry software. I uploaded about 500 photos for processing. The spread was supposed to last 9 hours. I stopped the process.Later I only took 50 photos and I was done in 2 hours, but I got a huge cloud of points rather blurry. My cpu is i9 11th generation and gpu rtx 3070ti, RAM 64GB
Question for you! How do you know if it is working/broken? Mine has been running 45 minutes and displays nothing.
Is it possible to create web based interactive 3d scenes with Postshot as you would with Luma AI?
Yes it is with Spline service. You can upload PLY file into spline and create your own web viewer with it. Of course it is not as simple to create as in Luma AI but you have much more control how users can rotate and watch your model and it is very simple to link or embed to your webpages.
@@OlliHuttunen78 do you have tutorial about self hosting splat with spline?
@@dekahobbyPerhaps I could make a video about that process. It is good idea.
@@OlliHuttunen78 many thanks...
Have you messed with Splat Density or MaxFeaturesPerFrame? Any data?
U should make a video on how to use it in after effects
does it work on linux with proton and enabled NVAPI?
He did not send verification e-mail to register in Photoshot.
is the maximum image I can import is of total of 133 only? Can it be greater than that?
Sure. You can import as many images you want. But it of course takes more time to process them. Check out my other videp where I explained this more detailed: th-cam.com/video/pfCZeJHfjVs/w-d-xo.htmlsi=NYBmOa7HF6j4YQ63
Is it possible to convert the gaussian splat to 3D mesh like obj or fbx ?
Thanks for the video.
can we import this in blender 3d software?
Not very well. There is only one unofficial addon in github wich can read Gaussian Splatting PLY in Blender. It is very slow and runs with cycles engine.
How can you import it into after effects? Don't see any option to do so
Installation comes with the after effects plugin. Go check the effects in AE and search effect called postshot. Then you just load with it the .psth file that you have trained in Postshot program.
thanks so much. you are definitely one of my spatial gurus ...got any msg boards or discord channels that focus on this?
Bravoo!
it can take Sora video as input and be used as text to 3D which is awesome
Muchas gracias!
I've tried to install the Beta-Version of postshot; it crashed at the installation. I don't know why.... I've tried it many times, but it crashed...so sad...what am i doing wrong??
i faced the same problem, after that , i clean my c drive using ccleaner , all works well .
Is it possible to create 3D mesh from this point cloud?
Not in Postshot but you should check out Kiri Engine app new feature where you are able to create mesh from Gaussian Splatting model.
Unfortunately, that only seems to work nvidia GPUs.
Can this be converted to meshes?
No. Not at least with this program but Kiri engine has new feature that can convert Gaussian Splatting to mesh. Check that out.
@@OlliHuttunen78 I bet Mesh Lab could convert these...
@@eddiej.l.christian6754 I'm not sure is Mesh Lab able to open Gaussian Splatting PLY files, but it is worth to try. Tell me if it possible.
thankyou
Tq bro ..i m testing now
Doest work with AMD graphics card
Hum... now we can use a bad rendering sequence with 260 frames, like your blender scene, and created a radiance virtual viewer in this software!
Thankyou