thanks for the video, got my little scene to unreal too after this workflow. Any tips on model or settings for export/import, to have scene appear normal in VR? I imported to ue5 vr template but in vr-review, the splatting model seems to be non-stereo, something is off.. feels bad when looking with both eyes.
This is really good stuff. I've been trying to get a decent point cloud built in Reality capture but it always creates so many different components. Do the components have to be merged together before the PLY file is exported from Reality Capture or how is it done? I tried to look at the settings in your video and it looked like you had many separate components too.
Correct, everything needs to be merged into a single component for things to be aligned properly. In terms of your work (combining multiple cameras or views from a 360 camera), there are some tricks to making sure everything aligns like, making sure all cameras "see" the same feature at the start/end of a loop. You could even print out AprilTags that will ensure RC will recognize them as shared features across the cameras: wizardofaz.medium.com/how-to-use-my-3d-printable-apriltag-scale-markers-for-realitycapture-6e3244da050e I have a few more tricks listed out here: wizardofaz.medium.com/reality-capture-alignment-tips-fixes-d49371ee6643
when you say its trivial to have the same coordinate data for photogrammetry and g splats what do you mean? do you have the option to export either one once you import all your clips?
At 7:01 you say "If you want to use the mesh from photogrammetry but the visuals of gaussian splatting, importing them and having them be aligned at the right scale is trivial because they're based on the same alignment data, so that to me is a massive benefit." Sorry if this is a dumb question, but are you just talking about how RC is useful for alignment, or can you actually combine the mesh from RC and the splat from Postshot in some other way? Is there a way to combine them beyond alignment data?
Great tutorial, like always! Did not used PostShot a couple weeks, I see they added new option " Splat MCMC" - does it work better compare to just "Splat" ? Thank you
Why will you go on RC first if you can train the photos directly on PostShot? Can you help me understand, on RC you will need to create the model, texture, unwrap, and export, it's a large workflow just to get a 3DGS.
No, you don't need to create the model, unwrap, texture, etc. You just need to align and export. The reason you'd do that is because RC's alignment is much faster than PostShot's COLMAP. Watch the intro again.
@@AzadBalabanian I tried your process on Postshot just with Alignment and the photos, after a while on Postshot I received the message "Reach the maximum 32k' but the Gaussian result is ugly. I think the process isn't finish. I have a 4090 don't think the error is about Vram
@@markinmkn I imagine it's due to the accuracy of the alignment isn't very high? Try using the default "compute from images" setting in PostShot instead of importing RC alignment
หลายเดือนก่อน
also RC alignment success is like 10x lower than Agisoft
Depends on the data. However, I agree that Metashape can have a more robust alignment than RC's sometimes. There is also a PostShot workflow for Metashape as well. But RC is my preferred software and is now free to use
thank you for your tutorial
I have finally understood why i couldn't do it
Thanks Azad! You are always ahead in digital twins!
Massive thanks for sharing! I haven't kept up with gaussian splatting and this brings me up to speed and gets me fired up at the same time 🙏
Excellent! I was stuck on exactly what/how to export for import into Postshot.
Pretty cool workflow. Thanks for sharing.
Thank you, excellent content!
thanks, awesome tutorial!
thanks for the video, got my little scene to unreal too after this workflow.
Any tips on model or settings for export/import, to have scene appear normal in VR? I imported to ue5 vr template but in vr-review, the splatting model seems to be non-stereo, something is off.. feels bad when looking with both eyes.
This is really good stuff. I've been trying to get a decent point cloud built in Reality capture but it always creates so many different components. Do the components have to be merged together before the PLY file is exported from Reality Capture or how is it done? I tried to look at the settings in your video and it looked like you had many separate components too.
Correct, everything needs to be merged into a single component for things to be aligned properly. In terms of your work (combining multiple cameras or views from a 360 camera), there are some tricks to making sure everything aligns like, making sure all cameras "see" the same feature at the start/end of a loop. You could even print out AprilTags that will ensure RC will recognize them as shared features across the cameras: wizardofaz.medium.com/how-to-use-my-3d-printable-apriltag-scale-markers-for-realitycapture-6e3244da050e
I have a few more tricks listed out here: wizardofaz.medium.com/reality-capture-alignment-tips-fixes-d49371ee6643
when you say its trivial to have the same coordinate data for photogrammetry and g splats what do you mean? do you have the option to export either one once you import all your clips?
Thanks for your excellent tutorial! Will you share this dataset sample in youtube for downloading?
At 7:01 you say "If you want to use the mesh from photogrammetry but the visuals of gaussian splatting, importing them and having them be aligned at the right scale is trivial because they're based on the same alignment data, so that to me is a massive benefit." Sorry if this is a dumb question, but are you just talking about how RC is useful for alignment, or can you actually combine the mesh from RC and the splat from Postshot in some other way? Is there a way to combine them beyond alignment data?
certainly. You can combine them in engine and create a seemly blend of the two. See: th-cam.com/video/-cAL9zQGRVE/w-d-xo.html
Really cool tutorial and thks for the script, but I tried with nef files (Nikon Raw) and postshot don't recognize the format (need to try with jpg)
It won't work while the target is in actions from a single camera.
Great tutorial, like always! Did not used PostShot a couple weeks, I see they added new option " Splat MCMC" - does it work better compare to just "Splat" ?
Thank you
I believe that’s now the default splat model. There’s another model that focuses on density. Haven’t tried it much though.
@@AzadBalabanian Thank you
tq bro share
Veery cool, thank you
Yes please, I subscribed and am super keen to see more videos.
Your shortcuts are lightning as well.
按流程做了一遍，到postshot提示，plyreader：unexpected table size
Why will you go on RC first if you can train the photos directly on PostShot? Can you help me understand, on RC you will need to create the model, texture, unwrap, and export, it's a large workflow just to get a 3DGS.
No, you don't need to create the model, unwrap, texture, etc. You just need to align and export.
The reason you'd do that is because RC's alignment is much faster than PostShot's COLMAP. Watch the intro again.
@@AzadBalabanian Thank you for your help, did you already try that with laser scan data inside RC?
@@markinmkn I dont understand. Yes, you can process LiDAR data in RC. No, I don't think they'll work in PostShot for gaussian splatting
@@AzadBalabanian I tried your process on Postshot just with Alignment and the photos, after a while on Postshot I received the message "Reach the maximum 32k' but the Gaussian result is ugly. I think the process isn't finish. I have a 4090 don't think the error is about Vram
@@markinmkn I imagine it's due to the accuracy of the alignment isn't very high? Try using the default "compute from images" setting in PostShot instead of importing RC alignment
also RC alignment success is like 10x lower than Agisoft
Depends on the data. However, I agree that Metashape can have a more robust alignment than RC's sometimes. There is also a PostShot workflow for Metashape as well. But RC is my preferred software and is now free to use
I have 100% CPU usage and 0% GPU usage in RealityCapture1.4 alignment, here's why.