RealityCapture to Unreal Engine 5
ฝัง
- เผยแพร่เมื่อ 2 ส.ค. 2024
- In this tutorial, you’ll learn how to process a scan in RealityCapture and use it in Unreal Engine 5 as a nanite mesh. We’ll go through every single step of the processing in RealityCapture and the setup in Unreal Engine 5.
Timestamps:
0:00 - Intro
2:40 - Detect markers and alignment
7:21 - Mesh reconstruction
10:32 - Mesh clean up
12:42 - Texturing
13:54 - Simplification
14:58 - Unwrap
15:54 - Texture reprojection
16:48 - Export
18:02 - Medieval Game Environment
18:42 - Importing the mesh to UE5
20:36 - Editing the material
22:10 - Creating a material instance
23:00 - Placing the mesh in the level
Download the dataset: www.capturingreality.com/down...
Winter Environment using RealityCapture, Quixel Mixer and Twinmotion: • Winter Environment usi...
Download RealityCapture (PPI) for FREE here: bit.ly/2sotr7h
Try it yourself with free sample datasets: bit.ly/3cRBfQp
Follow us on:
Instagram / capturingrealitycom
LinkedIn / capturing-reality
Facebook / capturingrealitycom
Twitter / realitycapture_ - ภาพยนตร์และแอนิเมชัน
Great tutorial, really enjoyed the pace of the video, very clear and easy to follow. Looking forward to applying this into my workflow.
This is great can't wait to try this out
Blender, RC, UE5 = my favorite trio
Thank you for another great tutorial. I didn't know you can generate markers within RC.
This is amazing software and an excellent tutorial!
very nice. I'm honestly stoked you managed to get such a short title ha
That was perfect! Thank you, thank you :)
This guy is the best teacher I have in my entire life.
this is crazy!
wow
You can change the poly count in the workflow>settings tab much higher than 40m limit now.
What blows my mind is that, at this pace, it will be pretty soon where just anyone will be able to make a game or movie using this technology
will stitched 360 photo/video support be added?
Does anyone know of any current companies looking for someone experienced in photoscanning and retopology or where to find work in that field for film or games?
very nice video ，thk！！！
Is there any way to use RealityCapture to scan an entire room and use it as a digital set extension in Unreal Engine 5? Do you have a recommended workflow?
What is the ad song you used to promote this video? My friend and I are making a video and we think the song is really good
Thanks, learned a bunch but will need to watch this video a few more time. Can you do a video on capturing the images required to do a model capture?
We appreciate that you like the video! Jakub also made a video about how to take images for RealityCapture. Here is the link th-cam.com/video/9e_NLp_FaUk/w-d-xo.html . Also for this particular scan you can notice the camera positions in the 3D view after the alignment. That should also give you an idea of how to scan similar objects.
how do you control the UE5 controls
to raise the view up?
Thanks for the tutorial. It's great. Did you do any post processing on the pictures before importing them into reality capture or they are jpeg direct from camera ? They seems kind of flat like if you had boosted the shadows and lowered the highlights
We appreciate that you like the tutorial! Photos were shot in RAW and then developed to JPGs. The only adjustment was lowering the highlights and raising the shadows. The images were kept with original distortion. RealityCapture estimates the parameters and undistorts them by itself.
Is there anyway to use matterports for unreal engine 5?
I've used Reality Capture for years and its the best tool for Photogrammetry... BUT.... I am migrating my development environment to Ubuntu.. This is the only tool I use that does not yet have a Linux version... Now that Unreal Engine 5 has a full Linux version, is there any chance that Reality Capture will have a Linux version as well? This would be a great market for you guys to capture!
I have a big problem. I need a scene without lumen (baked ligting) for VR performance considerations. When I build the lighting, the scanned asset turns black... It is set to static.
waait a minute, are you use updated version of RC that is not released yet? i see you merged Unreal / maya+Arnold export preset into one :)
Love that tutorial and happy to see it. Thanks
The tutorial was recorded in the latest official release, 1.2.0. 17385. This FBX preset has been there for some time now. The OBJ export presets are a little bit different so maybe that's why you noticed it :)
This has been a great video.. I just used this workflow for a new model I am making.. I have the latest version 1.2... But the export dialog is different from this one... On mine there is no section for "color layer" and "normal layer" under the "texturing settings".. Is this the latest internal build of RC that has these changes? Thanks!
Thank you for liking the video! The tutorial was recorded on the latest official release of RealityCapture 1.2, and the options for exporting color layer, normal layer, and even displacement layer was present even before. If you don't see the options check if your model has these layers. In this tutorial, the texture layers were created with the texture reprojection tool. They were projected from Model 2 to Model 3.
Your 35mm camera with 24mm prime lens is vastly better suited to photogrammetry than a typical drone/cellphone camera.
Can I get marker jpg file?
RealityCapture doesn't work with AMD drivers and Mac.... any chance in the future for more options to use this software?
Nice video. Could I offer a suggestion that could help with following the steps? Could you zoom up on the options selected? I like watching the tutorial videos on a big screen tv.
Thank you for your ideas.
Exported the 16k texture as png? That's probably like a 200mb texture lol. Great help though, I will try this out with my new drone tomorrow.
Thank you for this tutorial . Is it possible to import the Reality Capture registration (Internal / External camera parameters ) in Unreal Engine? If so what's the best way to do it?
Yes, it is possible. This is one possible option: Export the mesh from RealityCapture as an FBX. In the export options dialog, search for Camera Settings and switch Export Cameras to yes. Now there are many options for undistortion, and we have that documented in the built-in RealityCapture help, so definitely check it out. In Unreal Engine, use the Import into level option from the File menu. There are also multiple options for the import, but make sure the cameras are selected in the RootNode and it should work.
@@CapturingReality thank you for your reply, I will try :)
Awesome tutorial, thanks so much. Just where on earth did you find a 4m selfie stick? Maximum length I found is 3m. Appreciate a hint. Thanks so much 🙏
Thank you. It is not a selfie stick but camera pole, even longer can be found.
Great tutorial! I wish the UI was more intuitive. Like, why can't you add the distance information directly into RealityCapture instead of having to create a text document and load it up? It sounds like a lot of extra steps.
Any chance you can make that model available, perhaps on Sketchfab? Thanks!
We are glad you liked the tutorial, and thank you for the feedback! It is definitely possible to add the distance directly in RealityCapture. It is possible in the selected distance constraint panel. The text document was just for demonstration. Imagine you had multiple distance constraints all over the scene. In that case, it is much easier to reuse a distance definition text file instead of manually adding them in RealityCapture.
Great tutorial and there is a crucial question, at the simplification process you went down from 138m to 10m at once. Is that the best way to simplify like straight to the minimum desired or a 50% reduction till the desired polys reached is the best approach? many thnx!
Hi George, 50% incremental step is recommended one.
@@CapturingReality Any plans to add a C4D export preset?
@@georgeluna6217 If you wish we can create a feature request for it.
@@CapturingReality that’s would be awesome 🤩 !!!
If the play station 10 is ever to become a thing to exist, I’m sure that the games will look like reality.
medieval game environment not opening with UE 5.4
Ďakujeme za ďalšie super video, pre nejaké nezrovnalosti by sme mohli dať osobne už reč :), kolegyňa mána mňa mail.
Have anything for quadcopters?
If you mean tutorial there is one regarding to drones: th-cam.com/video/jxOCAr_33zA/w-d-xo.html
Is this done with video now instead of images?
Yes, you can also use a video as source data.
I dont get Normal map from exported FBX file. I have tried many times, I only get diffuse map :( can you help me to fix this problem?
Have you had enabled Normal reprojection in Simplify tool or Texture reprojection tool?
@@CapturingReality finally, I fixed the problem. I used Mesh and pointcloud.
perfect
more'
Epic :) UE5 can handle 16k textures, really? If ti's the case it's amazing as 8k is not enough for many objects.
It is also possible to use UDIMs. You don't have to use a 16K texture but export multiple 4k texture tiles and use those in Unreal. William Faucher uses UDIMs in his RealityCapture to Unreal Engine 5 tutorial, so we recommend watching it: th-cam.com/video/WrCOhes1Zgg/w-d-xo.html
@@CapturingReality Thanks for the tips, I'll look for sure!
Why do we need to have three "Tools" in the top toolbar...
Each tool is for different tab (1D, Scene 2D, Scene 3D) as it is in the video. Are you able to see those tabs?
Are you polish or something that accent seems familiar
Slovak :)
Пилите приложение для андройда
You forgot the magic word
900 images?!?!
Якуб примите меня к себе в коллектив хочу учится и работат с вами
Thanks, learned a bunch but will need to watch this video a few more time. Can you do a video on capturing the images required to do a model capture?
There is also a video how to capture images for RC in our channel (th-cam.com/video/9e_NLp_FaUk/w-d-xo.html)