Blender tracking tutorial: Add 3d buildings to Live action Footage
ฝัง
- เผยแพร่เมื่อ 20 ก.ย. 2024
- CityBuilder 3D on Blendermarket: www.blendermar...
Our Patreon: / lightarchitect
In this video I show how to 3d track your live action footage in Blender and then recreate the lighting in Blender so that you can add cgi to over your footage in compositing! Part two in After Effects coming soon! Let us know what you would like to see next!
Drone footage link: pixabay.com/vi...
Our Blender Add-ons:
Ultimate Blender add-on value pack: www.blendermar...
CityBuilder3D: www.blendermar...
KHAOS (Ultimate Explosion/Destruction Add-on): www.blendermar...
Spyderfy: www.blendermar...\
Nature/Creature add-on bundle: www.blendermar...
WeatherFX: www.blendermar...
Cablecam (Cinematic movement rig): www.blendermar...
LightArchitect (Film setup previsualization): www.blendermar...
KHAOS Fire Shader: blendermarket....
Create custom cities in Blender 3d with over 55 professional 3d assets packed into a single user friendly add-on! Designed by 3d artists in Hollywood, the CityBuilder add-on and 3d asset database allows you to add over 55 various 3d modeled and textured building assets to your 3d scene with the click of a button! Enhance your 3d art and visual effects work using these professional assets packed into a great add-on with ease.The CityBuilder 3d add-on and asset database includes four differently themed kits for your 3d art and visual effects. With 15 3d assets in each kit there are great options of buildings to choose from. Choose between Metropolitan, Derelict Future, and Cyberpunk Clean Future cityscape assets to enhancing your world. Built for an established platform! Blender 3D!The CityBuilder add-on and 3d asset database is designed to be integrated with the powerful and tested software Blender 3d! Materials are optimized to work with the realistic Cycles rendering engine but are also compatible with Eevee realtime rendering!Performance Note: Citybuilder contains detailed 3d models and materials. Because of this the performance of your computer while using multiple 3d assets can vary. For your reference all of the projects in our promotional trailer were created on a 2017 Macbook Pro with 16gb RAM and an Intel HD Graphics 630 1536 MB graphics card.
CityBuilder 3D on Blendermarket: www.blendermarket.com/products/citybuilder-3d
In this video I show how to 3d track your live action footage in Blender and then recreate the lighting in Blender so that you can add cgi to over your footage in compositing! Part two in After Effects coming soon! Let us know what you would like to see next!
Our Blender Add-ons:
Ultimate Blender add-on value pack: www.blendermarket.com/products/add-on-value-pack-citybuilder3dkhaoslightarchitectcablecam-bundle
KHAOS (Ultimate Explosion Add-on): www.blendermarket.com/products/khaos-ultimate-explosion-simulator
CityBuilder3D: www.blendermarket.com/products/citybuilder-3d
Cablecam (Cinematic movement rig): www.blendermarket.com/products/cablecam-cinematic-camera-movement-rig
LightArchitect (Film setup previsualization): www.blendermarket.com/products/lightarchitect---filmmaking-add-on
KHAOS Fire Shader: blendermarket.com/products/khaos-fire-shader-fire-shading-simplified
14:06 it's baffling how many times the English language allows you to say "go ahead and..." In a single sentence whilst making perfect sense
bro said go ahead so many times I dont even know what he was talking about 💀 💀
I'm going to "go ahead" and give this video a like.
Haha good choice of wording here Jo Boo!
Wow. Great skills and well explained.
All I can say is that 3D animation and design is one of the most complicated creative fields ever. It combines many arts together.
Thank you! Glad you find it useful! Definitely both creative and technical when it comes to doing visual effects work. And this is just a basic effects the sky is the limit.
His new word..."Compositing"..I love it..great tutorial!
Hahaha thank you!
Love your tuts.... I'm new to blender... but started with Maya for 5 years and 12 years with C4D... thank you... many blessings...
thankyou so much really appreciate that you did the comping in Blender ..thanks a lot again...
You are welcome! Thanks for the comment!
The clearest blender tracking tutorial at all. Thank you so much!
Awesome! Glad you found it useful! We'd love for you to check out our new Add-on trailer if you like: th-cam.com/video/YiQfwX20mag/w-d-xo.htmlsi=5H0k87cwuINncxW1
Thank you for explaining the whole process how to do this in Blender!
You got it! Glad you found it useful!
Dude at the starting of the video that was a good rap
Hahaha. Unintentional rap.
You taught me 3D tracking in blender!
Awesome! That's an important step!
I was searching a video like this in the youtube but I got nothing before watching this thanks
You are welcome! Glad it helped!
The best and clearest camera tracking tutorial. Thanks✌
Thanks Vahid! Glad it is helpful!
thankyou for publishing this video, I needed this very badly and the video I working on is pretty the same as yours in-camera motion. thank you once again
You are welcome! Glad you are finding it useful! -Brad
This really helped me understand motion tracking a lot more! Thanks for explaining what your doing along the way!
You are welcome! Let us know what you would like to see next!
Best tracking tutorial ever! Thanks for going through everything in such deetail!
Thanks Jon!
Thanks for showing this very helpfull tracking tutorial and happy blending with blender.
Thank you! Glad you found it helpful!
Bro this was the BEST live action motion track tutorial video I’ve ever seen! Thank you so much! You got yourself a new sub! Hope to see more on live action 3D compositions. All the other big VFX creators makes it so complicated :/
Keep up it champ!!
Thanks Kristoffer! Glad it was useful! I may have to follow it myself if I forget my own steps so glad its comprehensible haha.
@@LightArchitect haha same. I have my self always going back to tutorials like this even tho I’ve done it multiple times xD. At least now I know which tutorial I’ll go too ;)
@@Kristoffer_Amundsen Haha well thank you!
Thanks bro... It was very helpful vdeo..... Good explaining...
Thanks! Glad it was useful!
What I learnt from experts related to motion tracking in blender is to make them separate images and add as image sequence rather than single video.
Interesting. That may help with file errors or something. Didn't know that though. Thanks for the comment!
Downsampling the video can help too if you don't have a highend setup.
@@mikelittlenz Good point. That could decrease the amount of data that you could use as points though I think. But as long as you didn't do it too much.
@@LightArchitect Yeah it definitely can you are right, but I've successfully used lately where there are nice high contrast tracking points.
@@mikelittlenz Yes I can definitely see that working without any problem!
Super useful tutorial! Thanks for sharing!
You are welcome!
I like the subject of the tutorial and examples. Thank you for making it.
As the person making the video you do not have to keep saying : " anyways this video is getting a bit too long.." etc.
As the voluntary viewer I don't care (or even know) that it feels longer than something. I will stay interested if it is giving the info I want.
Repeatedly announcing how long it is just introduces doubt in my mind about your skills [If he thinks his time management is wrong what else is incorrect?] but I have picked the video to hopefully pick up some of your skills.
Your upset about duration can be received by the audience as you being impatient with having to even make the video . And of course you don't have to. I am just glad you have made it cuz at MY end: FREE USEFUL TUTORIAL YAY! Take all the time you need to share with me. And thanks for the gift , essentially.
I can hit pause.
I can see if 1.25X speed is better for me.
If I miss something I can rewind.
I suggest this: ditch ALL efforts to ever alert me to how long the video is SUPPOSED to be.
(does TH-cam criticize the length for some reason? honest question not rhetorical)
and concentrate on making sure you present the specific reasons you take the actions you do, what they accomplish and the exact methods for achieving the well-indicated goals. Don't hurry to do each step. Let each next step be clear and imagine people [me] don't know what's next at each step.
It can seem to you that you are going too slow. Don't worry about that cuz I'm not.
Last comment: the music.
Not necessary OR pick an easy groove that is not DRIVING the speed in any way [again for above reasons].
Pleasant non-hurried tempo LOW level music maybe(?) but frankly just not necessaryespecially if it obscures the words that need to be heard.
Hey Craig,
Thanks for the detailed input! Will keep this in mind for future videos. I do need to find a new music track soon. Been using the same one a bit much. Thanks for watching!
The only vedio that explained it very well, thanks alot dude.
Thank you! Glad to help!
Such a clear and easy explanation!
Thank you!
You are a legend, you helped a lot and you explained it really great!
Thanks Vijayalakshmi! Glad it was useful!
This is my first time seeing one of your tutorials. I subscribed. By this time next year, I plan to be able to figure things out on my own, but I am not afraid of looking for help until I get to that level.
Awesome! Thanks for the support! Even after many years of experience I look up lots of tutorials myself. Great way to learn new concepts plus things are always changing! Happy Blending!
Very nicely explained! Awesome assets as well.
Thank you!
This is so helpful..
Thanks.. subscribed
You are welcome Thanuja! Thank you for watching!
Thank you so much. I did it.
Awesome! Glad to help out!
Thank you so much!!! i've been making a few tracking videos and this video helped a lot!!
You are welcome AVA VFX. Tracking can be tricky but really fun once you get it down.
Dude, you're insane!
:D:D Thank you? I think lol.
beautiful work bro very informative. Thanks
Thanks for taking the time to comment John!
Awesome thanks man
You are welcome! Thanks for watching!
Super Tutorial!!
Thank you Mahiran! Appreciate the support!
So useful!
Thank you!
i subbed the tutorial is great
Thank you! We appreciate your support and feedback!
Awesome bro subscribed
Thank you! Glad you find it useful!
@@LightArchitect these tutorialls are not useful, these are gold, thanks to you for putting lot of effort and making these, soon i ll make video based on this tutorial then i ll tag you on instagram 😁
@@francsharma7276 Awesome! We'll l keep an eye out for it! Thank you again!
Thanks for the lesson. Just brought soft soft
Interesting video thank you.
For sure! Glad you find it useful!
nice rap 00:08 - 00:17
Haha thank you.
Dude you are a saint!!!!!!!!!!
Lol glad to help!
Love the intro 😂💯
Thank you!
my background doesent show up in rendered view mode only where the floor is an than when i click f12 it doesent show up at all followed everystep it does show in solid an material preview mode tho only difference i did was use text instead of a building
awesome tutorial.. tys m
You're welcome! Thanks for watching!
4 k likes absolutely SHREDDING
Thanks! This is our top watched video. Should we do a collab?! :D
@@LightArchitectdamn she really ghosted you
@@DumPixels :D :D :D Apparently!
Thank you broooooo
You are welcome Signal! Thanks for watching!
Amazing ♡
Thank you Dodo! Lots more VFX content coming soon!
Please make an animated tutorial on building a house using 3ds max or blender.
Great idea!
Would it be easier and more accurate to take the motion tracking data from a different program and bring it into Blender? I see you are placing trackers individually and are required to place 8...but After Effects does this step autonomously and can give you 100 or more trackers...what do you think?
Hi DPLawlorFilms. You can do both. Last time I checked Blender's 3d motion tracker seemed a bit more advanced than After Effects. You can automate this process in Blender as well by using the "detect features" option and then cleaning up the track. It's not as fast and easy as After Effects but when it comes to really advanced matchmoves a 3d software is generally a better route. Hope this helps. -Brad
I try Track many yellow/red point but very bad. deleted. I am frustration. I wish should use vive tracker with base station plugin to blender.
it is way easier if you do the 8 tracking points manually
Fair enough. Depends on the shot I suppose.
nice tutorial.. thanks :-) ... watch the music levels.. too loud = too distracting..
You are welcome. Noted for the future.
The tutorial was great but the dramatic music made me really anxious hahaha
The level of detail almost makes the intrusive background music forgivable.
hahaha thanks...I think?
@@LightArchitect Heh. I did think the background music was annoyingly intrusive, but you that's just my opinion. The video was still very good. It's rare to see Blender videos that either cover the entirety of a given topic *or* go into much detail-if any-about relevant options, settings, or reasoning behind any decisions, and you did both. I haven't watched any of your other videos yet, but if they're anywhere near as informative as this one, I'd definitely recommend you over the endless guff that Andrew Price from the Blender Guru channel knocks out.
On the strength of this one video alone, you've earned my sub. 😉
22:30 you can see where your shadow abruptly ends. Do you if there is a way to prevent the abrupt end and have it more of a feathered edge?
Good video, making tutorials isn't easy.
The reason the shadow abruptly ends is because the shadow catcher plane ends. So in order to extend it and make it softer I would increase the size of the shadow catcher plane and perhaps model it more accurately to the geometry of the environment. Then probably I would roto the ground on the top of the hill and feather that mask for a smoother falloff and feathered edge. Hope that makes sense. And thanks!
@@LightArchitect Awesome :) Thank you for the reply.
Keep making great content and tutorial videos.
@@dislikecounter6392 You're welcome. Lots more coming soon! And perhaps some heavy vfx shorts coming this year too!
Thank you so much for sharing and very well explained!
May I ask, what if the floor of my footage is reflective, how to make reflection of the 3D object on the floor?
Thanks Wang da-wei! Good question. We have a few tutorials on this subject actually.
Reflective Surface Short Version: th-cam.com/video/duf4mwXt2YQ/w-d-xo.html
Reflective Surface Long Version: th-cam.com/video/HK4qj3A7IZM/w-d-xo.html
Let us know if you have any more questions.
Thanks! This is great.. Why scale the building down? Instead of scaling the scene up? This way all assets merge in correctly.
Hey Mike thanks for the comment. I think scaling the scene up like you said is probably better. Still the same end result but with a more complex scene scaling the building up could be more time consuming. -Brad
I was wondering the same thing. What if you have a development that includes more than one building + some site model. Also, the light may react a bit differently with a tiny model versus real-world size. Still, great tutorial!
@@acadgatsu I'm 99% sure it doesn''t "react" any differently. Light falls off at the same rate no matter what the scale.
@@mikegentile13 I was just thinking with the inverse square law for light. It would light a model slightly differently at full scale versus say 5% of the real scale. But not tested so I can be wrong.
@@acadgatsu technically it would be the same. However in the renderer it could be slightly different due to rounding.
Nice tutorial. The music is a bit grating though
Thanks. Appreciate the feedback.
my problem is, I see the Video only in solid and material view. In the Rendered View I only see my Object
If you followed the steps in this video you will only see the composite with the video when you render out an image. The background won't show up in the blender preview render though.
I struggled with this problem too and here is the answer: Render Properties / Film / Transparent
@@olgademidova177 You just save me
when I put it to render some frames the image does not appear, how to solve it?
Great tut! But I had a problem: I tracked a mountain scene and added a castle on it. I exported the castle and shadow in order to do a composition in AE. In Blender it worked perfectly, but when I played it in AE, There was a shift between background video and castle export. However I took attention to make the same fps in each software and the 2 sequences have the exact same duration. Do somebody have an idea about it?
Hey Vi Design, Thanks for the kind words. I struggled with this same problem before but the solution is super easy. When you import your exported sequence into after effects the frame rate by default in that sequence is usually 30fps(even if you export at 24fps in blender). You need to change the frame rate of the imported sequence to whatever the frame rate of your footage is that you are adding your element to. To do this right click on the imported sequence and click on "interpret footage"-->"Main" and then change your frame rate.
Hope this helps!
Brad
@@LightArchitect oh thank you, this is working!!
Amazing content. I have two questions (maybe not related to this Blender 3d), what microphone are you using and will a 2GB Nvidia Graphics Card be enough to animate in Blender (animate basically meaning working with blender and all its features). Thank You.
Hi Moses,
The mic I used to record this video is a basic Insignia USB microphone. Model #NS-CBM19 . As far as your graphics card question goes 2GB should be enough for most features. When it comes to simulation and heavy scenes with lots of data it could slow but I have 4GB in my graphics card and it works pretty well. Obviously the more maxed out your specs are the more crazy graphics and simulation you can do/render.
as far as HDRI lighting I would output a single frame from the video use it to drive an emissive texture and bake an HDRI... my 2 cents...
Everyone is at the beggining.
how can I make a 3D object appear behind a video clip, If the house was behind a fence.
You would have to find a way to mask out the fence. You could use rotoscoping or create a holdout layer of the fence inside of Blender. I usually just animate a mask inside of After Effects. Hope this helps!
can you make a Reflection catcher tutorial in the future?
Great idea! I'll see what I can do!
@@LightArchitect Awesome!
Thank you!!!! which music is this? give me link plz
I think it is called Archtype. I got it from a royalty free site but can't find the link.
@@LightArchitect Thanks
casual 101 k views slayyyyyyyyy
DM us for a collab! Maybe we can add some butterflies or birds too a 2.5d photo of yours utilizing our Spyderfy add-on. We would be glad to connect. And you could show the BTS process of you taking the videos/ as well! Just an idea!
Sorry it's just the 3d object show in render with shadow and all black without the video
Hi Ahmed, sorry its hard to answer these types of questions if I don't have the specifics of the blendfile. Glad you figured this out though!
Hi again, revisiting this tutorial, still trying to understand layers. Curious why the foreground and the background render passes both contain the same shadow? I thoguht you wanted the shadow separately, otherwise how does having the shadow in both renders help later in compositing in AE? thanks (Maybe you needed to reactivate holdout of the background collection for the foreground layer, that way have the tower and shadows separately?)
Great video and thanks for sharing valuable information. I've been trying to do it for a few days. But even though I followed the same steps as you, I'm having problems with 2 issues. First, when I switch to the render screen, the background video only appears on the shadow catcher. Secondly, things get worse when I turn the render engine from Evee to Cycles. The shadow catcher just looks pitch black, the background is completely blank and my subject has rendered bad images. I can't understand where is the error, can you help me?
I am having the same issues. I think things must have changed within blender because of recent updates as this tutorial is a bit old.
oh wait, did you check "transparent" under film? in the render properties. I think that fixed the issue for me.
thank you so mutch :)@@BlueBerryFTW
@@BlueBerryFTW been trying to find this solution, thanks!
Hi, great tutorial. At 18:11, when I move building into foreground and go to camera view in render, the camera background does not appear. My render still looks like how your's does at 18:05. I am using Blender 4.0. Ideas?
quick question how do i put my greenscreen video into the foreground so that my background layer is a 3d layer.
Oh this is a trickly question to answer in a comment. I'll see about a video in the future.
I'm having issues with a zooming drone footage it is like the building is getting slightly out of place when zooming in
Hi, how to you select multiple markers? I'm having trouble at the set floor part. Thanks
Just press ctrl A or just press A :)
Yes Paida is correct.
Finished the tutorial in Blender 4. The beauty pass is not producing a file. Anyone else having this problem? I have files for AO, mist, shadow, but the beauty pass folder set under Render settings is empty.
Help: I use your footage and do exactly what you do but I get a solve error of 128.96. What am I missing?
Hi Geno, It's hard to say without looking at your actual project file. I would make sure the tracking points you are using are far enough away from each other as to give each other lots of parallax for the computer to calculate the camera movement better. Select both points in the foreground and the background of your footage.
@@LightArchitect Thanks for responding. I am using your footage so I expected to get the same results nut kept getting very high solve error. After much fooling around I got it down some and was able to get it to work. I also purchased your City Builder package. When purchasing it said that if I registered I would be entitled to future updates. I didn't see anywhere to register? Thanks
My floor doesn't orient to the floor in the video for some reason. Tried to adjust the camera and resolve camera but the solve messed up for some reason
Man I followed everything exactly but then suddenly the solve error is outrageous. The weird part is all the red/green lines in the graph look pretty good like your one but somehow this monster blue line showing solve errors as high as 433 appear. When I check out these individual markers they are tracking very well so I just don't get it. Tried googling but no luck. I feel so lost.
Hi Hayden,
It's hard to know exactly what your error is without looking at your project directly. Sometimes it just requires a lot of trial of error for tricky shots to get a good track. Wish I could help more.
how much time will take to render if add green screen live action character to these kind of 3d world...please reply
Hi Bujji,
I'm not sure exactly what you mean by this. but if you mean compositing a character on a greenscreen into a distant 3d shot it should'nt take too long. Make sure to match perspectivess and focal length and import the video as a plane with and alpha channel so that you can integrate it into your 3d scene.
Why are you exporting for compositing? Didnt you already compose it in Blender?
I exported the various passes as openexr sequences so I could composite in video form. You can export your composite directly in blender as well.
thanks for the video but why on earth dont youtubers explain exactly what they are doing. at least script and plan these videos out. youd have shed loads of subscribers if you did - what on earth happened at 20:52 and what did you select to get the bg shadow?
Really cool video. Everything is well explained. My issue is I don't know Blender.....I am using Vray+3dsmax...
Does anyone know what is a good (and cheap) workflow for 3D tracking using 3dsmax.
Is there a 3rd party software for tracking and then exporting tracking points and camera to max?
Or does it make sense to track in blender and then export it to max for rendering?
Hi Marcin, Thanks for the comment. If you are using 3ds max I am pretty sure there is an inbuilt camera tracker as well that you can use. Of course Boujou and Syntheyes are also both great tracking softwares as well. I think Boujou is a little expensive though.
where is the refine tab in 2.92?
i just have set markers manually after figuring out this part in 2.92
i added the camera, and everytime i click set origin my camera goes soooooo far away so i get it back closer and then when i set the land points it goes back really far. need help
hello dude, thanks for share ... I have a question.... Can do you use this technique for make camera projections and integrate to Nuke?
Can u do shadow catcher in evee?
I am pretty sure you can but I have never tried it.
Bro can you solve my problem? I am a beginner in this so I face many problem, and one of the biggest problem when I render a video in blender and when I open it, it show only a photo ( animation is not showing ) even I select MPEG4 format but still problem is continues,
Can you help me please? My render engine is evee
Hi Manan,
I'm not sure I can really solve this issue without troubleshooting the exact project. My guess is that you are importing an image sequence but only one image is importing. Might be a setting you have to change.
U should use shortcuts rather than opening those tabs again and again
Good idea Taranveer. When I made this video probably wasn't as familiar with them.
@@LightArchitect yeah it's easy to remember some shortcuts rather than remembering the tabs and sub tabs
Smh Dude, how did you fail to properly match the shadow angle when the cliff edge is right there?
Awsome tutorial though. I learned a lot.
Yes I should have modeled the edge of the cliff as well to be more precise. Still glad it helped though!
when working through complex asset management, a good idea is to always a light snack. for you -- i would recommend almonds
My laptop can’t motion track, my laptop for some reason can’t handle it but I’m confused because I have an Alienware m17 with top tier specs
make sure that you have NVidia graphic card selected instead of internal one...
I am not sure how to solve this unfortunately. I would think with even a basic laptop tracking should work. Maybe try Simangka's advice below and see if it works better.
@@Simangka how do I do that?
@@dedrickriley1188 -right click on desktop
-Go to nvidia control panel
-on left hand side Go to 3D setting under that goto manage 3d setting
-then you will see PREFERED GRACHICS OPTION
-Set it to High-Perfomance NVIDIA Processor
-HIT APPLY DONE
@@Simangka OMG THANK YOU, I never knew that crazy.
blender track point stopped tracking before it reached the end of the clip? Tf, I can't even make it continue. Why?
It probably lost its point of contrast. Select it and move it manually to the point on the frame where it stopped. Then try to continue from there.
but notNice tutorialng seems to work. Tried built-in content, and scarlett solo. What's the hardware you have? windows mac? special soft card?
is it possible to use this blender tracking footage and import it in Davinci Resolve? sorry I'm pretty new to cgi stuff so I have a lot of question about the workflow on Davinci Resolve to blender & back for color grade and stuff
Hi.Great work. I have a question.What is you colormanagement setup? I try to render my animation to openexr or radianceHDR but it is overexposed.
What do I do when the channel rack becos too cluttered? If I can, how do I clear it?
Hahaha why you be rappin in the beginning tho
It's my second career choice.
cant u export the final video directly from blender ??
Yes you can! Just attach the composite node to where the viewer node is in this video and your output will be what the viewer node sees. Hope this helps!
okok please can anyone answer me because i got 0.16 as error is it right ? also the color turned red at the prefetch tab (purple line) so when i try to set origin it says (at least one track with bundle be selected to define origin position)
haters guna hate.
:D:D True.
Hi, I am trying to follow this tutorial, but when I try to view my scene in the render preview viewport I do not see the background video anymore. Anyone know how to fix this?