Dude, this tutorial is awsome. In les then 3 minutes you show how to motion capture. But, what happen if you 1- turn around. Will the animated character turn around also? 2- changing your face expression. Open your mouth. Sad face ti happy face and so on. 3- talk for auto lip-syncing. This exists in Adobe Character Animator. Any features for that in blenber?
@smarthalayla Thank you! 1. No, that would take a lot more animation and work to do that. 2. Maybe, I haven't tried it yet. 3. No, maybe there is an addon out there that I don't know about.
Amazing how now days kids are putting out more useful info to the amateur VFX community than anyone else seems willing or able to. This earned my sub! 👌
@@HappyDude1 precisely. When a service becomes easier to accomplish and more people are doing it at a common knowledge basis, the less it becomes a "skill" for in-demand, high salary jobs. So, they narrow the field to only those with certifications. Less competition; higher salary for those who get the gigs. This can be said in almost any type of business, but it happens to be really noticeable in subjects like entertainment. Luckily, if you master this craft, you can still pull in a fortune doing it, certified or not. It just takes a good portfolio. 👍
@@caydeisclutch2589 Yes thats the complex explenation 😁 i also noticed that a lot of vfx becomes automated like even my phone can do amazing editing like tracking or cutting something out of a video or photo. Or creating greenscreen around something.... now with AI more things will become more easy This wil replace a lot jobs sadly In every sector
@@HappyDude1 Absolutely. Fortunately, digital animation is an art that only gets better with technology, so it's not going to die out any time soon. As it stands, it's transcended typical trends and is here to stay; it could easily substitute the need to use any real-life being at all in the future, with databases full of pre captured content that allow any creation to be rigged to it. (Consider how years ago it was used to recreate Paul Walker in a "Fast and Furious" film after he had passed away). Not only this, but with automated tricks like floor locking, MoCap has the ability to be created in a single, small apartment sized room if you wanted. It's wild to imagine.
This legend is single handily saving my uni project. Edit: my foolish self did not appropriately address this legend by the proper name, thus I have changed my comment.
This is amazing! I had a similar idea a year or two ago but your process is so much more streamlined! It gets surprisingly good results too. Definitely saves time when doing low-budget animation of any sort.
As a beginning VFX artist, this is amazing and the fact that you put it out for free is mind blowing (in a good way lol). Anyway, thank you so much for this video
I'd say that these days kids are extremely talented at such a young age, which is true, but this takes me back 10 years ago when I was your age and I was also into some heavy tech stuff people would never guess it came from a pre teen. So yeah, never underestimate! Also great tutorial
Why have I not seen this technique presented before? I imagine there are shortcomings in some circumstances...but I have been researching mocap and "free" for a while now and , yes found solutions, but all much more muddy processes or reliant on some external site or AI you can plug on to. This awesome simplicity is a great starting point for animation. Thank you for reminding me that this very straightforward function is all that you need to employ to get some good human-feeling (or whatever your footage) movement. Disney animators essentially rotoscope real live action footage all the time.
You're so based man. People have got to be more like this. i love how much more willing people have been lately about sharing their secrets. Legitimately, thank you.
Nice. This can work fine when the movements stay along 2 axis but I suspect blender won't be able to figure out the depth from a static camera if you move a hand towards the camera for instance. Threedposetracker is free and works ok extracting human motion from monocular video if this technique fails for anyone. Thanks for the tutorial.
I've been working on this technology lately and the method used by blender is possibly mean-shift algorithm. It does not require high-performance graphics cards, but the result is still not satisfying enough as what most Deeplearning models can produce. By using mean-shift you'll first need to go through a long process to get the raw data, then you'll have a large set of parameters to adjust. So check out those new AI-based motion trackers. I think they can help u with your furthur projects.
You deserve youtube award of the year. TNice tutorials video truly nails it! Very well explained... The way you cut the bullsNice tutorialt and get straight to it..
I haven't tested this out, but for depth, you could set up a second camera to record the side angle for your reference, and then hand animate the z position of the points to match. You might be able to track them and somehow link the points together But that might be more difficult than just hand animating the depth to get as close as possible. But yeah, this seems like a really good method for some quick rough motion capture, especially if your character is just going to be in the background.
@@KidChemic I'm not sure, but I would guess the easy way would be to use his method for the front angle. Then setup the side angle in orthographic view, create new empties for each point, and use auto-keyframing to roughly animate the empties to match the positions from the side view. Then use constraints to copy only that axis (Y?) of the tracked points to your depth points
Not exactly the same but it reminds me of a Default Cube tutorial on 2D face tracking, but he projects the points onto the surface of a face mesh to get the depth
It's really annoying, I tried, problem is, we have 2 arms, often one is out of frame, which results in a bad track, multi camera setups only seem to work where you have enough cameras that all points are visible to atleast 2 cameras
But how do we track rotation? Suppose the character wants to rotate their hand - this would only work with 2D tracking, not rotation tracking, right? I have an idea for an experiment: we can track footage from three perspectives: the top (up) perspective for the character's position, the front perspective for armature movements, and the left perspective for the left hand position and armature tracking. Can all these perspectives be tracked at once, or do we need to track each perspective one by one? If we track them one by one, can I track from footage that's already been tracked, like the front perspective? And what about rotation? How can I achieve hand rotation? If you try this experiment, please let me know if it works?"
Pretty good I’ve always just made a premade animation and overlayed into an actual scene but motion capture with blender is actually a pretty good idea. Thanks for the tutorial.
Is it possible to perform motion capture using multiple cameras? This video was tracked by shooting only the front, but I think that if we also shoot the side view and track the arms and legs and add that tracking movement, we will be able to achieve more accurate motion capture. In other words, can we track the side and add that tracking movement?
I might be misunderstanding how the technology works? I’m assuming that each hand should be surrounded by a tracker in frame 1. Then A.I. will have the tracker follow the hand through the following frames to make keyframes. Instead, each keyframe might need to be manually recorded using the video footage as a guide?
Good video :D i have one question though: do i asssume correctly that with this approach you're limitted to 2 dimensions, meaning the empties move only on 2 axes e.g. X and Y, but not on Z. So you wuld not get any depth information, because the video does not provide it. If yes, did you think/work on any workarounds/solutions?
This is probably one of the best motion capture tutorial I’ve seen! Kudos to you bro! Also one question does this also work for other types of videos like games or live action movie scenes?
In 0:46 when you tracked your hands and played back the video the square moved with your hands with a red line fallowing. but when I do it the square just stays up in the air what am I doing wrong? Thanks for taking your time to help ☺
Hi I'm new to animation but wanted to ask a question. Can this be used to make animations and possibly group animations for a game like sims 4? or any other life sim game?
I follow the same settings as you do and when I click my hand, the tracking box line does not appear. How did you set it up so that the tracking box line appears?
How old are you??? It’s like someone senior with huge amount of skills giving lesson. 🫣🫣 Awesome tutorial love that, thank you so much for sharing your knowledge🙏🏻🙏🏻.
This is AMAZING thank you so much!!!! I really wanted to do something like this but didn't want to use AI. This makes so much sense, I appreciate you so much big up 🎉
Saw that ur comment is recent.. may i know how exactly I need to click to start tracking? I found myself clueless after 00:47 . I have no idea how does it manage to track with the blue-red line. Appreciate for your answer. Thank you in advance.
actually tried this before intuitevly but my laptop couldnt track properly ill attmept it again, also had an idea to localize the tracks in a 3d scene it involves mutli direction filming. u track from the front view then swap to the other sides to get a synched up result not sure if iam wording this correctly though lol, hopefully u understand where im coming from. Film front and side track front and side, constraint them to the respected dimensions and u should be good ill try this in a bit.
Very cool, how would you do MOCAP of an actor moving toward the camera? Or turning around? Looking forward to more of your posts. I think you are onto an amazing work flow. Thank you for the video.
I am finding it really hard to look for motions that I want in maximo. Like there was one that I found once and wanted to download but couldn't and now I can't find it as I don't know what keyword I used to get that one. Is there a way to look for animations that I would want? Or I'll have to manually look through all the animations to find the one that fits in my workflow?
amazing video! exactly what I need! however, when I press link empty to track all the crosses are located in the exact same position. any idea how to fix it?
![SAFEPLANET - ดาวเคราะห์ [ THE PLANET ]](http://i.ytimg.com/vi/4X1XL3I_k3c/mqdefault.jpg)
By the way, if your trackers are failing and you're getting lots of errors, Just watch a few Blender tracking tutorials on TH-cam
Dude, this tutorial is awsome. In les then 3 minutes you show how to motion capture.
But, what happen if you
1- turn around. Will the animated character turn around also?
2- changing your face expression. Open your mouth. Sad face ti happy face and so on.
3- talk for auto lip-syncing. This exists in Adobe Character Animator.
Any features for that in blenber?
@smarthalayla Thank you!
1. No, that would take a lot more animation and work to do that.
2. Maybe, I haven't tried it yet.
3. No, maybe there is an addon out there that I don't know about.
@@RedLabEffects
Thanks man ;)
@@smarthalayla6397 your welcome
@@smarthalayla6397 isn't she a girl 😅😅😅
Amazing how now days kids are putting out more useful info to the amateur VFX community than anyone else seems willing or able to. This earned my sub! 👌
Yeah Its like they want you to pay for lessons 😂 because nobody shows how to do it
@@HappyDude1 precisely. When a service becomes easier to accomplish and more people are doing it at a common knowledge basis, the less it becomes a "skill" for in-demand, high salary jobs. So, they narrow the field to only those with certifications. Less competition; higher salary for those who get the gigs. This can be said in almost any type of business, but it happens to be really noticeable in subjects like entertainment. Luckily, if you master this craft, you can still pull in a fortune doing it, certified or not. It just takes a good portfolio. 👍
@@caydeisclutch2589
Yes thats the complex explenation 😁 i also noticed that a lot of vfx becomes automated like even my phone can do amazing editing like tracking or cutting something out of a video or photo. Or creating greenscreen around something.... now with AI more things will become more easy
This wil replace a lot jobs sadly
In every sector
@@HappyDude1 Absolutely. Fortunately, digital animation is an art that only gets better with technology, so it's not going to die out any time soon. As it stands, it's transcended typical trends and is here to stay; it could easily substitute the need to use any real-life being at all in the future, with databases full of pre captured content that allow any creation to be rigged to it. (Consider how years ago it was used to recreate Paul Walker in a "Fast and Furious" film after he had passed away). Not only this, but with automated tricks like floor locking, MoCap has the ability to be created in a single, small apartment sized room if you wanted. It's wild to imagine.
Kids are becoming the only hope once again adults have failed us all
This legend is single handily saving my uni project.
Edit: my foolish self did not appropriately address this legend by the proper name, thus I have changed my comment.
U did it🫡
then you should show some respect by addressing him as a "Legend"
@@bossmen6665 done
You're in uni and you don't know how to spell "single-handedly"?
@@TheFilipFonky Sorry, must of mistyped. My dong is too big for the keyboard.
I’m not only impressed by the simple and easy to follow tutorial but by how young you are and producing this quality of content. Extremely impressive
Really respect and appreciate people like yourself who give their ti and expert knowledge so others can benefit and enjoy soft
Thank you man
@@RedLabEffects let's go
When he said “I got ya”, I knew this was the best tutorial. Thanks a lot! 🙏🔥
This is amazing! I had a similar idea a year or two ago but your process is so much more streamlined! It gets surprisingly good results too. Definitely saves time when doing low-budget animation of any sort.
Thank you
As a beginning VFX artist, this is amazing and the fact that you put it out for free is mind blowing (in a good way lol). Anyway, thank you so much for this video
I'd say that these days kids are extremely talented at such a young age, which is true, but this takes me back 10 years ago when I was your age and I was also into some heavy tech stuff people would never guess it came from a pre teen. So yeah, never underestimate! Also great tutorial
Im so impressed. This tutorial is the fastest and most clear quick guide to motion tracking. Nice job!
Why have I not seen this technique presented before? I imagine there are shortcomings in some circumstances...but I have been researching mocap and "free" for a while now and , yes found solutions, but all much more muddy processes or reliant on some external site or AI you can plug on to.
This awesome simplicity is a great starting point for animation. Thank you for reminding me that this very straightforward function is all that you need to employ to get some good human-feeling (or whatever your footage) movement. Disney animators essentially rotoscope real live action footage all the time.
No way this is real. Bro you've just helped millions of people save money. Bro thank you
this kid single handedly saved my short film
This tutorial feels like what we used to have back in the days, simple short and to the point. Keep it up brother 👊
You're so based man. People have got to be more like this. i love how much more willing people have been lately about sharing their secrets. Legitimately, thank you.
Nice. This can work fine when the movements stay along 2 axis but I suspect blender won't be able to figure out the depth from a static camera if you move a hand towards the camera for instance. Threedposetracker is free and works ok extracting human motion from monocular video if this technique fails for anyone. Thanks for the tutorial.
Fabulous presentation, instruction, and education. Superb format. Thanks young man & Godspeed in all of your endeavors!
I've been working on this technology lately and the method used by blender is possibly mean-shift algorithm. It does not require high-performance graphics cards, but the result is still not satisfying enough as what most Deeplearning models can produce. By using mean-shift you'll first need to go through a long process to get the raw data, then you'll have a large set of parameters to adjust. So check out those new AI-based motion trackers. I think they can help u with your furthur projects.
You earned my sub little bro :) been looking for a cheap motion capture solution for ages and you pointed me to exactly what I needed!
That's a good trick. If Blender adds solving multiple cameras, it would actually be a proper motion capture solution (that's not trivial though).
That looks really nice.. Wasn't aware of blender being able to do this without special devices...
i have no idea why, but hearing your voice just makes feel soothed.
You deserve youtube award of the year. TNice tutorials video truly nails it! Very well explained... The way you cut the bullsNice tutorialt and get straight to it..
Thank you so much!
I haven't tested this out, but for depth, you could set up a second camera to record the side angle for your reference, and then hand animate the z position of the points to match. You might be able to track them and somehow link the points together But that might be more difficult than just hand animating the depth to get as close as possible. But yeah, this seems like a really good method for some quick rough motion capture, especially if your character is just going to be in the background.
Is there any documentation on this process? Multi-angle mocap in Blender would be perfect for a project I'm working on.
@@KidChemic I'm not sure, but I would guess the easy way would be to use his method for the front angle. Then setup the side angle in orthographic view, create new empties for each point, and use auto-keyframing to roughly animate the empties to match the positions from the side view. Then use constraints to copy only that axis (Y?) of the tracked points to your depth points
Not exactly the same but it reminds me of a Default Cube tutorial on 2D face tracking, but he projects the points onto the surface of a face mesh to get the depth
I don't know, this seems like far more work for a really choppy result than just modifying already existing mixamo anims.
It's really annoying, I tried, problem is, we have 2 arms, often one is out of frame, which results in a bad track, multi camera setups only seem to work where you have enough cameras that all points are visible to atleast 2 cameras
0:46 my only issue is how do you make that square appear to track? First time using blender but I can't seem to find where you clicked?
in the details. when you get stuck, roll back to the beginning and start over. The other weay is to focus entirely on one set of commands
But how do we track rotation?
Suppose the character wants to rotate their hand - this would only work with 2D tracking, not rotation tracking, right?
I have an idea for an experiment: we can track footage from three perspectives: the top (up) perspective for the character's position, the front perspective for armature movements, and the left perspective for the left hand position and armature tracking.
Can all these perspectives be tracked at once, or do we need to track each perspective one by one? If we track them one by one, can I track from footage that's already been tracked, like the front perspective?
And what about rotation? How can I achieve hand rotation?
If you try this experiment, please let me know if it works?"
as a beginner, and a person who doesnt thumb up videos, i learned alot and liked the vid
this is the most concise information that i have ever seen in a video? like ever??
The part of tracking. Which button do you press ?
one of the most useful videos I saw for a while
I can't believe literally no one is talking about how satisfying Nice tutorials voice softs.
Pretty good I’ve always just made a premade animation and overlayed into an actual scene but motion capture with blender is actually a pretty good idea. Thanks for the tutorial.
TNice tutorials is the best tutorial. Simply explained to a newbie, great job man.
At last something that works! you just earned a sub
Change the "Program" from Agressive TE to Analog Base 1 TE inside the GMS setup equlizer panel.. Found another comnt with the
Is it possible to perform motion capture using multiple cameras? This video was tracked by shooting only the front, but I think that if we also shoot the side view and track the arms and legs and add that tracking movement, we will be able to achieve more accurate motion capture. In other words, can we track the side and add that tracking movement?
This is a simple and effective way of going about this, really smart.
Thanks
I could listen to Nice tutorialm talk for hours man what a passionate dude ❤️
If you're a complete beginner to soft production then soft is imo the easiest daw that you can get, I started off with it.. If you have a little bit
I might be misunderstanding how the technology works? I’m assuming that each hand should be surrounded by a tracker in frame 1. Then A.I. will have the tracker follow the hand through the following frames to make keyframes. Instead, each keyframe might need to be manually recorded using the video footage as a guide?
Good video :D i have one question though: do i asssume correctly that with this approach you're limitted to 2 dimensions, meaning the empties move only on 2 axes e.g. X and Y, but not on Z. So you wuld not get any depth information, because the video does not provide it. If yes, did you think/work on any workarounds/solutions?
Dude this was an awesome workflow. Did you come up with it by yourself? Amazing!
This is probably one of the best motion capture tutorial I’ve seen! Kudos to you bro! Also one question does this also work for other types of videos like games or live action movie scenes?
Thanks, I found rokoko's video-to-motion capture helps with more complex movements for games and short films. My way is just quick and dirty.
@@RedLabEffects do you think you’ll be able to make a video talking about it in the future?
@@top10lists37 Maybe, there are already a lot of videos on it I think
@@RedLabEffects is there any other way to contact you? Like Instagram or Twitter? Something like that?
@@top10lists37 No, just youtube
In 0:46 when you tracked your hands and played back the video the square moved with your hands with a red line fallowing. but when I do it the square just stays up in the air what am I doing wrong?
Thanks for taking your time to help
☺
Idk, try watching a few tracking tutorials to get familiar with Blender tracking. This video might help too: th-cam.com/video/WLSGG7sDEac/w-d-xo.html
Nice tutorial. I have been having content issues with my hmdi connected speaker and subwoofer. No soft is coming through, still coming out of
Nicely done. Taking on Default Cube / CG Matter? Or... *mystery chime* Ian Hubert?
Keep em tutorials comming.
Thanks for explaining it really well! I've been putting off learning soft soft cuz it looks so intimidating but now that I easily understood the
Hi I'm new to animation but wanted to ask a question. Can this be used to make animations and possibly group animations for a game like sims 4? or any other life sim game?
For games I would use Rokokos video-to-mocap
killed it! fast, easy and learned something. KEEP MAKING CONTENT
This is really great! But how would you go about doing a more 3d approach, instead of 2d facing forward?
found actually helpful for people started from scratch
I follow the same settings as you do and when I click my hand, the tracking box line does not appear. How did you set it up so that the tracking box line appears?
Now I can add more action and production value to my NPC’s and videos. Thanks dude!
What's the difference between Rotomation and Motion Capture?
Those squares at 0:46 aren't showing up for me. May you please tell me how you made the squares show up for you please.
Highly respect your work on this vid.
Really a treasure for the community, thank you! :D
i think we have the next MKBHD here! Fantastic presentation and quality content!
I have a question, can we use this method for shaking fingers
Also if we use a green background, it will better isn't it
Thanks, this will make walking animations easy
Impressive!
Is there a way to do this only for the facial features?
Can we just agree that we need to bring this vibe back. 10 years later and this song still hits different. Truly a masterpiece.
What song? The one at the end?
Does this easily break on complex movements?, CGMatter would be really proud tho
Thanks ArcNice tutoriale! If you ever have a question, just write a comnt and I’ll try my best to help. Also consider joining my free community
How old are you??? It’s like someone senior with huge amount of skills giving lesson.
🫣🫣 Awesome tutorial love that, thank you so much for sharing your knowledge🙏🏻🙏🏻.
Thank you so much for all these tutorials bro. So much valuable knowledge
Thank you!
If this was star wars, you would be a force sensitive padawan candidate. This video is extremely well done for your age.
How do you track?
Amazing kid, you have a bright future ahead of you.
I'm using the trial version of soft to learn the basics. How do I make a cool keyboard lody that isn't just a basic softing soft?
As someone who was recently inspired to creat an indi video game with motion capture this was so helpful
Nice one, way better than all the videos wanting to promote their AI websites!
I love it I’m 13 and was just using mixamo for my motion capture but this helped definitely subscribing
by any ans, but I can make what I envision, and that's the greatest gift to . You are, without a doubt, an expert teacher. You may
This is AMAZING thank you so much!!!! I really wanted to do something like this but didn't want to use AI. This makes so much sense, I appreciate you so much big up 🎉
Saw that ur comment is recent.. may i know how exactly I need to click to start tracking? I found myself clueless after 00:47 . I have no idea how does it manage to track with the blue-red line. Appreciate for your answer. Thank you in advance.
Can you do this in a model 3d mentional way? Like what happens if you rotate your body? Does it track it correctly?
Thank u so much, interested in starting so soft during quarintine and just need a place to get started, thx for the support
Your welcome
Thank you for sharing your process! I'm impressed, bud, at your age, I could've only done tutorials on how to waste my time efficiently.
Hands down, tNice tutorials is THE best beginner video I've watched. Others want to brag about all the sample, loops, etc they have. You keep
actually tried this before intuitevly but my laptop couldnt track properly ill attmept it again, also had an idea to localize the tracks in a 3d scene it involves mutli direction filming. u track from the front view then swap to the other sides to get a synched up result not sure if iam wording this correctly though lol, hopefully u understand where im coming from. Film front and side track front and side, constraint them to the respected dimensions and u should be good ill try this in a bit.
Very cool, how would you do MOCAP of an actor moving toward the camera? Or turning around? Looking forward to more of your posts. I think you are onto an amazing work flow. Thank you for the video.
Thank you! The motion capture is pretty limited, but like I said, you can use mixamo if you need complicated movement
I'd recommend moving in place then just manually animate the root position.
How do I rig an armature with IK. Is there any video that you can recommend me to watch?
Is there a way to add round black circles to certain parts of the body and be accurate tracking it?
Can I make very detailed and realistic horse motion capture with this? And can't I set up a second camera for when I turn my back?
creating a second track to add into the recording as I play through the first tract?
I am finding it really hard to look for motions that I want in maximo. Like there was one that I found once and wanted to download but couldn't and now I can't find it as I don't know what keyword I used to get that one. Is there a way to look for animations that I would want? Or I'll have to manually look through all the animations to find the one that fits in my workflow?
I love how cartoony the characters look lol, this is getting me back into modelling
Drag the volu for the setuper track that you're recording into all the way down.
This is a shockingly clear and easy to understand tutorial for how to get started with the basics of motion capture, thanks!! :D +1 Sub
this is both admirable and adorable! Keep going! great tutorial
good to know this method does work with the whole body!
This kid will become succeed in the field of animation.😊
That's a pretty cool trick
Thanks!
Dude, you're the best!
Quick question what did you press to select a video
You press the open button in the motion tracking tab.
kid, you are going places. keep at it!
Your lesson helped a lot, after that i wrote my first lody. Thank you very much.
Your welcome!
this kid is going to go places
fantastic tutorial
Why is only one bone highlighted green when I try to constrain?
amazing video! exactly what I need! however, when I press link empty to track all the crosses are located in the exact same position. any idea how to fix it?
solved it! I added a camera with a camera solver constraint and the trackers moved to the correct position.