Dude, this tutorial is awsome. In les then 3 minutes you show how to motion capture. But, what happen if you 1- turn around. Will the animated character turn around also? 2- changing your face expression. Open your mouth. Sad face ti happy face and so on. 3- talk for auto lip-syncing. This exists in Adobe Character Animator. Any features for that in blenber?
@smarthalayla Thank you! 1. No, that would take a lot more animation and work to do that. 2. Maybe, I haven't tried it yet. 3. No, maybe there is an addon out there that I don't know about.
Amazing how now days kids are putting out more useful info to the amateur VFX community than anyone else seems willing or able to. This earned my sub! 👌
@@HappyDude1 precisely. When a service becomes easier to accomplish and more people are doing it at a common knowledge basis, the less it becomes a "skill" for in-demand, high salary jobs. So, they narrow the field to only those with certifications. Less competition; higher salary for those who get the gigs. This can be said in almost any type of business, but it happens to be really noticeable in subjects like entertainment. Luckily, if you master this craft, you can still pull in a fortune doing it, certified or not. It just takes a good portfolio. 👍
@@caydeisclutch2589 Yes thats the complex explenation 😁 i also noticed that a lot of vfx becomes automated like even my phone can do amazing editing like tracking or cutting something out of a video or photo. Or creating greenscreen around something.... now with AI more things will become more easy This wil replace a lot jobs sadly In every sector
@@HappyDude1 Absolutely. Fortunately, digital animation is an art that only gets better with technology, so it's not going to die out any time soon. As it stands, it's transcended typical trends and is here to stay; it could easily substitute the need to use any real-life being at all in the future, with databases full of pre captured content that allow any creation to be rigged to it. (Consider how years ago it was used to recreate Paul Walker in a "Fast and Furious" film after he had passed away). Not only this, but with automated tricks like floor locking, MoCap has the ability to be created in a single, small apartment sized room if you wanted. It's wild to imagine.
This legend is single handily saving my uni project. Edit: my foolish self did not appropriately address this legend by the proper name, thus I have changed my comment.
As a beginning VFX artist, this is amazing and the fact that you put it out for free is mind blowing (in a good way lol). Anyway, thank you so much for this video
This is amazing! I had a similar idea a year or two ago but your process is so much more streamlined! It gets surprisingly good results too. Definitely saves time when doing low-budget animation of any sort.
I'd say that these days kids are extremely talented at such a young age, which is true, but this takes me back 10 years ago when I was your age and I was also into some heavy tech stuff people would never guess it came from a pre teen. So yeah, never underestimate! Also great tutorial
Why have I not seen this technique presented before? I imagine there are shortcomings in some circumstances...but I have been researching mocap and "free" for a while now and , yes found solutions, but all much more muddy processes or reliant on some external site or AI you can plug on to. This awesome simplicity is a great starting point for animation. Thank you for reminding me that this very straightforward function is all that you need to employ to get some good human-feeling (or whatever your footage) movement. Disney animators essentially rotoscope real live action footage all the time.
You're so based man. People have got to be more like this. i love how much more willing people have been lately about sharing their secrets. Legitimately, thank you.
Pretty good I’ve always just made a premade animation and overlayed into an actual scene but motion capture with blender is actually a pretty good idea. Thanks for the tutorial.
You deserve youtube award of the year. TNice tutorials video truly nails it! Very well explained... The way you cut the bullsNice tutorialt and get straight to it..
This is probably one of the best motion capture tutorial I’ve seen! Kudos to you bro! Also one question does this also work for other types of videos like games or live action movie scenes?
I've been working on this technology lately and the method used by blender is possibly mean-shift algorithm. It does not require high-performance graphics cards, but the result is still not satisfying enough as what most Deeplearning models can produce. By using mean-shift you'll first need to go through a long process to get the raw data, then you'll have a large set of parameters to adjust. So check out those new AI-based motion trackers. I think they can help u with your furthur projects.
This is AMAZING thank you so much!!!! I really wanted to do something like this but didn't want to use AI. This makes so much sense, I appreciate you so much big up 🎉
Saw that ur comment is recent.. may i know how exactly I need to click to start tracking? I found myself clueless after 00:47 . I have no idea how does it manage to track with the blue-red line. Appreciate for your answer. Thank you in advance.
How old are you??? It’s like someone senior with huge amount of skills giving lesson. 🫣🫣 Awesome tutorial love that, thank you so much for sharing your knowledge🙏🏻🙏🏻.
I imagine if you can record from at least two different angles (front and side for example) youd get much better results (almost like optical mocap). nice vid
But how do we track rotation? Suppose the character wants to rotate their hand - this would only work with 2D tracking, not rotation tracking, right? I have an idea for an experiment: we can track footage from three perspectives: the top (up) perspective for the character's position, the front perspective for armature movements, and the left perspective for the left hand position and armature tracking. Can all these perspectives be tracked at once, or do we need to track each perspective one by one? If we track them one by one, can I track from footage that's already been tracked, like the front perspective? And what about rotation? How can I achieve hand rotation? If you try this experiment, please let me know if it works?"
Thankyou for actually explaining tNice tutorialngs. Other videos that I watched started talking about how to make soft and didn't ntion anytNice tutorialng
Nice. This can work fine when the movements stay along 2 axis but I suspect blender won't be able to figure out the depth from a static camera if you move a hand towards the camera for instance. Threedposetracker is free and works ok extracting human motion from monocular video if this technique fails for anyone. Thanks for the tutorial.
I haven't tested this out, but for depth, you could set up a second camera to record the side angle for your reference, and then hand animate the z position of the points to match. You might be able to track them and somehow link the points together But that might be more difficult than just hand animating the depth to get as close as possible. But yeah, this seems like a really good method for some quick rough motion capture, especially if your character is just going to be in the background.
@@KidChemic I'm not sure, but I would guess the easy way would be to use his method for the front angle. Then setup the side angle in orthographic view, create new empties for each point, and use auto-keyframing to roughly animate the empties to match the positions from the side view. Then use constraints to copy only that axis (Y?) of the tracked points to your depth points
Not exactly the same but it reminds me of a Default Cube tutorial on 2D face tracking, but he projects the points onto the surface of a face mesh to get the depth
It's really annoying, I tried, problem is, we have 2 arms, often one is out of frame, which results in a bad track, multi camera setups only seem to work where you have enough cameras that all points are visible to atleast 2 cameras
I had soft soft for a wNice tutorialle but never actually opened it because it looked too complex. TNice tutorials actually helped quite a bit. i an like for
Very cool method! And now there's another option, maybe faster : Rokoko. You create a video, upload it on Rokoko and you can export the animation in Blender.
Ok, I'm done with this world. 😀 Once, there was a time, I was as brilliant as this kid in his age doing stuff with IT in all its ways and especially 3D stuff. 30 years ago it's been Cinema4D etc. what I've been working with. Now, many years later I look at common software and it feels somewhat known, but it's kind of shocking again when a kid in this age (no front) knows this stuff a hundred times better than myself and I probably won't be able to get the knowledge fast enough. Maybe, it's just a feeling and I just should try. 😀 Thank you for the video and explanation! 🙂
By the way, if your trackers are failing and you're getting lots of errors, Just watch a few Blender tracking tutorials on TH-cam
Dude, this tutorial is awsome. In les then 3 minutes you show how to motion capture.
But, what happen if you
1- turn around. Will the animated character turn around also?
2- changing your face expression. Open your mouth. Sad face ti happy face and so on.
3- talk for auto lip-syncing. This exists in Adobe Character Animator.
Any features for that in blenber?
@smarthalayla Thank you!
1. No, that would take a lot more animation and work to do that.
2. Maybe, I haven't tried it yet.
3. No, maybe there is an addon out there that I don't know about.
@@RedLabEffects
Thanks man ;)
@@smarthalayla6397 your welcome
@@smarthalayla6397 isn't she a girl 😅😅😅
Amazing how now days kids are putting out more useful info to the amateur VFX community than anyone else seems willing or able to. This earned my sub! 👌
Yeah Its like they want you to pay for lessons 😂 because nobody shows how to do it
@@HappyDude1 precisely. When a service becomes easier to accomplish and more people are doing it at a common knowledge basis, the less it becomes a "skill" for in-demand, high salary jobs. So, they narrow the field to only those with certifications. Less competition; higher salary for those who get the gigs. This can be said in almost any type of business, but it happens to be really noticeable in subjects like entertainment. Luckily, if you master this craft, you can still pull in a fortune doing it, certified or not. It just takes a good portfolio. 👍
@@caydeisclutch2589
Yes thats the complex explenation 😁 i also noticed that a lot of vfx becomes automated like even my phone can do amazing editing like tracking or cutting something out of a video or photo. Or creating greenscreen around something.... now with AI more things will become more easy
This wil replace a lot jobs sadly
In every sector
@@HappyDude1 Absolutely. Fortunately, digital animation is an art that only gets better with technology, so it's not going to die out any time soon. As it stands, it's transcended typical trends and is here to stay; it could easily substitute the need to use any real-life being at all in the future, with databases full of pre captured content that allow any creation to be rigged to it. (Consider how years ago it was used to recreate Paul Walker in a "Fast and Furious" film after he had passed away). Not only this, but with automated tricks like floor locking, MoCap has the ability to be created in a single, small apartment sized room if you wanted. It's wild to imagine.
Kids are becoming the only hope once again adults have failed us all
This legend is single handily saving my uni project.
Edit: my foolish self did not appropriately address this legend by the proper name, thus I have changed my comment.
U did it🫡
then you should show some respect by addressing him as a "Legend"
@@bossmen6665 done
You're in uni and you don't know how to spell "single-handedly"?
@@TheFilipFonky Sorry, must of mistyped. My dong is too big for the keyboard.
I’m not only impressed by the simple and easy to follow tutorial but by how young you are and producing this quality of content. Extremely impressive
When he said “I got ya”, I knew this was the best tutorial. Thanks a lot! 🙏🔥
As a beginning VFX artist, this is amazing and the fact that you put it out for free is mind blowing (in a good way lol). Anyway, thank you so much for this video
this kid single handedly saved my short film
Im so impressed. This tutorial is the fastest and most clear quick guide to motion tracking. Nice job!
This is the best tutorial I have seen. You should be proud of how concise and high quality this video is
No way this is real. Bro you've just helped millions of people save money. Bro thank you
This is amazing! I had a similar idea a year or two ago but your process is so much more streamlined! It gets surprisingly good results too. Definitely saves time when doing low-budget animation of any sort.
Thank you
I'd say that these days kids are extremely talented at such a young age, which is true, but this takes me back 10 years ago when I was your age and I was also into some heavy tech stuff people would never guess it came from a pre teen. So yeah, never underestimate! Also great tutorial
This tutorial feels like what we used to have back in the days, simple short and to the point. Keep it up brother 👊
Really respect and appreciate people like yourself who give their ti and expert knowledge so others can benefit and enjoy soft
Thank you man
@@RedLabEffects let's go
Crazy kid! When I was in your age I started on c64.
Why have I not seen this technique presented before? I imagine there are shortcomings in some circumstances...but I have been researching mocap and "free" for a while now and , yes found solutions, but all much more muddy processes or reliant on some external site or AI you can plug on to.
This awesome simplicity is a great starting point for animation. Thank you for reminding me that this very straightforward function is all that you need to employ to get some good human-feeling (or whatever your footage) movement. Disney animators essentially rotoscope real live action footage all the time.
Now I can add more action and production value to my NPC’s and videos. Thanks dude!
You're so based man. People have got to be more like this. i love how much more willing people have been lately about sharing their secrets. Legitimately, thank you.
i have no idea why, but hearing your voice just makes feel soothed.
You earned my sub little bro :) been looking for a cheap motion capture solution for ages and you pointed me to exactly what I needed!
If this was star wars, you would be a force sensitive padawan candidate. This video is extremely well done for your age.
Pretty good I’ve always just made a premade animation and overlayed into an actual scene but motion capture with blender is actually a pretty good idea. Thanks for the tutorial.
You deserve youtube award of the year. TNice tutorials video truly nails it! Very well explained... The way you cut the bullsNice tutorialt and get straight to it..
Thank you so much!
this is the most concise information that i have ever seen in a video? like ever??
as a beginner, and a person who doesnt thumb up videos, i learned alot and liked the vid
This kid has cooked so well, awesome vid, keep goin!
Fabulous presentation, instruction, and education. Superb format. Thanks young man & Godspeed in all of your endeavors!
That looks really nice.. Wasn't aware of blender being able to do this without special devices...
At last something that works! you just earned a sub
one of the most useful videos I saw for a while
I love it I’m 13 and was just using mixamo for my motion capture but this helped definitely subscribing
Can we just agree that we need to bring this vibe back. 10 years later and this song still hits different. Truly a masterpiece.
What song? The one at the end?
👏
Keep it up younge man
Your really r a saver
Thank you
I have a masters in digital media and animation and a 12 year old has taught me more than any of my tenured professors
That's a good trick. If Blender adds solving multiple cameras, it would actually be a proper motion capture solution (that's not trivial though).
Thank you for sharing your process! I'm impressed, bud, at your age, I could've only done tutorials on how to waste my time efficiently.
Its amazing. Is it possible to apply this, with 3 cameras and apply it to x, y, z axis seperatly for more accurate results ?
Kids like this give me hope for the future.
Dude this was an awesome workflow. Did you come up with it by yourself? Amazing!
This is probably one of the best motion capture tutorial I’ve seen! Kudos to you bro! Also one question does this also work for other types of videos like games or live action movie scenes?
Thanks, I found rokoko's video-to-motion capture helps with more complex movements for games and short films. My way is just quick and dirty.
@@RedLabEffects do you think you’ll be able to make a video talking about it in the future?
@@top10lists37 Maybe, there are already a lot of videos on it I think
@@RedLabEffects is there any other way to contact you? Like Instagram or Twitter? Something like that?
@@top10lists37 No, just youtube
i think we have the next MKBHD here! Fantastic presentation and quality content!
Super well explained, short and quick all the important information 👍👽🌞
I've been working on this technology lately and the method used by blender is possibly mean-shift algorithm. It does not require high-performance graphics cards, but the result is still not satisfying enough as what most Deeplearning models can produce. By using mean-shift you'll first need to go through a long process to get the raw data, then you'll have a large set of parameters to adjust. So check out those new AI-based motion trackers. I think they can help u with your furthur projects.
I can't believe literally no one is talking about how satisfying Nice tutorials voice softs.
Nice one, way better than all the videos wanting to promote their AI websites!
in the details. when you get stuck, roll back to the beginning and start over. The other weay is to focus entirely on one set of commands
This is AMAZING thank you so much!!!! I really wanted to do something like this but didn't want to use AI. This makes so much sense, I appreciate you so much big up 🎉
Saw that ur comment is recent.. may i know how exactly I need to click to start tracking? I found myself clueless after 00:47 . I have no idea how does it manage to track with the blue-red line. Appreciate for your answer. Thank you in advance.
If you're a complete beginner to soft production then soft is imo the easiest daw that you can get, I started off with it.. If you have a little bit
TNice tutorials is the best tutorial. Simply explained to a newbie, great job man.
I could listen to Nice tutorialm talk for hours man what a passionate dude ❤️
by any ans, but I can make what I envision, and that's the greatest gift to . You are, without a doubt, an expert teacher. You may
Nicely done. Taking on Default Cube / CG Matter? Or... *mystery chime* Ian Hubert?
Keep em tutorials comming.
This is a simple and effective way of going about this, really smart.
Thanks
Good approach 😊👍
Thanks, this will make walking animations easy
badhiya chotu
This kid will become succeed in the field of animation.😊
As someone who was recently inspired to creat an indi video game with motion capture this was so helpful
SUPERB....TUTORIAL, WELL DONE.....EASY TO LEARN :)
kid, you are going places. keep at it!
killed it! fast, easy and learned something. KEEP MAKING CONTENT
Dang kids are getting smart!
wow you are soo cool man. young kid out here making moves.
Amazing kid, you have a bright future ahead of you.
This tells us that Awesome Blender is better than we think, when Awesome People show us how.
How old are you??? It’s like someone senior with huge amount of skills giving lesson.
🫣🫣 Awesome tutorial love that, thank you so much for sharing your knowledge🙏🏻🙏🏻.
Absolute genius although I gotta probably rewatch it 100 more times for me to follow lol
I imagine if you can record from at least two different angles (front and side for example) youd get much better results (almost like optical mocap).
nice vid
But how do we track rotation?
Suppose the character wants to rotate their hand - this would only work with 2D tracking, not rotation tracking, right?
I have an idea for an experiment: we can track footage from three perspectives: the top (up) perspective for the character's position, the front perspective for armature movements, and the left perspective for the left hand position and armature tracking.
Can all these perspectives be tracked at once, or do we need to track each perspective one by one? If we track them one by one, can I track from footage that's already been tracked, like the front perspective?
And what about rotation? How can I achieve hand rotation?
If you try this experiment, please let me know if it works?"
0:46 my only issue is how do you make that square appear to track? First time using blender but I can't seem to find where you clicked?
found actually helpful for people started from scratch
Impressive!
Is there a way to do this only for the facial features?
this kid is going to go places
fantastic tutorial
Thank u so much, interested in starting so soft during quarintine and just need a place to get started, thx for the support
Your welcome
Thankyou for actually explaining tNice tutorialngs. Other videos that I watched started talking about how to make soft and didn't ntion anytNice tutorialng
Highly respect your work on this vid.
Really a treasure for the community, thank you! :D
Change the "Program" from Agressive TE to Analog Base 1 TE inside the GMS setup equlizer panel.. Found another comnt with the
Nice tutorial. I have been having content issues with my hmdi connected speaker and subwoofer. No soft is coming through, still coming out of
The part of tracking. Which button do you press ?
Dude you are better than those freaks , who wasted tons of my hours .i am gonna try it.hope it works.
This Is nice 👍 but how would that work with some 3D moves ? Like pointing a finger towards the camera ?
It doesn't, that's why I said to use miximo if you wanted to do advanced motion capture
Maybe with a second camera from above or from the side?
Nice. This can work fine when the movements stay along 2 axis but I suspect blender won't be able to figure out the depth from a static camera if you move a hand towards the camera for instance. Threedposetracker is free and works ok extracting human motion from monocular video if this technique fails for anyone. Thanks for the tutorial.
Nice tutorial!
I subscribed!
I haven't tested this out, but for depth, you could set up a second camera to record the side angle for your reference, and then hand animate the z position of the points to match. You might be able to track them and somehow link the points together But that might be more difficult than just hand animating the depth to get as close as possible. But yeah, this seems like a really good method for some quick rough motion capture, especially if your character is just going to be in the background.
Is there any documentation on this process? Multi-angle mocap in Blender would be perfect for a project I'm working on.
@@KidChemic I'm not sure, but I would guess the easy way would be to use his method for the front angle. Then setup the side angle in orthographic view, create new empties for each point, and use auto-keyframing to roughly animate the empties to match the positions from the side view. Then use constraints to copy only that axis (Y?) of the tracked points to your depth points
Not exactly the same but it reminds me of a Default Cube tutorial on 2D face tracking, but he projects the points onto the surface of a face mesh to get the depth
I don't know, this seems like far more work for a really choppy result than just modifying already existing mixamo anims.
It's really annoying, I tried, problem is, we have 2 arms, often one is out of frame, which results in a bad track, multi camera setups only seem to work where you have enough cameras that all points are visible to atleast 2 cameras
Nice tutorial Michael,
I had soft soft for a wNice tutorialle but never actually opened it because it looked too complex. TNice tutorials actually helped quite a bit. i an like for
good to know this method does work with the whole body!
That's a pretty cool trick
Thanks!
Clever work around. Nice video!
Very cool method! And now there's another option, maybe faster : Rokoko. You create a video, upload it on Rokoko and you can export the animation in Blender.
This video is excellent thanks
You are sure right
Dude, you're the best!
i was at the 8 minutes mark then i got engrossed in the potential masterpiece i could make and started dancing and bobbinb my head
How do you track?
Amazing! Keep it up brother
Thanks for the motivation. I wasn't sure if I could do it, but I might try it eventually.
wow, it is the most useful and simplest tutorial i have found today
Best tutorial ive evr seen bro ur d best!!!!!
damn little bro! you going places!
Ok, I'm done with this world. 😀 Once, there was a time, I was as brilliant as this kid in his age doing stuff with IT in all its ways and especially 3D stuff. 30 years ago it's been Cinema4D etc. what I've been working with. Now, many years later I look at common software and it feels somewhat known, but it's kind of shocking again when a kid in this age (no front) knows this stuff a hundred times better than myself and I probably won't be able to get the knowledge fast enough. Maybe, it's just a feeling and I just should try. 😀
Thank you for the video and explanation! 🙂
This is a shockingly clear and easy to understand tutorial for how to get started with the basics of motion capture, thanks!! :D +1 Sub