MetaHuman Animator Tutorial | Unreal Engine 5
ฝัง
- เผยแพร่เมื่อ 22 พ.ค. 2024
- Step by step guide for Unreal Engine's MetaHuman Animator, the latest update for high fidelity facial motion capture. In this video, we are going to show you how to setup your iphone with the LiveLink app to capture your facial motion, then bring the footage into Unreal Engine 5 to Calibrate, Process and then transfer that facial animation to your Metahuman.
If you don't know how to create a MetaHuman, here is a complete guide:
• Create your own MetaHu...
Timestamps:
00:00:00 Intro
00:01:35 Setup LiveLink and Record Takes
00:02:28 Setup Project in UE5
00:03:50 Import footages into UE5
00:04:46 Calibration
00:06:42 Process Animation
00:07:17 Add Face Animation
00:09:31 Add Body Animation
00:12:10 Blend Face and Body Animation
Shoutout to @ibrews for his body and head blend tutorial: • MetaHuman Animator Com...
Join our discord server:
/ discord
If you wanna see us to do cool things follow us here too:
Instagram: / badxstudio
Twitter: / badxstudio
TikTok: / badxstudio
LinkedIn: / badxstudio
Bad Decisions Podcast 🎙️:
podcasters.spotify.com/pod/sh...
Our personal handles: (if you wanna stalk us)
/ farhad_sh
/ farazshababs
/ farhads__
/ farazshababi
/ farhadshababi
/ farazshababi
#unrealengine5 #metahumans #ue5 #metahuman #metahumancreator #vancouver #blender3d #canada #blender #metahumananimator - บันเทิง
Most common issue: If your head is moving and your face is not"
Make sure that in the sequencer, where your FACE is, delete the CONTROL RIG LAYER.
There must only be ONE layer under face. That is your baked animation :)
as usual, ue4 is crashed and now I can’t find even a sequencer or animation at all, I already got to the part where idle animation was applied but it didn't work for me and when I tried to switch to hoodie everything fell down and now it's just an empty project
idle animation isnt working on metahuman
@@sergeypopik6879 do the same for the body as this comment says for the head. delete the Control Rig under BODY. worked for me. goodluck!
o you know by any chance how to import metahuman with the animation and everything textures, hair ect. In to a 3D Program like blender or similar to then render it there?
The face animation is working stand alone, but when I remove the control rig layer, the face does not move anymore.
What could this be?
For anyone who is using UE 5.3.2 and has a problem with not having FACE in sequencer, I got it working this way:
- In MetaHuman Performance view, do everything the same until Export Level Sequence
- When you click there and you get Export settings, go all the way down to MetaHuman Tracks
- Select your MetaHuman BP as Target MetaHuman Class and tick Enable MetaHuman Head Movement
- Now you have your MetaHuman in Sequencer, remove the controlRig from Body
- Add animation to body
Done. Thanks Bad Decisions Studio for awesome tutorial!
I much needed this solution. Thank you so much.
This is exactly what I need... thank you
but my editor keep crashing when I try to add the animation:
Assertion failed: Pose.IsValidIndex(BoneIndex) [File:D:\build\++UE5\Sync\Engine\Source\Runtime\Engine\Public\BonePose.h] [Line: 568]
anyone getting the same error??
I get that too@@pipcy
following this step also automatically connected the head to the body and maintained the neck movement.
Thank You!!!!!
Love what you have done here. Really nice work.
I am a member of the MetaHuman team at Epic, and have just one small comment on the creation of the MetaHuman Identity. For the 'Teeth' pose, you should make sure that the top and bottom teeth are together, with the back teeth meeting in a 'clench', and (likely) top teeth slightly overlapping the bottom teeth, and opening the lips so that the upper teeth tips are visible. In your pose, there was a small gap between top and bottom teeth, which can lead to slightly less accurate positioning of the teeth in the MetaHuman Identity, and therefore slightly less good quality of animation.
Hey Jane!!
Nice to meet you and thanks so much for your feedback.
We are definitely going to implement this next time :)
Is there anyway we could contact you? we have a few questions that we'd love to clear out before releasing here on the channel :)
@janehaslam684 Still the weakest part of Metahumans is the eye integration. The face seems to be a mask, then there seems to be a gap and then come inside both eyes. They seem not connected. In real life there is translucent flesh and tear fluid. I know it's possible to fix it manually, but it's not easy. Hopefully this will be improved. And otherwise @badxstudio it's worth another tutorial, if you find out how to fix this... Thanks
Hey Jane, sorry to ask an unrelated question here but maybe you know the answer :)
Can animations done with Metahuman Animator in 5.2/3 be exported backwards to 5.1 as FBX, or did Metahuman rigs change too much when this new tool was added in 5.2? I'm afraid of buying a new iPhone to record animations for my 5.1 project in 5.2 Animator, without knowing if it will work (and I have dependencies that lock my project to 5.1).
Can anyone please help??? I AM STUCK
When Exporting the Level sequence, Face is not visible in the sequencer. There is ust Newmethumanidentity and Animation and face controlboars_CtrRig under it. what do I do now?@@badxstudio
Hello Jane, I can’t help but ask pro in metahumans as you are. I’m trying to make manually keyframed body animations with control rig implemented in MH combined with face animation made with MH animator, but I still get the detached head when I try. Please help me find the solution of this problem. Maybe you know how to fix it, or you know someone who explained it on YT, anything helps, any help is appreciated. Thank you in advance. And, thank you for your hard work!!! You and the whole team you work with made a big step in CG, you created a spectacular masterpiece.
This is insane. I didn’t know stuff like this was possible. It’s incredible how fast technology is moving
I found you guys like a month ago and by far give the best UE tutorials, so thorough and entertaining! Keep up the great work!
Agent this means a lot to us man ... we really do spend countless hours re-writing our intros and main script to ensure its entertaining and clear so people can really learn something. The fact that it's working and you guys like it means a lot to us
It's amazing to see how fast this channel is growing. Super deserved work, guys! 🥳🥳
Thank you for bringing yet another quality tutorial and still supplying details and procedures that most didn't do.
Thank you so much! Your words mean a lot man.
One of the best, easiest to following and engaging tutorial that I have ever watched. Thank you sir!
Gentlemen, This video is incredible. I was totally lost when it come to metahuman animation - but you guys got me up and running like a charm. Excellent instruction.
Wow, thanks! So happy that it helped you 🙌
Subscribed! You guys are awesome! straight-to-the-point videos, no BS, and a great vibe! Keep it up!
Awesome! Thank you so much!
Thanks Mate, your video was, by far, the most complete and well made about metahumans. You turned something dull and tedious into something simple and freaking funny to watch. I've just subscribed. Thanks again!
You are absolutely welcome ❤️❤️ we put a lot of effort to get that exact vibe across and glad it worked out! Listen we’ve got another one coming for metahuman customisation over the next 3 weeks ❤️
@@badxstudio I can guarantee that every effort put into the videos is noticed, top notch content.
I've seen several other videos from you guys and I'm sure the TH-cam algorithm will promote BDS soon...
Congrats again and keep up the good work...
Cheers!
i iwsh all tutorials were this direct, no filler stuff that is distracting, step by step and clear and concise
Glad you liked iit bro
You guys are my go to Unreal tutorials for sure. Thank you!
We love you
Thank you so much for going through all the neede steps. You guys rock!
Great Tutorial again, always with lots of fun and it really helps to learn new things about Unreal Engine and Metahuman. Thank you guys for this great demonstration. 😉
That was the whole goal
genuinly one of if not the most thorough, well developed tutorial ive ever followed. You accounted EVERY possible error, this was fantastic. Thank you.
Thanks mate! Glad it helped!
All worked fine for me (thank you SO much, so awesome), except once i click Disable Post Process Blueprint for the face it goes bad for me and the face animation no longer plays/works :( Any ideas?
@@rctakedown9595 i have the same issue and idk how to solve it either :(
Dude god bles you I’ve been trying to figure out if I’d ever be able to make short funny animations and this tech is possible now and high quality now. Wow I used to draw frame by frame this is amazing you basically just have to be able to act in character. Insane!!
Superb tutorial! thank you guys! I look forward to your next installment.
Thanks for watching!
thank you for the neck and body section! incredibly helpful
We knew its gonna be a pain ... glad it helped
@@badxstudio you guys are really doing the lords work. So precise and entertaining to watch, you nail it every time. As someone who has watched many tutorials for the last 5 years, you two are by far the best.
At last! I have been waiting for you guys to do this very tutorial.
Well now that you've seen it, what did you think?
@@badxstudio It most certainly reduced the headaches of getting the animations from the performance mesh to the metahuman. I'm pretty new to Unreal Engine and have a lot to learn...
@@badxstudio Also, where did you get a Patrick Stewart Metahuman?
I’ve been waiting for this for so long!!!
Glad to know you are watching it now
@@badxstudio Just went through the process and it's super cool! Thanks for the easy tutorial!
Amazing content guys. Im doing this process tomorrow and was curious how I was gonna connect the head to the body. Thanks for the funny walk through 🎉😂❤
Thank you
amazing and so helpful, seemed like you guys just started a youtube channel. I have to say that this is reallllly interesting. keep going kings! you're so potential.
hahahah thank you we started about 100 days ago :D Pretty new but we quit everything to do this so we are all in.
Thank youu for supporting us!!
thank you soo much i tried to do learn how to do this several times and it was always too confusing but this made it infinitely clearer so thankyou
🙏🙏🙏
You're very welcome! Glad that it helped :)
Awesome tuts guys, keep it up!
Very clear and concise tutorial... thank you
Thankyou for the awesome tutorial!! Definitely subbed!
Awesome, thank you!
dudes your both awesome thanks for this when my head stops spinning ill see if i can take this all in
Hahhaha love you brother!
Im sure you can handle it :) Let us know if u need any help
perfect! i'lm loving yours energy guys! keep going
Thank you so much!!
This is so good, and easy to follow!
My brother
Thank You SO Much For MAking This Awesome Tutorial For fRee
Amazing tutorial. Talk about delivering value!
Thank you brother
메타휴먼 관련해서 가장 멋진 채널 중 하나입니다! 재밌으면서 실용적인 컨텐츠 앞으로도 기대합니다
داداشا دمتون گرم بهترین و با کیفیت ترین آموزش هارو داخل چنلتون با تمام جزیات میزارین ایول❤
damet garm bro ❤ Thanks for watching
*I love this channel, great tutorials here*
You are welcome brother!! Jus checked your vids too they are dope :)
Awesome, super easy to do. Can't wait to see what we'll have in 10-20 years
Dude 10 years? Man jus wait for 1-2 years this is gonna jus keep gettin better!!
@@badxstudio Yeah, 10-20 years? FFS, I and millions of others might and will be dead in 10-20 years. Things are moving extremely fast right now, and there is no reason to wait a day let alone years to see how things are "better". There is no excuse to not start making cool things right now. You can use the cloud to use a computer so you don't even have the excuse of not having a computer. Kids these days don't have a clue how easy mode they have everything!
I get your point though.
@@vincestevenson9430 couldnt agree more 🤟🏼 crazy times we live in and no excuses
Hey guys, this is a stunning tutorial! I learned so much from it, so thank you !! I have a small question. Is it possible to import the animated metahuman with facial animation into your scene? and make it into a BP with a skeletal mesh (the auto-rigged metahuman) and attach an animation (UE defult animation + facial animation ) ? Great content again !
This is SO cool!
I know right!! Just imagine the possibilities now for the Music industry!
trying to make my own open world story game with 0 experience it’s going to take years but with things like move ai and this for storyline based cutscenes will make my life a whole lot easier
love the work brother, b y the way i recognize Iranian accent anywhere, proud of you man
Thanks bro ... and you guessed it right :)
This.... Is ... Crazy. People could make an easy Animation with this🤯
This continues to blow our mind!!!!
Agsolutely amazing!!! 👏💎
This is so amazing!
No you are breathtaking!!
man we love the perfect videothat no other one created thanks alot
Glad you liked it
oh hey thanks for the shoutout guys-- you rock :D
The beest tutorial for thiss, thanks!
Glad you like it mate 🫡
Thank you very much. I know how much hidden work is behind this video. Much appreciated! Where did you get the Patrick Stewart model?
Cool, now let me try to do this again wiothout following a tutorial :D . . . . This tech is amazing but damn it's a hell of a lot of steps... I'll have to do this 20 times before I can do it fluently. Great tut guys!
Love that part you guys cover your local network Ip address to avoid any hack attempt and protecting your privacy :D
No haunting! Sub'ds. Awesome work. Much appreciated.
daaaaaaaaaaaaang!! This one is EXACTLY waht i needed
Hellllll yeahhhh
Thank you so much for the tutorials you guys are my number 1 source for metahuman knowledge. can you please tell me the render settings you´ve used in Movie render queue? I always have to much noise in the shadows from hair or problems with hair physics when using anti aliasing. do you even use AA or is there another way to get high quality renders with metahumans?
Honestly, what you do is incredible, it helped me too much for the projects I'm doing, thank you very much and I hope you continue with this incredible content, greetings from Colombia
Ma maaaaann from Columbia!!! Glad you enjoyed it broski. Listen we are just starting out and doing thiis full time so expect LOADS of content comin at ya!
If you dont mind me asking what kind of project you are working on? And also what other videos would you like to see next from us?
Hey guys have used this for months and I'm so grateful for your genius problem solving skills. Having some issues in 5.4 though, have you run into any yourselves ?
thank you. Just a couple of things to make your life easier: you don't need to change the identity or bake it. Simply export the sequencer and the animation will be on the control rig. You can then apply it to any other face without any additional steps. You don't have to go through the retargeting process at all. Just export the body animation as an FBX, then import it back as a Metahuman base skeleton, and you'll have your body animation ready to go. I will have a through tutorial soon on my channel.
i dont get this :P for which part are you taking about ?
I don't understand this, can you elaborate? Checked your channel and there isn't a video describing this.
@@poppi3362 for the face. don't do any baking just export the animation to control rig and for the body after savin the animation don't do retargeting export the animation file as fbx and then import it while importing make sure you select metahuman base skeletal
@@Metarig export to control rig, what do you mean by that? I am able to export the animation in the performance file but where else do I apply it other than the sequencer? Maybe a short video, even if unlisted, would be easier as I am not that familiar with unreal.
@@poppi3362 ok bro the next video will be about that
best unreal engine Tutorial in the planet
Hahaha love u!!! We got ripped doing all the metahuman scene exports 🤪🤪🤪
Seeing Patrick Stewarts head in this detail, is incredible!
Amazing tutorial!
Can you please make a step by step tutorial on how to use scan-based texture to achieve maximum likeness? 🙏
Thank you it is amazing and thanks againg for pricesless informations
Our pleasure!
Thanks! It works !
so good haha, thank youuu
Broski we did it for you
It's a good day when Bad Decisions uploads!
Honestly if a video doesnt get a comment from shelf then the video aint good … ❤️❤️
God damm this is so good !
Juan thank god you commented if you didnt we'd be sad :(
thnks for this video's bruh i wanted create realistic animation and u helped a lot 😉✌️💓💓💓💓
U are absolutely welcome ❤️
You rock !!! Thanx !!!!
Glad it helped!
This video just earned you a new subscriber, good job fellas 🤌🏾
Thank you brother! Welcome to the Bad Decisions Fam :)
Been loving this channel in the last few weeks, guys. Keep kicking butt. I do have a question: I can get the animations and blending working as you describe, which is awesome, but every time it works, I seem to lose the connection with my groom binding for my metahuman. If I reconnect the binding in the MHP blueprint, I lose the head / body connection. If I fix the connection, I lose the groom binding! I'm going around in circles 😅 Any advice??
Hey buddy thanks for the love! Lol hahaha that sounds horrible sorry brother! Listen no idea why thats happening but im literally replying while in bed… if you can join our discord we can try to figure it out together tomorrow?discord.gg/J2FbSqBB
@@badxstudio Will do!
I'll be glad when all this cool MetaHuman stuff actually works on Macs.
After 7 months after I watched this tutorial I bought an iPhone only for this. I am re-watching it step by step again 😃
Were you able to connect to your phone in UE?
I only get the realtime version working, but the saved sequences won't appear. I don't know...
@@meskalation Yes, I tried both. Better results are using the pre recorded video
@@AlexisRivera3D Thanks. I assume that, but couldn't get access to the prerecords. I'm sure i mess up something in the connection setup :/
@@meskalation use ipv4 address
best tutorial ever
Awesome.
Thank you! Cheers!
Outstanding video. Now I just need to know how to add clothes and I’m good. 👍🏼
Thank you for the love!!
yeap clothes is another boss of its own. Do you know marvelous?
@@badxstudio no, I used iClone Daz and Blender so, it isn’t difficult on those platforms. But I’m trying to transition to Unreal which is more industry standard.
I can show you clothes
best tutorial and narative
Thanks.. happy you liked it buddy 🙌
Can't wait until you can use the Apple Vision Pro with Metahuman.
Imagine being in the scene with the cgi metahuman actors, like standing next to them.
Acting out each metahuman. 1st the main metahuman that drives the scene, then you change to act out the other metahuman characters.
I love this tutorial and everything works perfectly, one small thing, maybe someone can help me out. After disabling the Post Process Blueprint on the face and fixing the blend shape of the head. I can't see the facial animations anymore. How can I fix that? (I am using the idle animation from the 3rd person BP)
Basically the baked animation that was recorded on my iphone, the face, the mouth, all animations stop after I disable post process blueprint.
thanks for the wonderful video!🤩
request: can you show how to animate the face of the character that I created in Blender?
And how in general should this process take place CORRECTLY?🥲
I tried but my textures are not working correctly in UE😓
You are absolutely welcome
Hi!! Amazing content!!
I wonder for any advice for troubleshooting these three issues on Metahuman Animator:
- “Promote Frame” randomly jumping to a different frame than the selected one.
- Metahuman Identity Solve not accurate result.
- “Add Teeth Pose” breaking the Identity Solve even more.
Any ideas?
Thanks a lot!!!!! Awesome channel
9:07. I did an animated bake and called a facial animation to a new blue print character. No facial animation, just head movement. Do you know why? The baked animation asset has a good facial movement
Thank you very much for a wonderful instruction. This workflow is not easy for me. I've been animating Metahuman, using Control Rig from scratch. Can I just remove any head movement perfectly and use only facial expressions in sequencer so I can work face and body separately like I do normally. That way I would use this new Metahuman animator. If you can answer my question, you would save my life. Thank you.
Yeah during the processing stage, where we chose CONTROL RIG as the head movement mode ... try DISABLED!
@@badxstudio Sounds good! I will disable it! Thank you very much!
very nice tutorial.
How do you add the audio and sync it on top of it?
Yes! Now I can take my tiktok NPC business to the next level!
Gang gang
Lol :D :D Gang gang ... those were some of the weirdest videos we've watched!
That's some strong coffee right here.
It looks amazing :D I noticed that you have mentioned IPhone only. What about Android users?
Hello Guys! great video this has helped me a lot!
I have a question, I have a turtleneck on my character which is plugged into the Torso mesh, how can I make sure the cloth neck region also gets the info from metahum animator? as this currently only gets the info from body anim sequence and therefore get intersections :S
Thanks in advance!
Congratulations guys, I love your channel, a very valuable content, I have tried to do the tutorial again and again, the first time, when I exported the Level Sequence if the FACE track appears as you do, among the tracks of the metahuman generated from the videos but as much as I try to repeat it I can not get the FACE track to appear when exporting the sequence and of course I can not get the animation bake from that track to pass it to my metahuman.
Thank you for the tutorial! It is one of the only complete mocap ones.
Just a quick question, my 3070 always freezes when I get to baking the animation of the head. Is there some way I can fix that?
how did you get a good lip sync? Any tips on improving the accuracy? Is it possible to control and manage the eyes separately in order to,follow the camera?
When I attach the animation from the face to the metahuman, only the head moves. The lips have no animations. Any tipps?
great tutotiral
Thank you 🙏
thanks. Any Androind alternative on the market as of october 2023?
Awesome tutorial..Can't get it to work on 5.4.0 though. When adding the blend mask at the end, I lose the face animation on the Metahuman character...?
For some weird reason, i can't seem to make the head attach to the body. I've spent 2 days now trying to figure out what went wrong, and i did everything in this video.
به به یه ایرانی میبینی آموزش انگلیسی خفن میزاره ادم عشق میکنه❤❤
Hhahahah merci dadash asheghetam
that looks way too good !
Right dude??? this tool is crazy .......
Great tutorial - thanks for this. However, the tracking data Im receiving is quite..terrible. It seems that the bottom lip of my character constantly pulls back which results in a massive overbite - one eye is always slightly closed more than the other, and it is impossible to replicate an angry face. Do you have any suggestions that I should try? Currently in a well lit room with my phone on a chest mount. Would love any feedback!
Very nice tutorial, learning a lot! Thanks. I do run into a slight problem. All is going well until the step where I connect the baked animation to the body. The head moven but the face does not. What am I doing wrong?
Make sure that in the sequencer, where your FACE is, delete the CONTROL RIG LAYER.
There must only be ONE layer under face. That is your baked animation :)
@@badxstudio yes! Worked. Thanks!
hey at 9:05 when bake to animation and export to animation, my ue5 keep freezing.. any solutions ? :(
Hey thanks for the great tutorial! At 11:00 Its suppose to automatically show the sequencer? But I'm still in my content browser, do you perhaps know how to solve this?
Cheers!
Can i add motion data from move ai to my metahuman with facial expressions ? also can i export whole animation for editing ??
this is a game changer. would it be an entirely different process if you wanted to apply any animation you wanted to the body, for the head to attach to? or maybe exporting the head animation but the body is in a T pose ready for any animation?
It surely is! We did show u how to apply body animation at the end of the video 🫡
I also found you need to upgrade your legacy metahumans to 5.2 if you use that engine or newer