Unreal Engine Metahuman Facial Motion with Faceware Mark IV and Glassbox Live Client
ฝัง
- เผยแพร่เมื่อ 25 ส.ค. 2024
- This was my first attempt at trying to capture 1:1 facial motion with Metahumans in Unreal Engine. What I loved about this experience was that I was able to do everything entirely in Unreal.
Throughout this process I developed a method of fine-tuning facial motion thanks to the face control rig board, that I will be sharing in an upcoming tutorial.
Equipment: I captured the face and body motion simultaneously with the Mark IV HMC by Faceware and the Xsens Link suit/Manus Prime II gloves.
I streamed in the facial motion directly into Unreal via the Glassbox Technologies Live Client plugin from Faceware Studio.
All of this, being powered by a custom Puget Systems workstation with an NVIDIA RTXA6000.
Thank you to Epic Games and 3Lateral for making these high fidelity Metahumans and the incredible tools in Unreal Engine available to everyone.
Thank you to everyone at Faceware (Catarina M Rodrigues, Joshua Beaudry, Karen Chan (she/her) and Pete Busch), at Xsens (Katie Jo Turk), Manus (Arsène van de Bilt), Glassbox Technologies (Norman Wang and Johannes Wilke) and at Puget Systems.
Thank you to my Unreal Fellowship collaborators for your troubleshooting assistance, Gabriel Paiva Harwat and Diana Diriwaechter.
Thank you to Bernhard Rieder for your lighting assistance, and to Daniel Rodriguez Cadena for customizing the female character body textures. And thank you to Pixel Urge for modifying the character body to allow for the metahuman face to be attached and for teaching me how to modify the Metahuman face textures in Substance Painter. You rock!
Female Robot character by Michael Weisheim Beresin
Music by Epidemic Sound
#unrealengine #metahumans #facemocap #motioncapture #virtualproduction #nvidiartx #pugetsystems #epicgames
#mocap #xsens #faceware #metaverse - ภาพยนตร์และแอนิเมชัน
Holy cow this is by far the most accurate facial performance capture I've seen more metahumans, looking forward to the tutorial.
Wow, thank you so much! Big fan of yours!
Super awesome Gabby I know how much work you put into this, looks amazing! 🤙🏾
This is beyond belief...
OMG
Sooooo good!! WOW! When you do the split face my jaw dropped!! So inspiring to see this Gabby!
BEAST MODE!!!!!
killin it homey
This is genuinely impressive! TYou just earned yourself a sub! Keep up this dope content!
As always, great job G!
Looks awesome, looking forward to your tutorial!
I think even Epic and Andy Serkis will be surprised by your achievements. Just unbelievable.
Tremendous work Gabby! We are so proud to support creative artists like you. Bravo
Best facial capture I have seen with Faceware! Nice work
Thank you so much! I am a HUGE fan of yours! Your tutorials were some of the first I learned from when I first started learning Unreal! You rock!!!
⭐️⭐️⭐️Amazing ⭐️⭐️⭐️
You're amazing. Thank you for all you do :)
Nice!
Awesome work!! I love these videos, keep posting :D
Awesome work! Looks amazing.
Doooope!
so good!!!!
Wow! This looks great! Quick question... Is the lipsync raw from Faceware Studio or was it baked and touched up? While it's a bit jittery in parts, I think it's incredibly accurate for real-time results. The split screen with your live action footage was a really nice touch!
Thank you so much! And yes, Faceware got me 90% of the way and the rest I utilized controls that are only available on the control rig board.
@@FeedingWolves That makes total sense and it shows that you combined the strengths of both a real-time and a post-process workflow. Great job! I'm also happy to see your work getting the reactions and recognition it deserves.
@@echoperformances Thank you so much! You are so kind! I appreciate that so much!
I really love this kind of projects!! New follower here :D
looking great!!
great progress!!!
I love this sweetie so much!
yeaaahhh. Very very goodness. Greaat!!
when are you dropping the tutorial for this??? cant wait!
🤩
This is very realistic. Excellent work. However we are waiting your tutorial because for many of us it is impossible to get these results with Faceware studio.
It is coming, I promise!!
excellent work! how much time you put on this amazing work?
Thank you so much! One week 😉
@@FeedingWolves great job
WOW!!! When will the tutorial come out?
haha soon!!
why model face is symmetrical?
This looks fantastic. Unfortunate that this takes around $20K plus subscriptions to do right now though ☹️
Using an iPhone with a true depth camerac and the free companion UE “live link Face” app, this can be done with no subscription, no cost.
Maybe not as refined I’ll give it that 😂
Thank you! And I understand, the HMC is not cheap, however, I am working on a tutorial showing that you can get great quality data with even a video recording captured from a dslr. Thats how I started before the HMC.
Actually the 2 major things that give it away is 1) the eyes just don't have the same depth, especially at the corners of the eyes. 2) The skin itself and the shadows in places like the corners of the mouth missing or so soft it looks weird. Overall it's not bad, but there is a depth missing to the face that is just missing on the model.
Hi, where i can get the Clothes that you use
Can I use it to make a live streaming podcast? Please let me know thank you.
You can stream in any type of video data into Faceware, including iphone and webcam footage, so yes!
How much ....
...We gotta see your workflow.
lol, I know I know, developing it as I create!
Not really SUPER real. They are matte and lack strong reflections. And look closed bit too much but it might be the way they are painted. Area of lips is having this little twitches all the time. It sure looks great but I am not in awe.
Hallo
Заебись.
Nothing new, nothing impressive