Unreal Engine Metahuman Facial Motion Workflow with Faceware
ฝัง
- เผยแพร่เมื่อ 17 เม.ย. 2022
- A glimpse into my Unreal Engine Metahuman facial motion workflow with Faceware.
Link to my Discord: / discord
Link to Faceware Webinar: lnkd.in/dyyBd8Yc
Metahumans from Epic Games & 3Lateral doo Novi Sad
Thank you, to an incredible community of collaborations for being a part of my journey and creative process!
Special Thanks
-------------------------
The team at Faceware - Pete Busch, Catarina Rodrigues, Joshua Beaudry, Tatjana Vejnovic and Brandon Suyemoto.
Norman Wang - CEO & Co-Founder Glassbox Technologies
Katie Jo - Senior Product Specialist of Xsens Products at Movella
MANUS™ - Arsène van de Bilt
Puget Systems and NVIDIA
VR Division / Yahiya Jasem - Unreal Environment
Gabriel Paiva - Metahuman Whisperer
Diana Diriwaechter & Emanuele Salvucci - Rendering & Materials
Jonathan Winbush - Unreal Educator
Jobutsu - UE5 Metahuman Tutorials
Artist Credits
----------------------
Michael Weisheim - Original Character Artist
Pixel Urge - Character Body & Face Modification
Daniel Cadena - Character Body Textures
Konstantin D’Lakrua - Character Hand Rigging
Bernhard Rieder - Lighting & Cinematics
Gear I Use:
Faceware Mark IV HMC: facewaretech.com/cameras/markiv
Faceware Studio: facewaretech.com/software/studio
GlassboxTech Live Client Plugin: glassboxtech.com/products/liv...
Xsens Link Suit & MVN Animate Pro: www.xsens.com/motion-capture
Manus Prime II Gloves: www.manus-meta.com/mocapgloves
Puget Systems Workstation & Nvidia RTX A6000: www.pugetsystems.com/landing/...
#unrealengine #metahumans #virtualproduction #facemocap #mocap #facialmotioncapture #motioncapture #faceware #xsens #faceware #liveclient #glassboxtech #nvidiartx #pugetsystems #epicgames #metaverse - ภาพยนตร์และแอนิเมชัน
![[SUB] 베몬이 교관님 멘탈을 탕탕 후루후루~٩(๑❛ᴗ❛๑)۶ FOREVER 웃게 되는 갓기들의 수련회 | 돌들의침묵 | BABYMONSTER(베이비몬스터) 'FOREVER'](http://i.ytimg.com/vi/FISAO7BwIxE/mqdefault.jpg)
"During the process of creating, that is when you learn the most. You find solutions to problems and create new pipelines" - this is so so true! Great video!
Just to put this in perspective: she is using at least 47 168$ of hardware, not even including software licenses. So the result is really nice, but it's also very proffesional gear.
Not for your average 3D Artist 🥲
Faceware Mark IV $ 28,749
Xsens MVN Link $ 13,630
Manus prime II $4,789
Exactly! haha, I was like shit you quit bartending and bought 50k worth of the highest end gear to make a short for yourself? -- That must have been some seriously nice bar:)
Amazing! Thank you so much for documenting this process and sharing with all of us.
This is the best model I have ever seen. Good for you for giving the proper credits to your contributors :)
Not even sure what to say. You are amazing. I'm slowly getting into UE5, focusing on lumen and nanite, however it's hard to ignore how incredible this platform is in so many other aspects. Thank you for sharing this.
I've been working with unreal engine and 3d applications for 15 years, its really great to see how elements of the engine have become very intuitive for people like yourself to just jump in and create awesome work without years of experience under your belt. Very talented work and I'm glad you are able to express your creativity without a problem using ue5
Thank you so much for your kind words!
Is Blender + UE5 a good choice, from the career standpoint, for somebody starting out in this space?
The eyes wide open as a sync point is a gem! 👍👏
Setting the example for the rest of us, just amazing
Having a team just for a dedicated work flow is very helpful. As a solo artist, I struggle alot due to lack of limited online information, funds and time.
You all r great and doing 100000x great job than mine 🙂. I m steel limited to use manual key framing for animations.
Congrats! Looks Awesome. This level of tech is ahead of what artist have been trying to do for decades. Totally Next Gen.
Gabriel, its very very cool👍 Thank you for studying this awesome job and sharing your experiences and knowledge with us. Develop further and share with us. We will support you by getting inspiration from you. I hope that transferring your project to UE5 will be a big bang, in the field of animation, graphics, motion capture and much more. Your 3D model is as beautiful as you are🤩 Greetings from sunny Kazakhstan🖐
The uncanny valley is slowly disappearing. This is gorgeous. Can’t wait to see it in video games, imagine the drama the characters will convey with those realistic expressions.
What a wonderful person you are!
This is by far the best mocap result I've seen so far. There were no jerky movements and the mouth didn't half way open like other videos I've seen. This is perfect.
Mocap always looks better if you have tens of thousands of dollars to work with
By far the most interesting, valuable, insightful look at this world which I have only recently begun to seriously learn. I really appreciate you making this, instantly subbed.
The riggers on this are gods. This blows my mind.
Brilliant video thank you - I am starting out with performace capture, with the emphasis on performance. Your character's aminmation is so nuanced! Inspired.
Thanks so much for showing us the process. Looking forward to learning more.
Thank you for this! keep up your amazing work and sharing 😍
Beautiful work.
Thank you for explaining your process.
Subscribed.
Talented and beautiful, willing to share her experiences to make others better.
just amazing, really impressive work
Wow, you made an amazing leap. Very cool. Congratulations.
Κάνεις φανταστική δουλειά !!! Συγχαρητήρια !!!
fantastic! will sub! Im just starting my journey into unreal and i couldnt be more thrilled! this is great! keep it up!
felt like a lone wolf geeting fed, thanks!
Bravo. I love this!! Well done!! Inspiration for me to up my game.
it was the best motivation for me as a demotivated artist these days. thanks.
Outstanding
Fantastic!
This is truly inspiringggg!!Keep going Gabz
Most impressive, a consistent inspiration!
Amazing, excited to see more!
Awesome work! Can't wait to see what you can do in Unreal 5!
For the people who think this is accessible, all of that is over $40k worth of equipment. Just saying...
You can now do it with a camera or 2
@@criscanto7040 lol I we all wish.
@@TheFunDimension not kidding I work with AI I can translate movement in my camera to UE
@@criscanto7040 can u share ur workflow?
@@criscanto7040 you know it doesn't fucking look anything close to as good as this lmao the hand rigs are insane.
Wowww.... Superb.... 😍 😍
so amazing
Very well explained. Great work on documenting this and explaining it so succinctly.
Thanks for this! Amazing work 💥💥. Can’t wait to see what’s next, Feeding Wolves :)
This is awesome!
excelent video your work is cool, I hope you can execute all your ideas and projects with great success. Blessings.
this is so good!
Great work!
I can’t wait to see this in actual video games
Most excellent ... WOW
This is crazy awesome!
I love your channel. That's great.
Technology is insane dude,
Amazing videos.very inspiring.
Amazing job! Thank You!!!
your a bluddy legend
Brilliant
Mind blowing!
just beautiful
AMAZING!
amazing
really insightful thank you
interesting video you are super talented and a inspiration!
Saw you mentioned in an Epic Games metahumans talk at SIGGRAPH in Vancouver today- had to look you up. Incredible work! Especially for a newly self-taught person, this is inspiring!
Thank you so much!!!!
Incredible. 😊💯
Awesome!
I really admire you!
awesom
damn this is amazing
Amazing!!!!!❤👍
This is the go to benchmark.
Dats my Girl!!! GET SOME!!!
awesome talking animation
Whoa!
Incredible work Feeding Wolves!
Stunning amount of information, great video, thank you!
Just went on their website to check the pricing and the system (Mark IV) you're using right now is 30 grand usd? Bananas
This is what the Metaverse should have been!
Amazing tech. Little bit of sticker shock when I seen the 30k pricetag (For just the Mark IV Wireless Headcam System). You can't deny the results though. Look fantastic.
I would be so happy to invest in these products, as soon as they do away with the ridiculous subscription costs. ^_^
Awesome work. I'd love to work on a project together one day! Kudos!
3:24 in you answer my question thasnk you very much you are the very very best
Ziva looks more true to life to me. I think you should try it.
like you i am trying to change my life using unreal. Thank you for the inspiration.
Its going to happen sooner than you think! Keep at it!
@@FeedingWolves your so kind, thank you for the nice words!
The jitter smoothing looks good, you make UE look real good. I think the reason it still looks stiff at some parts of the face is the rig. Most sliders on the rig is a 2 way axis. So this looks like a great previz but i wonder if it'd be possible to fully utilize the axis on each bone for the final shot somehow.
Thank you so much! I am not sure if it is possible to fully utilize the axis on each bone.
This is VERY interesting. How do you do you do such things? Can you make an in depth tutorial??
(Great work Feeding_Wolves, blown away as usual.)
Inspiring af
Hi! Your video and workflow is amazing! Really open my eys to a new virtual world! I am a blender user and very interested in learning blender / metahuman / Unreal. I am very new to Unreal 5 and very much hope that you can make a in-depth tutorial to help show the steps! It really helps newbie like me try to enter this fun world like you! Also, I love the presentation of your avatar, she looks very pretty! Great work and hope to see more videos from you!
Thank you so much! Wish I knew blender a little better so I know what it is like using a new software. I will be releasing a full course soon for this metahuman motion capture workflow, so stay tuned!
@@FeedingWolves Thanks and looking forward for your tutorial! Have a nice day!
By far the best MetaHuman character in the community. I'm very excited to see the evolution of this project in the future.
WOW this is beautiful, how do you syncronise the audio when using a meta human?
This is so so helpful, as always Gabriella. You make such clear, awesome videos. Faceware is so great - I just wish they employed someone like you to fix their “how to” videos and help resources. They are outdated and don’t help with common bugs and issues. Btw Faceware studio is heavily dependent on having major contrast between lips and skin, and strong eyebrows. I have pale skin and pale-ish lips, sparse-ish eyebrows, plus a beard/mustache. Faceware Studio doesn’t work unless I wear heavy makeup. :) I have FW studio and also own analyzer/Retargeter which is much more accurate but harder to use. And is buggy with metahumans and maya - crash city! 😂
Thank you! I personally do not have a beard lol so I haven't experienced this issue. I know the beard might confuse the tracker because you really want your mouth visible for it to get good tracking. I also recommend trying the different tracking methods - stationary vs professional head cam options. I have not used the Maya pipeline so I am missing out ;)
Awesome stuff! You must have been a genius level bartender 😅😉
hahaha well I was a bartender for the last decade, I would hope so!
Thank you so much will this work on Daz characters too?
30 yers exp.. Thats amezing ... its wold take me some month or 2 to make this from scratch in some 3D soft.. With 1 year exp.. Thats Crazy.. Modern Stuff..
I really enjoyed this video. I am proud of you! So, does anyone you know use their Metahuman to livestream? I am having a hard time finding real time content. Thank you!
Um, not to diminish anything you are doing (it *_is_* extremely impressive), but why are you doing this, and who is funding your project? It all sounds very intense and *_very_* expensive.
10/10
Hi gaby, nice project, where can i get the clothes that you used?
amazing feeding woles
5:34 "faceware will get you 90 percent of the way there" - Thanks for this stunning video. Question about this one quote: Is there any place where you compare the raw faceware images with the final? And did you ever get more of those jitters solved? For example is the facial tracking you show in this video, say at 1:20, is that raw or processed (by you, by hand). And if it is processed how long did that take per second of video? Did you find it mostly a problem with mouth closures on the explosives? Thanks
Hey Gabriella, It's amazing that you showcase the facial animation quality that can be achieved by a single person. Looking forward to see your continued journey. I have a few questions:
1. How much time did you approximately spend on manual clean-up and additional animation in the video's that you have shown so far? Or what would be a good estimation to achieve your quality level for 1 minute of continued speech animation?
2. Did you fully manually animate the tongue or did you use some tool to help you with this?
3. Can you show a side by side comparison of the raw motion capture data vs the post-processed (incl manual work) version? I'm quite interested in the visual difference.
Thanks in advance and keep up the good work!
Thank you for your kind words. To answer your questions:
1. It is hard to give you an approximate time on how long each performance takes for fine tuning. It really depends. The Greek metahuman robot girl took me three days. The one following that, that had more dialogue and took a bit longer.
2. I did animate the tongue manually and used my own reference video to figure out when to drop those keys. I show my process for this in the intro of this video th-cam.com/video/Yxm9qMo9gyQ/w-d-xo.html
3. Raw vs processed data..skip to 6:32 th-cam.com/video/S6-JkiqlGRM/w-d-xo.html so you can get an idea of what the data looks like raw with the additive layer disabled vs it enabled.
Why are the lip animation so much better here than with an iphone and live link?
Is it possible to use an Advanced Skeleton rig that uses a Metahuman rig for the face?
Rad.
👏🏼 👏🏼 👏🏼 👏🏼