Enzo: Vitruvian Metahuman | Real-Time Filmmaking in UE5 with Mesh to Meta Plugin
ฝัง
- เผยแพร่เมื่อ 25 ส.ค. 2024
- An in-depth behind the scenes will follow so that Tomas and I can show our workflow and what it took for a team of just two artists to create this.
This Greek speaking Vitruvian Metahuman was created in Unreal Engine 5 and was brought to life with the revolutionary Mesh to Meta plugin by 3Lateral and the Metahuman team at Epic Games. This is dedicated to them.
What would have cost hundreds of thousands of dollars to have a person scanned, fully rigged at a level of quality only studios could afford, customized and brought to life as a digital human, is now at the artist's fingertips, for free.
This has allowed me to collaborate with talented character artist Tomas Sackmann, who not only sculpted the original head mesh from scratch along with the metahuman body morph, but all of Enzos textures.
The Vitruvian Sculpture was also done by him sculpted manually in ZBrush respecting proper proportions and human anatomy. We imported the high res sculpt using Nanite to maintain all sculpted details.
The Vitruvian structure, also tailored to the exact dimensions of the original drawing by Leonardo da Vinci was constructed and rigged by 3D artist Pixel Urge and final touches on the textures were done by Tomas.
This project allowed me to combine all of my virtual production equipment to create this.
For the facial performance I used the Faceware Mark IV HMC and Faceware Studio, to stream the data live into Unreal using the Glassboxtech Live Client plugin and record it.
For the body performance, I combined body data from Xsens with the Manus Prime II gloves, which was also used to create the Vitruvian man sculpture by merging the Metahuman motion capture data into one static mesh.
The backbone of this project was the Puget Systems workstation tailored by Kelly Shipman and his team, utilizing an NVIDIA RTXA6000.
All of the motion capture fine tuning and cleanup was done entirely in Unreal with Control Rig.
I want to thank everyone that touched this project.
Roberto & Carlo Sansonetti from CGCircuit for giving me permission to use the head and body meshed created by Tomas during his courses on Creating a Realistic 3D Character.
Link to course: www.cgcircuit....
Simon Kay - I am so grateful for all of the knowledge you shared with me throughout this project and have played a huge role in my journey. Including your Mobu course when I first started out a little over a year ago: mocappys.com/
I continue to apply what I learned from your course in my Unreal motion capture editing pipeline.
Metahuman Troubleshooters
Sergey Vereshchagin - you helped us bring in the body morph from Maya to Unreal and we couldn't have done this without you. Thank you for all of the time you took to help us troubleshoot.
RealtimeGraphX - assisting me in the early stages up until the end with Metahuman morph technicalities.
Lighting Advisors
Bernhard Rieder - You have taught me so much about lighting and cinematography. There is a lot of you in here.
Diana Diriwaechter - Thank you for touching this project with your support and keen eye for lighting.
Kelly Shipman and the Puget System team - you tailored a workstation made for the Gods. This was the backbone of this project along with the NVIDIA RTXA6000. Thank you for helping creators like myself bring our work to life.
The following Motion Capture companies that breathed life into Enzo were the heartbeat of this project.
FacewareTech - Peter Busch, Josh Beaudry, Tatjana Vejnovic, & David Yoon. None of this would be possible without your tools and incredible team support. Thank you for believing in me!
Xsens/Movella - Remco Sikkema, Thomas Watabayashi and supporting team. Your motion capture data is what brought this together! You were the muscles of this project.
Manus-Meta - Arsène van de Bilt, your company and you were a true breakthrough for me.
GlassboxTech - Norman Wang, you are such a genius and one of a kind. Johannes Wilkes, you were always on point when I needed you.
Emanuel Salvucci & Sean Spitzer - You have never let me down, ever! From rendering to blueprints, you are always dependable.
Jamie Hurcomb - thank you for documenting part of this journey with your beautiful presentation at SIIGRAPH.
To everyone else that touched this project with even the little things like taking time to answer my questions and share your feedback:
~ Ratha Chea ~ Jonathan Winbush ~ Marc Morisseau ~ Pavan Belagam ~ Gabriel Paiva
~ Peter Lisch ~ Sky Ferren ~ Simon Habib ~ Jobutsu ~ Yahiya Jasem ~ DJ TC Czar
~ Tony ~ Ernesto Arguello ~ Connor Buchanan
Motion Capture Performance, Lighting and Cinematography inspired by TV show Snowfall and Tommy Maddox-Upshaw, ASC.
Music by Grant Newman from Epidemic Sound
3D Assets and Softwares:
Unreal Engine, Adobe Substance 3d, Autodesk, Maxon Zbrush, Zwraps R3DS,
Turbosquid
#UnrealEngine5 #Metahumans #virtualproduction
I think even Leonardo would be blown away by this!
This is a masterpiece! The texturing, the INSANE macro shots, the movement, color, lighting... just wow. Incredible work!
Thank you so much!!!!
Thank you so much!
I was write something but you resume in a few words... Such a beautyful work!
I waited and waited...and then the magic happened at the end!!! Well done team!!!!! Gabi, this is beautiful!! the Greek dialogue is an awesome icing on the cake :)
haha I love it! Solomon, thank you!!!
Μπράβο!! Bravo!
Thank you so much Solomon
Spectacular
Awesome ! 👍
Thank youuuuuu
Wow i loved the camera work and the symbolism in the story, this is really good
Turned out awesome!
Awesome! Lights are way beyond
Thank you so much!!
Great job Gabby, now Enzo can finally take a break 😃👍😜
Thank you so much for your help!
stunning, how you got the fingers to interact with the arm like that, wow
Masterpiece!
Great work !
Thank you so much!!! Now let's get back to retargeting in UE5 hehe
Looks great 🍻
Well Done!
Great music, great performance, great message - thx for your inspiration and this pioneer work - imho its a incredible mix of passion&technique
Sublime
so good!
Next level! Great work!
i am so impressed Gabriella, congrats to both of you
Fantastic work as always Gabby!! Wonderful homage to Leo & Vitruvian man
Stunning! The animation, the camerawork, the blood vessel, the nails ... I didn't think this level of detailed expression was possible. You have significantly raised the bar. Amazing!
Wow! Thank you so much!!!
This is amazing!
Congratulations! The final result looks great!! 🥳
Thank you so much for helping me!!
applause the kind of the creation envisioned to spark the render of this symphony and thus vibrate the sense of its artistic composing.
This is beautiufl amazing work well done.
Amazing!! You did such great work, and It's only the beginning!! Bravo!
Beautiful work. Love it!
Nice work Gabby, you've raised the bar!
wooww crazy 😍😍
You did it again! Incredible work 👏👏👏👏👏👏👏👏
With your help of course!!
@@FeedingWolves 😀
Everything is amazing from animations to lighting. 👏🏻🥂
Awww thank you!!
Really amazing. Well done!
Absolutely superb!
Loved the lighting! Also, crazy animation on the hands touching the arm!
Thank you so much!!!
AMAZINGGGGGG!!!! bravo!!!!
if you ever need any additional team members or artists for your next production...count me in!
@@TheDavidTurk do you even need to ask! That is a hard yes!!
@@FeedingWolves yes!!!! 😊
fire
This is incredible! 😮Seriously well done!
2:55 I love this part!!
Great artistry, attention to detail, production quality. Congrats!
Thanks a lot!
Super 👏🏻👏🏻👏🏻, great work 👍
captured emotions are so good 😊 feels the weight in the scene.
❤️🔥🔥
The production quality is amazing!!
Wow
I read the comments and realized that all the epithets of the highest order have already been used to describe this work.
I ask the author to excuse me, but I intend to repeat the following:
Incredible skin work.
Very cool animation! Is it motion capture?
The performance is real theatre. I literally lived the emotions of the hero.
Exclusively! Thank you for your hard work!
Wow, I cannot thank you enough for your kind words. Thank you so much!!! Your comment made my day!
Insane shots gabby, can i take a help hand
Well done!!!!
Jeez, goosebumps much? :)
This Is art
Wow, thank you!
Thanks a lot! :)
Wow its so Great.👍👍👍👍Greetings rosuckmedia
...Wow
😯🔥🔥🔥🔥🔥
You are complete and total fire!❤🔥❤🔥❤🔥 This is so darn creative and meticulously arranged... I am severely impressed with it all, the sounds and the entire composition is very professionally done! You are a whole vibe ❤🔥All of your investment of time, energy, will power, desire and money will soon be your biggest dream come true! I love it👏👏👏 Bravo!!!!👏👏👏👏
Thank you so much!!!
this is amazing
well done!!!
the only thing bothered me was the depth of field and some aa issue
but it looked great
Wow, by far the best thing made with metahumans so far... Congrats!! It's just such a pity that the Depth Of Field of unreal engine still looks so jittery and un-realistic, ISN'T THERE A WAY TO FIX THAT WITH SOME CONSOLE COMMAND? Btw! by increasing a bit the "Cast deep shadow" in the lights, the eyebrows will look much more realistic. But you're a master, not giving any tips! And you have such a great taste!
Thank you for your inspiring work!
did you manually tweak that animation for the fingers to the arm or did ue5's ik help with that any? It was all beautiful but that perfect interaction with the arm was fantastic.. as was the facial mocap.
loved all the details like the scratches and blemishes as well.. really fleshed the character out
Aww thank you so much. The shot where the fingers are touching the skin was mocap, and I modified specific curves in the animation via control rig to fine tune the fingers making contact with the skin. Ill show that in the behind the scenes ;)
This is incredible work!!!! My mind is blown!!
Thanks a lot!
Stunning! So well done!
Thanks!
Enzo is gorgeous.
Rockstar Feeding wolves :)
Thank you, Pavan! Every project I do starts with you walking me through something in UE5! You are the rockstar!
breathtaking work! Another banger. Huge congrats to all involved! 🇬🇷🇬🇷🇬🇷
Thank you so much, David! Couldn't have done it without the help of your team!
Cool tech demo, but poor pacing issues as a narrative. There's a power that comes from showing characters in thought, but too much is lost to superfluous shots in this short film.
please do a backstage!)
haha I am working on it right now!
Congrats to everyone involved. Amazing work.
Thank you very much!
we wuz greeks
Vitruvian man: afroamerican? lol
Wow