@@ForDadsTV yeah. That's not what they would use in professional settings, but with lighting adapters and the iphone's 3d scan ability, you can do amazing things with it. Like, your iphone can literally scan your whole house and render it out in real time. It's fkn crazy!
@@FantasyNero It's not a matter of if the phone is capable, as doing research shows that it can. It's a matter of whether or not Epic can make the software to do it.
Yup UE5 is quite à technological milestone for the industry. A lot is going to change in the background. People might not see it through games and shows/movies but it will be used in a lot of production pipeline now.
It's hard to overstate just how incredible it is to get to 85% finished facial animation (especially since it is now easily editable with animatable controls) integrated into the pipeline in around 3 minutes of real time using a freely-available engine and only a phone camera for the capture. They're playing it cool, but this is a serious flex.
@@korinogaro the only thing really missing for NPCs are human like behaviour. Imagine if NPC act like humans? Hopefully as advancement in AI, we would see it applied in game where there are a billion parameters the NPC can act like at all times.
Metahumans are not game-ready. And they will not be game ready for a few years at least. They TANK the performance of your project. And that is before optimizing with LOD, adding facial animations or adding hair physics. Yeah its cool technology. But Unreal Engine 4.26 without Metahumans is the meta for indie developers. Haha did you see the pun there.
This is quite amazing. You know what they need to do? Go to visually pleasing places and take a stroll and record it, take a recording of people talking, record a couple. Then recreate the scenery and model and animate them in a similar fashion. Then put them in any order and see how many people can spot which one is the real and which one is the Unreal.
It's absolutely insane how quick that process is. With maybe 10-20 more minutes you could pretty much completely clean up the animations and smooth everything out.
@@Rapunzel879 that's the aim of many of the improvements made to unreal. hoping for the best but even with all these advancements, I'm unsure games will come out much quicker.
I've been impressed with motion capture and performance capture for many years. But it's the first time I've seen it done in a way that doesn't require a separate room with trackers, many cameras and an entire team to make it go prrrrr. This is beyond impressive and should help even the tiniest teams to get some great performances in their games. Incredible!
Following their whole process from making Hellblade, she became my favorite person with no prior cinematic experience be able to elevate the character they way she did it is exceptional.
This is a crazy game changer for cutscene animation. Traditional motion tracking is still using reference to start from scratch, while this goes through 80 percent of the process and leaves only a bit of rendering left for the animators. Crazy.
That’s MIND BLOWING… even the smalles of studios have facial motion capture within reach now… what a time to be alive… Unreal is just giving the best tools to developpers right now.
For sure, but this can be hand tweaked to fix a lot of that as far as animation. However, think back just a few years to high budget CG movies like Beowulf, Final Fantasy Spirits Within or even Avatar and how close this gets to that in real time without armies of artists and with almost no budget. It's a huge leap.
Wow, 2023 is off to a great start with all the incredible advancements in tech! From AI to Unreal Engine 5.2, this year is already shaping up to be a wild ride.
Sorry to be pessimistic, but we've been saying that for years and the quality of games has decreased. Everyone was saying ''future looks bright for gaming'' but then we just got disappointments.. The only game that truly reached the expectations from 10-15 years ago is RDR2. Most gamers expected that every game will have the same quality as RDR2 by now, but that's not the case. Even the most advanced technology is useless if the companies are greedy and the developers are lazy and have no passion..
@@mclarenrob2 thats Ubisoft. The unity one is implemented in the engine. so if you write create 100 cubes it will do that or any other task that is not too complicated. Yet
-Phillipa Soo “Exposing yourself to many kinds of art can only lead to amazing things. It helps you learn about your own art, your own taste, what kind of art you want to create for yourself.”
The mouth looks off but with a bit time for adjusting it should be convincing. Pretty incredible for small studios who want to tell character-driven stories.
IDK why people are saying the end result looks "rough". The result was on par with my many AAA titles today, and yet it was done in just a couple minutes using an iPhone. To get comparative performance with tradtional methods would take way more time, money, and skill.
If this tech was used in an online VR setting with more processing power you could have real time facial capture animated on your avatar. Getting closer to ready player one every year.
That would be a online game with quiet some minimum requirements, just for one feature. Unlikely financially feasible in the coming decade, because those games want a huge userbase, i.e. let it run on a potato
You can already do it on sports games now at a lower level. Games like NBA2K allow you to scan your face with your phone and upload it into the game. Not nearly as detailed as this, but the idea is def out there.
Now that we have soundbites from people with the exact facial movements when they said them, it seems like in the future if we have vocal chord mapping, we should be able to also take quotes from people and change the voice to any person we want the same way they effortlessly changed the model as shown at the end of the video.
Uncanny-valley still evident but things keep on improving and it is highly impressive. There are nuances, particularly in the stop/start movements that look a little bit like the old days of stop-motion animations.
Its rough for like a finished game but big budget games that will be using this stuff already has people that tweak little facial movements after they were recorded so this would DRASTICALLY shorten the process its actually insane Insane how every year some tech company unveils their new stuff and each time I'm blown away
@@alexdoan273 It's not perfect, but they didn't really take their time to make any adjustments, they did it in under 3 minutes, imagine if they took 10 minutes to tweak it
Not sure if you watched to the end but after the raw capture they cut to a polished clip. The capture isn't lacking its the environment/lighting/Vfx work that puts it over the top.
everything ive been learning about animation and modelling over the last 5 years? defeated lol. the rate of development at the moment is really incredible.
That rig generation was super fast and the quality looks pretty amazing. Metahuman is truly a game changer the moment it arrived. Always happy to see it progressing beyond limits.
This looks so cool. If I’m not mistaken the little kid model that they showed on the screen looks like it can be a character in the movie Monster House
they did all this in less than 5 minutes on a phone. Imagine what game studios can do with even better equipment and time to properly fine tune the facial expressions.
This is pretty incredible for devs and creators, small especially in terms of accessibility etc, but large too for time and budget and such. Really looking forward to this tech being used more widely.
Looks like a big step towards getting past the Uncanny Valley problem. Though the different faces at the end were weird. That is to be expected from different facial structure.
Surprised no one mentioned Melina's acting at 1:18. She had to perform multiple emotions very quickly, yet it looked so believable. Especially when she's acting scared. Shows what a great actress she really is.
Has nothing to do with this. Thats like saing it would have been impressive if the technician did a backflip or the stage theyre on build itself like a transformer...
Hearing that Unreal worked with Ninja Theory to make a bespoke rig for them to use in Hellblade 2 has me very excited to see the end product of that game as it seems as tho its going to be a major showcase for Unreal Engine 5.
Damn! Still needs a bit of tweaking but this definitely pushes models over the uncanny valley. Ps: all animator’s who painstakingly hand key facial animation are probably mad af right now that this wasn’t available earlier lol
Imagine for a moment you capture the facial expressions in 8K, 240fps... The level of detail in the animation though... Mind-blowing is an understatement!
Picture this, combined with an AI like ChatGPT and you got yourself a... I don't know what... This is getting better by the day, and I'm excited to see where it goes in a few years! Absolutely amazing!
That is likely to happen some places. But, if Unreal is mostly unlocked to low budget teams, this could lead to more small team devs and more games released. In essence spreading the wealth versus a few companies monopolizing everything.
The fact that this doesn't result in uncanny valley shows how close it is. We can still detect imperfections, but beating uncanny valley is a major achievement
I’m no game developer, but the fact that it took less than 5 minutes to do this is mind blowing!
But was this really captured on iPhone ?
@@ForDadsTV yeah. That's not what they would use in professional settings, but with lighting adapters and the iphone's 3d scan ability, you can do amazing things with it. Like, your iphone can literally scan your whole house and render it out in real time. It's fkn crazy!
Don't judge yet, we need to see this real-time when released, so everyone will make a video about it if it's true or lie.
@@FantasyNero It's not a matter of if the phone is capable, as doing research shows that it can. It's a matter of whether or not Epic can make the software to do it.
Yup UE5 is quite à technological milestone for the industry. A lot is going to change in the background. People might not see it through games and shows/movies but it will be used in a lot of production pipeline now.
It's hard to overstate just how incredible it is to get to 85% finished facial animation (especially since it is now easily editable with animatable controls) integrated into the pipeline in around 3 minutes of real time using a freely-available engine and only a phone camera for the capture. They're playing it cool, but this is a serious flex.
3 min for 85% of a 9 second shot.
honestly id say its above 85 the movements almost perfect, but it’s rendering in real time. absolutely insane.
@@ThatGuyMata Its free
@@ThatGuyMata yea its great
That cleanup though!
It's not perfect but this is incredible for how much time this saves and how little needs to be adjusted
What nickpick do you have clown
True, but imagine that you can have high quality close-up while you talk with literally every NPC in some RPG... Insanity.
No worries AI will fix it by next week.
Well, they did do this with a cell phone.
@@korinogaro the only thing really missing for NPCs are human like behaviour. Imagine if NPC act like humans? Hopefully as advancement in AI, we would see it applied in game where there are a billion parameters the NPC can act like at all times.
That deserved a standing ovation. This is so impressive to be able to render this level of quality animation in only 5 minutes.
Everyone is overwhelmed with all the innovations happening all the time. We can't keep acting surprised and blown away every 5 minutes.
@@jmasked5082 bro is not excited 💀
@@jmasked5082 because it doesn't look like your as passionate about it as we are
Metahumans are not game-ready. And they will not be game ready for a few years at least. They TANK the performance of your project. And that is before optimizing with LOD, adding facial animations or adding hair physics. Yeah its cool technology. But Unreal Engine 4.26 without Metahumans is the meta for indie developers. Haha did you see the pun there.
And using a phone as the capture device.
This is quite amazing.
You know what they need to do? Go to visually pleasing places and take a stroll and record it, take a recording of people talking, record a couple. Then recreate the scenery and model and animate them in a similar fashion. Then put them in any order and see how many people can spot which one is the real and which one is the Unreal.
That idea is unreal
TM
you're hired!
This is gonna be huuuuuge for low budget projects, amazing
which will never come out in the frst place
@@rokpepeshogun Spiderman lotus reference
So now we will have better corn animation?
For everyone really
neil breen might be able to make even more amazing movies
Really excited to see what independent filmmakers do with this tech
One man movie... you can create a whole movie alone. Or from clips on the internet. :D
You won't watch it, even when they do. There's so much content out there now, no one has the time.
Zumeckis enters the chat
They don’t need to hire actors.
@@badpuppy3 you're boring
Eerily scary to see that from just a short period of time,from 1990s' onwards,technology has progressed immensely.
Right? 50 years ago was when Pong arrived.
Why is everything going so fast
@@jojothepro15 Technology will keep expanding exponentially. Especially now A.I is becomming to become a thing. It will actually go faster.
@@jojothepro15 Gotta go fast!
@@jojothepro15 That's how technology works. But still... not fast enough.
It's absolutely insane how quick that process is. With maybe 10-20 more minutes you could pretty much completely clean up the animations and smooth everything out.
This brings AAA animation and graphics to the hands of indie game developers. The future is looking so exciting!
Or boring and repetitive
@@jhinabloomingflower807 will see tho
Its looks dystopian and evil tbh
You miss the point. This technology is boring and old without AI-NPCs
Wait till AI takes away your writing job too...then AI will do all the 'developing'. No humans required.
Holy crap! From months to minutes… Games in the coming years are going to be absolutely insane
Let's hope that games will come out faster because nowadays it takes them forever.
@@Rapunzel879 that's the aim of many of the improvements made to unreal. hoping for the best but even with all these advancements, I'm unsure games will come out much quicker.
@@Rapunzel879I’d rather have them take forever and make a masterpiece, than have it sooner and be terrible.
graphics aren't what makes the games fun, as we have witnessed in the last... 7-10 years
Lets hope the file size is smaller.. current game at least 20gb
I've been impressed with motion capture and performance capture for many years. But it's the first time I've seen it done in a way that doesn't require a separate room with trackers, many cameras and an entire team to make it go prrrrr. This is beyond impressive and should help even the tiniest teams to get some great performances in their games. Incredible!
Happy to see Melina is basically the face of a bright-looking future for performance capture.
Following their whole process from making Hellblade, she became my favorite person with no prior cinematic experience be able to elevate the character they way she did it is exceptional.
She's gorgeous
@@darcksonrabelo1866 no cap
who is melina
This is a crazy game changer for cutscene animation. Traditional motion tracking is still using reference to start from scratch, while this goes through 80 percent of the process and leaves only a bit of rendering left for the animators. Crazy.
4 minutes for that level of quality animation is absolutely insane. Can't wait for this
That’s MIND BLOWING… even the smalles of studios have facial motion capture within reach now… what a time to be alive… Unreal is just giving the best tools to developpers right now.
2 minute papers ha ha!!
David Cage : "Emotion is something complex and challenging to capture"
MetaHuman Team : "All we need is a phone a PC and a couple of minutes"
And a cup of coffee (not included for free in Unreal) Engine
A lot of complex things are being calculated by the phone and PC.
It's still in the uncanny valley, but just the amount of workload that's being cut out is amazing!
True. Climbing that valley!
For sure, but this can be hand tweaked to fix a lot of that as far as animation. However, think back just a few years to high budget CG movies like Beowulf, Final Fantasy Spirits Within or even Avatar and how close this gets to that in real time without armies of artists and with almost no budget. It's a huge leap.
the eyes still looks dead !
@@offlinegamer6756 cry to mommy
@@bulletsmichael Why are you butthurt?
This could be useful for artists too, you could take a picture of an expression and showcase it from different angles and use it as a reference
Wow, 2023 is off to a great start with all the incredible advancements in tech! From AI to Unreal Engine 5.2, this year is already shaping up to be a wild ride.
Insane how far our technology has come in the last 50 years. Even in an early state this looks phenomenal!
Imagine what the next 50 years will be like.
50? Try 10.
50 years? Try 15 days.
@@SassInYourClass 15 days? Try 5
@@sandprince4165 5 days? Try 5 minutes
The future is bright for Game development
@@Siranoxz Unity just added chatGPT into the engine
Scary 😱
Sorry to be pessimistic, but we've been saying that for years and the quality of games has decreased. Everyone was saying ''future looks bright for gaming'' but then we just got disappointments.. The only game that truly reached the expectations from 10-15 years ago is RDR2. Most gamers expected that every game will have the same quality as RDR2 by now, but that's not the case. Even the most advanced technology is useless if the companies are greedy and the developers are lazy and have no passion..
@@Irrelavant__ is that just for NPC dialog creation? Im most excited for when AI can actually create game worlds itself
@@mclarenrob2 thats Ubisoft. The unity one is implemented in the engine. so if you write create 100 cubes it will do that or any other task that is not too complicated. Yet
Amazing work guys!
-Phillipa Soo
“Exposing yourself to many kinds of art can only lead to amazing things. It helps you learn about your own art, your own taste, what kind of art you want to create for yourself.”
The mouth looks off but with a bit time for adjusting it should be convincing. Pretty incredible for small studios who want to tell character-driven stories.
Whoa that's crazy. No dots on the face with just a phone. Insane.
metahuman looks more promising than metaverse
Different technologys.
@@AlmiranteLobo yeah no s**t sherlock ☠
You do know that unreal engine 5 will be used for the metaverse and there is a tech called metahero that scans items.
metahuman looked like Mark Zukerberg tho' :v
WTF is "metaverse"??
IDK why people are saying the end result looks "rough". The result was on par with my many AAA titles today, and yet it was done in just a couple minutes using an iPhone. To get comparative performance with tradtional methods would take way more time, money, and skill.
This saves a lot of production time and is efficient.
The devs just need to focus on the finishing touches
Or focus on looking for new jobs or start their own projects
Finally. It's just crazy how game developing time is 2...7 years nowadays
we are near the peak of graphics. What more could you possibly want more than this.
for a process that would take weeks to get to this stage, forming almost instantly, it's impressive.
This is a game changer for creatives everywhere. This technology is going to unlock new levels of innovation for artists! Wow!
If this tech was used in an online VR setting with more processing power you could have real time facial capture animated on your avatar. Getting closer to ready player one every year.
This was my thought as well. You've got to think that's next.
That would be a online game with quiet some minimum requirements, just for one feature. Unlikely financially feasible in the coming decade, because those games want a huge userbase, i.e. let it run on a potato
Sounds like you'd need a NASA computer for that
@@lgolem09l you could just turn it on or off
Imagine one day we have the opportunity to "upload" our face to a character customization process, rather than trying to re-create ourselves... 🤯
Combine that with the programs that can recreate your voice from just a couple of words and people could be playing as themselves.
You can already do it on sports games now at a lower level. Games like NBA2K allow you to scan your face with your phone and upload it into the game. Not nearly as detailed as this, but the idea is def out there.
The whole point of gaming is being someone else no?
So we can have better avatars for social media than the ones on our phones
@@DazHotep6EQUJ5No
Now that we have soundbites from people with the exact facial movements when they said them, it seems like in the future if we have vocal chord mapping, we should be able to also take quotes from people and change the voice to any person we want the same way they effortlessly changed the model as shown at the end of the video.
Uncanny-valley still evident but things keep on improving and it is highly impressive. There are nuances, particularly in the stop/start movements that look a little bit like the old days of stop-motion animations.
honestly, the slight smile seriously impressed me. That part looked the most human to me
Well to be honest
She herself was uncanny in the capture athe very first place
Its rough for like a finished game but big budget games that will be using this stuff already has people that tweak little facial movements after they were recorded so this would DRASTICALLY shorten the process its actually insane
Insane how every year some tech company unveils their new stuff and each time I'm blown away
have you seen Ubisoft games? This is in no way rough! This level of facial performance is already better than many AAA games' already
@@alexdoan273 It's not perfect, but they didn't really take their time to make any adjustments, they did it in under 3 minutes, imagine if they took 10 minutes to tweak it
@@alexdoan273 Keyword "finished" no Ubisoft game is finished lmao
@@misterteee9471 LOL truth about Ubisoft 😂
Not sure if you watched to the end but after the raw capture they cut to a polished clip. The capture isn't lacking its the environment/lighting/Vfx work that puts it over the top.
It is crazy how far we keep advancing in mo-cap! Truly impressive!
This is insane!!!!!
Thanks to Jordan Mechner who started the motion capture way back in 1989, in a game "Prince Of Persia"
It's funny that they chose an actress who herself looks like motion capture when she moves :D
This is insane... it's absolutely crazy to think how much this type of technology has developed. What a great time to become a game dev.
Happy to see Melina again.
Imagine video game performers doing their jobs without a mocap
This is still MoCap..
You mean without the mocap suit
@@trmbne yup its using Iphone to detect our facial structure, so webcam or android phone cant be use since the technology is better on Iphone
You know what Motion Capture is.. right?..
Since the last December, everything in IA is going ultra mega fast
everything ive been learning about animation and modelling over the last 5 years? defeated lol. the rate of development at the moment is really incredible.
What a time to be alive guys! Now imagine old games like PoP with this features..
Mentions PoP, deserves a like. My man.
Prince of Persia?
That rig generation was super fast and the quality looks pretty amazing. Metahuman is truly a game changer the moment it arrived. Always happy to see it progressing beyond limits.
This is incredible tech that is only going to improve over time. Indie devs and filmakers are going to benefit tremendously from this
Competition will skyrocket.
the last few seconds of the capture looked the best of it all
Great work. It gets me woried about actor and actresses's future.
i'm waiting for the combination of Metahuman + chatgpt + whisper + text to speech.
So, it's not perfect, but the fact that this could be produced so quickly is mind-blowing, especially considering this was captured on a phone.
At some point they will release a video like this and reveal the presenters were actually the MetaHumans.
This looks so cool. If I’m not mistaken the little kid model that they showed on the screen looks like it can be a character in the movie Monster House
Feels like we're in the future. Gaming went from lovable pixel art to "life could be a simulation" in the span of
This is easily the biggest benefit for me as an independent filmmaker in Unreal Engine
they did all this in less than 5 minutes on a phone. Imagine what game studios can do with even better equipment and time to properly fine tune the facial expressions.
Minha cabeça explodiu com isso, meses de trabalho em minutos! Eu aplaudi junto com o público.
This is pretty incredible for devs and creators, small especially in terms of accessibility etc, but large too for time and budget and such. Really looking forward to this tech being used more widely.
Awesome! So glad she ended up playing Senua.
This would forever keep people alive no matter what age
Politics getting wild in 10 years
@@LouSipher It's wild enough now ffs
Nice. Pet Cemetery not required.
@@devinsidell It was wilder before. Someone legit made a horse a politician in the past.
Deepfake grandma doing her own funeral service.
Looks like a big step towards getting past the Uncanny Valley problem. Though the different faces at the end were weird. That is to be expected from different facial structure.
Wow. Extremely impressive.
We’re getting closer to the simulation
All the motion capture things just in 5 mins. That's really saved a big time.
This is absolutely AMAZING. Gawdamn!!!!!!!
01:23 Angry while smile 😁 ❤
The automatic rotoscoping alone deserves recognition.
there is no rotoscoping.... the tracking data its being placed on a 3d character with a 3d background.
Its not rotoscoping. That is different.
Rotoscoping is 2d animation technique and this is a 3d model.
it seems the cooperation with alliance is done perfectly
Surprised no one mentioned Melina's acting at 1:18. She had to perform multiple emotions very quickly, yet it looked so believable. Especially when she's acting scared. Shows what a great actress she really is.
This is seriously impressive tech.
There literally cutting days, possibly MONTHS of work out of the process with this and the other procedural stuff they're doing! This is insane!
Not insane, UNREAL.
What would really blow my mind would be if right at the end, it was revealed that the people on stage were actually just a sim running in MetaHuman
Too soon. Maybe in 5 to 10 years
We still don’t have the technology for IRL 3D hologram… All we have right now is a 2D projection on a glass..
Has nothing to do with this. Thats like saing it would have been impressive if the technician did a backflip or the stage theyre on build itself like a transformer...
Baffled me wordless. The time savings let alone the worktime-flow! Impressive! Thats gamechanging
This is absolutely astonishing and is a massive breakthrough for animation technology.
it's not there yet, but it sure is perfect for a quick entry, it's like 80% there. but at low budgets it's 100% there.
This tech makes independent and amateur filmmaking so much more accessible and high-quality
Epics killing it.
This has terrifying uses. Awesome, but also oh no what have we done.
This will change the digital industry forever.
It is really fast to finish the capture…Awesome!
that angry grunt was wholesome
*sexy
Hearing that Unreal worked with Ninja Theory to make a bespoke rig for them to use in Hellblade 2 has me very excited to see the end product of that game as it seems as tho its going to be a major showcase for Unreal Engine 5.
Damn! Still needs a bit of tweaking but this definitely pushes models over the uncanny valley. Ps: all animator’s who painstakingly hand key facial animation are probably mad af right now that this wasn’t available earlier lol
mind blown! from months to minutes! technology sure is fascinating!
Imagine for a moment you capture the facial expressions in 8K, 240fps... The level of detail in the animation though... Mind-blowing is an understatement!
I'm genuinely impressed. Bravo 👏
Picture this, combined with an AI like ChatGPT and you got yourself a... I don't know what... This is getting better by the day, and I'm excited to see where it goes in a few years! Absolutely amazing!
until you ask chatgpt to do anything above a 5th grade level and it completely breaks down
amazing technology
In five minutes to transferred a scene. It's amazing.
The future of gaming is really bright
Wow this will make game development much faster
Congrats to melina on being the face of unreal's metahuman
This would not only revolutionize game design but pretty much anything else CGI related. Fantastic!
This will revolutionize the whole animation landscape
The amount of developers that will be layed out because of this technology will be immense!!!
That is likely to happen some places. But, if Unreal is mostly unlocked to low budget teams, this could lead to more small team devs and more games released. In essence spreading the wealth versus a few companies monopolizing everything.
Wow!! This is insane
Can't wait for the Dark Pictures series or another bigger game from Super Massive Games to use this tech.
Wow the technology of what it can do now is freaking Amazing!
The fact that this doesn't result in uncanny valley shows how close it is. We can still detect imperfections, but beating uncanny valley is a major achievement
That’s pretty impressive
Love it!!!!! Astounding!!!