Unreal Engine 4 Metahuman Live Link Face App vs Faceware
ฝัง
- เผยแพร่เมื่อ 22 พ.ค. 2021
- Unreal Engine 4 Metahuman Live Link Face App vs Faceware,ue4 metahuman live link face app vs faceware,live link face vs faceware,faceware vs live link face ios app,unreal live link face tutorial for metahuman,faceware tutorial for metahuman,live link face app for android,unreal live link android,live link face ios app,live link face android,live link face ipad,unreal live link face android,unreal live link android,faceware studio download,faceware studio vs live link face app,jsfilmz
#facewaretech
#metahuman
#unrealengine4
#ue4
#livelinkface
#jsfilmz
Buy my courses Unreal Engine 4 Lessons to support my Channel!
Sellfy Link:
sellfy.com/jsfilmz
Buy my course Udemy Link:
UE4 for Filmmaking Beginners Edition
www.udemy.com/course/how-to-c...
Create a movie in Unreal Engine 4 using Metahuman
www.udemy.com/course/how-to-c...
Buy my course from Artstation
www.artstation.com/marketplac...
How to make a movie in Unreal Engine 5 Beginners Edition Sellfy Link:
fpvltjxd.sellfy.store/p/how-t...
How to make a movie in Unreal Engine 5 Beginners Edition Artstation Link:
www.artstation.com/a/7481092
Udemy Link
www.udemy.com/course/how-to-c...
Check out My Linktree for more:linktr.ee/jsfilmz - ภาพยนตร์และแอนิเมชัน
Great video.Thanks for the comparison! - Both systems seem to have issues with phonetics that use puckered lips; F's & S's. But there wasn't a huge difference between the two. The free Live Link App get's you about 90% there without spending anything. (Great if you don't have a ton of dialogue in your game or application). Faceware's subscription model looks greedy by comparison. It's great that it allows for tweaking, but I wouldn't exactly call it a Ferrari.
Live Link seems like the place to start when you're drafting your piece. Great for getting your idea together for pitches to clients or investors. (IMO)
As far as the iPhone gripes, they all have pretty simple work-arounds.....
- Firstly, 3 minutes is a pretty long shot. It's a lot of dialogue in a static cinematic shot and it a far longer shot than most music videos out there. (I worked on some videos that went to MTV in the 90's. We'd certainly do multiple run-throughs of the song for edit, but if the video had been previously story boarded, we'd just do multiple takes of single shots. (20-30 seconds at most?).
-- Secondly, putting ones phone into DND mode is pretty simple in the new IOS version. It can disable both phone, wifi messaging & notifications.
- Thirdly, I don't see why one would have to be close to their computer... The app is connecting to your computer though your wifi. It's not doing a peer-to-peer connection (like BlueTooth, which is still 30+ ft range). So you SHOULD be able to be connected anywhere in the house/office where both devices are connected to the same wif-fi. -- But realistically, unless you had two people running the rig, you'd want to be somewhat close to your computer anyway. Right?
hi, Great stuff. Thanks for that.
But a small note: In my experience, significantly more motion data arrives in Unreal when the signal is sent over a LAN adapter and not via WLAN.
This results in noticeably better mouth movements.
Maybe worth a try for future comparisons.
yes but then again i was not able to have ethernet hanging down combine with motion capture, even with a long cable my motion was very limited, be fine if your sitting down like my example here
Very nice comparison. I'm finding Faceware Studio to be much better for mouth movements, I've tried the curve pin thing for Live Link Face (along with a couple of other adjustments) but found it created other problems with the mouth area. Oh and I thought it was just my second hand iPhone being a bit faulty but I guess overheating is a common thing with the app haha
watching this vid actually stopped me on buying an iphone. I will never finish to thank JSFILMZ
Good stuff man! Love seeing the progression. Keep it up
appreciate it man!
I made all the settings, but the character's neck does not move, only the face movement works. I also checked (is there a problem with the blueprint?)
Hi there, want some help with live link face, I've connected everything and I see the face animation come through, but it drops in and out every 3-4 secs, I connected the iphone with lighting - usb c cable, but none of that helps.....
Any solutions? Thanks!
I think both results have their pros and cons. The livelink I feel has better fleshiness and in-between motion (which i expected as it's a 3d tracker) but not very good lip shapes on their own (probably from the fact 3d morphable models based on blend shapes in my opinion and experience struggle with that as they're not bespoke to the captured lip shapes unless they have correctives as apart of their pipeline) and faceware seems to have cleaner lip shapes that seem more accurate in that respect but it overall feels more robotic and puppet like (which I kinda expected since it's 2d monocular capture medium) but then again, I don't know if that's inherent to the method of capture or calibration here, but regardless I am interested in combining the two, maybe using the livelink as a first pass, then enhancing eyes and lips with the faceware directly as if I was animating the livelink model as you would a rig.
Great Video , dude , as always 👍 ...BTW , natural pose calibration is coming in 4.27 for the Live Link Face App 😀
hahahahah yea i know thats why i hinted idk if its coming back ;) hahahahha didnt want to spoil it well see. apple and epic games still has that lawsuit so the future if livelink is questionable
Do you have a link to stylemarshalls setup? I’ve been following him for a while but I don’t see his video on it. I’ve been using reallusion’s guide from their forums, but the lip / mouth movement is really lack lustre with the iPhone (I’ve have a VOD on my channel from the other night with it). I grabbed faceware with your code to test and like the results a lot, but have struggled to get it working with a CC3 based character in ue4
UE5 did some significant upgrades to the face capture too
so when will we see this app on other platforms like windows or android or is that an issue?
Great Video , dude , as always 👍
Why WHY YOU HAVE ONLY 26000 FOLLOWER. I love your content
hahahahah its all good man thanks
I agree . Thanks to your channel, I decided to get creative. thank you for the motivation. more jokes
@@MetaHuman2077 Same!
be patient, in the end of 1 year i think he will hit 1mil for sure, and we will be here to testify :D
Subscribers do not always equate to views and likes, I have more subscribers but a lot of people really dislike my stuff and nobody watches LOL, JSFILMZ is much loved!
Aww, this made my day! By the way, awesome how you did this comparison....actually kind of genius!
i learn from the best, now give me your link suit thanks ur so awesome
@@Jsfilmz Great comparison JSFILMS, obvious Iphone Live Face is better cuz of Depth Camera, faceware works from Python just Facemarks, thats never gona be such accurate like DepthCamera.
Faceware wins for me... also, it has a feature I really need - the ability to record the facial mocap to a video file for later tweaking and retargetting. I will be getting facial mocap from my voice actors (in some cases, celebrities) by visiting them. I would like to be able to just use a dslr or have a simple laptop for this. Then feed the video into Faceware later.
Thanks for vid bro. Put phone in do not disturb mode and have dry ice in protective casing.
You should try the Jali facial capture with metahuman!
This Is the video I need Thanks. I also hate Iphones but as I dig in to the metahuman and vtuber realm I realize I need to either find the money for a Iphone 13 pro or use something els. As I have a plan to solve a common problem with metahuman vtube setups
Another great and very timely video thank you. The Faceware impressed me in just the sense that the guys eyes were looking at camera (likely because of the calibration you mentioned). Also....You do seem ideal to make a video on hardware recommendations for using metahuman and mocap to get photorealistic imagery. I find myself looking around your room while you are talking and looking up the gimbal you mentioned. Personally I would love to know what you think would be best in terms of both a laptop rig (I travel all the time) and a home rig, to get the best quality (photorealistic) output. I'd enjoy getting all the little details like hard drives, graphics cards, gimbals, gimbals, microphones, mocap suits, backup system etc. Also, if I want to collaborate with someone on an unreal project is it possible to share (characters etc) or do we have to both have access to the same accounts?
Also, given that we can't really alter the metahumans (even in maya, correct?), what is the second best way to get hyperrealistic faces that we create into unreal? I have hired out two characters (a Charles Darwin and a John F. Kennedy) but I'm still not sure how metahuman they will look. I want perfect. Is metahuman the only way?
Finally, Faceware doesn't appear to require any phone at all. Probably worth mentioning for those like you and me who hate iphones. It appears to work with Android or even a video camera.
Faceware is slightly better, both animations are quite bad tho. I doubt it's possible to make a convincing face capture with just a mobile phone.
It's a good starting point for animators and great for timing acting beats. I wouldn't depend 100% on the hardware.
The problem isn't so much with the capture tech, it's with facial movements not really translating to CG characters. A facial movement that looks natural on a real person looks odd on a CG face, and the closer to real the face looks, the more this feeling of "this isn't quite right" is heightened. For example, a mouth opening wide before starting talking looks normal on a real person, on a CG character it looks weird, like there's a sound missing at that point. Also some articulations like the tongue touching the roof of the mouth for certain consonant sounds which aren't translated visually.
@@Monoville Ok ok, but have you seen the Metahumans talking heads demo? What technology did they use? Because the animation was pretty amazing.
@@JaroAtry I did, I feel like they might have been quite selective about the mouth movements they showed and the ones they hid, and the choice of words used. Also probably a lot of manual tweaking. I can imagine them possibly coming out with their own facial capture app at some point. It's still very early days for the technology!
@@JaroAtry Actually, there is another trailer which shows more of the mouth movements alone (and the UE4 project itself which has the anims). Would be nice to find out how they did it, if it's not just a lot of manual adjustments.
Interesting, not one single word about the actual quality of the two capture methods.
1:15
Apple has Face ID. So they can literally make a 3D Model of ur face...
Android phones simply don't have that kind of expensive and advanced technology XD (joke)..............
So yeah... that's Androids don't and won't ever get that!
you can stop people to message you by disable the notification options, idk if this is available in iPhone but it's available android i just disable the notifications and enable it again
The reason why iPhone has better AR is because of the lidar sensor (which gives that huge notch in Apple phones as lidar sensor are pretty bulky). Most Android phones don't use lidar sensors because in the eyes of the majority, Lidar is not really a necessity and a waste of money hence the lack of AR.
i have an iphone 12 mini it doesnt have lidar. lidar not needed here
@@Jsfilmz Ight. Also google is now investing on AR tech so that's a good thing for android.
got apple exactly for the same reason. I personal hate Apple, but because of the software and i need it.
Faceware is looking like the option for me as I can use a high quality video from my Nikon Camera for example where as a phone plan getting an iPhone I don't want or need would actually cost much more as I would be locked in a plan, I don't need a year's subscription.
did u see the new pricing?
@@Jsfilmz yes Indie is reasonable
That's awesome info, thanks :3
No problem!
It may depend which app you use. We use Facecap, and do looooooong takes, as in 10 minutes, with 2 phones one on each person. However, we don’t stream just do a capture with audio, and then export both the FBX and the audio for use in either Maya or Mobu. It works well for recording with audio in the studio. The reason I’m looking at Faceware is the phones are just so massive to be carrying around with headgear.
true and not with indie pricing on fw is a steal
@@Jsfilmz ya, saw that today. Following the trend. Redshift just came out with some crazy indie pricing couple weeks ago as well. Everyone keeps asking if ‘it’s real.’
is it possible to do this live? for an exhibition style activation?
I haven't had a problem with the iPhone 11 pro overheating but I, like most people aren't doing 6 minutes. That's a very long take even for a typical feature. I thought the mouth opening was better with the iPhone in your comparison
Unofficially there is a calibration option for Live link. Basic concept is to copy over KiteBoy AR kit example anim blueprint section.
Hopefully Unreal will release a built-in ready-to-do calibration soon.
When you record with Live link Face it also saves a CSV file of the face shape info. Once again there's an unofficial script to load the file in so that you don't have to record 'live'. Hopefully Unreal will release an official means of loading those files.
the lawsuit between and apple and epic games prolly not helping the dev of this app lol
Can you please point where i can learn these unofficial options?
@@RoyallRed the latest live link face app for the iPhone has a built in calibration function
Can you compare Tobi Or Other FaceMocap Sensor with IPhone Live link ? which one is better ? and can we fix the live link motion capture after recording in Unreal ?
yes kind of you can fix it after
Taking the phone out of the case solved the overheating issue for me. Not sure what you mean about 'being close to your computer' for Face Live Link? As long as my phone is connected to my wifi router, I can go as far away from he computer as the signal allows. The problem is stopping and starting the recording, of course, but something like Team Viewer on an ios or android device makes a pretty good solution.
ill try it
Synchronization looks good, BUT the face appears over-animated,at least to me.
The lip movement seems to influence the cheeks and the upper part of the face too much.
I'm not an animator tho, just my impression.
Faceware is best to animate your character pls comment
Great Tutorials !!!! I would like to know something but cant find the answer anywhere so far..... Metahuman can be used to make a commercial ? Can be use to sale animations/commercially ? Sorry maybe is a dump question ... I just like to know before I spend long time learning. Thanks again for you Fantastic Tutorials.
The one rule is that you can only publish characters you make with MetaHuman Creator in Unreal Engine projects, binding them to Epic's Unreal license. That license is quite permissive for small projects: You can use the Unreal development kit free, and if you publish a game made with it, you don't pay Epic any royalties until you've made at least $1 million in revenue. After that, the royalty is five percent.
@@Jsfilmz Thanks for the description, good to know the rules and possibilities.
If one is going to use close-up shots like you did, I think none of these 2 apps are good enough. The lip sync is clearly off pretty much at all time. I'm confident this will improve (maybe with AI ?) but for now, this does not do justice to the Metahumans human-like look. I wonder how Unreal Engine did their first ads for Metahuman, the lip sync was close to perfect. Maybe they did a ton of manual fine tuning post prod (pain in the neck). Thanks for the time you spend on this and sharing with us.
Cubic Motion is using a proprietary software called "Persona" , way too expensive for us "Amateurs" 😀
@@StyleMarshall 12k right? maybe more lol
@@Jsfilmz I have no clue 😎
i finally found time to try faceware. I wonder how difficult (and if possible) to add some hidle mocap micro movements to use it in realtime so the character move a little and not only the head.. i have to investigate about it
I had just bought an iPhone X to try face link. As soon as I saw a how terrible both techniques looked, I asked to cancel my order... I'll just keep animating!
I appreciate the honesty about your dislike of iPhone. I'm right there with you! But I think it's important to realize (and admit?) that some tools are just better for some tasks, as is the case here. Question: do either of these face tracking apps allow recording the motion in the app and then importing to UE later? It looks like they all stream the data to UE, but I'd love it if I could record the motion on my phone and then later import it. Thanks!
not at the moment but i think that might come in the future
great video thanks for it !!!!!
yw!
Great video! But if I have faceware (license) plugin for iClone, should i buy faceware studio? it it better choice?
try it first to see for your self
@@Jsfilmz i have used faceware for iclone and facetracking is a bit "wooden"but studio has more controls and uses same technology. I am a bit confused..because the result is closer to the same. And what do u think?
@@andrewmatus6614 the software is going be only as good as the 3d character im not sure how many morph targets your character had in iclone so i cant say
Hello guys I have a question. Which iphone model do I need to run LiveLink? Is there any special requirements(sensor?)
iphone 8 is the oldest u can use iirc
@@Jsfilmz Thanks
Brother, is there a way to link your android phone to Unreal Engine 5 and doing body motion capture via the phone, instead of a motion capture suit???
nah man android sucking at developing cool stuff
Dear Epic Games:
Will You Please Partner Up Or Buy Faceware So We Can Use It For Free Like Unity Users? Thanks! 🤣
lol.
They actually bought some similar company, so maybe in the future this technology will be for free, and maybe better.
Hey man, have you ever tried your D2 with Faceware Studio? Curious if that would work
hahaha nah i dont see the point man
@@Jsfilmz wow, is Faceware really that far behind Facegood?
@@Jsfilmz ps. Happy Thanksgiving. Sorry, wasn't expecting you to be checking YT tonight :)
I think calibration of live link app will come back in UE4.27 I’ve just seen that in the unreal engine public roadmap
yea it is thats why i hinted idk if it will ever come back :)
JSFILMZ it seems it’s comming this summer in 4.27 portal.productboard.com/epicgames/1-unreal-engine-public-roadmap/c/339-live-link-face-calibration
Funny, I feel the same way about iPhones. I hate them and would rather be on android, but the tech is priceless. I may just keep my XR for only Live Link and get an android next year.
yea im using android but have an iphone for mocap although the 12 mini overheats so fast. Does the xr overheat?
Hey.. I just bought today the indie licence of faceware since the price is affordable now..BUT ... whatever i did, I never managed to make just a nice facemotion like you did in this video.. any tip ? or any tutorial ? especially the lips are not responding well enough... We would appreciate any info (or tutorial :D ) how to make it better
its weird man cos depending on your facial expressions you have to talk with mocap in mind also shoot 60fps
cut your mustache
Lol yes you DO need a new camera with better AF. I feel your pain - my GH5 has the worst autofocus EVER
Bro is it only iphone if so then I am unlucky
Hey I am still watching the video currently but would like to say I personally think the livelink app looks better in this comparison. Faceware seems to over do some of the mouth movements and seems to show abit too much teeth imo.
Also I cant speak for an iPhone12 but I have the regular iPhone11 and have never had an issue with the phone getting too hot and havent had any frame drops and I have been streaming on twitch for up to 8 hours using it.
looks like i need to downgrade. do you have pro?
@@Jsfilmz I just have the regular iPhone 11. I didn't realise the 12 had issues until you mentioned it.
@@Jsfilmz I were just thinking it may not be your phone but possibly the faceware app that is causing your phone to overheat. I have only used the Live Link Face app, so maybe try that before downgrading your phone.
Ok then. Am i right - if you I use Live link its free but i need to buy iphone. If i use faceware i can record my face on webcam but i need to buy faceware, yes?
si
Why is live link only available on iOS? I don't get it. Unreal is making PC games and they don't offer it for android?
im an android user man android just dont put sh*t on their phones they are copying apple but not in the right way
So.... Consensuses is FaceWare it gives better results?
yes
Just turn on “Do not disturb” function and no one will disturb you wile you’re working =3
thanks for taking the time to make this comparison. IMHO, they both suck. Neither are believable. 4D tech seems way more closer to something useable, and hoping retargeting will also work.
Why u using sequencer recorder and not take recorder? very curious.
im not gonna stop using it till its gone, ive always used it i effin hate take recorder
@@Jsfilmz Yeah, I tried using take recorder and not really a fan. Also for some reason it crashes UE4 for me after every Faceware Studio Metahuman recording.
well nice video as always i enjoy watching your work , i want to ask you a question im sure you will know the answer, if i want to make a cut scene in my game by using i phone and meta human and live link , but my problem is why the neck is not moving and his head is not moving too is there a way to make him turn his head left and right and up and down too when he talking or just the face , because if it's just the face it will be not good when the character don't move his head or his body, i was thinking about solution maybe i could make animation for all the body and the head in blender and use it with the live link to make a full animation for the cutscene, my English is bad sorry i hope you can understand 😂
you can also move the neck but for me i use my mocap for neck and body motions so i disable it on the app
@@Jsfilmz oh cool that's what i want ,thanks
Keren bang
Man, i'm trying to make a real animation with control rig Body and Face (with faceware) And it's a nightmare. First is hard to understand what we need to do: First record and them play, but we need to animate the body first? And neck? Faceware get neck movement, but when you put it to run with control rig Body, it's stop... Or how to mix an face animation recorded and them start to use control rig Face? Becase if you run animation, you neet do deactivate control rig face... so complicated man!!!! Please can you make a tutorial explaining that?
i must have made 2 or more tuts on this topic
Do you happen to know if the results from an iPhone 12 is better than an iPhone X?
iphone x was good enough for me mang i just needed somethin small
@@Jsfilmz Have you heard/do you know if the 11/12 is 'better' or it would probably be about the same. i wonder if the Lidar on the 12 has any impact for example...
I leave you some tips so that your iPhone does not overheat when using live link face, what I do is lower the brightness to the maximum, remove all background applications that may consume unnecessary processes in the system, use a cover that has a fan, Do not use the live link face with the charger on, first charge the entire battery to 100% and use it without a charger,this will undoubtedly make the phone not overheat excessively,, I would like to ask you if you have any tutorial to make the human meta's mouth close or fit better when speaking ??? thanks for the good content
did you try the modify curves i showed here?
@@Jsfilmz I didn't even notice, I'm going to pay better attention to the video, thanks
Dear Sir.
I have problem with ( Mustache ) , when i talk its shiking alot and i dont know how i fix it , so can you please help me to do that ? ( UE4.27.1 with Metahuman ).
i mean its metahuman Mustache shaking and not stable
@@ar3d189 turn physics off maybe on the groom
@@Jsfilmz thanks for very fast reply, can you please explain to me from where I can turn off?
Thanks i fixed it
Harus pakai iPhone ya gan?
Wait you can do 60fps face tracking?! I thought truedepth could only do 30fps.
nah man its 2022
when both apps looks so unrealistic while capturing facial performance,
The mouth tracking looks like crap on both... :(
your speaking is too longer than pc screen showcase
Live link looks better
We have the technology to do better, I know they’ll somehow add an AI to the software
wait buddy boi, on live link you complained about having to wait for your phone to cool down, tell us which camera you used with faceware?
did you use a webcam? a go pro? how many fps ? was it pre-recorded video?... how did you miss that many questions ??? is faceware sponsoring this video ? LMAO
used the same camera dude the phone
$200 a month subscription for FaceWare Studio.
get it free bro got a coupon
it seems like everyone can have an iphone to say "free app"
i dont understand your comment, the app is free
UE4.27 Live Link Face new calibration feature added
yup
Faceware is better, but needs some teeth fine tune.
But what happens when the free trial ends 🤷
😬
Honestly I didn’t care for either. :/
1st: How do use my Android to use live face link?
2nd: How do use webcam to use face link?
super easy buy an iphone
@@Jsfilmz 😂😂😂
I would have to sell my kidney for that
non of them are realistic