Unreal Engine Metahumans & Facial Motion with Faceware Studio Vlog#3
ฝัง
- เผยแพร่เมื่อ 29 มี.ค. 2021
- In this vlog, I go over how I used facial motion capture data for the first time. I tested it out in the Metahumans project in Unreal Engine using Faceware Studio with the Live Client plugin for Unreal by Glassbox Technologies.
I combined the body and finger mocap data from Xsens and Manus and combined it with the facial motion data from Faceware Studio.
Special thank you to 3Lateral, Epic Games and Unreal Engine for creating this project and for these amazing high fidelity human characters!
#unrealengine #virtualproduction #motioncapture #facialmotioncapture #epicgames #animation #metahumans #razer #razerstudio #nvidia #rtx - ภาพยนตร์และแอนิเมชัน
Seriously your doing these companies such a great service. Great job! I literally opened up their pdf documentation and said Nope Not today. They really need to consider adding a bp like this for their users to use.
Jay, you are too good to me!!! Coming from the guy whose tutorials were the first that gave me a taste for virtual production and Unreal, that is a huge compliment!!
Great tut! Exactly what I was looking for. Keep up the great work 👏
Came here from JSFilmz channel, awesome workflow - thank you for preparing this Gabby!
Thank you, Adam!! Yes, JSFilmz is pretty amazing! His channel is the first place I got my first win with Unreal!
Awesome, and thank you so much for putting the time into this. The kids are loving it. Found you thanks to JSFILMZ. Hats off to you, and look forward to your future projects :) BiG love and safe vibes from the UK:)
Super awesome!!! Thank you for doing this!!!!
Amazing Thx, is really great service for all devs,more easy creation worlds and humans for cinematics,etc.
Aww, thank you!!
;")
Oh wow. Thank you so much for sharing this.
Awesome! Well-done! Someone is definitely all-in with the hardware and software. ;-) IMO, Epic needs to add a TTS/lipsync, expression and animation starter kit to make it more usable out of the box. I don't think that's too much to ask given Epic's resources. Maybe someone will put something on the MarketPlace.
Thank you so much for this. We definitely need tutorials like this one that going step by step... I m going to try and see what will happened :D
Hi George S! You might want to try the new updated blueprint I did a tut on for the Metahumans and Faceware, no need to create anything, its plug and play;)
@@FeedingWolves any link please for this updated blueprint ? thank you :DDD
Amazing.... awesome tutorial!
intense stuff! thx a million:)
Just Genius. Thanks Ma'am.
Hi Gabrielle! Just got finished setting up my live link client and the blueprint works perfect when playing in the viewport. Then I try to follow the steps to add the animation into sequencer, the face will not move :( Not sure if there is new steps to follow since this video is a year old. I will try to reach out via discord to see if anyone has a clue. Thank you so very much for the clear and concise content. It was incredible seeing our work with the metahuman come to life with the Faceware program. What great tech!
literally you are feeding wolves 🤣, Thanks for the video 💕
Geez, you've gone up a level again :)
Aww thanks so much!!
Amazing Thx, is really great service for all devs,more easy creation worlds and humans for cinematics,etc.
Nice Work...
This is great 🔥
Thanks, Jonathan!
Great work!
Thank you, Matt!
Amazing!!
Thanks, Mori!
THANK YOU!
Hi. IMO absolutely better results(than live streaming) i achived when i first recorded video , then split video to Img Sequence and then drop everything to Faceware i mean that img sequence (i tested it with ICLONE 7). Greetings.
At the end of the video, I half expect her to tell us that she's actually been a 3-d model this whole time.
She looks more real than the models used in this video, but that's no reason to doubt technology.
Question: Can I use the head on a different body and still have this working?. Also to pile on, I came here because of JSFILMZ
Hi! You may want to wait a little bit as I have a new tut coming out showing the new blueprint Faceware/Glassbox have where everything is set up, and I also show how you can use it on different characters;) p.s. JSFILMZ is definitely awesome!!
This seems nice, but how does it perform for real time lip syncing?
That very cool. A question, have you managed to take the facial and body mocap and refine with the metahuman face and body rigs? I can only seem to do one or the other, I’ve tried an additive track, but what I really want is to get the mocap let’s say for the face, put as an anim track in sequencer then add the rig to adjust keys and refine, I ve asked all around to do this and can’t find an answer. To me it’s just the final part of the puzzle to polish. Like your stuff, just subscribed on recommendation from JSFILMZ.
Hi Garry, So if I understand correctly, you want to add a facial animation to the metahuman, add the facial animation track, and then edit the body as well?
Yeah, so you already did that later in video as additive, I wonder why i can’t get it to work, after I bake to rig, I can’t move controls in additive, I will watch video again later when in my studio setup and try again. Awesome.
If you can word the question a little more specifically, perhaps I might be able to help. I am working on a vlog that shows something along those lines, so let me know.
@@7_of_1 So it is a little tricky. Make sure when you add the character bp, you delete the control rigs already in the sequencer track, the face and body. Then, bake to control rig your animation. Then in the new track, you select Additive. You will notice you now have two tracks. The bottom one you select the drop down, and in that area that is now blue, right click and select, key this section.
@@FeedingWolves yep, got it. Will try today, thanks.
Great video, super clear and to the point. Thanks for sharing! Any tips on how to troubleshoot the connection between FaceWare and UE? my setup seems ok but it seems UE is not receiving all the data from FaceWare, which is kinda odd :(
Hey! Make sure when you select the Metahuman in the UE Viewport, select the face part of the Meta component and switch the Blueprint to the Faceware one. Someone else mentioned they had the same issue. I should have shown that step...so sorry
@@FeedingWolves Forgot to tell you I got it working! again thank you for the video!
@@edwinvargascortes Awesome! You might also want to check out the more recent vid I made on the new Faceware/Glassbox motion logic blueprint. That one has a blueprint already set up and takes 5 minutes to get it working.
@@FeedingWolves will do!
Hey Hello. Can i ask You something. In Your video you show that you are merging Break faceware Livedata with Modify Curve 6:35 , are You achiving better results merging this? And how this is possible that you have acces to keys ? (You are able to clean mocap data thats great) but how you achived this // If i follow your video step by step im alos able to have this possibility? // RIght now we are just doing 2 steps to get data from Faceware with Unreal Engine. But you made many many more. Many thanks for answering me.
I made all the settings, but the character's neck does not move, only the face movement works. I also checked (is there a problem with the blueprint?)
Can you get a ctrl+c in your nodes and put it in a txt file for sharing? This would be very nice for us. Thanks a lot.
Hi! You should check out this Blueprint for the Metahumans. Literally plug and play. th-cam.com/video/Gg2RtJlM5Zg/w-d-xo.html
I'm having trouble with head rotation everything else works but my head doesn't rotate any suggestions?
This is an old tutorial. There is a new metahuman blueprint available if you want to try that. Otherwise, what you would need to do if you want to stick with this method, is you need to connect the pins for the head neck rotation in the blueprint first. Then make sure you also have head/neck rotation turned on in studio. Here is the link to the more recent one th-cam.com/video/8Kv_pN6SCnc/w-d-xo.html
any chance of getting the blueprint as a download? iam using the trial code from jsfilmz and tbh am really struggling for time learning unreal. thanks
Hi! Yes, there is an updated blueprint on the site. I will have a video uploaded later today that walks you though the entire process;)
@@FeedingWolves awesome thanks
I am having way too much fun looking at my characters and going "Aga blah blah blah blah? Ahh! Blabblab blah blah!" and laughing to myself. It's a good thing I'm working remotely today, people would think I'm having some kind of breakdown.
haha yes, this tech is too much fun!!!! I am so happy you are enjoying it. I always say, if you are not having fun in Unreal, you're not doing it right! Clearly you are doing everything right!
Sadly, at the end of the day, FaceWare is extremely buggy. Now that I've added an OBS virtual camera, I cannot switch to any other camera at all, it will only display that source. Previously I had to restart FW to use any other source. If I start, choose my camera, all other sources have no reaction and thereon all choices produce black screens until FW is restarted. So a 30 day trial of software that's so inconsistent...
Time to buy an Apple device for LiveLink. =)
@@KenzieSFTI am sorry to hear that. I recently had a black screen issue too, but mine was due to the USB from the camera feed being plugged into the wrong usb input on my workstation. I saw someone was able to figure out how to connect an iPhone to faceware so not sure if that is helpful, but I am glad at least you have an alternate option. Let me know if I can help.
PS: If you have this same issue, you can run your cameras through OBS, into FW via your OBS virtual camera. I believe this will cause additional input delay, not sure because I can't test.
@@FeedingWolves Hmm, well I had it working just now just using OBS' virtual camera and my own webcam, so that's a solution to the virtual camera issue. However, my file menu disappeared when I wanted to grab my own facial preset. After restarting FW, we're back to a white screen and it doesn't respond, hahah. =)
Are there additional steps to perform to apply this to character 4? I can get it working on character 1 but I can't seem to get it to work on character 4, any ideas?
Hi Anthony! If you want to see the data played out by the male, in the details panel for the male metahuman, when you select the face, make sure the blueprint you have selected is the faceware blueprint. In addition, make sure that the male character has the Faceware live component added to it. Let me know if this works;)
Lastly, make sure you have in the Faceware Live component in the details panel, stream to client checked on.
@@FeedingWolves thanks for the reply! Great stuff by the way! I think it has something to do with the "_face_CR" component being missing because of the way I rebuilt my scene. Starting over to check it out!
@@anthonyricciardi6848 By the way, the new Faceware Metahumans project became available on Facewares website.....lol everything is already set up for you in that project.
@@FeedingWolves lol..... much easier! Thanks again! Gonna download a bunch of character from Bridge and see what I can do!
hi, nice tutorial. I have a problem. I did everything exactly the same and even faceware sends signal to UR4, but faces don't move. Any idea how to solve the problem?
Hi! Thank you! Try this, select your character in the viewport, and select the face in the details. Make sure you change the face blueprint to the one you made. Then try it again. Let me know if that works. I know how annoying it is when something isnt working.
@@FeedingWolves "Make sure you change the face blueprint to the one you made." Thanks!!!. The problem was face blueprint default.
@@mashcaphysics9601 Yay!! It worked! So happy to hear that! Let me know when you make something with the BP, id love to see it!
@@FeedingWolves I was so disheartened briefley after I thought I stuffed up - saw this and thank you! It works! All be it I look like a cartoonish maniacal drunk at the moment hahaha (need parameters tweaked). These tutorials are so well presented, and I love how you consider your audience (the slow scroll for screenshots)!
Im a first-timer in this area and people such as yourself and your channel make it a real joy! ^_^
glassbox live link trial did not work at all:( it says that "my license was activated on a different machine"
Uh oh! I am not sure about the notification you got about the license being activated on a different machine. Have you tried contacting Glassboxtech and asking them?
@@FeedingWolves i contacted them and its fixed!
@@ramenking1336 Yayy!! So happy to hear that! They are indeed very responsive. I would love to see what you create, so feel free to tag me on social when you do!
when you are connecting from brow upper left to the modify curve its not clear for me which button you pressed? at the 4:49 of the movie... would you please help me
Hey! Type in float + float. Is that what you mean?
@@FeedingWolves thanks for fast reply. I see when you are trying to connect " brow upper left "to "modify cure" the source pose suddenly become separated. which button you press? or what did you do?
@@FeedingWolves Would you please explain what did you do in 4:50 of your video?
@@saramostowfi2303 Ohh ok, I get your question now. So, right click on the modify curve node, then "Add a curve", then it will pop up some options on that curve, so type in the data point.
Hello @Feeding_Wolves, your tutorial videos are very helpful. Can you create a tutorial about how attaching face animation with body? As I don't have any mocap suit, so I'm retargetting mannequine animation as body animation, then I attach the face animation. But It's looks not attaching face and body part correctly. can you help?
Hi! I can definitely help you with that. Here is my discord discord.gg/m4FwFRHG
@@FeedingWolves Thanks.
@@FeedingWolves Hi I have the same issue! Whenever I connect my facial animation to the metahuman body (which I have a seperate body animation on) The result is the face is floating, disconnected from the body (while both animate successfully on their own) Would you be able to help me solve this issue?
@@wackcrewpeeps Sorry to hear you are having this issue. When you recorded the face animation, did you also record body animation simultaneously? Also, are you doing this with a Metahuman?
@@FeedingWolves @Feeding_Wolves Yes I'm using Metahuman and I recorded the entire BP but I'm using the animation which looks like it's only for the face (there were a few created in the animation folder.)
Hello, I am from Russia, so I write with the help of a translator. I have a problem, I do everything exactly as you have in the video, but nothing works for me. I'm using a Metahuman that I made. Can you tell me what the problem might be?
What I can suggest is, perhaps try selecting your character, then in the details panel, select the face and make sure it is set to the Faceware blueprint. Also, you may want to check out the new blueprint Faceware made available on their website;) In a few days, I should have a tutorial showing how you can use it for your custom metahumans. I have not tried this old blueprint out on the new custom ones as I am testing out the new one on the custom ones.
@@FeedingWolves I just see that in the Faceware drawing I have the coordinates of the points of the face moving, for example, Eye Blink, and so on. But the character doesn't move his face. The drawing is set to face. I'd rather wait for your video tutorial. Thank you in advance :)
@@FeedingWolves And all, indeed, it was only necessary to choose the blueprint of the bluprint. Thank you very much) And I killed so many nerves
@@wtolamich4793 If you are seeing the input coming in from Faceware, make sure when selecting the Faceware Live component in the details panel, stream to client checked on. You may also want to double check when selecting the face mesh, that the blueprint is set to the Faceware Live BP. And yes, I definitely suggest you wait for this new tutorial. I am literally working on it right now;) The new blueprint is already set up.
@@wtolamich4793 Oh believe me, you are not alone with the nerves! Story of my life.