UE Take Recorder Live Link Source & Control Rig Backward Additive Solver
ฝัง
- เผยแพร่เมื่อ 10 ก.ค. 2024
- Link to my Discord: / discord
In this video, I go over how you can record your Live Link Source data from the UE Live Link Face in Take Recorder for cleaner facial motion capture data on the new Metahumans.
I also show you how you can use the new Control Rig Additive Backward Solver to either fine tune or add animations to your recording in Unreal Engine.
Created this using the Razer Blade 15 Studio Edition laptop with NVIDIACreator graphics.
#MadeWithBlade #UnrealEngine #EpicGames #3Lateral #FacialMotionCapture #UEControlRig #MotionCapture #VirtualProduction #Nvidia #RazerStudio #Animation #Raytracing #Quixel - ภาพยนตร์และแอนิเมชัน
Take recorder is scary. Thanks for making this video! 🍻
Aww, thanks Matt....or should I say....MetaOne!
Amazing! Bake to control rig is the core bit of this we've been searching for for months - so glad you made this video! Thanks so much!
This has got to be the absolute best breakdown of this workflow I've ever seen on video! This is gold, diamond and platinum rolled into one. Thank you!
Wow. Thanks. This was exactly what I was looking for but couldn’t find anywhere else. Looking forward for more videos 😃
Thank you very much for this tutorial, also had a look on some of your vids it's inspiring and very motivating! Keep up the good work Gabriella!
super clear. Take recorder was super confusing earlier,
this video is very helpful. Thanks a lot.
YES, exactly what I was looking for right now while playing with my MetaHuman =) Thank you!!
I keep coming back to this video, it's so helpful, every time I run into an issue with livelink and MH. This video has become my checklist.
Wonderfully clear, I can't thank you enough, it would have taken me ages to figure this out. Keep the excellent videos coming!
Aww, thank you so much!
Absolutly amazing! Thank you so much for this! It really explained everything I was missing! keep up the great work!
I am so happy to hear that!! Thank you!
Great video, Gabriella! Interesting comparrison between the results from the different recording modes at the end.
Thank you so much, Simon! Coming from you that is a huge compliment!!
@@FeedingWolves Hi,
mocap is new to me. Would connecting iphone with cable give better result? Wifi has a lag for sure.
This is by far the most informative tutorial on the little gotchas about using ARKit in UE5, thanks a bunch
Thanks so much - I was pulling my hair out over the "read only" problem on the level sequences.
Thank yo su much!!! Cant wait to see your other tutorials!!! Has helped me very much! :)
I've lost count how many times I've had to come back to this video for various new projects lol. Thank you so much for making such an informative tutorial!
There's a lot of videos on recording Live Link with metahumans, but almost none of them seem to show how to properly do it right like in this tutorial! Great work!
Thank you so much for your kind words! This video is old but so happy it is still useful for people ;) p.s. love your channel, just subscribed
Searched for "livelink metahuman control rig".
This is the first in the search result.
Thank you and have a good one.
Love you! Thanks a lot! Saved a day by giving a hint how to unlock the sequence! It is so strange that it is locked by default. At least I can't see why is it a primary option.
You're a legend!
Excellent tutorial A complex task. U walked us thru it like mom explaining to a child how to eat cereal or something. Keep the awesome vids flowing…
You are too kind!
Thank you so much for making this!
Thanks a lot, finally I found a plausible explanation!
thank you!!! OMG what everyone said so many MH tutorials out there and this is the only one that has helped haha. thanks again :)
Amazing tutorial. Thank you!
wow perfect tutorial!!! Thank you so much
Amazing. Thank you for the tutorial.
So many metahuman tutorials, yet only yours gets us to where we want to go. Controlling and recording the animations. Thanks for what you do, I was at a wall and this took me from A to Z. 🙏
Wow! Thank you so much! If you ever hit a wall a wall again, feel free to join my Discord channel ;)
Yes, very to the point. No BS talking.
So true.
Thanx a lot. This is the only way I can record my metahuman.
The only creator that teaches how to use the livelink animation
amazing tutorial! thank you!
Thank you soooo much for this!
Thanks, great video.
awesome just what i needed thanks
very helpful, thank you.
oooh yes, it helped me with audio 2 face !!! thanks a lot !!!
Thanks Gabby! :D
Very nice tutorial 😊
Very Helpful
Thank you so much!!
so freakin' helpful thank you thank you
My pleasure!! Glad it helps!
Great Video!!!
Great video , thanks !
One thing that would improve it , would be to name the buttons you are unchecking or checking so it’s easier when following along. Apart from that very helpful thanks.
Hi! Thank you for the feedback. I will definitely do that, as I know how frustrating it can be to try and follow along only to get stuck on simple stuff with UE. Out of curiosity, which buttons did you have a hard time with?
Sorry , thought I’d replied already. It was at 1:46 when you were saying these two. I was getting a whiplash effect trying to check my screen and your screen quickly , so naming the buttons would help in that regard. Thanks again for the video , I’ve got some nice stuff working with it and use your video as a quick setup guide when grabbing captures from my va’s
wow, nice one. thanks
Thank you!
Thanks, life saver
thank you so much
thankyou FW!
You're the best
Thank youuuuuuuuuuu
thanks, very nice and easy to understand, as yet there is no UE5 equivalent, so I am going to try to follow this but find the equivalents in UE5
This is very awesome, thank you. I'm finally looking into Live Link to use with Metahumans so this is great timing, look forward to seeing more videos on these processes and details/tips. Any suggestions if I were to use another source for mouth? (i.e., Vive facial tracker, I'm assuming it'll be more accurate for mouth area)
Hi Rick James! If the facial tracker has a live link source, then it would be the same method. However, I believe @MetaOne would have more experience with the vive tracker workflow as I have never tried this out myself.
Thanks for this! Was starting to get frustrated with Take Recorder + the BP_Metahuman route...
I was just as happy to discover this as you are!
@@FeedingWolves I mean to ask, is there something I'm missing to get the face rotation from live link? I see that the data is recorded in the original LiveLink SubScene (HeadYaw, HeadPitch, HeadRoll), but when I bake the animation that data doesn't seem to transfer.
Never mind, just figured it out! Needed to have the animation mode in the BP set to animation asset.
Hmm so after some further testing, it doesn't look like there is a way to bake the face rotation (from livelink) to the control rig.
@@lucdelamare8996 thats interesting. So when you bake the face, you loose the head rotation?
This has been such a frustrating experience. Trying to deal with this on my own as well as following the numerous tutes and yet, still not getting to where I want/need to be.
Your tute's the first to get me the farthest. Yet, even then, the results aren't great. In the end, it feels like the program's to blame with how finicky it is.
At this point, I'm thinking it best to just try the control rig route since this week I'm just looking for head gestures w/smiles. I've your tute to thank (halfway) for getting me there but not without jitteriness in movements.
Anyhow, will look through your channel to see if there are updated versions of this all. Presently using UE5.0
'and thanks btw for this. At least it DID get me somewhere. 🙂
We have all been experienced those moments of frustration lol! UE Live Link face is free which is great, but if you are looking for slightly higher end quality, you might want to try out faceware. Unreal Learning released a course on it and I am pretty sure you can sign up and get a free trial just to test it out. All you need is some video footage, and they provide some sample data so you can have something to work with. dev.epicgames.com/community/learning/courses/d66/metahuman-workflows-with-faceware-studio/Zd8v/faceware-studio
Thanks!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Thank you for this! This video helped in a massive way with my project! Question for you, I noticed that there is a record button in the Live Link app. How would I import those recorded takes from my phone into Unreal. Is that were the "use source timecode" comes in at 1:36 Any input is appreciated. Thanks again and keep up the great work!
try this: th-cam.com/video/z99Fo9LXLHk/w-d-xo.html
I'm also interested in the baking of neck/head movement; are there some drive controls that need to be added to the blueprint?
This is amazing! If you do contracting engagements I'd be keen to chat
Thanks for sharing your knowledge. Is it possible to also play back the head tracking that exists in the recording? When I bake it into the face control rig, it is only driving the face bones. The head motion would need to be added to the body rig? I'm not sure.
Thank you for this vid! is this still applicable with the new Unreal Engine 5?
Hi! Thank you for your clear and to the point tutorial. So helpful! I have a problem still: For some reason, only the facial recording comes through in the baked animation, but not the head/neck. I tried baking a seperate animation for the body, hoping that would cover the head/neck, but it didn't do anything! How do I get that head/neck movement?
Did you find a solution?
@@thebensimon no *sigh*, not yet
@@binyaminbass I can't find anything about it as well :(
Anything about the neck animation?
@@thebensimon I've turned my attention elsewhere...for now. A little disheartening that you are still having this problem. I'm going back to this soon.
Hey Gabriella! Thank you for sharing your knowledge :) I have a quick question - for non-meta human characters with blend shapes/morph targets, is it possible to combine body animation and face animation? I noticed that metahumans have face and body separated in the sequence track, but most 3D models don't have this. Let me know if you've already covered this else where!
Hi! Thank you! So you are trying to record the Live Link source for the body and face simultaneously or the actual body/face data by dropping the entire character into Take Recorder. It also really depends on how you have your character set up. What kind of character are you using?
@@FeedingWolves I eventually figured it out! I appreciate you replying :D!! Thank you!
@@loregodd I'm very interested to know how you did :)
@@loregodd Also am curious what you did to solve this!
This is incredible! Do you have any tips for a college grad seeking a mocap job like your vids to watch
Checked out your mocap vids! Pretty awesome! Keep doing what you are doing! And thank you! I still have so much to learn. As far as tips, create something with your mocap and have fun with it;) See where it takes you!
@@FeedingWolves Oh my you actually responded! Would it be ok to ask you questions from time to time! I've recently added you to instagram!
nice tutorial.
When I bake my animation into the rig for an additive animation layer, i am not able to move the head and neck controls anymore...
how can I fix it?
I have a problem with take recorder maybe you have seen. I live-animate my metahuman using a mocap suit, which works fine. But if I use "from actor" in take recorder to record the character, the character comes out distorted when I play it back. Usually this is hunched shoulders and an enlarged upper body but it varies depending on the metahuman used. The default character DHRUV is the worst, some of the female characters are only slightly distorted. Do you know a good solution? The ones I've found involve editing the skeleton but this doesn't seem right because they change a lot of things that are explicitly set different ways in the Metanuman.
Hi Greg! So when you record only the body live link source in Take, the data looks good, but when you drop the entire character into Take Rec, the recording looks weird? Is this correct? What mocap solution are you using? Depending on your solution, does this require you to set your character in a T pose or to create a remap asset?
@@FeedingWolves Actualy, you can see the problem without doing any mocap. Just load up a meta (DRUHV has the worst problem) and do a short take recorder recording "from actor" then review the take and you should see it. Here is a milder example th-cam.com/video/Tun5sID9ab4/w-d-xo.html but DRUHV's head sinks down till his chin is level with his shoulders! In that video I fix it by resetting the retarget in the recorded animation but it seems like there should be a better way than this. Most of the female metas don't distort or get only slightly thinner. The tall male metas seem to distort the most. This only happens if you record "from actor", some mocap setups require to use this instead of recording the livelink source directly. Rokoko recommends the same fix I am using in their latest tutorial.
@@GregCorson It is difficult to figure out what is causing this. I would need a better idea as to how you are setting up your mocap on the metas first. What I can tell you is that depending on what you want to record on a Meta, you can drop your Meta into take recorder, and once you select the MH, there should be an options menu below (in take recorder). There, you can uncheck the root, and only check on the things you want to capture, such as Body-animation track, Face-Animation track. Is this a Rokoko set by the way? Are you using the facial capture built into the Rokoko pipeline or running the UE Live Link face app separately? In other words is the body/face mocap from Rokoko integrated into one Live Link Source? If you tell me more about how the Live Link pipeline for Rokoko is set up on the actual metahuman, I can tell you what might be causing these things. If I had to guess though, looks like you might need to go into the actual MH skeleton and change the retargeting options....again I would need more info to help resolve this
@@FeedingWolves You don't have to be doing mocap...it seems to happen whenever you do a record "from actor" on a meta. Doesn't matter if the character is standing still, animated from a control rig, by mocap or something live like Perception Neuron or Rokoko. Take recorder just seems to mess up the animation it records when "from actor" is used, apparently by not copying the retarget skeleton from the original meta into the recorded animation. The fix is to set the right retarget skeleton yourself, but you have to do it to every animation take recorder records, which is very inconvenient. If you look at my video linked earlier, you can see the whole setup and the fix.
Thanks, great video. I'm a wee bit stuck with Faceware and Glassbox using take recorder and the child blueprint. I can't seem to record data. When the sequencer comes up it disables the Faceware! Possibly something to do with control rig tracks perhaps?
So there is no live link source for Faceware/Glassbox. For that workflow, you need to add the actual character BP into take recorder. Go into play mode, then record. How are you recording?
@@FeedingWolves Thanks for getting back to me. Yes I was using the BP in the recorder however it was also bringing in control rig tracks which for some reason turned faceware off. Deleting the control rig tracks enabled me to record data so all sorted now thanks to your tutorial! Now just need a basic webcam solution for body mocap! On an additional note regarding the additive control rig section. Is there a way to not override the whole mocap track when making a change on the control rig? I noticed for example If I add a blink and the final keyframe is open eyes, the eyes stay open and it overrides any subsequent blinks on the mocap.
@@SonicTemples Hi! So I am not sure what you mean by when adding the BP in take recorder, it was bringing in the control rig tracks as well. Can you send me a snapshot of this if it happens again? Very curious about this. discord.gg/JhuRsgbu (link to my discord server for Meta troubleshooting). Now as far as the blink issue, so when you make a change, what I can suggest, is add a keyframe, before and after where you want the change to occur, and then in the middle make your adjustment. The reason being, when you just add a keyframe, it holds that expression, instead of just adding one in between the mocap data. Let me know if that works. P.S. When you add the before and after keyframes, dont make any changes to those, just add a keyframe, without any adjustments. Make the adjustments only in the middle keyframe. So A, B,C. B is your change. A and C you leave as is.
@@FeedingWolves Thankyou, my error was bringing the child blueprint into the sequencer track rather than the take editor it seems!
@@SonicTemples so glad you figured it out! Yes I did that once and then realized you cant use the actual child in sequencer, that the child is just for recording lol.
Thanks for the video! I just have an issue that the full animation does not bake - only the first couple of seconds. Do you know what I am doing wrong maybe? Thanks again
Figured it out :)
Great Video.. Can you please help me? Instead of save in uasset form. Can we download(Render from sequences) in avi or png form? Using Livelink
At the 4:06 mark, when clicking the + sign on face, the option to choose animation is not there. Only template sequence and control rig are at the top. I'm using 5.0. If I click the + sign on the BP_name of Metahuman, the animation prompt is there, but the recorded animation isn't in the list to be chosen. Any ideas? Tried to join the discord but it says the invite is invalid
update: I think it had to do with the timeline scrubber not being in front of the animation on the timeline ...
I am glad you figured it out. Here is the link to the Discord discord.gg/GehykCmvAB
very cool , any way to export control rig animation to maya ? if i export something actually i get a group with all attributes from control rig but no keys, would be amazing can send the live link baked info to maya control rig
When I' bake animation to sequence' I end up with an empty animation in the blueprint with the bold head...I have no idea what s not working on my end. it also doesn't really make any sense to me how the face should know what it needs to bake to what in the first place with this tecknique. thx one million for ur great tuts though. and any help on this issue would be greatly appreciated!
Ok so when recording the live link source, go into the subsequence of that recording. You should be seeing the keys in the timeline. Unlock the timeline, drop your character into the timeline, and if you recorded in Play mode, go back into Play mode and then bake to animation sequence. Let me know if that fixes the issue.
Also, when you drag the character into the sequence, make sure the timeline scrubber is a few frames before the actual animation.
@@FeedingWolves thx a million , that did it! u gotta love UE's mysterious ways...
@@FeedingWolves thx:)
@@FeedingWolves is there anything we did explicitly so there wouldn't' be head rotation? I'm trying to find the option for the head rotation to be baked onto control the rig also...unreal engine is so amazing at not working in obvious ways. lol . I did record with head rotation switched on on the iPhone and it's there in the animation blueprint.
I noticed that the recorded head movements aren't there after baking the animation to Face. So would that be the same process for Body to also get the head movements from LiveLink?
This tbh, really need these for it to be useful.
Just noticed that if I do the sequence stuff at 3:51 in the original subsequence, instead of the level sequence, and then drag the subsequence into the level sequence, the head motion is retained.
Hi K! You are not the only person that has said this is happening to the head movements. Working on trying to replicate this issue to find out how to fix it.
@@XaertV are you then baking the face to the control rig and the head motion is retained? I ask because a few people are loosing the head rotation when baking to control rig and trying to replicate this issue so I can fix it.
@@FeedingWolves yeh, I basically do the face baking, then re-apply from the baked animation within the recorded sub-sequence. Then after creating the level sequence, I drag the sub sequence in there, and that appeared to work for me. Although, only if the current frame selector is outside of the sequence timeline when playing? Kind of weird still
Nice tutorial, but how can I get the head rotation control rig when baking face animation? The head control rig belongs to body component...
Hello, awesome tutorial! But the same method doesen't work for UE5, i mean baking sequence animation in UE5. Can you explain me how to do this? thank you
How would you go about doing the same with translated head rotation? I lose that once I've applied the animation to the Face. Thank you!
Are you using the UE Live link face/neck data?
Ok just tested this out. If you recorded the head/neck rotation in play mode, when you bake to sequence, make sure you are also in play mode;) When you are not, you do lose the neck rotation. let me know if this works.
@@FeedingWolves Right I See! Im using face/neck data. That probably won’t translate well if you bring cine cameras in I imagine .. I’ve been playing around today with this + retargeting animations from the starter kit - can you think of a way to combine those two with the proper head rotation? I’ve also noticed that there’s no slider for the rotation in the „face“ tab, I imagine that’d be in the body one.. let’s say you have a retardierendste body animation (with head rotation), is there a way to replace that head rotation with the one from the face app?
@@greylight1 So if I am understanding correctly, when you say it wont work with cinecams, do you mean you cant seem to hide the control rig? If that is what you mean, all you have to do, is save the sequence you have your anims set up in, close the sequence and reopen it. The control rig should no longer be visible.
As far as neck rotation via ue live link face and how to deactivate it when combining body data that already has head neck rotations. One thing you can do is just disable the neck rotation when recording. The other thing you can do is if you have the animation with the neck rotation, when you bake that to a sequence, dont go into play mode when baking. It will remove the neck rotation. Let me know if this works.
@@FeedingWolves Hello Gabriella, first thing, thanks a lot for this tutorial, I've checked your channel, great videos, you've got a new subscriber :)
Regarding this issue, I'm experiencing the same king of thing, I've tried multiple tests, but I don't manage to get that working:
The rotation is actually well baked in the animation. But when putting back the animation on the "Face" animation track in sequencer, it doesn't get played (all other facial animations are well played) Would you have any lead for me to look into?
Cheers !
Hi Gabriella! Excellent tutorial! I recorded a video for LiveLink, added to a Sequencer... everything was perfect except is important that the character moves and tilts the head accordingly to the gestures (as it was recorded), but when I use the Face Control Rig, the head won't move anymore. The gestures are fine but the tilt and all of that won't happen again. If I delete the control rig, the neck and head movements return without any problem. Is there any way to mix both? I´ve tried every "solution" but none works
in UE5.0.3 keep simulation mode running while you bake to animation sequence!
Very nice video but I can't also bake the rotation of head and neck to animation.......
why the UI controls of modifiers, only can be showed in secuencer and not out of there? thanks
Super good. I’m dropping the character BP in the take recorder rather than the live link source, is that the wrong way to do it? It seems to work ok. When I add my live link source and record the take, the animation is empty for some reason. Great, thanks., EDIT, just watched end and you explain lol. I’m not doing any body capture at the same time so it seems to come in fine, and also can’t get live link data source to work, will try it again.
Make sure you unckeck timecode when you select the live link source in take recorder. Also, make sure when you also have the timecode boxes unchecked in the take recorder settings as well.
Also, by dragging the character into take, no, that is not the wrong way at all. However, when you record that way, when you look at the animation files you notice it is recording everything, the body, face, clothes, etc, so there is more processing power required, hence the data you are recording is not going to be as clean.
@@FeedingWolves good, tip, will try it again today. Was hoping to try the Faceware 30 day, demo this weekend as well as they are going to be doing the indie license from next week they tell me.
@@7_of_1 Yes, those timecodes being unckecked was how I got it to work. When they were checked on, I as well did not see anything in the subsequence file;)
@@FeedingWolves just a quick one, sorry to keep bothering you, but I don’t find many people using the rigs as well. I did a couple of takes with Faceware over the weekend, pretty good out of the box. Is there anything special to get baked to the rig with it? I’ve got the sub scene take in sequencer and added the face and body animation tracks I recorded on the take, then baked to face and body rig. A couple of things happened, first is that the head rotation from Faceware didn’t work anymore without highlighting both anim tracks in sequencer and right click and select active, then I can see controls moving on the rigs etc, so all good. When I play back sequence now it’s gone from 70 FPS to 11fps in the viewport. It’s all a bit weird, do I need to bake down the control rig after adjustments I make back to an anim clip again? I can’t see to find anywhere the workflow to do it.
Also I found on baking the face rig, a couple of controls were fired off a higher value around the nose. Sorry to ask but I can’t find anyone else actually using the rig to try and refine the anim after recording the take, but now I have a sequence stuck at 11fps with the control rigs, do you know where I can find decent documentation on the workflow for it. Sorry, again..
Thanks for the video. I tried to bake my recordings that have been streamed in via faceware as shown in your video but unfortunately I don't get any animation data baked this way (and thus can not use it via an animation track). Can you please make a tutorial on how to bake your faceware recordings as well? Thanks again!
Hi Daniel, because the Faceware/Glassbox pipeline to unreal does not use a live link source, instead the data is transferred via the Live Client plugin, you wont be able to record the live link source. Instead, you will have to drop your child character BP into Take Recorder and record that way.
@@FeedingWolves Thank you for your quick reply :-) Yes, that's what I did and I can as well record this way. But the part where you bake this recording to an actual animation via Right Click >> Bake and based on this baking this to the Metahuman Face Rig I can not get to work unfortunately ...:(
@@DanielPartzsch
1. Add the character to sequencer,
2. delete the control rig board for the face.
3. Add the animation you recorded,
4. Right click on the face track, select bake to control rig
5. Select new control rig board, make additive track
6. Right click on additive track and select key this section
7. If you want to save this new animation just right click the face again and select, bake to animation sequence
@@FeedingWolves sorry, I actually meant the part before that, starting at around 3min, when you bake the animation from the recorded sub scene and save it to a new animation. When I try to follow this, nothing has been baked / saved in my case (in contrary to what you get afterwards when you show the head only playing the animation in the animation editor. In my case the head is just doing nothing 😉). I will see if I can make a screencast tomorrow to maybe better show what I mean 😊
@@DanielPartzsch I started a small discord for this kind of troubleshooting. Feel free to join in here;)
discord.gg/WUxwBYu3
what happens to head rotation how to add them
How to add head movement? in my take i got only face expression.
If you had the UE live link face Neck rotation activated and lost the neck rotation after baking to an animation sequence, what you can do is in sequencer once you add your animation, you should be able to keyframe in the metahuman components section "custom mode".
@@FeedingWolves thank you so much
@@FeedingWolves I added my animation, but I'm confused by what you mean here? I should add a keyframe and set the animation to "Custom Mode"? I did this, but when I go to bake to control rig, the head movement is still missing
@@Great_Cardinal I see, so you are losing head/neck rotation when baking to control rig?
When baking to control rig you will lose the head rotation. However I do have a solution for this..it does involve changing a few settings on the BP level. You are welcome to hop into my Discord server and i can link you the screen recording for this that has been shared in there.
so for metahumans there is a bake to control rig option for the face but there does not seem to be a control rig class for the body. how do u get that?
If the body control rig does not show up when you go to bake an animation, you can locate the metahuman control rig asset itself, go to the preview tab on the top right panel, assign the female medium normal weight preview mesh, then go to the root heirarchy tab on the bottom right click on it and select refresh (last option on the bottom) and reselect female medium normal (its the base skeleton) compile.
That seems strange that you're not using the Timecode from the recording. Wouldn't you need that for everything to sync correctly? Great video though :)
Has anyone figured out how to get through this process and still keep the head rotation information from livelink? I can't figure it out 😢😢
There is a problem with baking step. When I bake the animation and open the file, face mesh is not previewing the animation. I tried to continue without seeing animation but its not working. I don't know how to pass that.
I am having an issue where when I "Bake to Animation Sequence" none of the motion is captured it's just the face with the no movement. Any ideas? Ty for the video btw it's great!
Are you using the UE Live Link face app?
For anyone having this issue I solved it by hitting Play in Editor (not simulate) and THEN baked the animation.
@@xkigolx BRUHHHH this was driving me insane, thank you for sharing the hot tip!
Does anyone know how to combine a Livelink facial animation with a body animation. I've recorded a facial capture and want to use it in a scene where I have an existing body animation. When using both in the sequencer, the body moves but the head becomes detached and stays in place although the facial animation does play. How would I keep the head attached to the body so it all moves together? Any help is really appreciated
You might want to try using a fresh metahuman. This sometimes happens when you use the metahuman you recorded the facial performance in the same level.
@@FeedingWolves thanks for the reply. It's a different scene that I migrated the animation to although the metahuman is the same blueprint. I'll try reloading the metahuman into the scene
@@FeedingWolves I managed to get the actual facial animation working in my scene, although head rotation doesnt work. I saw something on a forum about force custom mode but when I tried that the head rotation works but the head detatches from the body. I've a feeling this should be easier than it is lol. Have you any suggestions?
@@andyhair4665 Do you already have body mocap or are you just trying to use the head and neck rotation?
@@FeedingWolves the animation for the body is retargeted from mixamo. The head and face animation was recorded over livelink. I've backed the animation and migrated it to the required scene. Body animation is working fine, I can see the facial expressions moving but the head rotation isn't working. I had another scene where the metahuman was looking around and because the body was idle I could use force custom mode which got the head rotation working but on this scene the metahuman is walking so I can't use that option. I'm new to unreal so I'm learning as I go but it seems like 1 step forward and 2 steps back at the moment lol
I can't seem to get this to work with the male rigs. Been reading that the female average rig is the only one that plays well, and the others have scaling issues. Have you been able to replicate these results with a variety of Metahumans?
The live link source is not working on the males? Are you doing this in UE4 or UE5?
@@FeedingWolves sorry, to clarify, the recorded results with the males have very inconsistent results. In UE4 and UE5. Like scaling issues on the recorded data.
@@JenniferMcSpadden are you recording body or face data?
@@FeedingWolves both simultaneously. Optical body data and face from Faceware. Fingers from gloves.
Is there a button to putting down manual keys?
Hi! I believe S is what what you mean? When you have "keyed this section" in the additive layer, when you add keys, you press S. Unless your question meant something else?
@@FeedingWolves thanks that’s what I meant.
When I :Bake to Animation Sequence" at 3:15 .. it doesn't create animation. Just all tracks with flat lines when I open the created animation. I did right click on the face track when I did this too. Maybe the Unreal 5 version is different than this 4.x version? I feel like there has to be a missing step to tell the keyframes on the myphone track to actually drive the "face" track. The face animates with the live link correctly and when I look at the raw clip it animates correctly as well. Just getting it to jump from the myphone keyframes data to drive the "face" layer in the sequence we unlocked isn't happening. Bake produces tracks with flat lines. ---EDIT--- NEVER MIND... I Forgot to press the play button so that it is running properly. Sorry it works correctly now. :) Thanks
Are you using UE Live Link face?
In the comments here, Paul Grey mentioned he uses simulation mode running while you bake to an animation sequence in 5.0.3.
@@FeedingWolves Yeah it was the play mode not running. Sorry. Left the comment there in case anyone else makes the same slip up. Very useful info here. So many tutorials get the setup... but actually setting it up to include the iPhone data ... as well as baking it down to usable clips was essential for a traditional cinematics to render workflow. Thanks for the help.
Hey there,
I can create 52 blendshapes on a custom character, like the ones on the metahuman. Hit me up if you need any.
no need to bake.. just import into main sequence the data
how do u find the message u wanna reply to, I hate TH-cam replies...lol
haha did you figure out the neck rotation issue being lost after being baked to the control rig?
@@FeedingWolves yes, if figured it all out...buggy shitshow that it is..in the end I forced stuff with blueprints...super annoying...dont; get me started on Rokoko...lol.
@@NicolasLekai Any chance you can share the solution, please? Also, @feeding_wolves, is the discord server still up? Couldn't join for some reason. Thanks!
@@josem.norton4136 sorry Jose I already forgot...lol...been in bug world of UE ever since...
this is "arkit"?
Yes;)
Thank you!
Thank you!
Thank you!