Unreal Engine Metahuman Face and Body Motion Capture Tutorial

แชร์
ฝัง
  • เผยแพร่เมื่อ 2 พ.ย. 2024

ความคิดเห็น • 62

  • @Jsfilmz
    @Jsfilmz  3 ปีที่แล้ว +3

    Support my channel by buying some JSFILMZ merch
    www.amazon.com/s?rh=n%3A7141123011%2Cp_4%3AJSFILMZ&ref=bl_sl_s_ap_web_7141123011

    • @fahdbitahi2696
      @fahdbitahi2696 3 ปีที่แล้ว +1

      ok

    • @kodyleon8639
      @kodyleon8639 3 ปีที่แล้ว +1

      dunno if anyone gives a damn but if you are stoned like me atm then you can watch all of the latest series on InstaFlixxer. Have been streaming with my gf during the lockdown =)

    • @jackdavion8782
      @jackdavion8782 3 ปีที่แล้ว +1

      @Kody Leon Yea, I have been using InstaFlixxer for years myself =)

  • @mindped
    @mindped 2 ปีที่แล้ว +1

    no where in this video do i see anything about what software u used for the facial mocap.

  • @27mth
    @27mth 3 ปีที่แล้ว +1

    This is what I need.:O TY

  • @mrukgamer
    @mrukgamer 3 ปีที่แล้ว +2

    For anyone who installs the neuron plugin and still cant see it pop up under "Load" here is what to do, press load then at the bottom itll say options, click on this and select "show plugin content" and itll pop up.

  • @TheShureen
    @TheShureen 3 ปีที่แล้ว +2

    Hi thank you so much for this amazing tutorial! I have two questions - Have you tried this set up in Real-Time in VR? It keeps on crashing, it doesn't show the metahuman hair and also the LiveLink app is like blocking into the head sensor of Noitom and it gets the face tracking but not the head tilt of the LiveLink app. If you have any idea regarding these issues i would be extremely grateful!

  • @koraybirand
    @koraybirand 3 ปีที่แล้ว +1

    Hey JS, i have been struggling with the seq recorder. I got it to work once but i do not get a consistent result. There seems to be no pattern to follow to het a steady result. Did you find a better workaround ? I tried to use the take recorder it works but just the head the reat of the body stays in T pose .

    • @Jsfilmz
      @Jsfilmz  3 ปีที่แล้ว

      yea man i struggle with it as well unfortunately epic's focus is still video games so maybe next year when ue5 comes out officially all the quirks will be worked out. I am sure they are tracking

  • @ninomancuso7021
    @ninomancuso7021 ปีที่แล้ว

    Nice tutorial, quick question about body and face combined mocap. If you're NOT using a metahuman, which has the handy input dropdown in its BP for iphone livelink, you would need to build an Anim BP for the character with a live link pose, and then select the iphone.
    But Anim BPs are typically driving body mocap. So how can you combine both at the same time if it isnt a metahuman with the built in drop down?

  • @sebastian_dohnal
    @sebastian_dohnal 3 ปีที่แล้ว +1

    Hi, I'd like to ask you... Is there any way how to solve the crossing of the hands, feet... because offten the mode have diferent body lenght than actor, so if for example is leg on the model longer than actor's leg, its ofthen going trouht mesh of the other leg. And this can be cleaned in postprocesing or thare can be some offset but Id like to know if theres any way how to deal with this through capsule coliders, physic ect. ?

    • @Jsfilmz
      @Jsfilmz  3 ปีที่แล้ว +1

      mocap softwares should let u input custom measurements for your body

  • @EricTareDenedoteentalk
    @EricTareDenedoteentalk 3 ปีที่แล้ว +1

    Hey bro. Great tutorial as always. I have an issue and I do not know if you can help. Everything works until I get to the point of adding "live link skeletal animation" I add it but the character does not respond, however in the Animation blue print it is showing that everything is connected properly.. Please if you can assist

    • @Jsfilmz
      @Jsfilmz  3 ปีที่แล้ว

      check the body in the outliner to make sure its set to the correct anim bp

  • @DarionDAnjou
    @DarionDAnjou 2 ปีที่แล้ว

    how do you record and sync audio for the facial animation for example when talking and syncing dialogue?

    • @Jsfilmz
      @Jsfilmz  2 ปีที่แล้ว +1

      one to three clap

    • @DarionDAnjou
      @DarionDAnjou 2 ปีที่แล้ว

      @@Jsfilmz thanks and where are you recording it to? i'm thinking what's the whole workflow?

  • @SP95
    @SP95 3 ปีที่แล้ว +7

    Great intro

    • @Jsfilmz
      @Jsfilmz  3 ปีที่แล้ว +5

      spent 200 on fiverr to get that made

    • @dpredie
      @dpredie 3 ปีที่แล้ว

      Truer words have never been spoken

  • @koraybirand
    @koraybirand 3 ปีที่แล้ว +1

    Great Tut, and great channel. You have all the stuff that falls into my interest. Now the question.
    I followed all the steps. When i click on the livelinkpose node for the retargetting I only get livelinkremapasset and thats it. No UE4remap, no manual. I also watched you other video where you fix the thumb. I also downloaded that manual remap asset. I can not seem to get it into the project because I get a parent class missing error.
    I have created a blank project and imported my metahuman from quixel as well. And I also created a project with Metahumans from my vault (the same project that you have in this tut).
    No luck. Any ideas ?

    • @koraybirand
      @koraybirand 3 ปีที่แล้ว +1

      I know why now. I did not enable the Neuron plugin. I did not want to delete my question because may be someone will make the same stupid mistake.

  • @7_of_1
    @7_of_1 3 ปีที่แล้ว +1

    Actually just tried take recorder again instead of sequence recorder, and that didn’t capture the head movement for some reason. I used the actor BP as source in take recorder and it recorded it all without adding a live link source for the take at all. Now just have to work out how to access the live link blend data, or maybe it’s isn’t record it. If I use live link as source in take recorder, the recording is empty. It’s just weird.

  • @florianbischoff
    @florianbischoff 3 ปีที่แล้ว +2

    Thank you for all the helpful videos. I have a problem with ARKIT in sequencer, when I rcord facial and also the head rotation. It works, but as soon as I add a retargeted animation for the body, it looks like body and face are disconnected. I can solve this by selecting the face anim BP for the face skeletal mesh component instead of custom mode, but doing this, I lose all the head rotation/movement. Any idea what might cause this?

    • @georges8408
      @georges8408 2 ปีที่แล้ว

      Did you find any solution ? I have a very similar problem... head is disconeccted from the boy although facial animation is still here but the head is not following the body

  • @benquernheim797
    @benquernheim797 3 ปีที่แล้ว +1

    I cant get the "Axis Neuron Live" tab to show up under the add "source" in livelink window :(

    • @Jsfilmz
      @Jsfilmz  3 ปีที่แล้ว

      either ur ip is wrong or firewall

    • @benquernheim797
      @benquernheim797 3 ปีที่แล้ว

      @@Jsfilmz where would i change the ip settings in unreal, Im connected wirelessly at the moment to my Perception Neuron Suit and am getting data in AXIS. Im also plugged into a shared router (could be the issue)

  • @magnumchicken
    @magnumchicken 3 ปีที่แล้ว +1

    Does anyone know how to get a MetaHuman working with Begin Component Overlap? Trying to make it where in VR Mode I can “press a button” with the hand. Works with Mannequin. But can’t get it working for MetaHuman.

    • @magnumchicken
      @magnumchicken 3 ปีที่แล้ว

      Ended up making a tutorial on this: th-cam.com/video/ND9uLGk2Kgo/w-d-xo.html

  • @sebastian_dohnal
    @sebastian_dohnal 3 ปีที่แล้ว +1

    For correct thumb you need to change setting of streaming in Axis. Chnage it from Thumb open to Studio. that will fix it. :)

  • @yangarthas4855
    @yangarthas4855 3 ปีที่แล้ว

    感谢教程,骨骼树那里从相对动画改成骨骼是最容易漏掉的重要的一步,自己做的时候找了很久从这里看到

  • @Blue20607
    @Blue20607 3 ปีที่แล้ว

    it's real helpful! btw, how do I create(or get) "remap asset" ? (in 10:52) for other mocap system? thx!

  • @Romeo615Videos
    @Romeo615Videos 3 ปีที่แล้ว

    is there a simple way to bypass all this and just use the skele from the robot in the neuron plugin?

    • @Romeo615Videos
      @Romeo615Videos 3 ปีที่แล้ว +2

      how u going to heart the comment but not reply

  • @dkbattle
    @dkbattle ปีที่แล้ว

    I love your content. I was wondering how much did you have to pay for your motion capture suit?

    • @Jsfilmz
      @Jsfilmz  ปีที่แล้ว

      i dont think its on sale anymore but it was $1700

    • @dkbattle
      @dkbattle ปีที่แล้ว

      @@Jsfilmz understood. Thank you!

  • @chuanjenchang3153
    @chuanjenchang3153 3 ปีที่แล้ว +1

    Dude did you figure out how to trigers the blendshape on cloths ?

    • @chuanjenchang3153
      @chuanjenchang3153 3 ปีที่แล้ว

      I wonder if theres a way to speaks to the control rig directly (from mocap suit) ,that would be sick!

    • @Jsfilmz
      @Jsfilmz  3 ปีที่แล้ว

      yes you can bake it to a control rig

  • @StyleMarshall
    @StyleMarshall 3 ปีที่แล้ว +1

    That looks like hard work , I have left a message 4 you in the RL Forum ;-)

    • @Jsfilmz
      @Jsfilmz  3 ปีที่แล้ว

      word brother checking it now

    • @DanielPartzsch
      @DanielPartzsch 3 ปีที่แล้ว +1

      Where can I find this? Would like to follow the discussion. Thanks.

    • @Jsfilmz
      @Jsfilmz  3 ปีที่แล้ว +1

      @@DanielPartzsch reallusion forum unreal tips and tricks

  • @dani6816
    @dani6816 3 ปีที่แล้ว +1

    Where can i get that kit. Please put a reference video of you connecting that to your pc step by step.

  • @ashokreddy932
    @ashokreddy932 3 ปีที่แล้ว +1

    does apple ar kits works for my android mobile?

    • @Jsfilmz
      @Jsfilmz  3 ปีที่แล้ว

      lol

    • @plagiats
      @plagiats 3 ปีที่แล้ว +1

      No, the cheapest compatible device to get is a second hand iPhone XR

  • @cashewmoney
    @cashewmoney 3 ปีที่แล้ว +1

    Thanks

  • @AICineVerseStudios
    @AICineVerseStudios 2 ปีที่แล้ว +1

    man , do you this intentionally by putting a tutorial with such caption and then when we get it doing ourselves , we get to know , oh shit, there are so many other things to do before you can even call this rigging FREE!!! , seriously, this is a second time I got trapped by your tutorials

  • @FeedingWolves
    @FeedingWolves 3 ปีที่แล้ว +1

    I think a way to fix the thumb might also be to straighten it out in the Tpose asset you created.

    • @FeedingWolves
      @FeedingWolves 3 ปีที่แล้ว

      By the way this method you are using is awesome!! Im doing it right now....of course I keep crashing UE but finally a tut that works!! Thank you!!!

    • @FeedingWolves
      @FeedingWolves 3 ปีที่แล้ว

      I must have done something wrong cause everything works in sequencer but I am noticing in the recording, there appears to be some weird skinning going on with her head.

    • @Jsfilmz
      @Jsfilmz  3 ปีที่แล้ว

      yea curling the thumb works as well

  • @MR_GFX
    @MR_GFX 2 ปีที่แล้ว

    22:24 you go about very important point and your cut your video this is my problem i didn't resolve it

  • @timmayvns
    @timmayvns 2 ปีที่แล้ว +2

    Ohh , its not a tutorial .....

  • @7_of_1
    @7_of_1 3 ปีที่แล้ว +1

    Just watched, man the whole thing is a head f**k. Problem for me I think, I’m using same project on 2 machines in 2 different locations with 2 devices, an iPad and iPhone, and so it works then doesn’t, again and again. Not doing body at moment, just face. Had some good takes using take recorder, but you using sequence recorder, will try that tomorrow. I have to say though, I am getting really frustrated with it and I think rather than just use us all as beta testers, maybe some motion capture tutorials from Epic might have been a good idea.
    Appreciate your videos though, you are getting into the deep dive of it, but it’s just very very frustrating. We keep going though.

    • @Jsfilmz
      @Jsfilmz  3 ปีที่แล้ว

      yea it is. it really seems like a beta test hahahahha. im also waiting on noitom to come up with their tutorial they prolly know a better way

  • @GoraGames
    @GoraGames 3 ปีที่แล้ว +1