Facial Mocap in Unreal - Tutorial for Advanced Users

แชร์
ฝัง
  • เผยแพร่เมื่อ 22 ก.ค. 2024
  • Discover the new features of our plugin for Unreal Engine 4. Learn a few tips in Unreal with Flora to get the best facial animation using our motion capture software Grabber and Dynamixyz Live Link Plugin.
    01:02 - CUSTOMIZE YOUR ANIMATION
    01:25 - Connect to Dynamixyz Grabber
    03:09 - Set up your retargeting blueprint
    04:30 - Fix the head
    05:02 _ Customize the blendshapes
    05:57 - Customize the bones
    06:50 - Blend face and body
    07:35 - CONTROL SEVERAL CHARACTERS
    07:46 - With the same Grabber & RT profile
    09:20 - With multiple instances of Grabber
    10:46 - With multiple retargeting profiles
    12:22 - EXPLORE THE WIDGET BLUEPRINTS
    12:26 - Display the video feedback from Grabber
    14:22 - Calibrate the actor's pose
    16:08 - Trigger a video recording from Unreal to Grabber
    17:56 - ANIMATE IN A PACKAGED GAME
    Links :
    Download Dynamixyz Live Link Plugin from the marketplace : www.unrealengine.com/marketpl...
    First steps with Dynamixyz Live Link Plugin : vimeo.com/345723539 (Vimeo) / • Live face tracking wit... (TH-cam)
    All our online tutorials : vimeo.com/showcase/1894568 (Vimeo) / • Dxyz Factory Tutorials (TH-cam)
  • ภาพยนตร์และแอนิเมชัน

ความคิดเห็น • 71

  • @alexusa-zo3fn
    @alexusa-zo3fn ปีที่แล้ว

    12:18 that wink

  • @Silpheedx
    @Silpheedx 3 ปีที่แล้ว +1

    Thank you so so very much for this!

  • @CinematographyDatabase
    @CinematographyDatabase 4 ปีที่แล้ว +9

    Looks great!

    • @zaneangel6181
      @zaneangel6181 3 ปีที่แล้ว

      a trick : you can watch movies at kaldroStream. Me and my gf have been using them for watching a lot of movies lately.

    • @shepardanders735
      @shepardanders735 3 ปีที่แล้ว

      @Zane Angel yea, I have been watching on kaldroStream for years myself :)

  • @pipo0569
    @pipo0569 3 ปีที่แล้ว +1

    hola, muchas gracias

  • @dela_films
    @dela_films 3 ปีที่แล้ว +1

    Hi, is there away of controlling this in the UE4 Sequencer?

  • @ZakariaKhaldi
    @ZakariaKhaldi 3 ปีที่แล้ว +1

    can I Use my sony camera to record facial animation?

  • @Andrew-rq1gg
    @Andrew-rq1gg 3 ปีที่แล้ว

    How do I use them in the editor with out playing

  • @Andrew-rq1gg
    @Andrew-rq1gg 3 ปีที่แล้ว +1

    how do I use it in sequence

  • @AleRender
    @AleRender 3 ปีที่แล้ว +2

    A query: where does the profile loaded with "call_rt" come from. Where do the files "esc" and "dmc" come from?

    • @DynamixyzTeam
      @DynamixyzTeam  3 ปีที่แล้ว

      Hi! The "call_rt" profile was created via the Performer software. Exporting the profile into the software generates an .esc file which contains the entities (blendshapes and bones) of the model used during the retargeting phase, and a .dmc calibration file which contains the information from the camera used to create the profile (resolution, focal length, distortion) !

  • @leostrauss9376
    @leostrauss9376 4 ปีที่แล้ว

    Can the body be driven by the head location? I mean if you don't have a mocap suit and want to be able to at least drive it with the head location with inverse kinematics or whatever, is it posible? Does it track the head as a whole? Or is it any documentation for doing that?
    I know it kind of depends on the rig and stuff, but I'm curious!
    Thank you in advance!

    • @DynamixyzTeam
      @DynamixyzTeam  4 ปีที่แล้ว

      Hi Leo :)
      If you are using a static camera, the head bone will be driven by your position&orientaion in front of the camera. However, this will not be the case if you are using a HMC since your position&orientation will always remain the same. In that case, you might want to use an idle animation or combine Dynamixyz with a head-tracking solution. Another idea would be to get the eyes rotation to influence the head in the animation blueprint, but it won't feel as natural as if you use a proper head-tracking solution.

  • @ty_teynium
    @ty_teynium 4 ปีที่แล้ว +2

    I couldn't help but laugh when the two winked 😆. Also does a performance for motion capture have to be live. By this I mean can you record a video of yourself dancing and use the data captured for Unreal to use as motion capture?

    • @DynamixyzTeam
      @DynamixyzTeam  4 ปีที่แล้ว

      Hi, there are basically two ways to do mocap : offline and live/pre-recorded. Offline means it will produce an animation file that you can rework in a 3D soft like Maya, Motion Builder, etc. Live/pre-recorded means you will use a video stream/file to directly animate into a real-time engine, like in this tutorial :)

  • @Jsfilmz
    @Jsfilmz 3 ปีที่แล้ว +1

    whoaa a retarget tool with a ui. Will this work with reallusion characters?

    • @DynamixyzTeam
      @DynamixyzTeam  3 ปีที่แล้ว +1

      Hi! We don't have any bridge for Iclone. However if your characters are bones or blend shapes based they can be exported in FBX format to be used in a compatible 3D software. :)

  • @xxerbexx
    @xxerbexx 3 ปีที่แล้ว

    i still dont get this.
    Im a somewhat experience user.
    I would like to know what kinda licence we are talking about here.
    do i only need the ue4 add on? or do i need to buy the sofware for this absolutly ridiculous pricing on your website?

    • @DynamixyzTeam
      @DynamixyzTeam  3 ปีที่แล้ว

      Hi xxerbexx, Flora mentions 2 different software packages to do real-time facial animation with Unreal Engine: Live Pro which is specific to an actor and gets you the best out of an actor's performance and Live Instant which works with any face. Both packages come with licenses of Grabber and Performer with features limited to real-time only.

  • @AleRender
    @AleRender 3 ปีที่แล้ว +1

    my character is made in character creator ... but I don't match any of the morph names

    • @DynamixyzTeam
      @DynamixyzTeam  3 ปีที่แล้ว

      Hi! This should work. Did you do well in the retargeting phase with one of the supported softwares (Maya MotionBuilder, 3DSmax, Cinéma4d)?

  • @CHITUS
    @CHITUS 2 ปีที่แล้ว +2

    Very sad to see this beautiful software ended with upsetting there users

  • @freenomon2466
    @freenomon2466 4 ปีที่แล้ว +3

    how much is graber for unreal? is it subscription only or do you also have perpetual? is graber all that is needed to do live unreal streaming animation or do I need other modules?

    • @DynamixyzTeam
      @DynamixyzTeam  4 ปีที่แล้ว

      Hi, Grabber is for streaming animation, you need another software and a 3D soft to create your profile first. We provide two offers : Live Instant (generic tracking with a quick setup) and Live Pro (specific tracking with high fidelity) you can find information and pricing here : www.dynamixyz.com/software, and you can access a 1-month trial :)

    • @freenomon2466
      @freenomon2466 4 ปีที่แล้ว

      DynamixyzTeam so I need graber and live pro for optimal quality?
      how about for offline solutions? does it yield better quality end mocap compared to live versions?

    • @DynamixyzTeam
      @DynamixyzTeam  4 ปีที่แล้ว

      @@freenomon2466 Hi again, indeed, for optimal live-animation quality, Live Pro would be the wise choice. Offline production solutions offer more control on the final animation, so the quality can be improved in a number of ways. If you are interested in both live and production, you can try our whole package Dxyz Factory for 1 month by registering here : www.dynamixyz.com/free-trial.

    • @aelendysfaery182
      @aelendysfaery182 4 ปีที่แล้ว +1

      @@DynamixyzTeam It's totally weird... Or I didn't understand at all... On your page, the "Live Instant" and "Live Pro" softwares are far more expensive than the whole package (Dxyz Factory). Is this an error ?

    • @DynamixyzTeam
      @DynamixyzTeam  4 ปีที่แล้ว +1

      @@aelendysfaery182 Hi! I agree this can be confusing on our website. We have different pricing depending on your status: Indie or Studio. We recommend the Dxyz Factory solution for Indie. We'll improve that, thank you for your comment! :)

  • @krisztiankovacs1014
    @krisztiankovacs1014 3 ปีที่แล้ว

    Hi, very informative video. Do you know of a possible solution that I'd record my own face and unreal engine would produce a player with my face? I hope this question makes sence. So I basically want to make a short video skit and I'd like to put myself into the video within the unreal engine.

    • @DynamixyzTeam
      @DynamixyzTeam  3 ปีที่แล้ว

      Hi! You can use the Grabber feedback widget to get the video input on a 2D layer in your Unreal scene (12:26 in the video). Hope this helps ! :)

    • @krisztiankovacs1014
      @krisztiankovacs1014 3 ปีที่แล้ว

      @@DynamixyzTeam thank you!

  • @experiencescience3975
    @experiencescience3975 4 ปีที่แล้ว +1

    Does it work with any camera or we need depth Sensing camera like iPhone 10?

    • @DynamixyzTeam
      @DynamixyzTeam  4 ปีที่แล้ว +1

      Hi, our software can be used with any type of camera, from a simple webcam to a Head Mounted Camera

    • @experiencescience3975
      @experiencescience3975 4 ปีที่แล้ว +1

      DynamixyzTeam thank you so much.

  • @TheXarxus
    @TheXarxus 4 ปีที่แล้ว +3

    What if my rig is made with controllers? can grabber stream controllers into UE4?

    • @DynamixyzTeam
      @DynamixyzTeam  4 ปีที่แล้ว

      Hi, only bones and blendshapes can be driven in Unreal, however you can set-up your animation profile using controllers and convert it to a bones-and-blendshapes real-time profile within a few clicks in our software :)

    • @canyonroadstudios5007
      @canyonroadstudios5007 3 ปีที่แล้ว

      @@DynamixyzTeam Is there a way to set-up the animation profile without using controllers and just the bones and blendshapes in maya?

    • @DynamixyzTeam
      @DynamixyzTeam  3 ปีที่แล้ว

      @@canyonroadstudios5007 Hi ! Yes it is possible, just select the bones in the outliner, and the blendshapes node from the Shape Editor. This tutorial shows how to create a real-time entity-set and transfer existing retargeting links from a controller-based entity-set : vimeo.com/showcase/7016283/video/345722416 :)

    • @canyonroadstudios5007
      @canyonroadstudios5007 3 ปีที่แล้ว +1

      @@DynamixyzTeam Thank you guys so much! It was total user error on my part though..I figured out that I had an older version of bridge installed and that is why it was not saving the blendshapes to the entity. Updated to current bridge and all is well..you live and learn lol...

  • @skilattutos6696
    @skilattutos6696 3 ปีที่แล้ว

    C'est exactement ce que je cherchais

  • @Assassins748
    @Assassins748 3 ปีที่แล้ว

    hello how download and install grabber pleasse

    • @DynamixyzTeam
      @DynamixyzTeam  3 ปีที่แล้ว +1

      Hi! Thank you for reaching out. You can request a free trial to download performer and grabber during one month. www.dynamixyz.com/free-trial

  • @ntygamer20
    @ntygamer20 3 ปีที่แล้ว +1

    what cam do you use?

    • @DynamixyzTeam
      @DynamixyzTeam  3 ปีที่แล้ว

      Hi! We used a classic camera filming in 720p

  • @jiexu6082
    @jiexu6082 4 ปีที่แล้ว +1

    Hi, how do I get Grabber?

    • @DynamixyzTeam
      @DynamixyzTeam  4 ปีที่แล้ว

      Hi! You can request a free trial on our website: www.dynamixyz.com/free-trial. You've got one month to try Grabber and Performer with all features.

  • @3dartdesign372
    @3dartdesign372 3 ปีที่แล้ว

    How can I find your first basic tutorial share your link.......thanx 0:32

    • @DynamixyzTeam
      @DynamixyzTeam  3 ปีที่แล้ว +1

      Hi adnan, please jump to our playlist Performer Tutorials: th-cam.com/play/PLCJCE87-qdi8019mb8VVEeygRp7c0B5qg.html

  • @henriquelc3
    @henriquelc3 4 ปีที่แล้ว

    Possible use in blender?

    • @DynamixyzTeam
      @DynamixyzTeam  4 ปีที่แล้ว

      Hi Henrique, our live mocap solution can stream data into Maya, Motion Builder, Unreal and Unity. However, we do share our network protocol with users who want to get the data into other external software, just send an e-mail to support@dynamixyz.com :)

  • @timurozer6709
    @timurozer6709 4 ปีที่แล้ว +3

    Can we into the cutscene in Unreal Engine 4?

    • @DynamixyzTeam
      @DynamixyzTeam  4 ปีที่แล้ว +1

      Hi Timur Özer, could you please tell us more about your needs? We'd be happy to help you :)

    • @timurozer6709
      @timurozer6709 4 ปีที่แล้ว +1

      @@DynamixyzTeam I want to make cutscene in my game. I use unreal engine 4 for my game. So can i add this face animation in cutscene. For exampla talk to Npc

    • @timurozer6709
      @timurozer6709 4 ปีที่แล้ว

      ???

    • @DynamixyzTeam
      @DynamixyzTeam  4 ปีที่แล้ว +1

      @@timurozer6709 Hi again Timur ! Yes, our solution can either be used to stream your animation into Unreal and record your cutscenes from here, or generate FBX animation files then import and play them into Unreal. You can register for a free trial here to try out our solution : www.dynamixyz.com/free-trial :)

  • @Andrew-rq1gg
    @Andrew-rq1gg 3 ปีที่แล้ว

    does input pose link to the animation

    • @DynamixyzTeam
      @DynamixyzTeam  3 ปีที่แล้ว

      Hi Andrew, with the Dxyz Livelink plugin you can connect our software Grabber to Unreal and track your actor in real-time. It will stream the motion to Unreal Engine and animate your character in real-time.

    • @Andrew-rq1gg
      @Andrew-rq1gg 3 ปีที่แล้ว

      @@DynamixyzTeam yes but at 2:37 if you link "Play Call_idle" to "Live Link Pose" will the animation play and can you talk when the idle animation plays

    • @DynamixyzTeam
      @DynamixyzTeam  3 ปีที่แล้ว

      hi @@Andrew-rq1gg , after checking with our experience team, it looks like that if you want to play an idle animation and the facial animation at the same time, you have to add the "Layered blend per bone" node in your AnimGraph. After, link your idle animation to the "Base Pose" input and the facial animation to "Blend Poses O" input. Then, link output to "Output Pose" node and the animation will play both at once. Hope that helps. If you want to dig the subject, please email support@dynamixyz.com.

  • @feshprod1121
    @feshprod1121 3 ปีที่แล้ว +2

    ahh mais vous êtes français ? XYZ comme texturing a toulouse ?

    • @DynamixyzTeam
      @DynamixyzTeam  3 ปีที่แล้ว +2

      Bonjour! Oui nous sommes une entreprise basée à Rennes :)

    • @hugo17089
      @hugo17089 3 ปีที่แล้ว

      @@DynamixyzTeam mais nan des Rennais :)

  • @videos40058
    @videos40058 3 ปีที่แล้ว +3

    I'm giving up again!

  • @skilattutos6696
    @skilattutos6696 3 ปีที่แล้ว

    It would be much better to have only one tutorial for everything rather than having to search for how to do things separately... Why not show how to make an liveinstant
    profile?

  • @jasondonaire2593
    @jasondonaire2593 3 ปีที่แล้ว

    $ 356.53 is too steep for Indie price per month. Who can afford that? I thought Iclone 7 Face mocap was expensive.

  • @ranaumair100
    @ranaumair100 2 ปีที่แล้ว +1

    Very sad to see this beautiful software ended with upsetting there users

    • @JCPhotographyMallorca
      @JCPhotographyMallorca 2 ปีที่แล้ว

      what happened it seems the software has been taken down cant find the link to it anywhere

    • @ranaumair100
      @ranaumair100 2 ปีที่แล้ว +1

      @@JCPhotographyMallorca these guys merged with another company and discontinuous software development and there software are not functional any more

    • @JCPhotographyMallorca
      @JCPhotographyMallorca 2 ปีที่แล้ว

      @@ranaumair100 ahh I see that is a shame looked like a great software