How to Retarget Motion Capture Animations to Rigify Characters in Blender - Rokoko Guide

แชร์
ฝัง
  • เผยแพร่เมื่อ 10 พ.ย. 2024

ความคิดเห็น • 67

  • @plyczkowski
    @plyczkowski 3 ปีที่แล้ว +37

    The character is not 'rigged with rigify', the rigify rig is what you get when you click 'Generate Rig'...

  • @kat74809
    @kat74809 2 ปีที่แล้ว +10

    What if the animation is stored in the rig generated by rigify rather than the metarig? I want to use the rig as a source, but I can't select it. Why is this? The rig can only be selected as a target.

  • @dinopuff7354
    @dinopuff7354 ปีที่แล้ว

    ill admit enitially seeing this method i didnt think it would work very well, working with FK joints is never appealing to think about and the method shown looked almost to simple to be true... whelp i will now admit i am completely wrong, working with fk still isnt the best but my word is it simple to set up onto the characters and quickly edit the motion capture data to look more appealing especially when it comes to posing. so thank you for the amazing tutorial i am incredibly impressed with how much rokoko has done with tutorials working with various applications to get high quality motion capture footage with relatively easy setup,

  • @marcoelfilmm
    @marcoelfilmm 7 หลายเดือนก่อน

    How do you add the T pose to the rokoko armature? Do you just pose it in blender?

  • @funnyberries4017
    @funnyberries4017 หลายเดือนก่อน

    hey! You messed this up. After you click "Generate rig" you need to delete the metarig, and parent with the thing called "Rig". From there, you need to retarget. It's very tedious as it currently is, it would be nice if the rokoko addon was set up to have the proper names from a standard rigify rig.
    To clarify, the rig that is Generated, that is what needs to be retargeted to. The Meta-rig, which is what you are using inthe video, is not the rig to be skinned to the model.
    Hope this helps

  • @nosyb
    @nosyb 3 ปีที่แล้ว

    Super tools , and free. Thank you Rokoko!

  • @runningcoyote9972
    @runningcoyote9972 3 ปีที่แล้ว +2

    what if we need IK controllers for hands and feet ?

  • @raymondwood5496
    @raymondwood5496 ปีที่แล้ว

    I thinking to transfer the motion to rigify rig.. i think there should be some methods.. later will try it out

  • @andrew_raya
    @andrew_raya ปีที่แล้ว +2

    Someone know how to do it WITH rigify? xD

  • @dragonskunkstudio7582
    @dragonskunkstudio7582 3 ปีที่แล้ว +7

    I'm confused, why did you hit the generate rig if you're not gonna use it?

    • @Simon2d3d
      @Simon2d3d 3 ปีที่แล้ว +1

      If you want to do this, go here:
      th-cam.com/video/Hz2rci_dVOI/w-d-xo.html

    • @dragonskunkstudio7582
      @dragonskunkstudio7582 3 ปีที่แล้ว +2

      @@Simon2d3d Video = private

  • @themightyflog
    @themightyflog 3 ปีที่แล้ว

    Thank you! It did!

  • @havardtveito4070
    @havardtveito4070 ปีที่แล้ว

    Hi! I am working with some animations that was captured with Rokoko and retargeted to the Rigify rig. But is there any tutorials on how to export them to UE5? Because UE5 does not respond well to the Rigify rig as far as I can see...

    • @RokokoMotion
      @RokokoMotion  ปีที่แล้ว

      Hey! Thanks for your question. I recommend you check out the Rokoko Guide video through the link here - th-cam.com/video/470p0tFL8pI/w-d-xo.html. Hope this helps!

  • @castoxmods
    @castoxmods 3 ปีที่แล้ว

    Hello, I cannot create a keyframe on my new layer, any solutions?

  • @ShutterAuthority
    @ShutterAuthority 3 ปีที่แล้ว +3

    Thanks for the cool tutorial Sam! Have you figured out a way to easily get the rig to work with IK + Mocap data?

    • @why7893
      @why7893 3 ปีที่แล้ว

      Did you figure it out?

  • @jeancampos5831
    @jeancampos5831 3 ปีที่แล้ว

    Cool! Thanks for it!

  • @superconceptng
    @superconceptng ปีที่แล้ว

    Thank youuu

  • @NickShaheen
    @NickShaheen 3 ปีที่แล้ว +2

    Is there a way to tweak the animation in C4D similar to the "non-linear" animation layer technique?

    • @RokokoMotion
      @RokokoMotion  3 ปีที่แล้ว

      There is, here is the tutorial: th-cam.com/video/gu-sYzoH2tQ/w-d-xo.html

  • @Γνωθισαυτον15
    @Γνωθισαυτον15 3 ปีที่แล้ว

    Hi, I really would love to use the rokoko plug in with the human generator addon. Whatever I try fails ... any chance for a walk through of that workflow. Whenever I go for it I get an Error with something like this: euler = pbone.matrix_basis.to_euler(obj.rotation_mode, euler_prev)
    ValueError: Matrix.to_euler(): invalid euler order 'QUATERNION'
    Unfortunatly I am not in animation at all - so maybe it´s easy to solve. Any advice would be very welcome. All the best.

  • @GhostUEP
    @GhostUEP 3 ปีที่แล้ว

    great stuff

  • @SuperGari2
    @SuperGari2 3 ปีที่แล้ว

    Would Rokoko works with short character(very short legs or arms)?

    • @RokokoMotion
      @RokokoMotion  3 ปีที่แล้ว

      Definitely! You just might get some foot sliding because of the difference in the limb proportions - that can be fixed using animation layers in Blender, though!

  • @dam55ian
    @dam55ian 2 ปีที่แล้ว

    if ur rigging a character this way with the Rokoko retarget can u export the model and have it work with the smarts uit in lets say unreal?

    • @RokokoMotion
      @RokokoMotion  2 ปีที่แล้ว

      Yes, if you export to an FBX you'll have the rig and the mesh retained and can use it in other contexts like Unreal 😀

  • @curtiswindover4564
    @curtiswindover4564 ปีที่แล้ว

    Sacrifice having a control rig? After retargeting you might have hundreds of tweaks and additions you want to keyframe in. Finessing the fingers for example. Ditching the control rig is going to cost you a lot of time isnt it?

  • @insertanynameyouwant5311
    @insertanynameyouwant5311 3 ปีที่แล้ว

    sometimes it works but arms are in the body, how can I fix it?

    • @RokokoMotion
      @RokokoMotion  3 ปีที่แล้ว

      It probably has something to do with the rest pose of the character being an APose - check out this tutorial for more information on that: th-cam.com/video/PTbxh1J8qLk/w-d-xo.html

  • @StrayVertex
    @StrayVertex 3 ปีที่แล้ว

    Neat, thx :)

  • @Frigus3D-Art
    @Frigus3D-Art 2 ปีที่แล้ว

    But what if you need the animator rig bc you facecapture with blendartrack (android) and that relies on the generated rig?

    • @RokokoMotion
      @RokokoMotion  2 ปีที่แล้ว

      Hello! You can use our plugin to retarget to any humanoid rig, this is just one example where we set up a mesh with a rig first. Just follow the process from 3:34 and forward with your own rig - though do make sure you pick the appropriate bones, might take a bit of guessing if the names are wildly different. You can save the bonemap afterwards and reapply it to other characters using the same rig, however, so it's a one-time process 🤓

    • @kat74809
      @kat74809 2 ปีที่แล้ว

      Did you ever find a solution?

    • @Frigus3D-Art
      @Frigus3D-Art 2 ปีที่แล้ว

      @@kat74809 yes, simply retarget the animator rig. in the armture tab set the bonelayers (the grey boxes where some have points in it) so you can see the underlying bone skeleton. (not the helperbones)
      this skeleton are the bones you have to retarget. also you have to turn from ik to fk. hope this will help you

    • @kat74809
      @kat74809 2 ปีที่แล้ว

      ​@@Frigus3D-Art I'm trying to use cgtinker's BlendArMocap addon. It must be used with Blender's Human (Metarig) to transfer animation. I followed the instruction: Shift+A->Human (Metarig), In Object Data Property-> Generate Rig. The addon then transfers the animation in the rig generated by rigify rather than the metarig. The metarig is essentially useless and can be deleted. I want to use the rig as a source, but I can't select it. Why is this? The rig can only be selected as a target.

  • @conorsvfx
    @conorsvfx 2 ปีที่แล้ว

    Great tutorial!! Is there a tutorial to stop feet from sliding? I’ve used radical ai for my mocap but I know rokoko also has this problem sometimes?

  • @3dkarate-virtualdojo280
    @3dkarate-virtualdojo280 3 ปีที่แล้ว +2

    Great tutorial! Any way to add the control rig (rig) so its possible to use the controls from that rig?

  • @CannyK9
    @CannyK9 3 ปีที่แล้ว

    Hi! I'm very interested in being able to override certain parts of the mocap animation, but having only worked on linear animations by hand so far, I'm not completely clear on the NLA tracks. My issue is that I cannot rotate a bone to keyframe it away on an extra layer as is shown from 5:28 onwards - I'm assuming that's because all the bones have constraints pinning them to the source skeleton. There's a cut in the video at 5:56, after which the Character1_Reference armature has disappeared, presumably along with the constraints, leaving just the base rig and the new animation. I can't figure out what happened in that cut but it seems like it contains a missing step, could you let me know whether that's the case? Cheers!

    • @CannyK9
      @CannyK9 3 ปีที่แล้ว

      I believe the issue here was that Blender 2.9 was crashing part-way through the re-targeting, so it was creating constraints but failing to create a new action, then leaving a seemingly valid unbaked set-up. It works well on 2.8!

    • @RokokoMotion
      @RokokoMotion  3 ปีที่แล้ว

      Hey there🙂Glad you've resolved the issues! In case there is anything else you need help with, do not hesitate to contact our Support Team at support@rokoko.com 🦾

  • @dominikl3406
    @dominikl3406 3 ปีที่แล้ว

    Hi Sam could you show how to retarget the rokoko fbx mocap to a Auto rig pro rigged character?

    • @RokokoMotion
      @RokokoMotion  3 ปีที่แล้ว +2

      Hey Dominik - It's on the docket!! We know there are a bunch of issues that arise from AutoRigPro's animation rig that gets layered on top, but we think we found a good workaround and will be getting that video out shortly. Thanks!

    • @dominikl3406
      @dominikl3406 3 ปีที่แล้ว

      @@RokokoMotion Hi Sam thanks for the answer. Keep up your great tutorials :)

  • @MagicSwordFilms
    @MagicSwordFilms 3 ปีที่แล้ว

    I've been having an issue where my hands are crossed at the beginning of an animation, and then throughout are pretty far from where the base BVH data is. Anyone have this issue before?

  • @georgeheinz7074
    @georgeheinz7074 3 ปีที่แล้ว

    SAM and rokoko team great job! Question: I’ve learned a tutorial from Udemy... using blender and mocap... And the professor say: to do this... Use your mocap suit (rokoko, xsens, etc) and then rig it with “auto rig pro”... but I see if I recently I bought the rokoko suit, could be easier to pay a “studio plus plan and face capture software” than others softwares in the marketplace .... anyway, my question is: Do I need Auto rig pro if I decide to pay studio plus ?? Or what is the best workflow you recommend to me once you get a “rokoko suit”. (I don’t wanna pay extra softwares) THANK YOU! I’ll wait your answer
    Example:
    Environment: you can use blender and substance painter or do yourself
    Characters: mixamo, character creator 3d or do yourself
    Rigging and animation: get a mocap suit (rokoko the best hehe) + this software to rig it and you’ll be perfect
    Lights, camera and rendering: we recommend cinema tracker or blender.
    Etc... (It will be so awesome to have an entire workflow to make an animation of 1 minute)
    Bye Sam 😃

    • @georgeheinz7074
      @georgeheinz7074 3 ปีที่แล้ว

      @rokoko SAM please this question 🙋‍♀️ thanks

    • @RokokoMotion
      @RokokoMotion  3 ปีที่แล้ว +1

      Hey Sole - So if you're already invested in and know Blender, I would definitely recommend staying within Blender to do all your mocap retargeting. The Auto Rig Pro stuff that the professor was talking about was probably in regards to rigging a mesh (giving a character a skeleton, essentially). You can also use Auto Rig Pro to do retargeting, but you definitely don't need to - our plugin, which is free, can do all that retargeting for you using the method shown in the video. We also have a ton of tutorials about retargeting on the channel you can check out. So, for your example - you would download a rigged character from Mixamo, record your mocap using Rokoko, and then retarget your mocap to your rigged character in Blender using the Rokoko Blender Plugin. We've been getting a lot of requests taking people through the entire process from start to finish, so we'll probably put out a tutorial like that soon. TL;DR - no, you don't need Auto Rig Pro to work with our mocap in Blender, just our free plugin. Hope that helps!

    • @georgeheinz7074
      @georgeheinz7074 3 ปีที่แล้ว

      @@RokokoMotion you are so kind !! I appreciate your answer. So rokoko plug-in is free. But if I want to use a live system (body or face)... I need to buy both licenses right? Is that makes senses?
      Well, my question is... when do you recommend buy rokoko studio licenses?? (Faster workflow? Etc) thank you! Rokoko the best

    • @RokokoMotion
      @RokokoMotion  3 ปีที่แล้ว +1

      @@georgeheinz7074 Hi Sole - there is actually a 30 day free trial for the Pro subscription, which gives you access to the Live Plugins and also includes 30 days of facial mocap. I would do that and then try it out with your workflow to see if it's a good fit! I do think it's nice to be able to record everything to one program (face, body and hands) but you could use other facial mocap software alongside your face and hands mocap, just depends on the specific workflow I think. Hope that helps!!

  • @blenderblender792
    @blenderblender792 2 ปีที่แล้ว +7

    NOTE TO SELF IGNORE THIS TUTORIAL IT IS POINTLESS

    • @tajinderpal4561
      @tajinderpal4561 5 วันที่ผ่านมา

      did you find anything on retargeting with actual rigify rig ?

  • @RiggingDojo
    @RiggingDojo 2 ปีที่แล้ว +3

    This isn't a correct workflow look @cgdive for proper rigify retargeting. This video should be removed as it is going to just cause every user problems who follows it.

    • @mattwhitehead32
      @mattwhitehead32 2 ปีที่แล้ว +2

      This should be the top comment. "The rig that we're ignoring." It is just downright unprofessional to call this a tutorial for using rigify. People want a rigify tutorial because they *also* want to hand animate additional stuff on top of their mocap (like say, wings, or extra arms or something) or simply just clean up with better controls than you get from adding keys to a single barely functional bone.

    • @RokokoMotion
      @RokokoMotion  2 ปีที่แล้ว +1

      Thanks for pointing this out! The idea was to show a way to easily associate the bones with the mesh using the plugin, but it is not what the title is implying. I've forwarded your comment to evaluate if we should rename the video and/or make another video that makes proper use of the rig controls. Much appreciated! 👍

    • @mattwhitehead32
      @mattwhitehead32 2 ปีที่แล้ว

      @@RokokoMotion Cool beans! So, if you want to do something like this to make a simple deform bone, what I would do is make your own 'metarig' template that's actually just a match to the default mocap bones that people can 1-click add and line up (because this use case is also going to be common- plenty of people just want their mesh humanoid to work with their suit, right). That then avoids the rigify confusion issue entirely. Then also cover rigify separately. It's actually pretty easy to take a look at how rigify outputs templates and you 'borrow' the tools it has to help you get the python you need to make yours and derive whatever else you might want around it to make it work better in your addon.

    • @madex3d120
      @madex3d120 2 ปีที่แล้ว

      @@mattwhitehead32 This is exactly what I was thinking, and I'm I'm brand new to character animation. I know that I'm going to need those damn hands to look like they grabbing stuff.

    • @RokokoMotion
      @RokokoMotion  2 ปีที่แล้ว

      Great suggestion! We'll definitely keep this in mind for an updated video 🤓

  • @nbamol5453
    @nbamol5453 3 ปีที่แล้ว

    im using blender 2.93 when i try to unable the addon i get this error
    ModuleNotFoundError: No module named 'rokoko-studio-live-blender-master.packages.win.lz4._version'