ฝัง
- เผยแพร่เมื่อ 24 มิ.ย. 2024
- Dive into the world of Full Performance Capture in Blender using the Rokoko Blender Plugin. Start effortlessly retargeting your data onto your characters and live streaming face and body mocap data from Rokoko Studio.
Download the Blender Plugin here (available for Windows, MacOS, and Linux): rokoko.io/39Z7RaT
Check out this video for a fix for A Pose models: • Rokoko Guide: Easiest ...
Mime Character: shorturl.at/hkQT1
00:00-00:35: Intro to the Full Performance Capture Bundle
00:35-00:59: Two Different Methods
00:59-06:00: Retargeting Full Performance Capture in Blender
06:00-10:26: Live Streaming Mocap Data to Blender
💜 Join our community of 3D professionals, VFX experts, and game devs on Discord: / discord
📣Follow us on:
Instagram: / hellorokoko
Facebook: / hellorokoko
TikTok: / hellorokoko
Twitter: / hellorokoko
LinkedIn: / rokoko
Discover more about Rokoko: www.rokoko.com
Reach us at hi@rokoko.com
#rokoko #mocap #blender
------------------------------------------------------------------------------
SEO: rokoko, rokoko mocap, rokoko motion capture, rokoko smartsuit pro, rokoko smartsuit pro 2 , rokoko blender, blender rokoko, rokoko blender plugin, rokoko blender addon, rokoko smartsuit pro blender, rokoko face capture blender, rokoko blender tutorial, how to use rokoko in blender, rokoko blender live, mocap suit, 3d capture, mocap gloves, hand animation, animation mocap, motion capture, exploring mocap, mocap animation, rokoko gloves, rokokoko animation, motion capture suit, motion capture animation - ภาพยนตร์และแอนิเมชัน
![แฟนแนวใด๋ - ยูริ โตเกียวมิวสิค [OFFICIAL MUSIC VIDEO ]](http://i.ytimg.com/vi/4_XVMuhhbsU/mqdefault.jpg)
This is Epic! Thanks for making the video. Keen to try live mode!
Me gusta este traje de Rokoko para crear las animaciones de mis personajes. Es una buena inversión. Gracias por el ejemplo en Blender. Salu2
OMG!!! SO AWESOME!!! 🔥🔥🔥
this is amazing!!!
I look forward to these types of products being developed with hobbyists in mind. $39 a month just doesn't make sense for an individual.
Pro tip:
Have a ton of projects that NEED this lined up and knock em all out in a month.
I plan to just get a month so my models have animations and I can test if they are vr ready.
@@ZigealFaust Good tip
Hey! Great video. I would love to try out some face capture data. Is it possible to get some test-data from you, to test it out ?
I want these stuff. Animation is not difficult anymore. :)
I will be getting the full capture suit
Thats cool, now is there a way to get these facial retarget on any character we want ? (like a rig, or a way to import the shape keys to any face?)
Very cool!!! I really want to try the suit. I notice that hands are not yet captured?
Hi Jimmy! We are about to release our own finger tracking solution soon: www.rokoko.com/en/smartgloves
Do you have a link to the DAZ blendshape tutorial?
Here it is: th-cam.com/video/JuQaiwZKHFM/w-d-xo.html
I wasn't expecting you here
heyy austin
hi austin, massive fan
woah, didn't expect to see you here Austin
It's not supereasy, dude, but it is super fucking fun. Made me wanna learn Blender.
Amazing.
When work it with rigify, i will buy one Rokoko for me
It would be super useful.
Was watching with smile. You guys are awesome. How can I donate for you guys?
Bro I have a doubt please answer to this . Can we do facial motion capture by android mobile or any webcam . only this two method are there . can we record a video and we can convert into facial motion capture . Which app and software to use this
So good
Super glad to hear that! 😉
If i get successful in this
I'll definitely subscribe for life time
me too :)
To anyone who's having the pasting issue for face capture--make sure to have some kind of keyframes for all of your Shape Keys before pasting--I had to go and make individual frames for all of them, was a pain but it worked. If anyone has a faster method, would love to know--and to Rokoko, I would really like to see a more automatic system for this in the plugin--it would really improve the smoothness for new folks!
I just wish the facial capture plugin was a bit more accurate
Hi!
please explain How to Animate fingers in Rokoko ad blender . and some profisional Tick's and tricks .
Thank You for this plugin and Guide video :)
Hi! Thanks a lot for the suggestion. We shared it with our Content Team and we will take it into consideration for our next tutorials. If you are experiencing issues, you can always check out our Help&Community page, ask our users in our Facebook Group here facebook.com/groups/252832679299596 , or reach out to our Support Team at support@rokoko.com.
Hello!right now how to expropriate this animation for unreal?and then importing into the unreal and also how to change how animations of the character in the ureal?
The video was really amazing. NOw, how to rig a character in order to work properly with this ? please do a tutorial asap :/
Hi! Thanks a lot for the feedback. We shared it with our Content Team and we will take it into consideration for our next tutorials. If you are experiencing issues, you can always check out our Help&Community page, ask our users in our Facebook Group here facebook.com/groups/252832679299596 , or reach out to our Support Team at support@rokoko.com.
is there a linux version for rokoko coming soon or a solution to record the mocap data with the blender plugin? Windows and Mac is not an option for me.
Additionally, I have seen in your other videos that one has to login into the plugin with credentials. What is the purpose of this? Is there a plan to limit the functionality / make retargeting animation as a pay per retarget service?
Hi Jekker1000 - we have zero plans to limit functionality or make the retargeting animation a paid service. With the Blender plugin in particular we wanted to make sure that we were fitting into the Blender paradigm of free-to-use.
also what if we dont have a motion capture suit ? will the realtime stream still work off just video?
how do you show your background with the avatar like inside your house, in other words, how do you replace your body for your avatar?
This is good to start virtual youtuber chanel
not when ur broke :(
Hi Rokoko!,so is this the basic version of the face mc in this video?
In video says that have a 3d model to download in the description, for we can test it, but i think you forgot to add it!?
Thanks for alerting us Sergio! Here is the download, and it can also be found in the description now: shorturl.at/hkQT1
Does anyone happen to have a list of these needed 52 blend shapes? I have a 3d character I've made from scratch that I want to apply motion capture data to, I know how to make blend shapes and am willing to make the needed 52, but I'm unsure exactly what they are.
My country is going in lockdown again so it would be kinda funny to use this is teams calls
Is one able to bring in footage and transfer that data onto the character, rather than have it all live streamed?
it awsome
We're glad you find it useful! :)
i imported my daz character just like you guys showed us in your other tutorial, i am now trying this with reecorded mocap and when i get to the part where i gotta copy and paste key frames i get the error " "No selected F Curves to Paste Into." what am i doing wrong?
make sure u have some kind of existing keyframes for all the Shape Keys before pasting--should fix it
so .. what if i dont wanna use shape keys and instead i wanna use bones to move the model i aim to use for my animations?
like i wanna track my own face doing the things and then have the model which does not look human do them? ... the creature you are using still looks "human" i want to do this for a non human character (like a dinosaur or dragon)
also what if i just wanna use a panasonic DSLR camera for recording the footage and not apple
Hi, what kind of camera do you use to capture your body movement from the computer
Hi! There's no camera to capture the body movement. It is done with the mocap suit Smartsuit Pro: www.rokoko.com/en/products/smartsuit-pro
Hello i did the same thing but at the last the character going little up? can u plz help me for it
I really just want it to track my head and open and close the mouth. No where near 52 shape keys. How wud I do this?
And this is how i’d use my smartsuit.. If i had one!
Are there any new movies or games that used your rokoko mocap system
which type of mobile we want use for a facial motion capture pls comment mobiles name pls
Does every Mocap data exporting software exports the Face Mocap data in form of blendshapes? I may recieve some Mocap projects which includes both Body and Face, hence wanna be sure. Thanks
Hi! It depends on the software in question. A lot of facial capture apps use blendshapes for the movement. More specifically, our facial mocap system uses the Arkit blendshapes API made by apple. This is something you can read more about here shorturl.at/nGJ45
When it comes to Rokoko Studio the facial animations are exported as blendshapes.
@@RokokoMotion Thanks for the reply. Link is opening short url home page though
@@RokokoMotion As mentioned that link appears to be incorrect. Would love to know more about how you get those ARKit blendshapes on any character model. Mixamo/Fuse out of the box has its own set, and I'm personally now using Character Creator. I'm not a 3D modeller so the thought of having to learn Maya is more than a little off putting. What's the exact workflow?
@@baroquedub Apologies! Here is the new link:
developer.apple.com/documentation/arkit/arfaceanchor/blendshapelocation The link shows a list of all the different blendshapes needed in order to properly use the face capture. In Character Creator you can make custom blendshapes so they match the ones in the ARKIT API. To get the blendshapes onto a character you'll have to make them.
Is the timing good with facial when you speak?
does this only work with Iphone or does it work wit samsung? or webcam?
Seems expensive for VR quality animations.
hi, recent smartsuit owner. is there a step between copying and pasting data that's missing or am I overlooking something? I've rewatched several times - this doesn't work for me as far as face capture. successful mocap rigging (haven't tried with suit but used samples). creates a new parent/face or if i select the timeline first, does not create its own channel. Please advise?
Copying the shape keys does not work either :\ "No selected F Curves to Paste Into."
@@HELLOPROTOTYPE same ugh
i figured it out did you?
yeah I've had the same issue, not sure how to work with it
ok i figured this out--maybe there's a faster way but this did work for me. You have to already have some kind of keyframe for all the Shape Keys in the face you're pasting into. So I literally just went and clicked and added a keyframe to every single one of them before pasting, then it fully worked.
could we do this with the daz shape keys?? when you send a character through the bridge it has a morph picker would it be possible to do it that way
Sounds plausible! Not something we've tested ourselves, but someone in our Discord community might know - feel free to jump in at discord.gg/rokoko 🤓
@@RokokoMotion ooh I also found out that rokoko does a great job with the daz rigg thank you so much for the suggestion
all tihng tihng sounds amezing but haw i can find the skeleton source ?
The skeleton source exists in the scene collection on the right. If you click the drop-down menu for source in the retargeting panel the name will show.
can you stream this on twirtch or yt?
What kind of support is there for ppl who purchase Rokoko suit but aren't as tech savvy with 3D animation?
rokoko support is excellent, they're very responsive. if they have time some hints and tips on how to clean/amend mocap in blender would be awesome, there's not alot on youtube that covers it
@@noiseworks Can Rokoko's motion files be used in Studio Filemaker?
That's what I'm using for animations
would a Rigify rig work with this ?
Are these worked with blender 2.79? I just want to make some animations for second life with these.
Hi Kira! Our Blender plugin only works with 2.8 and higher currently, thanks!
can I capture the movement of only the top part of my body and not use a smart suit? is there a program that can do that?
Hello! Unfortunately a product you are looking for is not something that we can provide.
Hey! This is so cool!
I'm wondering if it's possible to do this, but just for facial capture?
And then superimpose the animated face 3d model over the original video, as a way to hide my face, but preserve my expressions, and talking.
What I want to do is capture face motion from a normal, pre-recorded video, apply that to a 3d model, and then superimpose that 3d model over my face back in the original video.
How did you go with this?
Hi! Is this compatible with the IPhone XR? I know it works for the IPhone X but I hear the iPhone XR has a slightly different true depth camera. Also is one better than the other? I’m buying a new phone today just to use this software so if you guys could get back to me that would be great! I’m literally going to get which ever one works better with your face capture software rather that be the X or XR. if there are any differences, please let me know!
Hello Jerron and apologies for getting back to you late! You can use it with all iPhones with a true depth camera ☺️
يا جماعة التصوير فقط ب ايفون؟؟ او استطيع اصور بنظام أندرويد؟؟؟
how did it capture your body motion? are you wearing a suit specific for Rokoko Studio? and is it free for a single Indie game developer?
Hi! We were capturing the body motion using our Smartsuit Pro! 😉You can find more info about it here: www.rokoko.com/products/smartsuit-pro.
The second thing you are asking about is the free trial, which allows you to try out the Studio Pro plan and Face Capture for a month to allow you to see if it will be the right solution for you.
If you are interested in seeing how the product works and the results you can achieve with it, you can always book a free online demo with one of our Product Specialists: www.rokoko.com/book-demo
They will gladly answer all of your questions regarding our tools and show you how they can be integrated into your workflow. Have a great day!
Are you seriously asking if a high quality motion capture suit is free?
mocap suits are very expensive man, but maybe you can use Rokoko Vision for the body animations
Do you need subscription to export this to blender ?
Can I use MeowFace Android App with Rokoko for face mocap???
Do you have to have a smart suit for the facial capture to work?
Hi and thanks for reaching out! You do not have to use Smartsuit Prro in order to use our Face Capture. You can find more info about our Face Capture add-on here: https//www.rokoko.com/products/face-capture.
With our facial motion capture solution, you can visualize your data in Rokoko Studio and either export your data in FBX, BVH or CSV, or livestream the data in realtime into your custom character through our native plugins. In Rokoko Studio you can also easily sync your data with inputs from our other capture tools and achieve a production-ready full performance capture result in mere minutes.
If you have any further questions about how the product works and the results that you can achieve with it, you can always book a free online demo with one of our Product Specialists: www.rokoko.com/book-demo
Have a great day!
Any Linux Support? Current or Planned? Really looking to ditch both Adobe, Mac and Windows
Can I pls ask which app did you use in your mobile
It is the Rokoko App for Face Capture :)
Can I use a normal camera- not an IPhone?
maybe someone cna help me, I am trying to link my animation to my sims rig but it wouldn't do the tricks. Am i doing something wrong? there are no videos about this.
Hi! For this kind of questions, please reach out to our Support Team at support@rokoko.com. They will surely help you in no time!
When we can use RokokoStudio in Linux?
Hi! At the moment we have not released a version of Studio for Linux but we would like to release one in the future. In case you are not aware of it, users can always run Studio on a basic Mac or Windows computer and forward the data to a linux machine - either to a software we have a plugin for or to their custom plugin.
Can i mocap my self with out smartsuit pro?
:"(
I don't understand why the 52 blend shapes is such a big secret. Isn't there a reference somewhere, so people could just make the appropriate shape keys in Blender and skip the middle man of external modeling programs?
Hi Axon - absolutely they could! There are tons of references for exactly what each blendshape is supposed to be, it's just pretty specialized knowledge to be able to sculpt them all personally. There's just a big bottleneck when it comes to models that are already set up with the blendshapes - hopefully MetaHumans will help with this when its released!
@@RokokoMotion is metahuman going to be released for blender too?
Or is it only for unreal engine?
mast mast mast how you get that plugin
Where can you get a smart suit from?
You can get it directly on www.rokoko.com :)
How does he not get magnetic interference capturing in his room like that?
Hi there, problematic magnetic interference usually always comes from metal beams (enforced concrete) in floors (9 out of 10 issues we see) and walls. It does not come from many objects in a room or close proximity to walls etc, unless these walls have heavy metal in them. You can easily be next to a TV and a computer etc as long as the floor is problematic. Most ground floors usually work pretty well in our experience.
Where can I get the correct Helmet Mount from?
Hi Bryan! You can find more info about our Face Capture and Phone Mount at: www.rokoko.com/shop/face-capture
CAN I GET GET ALL THOSE BLEND SHAPES
Now the new Genesis 8.1 figures in DAZ come with the ARKit blendshapes for free!
Mixamo works for some characters but not others. Then I have to rig with Rigify or Auto-rig-pro...but I am struggling to get that to work with Rokoko mocap data. I would love to see a tutorial about that workflow
Hi! Thanks a lot for the feedback. We shared it with our Content Team and we will take it into consideration for our next tutorials. If you are experiencing issues, you can always check out our Help&Community page, ask our users in our Facebook Group here facebook.com/groups/252832679299596 , or reach out to our Support Team at support@rokoko.com.
can it motion track with only video?
i think no
If would be so funny to see a youtuber who has never shown their face do a face reveal only for them to use this to make themselves look like a green goblin streaming from a cave in the woods or something.
I like this idea... :)
I want buy the suit but,is face capture only avaliable in iPhone?
Hi! We currently only offer face capture for Iphone X series but we are developing our Android version as well. We will release it soon :)
@@RokokoMotion this suit can ship to Indonesia?
@@hheboi2567 Yes, we ship globally. However, it is up to the customer to pay the import fees to the specific country. You can reach out to our sales department at sales@rokoko.com for more info on that. Thanks!
Hello is the face capture available on Android?
Coming very soon! :) Hopefully already end October. Stay tuned
I have the face app - they are on the same network - I open the face app and then virtual remoted and click the connect button and both just sit there. It is not working. Firewall down. What now? I even made the phone the actual router. Now what? It just sits there. This is supposed to be easy. I can connect all my apps to the computer. Why cant ya'll do something like Whatsapp with the bar code and boom.
If you go to the rokoko symbol in the left upper corner under settings > Command API there is a number in the listen port. It should match the one on your phone. I"m stuck too thought. Everything connects on my end but the face doesn't show up in the scene.
Any updates on when it will be out for android?
Hello Trishy! Big apologies for getting back to you late. Our Android version of our Rokoko app is expected this Fall or by the end of year. Cheers!
@@RokokoMotion Can't wait, thank you!
can it track fingers?
Yes, it certainly can :) Check out our Smartgloves here: www.rokoko.com/products/smartgloves
Is anyone else having issues with the mime character? the arms and torso are just doing things completely wrong
my god, i dont have a iphone, jesus.
i get that the quality is better on iphones but there are 5 million apps who do basic face capturing on andriod. why is there no way using a andriod livestreaming the tracking points.
Hi! We haven’t released the version for Android yet but we are working on it. Stay tuned 😇
what does it cost to do that?
Hello! If you would like to know more about our bundles you can find all the info here: www.rokoko.com/products/bundles.
The price of the bundle starts at 1495 USD. Additionally, if you are interested in seeing how the product works and the results you can achieve with them, you can always book a free online demo with one of our Product Specialists: www.rokoko.com/book-demo
They will happily answer all of your questions regarding our tools and show you how they can be integrated into your workflow. Let us know if we can help you in any other way. If you need more info about our products you can always reach out to us at hi@rokoko.com and if you are interested in seeing how our users are working with our tools, you should check out our Rokoko Community: rokoko.io/3bGoMBZ .
Have a great day!
Is he detecting fingers?
Hi! Not in this video :)
Make Rokoko as a vrchat avatar.
prefer to be taught by purple demon.
쩐다
This doesn't work with Andoird... unistsalling...
Hi Rodrigo! Our app is currently only available for iOs. We are developing the Android version and we plan on releasing it very soon. Sorry about the inconvenience!
Hello Rodrigo! We are currently working on that issue.
Hope you are having a wonderful day!
Rokoko remote for Android???
Coming in October! :)
nice iphone ad
Very bad this app is only available on iphone
iphone only ? wtf .. :'(
Android version dropping in late September - stay tuned! :)
@@RokokoMotion Any update?
Guy's when are you going to make a $1000 suites for studio's that require 5 and more suites.
Please
Is it free ?
Hi! Yes, the Blender plugin is free and available to everyone. You can find the download link in the description of the video.
Is this free?
Hi! Our Blender plugin is free and accessible to everyone: help.rokoko.com/support/solutions/articles/47001150422-release-notes-blender-plugin-1-1-1#release-notes-blender-plugin-1-1-1-0-0
I JUST WANT TO KNOW HOW TO IMPORT MY OWN content!!!!!!!!!!!!!
U didn't wear dress 😂😂
Just joking 😸
tutorial that doesn't really explain anything at all.
Terrible facial Mocap. This is ok for noobs who have never watched another humans mouth move and facial expressions as they talk. When I 1st tried animation lip-sync many years ago My initial
reaction to watching my characters mouth move was the same as any noob( Amazed momentary). But I soon realized that the character only moved it's mouth up and down and was not making any of the vowel shapes that you see in cartoon animations like Disney. If the software company's wanted to make realistic facial animation they could do. But instead they prefer to water down the functionally of the software so that people investing the software have to wait for updates that never improve the mocap but they add tons of time wasting new features that one never gets to use in a productive way.
Thanks for the feedback! There are some limitations for sure, but it also comes down to the artistry of the character model itself. How the emotions are displayed depend on how the blendshapes are modelled on the mesh itself and you can do quite a lot with the 52 shapes we have now if you are leaning into the limitations with your design. More blendshapes is more work per model - and the current shapes are fairly standardized, so that's what we've stuck with for now. With that being said, we are of course also exploring ways to improve this experience down the line 😀
true. actual facial mo-cap is more advanced in nature and is provided by only one company right now and doing this is not easy it needs pro level knowledge. for noobs this is okay but for real results there is hardway, not easy one like rokoko shows.
EDIT: even iclone is way ahead of rokoko in this game.
I would really love to have this. But im poor 😌 hope someone could give me this so that i can start live streaming on a game using this so that I can earn some money for supporting my family for daily need, for those who are kind out there who've seen my comment, please help me.
A dreaming boy from Philippines
Sorry but I don't think that someone would spend $2,495 to a random dude in the comments
@@tengu5305 hi sir. I'm not asking for a higher specs phone. Any phone would be valid sir.
@@tengu5305 and when it comes on computer sir. $100 is into php is 5k+ sir. 25k can buy a whole set of computer.