Motion Capture from an Anime Character

In the video, the central Hatsune Miku avatar is driven by optical motion capture of a real person on the left, while the Hatsune Miku on the right is driven by video motion capture based on the central Hatsune Miku.
You can see real-time motion recognition in the bottom left corner of the screen.
(Using anime characters as inputs for video motion capture is not best practice and is just for fun)
The motion is captured using Dollars MONO and streamed to Unity in real time.
(The original video was edited to retain only the cartoon character parts.)
Dollars MONO:
Real-Time Facial and Full-Body Motion Capture with Finger Tracking Using a Web Camera or Video Files
www.dollarsmoc...
Hatsune Miku Model on the right:
3Dモデル「止丸式初音ミクNT」
booth.pm/en/it...
#miku #mmd #animation #mocap #motioncapture

[@SapoNaArea]

This technology is impressive and how it is advancing, can you use this technology in the VR gamer? If so, wonderful, they are just for dancing and recording on video, impressive too, when you can use them for VR gamers, the leap will be huge and people will buy them to play and enter Steam's VR multiplayer.

[@DiMocap]

More mocap comparisons: th-cam.com/video/9vEhPpcnwd4/w-d-xo.html

[@SapoNaArea]

and even more multiplayer games that can be used, it will reshape playing on PC, enter blade and soul, ff14, and others in reality and play, it is even difficult to imagine this, people will stop living in the real world and stay in the virtual world, just going out to eat, sleep when your body gets tired and re-enter the virtual mmo world that you like as much as the anime that Shangri-La Frontier is showing, this way of playing is not very far away, not in our real world.

[@Ponk_80]

It’s too bad that this kind of technology is so expensive and requires a massive amount of computing power.

[@user-insidedimension]

I think that motion capture will great option to animate Miku character, by the way it's better than mmd recording 😊

[@DolorAeturnum]

FIRST!! Also, I love the difference!

[@filipemalandragem6574]

It's very beautiful to see this woman dancing alongside Miku, and her counterpart who we are sure is doing her best

[@DiMocap]

Same video mocap comparisons: th-cam.com/video/9vEhPpcnwd4/w-d-xo.html

[@DarenKajiWolf]

The best part besides the cool detection is the use of one of the best (good looking/sexy) Miku model!!

[@psychicguro8858]

In life I'm the third Miku jajajaja 😂😂 this is pretty awesome ✨✨

[@KimMorrigan]

mikugod