Testing Headcam with Android Face Capture app | Comparison with iOS/ARKit

In this video our Director of Product Development, Jesper, will give you a quick
behind-the-scenes look at using Headcam with the Face Capture app for Android directly in Rokoko Studio. See the live side-by-side comparison with the iOS Face Capture solution utilising ARKit.
You can still pre-order the Headcam for $495 including 1-year Face Capture subscription:
rokoko.co/3XpWvr4
#mocap #facetracking #android
---
Learn more about Rokoko and stay updated:
Reach us at [e-mail] or the chat on www.rokoko.com
Join our Discord: / discord
Official Facebook Page: / hellorokoko
IG: / hellorokoko
Twitter: / hellorokoko
LinkedIn: / rokoko

[@LautarohAguilarOficial]

Great.

[@thronosstudios]

Can you use it as a simple camera feed that is sent to Camo, so then we can open up Camo in Accuface, for example?

[@RokokoMotion]

In theory yes, but it depends on whether Camo supports external USB cameras (you will have to check that on their side). But the Headcam works for any Android app that supports external USB cameras

[@mjaada]

So the headcam can be connected to the android phone? What about IOS iphone? Doesn't the iPhone version need the TrueDepth Camera?

[@RokokoMotion]

Yes, it connects to Android phones via USB-C (or directly to a PC with a USB extender if you need that for a 3rd party solver).
iPhones do not allow you to change the camera away from the built-in True-Depth Camera, so you can't use the Headcam with an iPhone. To get access to the TrueDepth face capture solution (ARKit), you will need to use the iPhone's camera. We offer the Headrig for mounting that www.rokoko.com/products/headrig As we show in this video, however, our own solver (that comes for free for 12 months with a Headcam pre-order) can be quite comparable in data quality

[@SyntaxDomain]

The android solver seems to be updating at a low and inconsistent frequency especially in comparison to iOS. Is this due to using an older phone in the demo, the method used in recording the demo, etc. or is this expected behavior?

[@RokokoMotion]

Well spotted. In this video you can notice some of that, especially around drastic changes in light on the face.
We're still working on optimizing app performance across all supported Android versions, and we've actually already made a significant update on that front since we recorded this video. We're also optimizing for primarily securing a stable output rate from the solver, so even if the camera feed in the app may at times appear choppy, the received data in Studio may still retain a steady framerate. At the end of the day, it's of course also down to the phone itself and how it performs. For this demonstration, we used an Asus Zenfone 8

[@SyntaxDomain]

@@RokokoMotion Sounds good. I hope I didn't sound too critical. I can't wait to use it and hope you guys can make it not just good enough, but great! Good luck!

[@RokokoMotion]

@@SyntaxDomain Not at all - totally fair comment and just shows your attention to detail :) But yes, it won't be the case in the public version we will ship in August. We'll release more videos prior to also show that

[@rubberdog]

Is the 1-year Face Capture subscription a requirement for Headcam hardware?

[@RokokoMotion]

The first 12 months of the subscription are free for anyone who pre-orders now, and you are free to cancel after the 12 months if you don't want to continue :)

[@DavidNGoodman]

Does this work directly in Unreal?

[@RokokoMotion]

Yes, if you are on our Plus plan you can stream directly to Unreal using our plugin :)

[@DavidNGoodman]

@@RokokoMotion I'm only somewhat familiar with Rokoko products. If I'm not streaming directly into Unreal or using Accuface, can facial animation be captured in Rokoko Studio and imported to UE or iClone and applied there?

[@DavidNGoodman]

Nevermind, I bought all of it :)

[@RokokoMotion]

@@DavidNGoodman If you are not streaming in realtime, you can definitely record the face capture animation in Studio, export as an FBX and then import that into UE or iClone (hope I'm understanding the question correctly)

[@DavidNGoodman]

@@RokokoMotion Yes that was the question. When I first asked it, I was thinking that I would not have AccuFace, but I bought it after buying the headcam so I can use all the options now.

[@Joe-hr1dc]

don't buy this on. It's suck

[@RokokoMotion]

No customers have received this yet since it's still in pre-order, so maybe it's a bit early for that assessment :)