Testing Headcam with Android Face Capture app | Comparison with iOS/ARKit 

The headcam comes with 12-months of Face Capture add-on for free, at least during pre-order campaign. You will be able to use your Headcam as any external camera within any application that can receive video input, without any additional fees. To use the Headcam with our Face Capture app, converting the video feed to facial animation, sent to Rokoko Studio, you will need the Face Capture add-on - which is purchased and assigned on a per-seat basis.

Well spotted. In this video you can notice some of that, especially around drastic changes in light on the face. We're still working on optimizing app performance across all supported Android versions, and we've actually already made a significant update on that front since we recorded this video. We're also optimizing for primarily securing a stable output rate from the solver, so even if the camera feed in the app may at times appear choppy, the received data in Studio may still retain a steady framerate. At the end of the day, it's of course also down to the phone itself and how it performs. For this demonstration, we used an Asus Zenfone 8

@@RokokoMotion Sounds good. I hope I didn't sound too critical. I can't wait to use it and hope you guys can make it not just good enough, but great! Good luck!

@@SyntaxDomain Not at all - totally fair comment and just shows your attention to detail :) But yes, it won't be the case in the public version we will ship in August. We'll release more videos prior to also show that

I think that is due to iphone's sensors that are way better at facial tracking. At least that's what I want to think since I just dumped cash on ios and want to feel that it has been worth it somehow

If you want to work with iPhone/ARKit capture, you should probably go for the Headrig instead www.rokoko.com/products/headrig Unless you are asking about how to convert the output from our Android mocap solution (with the Headcam) to the 52 blendshapes?

@RokokoMotion yes brcause usually v tubers model using arkit! Thx for replying

@@RokokoMotion is headlamp using rgb camera?

👀

Still in development :)

@@RokokoMotion dont you need a good Android dev?, here i am :)

In theory yes, but it depends on whether Camo supports external USB cameras (you will have to check that on their side). But the Headcam works for any Android app that supports external USB cameras

Yes, it connects to Android phones via USB-C (or directly to a PC with a USB extender if you need that for a 3rd party solver). iPhones do not allow you to change the camera away from the built-in True-Depth Camera, so you can't use the Headcam with an iPhone. To get access to the TrueDepth face capture solution (ARKit), you will need to use the iPhone's camera. We offer the Headrig for mounting that www.rokoko.com/products/headrig As we show in this video, however, our own solver (that comes for free for 12 months with a Headcam pre-order) can be quite comparable in data quality

The first 12 months of the subscription are free for anyone who pre-orders now, and you are free to cancel after the 12 months if you don't want to continue :)

Yes, if you are on our Plus plan you can stream directly to Unreal using our plugin :)

@@RokokoMotion I'm only somewhat familiar with Rokoko products. If I'm not streaming directly into Unreal or using Accuface, can facial animation be captured in Rokoko Studio and imported to UE or iClone and applied there?

Nevermind, I bought all of it :)

@@DavidNGoodman If you are not streaming in realtime, you can definitely record the face capture animation in Studio, export as an FBX and then import that into UE or iClone (hope I'm understanding the question correctly)

@@RokokoMotion Yes that was the question. When I first asked it, I was thinking that I would not have AccuFace, but I bought it after buying the headcam so I can use all the options now.

No customers have received this yet since it's still in pre-order, so maybe it's a bit early for that assessment :)