Face Mocap using ANY Camera 

Boo-yah! I've been following the facial mocap scene for the past two years and it's so exciting there's finally a truly free workflow from beginning to end. This is going to open the door for so many people 🥳

DUDE!!!! I love that strike through the word IPHONE.. Makes me so happy

This video should be part of YT recommendations for any artist or developer. Great work you're doing with animation and mocap. And a big thank you to all devs who made these two addons available for free.

This is so excellent! I have been searching for months for a way to get mo-cap from pre-recorded video. The Audio2Face workflow was too complicated for me and I definitely prefer something integrated into blender. This was perfect!! I already have FaceIt and had the model pretty much set-up. I followed this tutorial tonight and within no time I had a result. I was surprised how well it captured the head tilts. In the video, the person was wearing glasses and had a lot of glare on the lenses, and surprisingly the software caught most of that movement. I have a lot of clean-up to do but this works great as a starting point. Thank you so much for making this tutorial!

😭😭😭you have no idea how much I've needed this, especially when the reallusion guys have just dropp their ai facial mocap stuff

Hi there, first try I did it, was successful, then tried again, faceit and live link face and I got this error multiple times ! Python: Traceback (most recent call last): File "C:\Users\myname\AppData\Roaming\Blender Foundation\Blender\3.6\scripts\addons\faceit\mocap\mocap_base.py", line 842, in execute for x in futils.get_action_frame_range( File "C:\Users\myname\AppData\Roaming\Blender Foundation\Blender\3.6\scripts\addons\faceit\core\faceit_utils.py", line 12, in get_action_frame_range frame_range = action.curve_frame_range AttributeError: 'NoneType' object has no attribute 'curve_frame_range'

13:41- OMG, "COMBINE" finally works in local SRT with offser! Gosh! It took forever to see it fixed. Thank you for another amazing video!

Thanks for your video! I've been following the channel for a long time and this is one of my favorites. IMHO This is the best channel about creating animations. You do a great work!

Thank you so much for this video ,You have solved my biggest problem as well as doubt or issue ,from past two years i was wondering about the facial expressions in animation. Thank you once again god bless you

Hi, thank you. I am facing a problem. When I try FaceIT, it reacts in the opposite way when I turn my head. When I turn the head left/right in the video, the character's head turns up/down in Blender. So it reacts in the opposite way - in the video I shoot the head up/down - in Blender it turns left/right. I am using auto rig pro with faceit.

I've been waiting for this video for a long time! You are the best!

This is perfect! I actually don't need the head rotations

Is there a way to do live capturing on the app without an iphone tho? bc I have only seen video do cvs and then you import but live capture only has 4 apps and all of them are iphone exclusives

LiveLinkFace wont work with CSV file. My character face stays idle

dude I love you! Thank you for sharing your knowledge. Your videos are perfect! You are incredible! Thanks!

The dead eyes tho. But still pretty impressive, probably useful with a bit of tweaking.

Would be nice to know how well it tracks the eyes. Because the eyes are the biggest issue here. Not just the eyelids.

This is great! I think a great addition to the suite of tools would be a way to scale up the responsiveness of the captured rig points, i.e. selecting the brows, lips, jaw and setting a multiplier for scale for more intense/detailed performance capture. Is the capture framerate based on the set framerate within blender or does it capture at the camera framerate and interpolate frames? Either way, I'll definitely be grabbing the add-ons to play with! I'm working on a character in unreal engine and so far I've had to just keep the face static.

This is so really good! Both as info and tech... but it's still seems like it could use some manual tweaking after because it didn't seem to capture all your acting as well as it could have

Thank you so much >> you still the best and you save the world , I am looking now for hand capture with finger movement .. I could not find it.. I hope you can help us (all the world) in this matter after you solve the problem by a nice video ( the above).

I love you so much man! What would we do without you? I'll try it next as soon as I finish my job. Thank you so much!

Hi! When I transfer a model with a faceit rig, the faceit addon stops seeing the rig. The ability to animate with LiveLinkFace is lost. How can I connect the addon to the ring if it has lost it.

big time thanks for this! just what i needed!

I love doing by hand 😊

For my part, face landmark only worked once and since then, there is a bug when opening just with the promt command

thanks so much

Can same thing done in unreal with metahuman without iphone

hey guys just curious how does this quality compare to iphone mocaps? if i use a webcam or android phone (without depth sensor), is it still comparable quality to iphone mocaps? or slightly worse?

very useful

Nice🎉👍🏻

a dream come true

Master Class

Thank you very much !

Omg finally!

There's an error showing up while importing the CSV file. It says, ValueError: could not convert string to float: 'V'. I put a mov file on the load audio section and a csv file on the csv import section. Kept the frame similar to the mov file. Then it showed error when I clicked import csv.

Once you do the mocap in blender, can you bring that information into Unreal Engine 5?

Thank you.

Plz make same for unreal engine

Thanks! I have looked at it, and do not see why it can't run on Linux or most other systems as it made in Python with numpy and Tk, but I'm not much of a programmer either and can't get the libraries to work together. Anyone here up for the task?

so cool, is there something for UE5 and any phone? I just use Metahuman

Thank you man Thank you so much thank you ×100×♾️🥹

Hi, this is amazing but I am wondering if this also works without faceit? It's quit expensive for starters. I'm using daz3d models that comes with a face rig as well or I can manully ad a face rig with the metarig from blender. Will that also works?

It didn't ask me to import a video file. It just launches my webcam and starts to track live footage. I don't know where to find the csv file when I stop the tracking.

Hi, thanks for his vid I wanna askdoes this work with Linux?

Good day guys , am a new subscriber ..i howsoever downlaoded face landmark but it shows two options saying (mild filtering ....) and the second which says (aggressive filtering ) when i try to install it , and neither of this options seems to work out ....please assist .

Thank you❤

I keep getting Github pages that don't match your description. Can you post the exact link? Thank you.

Thanks so much for the tutorial. I used the free addon. The csv file loads with the keyframes inserted but has no effect on the character. What could be the possible solution

It's work with unreal engine?

LiveLinkFace not working. Console flashes for a split second and disappears.

For knowledge it is ok But rhubarb is best for short videos

You can make mocap with wrinkles animation ?

this method work with auto rig pro?

Facelandmarker is only for windows!?

and so not useable when its windows only

Dear Sir/mam, I am facing ' The specified file is not valid' error while importing Mocap. Please guide me as the addon without this features is worthless for me and i just purchased it after watching this video. Thanks

Still nothing exist to make the life easier for the blendshape ?

Does this work for Rigify 3.22?

"The specified file is not valid." why i get this error when import csv into faceit

exe file not in this

Reallilluison crying in corrner

THIS IS FREE?

Wasn't really impressed with the result unfortunately. 90% of your expression was lost in the conversion it looks like. Especially with the eyes.