Faceit is a Blender Add-on that allows you to semi-automatically generate a set of facial Shape Keys for humanoid characters without using any sculpting or modelling tools.
For now Faceit is especially designed to generate the Apple ARKit Shape Keys (Blendshapes), mandatory for Performance Capture with the IPhoneX. Next to the tools for generating the facial expressions, Faceit is packed with a bunch of utilities to ease the process of Performance Capture.
With Faceit you can ready your character model for high quality Animation in minutes! Save Weeks of Work!
How Does it Work?
Faceit leverages standard rigging techniques to generate the deformation. A given character is rigged in an auto-rigging type of workflow and along with the rig an animation is generated, that holds the individual Expressions. A benefit of this workflow is that it allows you to tweak all expressions by using the mighty pose and animation tools Blender has to offer! Of course nothing stops you from adjusting any or all of the generated shapes in a traditional workflow. You will likely still save a lot of time.
You can iterate between rigging and animating the expressions and baking the shape keys by the click of a button! This allows you to non-destructively bake the expressions, check them in motion with the Face Cap App or any other capturing app of your choosing and return to rigging in case you notice any artifacts.
Smart Binding Process
To save you the pain of extensive weight painting sessions Faceit features a Smart Binding algorithm that generates a weight distribution based of the defined landmarks and the registered Geometry. (Disclaimer) As with any other rigging tool, for some characters the initial distribution is sufficient and on others you will have to invest in tweaking the weights.
You can use any Apple device equipped with the True Depth Camera to capture your facial motion and retarget it to a 3D character in realtime, provided that the character is equipped with the required Shape Keys. If you never heard of this, I recommend you to watch this video.
A multitude of apps stands available that support capturing and recording of facial motions, including:
- Live Link Face (Unreal Engine)
- Blender Motion Capture
Any character that has been processed with Faceit (equipped with the 52 Shape Keys) will be compatible with any iOS face capturing app. For now Faceit supplies an interface for the Face Cap App by bannaflak for live viewport recording and loading of recorded motions, but I will include more capturing apps in upcoming releases.
New: you can now import recorded motions from Epics Live Link Face App!
Face Cap App
Faceit offers helper functions for people who work with the Face Cap App, but you can of course use your favorite solution without a problem!
- Reorder the Shape Key Indices to Face Cap Order
- Load Recorded Motion from .txt format
- Go Live via AddRoutes Add-on.
- (New) Head Rotation
Watch the Introduction Video :
Direct download links 1 MB :
CGArchives Is The Best