Documentation: Face Shapes


The faces shapes are Action Units that can be used to control, for example, shape keys in an external program. The action units are computed from the user’s face and displayed on the live feed as graphs.

Clicking the checkbox next to the component name in the page tree on the left side of the UI enables face shape tracking and starts outputting the data over OSC. Alternatively, clicking the “Enable Face Shapes” button achieves the same result.

The IP address & port override can be used to output the face shape data to a specific IP address and port. If left disabled the main IP address and port on the setup page is used.

Face Shapes

For every face shape the OSC address and message can be edited by using the input boxes. The messages consist of the address and a single value, the OSC parameter tag {V}.

The shapes are computed to the range [-1, 1]. When the face is at rest position, or its “T-pose” of sorts, the approximate value of 0 is sent out for each face shape. When some shape is measured to be at its extreme, the value of 1 or -1 is sent out.

The scaling parameter can be used to multiply this value to some other range. For example, if the produced shape key value is a bit too low, adding the scaling parameter 2 might be useful.

If the invert button is checked the values are sent as 1 when the face shape is at its rest position.

Documentation: Kinect for Windows 2 / Kinect for Xbox One
Documentation: Sensor components
Face Detection Not Working
Documentation: Table of contents