Package org.lwjgl.openxr

Class FBFaceTracking2

java.lang.Object
org.lwjgl.openxr.FBFaceTracking2
public class FBFaceTracking2 extends Object
The XR_FB_face_tracking2 extension.

This extension enables applications to get weights of blend shapes. It also enables applications to render facial expressions in XR experiences.

It is recommended to choose this extension over the XR_FB_face_tracking extension, if it is supported by the runtime, because this extension provides the following two additional capabilities to the application:

  • This extension provides additional seven blend shapes that estimate tongue movement.
  • This extension allows an application and the runtime to communicate about the data sources that are used to estimate facial expression in a cooperative manner.

Face tracking data is sensitive personal information and is closely linked to personal privacy and integrity. Applications storing or transferring face tracking data should always ask the user for active and specific acceptance to do so.

If the runtime supports a permission system to control application access to the face tracker, then the runtime must set the isValid field to FALSE on the supplied XrFaceExpressionWeights2FB structure until the user allows the application to access the face tracker. When the application access has been allowed, the runtime should set isValid on the supplied XrFaceExpressionWeights2FB structure to TRUE.

Some permission systems may control access to the eye tracking separately from access to the face tracking, even though the eyes are part of the face. In case the user denied tracking of the eyes, yet, allowed tracking of the face, then the runtime must set the isEyeFollowingBlendshapesValid field to FALSE on the supplied XrFaceExpressionWeights2FB for indicating that eye tracking data is not available, but at the same time may set the isValid field to TRUE on the supplied XrFaceExpressionWeights2FB for indicating that another part of the face is tracked properly.