Package org.lwjgl.openxr

Class MSFTSceneUnderstanding

java.lang.Object
org.lwjgl.openxr.MSFTSceneUnderstanding
public class MSFTSceneUnderstanding extends Object
The XR_MSFT_scene_understanding extension.

Scene understanding provides applications with a structured, high-level representation of the planes, meshes, and objects in the user’s environment, enabling the development of spatially-aware applications.

The application requests computation of a scene, receiving the list of scene components observed in the environment around the user. These scene components contain information such as:

  • The type of the discovered objects (wall, floor, ceiling, or other surface type).
  • The planes and their bounds that represent the object.
  • The visual and collider triangle meshes that represent the object.

The application can use this information to reason about the structure and location of the environment, to place holograms on surfaces, or render clues for grounding objects.

An application typically uses this extension in the following steps: