Patent application reveals how you will use Apple's next big thing

The headset could be used for gaming, viewing digital media, browsing the web and more
“Embodiments of a mixed reality system are described that may include a mixed reality device such as a headset, helmet, goggles, or glasses (referred to herein as a head-mounted display (HMD) that includes a projector mechanism for projecting or displaying frames including left and right images to a user’s eyes to thus provide 3D virtual views to the user. The 3D virtual views may include views of the user’s environment augmented with virtual content (e.g., virtual objects, virtual tags, etc.). The mixed reality system may include world-facing sensors that collect information about the user’s environment (e.g., video, depth information, lighting information, etc.), and user-facing sensors that collect information about the user (e.g., the user’s expressions, eye movement, hand gestures, etc.). The sensors provide the information as inputs to a controller of the mixed reality system. The controller may render frames including virtual content based at least in part on the inputs from the world and user sensors. The controller may be integrated in the HMD, or alternatively may be implemented at least in part by a device external to the HMD. The HMD may display the frames generated by the controller to provide a 3D virtual view including the virtual content and a view of the user’s environment for viewing by the user.”-Summary from Apple’s patent application
The mixed reality headset would merge the real-world environment captured by the sensors with the graphics created for virtual reality. It also would show an avatar of the user’s face based on “information collected by the one or more eye-tracking sensors, the one or more eyebrow sensors, and the one or more lower jaw sensors.” The patent says that the HMD could sport a projector to project or display images to the user’s left and right eyes and would work with applications that add virtual content to a real-world view. Examples of such applications mentioned in the patent include virtual training, gaming, viewing digital media, and browsing the web.
The patent application was originally filed by Apple back in September 2017.