Mixed Reality: A Survey

Abstract

This chapter presents an overview of the Mixed Reality (MR) paradigm, which proposes to overlay our real-world environment with digital, computer-generated objects. It presents example applications and outlines limitations and solutions for their technical implementation. In MR systems, users perceive both the physical environment around them and digital elements presented through, for example, the use of semitransparent displays. By its very nature, MR is a highly interdisciplinary field engaging signal processing, computer vision, computer graphics, user interfaces, human factors, wearable computing, mobile computing, information visualization, and the design of displays and sensors. This chapter presents potential MR applications, technical challenges in realizing MR systems, as well as issues related to usability and collaboration in MR. It separately presents a section offering a selection of MR projects which have either been partly or fully undertaken at Swiss universities and rounds off with a section on current challenges and trends.

A Review of New Technologies: AR, VR, MR

“…Another application called Magic book built 3-D models of objects on the pages of the book. Different angles of the models can be seen by moving the book and observing from different angles [8].…”

“…Monitors in the operating room are used to display these medical images. A survey has shown that the accuracy can be increased by using such technologies with respect to traditional methods [8].…”

“…The operator makes use of mobile mixed reality to capture the scenario around him and forward it to the expert which analyses it and guides the operator accordingly through visual display of the operator's mixed reality system or the audio channel. For medical uses, Welch et al had suggested a system which visualizes the patient's body captured by multiple cameras and then displayed on a high resolution display or PDA of an expert at his place [8].…”

“…It is quite like a compass where the signs show the proper direction without getting affected by the orientation of the gadget. It could be utilized to guide guests inside the house or buildings or for travelers in a new city [8].…”

“…For example, MR version of the Quake video game, the Human Pac man game, Moon Lander game, etc. [8].…”