Review of Microsoft HoloLens Applications over the Past Five Years

Park, Sebeom; Bokijonov, Shokhrukh; Choi, Yosoon

doi:10.3390/app11167259

Cited by 102 publications

(45 citation statements)

References 70 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Moreover, HoloLens features smart microphones and natural language speech processing algorithms to ensure vocal controls work properly even in noisy industrial environments. Park et al [58] conducted a literature review to investigate the current status and trends in HoloLens studies published over the past five years (2016-2020), showing a growing use of MS HoloLens multiple fields, from medical and surgical aids and systems, and medical education and simulation, to industrial engineering, architecture, and civil engineering, and other engineering fields.…”

Section: Cg Content Overlay Mode Descriptionmentioning

confidence: 99%

Extended Reality for Smart Building Operation and Maintenance: A Review

Casini

2022

Energies

View full text Add to dashboard Cite

The operation and maintenance (O&M) of buildings and infrastructure represent a strategic activity to ensure they perform as expected over time and to reduce energy consumption and maintenance costs at the urban and building scale. With the increasing diffusion of BIM, IoT devices, and AI, the future of O&M is represented by digital twin technology. To effectively take advantage of this digital revolution, thus enabling data-driven energy control, proactive maintenance, and predictive daily operations, it is vital that smart building management exploits the opportunities offered by the extended reality (XR) technologies. Nevertheless, in consideration of the novelty of XR in the AECO sector and its rapid and ongoing evolution, knowledge of the specific possibilities and the methods of integration into the building process workflow is still piecemeal and sparse. With the goal to bridge this gap, the article presents a thorough review of virtual reality (VR), augmented reality (AR), and mixed reality (MR) technologies and applications for smart building operation and maintenance. After defining VR, AR, and MR, the article provides a detailed review that analyzes, categorizes, and summarizes state-of-the-art XR technologies and their possible applications for building O&M along with their relative advantages and disadvantages. The article concludes that the application of XR in building and city management is showing promising results in enhancing human performance in technical O&M tasks, in understanding and controlling the energy efficiency, comfort, and safety of building and infrastructures, and in supporting strategic decision making for the future smart city.

show abstract

Section: Cg Content Overlay Mode Descriptionmentioning

confidence: 99%

Extended Reality for Smart Building Operation and Maintenance: A Review

Casini

2022

Energies

View full text Add to dashboard Cite

show abstract

“…Figure 4 shows the 3D-CG model displayed on th HMD, and Figure 5 shows the 3D-CG model displayed on the SRD. For the HMD used in the experiment, we selected the HoloLens2 (Microsoft, Redmond, WA, USA), which is used in several AR types of research [17]. For the SRD, we used ELF-SR1 (SONY).…”

Section: Measurement Modelmentioning

confidence: 99%

Comparison of the Observation Errors of Augmented and Spatial Reality Systems

et al. 2021

View full text Add to dashboard Cite

Using 3D technologies such as virtual reality (VR) and augmented reality (AR), has intensified nowadays. The mainstream AR devices in use today are head-mounted displays (HMDs), which, due to specification limitations, may not perform to their full potential within a distance of 1.0 m. The spatial reality display (SRD) is another system that facilitates stereoscopic vision by the naked eye. The recommended working distance is 30.0~75.0 cm. It is crucial to evaluate the observation accuracy within 1.0 m for each device in the medical context. Here, 3D-CG models were created from dental models, and the observation errors of 3D-CG models displayed within 1.0 m by HMD and SRD were verified. The measurement error results showed that the HMD model yielded more significant results than the control model (Model) under some conditions, while the SRD model had the same measurement accuracy as the Model. The measured errors were 0.29~1.92 mm for HMD and 0.02~0.59 mm for SRD. The visual analog scale scores for distinctness were significantly higher for SRD than for HMD. Three-dimensionality did not show any relationship with measurement error. In conclusion, there is a specification limitation for using HMDs within 1.0 m, as shown by the measured values. In the future, it will be essential to consider the characteristics of each device in selecting the use of AR devices. Here, we evaluated the accuracies of 3D-CG models displayed in space using two different systems of AR devices.

show abstract

“…In more advanced cases, wearable spatially self-registering OST-HMDs such as Microsoft Hololens and Magic Leap can be used to display registered 3D content on the operation situs. One of the main research fields in the past 5 years for Hololens 1 and 2 as remote assistance devices are medical aids and systems (Park et al, 2021). Examples for application are, minimally invasive surgery training (Jiang et al, 2019), instrument navigation (Liebmann et al, 2019;Park et al, 2020) and overlays that contain medical data (García-Vázquez et al, 2018;Pratt et al, 2018).…”

Section: Introductionmentioning

confidence: 99%

“…Examples for application are, minimally invasive surgery training (Jiang et al, 2019), instrument navigation (Liebmann et al, 2019;Park et al, 2020) and overlays that contain medical data (García-Vázquez et al, 2018;Pratt et al, 2018). The most frequent experimental settings are phantom, system setup and simulator experiments whereas the application under real-world circumstances, especially for surgical procedures, has only been investigated in few research works (Park et al, 2021).…”

Section: Introductionmentioning

confidence: 99%

Real-time 3D scans of cardiac surgery using a single optical-see-through head-mounted display in a mobile setup

Dewitz¹,

Bibo²,

Moazemi³

et al. 2022

Front. Virtual Real.

View full text Add to dashboard Cite

Microsoft HoloLens 2 (HL2) is often found in research and products as a cutting-edge device in Mixed Reality medical applications. One application is surgical telementoring, that allows a remote expert to support surgeries in real-time from afar. However, in this field of research two problems are encountered: First, many systems rely on additional sensors to record the surgery in 3D which makes the deployment cumbersome. Second, clinical testing under real-world surgery conditions is only performed in a small number of research works. In this article, we present a standalone system that allows the capturing of 3D recordings of open cardiac surgeries under clinical conditions using only the existing sensors of HL2. We show difficulties that arose during development, especially related to the optical system of the HL2, and present how they can be solved. The system has successfully been used to record surgeries from the surgeons point of view and the obtained material can be used to reconstruct a 3D view for evaluation by an expert. In a preliminary study, we present a recording of a captured surgery under real-world clinical conditions to expert surgeons which estimate the quality of the recordings and their overall applicability for diagnosis and support. The study shows benefits from a 3D reconstruction compared to video-only transmission regarding perceived quality and feeling of immersion.

show abstract

Review of Microsoft HoloLens Applications over the Past Five Years

Cited by 102 publications

References 70 publications

Extended Reality for Smart Building Operation and Maintenance: A Review

Extended Reality for Smart Building Operation and Maintenance: A Review

Comparison of the Observation Errors of Augmented and Spatial Reality Systems

Real-time 3D scans of cardiac surgery using a single optical-see-through head-mounted display in a mobile setup

Contact Info

Product

Resources

About