Accuracy measurement of HoloLens2 IMUs in medical environments

Abstract

As augmented reality devices become more available, collaborative work in the augmented space is expected to increase. Knowing the position of participants allows for realistic interaction rather than passive participation. The HoloLens 2’s camera and IMUs fuse data to locate the device. In this paper, accuracy and repeatability of the HoloLens2 position finding was analysed to provide a quantitative measure of pose repeatability and deviation from a path while in motion. Deviation from a circular path was found to be below 5 mm per 628 mm travelled.

A Proof of Concept Combined Using Mixed Reality for Personalized Neurorehabilitation of Cerebellar Ataxic Patients

“…Further analyses of errors during the exergaming performance will be performed in the framework of patients’ acquisitions in order to obtain a detailed evaluation of patient performance. According to studies [ 7 , 8 , 25 , 26 , 27 ], the HL2 device is already validated for tracking the joint algorithm in similar conditions in healthy subjects.…”

“…In [ 7 ], the IMU of HL2 was compared with a gold standard reference sensor; 0.87 percent was the highest deviation from the starting position and a final position after the traveled path of 5655 m. Instead, in [ 8 ], the IMU was compared to other reference systems of gait acquisition. In static acquisition, HL2 measures were statistically equivalent (error ≤ 5%, p < 0.05, 95% confidence level) to the MoCap Technology measures, whereas its reliability in walking trials was found to be excellent, with intra-class correlation coefficient (ICC(2,1)) values ≥ 0.98.…”

“…Particular interest has arisen in the introduction of Virtual Reality (VR) and Augmented Reality (AR) devices that today are most studied for their applicability in rehabilitation. Knowing the position of the patient in real time allows for realistic interaction rather than passive participation [ 7 ], and makes post-processing analysis available. Different studies [ 8 , 9 , 10 ] have validated the capacity of these devices to support rehabilitative activities, generating biomechanical outcomes comparable to gold standard outcomes.…”

Microsoft HoloLens 2 in Medical and Healthcare Context: State of the Art and Future Prospects

“…Four contributions [ 108 , 109 , 110 , 111 ] have been included in the “other applications” subgroup since, due to their characteristics, they cannot be configured as belonging to the subgroups mentioned. More specifically, in the study of Onishi et al [ 108 ], the authors implemented a prototype system, named Gaze-Breath, in which gaze and breathing are integrated, using an MR headset and a thermal camera, respectively, for hands-free or intuitive inputs to control the cursor three-dimensionally and facilitate switching between pointing and selection.…”

“…In this work, authors presented a new prototype called HEARTS 2 consisting of Microsoft HoloLens 2 as well as realistic and animated computer graphics (CG) models of older women. Finally, Matyash et al [ 111 ] investigated accuracy measurement of HoloLens 2 inertial measurement units (IMUs) in medical environments. Indeed, the authors analyzed the accuracy and repeatability of the HoloLens 2 position finding to provide a quantitative measure of pose repeatability and deviation from a path while in motion.…”