Efficient Use of Mixed Reality for BIM system using Microsoft HoloLens

Bahri, Haythem; Kapp, David; Moezzi, Reza; Koci, Jan

doi:10.1016/j.ifacol.2019.12.762

Cited by 14 publications

(12 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…us, there is no need for extra computers or devices. Information is projected on specific see-through lenses based on holographic waveguide in front of the user's eye [18].…”

Section: Materials and Equipmentmentioning

confidence: 99%

“…e HoloLens hardware includes an inertial measurement unit, which integrates an accelerometer, a gyroscope, and a magnetometer to detect the head movements in the three-dimensional space. e hardware also includes a pair of short and long-throw infrared illuminators, an energy-efficient depth camera with a 120°× 120°a ngle of view, a 2.4-megapixel photographic video camera, an array made up by four microphones, and an ambient light sensor [18]. More specifically, Microsoft HoloLens is equipped with four gray-scale environment tracking cameras and a depth camera to sense its environment and capture gestures of the user.…”

Section: Materials and Equipmentmentioning

confidence: 99%

“…Thus, there is no need for extra computers or devices. Information is projected on specific see-through lenses based on holographic waveguide in front of the user's eye [ 18 ]. The HoloLens hardware includes an inertial measurement unit, which integrates an accelerometer, a gyroscope, and a magnetometer to detect the head movements in the three-dimensional space.…”

Section: Materials and Equipmentmentioning

confidence: 99%

“…Moreover, two of the gray-scale cameras are configured as a stereo mode, in order to capture the area in front of the headset so that the absolute depth of tracked visual features can be determined through triangulation. The remaining two additional gray-scale cameras are used to provide a wider field of view and to keep track of features [ 18 ]. It is worth saying that these synchronized global-shutter cameras are significantly more light-sensitive than the color camera.…”

Section: Materials and Equipmentmentioning

confidence: 99%

See 3 more Smart Citations

Experimental Setup Employed in the Operating Room Based on Virtual and Mixed Reality: Analysis of Pros and Cons in Open Abdomen Surgery

Galati

Simone

Barile

et al. 2020

Journal of Healthcare Engineering

View full text Add to dashboard Cite

Currently, surgeons in operating rooms are forced to focus their attention both on the patient’s body and on flat low-quality surgical monitors, in order to get all the information needed to successfully complete surgeries. The way the data are displayed leads to disturbances of the surgeon’s visuals, which may affect his performances, besides the fact that other members of the surgical team do not have proper visual tools able to aid him. The idea underlying this paper is to exploit mixed reality to support surgeons during surgical procedures. In particular, the proposed experimental setup, employed in the operating room, is based on an architecture that put together the Microsoft HoloLens, a Digital Imaging and Communications in Medicine (DICOM) player and a mixed reality visualization tool (i.e., Spectator View) developed by using the Mixed Reality Toolkit in Unity with Windows 10 SDK. The suggested approach enables visual information on the patient’s body as well as information on the results of medical screenings to be visualized on the surgeon’s headsets. Additionally, the architecture enables any data and details to be shared by the team members or by external users during surgical operations. The paper analyses in detail advantages and drawbacks that the surgeons have found when they wore the Microsoft HoloLens headset during all the ten open abdomen surgeries conducted at the IRCCS Hospital “Giovanni Paolo II” in the city of Bari (Italy). A survey based on Likert scale demonstrates how the use of the suggested tools can increase the execution speed by allowing multitasking procedures, i.e., by checking medical images at high resolution without leaving the operating table and the patient. On the other hand, the survey also reveals an increase in the physical stress and reduced comfort due to the weight of the Microsoft HoloLens device, along with drawbacks due to the battery autonomy. Additionally, the survey seems to encourage the use of DICOM Viewer and Spectator View both for surgical education and for improving surgery outcomes. Note that the real use of the conceived platform in the operating room represents a remarkable feature of this paper, since most if not all the studies conducted so far in literature exploit mixed reality only in simulated environments and not in real operating rooms. In conclusion, the study clearly highlights that, despite the challenges required in the forthcoming years to improve the current technology, mixed reality represents a promising technique that will soon enter the operating rooms to support surgeons during surgical procedures in many hospitals across the world.

show abstract

“…us, there is no need for extra computers or devices. Information is projected on specific see-through lenses based on holographic waveguide in front of the user's eye [18].…”

Section: Materials and Equipmentmentioning

confidence: 99%

Section: Materials and Equipmentmentioning

confidence: 99%

Section: Materials and Equipmentmentioning

confidence: 99%

Section: Materials and Equipmentmentioning

confidence: 99%

See 2 more Smart Citations

Experimental Setup Employed in the Operating Room Based on Virtual and Mixed Reality: Analysis of Pros and Cons in Open Abdomen Surgery

Galati

Simone

Barile

et al. 2020

Journal of Healthcare Engineering

View full text Add to dashboard Cite

show abstract

“…Bahri et al [63] proposed an efficient use of MR technology to manage furniture in a room using HoloLens, to create a building information modeling (BIM) system. The MR systems can interact with BIM data, from a virtual to real environment.…”

Section: Architecture and Civil Engineeringmentioning

confidence: 99%

Review of Microsoft HoloLens Applications over the Past Five Years

2021

View full text Add to dashboard Cite

Since Microsoft HoloLens first appeared in 2016, HoloLens has been used in various industries, over the past five years. This study aims to review academic papers on the applications of HoloLens in several industries. A review was performed to summarize the results of 44 papers (dated between January 2016 and December 2020) and to outline the research trends of applying HoloLens to different industries. This study determined that HoloLens is employed in medical and surgical aids and systems, medical education and simulation, industrial engineering, architecture, civil engineering and other engineering fields. The findings of this study contribute towards classifying the current uses of HoloLens in various industries and identifying the types of visualization techniques and functions.

show abstract