A Wearable Augmented Reality Navigation System for Surgical Telementoring Based on Microsoft HoloLens

Liu, Peng; Li, Chenmeng; Xiao, Chenchao; Zhang, Zeshu; Ma, Jie; Gao, Jian; Shao, Pengfei; Valerio, Ian L.; Pawlik, Timothy M.; Ding, Chengbiao; Yılmaz, Alper; Xu, Ronald X.

doi:10.1007/s10439-020-02538-5

Cited by 48 publications

(37 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…AR technology has been widely used in a variety of areas. They include training in the automobile [25], aerospace [26], and medical fields [27], to name just a few. Hence, the use of augmented reality for workplace safety training has become widespread.…”

Section: Osh Training With Technologymentioning

confidence: 99%

The Enhancement of OSH Training with an Augmented Reality-Based App

et al. 2021

View full text Add to dashboard Cite

Recent advances in training approaches and technology have identified the need to improve training in the field of occupational safety and health (OSH). While many researchers have examined the use of augmented reality (AR) and technology-based classrooms to enhance conventional training practices, quantitative evidence for their effectiveness and motivational im-pact remains scarce. To contribute to filling this research gap, an AR-based application was developed to enhance OSH training. The enhanced training session was conducted in a closed, safe environment with ten participants with no background in OSH. Pre-test, post-test, and instructional material motivation surveys (IMMS) using a five-point Likert scale were deployed to measure the effectiveness and motivational impact in accordance with the respective ARCS factors. The empirical results obtained show that partici-pants performed significantly better in the post-tests than in the pre-tests (mean = 14.60, s = 1.71, t(9) = –12.11 with p-value < 0.001). The IMMS re-sults show that the perceived motivation arising from the AR-based applica-tion resulted in the highest mean score for the satisfaction factor (4.80) fol-lowed by the relevance (4.65), confidence (4.60), and attention (4.55) fac-tors. The results of the evaluation suggest that the AR-based application boosted participants’ active learning behavior, engagement, and interest dur-ing the enhanced training session and produced a better learning outcome and experience.

show abstract

Section: Osh Training With Technologymentioning

confidence: 99%

The Enhancement of OSH Training with an Augmented Reality-Based App

et al. 2021

View full text Add to dashboard Cite

show abstract

“…Google Glass launched in 2013 and demonstrated a viable use of OST HMDs through various situated applications in information visualization and augmented reality using images and instructions. Since then, commercial smartglasses from Microsoft [13][14][15][16][17][18][19][20][21], Google [22,23], HTC [7,8], Vuzix [24], Epson [25,26] and Brother [27] have integrated a wearable display with a computationally sufficient computing unit that provides connectivity and a multi-modal user interface. For example, the latest OST HMDs such as HoloLens 2 and MagicLeap One provide high-resolution displays (i.e., up to 2048 × 1080), a wide FoV (i.e., 52 and 50 degrees), and tracking and control capabilities.…”

Section: Wearable Displaysmentioning

confidence: 99%

“…Kim et al [33] No No Nursing Education Klinker et al [13] No No Medical Kopetz et al [22] No No Nursing Education Rochlen et al [25] No No Medical Huang et al [27] No No Medical Aebersold et al [34] No No Medical Hanna et al [14] Yes Yes Medical Yoon et al [23] Yes Yes Medical Lacy et al [35] Yes Yes Medical Rio et al [26] Yes Yes Medical Greenberg et al [32] Yes Yes Medical Liu et al [15] Yes Yes Medical Meijer et al [36] Yes Yes Medical Andersen et al [37,38] Yes Yes Medical STAR [16][17][18][19] Yes Yes Medical Mitsuno et al [20] Yes Yes Medical Mentis et al [39] Yes Yes Medical, Industrial Lin et al [40] Yes Yes Medical Gasques et al [21] Yes Yes Medical Hassan et al [41] Yes Yes Medical Giuseppe et al [42] Yes Yes Industrial Semsar et al [31] Yes Yes Medical Wang et al [7] Yes Yes Industrial Wang et al [8] Yes Yes Physical Task…”

Section: Remoteness Mentoring Domainmentioning

confidence: 99%

“…Furthermore, telestration from mentees can be used to highlight problematic areas. Several studies in our review also used some forms of telestration in their systems [14][15][16][17][18][19][20][21]26,31,[37][38][39][40], often with voice-based UIs [14,[16][17][18][19][20]31,39].…”

Section: Telestration User Interfacementioning

confidence: 99%

“…Table 2 identifies telementoring systems with smartglasses and their employed interaction styles discussed in this section. [13] No MS HoloLens Voice-based Kopetz et al [22] No Google Glass Gesture-based Rochlen et al [25] No Epson Moverio BT-200 Tangible UI Huang et al [27] No Brother AiRScouter WWD-200B Wireless Two-button Foot Pedal Aebersold et al [34] No N/A Video, Quiz Hanna et al [14] Yes MS HoloLens Voice-based, Telestration Yoon et al [23] Yes Glass Enterprise Edition 2 Voice-based Lacy et al [35] Yes N/A Voice-based Rio et al [26] Yes Epson Moverio BT-200 Telestration Greenberg et al [32] Yes N/A Voice-based Liu et al [15] Yes MS HoloLens Telestration Meijer et al [36] Yes N/A Gesture-based Andersen et al [37,38] Yes N/A Touch-based, Telestration STAR [16][17][18][19] Yes MS HoloLens Touch-based, Voice-based, Telestration Mitsuno et al [20] Yes MS HoloLens Voice-based, Telestration Mentis et al [39] Yes N/A Voice-based, Telestration Lin et al [40] Yes MS HoloLens Telestration Gasques et al [21] Yes MS HoloLens, HTC Vive Pro Telestration, Avatar Hassan et al [41] Yes N/A N/A Giuseppe et al [42] Yes Head-mounted Camera Voice-based, Gesture-based Semsar et al [31] Yes N/A Voice-based, Telestration Wang et al [7] Yes HTC Vive HMD Gesture-based, Head Pointer, Telestration Wang et al [8] Yes HTC Vive HMD Gesture-based, Head Pointer, Eye Gaze, Telestration…”

Section: Other Types Of User Interfacesmentioning

confidence: 99%

See 2 more Smart Citations

Opportunities and Challenges of Smartglass-Assisted Interactive Telementoring

Yoon

2021

ASI

View full text Add to dashboard Cite

The widespread adoption of wearables, extended reality, and metaverses has accelerated the diverse configurations of remote collaboration and telementoring systems. This paper explores the opportunities and challenges of interactive telementoring, especially for wearers of smartglasses. In particular, recent relevant studies are reviewed to derive the needs and trends of telementoring technology. Based on this analysis, we define what can be integrated into smartglass-enabled interactive telementoring. To further illustrate this type of special use case for telementoring, we present five illustrative and descriptive scenarios. We expect our specialized use case to support various telementoring applications beyond medical and surgical telementoring, while harmoniously fostering cooperation using the smart devices of mentors and mentees at different scales for collocated, distributed, and remote collaboration.

show abstract

Mixed reality technology enhances teaching of spinal blockade procedures

Lin

Liu

et al. 2023

Clinical Anatomy

View full text Add to dashboard Cite

To investigate the efficacy of utilizing mixed reality technology-assisted teaching of a spinal medial branch nerve block. Twenty undergraduate students from a 5-year clinical medicine program in Fujian Medical University were selected. They were divided into group A and group B using a random number generator, with 10 students in each group. Group A used the traditional teaching method and Group B used the mixed reality technologyassisted teaching method. At the end of the teaching period, both groups were assessed on the blocking operation, number of punctures required, puncture time, and final error value (distance between the final position and the reference position). A questionnaire was administered to both groups to assess teaching satisfaction. The number of punctures required was 7.40 ± 1.26 and 2.10 ± 0.74 for groups A and B, respectively. The puncture time in group A was 297.80 ± 50.95 s and 65.60 ± 22.02 s in group B. All differences were significant p < 0.01. The final error of the puncture in group A was 2.24 ± 0.35 mm and 1.96 ± 0.26 mm in group B-not significant. Group B had (p < 0.01) higher evaluation scores than group A for teaching effectiveness, learning interest, initiative, and teaching satisfaction. The application of mixed reality technology in the teaching of posterior medial branch blocks of the spinal nerve is superior to previous methods. This method should be adopted wherever possible to enhance learning of this difficult technique.

show abstract

A Wearable Augmented Reality Navigation System for Surgical Telementoring Based on Microsoft HoloLens

Cited by 48 publications

References 20 publications

The Enhancement of OSH Training with an Augmented Reality-Based App

The Enhancement of OSH Training with an Augmented Reality-Based App

Opportunities and Challenges of Smartglass-Assisted Interactive Telementoring

Mixed reality technology enhances teaching of spinal blockade procedures

Contact Info

Product

Resources

About