Remotely Shaping the View in Surgical Telementoring

Surgment: Segmentation-enabled Semantic Search and Creation of Visual Question and Feedback to Support Video-Based Surgery Learning

“…Recent work in surgical education emphasizes the use of asynchronous methods to observe trainees' performance and offer feedback, which can better prepare trainees before they enter the operation room [2,4,15,32,75,85]. Video recordings are essential learning materials for the learning of anatomical landmarks and surgical techniques [1,59]. Schmitz et al showed that video content was more effective than traditional textbooks [73].…”

Supporting Collaborative Discussions In Surgical Teleconsulting Through Augmented Reality Head Mounted Displays

“…The multiplication of communication supports aims to make interactions increasingly more efcient, in order to decrease cognitive load, i.e., the level of mental energy required to process information [4]. First, by enabling shared vision of a common view which lets collaborators co-construct their understanding of the information [31]. Then with a virtual pointer, which has proved its worth in co-located mentoring by reducing cognitive load and improving communication [38].…”

Opportunities and Challenges of Smartglass-Assisted Interactive Telementoring

“…Kim et al [33] No No Nursing Education Klinker et al [13] No No Medical Kopetz et al [22] No No Nursing Education Rochlen et al [25] No No Medical Huang et al [27] No No Medical Aebersold et al [34] No No Medical Hanna et al [14] Yes Yes Medical Yoon et al [23] Yes Yes Medical Lacy et al [35] Yes Yes Medical Rio et al [26] Yes Yes Medical Greenberg et al [32] Yes Yes Medical Liu et al [15] Yes Yes Medical Meijer et al [36] Yes Yes Medical Andersen et al [37,38] Yes Yes Medical STAR [16][17][18][19] Yes Yes Medical Mitsuno et al [20] Yes Yes Medical Mentis et al [39] Yes Yes Medical, Industrial Lin et al [40] Yes Yes Medical Gasques et al [21] Yes Yes Medical Hassan et al [41] Yes Yes Medical Giuseppe et al [42] Yes Yes Industrial Semsar et al [31] Yes Yes Medical Wang et al [7] Yes Yes Industrial Wang et al [8] Yes Yes Physical Task…”

“…Furthermore, telestration from mentees can be used to highlight problematic areas. Several studies in our review also used some forms of telestration in their systems [14][15][16][17][18][19][20][21]26,31,[37][38][39][40], often with voice-based UIs [14,[16][17][18][19][20]31,39].…”

“…Table 2 identifies telementoring systems with smartglasses and their employed interaction styles discussed in this section. [13] No MS HoloLens Voice-based Kopetz et al [22] No Google Glass Gesture-based Rochlen et al [25] No Epson Moverio BT-200 Tangible UI Huang et al [27] No Brother AiRScouter WWD-200B Wireless Two-button Foot Pedal Aebersold et al [34] No N/A Video, Quiz Hanna et al [14] Yes MS HoloLens Voice-based, Telestration Yoon et al [23] Yes Glass Enterprise Edition 2 Voice-based Lacy et al [35] Yes N/A Voice-based Rio et al [26] Yes Epson Moverio BT-200 Telestration Greenberg et al [32] Yes N/A Voice-based Liu et al [15] Yes MS HoloLens Telestration Meijer et al [36] Yes N/A Gesture-based Andersen et al [37,38] Yes N/A Touch-based, Telestration STAR [16][17][18][19] Yes MS HoloLens Touch-based, Voice-based, Telestration Mitsuno et al [20] Yes MS HoloLens Voice-based, Telestration Mentis et al [39] Yes N/A Voice-based, Telestration Lin et al [40] Yes MS HoloLens Telestration Gasques et al [21] Yes MS HoloLens, HTC Vive Pro Telestration, Avatar Hassan et al [41] Yes N/A N/A Giuseppe et al [42] Yes Head-mounted Camera Voice-based, Gesture-based Semsar et al [31] Yes N/A Voice-based, Telestration Wang et al [7] Yes HTC Vive HMD Gesture-based, Head Pointer, Telestration Wang et al [8] Yes HTC Vive HMD Gesture-based, Head Pointer, Eye Gaze, Telestration…”