Medical telementoring using an augmented reality transparent display

Andersen, Daniel; Popescu, Voicu; Cabrera, María Eugenia; Shanghavi, Aditya; Gómez, Gerardo; Marley, Sherri; Mullis, Brian; Wachs, Juan P.

doi:10.1016/j.surg.2015.12.016

Cited by 86 publications

(64 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…During preliminary testing, we found that a fixed platform (as opposed to a head-mounted camera) improved spatial orientation and communication between the mentor and the operator. Andersen et al reported that a similar set-up (STAR: System for Telementoring with Augmented Reality) decreases operator focus shifts and improves accuracy when performing port placement and abdominal incisions on a surgical simulator 23. Telementoring of trained surgeons learning new procedures appears to yield similar complication rates and surgical duration compared with on-site mentoring 24.…”

Section: Discussionmentioning

confidence: 99%

A pilot study of surgical telementoring for leg fasciotomy

et al. 2017

View full text Add to dashboard Cite

show abstract

Section: Discussionmentioning

confidence: 99%

A pilot study of surgical telementoring for leg fasciotomy

et al. 2017

View full text Add to dashboard Cite

show abstract

“…This customized lexicon was developed for use in the medical telementoring application STAR, in which the mentor or expert is provided with multimodal interactions, including touch-based annotations, air gestures, and tool manipulation to guide a novice surgeon or trainee through a procedure (Andersen et al, 2016).…”

Section: Data Set 1: Image Manipulation (Imd)mentioning

confidence: 99%

A Human-Centered Approach to One-Shot Gesture Learning

Cabrera

Wachs

2017

Front. Robot. AI

Self Cite

View full text Add to dashboard Cite

This article discusses the problem of one-shot gesture recognition using a humancentered approach and its potential application to fields such as human-robot interaction where the user's intentions are indicated through spontaneous gesturing (one shot). Casual users have limited time to learn the gestures interface, which makes one-shot recognition an attractive alternative to interface customization. In the aim of natural interaction with machines, a framework must be developed to include the ability of humans to understand gestures from a single observation. Previous approaches to oneshot gesture recognition have relied heavily on statistical and data-mining-based solutions and have ignored the mechanisms that are used by humans to perceive and execute gestures and that can provide valuable context information. This omission has led to suboptimal solutions. The focus of this study is on the process that leads to the realization of a gesture, rather than on the gesture itself. In this case, context involves the way in which humans produce gestures-the kinematic and anthropometric characteristics. In the method presented here, the strategy is to generate a data set of realistic samples based on features extracted from a single gesture sample. These features, called the "gist of a gesture," are considered to represent what humans remember when seeing a gesture and, later, the cognitive process involved when trying to replicate it. By adding meaningful variability to these features, a large training data set is created while preserving the fundamental structure of the original gesture. The availability of a large data set of realistic samples allows the use of training classifiers for future recognition. The performance of the method is evaluated using different lexicons, and its efficiency is compared with that of traditional N-shot learning approaches. The strength of the approach is further illustrated through human and machine recognition of gestures performed by a dual-arm robotic platform.

show abstract

“…Interactive additions to telementoring systems such as telestration, laser pointing capabilities, or increased remote control of the visual field have played a role in enriching the teaching capabilities of the remote surgeon. Wearable technology, such as the Google Glass (Google, Mountainview, CA), and methods of augmented reality telementoring have also been implemented and have had some success (25,26). Specially designed telemedical robotic platforms such as the Karl Storz Endoscopy-America, Inc. VisitOR1 (Karl Storz; Tuttlingen, German) and RemotePresence-7 robot (InTouch Health; Santa Barbara, Calif) have been developed and may play a role in further increasing the remote surgeon's presence in the operating room.…”

Section: Current Applicationsmentioning

confidence: 99%

“…They found that the students trained using the augmented reality platform had significantly faster skill acquisition as compared to students trained with traditional mentoring. Similarly, Andersen et al developed a System for Telementoring and Augmented Reality (STAR) that provided visual instruction to a monitor that the students used to visualize their operating field in order to evaluate its effectiveness in training tasks including a port placement and abdominal incision (26). The participants using STAR had decreased errors and focus shifts but took longer to complete the tasks as compared to those with traditional mentoring.…”

Section: Augmented Realitymentioning

confidence: 99%

The evolution of surgical telementoring: current applications and future directions

El‐Sabawi

Magee

2016

Ann. Transl. Med.

View full text Add to dashboard Cite

Surgical telementoring is a concept within telemedicine that involves the use of information technology to provide real-time guidance and technical assistance for surgical procedures from an expert physician at a different geographical location. It is a means to overcome the logistic obstacles associated with traditional mentoring and can aid in the distribution of advanced surgical techniques. In addition to its perceived educational benefits, it has the potential to directly impact patient care by providing immediate access to specialized surgical expertise in areas lacking access to qualified surgeons. With advances in technology, surgical telementoring has made significant strides in the past two decades and a breadth of positive experiences have been published in the literature. Despite this growth, questions remain regarding ideal videoconferencing methodology, resolution and latency requirements, security and liability issues, and telementoring in combination with emerging technology. This review addresses the history and progression, current applications, and future directions of surgical telementoring as a means to distribute advanced surgical expertise around the world.

show abstract

Medical telementoring using an augmented reality transparent display

Abstract: Background The goal of this study was to design and implement a novel surgical telementoring

Cited by 86 publications

References 14 publications

A pilot study of surgical telementoring for leg fasciotomy

A pilot study of surgical telementoring for leg fasciotomy

A Human-Centered Approach to One-Shot Gesture Learning

The evolution of surgical telementoring: current applications and future directions

Contact Info

Product

Resources

About