A non-contact mouse for surgeon-computer interaction

Grätzel, Carole; Fong, Terrence; Grange, S.; Baur, Charles

doi:10.3233/thc-2004-12304

Cited by 104 publications

(41 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In comparison with prior work, 9 which gauged intent by checking if gestures were performed in a predefined threedimensional workspace, our work uses environmental cues to determine intent allowing the user to perform gestures anywhere in the field of view of the sensor.…”

Section: Discussionmentioning

confidence: 99%

Hand-gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images

Jacob

Wachs

Packer

2012

Journal of the American Medical Informatics Association

View full text Add to dashboard Cite

This paper presents a method to improve the navigation and manipulation of radiological images through a sterile hand gesture recognition interface based on attentional contextual cues. Computer vision algorithms were developed to extract intention and attention cues from the surgeon's behavior and combine them with sensory data from a commodity depth camera. The developed interface was tested in a usability experiment to assess the effectiveness of the new interface. An image navigation and manipulation task was performed, and the gesture recognition accuracy, false positives and task completion times were computed to evaluate system performance. Experimental results show that gesture interaction and surgeon behavior analysis can be used to accurately navigate, manipulate and access MRI images, and therefore this modality could replace the use of keyboard and mice-based interfaces.

show abstract

Section: Discussionmentioning

confidence: 99%

Hand-gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images

Jacob

Wachs

Packer

2012

Journal of the American Medical Informatics Association

View full text Add to dashboard Cite

show abstract

“…Graetzel et al [4] gave an overview of the benefits of touchless interaction systems for medical data consultation by re-mapping a mouse cursor to a system using computer vision to track users hands. While overcoming the problem that we identified (sterility maintenance), this system was not easy to use, was not effective, had a low usability, and induced fatigue for the users.…”

Section: Touchless Interaction Within the Surgery Contextmentioning

confidence: 99%

Approach for Intuitive and Touchless Interaction in the Operating Room

Hurstel

Bechmann

2019

View full text Add to dashboard Cite

The consultation of medical images, 2D or 3D, has a crucial role for planned or ongoing surgical operations. During an intervention, this consultation induces a sterility loss for the surgeon due to the fact that the classical interaction devices are non-sterile. A solution to this problem would be to replace conventional devices by touchless interaction technologies, thereby enabling sterile interventions. In this paper, we present the conceptual development of an intuitive “gesture vocabulary” allowing the implementation of an effective touchless interactive system that is well adapted to the specificities of the surgical context. Our methodology and its implementation as well as our results are detailed. The suggested methodology and its implementation were both shown to be a valid approach to integrating this mean of interaction in the operating room.

show abstract

“…[4][5][6] The risk of error, unnecessary prolongation of surgery time, and lack of autonomy has prompted the development of multiple surgeon directed systems for intraoperative image navigation. [7][8][9][10][11][12][13][14] If a surgeon is able to navigate and manipulate diagnostic images while remaining sterile during a surgical procedure, this may reduce surgical time and give the surgeon further autonomy in the operating suite. By decreasing the communication required to direct personnel to navigate the image studies, the process of viewing images intraoperatively may be streamlined, and patient risk may be reduced.…”

Section: T He Role Of Diagnostic Imaging In the Surgicalmentioning

confidence: 99%

INTRAOPERATIVE IMAGE NAVIGATION: EXPERIMENTAL STUDY OF THE FEASIBILITY AND SURGEON PREFERENCE BETWEEN A STERILE ENCASED NINTENDO WII^TM REMOTE AND STANDARD WIRELESS COMPUTER MOUSE

Appleby¹,

Linden²,

Sears³

2017

Vet Radiology Ultrasound

View full text Add to dashboard Cite

Diagnostic imaging plays an important role in the operating room, providing surgeons with a reference and surgical plan. Surgeon autonomy in the operating room has been suggested to decrease errors that stem from communication mistakes. A standard computer mouse was compared to a wireless remote-control style controller for computer game consoles (Wiimote) for the navigation of diagnostic imaging studies by sterile personnel in this prospective survey study. Participants were recruited from a cohort of residents and faculty that use the surgical suites at our institution. Outcome assessments were based on survey data completed by study participants following each use of either the mouse or Wiimote, and compared using an analysis of variance. The mouse was significantly preferred by the study participants in the categories of handling, accuracy and efficiency, and overall satisfaction (P <0.05). The mouse was preferred to both the Wiimote and to no device, when participants were asked to rank options for image navigation. This indicates the need for the implementation of intraoperative image navigation devices, to increase surgeon autonomy in the operating room.

show abstract

A non-contact mouse for surgeon-computer interaction

Cited by 104 publications

References 10 publications

Hand-gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images

Hand-gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images

Approach for Intuitive and Touchless Interaction in the Operating Room

INTRAOPERATIVE IMAGE NAVIGATION: EXPERIMENTAL STUDY OF THE FEASIBILITY AND SURGEON PREFERENCE BETWEEN A STERILE ENCASED NINTENDO WII^TM REMOTE AND STANDARD WIRELESS COMPUTER MOUSE

Contact Info

Product

Resources

About

A non-contact mouse for surgeon-computer interaction

Cited by 104 publications

References 10 publications

Hand-gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images

Hand-gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images

Approach for Intuitive and Touchless Interaction in the Operating Room

INTRAOPERATIVE IMAGE NAVIGATION: EXPERIMENTAL STUDY OF THE FEASIBILITY AND SURGEON PREFERENCE BETWEEN A STERILE ENCASED NINTENDO WIITM REMOTE AND STANDARD WIRELESS COMPUTER MOUSE

Contact Info

Product

Resources

About

INTRAOPERATIVE IMAGE NAVIGATION: EXPERIMENTAL STUDY OF THE FEASIBILITY AND SURGEON PREFERENCE BETWEEN A STERILE ENCASED NINTENDO WII^TM REMOTE AND STANDARD WIRELESS COMPUTER MOUSE