Interactional Order and Constructed Ways of Seeing with Touchless Imaging Systems in Surgery

O’Hara, Kenton; González, Gerardo; Penney, Graeme P.; Sellen, Abigail; Corish, Robert; Mentis, Helena M.; Varnavas, Andreas; Criminisi, Antonio; Rouncefield, Mark; Dastur, Neville; Carrell, Tom

doi:10.1007/s10606-014-9203-4

Cited by 41 publications

(41 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Ethnographic studies [41][42][43][44]76] deserve a separate mention, since they transcend proofs-of-concept and user and prototype testing, and approach gesture-based touchless interaction from a holistic view that includes the social practices of surgery, and how the medical images and manipulation devices are embedded and made meaningful within the collaborative practices of the surgery [10].…”

Section: Discussionmentioning

confidence: 99%

“…Most of the articles (47) identified in this systematic review were proof-of-concept or prototype user and feasibility testing ( Table 1). The five ethnographic studies retained had the aim of identifying interactions between personnel and the gesture-based COTS systems in interventional radiology departments or in the OR [16,[41][42][43][44]. Two studies were aimed at comparing the performance of the MK with respect to a mouse [45,46]; one compared the performance of the LMC to that of a mouse [47]; and two studies compared different COTS devices [48,49].…”

Section: User Testingmentioning

confidence: 99%

See 1 more Smart Citation

Use of commercial off-the-shelf devices for detection of manual gestures in surgery. A Systematic Literature Review (Preprint)

Alvarez-Lopez¹,

Maina²,

Saigí-Rubió³

2018

Preprint

View full text Add to dashboard Cite

Background. The increasingly pervasive presence of technology in the operating room (OR) raises the need to study the interaction between the surgeon and the computer system. A new generation of tools known as commercial off-the-shelf (COTS) devices that enable non-contact gesture-based human-computer interaction (HCI) are currently being explored as a solution in surgical environments. The aim of this systematic review was to provide an account of the state-of-the-art of COTS devices in the detection of manual gestures in surgery, and to identify their use as a simulation tool for teaching motor skills in minimally invasive surgery (MIS). Methods. A systematic literature review was conducted in PubMed, Embase, ScienceDirect and IEEE for articles published between January 2000 and 2016 on the use of COTS devices for gesture detection in surgical environments, and in simulation for surgical skills learning in MIS. Results. A total of 2709 studies were identified, 76 of which met the search selection criteria. The Microsoft KinectTM and the Leap Motion ControllerTM were the most widely used COTS devices. The most common intervention was image manipulation in surgical and interventional radiology environments, followed by interaction with virtual reality environments for educational or interventional purposes; the possibility of using this technology to develop portable, low-cost simulators for skills learning in MIS was also examined. Given that the vast majority of articles found in this systematic review were proof-of-concept or prototype user and feasibility testing, we can conclude that this is a field that is still in the exploration phase in areas that require touchless manipulation in environments and settings that must adhere to asepsis and antisepsis protocols, such as angiography suites and operating rooms. Conclusions: COTS devices applied to hand and instrument GBIs in the field of simulation for skills learning and training in MIS could open up a promising field to achieve the ubiquitous training and pre-surgical warm-up.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: User Testingmentioning

confidence: 99%

Use of commercial off-the-shelf devices for detection of manual gestures in surgery. A Systematic Literature Review (Preprint)

Alvarez-Lopez¹,

Maina²,

Saigí-Rubió³

2018

Preprint

View full text Add to dashboard Cite

show abstract

“…The Kinect device and the Oculus Rift are examples-both were first deployed commercially with games as the primary use case. The widespread availability of these devices has enabled others working in HCI to expand the possibility space of interaction, for example, recent work examining the use of the Kinect in surgical applications (O'Hara et al, 2014).…”

Section: Exploration Of New Interactive Methods and Techniquesmentioning

confidence: 99%

Introduction to this Special Issue on HCI and Games

Bernhaupt¹,

Isbister

Freitas

2015

Human–Computer Interaction

View full text Add to dashboard Cite

International audienceGames have been part of human–computer interaction (HCI) research since the first CHI conference in 1982. At that gathering, Tom Malone, then at Xerox PARC, presented insights from the study of computer games to motivate a set of design principles for “enjoyable” user interfaces (Malone, 1982). Over the ensuing years, games-related HCI research has steadily grown as a subarea of CHI (e.g. Keeker, Pagulayan, Sykes, & Lazzaro, 2004; Pausch, Gold, Skelly, & Thiel, 1994), with more rapid acceleration in the last 10 years. A recent metareview (Carter, Downs, Nansen, Harrop, & Gibbs, 2014) analyzed game- and play-related content at CHI between 2003 and 2013, finding that the overall percentage of the CHI proceedings related to play and games rose from 2.5% to a peak of 9.5% in 2012. In the last few years, venues for game-related HCI work have expanded as well. From 2011 to 2013, two of this special issue’s editors (Bernhaupt & Isbister, 2013) formed a Games and Entertainment Special Community devoted to game-related HCI research at CHI, leading to the permanent addition to CHI venues of a Student Game Design Competition. And in 2014, a new ACM-sponsored conference was created as a specialized peer-reviewed venue for the intersection of HCI and Games—CHI-Play. Game-related research is clearly a valued, integral, and growing segment of HCI research

show abstract

“…As can be seen, the most common system application for touchless, gesture-driven interfaces has been various forms of image navigation, closely aligned with the OR and interventional radiology contexts listed above. Medical image navigation is the goal in seventeen papers, [4][5][6][7][8][9]11,14,[16][17][18][19][20][21][22][23][24] with the more specific subset of magnetic resonance imaging (MRI) image navigation being the goal in six papers. 5,7,8,9,14,16 Task context was also significant in identifying tasks for testing the systems implemented, such as measuring a lesion on MRI images.…”

Section: Context Of Usementioning

confidence: 99%

Touchless computer interfaces in hospitals: A review

Cronin¹,

Doherty

2018

Health Informatics J

View full text Add to dashboard Cite

The widespread use of technology in hospitals and the difficulty of sterilising computer controls has increased opportunities for the spread of pathogens. This leads to an interest in touchless user interfaces for computer systems. We present a review of touchless interaction with computer equipment in the hospital environment, based on a systematic search of the literature. Sterility provides an implied theme and motivation for the field as a whole, but other advantages, such as hands-busy settings, are also proposed. Overcoming hardware restrictions has been a major theme, but in recent research, technical difficulties have receded. Image navigation is the most frequently considered task and the operating room the most frequently considered environment. Gestures have been implemented for input, system and content control. Most of the studies found have small sample sizes and focus on feasibility, acceptability or gesture-recognition accuracy. We conclude this article with an agenda for future work.

show abstract

Interactional Order and Constructed Ways of Seeing with Touchless Imaging Systems in Surgery

Cited by 41 publications

References 23 publications

Use of commercial off-the-shelf devices for detection of manual gestures in surgery. A Systematic Literature Review (Preprint)

Use of commercial off-the-shelf devices for detection of manual gestures in surgery. A Systematic Literature Review (Preprint)

Introduction to this Special Issue on HCI and Games

Touchless computer interfaces in hospitals: A review

Contact Info

Product

Resources

About