Voice or Gesture in the Operating Room

Mentis, Helena M.; O’Hara, Kenton; González, Gerardo; Sellen, Abigail; Corish, Robert; Criminisi, Antonio; Trivedi, Rikin; Theodore, Pierre

doi:10.1145/2702613.2702963

Cited by 35 publications

(20 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The surgeon sits at the console and the bedside assistant stays next to the patient. In HCI, previous work have investigated how surgeons collaboratively construct a mental image of the body [43,45,46] and how they control medical equipment [44]. Specifically in robotic-assisted surgery, work has focused on training [9,28], performance metrics [31,38] and identifying future challenges in telesurgery: surgery with distributed medical teams.…”

Section: Introductionmentioning

confidence: 99%

Impacts of Telemanipulation in Robotic Assisted Surgery

Avellino¹,

Bailly²,

Canlorbe

et al. 2019

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Robotic-assisted Minimally Invasive Surgery (MIS) is adopted more and more as it overcomes the shortcomings of classic MIS for surgeons while keeping the benefits of small incisions for patients. However, introducing new technology oftentimes affects the work of skilled practitioners. Our goals are to investigate the impacts of telemanipulated surgical robots on the work practices of surgical teams and to understand their cause. We conducted a field study observing 21 surgeries, conducting 12 interviews and performing 3 data validation sessions with surgeons. Using Thematic Analysis, we find that physically separating surgeons from their teams makes them more autonomous, shifts their use of perceptual senses, and turns the surgeon's assistant into the robot's assistant. We open design opportunities for the HCI field by questioning the telemanipulated approach and discussing alternatives that keep surgeons on the surgical field. CCS CONCEPTS • Human-centered computing → Empirical studies in HCI.

show abstract

Section: Introductionmentioning

confidence: 99%

Impacts of Telemanipulation in Robotic Assisted Surgery

Avellino¹,

Bailly²,

Canlorbe

et al. 2019

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…Combining controls has been studied in HCI for interacting with systems in the surgery room, although there is more ground to cover to better understand interaction in this criticalcontext environment. Mentis et al [32] studied voice and hand gesture control for a system that shows preoperative images, and conclude that there is a case for redundancy as their benefits are circumstantial. O'Hara et al [41] highlights that control techniques should be designed to work within operating rooms, as individual and also collaborative practices vary.…”

Section: Combining Controlsmentioning

confidence: 99%

Multimodal and Mixed Control of Robotic Endoscopes

Avellino¹,

Bailly²,

Arico³

et al. 2020

Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

HAL is a multidisciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

show abstract

“…Thus, an automated robotic surgical system that is better than the current master-slave approach may be expected to reduce human error and thereby improve the quality of surgery. Up to now, relevant studies have mainly focused on the development of robots capable of performing short surgical tasks, such as knot tie and needle insertion [ 8 , 9 ], and the application of voice interaction technology during surgery may be one of the crucial elements that should be developed in an AI-based surgical assistant system [ 10 - 12 ].…”

Section: Introductionmentioning

confidence: 99%

Clinical Desire for an Artificial Intelligence–Based Surgical Assistant System: Electronic Survey–Based Study

et al. 2020

View full text Add to dashboard Cite

Background Techniques utilizing artificial intelligence (AI) are rapidly growing in medical research and development, especially in the operating room. However, the application of AI in the operating room has been limited to small tasks or software, such as clinical decision systems. It still largely depends on human resources and technology involving the surgeons’ hands. Therefore, we conceptualized AI-based solo surgery (AISS) defined as laparoscopic surgery conducted by only one surgeon with support from an AI-based surgical assistant system, and we performed an electronic survey on the clinical desire for such a system. Objective This study aimed to evaluate the experiences of surgeons who have performed laparoscopic surgery, the limitations of conventional laparoscopic surgical systems, and the desire for an AI-based surgical assistant system for AISS. Methods We performed an online survey for gynecologists, urologists, and general surgeons from June to August 2017. The questionnaire consisted of six items about experience, two about limitations, and five about the clinical desire for an AI-based surgical assistant system for AISS. Results A total of 508 surgeons who have performed laparoscopic surgery responded to the survey. Most of the surgeons needed two or more assistants during laparoscopic surgery, and the rate was higher among gynecologists (251/278, 90.3%) than among general surgeons (123/173, 71.1%) and urologists (35/57, 61.4%). The majority of responders answered that the skillfulness of surgical assistants was “very important” or “important.” The most uncomfortable aspect of laparoscopic surgery was unskilled movement of the camera (431/508, 84.8%) and instruments (303/508, 59.6%). About 40% (199/508, 39.1%) of responders answered that the AI-based surgical assistant system could substitute 41%-60% of the current workforce, and 83.3% (423/508) showed willingness to buy the system. Furthermore, the most reasonable price was US $30,000-50,000. Conclusions Surgeons who perform laparoscopic surgery may feel discomfort with the conventional laparoscopic surgical system in terms of assistant skillfulness, and they may think that the skillfulness of surgical assistants is essential. They desire to alleviate present inconveniences with the conventional laparoscopic surgical system and to perform a safe and comfortable operation by using an AI-based surgical assistant system for AISS.

show abstract

Voice or Gesture in the Operating Room

Cited by 35 publications

References 14 publications

Impacts of Telemanipulation in Robotic Assisted Surgery

Impacts of Telemanipulation in Robotic Assisted Surgery

Multimodal and Mixed Control of Robotic Endoscopes

Clinical Desire for an Artificial Intelligence–Based Surgical Assistant System: Electronic Survey–Based Study

Contact Info

Product

Resources

About