Hybrid Manual and Gaze-Based Interaction With a Robotic Arm

Maio, Matteo Di; Dondi, Piercarlo; Lombardi, Luca; Porta, Marco

doi:10.1109/etfa45728.2021.9613371

Cited by 1 publication

(3 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The tasks used to test these telemanipulation systems were drinking ( Huang et al, 2019 ; Stalljann et al, 2020 ), opening doors ( Dragomir et al, 2021 ), drawing ( Scalera et al, 2021a ; b ), printing cloths ( Sharma et al, 2020 ; 2022 ), assisting with industrial tasks in shared workspaces ( Di Maio et al, 2021 ), serving a meal or drink, picking up objects, changing CDs or tapes, making tea, and shaving ( Bien et al, 2004 ).…”

Section: Resultsmentioning

confidence: 99%

“…Multimodal control inputs can improve the user experience for each participant. They are combined to adapt to the degree and type of impairment ( Bien et al, 2004 ; Siean and Vatavu, 2021 ) and to the task ( Bannat et al, 2009 ; Di Maio et al, 2021 ), increasing the intuitive control of the complex system ( Bannat et al, 2009 ; Li et al, 2017 ; Sharma et al, 2022 ). The system of Bien et al (2004) presents a hierarchy and design for different levels of disability.…”

Section: Discussionmentioning

confidence: 99%

“…A related challenge is the Midas touch problem, which describes the misinterpretation of gaze that triggers robot commands. This leads to user frustration ( Alsharif et al, 2016 ; Di Maio et al, 2021 ). This challenge is compounded by the need to control the robot in a 3-dimensional space using 2-dimensional eye movements.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

A scoping review of gaze and eye tracking-based control methods for assistive robotic arms

Fischer-Janzen,

Wendt,

Van Laerhoven

2024

Front. Robot. AI

View full text Add to dashboard Cite

Background: Assistive Robotic Arms are designed to assist physically disabled people with daily activities. Existing joysticks and head controls are not applicable for severely disabled people such as people with Locked-in Syndrome. Therefore, eye tracking control is part of ongoing research. The related literature spans many disciplines, creating a heterogeneous field that makes it difficult to gain an overview.Objectives: This work focuses on ARAs that are controlled by gaze and eye movements. By answering the research questions, this paper provides details on the design of the systems, a comparison of input modalities, methods for measuring the performance of these controls, and an outlook on research areas that gained interest in recent years.Methods: This review was conducted as outlined in the PRISMA 2020 Statement. After identifying a wide range of approaches in use the authors decided to use the PRISMA-ScR extension for a scoping review to present the results. The identification process was carried out by screening three databases. After the screening process, a snowball search was conducted.Results: 39 articles and 6 reviews were included in this article. Characteristics related to the system and study design were extracted and presented divided into three groups based on the use of eye tracking.Conclusion: This paper aims to provide an overview for researchers new to the field by offering insight into eye tracking based robot controllers. We have identified open questions that need to be answered in order to provide people with severe motor function loss with systems that are highly useable and accessible.

show abstract