Supporting Human–Robot Interaction Based on the Level of Visual Focus of Attention

Abstract

We propose a human-robot interaction approach for social robots that attracts and controls the attention of a target person depending on her/his current visual focus of attention. The system detects the person's current task (attention) and estimates the level by using the "task-related contextual cues" and "gaze pattern." The attention level is used to determine the suitable time to attract the target person's attention toward the robot. The robot detects the interest or willingness of the target person to interact with it. Then, depending on the level of interest of the target person, the robot generates awareness and establishes a communication channel with her/him. To evaluate the performance, we conducted an experiment using our static robot to attract the target human's attention when she/he is involved in four different tasks: reading, writing, browsing, and viewing paintings. The proposed robot determines the level of attention of the current task and considers the situation of the target person. Questionnaire measures confirmed that the proposed robot outperforms a simple attention control robot in attracting participants' attention in an acceptable way. It also causes less disturbance and establishes effective eye contact. We implemented the system into a commercial robotic platform (Robovie-R3) to initiate interaction between visitors and the robot in a museum scenario. The robot determined the visitors' gaze points and established a successful interaction with a success rate of 91.7%.Index Terms-Gaze pattern, human-robot interaction, taskrelated contextual cues, visual focus of attention (VFOA).

Using Variable Dwell Time to Accelerate Gaze-Based Web Browsing with Two-Step Selection

“…Dong et al developed a hybrid gaze/electroencephalography (EEG) interface which suppressed the selection of unlikely commands depending on the user's intent estimated from their natural gaze trajectories . In the field of human-robot interaction, Das, Rashed, Kobayashi, and Kuno (2015) designed a robot which was able to determine VARIABLE DWELL TIME FOR GAZE-BASED BROWSING 6 the suitable time to interact with a person by estimating the person's visual focus of attention based on the cues including gaze patterns. Huang and Mutlu (2016) studied eye gaze in a scenario where a robot delivered an item to a user who ordered the item from a menu using speech.…”

Deep Learning Systems for Estimating Visual Attention in Robot-Assisted Therapy of Children with Autism and Intellectual Disability

“…People naturally tend to look and focus their attention on objects which are of immediate interest [26]. Visual attention also is normally established in social contexts like a conversation between two people, and the ability to correctly simulate focusing the visual attention on the interaction partner is considered a way for robots to exhibit social intelligence and awareness and facilitate HRI [27].…”

User Experience Results of Setting Free a Service Robot for Older Adults at Home

“…More work in this direction is ongoing, for example, [1,12]. What is still missing are robots that robustly and smoothly focus onto the user in their natural environment at home.…”

“…The highest developed robot with similar capability as Hobbit is Care-O-bot. It has been tested in many trials in care facilities for studying user interaction, for example, for bringing water or other assistive operations in care facilities [1]. However, this robot is too large to operate at homes; it would hardly fit through doors.…”