Eye-Head Coordination for Visual Cognitive Processing

Fang, Yu; Nakashima, Ryoichi; Matsumiya, Kazumichi; Kuriki, Ichiro; Shioiri, Satoshi

doi:10.1371/journal.pone.0121035

Cited by 88 publications

(70 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Taken together our results are compatible with the control models for manipulative tasks (Johansson and Edin 1993; Randall Flanagan et al 2006; Johansson and Flanagan 2009; Fang et al 2015; Haruno et al 2001; Flanagan and Wing 1997). In the first experiment, we observed that passers endowed with both visual and haptic/tactile input use predictive/anticipatory control purely based on vision to trigger the handover (Figs.…”

Section: Discussionsupporting

confidence: 90%

Humans adjust their grip force when passing an object according to the observed speed of the partner’s reaching out movement

et al. 2018

View full text Add to dashboard Cite

The way an object is released by the passer to a partner is fundamental for the success of the handover and for the experienced fluency and quality of the interaction. Nonetheless, although its apparent simplicity, object handover involves a complex combination of predictive and reactive control mechanisms that were not fully investigated so far. Here, we show that passers use visual-feedback based anticipatory control to trigger the beginning of the release, to launch the appropriate motor program, and adapt such predictions to different speeds of the receiver’s reaching out movements. In particular, the passer starts releasing the object in synchrony with the collision with the receiver, regardless of the receiver’s speed, but the passer’s speed of grip force release is correlated with receiver speed. When visual feedback is removed, the beginning of the passer’s release is delayed proportionally with the receiver’s reaching out speed; however, the correlation between the passer’s peak rate of change of grip force is maintained. In a second study with 11 participants receiving an object from a robotic hand programmed to release following stereotypical biomimetic profiles, we found that handovers are experienced as more fluent when they exhibit more reactive release behaviours, shorter release durations, and shorter handover durations. The outcomes from the two studies contribute understanding of the roles of sensory input in the strategy that empower humans to perform smooth and safe handovers, and they suggest methods for programming controllers that would enable artificial hands to hand over objects with humans in an easy, natural and efficient way.

show abstract

Section: Discussionsupporting

confidence: 90%

Humans adjust their grip force when passing an object according to the observed speed of the partner’s reaching out movement

et al. 2018

View full text Add to dashboard Cite

show abstract

“…The results show that head direction and saccade direction are closely aligned when they occur at the same time (panel a), but are increasingly divergent as time progresses (panel c-d). This suggests that gaze and head have different characteristics, reflecting different roles in visual exploration, a result that confirms similar findings ofFang et al (2015) andSolman et al (2017).…”

supporting

confidence: 82%

Visual Exploration of Omni-Directional Panoramic Scenes

Bischof¹,

Anderson²,

Doswell³

et al. 2020

Preprint

View full text Add to dashboard Cite

How do we explore the visual environment around us, and how are head and eye movements coordinated during our exploration? To investigate this question, we had observers look at omni-directional panoramic scenes, composed of both landscape and fractal images, using a virtual-reality (VR) viewer while their eye and head movements were tracked. We analyzed the spatial distribution of eye fixations and the distribution of saccade directions; the spatial distribution of head positions and the distribution of head shifts; as well as the relation between eye and head movements. The results show that, for landscape scenes, eye and head behaviour best fit the allocentric frame defined by the scene horizon, especially when head tilt (i.e., head rotation around the view axis) is considered. For fractal scenes, which have an isotropic texture, eye and head movements were executed primarily along the cardinal directions in world coordinates. The results also show that eye and head movements are closely linked in space and time in a complementary way, with stimulus-driven eye movements predominantly leading the head movements. Our study is the first to systematically examine eye and head movements in a panoramic VRenvironment, and the results demonstrate that a VR environment constitutes a powerful and informative research alternative to traditional methods for investigating looking behaviour.

show abstract

“…It was shown that sighted observers perform several saccades per head movement that are not always in the same direction as the head movement. 28 There are also many factors that affect eye-head coordination in real-world gaze behavior, 29 including external factors such as irregularity of the terrain. 30 Involuntary eye movements, even when users have been trained to keep their eyes straight, introduce localization error.…”

Section: Discussionmentioning

confidence: 99%