Visuo-vestibular heading perception: a model system to study multi-sensory decision making

Zeng, Zhao; Zhang, Ce; Gu, Yong

doi:10.1098/rstb.2022.0334

Cited by 4 publications

(4 citation statements)

References 130 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…2012 , Dupin and Wexler 2013 , Garzorz et al. 2018 , Britton and Arshad 2019 , Xing and Saunders 2022 , Zeng et al. 2023 ).…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Incongruent active head rotations increase visual motion detection thresholds

Pickard,

Davidson,

Kim

et al. 2024

Neuroscience of Consciousness

View full text Add to dashboard Cite

Attributing a visual motion signal to its correct source—be that external object motion, self-motion, or some combination of both—seems effortless, and yet often involves disentangling a complex web of motion signals. Existing literature focuses on either translational motion (heading) or eye movements, leaving much to be learnt about the influence of a wider range of self-motions, such as active head rotations, on visual motion perception. This study investigated how active head rotations affect visual motion detection thresholds, comparing conditions where visual motion and head-turn direction were either congruent or incongruent. Participants judged the direction of a visual motion stimulus while rotating their head or remaining stationary, using a fixation-locked Virtual Reality display with integrated head-movement recordings. Thresholds to perceive visual motion were higher in both active-head rotation conditions compared to stationary, though no differences were found between congruent or incongruent conditions. Participants also showed a significant bias to report seeing visual motion travelling in the same direction as the head rotation. Together, these results demonstrate active head rotations increase visual motion perceptual thresholds, particularly in cases of incongruent visual and active vestibular stimulation.

show abstract

“…2012 , Dupin and Wexler 2013 , Garzorz et al. 2018 , Britton and Arshad 2019 , Xing and Saunders 2022 , Zeng et al. 2023 ).…”

Section: Discussionmentioning

confidence: 99%

“…2006 , reviewed in DeAngelis and Angelaki 2012 ). Heading refers to the perceived direction of one’s translation, with the resulting global visual motion signal arising from relative motion of objects in the scene known as optic flow ( Britton and Arshad 2019 , Zeng et al. 2023 ).…”

Section: Introductionmentioning

confidence: 99%

Incongruent active head rotations increase visual motion detection thresholds

Pickard,

Davidson,

Kim

et al. 2024

Neuroscience of Consciousness

View full text Add to dashboard Cite

show abstract

“…This classic task has been used for a comparative understanding of human and non-human primate self-motion perception, and is well suited for the investigation of its neurophysiological correlates, through invasive recordings in trained macaque monkeys (see also Zeng et al . [ 17 ]).…”

Section: Visual-vestibular Integration: Raison D'être ...mentioning

confidence: 99%

Self-motion perception and sequential decision-making: where are we heading?

Jerjian,

Harsch,

Fetsch

2023

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

To navigate and guide adaptive behaviour in a dynamic environment, animals must accurately estimate their own motion relative to the external world. This is a fundamentally multisensory process involving integration of visual, vestibular and kinesthetic inputs. Ideal observer models, paired with careful neurophysiological investigation, helped to reveal how visual and vestibular signals are combined to support perception of linear self-motion direction, or heading. Recent work has extended these findings by emphasizing the dimension of time, both with regard to stimulus dynamics and the trade-off between speed and accuracy. Both time and certainty—i.e. the degree of confidence in a multisensory decision—are essential to the ecological goals of the system: terminating a decision process is necessary for timely action, and predicting one's accuracy is critical for making multiple decisions in a sequence, as in navigation. Here, we summarize a leading model for multisensory decision-making, then show how the model can be extended to study confidence in heading discrimination. Lastly, we preview ongoing efforts to bridge self-motion perception and navigation per se , including closed-loop virtual reality and active self-motion. The design of unconstrained, ethologically inspired tasks, accompanied by large-scale neural recordings, raise promise for a deeper understanding of spatial perception and decision-making in the behaving animal. This article is part of the theme issue ‘Decision and control processes in multisensory perception’.

show abstract

“…Zeng et al. [ 3 ] review basic elements of ‘multisensory decision making’ as a novel application of perceptual decision frameworks (e.g. signal detection theory and evidence accumulation/drift-diffusion) in a multisensory context.…”

Section: Overview Of the Theme Issuementioning

confidence: 99%

How the brain controls decision making in a multisensory world

Fetsch,

Noppeney

2023

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

Sensory systems evolved to provide the organism with information about the environment to guide adaptive behaviour. Neuroscientists and psychologists have traditionally considered each sense independently, a legacy of Aristotle and a natural consequence of their distinct physical and anatomical bases. However, from the point of view of the organism, perception and sensorimotor behaviour are fundamentally multi-modal; after all, each modality provides complementary information about the same world. Classic studies revealed much about where and how sensory signals are combined to improve performance, but these tended to treat multisensory integration as a static, passive, bottom-up process. It has become increasingly clear how this approach falls short, ignoring the interplay between perception and action, the temporal dynamics of the decision process and the many ways by which the brain can exert top-down control of integration. The goal of this issue is to highlight recent advances on these higher order aspects of multisensory processing, which together constitute a mainstay of our understanding of complex, natural behaviour and its neural basis. This article is part of the theme issue ‘Decision and control processes in multisensory perception’.

show abstract

Visuo-vestibular heading perception: a model system to study multi-sensory decision making

Cited by 4 publications

References 130 publications

Incongruent active head rotations increase visual motion detection thresholds

Incongruent active head rotations increase visual motion detection thresholds

Self-motion perception and sequential decision-making: where are we heading?

How the brain controls decision making in a multisensory world

Contact Info

Product

Resources

About