Multisensory Integration for Self-Motion Perception

Hou, Han; Gu, Yong

doi:10.1016/b978-0-12-809324-5.23879-0

Cited by 3 publications

(2 citation statements)

References 198 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Indeed, firing rate of LIP neurons in the bimodal condition is not a simple straight summation of the responses in unisensory conditions. These results are seemingly consistent with the prediction of temporally reweighting DDM [37,95]. If so, how is the moment-by-moment cue reliability tracking biologically implemented?…”

Section: Correlations Between Neural Activity and Multi-sensory Decis...supporting

confidence: 85%

Visuo-vestibular heading perception: a model system to study multi-sensory decision making

Zeng,

Zhang,

2023

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

Integrating noisy signals across time as well as sensory modalities, a process named multi-sensory decision making (MSDM), is an essential strategy for making more accurate and sensitive decisions in complex environments. Although this field is just emerging, recent extraordinary works from different perspectives, including computational theory, psychophysical behaviour and neurophysiology, begin to shed new light onto MSDM. In the current review, we focus on MSDM by using a model system of visuo-vestibular heading. Combining well-controlled behavioural paradigms on virtual-reality systems, single-unit recordings, causal manipulations and computational theory based on spiking activity, recent progress reveals that vestibular signals contain complex temporal dynamics in many brain regions, including unisensory, multi-sensory and sensory-motor association areas. This challenges the brain for cue integration across time and sensory modality such as optic flow which mainly contains a motion velocity signal. In addition, new evidence from the higher-level decision-related areas, mostly in the posterior and frontal/prefrontal regions, helps revise our conventional thought on how signals from different sensory modalities may be processed, converged, and moment-by-moment accumulated through neural circuits for forming a unified, optimal perceptual decision. This article is part of the theme issue ‘Decision and control processes in multisensory perception’.

show abstract

Section: Correlations Between Neural Activity and Multi-sensory Decis...supporting

confidence: 85%

Visuo-vestibular heading perception: a model system to study multi-sensory decision making

Zeng,

Zhang,

2023

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

show abstract

“…These empirical observations lead to the conjecture of a network-level operation that may account for the inconsistencies between theory and empirical observations. And in turn, this circuit property (i.e., divisive normalization) was able not only to account for population-level responses in cortex but also to incorporate traditional properties of single neurons in subcortex (see Fetsch et al 2013 andGu 2020 for insightful reviews).…”

Section: Neural Instantiation Of Bayes Optimal Cue Fusionmentioning

confidence: 99%

Cognitive, Systems, and Computational Neurosciences of the Self in Motion

Noel

Angelaki

2022

Annu. Rev. Psychol.

View full text Add to dashboard Cite

Navigating by path integration requires continuously estimating one's self-motion. This estimate may be derived from visual velocity and/or vestibular acceleration signals. Importantly, these senses in isolation are ill-equipped to provide accurate estimates, and thus visuo-vestibular integration is an imperative. After a summary of the visual and vestibular pathways involved, the crux of this review focuses on the human and theoretical approaches that have outlined a normative account of cue combination in behavior and neurons, as well as on the systems neuroscience efforts that are searching for its neural implementation. We then highlight a contemporary frontier in our state of knowledge: understanding how velocity cues with time-varying reliabilities are integrated into an evolving position estimate over prolonged time periods. Further, we discuss how the brain builds internal models inferring when cues ought to be integrated versus segregated—a process of causal inference. Lastly, we suggest that the study of spatial navigation has not yet addressed its initial condition: self-location. Expected final online publication date for the Annual Review of Psychology, Volume 73 is January 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

show abstract

From Multisensory Integration to Multisensory Decision-Making

Zheng,

2024

Advances in Experimental Medicine and Biology

View full text Add to dashboard Cite

Multisensory Integration for Self-Motion Perception

Cited by 3 publications

References 198 publications

Visuo-vestibular heading perception: a model system to study multi-sensory decision making

Visuo-vestibular heading perception: a model system to study multi-sensory decision making

Cognitive, Systems, and Computational Neurosciences of the Self in Motion

From Multisensory Integration to Multisensory Decision-Making

Contact Info

Product

Resources

About