Integration of Visual and Auditory Information by Superior Temporal Sulcus Neurons Responsive to the Sight of Actions

Barraclough, Nick E.; Xiao, Dongping; Baker, Chris I.; Oram, Mike W.; Perrett, David I.

doi:10.1162/0898929053279586

Cited by 308 publications

(270 citation statements)

References 65 publications

Supporting

Mentioning

233

Contrasting

Unclassified

Order By: Relevance

“…This is the prevalent signature of multisensory integration in VIP cells, in agreement with many other reports: in the SC of anesthetized (Meredith and Stein, 1983) and awake (Wallace et al, 1998;Populin and Yin, 2002) cats, in the cat (Wallace et al, 1992) and monkey (Barraclough et al, 2005) cortex, and in local field potential signals (Ghazanfar et al, 2005). Enhancement is usually described as more common than depression (Meredith and Stein, 1983;Perrault et al, 2003;Ghazanfar et al, 2005).…”

Section: Discharge Rate Depression and Enhancementsupporting

confidence: 91%

Multisensory Integration in the Ventral Intraparietal Area of the Macaque Monkey

Avillac¹,

Hamed²,

Duhamel³

2007

J. Neurosci.

247

205

View full text Add to dashboard Cite

The goal of this study was to characterize multisensory interaction patterns in cortical ventral intraparietal area (VIP). We recorded single-unit activity in two alert monkeys during the presentation of visual (drifting gratings) and tactile (low-pressure air puffs) stimuli. One stimulus was always positioned inside the receptive field of the neuron. The other stimulus was defined so as to manipulate the spatial and temporal disparity between the two stimuli. More than 70% of VIP cells showed a significant modulation of their response by bimodal stimulations. These cells included both bimodal cells, i.e., cells responsive to both tested modalities, and seemingly unimodal cells, i.e., cells responding to only one of the two tested modalities. This latter observation suggests that postsynaptic latent mechanisms are involved in multisensory integration. In both cell categories, neuronal responses are either enhanced or depressed and reflect nonlinear sub-, super-, or additive mechanisms. The occurrence of these observations is maximum when stimuli are in temporal synchrony and spatially congruent. Interestingly, introducing spatial or temporal disparities between stimuli does not affect the sign or the magnitude of interactions but rather their occurrence. Multisensory stimulation also affects the neuronal response latencies of bimodal stimuli. For a given neuron, these are on average intermediate between the two unimodal response latencies, again suggesting latent postsynaptic mechanisms. In summary, we show that the majority of VIP neurons perform multisensory integration, following general rules (e.g., spatial congruency and temporal synchrony) that are closely similar to those described in other cortical and subcortical regions.

show abstract

Section: Discharge Rate Depression and Enhancementsupporting

confidence: 91%

Multisensory Integration in the Ventral Intraparietal Area of the Macaque Monkey

Avillac¹,

Hamed²,

Duhamel³

2007

J. Neurosci.

247

205

View full text Add to dashboard Cite

show abstract

“…This impact of AVC was systematically contralateral to the peripheral stimuli, ruling out nonspecific explanations such as higher arousal in one condition than another. Contralateral preferences for STS accord with some animal single-cell work (Barraclough et al, 2005).…”

Section: Discussionmentioning

confidence: 61%

“…A role for STS in audiovisual integration would accord generally with single-cell studies (Benevento et al, 1977;Bruce et al, 1981;Barraclough et al, 2005), lesion data (Petrides and Iversen, 1978), and other human neuroimaging work (Miller and D'Esposito, 2005;van Atteveldt et al, 2006;Watkins et al, 2006) that typically used more complex or semantic stimuli than here. However, to our knowledge, no previous human study has observed the systematic contralaterality found here, nor the clear effects on primary visual and auditory cortex in addition to mSTS, attributable solely to temporal correspondence between simple flashes and beeps (although for potentially related monkey A1 studies, see Ghazanfar et al, 2005;Lakatos et al, 2007), nor the informative pattern of functional coupling that we observed.…”

Section: Activation Of Contralateral Human Msts By Audiovisual Tempormentioning

confidence: 55%

Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices

Noesselt

Rieger²,

Schoenfeld³

et al. 2007

J. Neurosci.

264

235

View full text Add to dashboard Cite

The brain should integrate related but not unrelated information from different senses. Temporal patterning of inputs to different modalities may provide critical information about whether those inputs are related or not. We studied effects of temporal correspondence between auditory and visual streams on human brain activity with functional magnetic resonance imaging (fMRI). Streams of visual flashes with irregularly jittered, arrhythmic timing could appear on right or left, with or without a stream of auditory tones that coincided perfectly when present (highly unlikely by chance), were noncoincident with vision (different erratic, arrhythmic pattern with same temporal statistics), or an auditory stream appeared alone. fMRI revealed blood oxygenation level-dependent (BOLD) increases in multisensory superior temporal sulcus (mSTS), contralateral to a visual stream when coincident with an auditory stream, and BOLD decreases for noncoincidence relative to unisensory baselines. Contralateral primary visual cortex and auditory cortex were also affected by audiovisual temporal correspondence or noncorrespondence, as confirmed in individuals. Connectivity analyses indicated enhanced influence from mSTS on primary sensory areas, rather than vice versa, during audiovisual correspondence. Temporal correspondence between auditory and visual streams affects a network of both multisensory (mSTS) and sensory-specific areas in humans, including even primary visual and auditory cortex, with stronger responses for corresponding and thus related audiovisual inputs.

show abstract

“…The STS regions play a clear role in human voice perception in particular and social cognition in general (Allison et al 2000). Evidence in the macaque shows that these regions also contain neurons selectively tuned to faces (Perrett et al 1992) and to sounds of actions (Barraclough et al 2005 suggest that some of these STS regions (particularly, area TAa) may send direct projections to the auditory prefrontal domain identified in the macaque brain (L. M. Romanski 2006, personal communication), further suggesting that STS regions would be particularly well suited to combine information from vocalizations and face displays, and yield a supra-modal representation of conspecific individuals. A second important conclusion relates to the patterns of functional lateralization.…”

Section: Discussionmentioning

confidence: 99%

Voice processing in human and non-human primates

Belin

2006

Phil. Trans. R. Soc. B

138

View full text Add to dashboard Cite

Humans share with non-human primates a number of voice perception abilities of crucial importance in social interactions, such as the ability to identify a conspecific individual from its vocalizations. Speech perception is likely to have evolved in our ancestors on the basis of pre-existing neural mechanisms involved in extracting behaviourally relevant information from conspecific vocalizations (CVs). Studying the neural bases of voice perception in primates thus not only has the potential to shed light on cerebral mechanisms that may be-unlike those involved in speech perception-directly homologous between species, but also has direct implications for our understanding of how speech appeared in humans. In this comparative review, we focus on behavioural and neurobiological evidence relative to two issues central to voice perception in human and non-human primates: (i) are CVs 'special', i.e. are they analysed using dedicated cerebral mechanisms not used for other sound categories, and (ii) to what extent and using what neural mechanisms do primates identify conspecific individuals from their vocalizations?

show abstract

Integration of Visual and Auditory Information by Superior Temporal Sulcus Neurons Responsive to the Sight of Actions

Cited by 308 publications

References 65 publications

Multisensory Integration in the Ventral Intraparietal Area of the Macaque Monkey

Multisensory Integration in the Ventral Intraparietal Area of the Macaque Monkey

Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices

Voice processing in human and non-human primates

Contact Info

Product

Resources

About