Multisensory Integration of Looming Signals by Rhesus Monkeys

Maier, Joost X.; Neuhoff, John G.; Logothetis, Nikos K.; Ghazanfar, Asif A.

doi:10.1016/j.neuron.2004.06.027

Cited by 148 publications

(165 citation statements)

References 33 publications

Supporting

Mentioning

144

Contrasting

Order By: Relevance

“…The multisensory interaction demonstrated in our study almost certainly does not arise from sensory-neural convergence of auditory and visual signals, i.e., the kind of convergence that has been well-established in single-cell sensory neurophysiology (51)(52)(53) and in human brain imaging (54). Instead, the interactions implicated in our study more likely entail information combination of the sort discussed in the context of cue combination across modalities (55,56).…”

Section: Discussionsupporting

confidence: 47%

Melodic sound enhances visual awareness of congruent musical notes, but only if you can read music

Lee

Blake

Kim

et al. 2015

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

Predictive influences of auditory information on resolution of visual competition were investigated using music, whose visual symbolic notation is familiar only to those with musical training. Results from two experiments using different experimental paradigms revealed that melodic congruence between what is seen and what is heard impacts perceptual dynamics during binocular rivalry. This bisensory interaction was observed only when the musical score was perceptually dominant, not when it was suppressed from awareness, and it was observed only in people who could read music. Results from two ancillary experiments showed that this effect of congruence cannot be explained by differential patterns of eye movements or by differential response sluggishness associated with congruent score/melody combinations. Taken together, these results demonstrate robust audiovisual interaction based on high-level, symbolic representations and its predictive influence on perceptual dynamics during binocular rivalry.music | binocular rivalry | multisensory interaction | visual awareness | audio-visual congruence V ision can be confusing, particularly when the retinal images inaugurating vision are ambiguous or underspecified with respect to their origins (1, 2). In some situations, confusion can be resolved by reliance on contextual information (3), prior experience (4), expectations (5), and/or implicit knowledge about structural regularities in our visual environment (6). In other situations, however, confusion resists resolution, in which case one can directly experience the dynamical nature of competition as conflicting perceptual interpretations vie for dominance (7). Among the visual phenomena exhibiting this behavior, none is more compelling than binocular rivalry (8).When the two eyes view dissimilar monocular stimuli, stable binocular single vision gives way to interocular competition, characterized by unpredictable fluctuations in visual awareness of the rival stimuli (9, 10). Rivalry offers a way to study the inferential nature of perception when the brain is confronted with conflicting sensory evidence (11,12). Within this context, recent studies imply that rivalry dynamics are governed by influences related to the likelihood of competing perceptual interpretations, such as motor actions (13), affective connotation (14-16), familiarity (17), and concomitant sensory input from other modalities (18-20). Here we examined the limits of susceptibility of rivalry to predictive influences by asking whether binocular rivalry dynamics depend on multisensory congruence between abstract representations familiar to individuals with expertise in that domain of abstraction. The domain we selected was music, for three reasons: (i) musical notation is symbolic; (ii) only people versed in music can decipher that notation; and (iii) melodic structure can be experienced via sight or sound. ResultsExperiment 1: Extended Tracking of Binocular Rivalry. Experiment 1 was implemented as a conventional binocular rivalry task in which participants...

show abstract

Section: Discussionsupporting

confidence: 47%

Melodic sound enhances visual awareness of congruent musical notes, but only if you can read music

Lee

Blake

Kim

et al. 2015

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

show abstract

“…Ethologically, a role in alertness for dangerous stimuli is highly probable, an interpretation that can also be attributed to the visuo-somatosensory projections: the specific link between the FST visual complex and the representation of the face in the somatosensory cortex could contribute to phenomena of avoidance of a ''dangerous" stimulus which may hit the body Graziano, 2003, 2004). More recently, there is also evidence for selective interactions between auditory-visual cues signaling approach or looming (Maier et al, 2004(Maier et al, , 2008Cappe et al, 2009b).…”

Section: Specificity Of Heteromodal Connections: Ethological Rolementioning

confidence: 99%

Multisensory anatomical pathways

2009

View full text Add to dashboard Cite

In order to interact with the multisensory world that surrounds us, we must integrate various sources of sensory information (vision, hearing, touch. . .). A fundamental question is thus how the brain integrates the separate elements of an object defined by several sensory components to form a unified percept. The superior colliculus was the main model for studying multisensory integration. At the cortical level, until recently, multisensory integration appeared to be a characteristic attributed to high-level association regions. First, we describe recently observed direct cortico-cortical connections between different sensory cortical areas in the non-human primate and discuss the potential role of these connections. Then, we show that the projections between different sensory and motor cortical areas and the thalamus enabled us to highlight the existence of thalamic nuclei that, by their connections, may represent an alternative pathway for information transfer between different sensory and/or motor cortical areas. The thalamus is in position to allow a faster transfer and even an integration of information across modalities. Finally, we discuss the role of these non-specific connections regarding behavioral evidence in the monkey and recent electrophysiological evidence in the primary cortical sensory areas.

show abstract

“…Prior studies have reported results for a variety of auditory phenomena including intensity discrimination ͑Schlauch et al, 1998͒, subjective duration ͑DiGiovanni and Schlauch, 2007;Grassi and Darwin, 2006;Schlauch et al, 2001a, 2001b͒, loudness ͑Irino and Patterson, 1996Neuhoff 1998Neuhoff , 2001Maier et al, 2004;Stecker and Hafter, 2000͒, and tonality ͑Patterson, 1994a. All of these studies, except that on intensity discrimination ͑Schlauch et al, 1998͒, report perceptual differences between ramped and damped stimuli of the same physical duration.…”

Section: Introductionmentioning

confidence: 99%

The role of temporal-masking patterns in the determination of subjective duration and loudness for ramped and damped sounds

Ries

Schlauch

DiGiovanni

2008

The Journal of the Acoustical Society of America

View full text Add to dashboard Cite

The association between temporal-masking patterns, duration, and loudness for broadband noises with ramped and damped envelopes was examined. Duration and loudness matches between the ramped and damped sounds differed significantly. Listeners perceived the ramped stimuli to be longer and louder than the damped stimuli, but the outcome was biased by the stimulus context. Next, temporal-masking patterns were measured for ramped-and damped-broadband noises using three ͑0.5, 1.5, and 4.0 kHz͒ 10 ms probe tones presented individually at various temporal delays. Predictions of subjective duration derived from masking results underpredicted the matching results. Loudness estimates derived from models that assume persistence of neural activity after stimulus offset ͓Glasberg B. R., and Moore, B. C. J. ͑2002͒. "A model of loudness applicable to time-varying sounds," J. Audio. Eng. Soc. 50, 331-341; Chalupper, J., and Fastl, H. ͑2002͒ "Dynamic loudness model ͑DLM͒ for normal and hearing-impaired listeners," Acust. Acta Acust. 88, 378-386͔ were greater for ramped sounds than for damped sounds and were close to the average results obtained via the matching task. Differences in simultaneous-masked thresholds for these stimuli could not account for the loudness-matching results. Decay suppression of the later occurring portion of the damped stimulus may account for the differences in perception due to the stimulus context; however, a parsimonious implementation of this process that accounts for both subjective duration and loudness judgments remains unclear.

show abstract

Multisensory Integration of Looming Signals by Rhesus Monkeys

Cited by 148 publications

References 33 publications

Melodic sound enhances visual awareness of congruent musical notes, but only if you can read music

Melodic sound enhances visual awareness of congruent musical notes, but only if you can read music

Multisensory anatomical pathways

The role of temporal-masking patterns in the determination of subjective duration and loudness for ramped and damped sounds

Contact Info

Product

Resources

About