The brain integrates the signals it receives from its different senses, thereby improving its perception of environmental events (Stein & Meredith, 1993). This process is highly effective in a variety of circumstances, and many suggest it operates in an optimal way in order to make best use of all available sensory information (Alais & Burr, 2004;Battaglia et al., 2003;Ernst & Banks, 2002;Shams et al., 2005). Supporting this idea are the many studies demonstrating that events providing spatiotemporally aligned auditory and visual stimuli are detected more rapidly and are localized far more accurately and reliably than those in which only one of those stimuli is

Concordant visual–auditory stimuli enhance the responses of individual superior colliculus (SC) neurons. This neuronal capacity for “multisensory integration” is not innate: it is acquired only after substantial cross-modal (e.g. auditory–visual) experience. Masking transient auditory cues by raising animals in omnidirectional sound (“noise-rearing”) precludes their ability to obtain this experience and the ability of the SC to construct a normal multisensory (auditory–visual) transform. SC responses to combinations of concordant visual–auditory stimuli are depressed, rather than enhanced. The present experiments examined the behavioral consequence of this rearing condition in a simple detection/localization task. In the first experiment, the auditory component of the concordant cross-modal pair was novel, and only the visual stimulus was a target. In the second experiment, both component stimuli were targets. Noise-reared animals failed to show multisensory performance benefits in either experiment. These results reveal a close parallel between behavior and single neuron physiology in the multisensory deficits that are induced when noise disrupts early visual–auditory experience.

The multisensory (deep) layers of the superior colliculus (SC) play an important role in detecting, localizing, and guiding orientation responses to salient events in the environment. Essential to this role is the ability of SC neurons to enhance their responses to events detected by more than one sensory modality and to become desensitized (‘attenuated’ or ‘habituated’) or sensitized (‘potentiated’) to events that are predictable via modulatory dynamics. To identify the nature of these modulatory dynamics, we examined how the repetition of different sensory stimuli affected the unisensory and multisensory responses of neurons in the cat SC. Neurons were presented with 2HZ stimulus trains of three identical visual, auditory, or combined visual–auditory stimuli, followed by a fourth stimulus that was either the same or different (‘switch’). Modulatory dynamics proved to be sensory-specific: they did not transfer when the stimulus switched to another modality. However, they did transfer when switching from the visual–auditory stimulus train to either of its modality-specific component stimuli and vice versa. These observations suggest that predictions, in the form of modulatory dynamics induced by stimulus repetition, are independently sourced from and applied to the modality-specific inputs to the multisensory neuron. This falsifies several plausible mechanisms for these modulatory dynamics: they neither produce general changes in the neuron’s transform, nor are they dependent on the neuron’s output.

No abstract