Intersensory temporal synchrony is an ubiquitous sensory attribute that has proven to be critical for binding multisensory inputs, sometimes erroneously leading to dramatic perceptual illusions. However, little is known about how the brain detects temporal synchrony between multimodal sensory inputs. We used positron emission tomography to demonstrate that detecting auditory-visual stimulus onset asynchrony activates a large-scale neural network of insular, posterior parietal, prefrontal, and cerebellar areas with the highest and task-specific activity localized to the right insula. Interregional covariance analysis further showed significant task-related functional interactions between the insula, the posterior thalamus, and superior colliculus. Based on these results and the available electrophysiological and anatomical connectivity data in animals, we propose that the insula, via its known short-latency connections with the tectal system, mediates temporally defined auditory-visual interaction at an early stage of cortical processing permitting phenomena such as the ventriloquist and the McGurk illusions.Key words: audiovisual asynchrony; temporal integration; insular cortex; PET; multisensory; cortical processing A fundamental brain function is to integrate information available to multiple sensory modalities producing a unified representation of the external world. Although multimodal sensory inputs from a single object or event normally coincide both in space and time, intersensory integration mechanisms seem to rely more critically on their temporal than spatial congruence (e.g., the ventriloquist effect) (Bertelson and Radeau, 1981). Indeed, the ability to detect and use temporal synchrony in associating multimodal sensory stimuli (e.g., sounds and visual events) has been demonstrated in human infants as young as 2 months (Lewkowicz, 1996(Lewkowicz, , 2000, and is believed to be operational at birth providing an innate capacity on which intermodal perception and associative learning are based (Spelke, 1987;Bahrick, 1992). Yet, the neural correlates for this basic process remain unknown. Using positron emission tomography (PET), we studied normal human subjects while performing a task requiring detection of auditory-visual stimulus onset asynchrony as well as a matched control condition. The PET experiment was designed for both paired image subtraction and correlational analysis methods. Brain regions specifically involved in temporal synchrony-asynchrony detection process were postulated where regional cerebral blood flow (rCBF) responses during task performance are significantly higher than during the control condition and appropriately modulated as a function of increasing task demand.
MATERIALS AND METHODSSubjects. T welve right-handed healthy volunteers (seven men, five women, ages 27-56 years) participated in behavioral and PET experiments after giving written informed consent.Behavioral task s. Subjects' ability to detect intermodal temporal mismatch between simple stationary auditory and visual st...