26In our natural environment, the brain needs to combine signals from multiple sensory 27 modalities into a coherent percept. While spatial attention guides perceptual decisions by 28 prioritizing processing of signals that are task-relevant, expectations encode the event 29 probability over space. Previous studies have shown that behavioral effects of spatial 30 attention generalize across sensory modalities. However, because they manipulated spatial 31 attention as signal probability over space, these studies could not dissociate attention and 32 expectation.
33In two experiments, we orthogonally manipulated spatial attention (i.e., task-relevance) and 34 expectation (i.e., signal probability) selectively in one sensory modality (i.e., primary)
35(experiment 1: audition, experiment 2: vision) and assessed their effects on primary and 36 secondary sensory modalities where attention and expectation were held constant.
37Our results show behavioral effects of spatial attention and expectation that are comparable 38 for audition or vision as primary modalities; yet, spatial expectations were formed more 39 slowly in audition. Critically, spatial attention and expectation affected responses more 40 strongly in the primary modality where they were manipulated and generalized to the 41 secondary modality only in an attenuated fashion. Collectively, our results suggest that both 42 spatial attention and expectation rely on modality-specific and multisensory mechanisms. 43 44 Keywords 45 Multisensory, space, attention, expectation, perceptual inference 46 47 Public significance of the study 48 In our natural environment, our senses are bombarded with myriads of signals. How does the 49 brain allocate spatial attention and form spatial expectations across the senses? Previous 50 3 studies have shown that behavioral effects of spatial attention generalize across sensory 51modalities. Yet, these studies conflated attention and expectation, because they manipulated 52 spatial attention as signal probability over space.
53This psychophysics study orthogonally manipulated spatial attention (i.e., task-relevance) and 54 expectation (i.e., signal probability) selectively in the auditory (resp. visual) modality and 55 evaluated their effects on target detection in the visual modality (i.e., audition to vision) and 56 vice versa (i.e., vision to audition). We show that spatial attention and expectation operate 57 similarly in audition and vision; yet, spatial expectations are learnt more slowly in audition 58 than vision. Our results suggest that spatial attention and expectation rely on modality-59 specific and multisensory mechanisms that enable partial generalization from audition to 60 vision and vice versa.