Optimal integration of auditory and vibrotactile information for judgments of temporal order.

Ley, Ian; Haggard, Patrick; Yarrow, Kielan

doi:10.1037/a0015021

Cited by 22 publications

(23 citation statements)

References 46 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Our use of two concurrent stimuli, however, may have acted to decorrelate to some extent, the timing information at each ear, making the extraction of ITD cues for each stimulus unreliable (see Lee et al 2009;Rakerd and Hartmann 2010, but see also Schwartz et al 2012) and causing a down-weighting of the ITD cue relative to the ILD cue. This would be consistent with recent models of optimal cue integration in a variety of sensory systems which embody a Bayesian or BKalman filter^approach to optimize fusion of multiple cues that may vary in reliability (Ley et al 2009;Wozny and Shams 2011).…”

Section: Summary Of Findings In Spatial Coordinatessupporting

confidence: 85%

Six Degrees of Auditory Spatial Separation

Carlile

Fox

Orchard-Mills

et al. 2016

JARO

View full text Add to dashboard Cite

The location of a sound is derived computationally from acoustical cues rather than being inherent in the topography of the input signal, as in vision. Since Lord Rayleigh, the descriptions of that representation have swung between Blabeled line^and Bopponent process^models. Employing a simple variant of a twopoint separation judgment using concurrent speech sounds, we found that spatial discrimination thresholds changed nonmonotonically as a function of the overall separation. Rather than increasing with separation, spatial discrimination thresholds first declined as two-point separation increased before reaching a turning point and increasing thereafter with further separation. This Bdipper^function, with a minimum at 6°of separation, was seen for regions around the midline as well as for more lateral regions (30 and 45°). The discrimination thresholds for the binaural localization cues were linear over the same range, so these cannot explain the shape of these functions. These data and a simple computational model indicate that the perception of auditory space involves a local code or multichannel mapping emerging subsequent to the binaural cue coding.

show abstract

Section: Summary Of Findings In Spatial Coordinatessupporting

confidence: 85%

Six Degrees of Auditory Spatial Separation

Carlile

Fox

Orchard-Mills

et al. 2016

JARO

View full text Add to dashboard Cite

show abstract

“…This approach is commonly used (e.g. Ernst & Banks, 2002;Ley, Haggard, & Yarrow, 2009) in order to estimate the weight being assigned to each sensory modality, and thus provide a further means of assessing the predictions of weighted integration models.…”

Section: Discussionmentioning

confidence: 99%

Weighted integration suggests that visual and tactile signals provide independent estimates about duration.

Ball

Arnold

Yarrow

2017

Journal of Experimental Psychology: Human Perception and Perfor

Self Cite

View full text Add to dashboard Cite

This is the accepted version of the paper.This version of the publication may differ from the final published version. Copyright and reuse: City Research Online aims to make research outputs of City, University of London available to a wider audience. Copyright and Moral Rights remain with the author(s) and/or copyright holders. URLs from City Research Online may be freely distributed and linked to. City Research Online: http://openaccess.city.ac.uk/ publications@city.ac.uk Permanent repository link: City Research OnlineThe APA has copyright on this article. When published, it can be found at: improvements can be predicted quantitatively, assuming estimates are combined by summation, a process described as optimal when summation is weighted in accordance with the variance associated with each of the initially independent estimates. We assessed this possibility for visual and tactile information regarding temporal intervals. In Experiment 1, 12 musicians and 12 nonmusicians judged durations of 300 and 600 ms, compared to test values spanning these standards.Bimodal precision increased relative to unimodal conditions, but not by the extent predicted by optimally weighted summation. In Experiment 2, six musicians and six other participants each judged six standards, ranging from 100 ms to 600 ms, with conflicting cues providing a measure of the weight assigned to each sensory modality. A weighted integration model best fitted these data, with musicians more likely to select near-optimal weights than non-musicians. Overall, data were consistent with the existence of separate visual and tactile clock components at either the counter/integrator or memory stages. Independent estimates are passed to a decisional process, but not always combined in a statistically optimal fashion. Statement of public significanceWe are able to judge the duration of events as they unfold (e.g. the time for which somebody holds our gaze). Sometimes, this information is conveyed to several of our senses at once (e.g. both seeing and feeling the duration of a caress). Theorists argue about whether time intervals are calculated separately for each sense, or rely on a common centralised timer. This study suggests that when people experience the duration of events via both vision and touch, they gain a multisensory benefit, performing better than when they receive just visual or just tactile stimulation.This kind of benefit can only accrue if time is first estimated independently within each sense, suggesting that separate timers exist.Humans and other animals express their ability to time intervals through a wide variety of behaviours. In the lab, this ability is often assessed by requiring experimental participants to make judgments about the duration of events. However, our knowledge regarding the neurocognitive bases of these judgments remains hazy. One debate concerns the centralised versus distributed nature of the hypothetical internal clock or clocks (Ivry & Schlerf, 2008;Ivry & Spencer, 2004 Revina, Bruno, & Johnston, 2012;and Morgan...

show abstract

“…They found that abrupt sounds attract the onsets of lights if presented within a time window of~±200 ms from the flash. Using the same paradigm, temporal ventriloquism has also been demonstrated between the visual and tactile modalities, in which taps capture the onsets of visual stimuli (Keetels & Vroomen, 2008a, 2008b, and between the auditory and tactile modalities (Ley, Haggard & Yarrow, 2009;Wilson, Reed & Braida, 2009). …”

Section: Temporal Ventriloquism: Immediate Effectmentioning

confidence: 96%

“…The Bayesian approach has also been adopted to understand temporal ventriloquism (Burr et al, 2009;Hartcher-O'Brien & Alais, 2011;Ley et al, 2009;Shi et al, 2010). Interestingly, different from the findings in spatial ventriloquism, all these studies report that the quantitative fit (dominance of auditory over visual in temporal perception) was less perfect than predicted by maximum likelihood estimation, although temporal localization of audiovisual stimuli was better than for the visual sense alone.…”

Section: Bayesian Approachesmentioning

confidence: 99%

Intersensory binding across space and time: A tutorial review

Chen

Vroomen

2013

Atten Percept Psychophys

211

180

View full text Add to dashboard Cite

Spatial ventriloquism refers to the phenomenon that a visual stimulus such as a flash can attract the perceived location of a spatially discordant but temporally synchronous sound. An analogous example of mutual attraction between audition and vision has been found in the temporal domain, where temporal aspects of a visual event, such as its onset, frequency, or duration, can be biased by a slightly asynchronous sound. In this review, we examine various manifestations of spatial and temporal attraction between the senses (both direct effects and aftereffects), and we discuss important constraints on the occurrence of these effects. Factors that potentially modulate ventriloquism-such as attention, synesthetic correspondence, and other cognitive factors-are described. We trace theories and models of spatial and temporal ventriloquism, from the traditional unity assumption and modality appropriateness hypothesis to more recent Bayesian and neural network approaches. Finally, we summarize recent evidence probing the underlying neural mechanisms of spatial and temporal ventriloquism.

show abstract

Optimal integration of auditory and vibrotactile information for judgments of temporal order.

Cited by 22 publications

References 46 publications

Six Degrees of Auditory Spatial Separation

Six Degrees of Auditory Spatial Separation

Weighted integration suggests that visual and tactile signals provide independent estimates about duration.

Intersensory binding across space and time: A tutorial review

Contact Info

Product

Resources

About