Auditory capture of vision: examining temporal ventriloquism

Morein‐Zamir, Sharon; Soto‐Faraco, Salvador; Kingstone, Alan

doi:10.1016/s0926-6410(03)00089-2

Cited by 404 publications

(383 citation statements)

References 24 publications

Supporting

Mentioning

341

Contrasting

Unclassified

Order By: Relevance

“…Because in our experiment we asked participants to compare crossmodally-defined empty intervals to filled auditory intervals, we have been able to limit the influence of possible biases such as temporal shrinking (Nakajima et al, 1991cited in Nakajima et al, 2004Sasaki et al, 2002), temporal stretching (Sasaki et al, 2010), and temporal ventriloquism effects (Morein-Zamir, 2003). The psychophysical findings on duration perception of crossmodally-defined intervals in our study are overall consistent with previous work (i.e., Grondin & Rousseau, 1991).…”

Section: Discussionsupporting

confidence: 90%

“…The filled interval was a continuous sound that lasted for 30%, 60%, 80%, 100%, 120%, 140%, and 170% of the duration of the empty interval. We used the combination of empty and filled intervals within a trial to control for perceptual time perception biases such as temporal shrinking (Nakajima, ten Hoopen, & van der Wilk, 1991cited in Nakajima et al, 2004Sasaki, Suetomi, Nakajima, & ten Hoopen, 2002), temporal stretching (Sasaki et al, 2010) or temporal ventriloquism (Morein-Zamir, 2003) which were likely to occur if we had asked participants to compare two empty intervals. Temporal shrinking refers to a perceptual bias that occurs when a train of three or four brief signals are presented.…”

Section: Methodsmentioning

confidence: 99%

“…Therefore, we chose a paradigm consisting of both an empty and a filled interval on a single trial. Temporal ventriloquism (Morein-Zamir, 2003) refers to a perceptual bias that occurs when auditory and visual signals are presented in succession. Morein-Zamir (2003) asked participants to judge which of two light flashes was presented first.…”

Section: Methodsmentioning

confidence: 99%

“…Temporal ventriloquism (Morein-Zamir, 2003) refers to a perceptual bias that occurs when auditory and visual signals are presented in succession. Morein-Zamir (2003) asked participants to judge which of two light flashes was presented first. Sensitivity decreased significantly when task-irrelevant clicks were presented before the first and after the second light flash.…”

Section: Methodsmentioning

confidence: 99%

See 3 more Smart Citations

Duration perception in crossmodally-defined intervals

2014

View full text Add to dashboard Cite

How humans perform duration judgments with multisensory stimuli is an ongoing debate. Here, we investigated how sub-second duration judgments are achieved by asking participants to compare the duration of a continuous sound to the duration of an empty interval in which onset and offset were marked by signals of different modalities using all combinations of visual, auditory and tactile stimuli. The pattern of perceived durations across five stimulus durations (ranging from 100 ms to 900 ms) follows the Vierordt Law. Furthermore, intervals with a sound as onset (audio-visual, audio-tactile) are perceived longer than intervals with a sound as offset. No modality ordering effect is found for visualtactile intervals. To infer whether a single modality-independent or multiple modalitydependent time-keeping mechanisms exist we tested whether perceived duration follows a summative or a multiplicative distortion pattern by fitting a model to all modality combinations and durations. The results confirm that perceived duration depends on sensory latency (summative distortion). Instead, we did not find evidence for multiplicative distortions. The results of the model and the behavioural data support the concept of a single time-keeping mechanism that allows for judgments of durations marked by multisensory stimuli.

show abstract

Section: Discussionsupporting

confidence: 90%

Section: Methodsmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

See 2 more Smart Citations

Duration perception in crossmodally-defined intervals

2014

View full text Add to dashboard Cite

show abstract

“…The most common methods require that participants report either the order of two events (a temporal order judgement; TOJ) or whether two or more events occurred synchronously or asynchronously (a simultaneity judgement; SJ). Intriguingly, when brief auditory and visual stimuli are repeatedly presented slightly out of synch during a period of adaptation, participants subsequently change their judgements in these tasks, consistent with their having developed a new opinion about the most synchronous relationship (Fujisaki, Shimojo, Kashino, & Nishida, 2004;Vroomen, Keetels, de Gelder, & Bertelson, 2004 Faraco, & Kingstone, 2003;Roseboom, Nishida, & Arnold, 2009;Scheier, Nijhawan, & Shimojo, 1999). In combination, these findings suggest that multi-sensory events adjudged likely to be related, either because of experience or because they are the only two events present, tend to be grouped perceptually across greater physical timing differences than other sensory signals.…”

Section: Introductionmentioning

confidence: 87%

Sensorimotor temporal recalibration within and across limbs.

Yarrow

Sverdrup-Stueland

Roseboom

et al. 2013

Journal of Experimental Psychology: Human Perception and Perfor

View full text Add to dashboard Cite

This is the unspecified version of the paper.This version of the publication may differ from the final published version. Permanent repository link AbstractDeciding precisely when we have acted is challenging, as actions involve a train of neural events spread across both space and time. Repeated delays between actions and consequent events can result in a shift, such that immediate feedback can seem to precede the causative act. Here we examined which neurocognitive representations are affected during such sensorimotor temporal recalibration, by testing if the effect generalises across limbs, and whether it might reflect altered decision criteria for temporal judgements. Hand or foot adaptation phases were interspersed with simultaneity judgements about actions involving the same or opposite limb. Shifts in the distribution of participants' simultaneity responses were quantified using a detection-theoretic model, where a shift of both boundaries together gives a stronger indication that the effect is not simply a result of decision bias. By demonstrating that temporal recalibration occurs in the foot as well as the hand, we confirmed that it is a robust motor phenomenon:Both low and high boundaries shifted reliably in the same-limb conditions. However, in cross-limb conditions only the high boundary shifted reliably. These two patterns are interpreted to reflect a genuine change in how the time of action is represented, and a timing criterion shift, respectively.Keywords: Temporal recalibration, temporal judgement, adaptation, synchrony, action 4 Consider a falling apple. Our subjective experience of this well-known prompt for scientific insight is seamless and unified; the apple appears to fall as a coherent composite of colour, form and motion, before striking the ground with a dull thud. However, from the perspective of a homunculus (or indeed a neuroscientist) looking down upon the brain's activity in response to this sequence of events, the view is of a time-smeared and spatially distributed cacophony of electro-chemical signalling. This viewpoint leaves us wondering how the observer is able to decide with confidence that this particular auditory thud occurred at the same time as that particular visual collision.Science has not yet provided a compelling answer to this question. There is, however, evidence to suggest that recent experience plays an important role, or, put another way, that the temporal relationships that constitute simultaneity can be learnt and relearnt. Several methods exist to try and establish the relative time at which two events appear maximally synchronous (known as the point of subjective simultaneity or PSS). The most common methods require that participants report either the order of two events (a temporal order judgement; TOJ) or whether two or more events occurred synchronously or asynchronously (a simultaneity judgement; SJ). Intriguingly, when brief auditory and visual stimuli are repeatedly presented slightly out of synch during a period of adaptation, participants subsequen...

show abstract

The Role of Stimulus Properties and Cognitive Processes in the Quality of the Multisensory Perception of Synchrony

Vatakis

2013

Handbook of Experimental Phenomenology

View full text Add to dashboard Cite

Auditory capture of vision: examining temporal ventriloquism

Cited by 404 publications

References 24 publications

Duration perception in crossmodally-defined intervals

Duration perception in crossmodally-defined intervals

Sensorimotor temporal recalibration within and across limbs.

The Role of Stimulus Properties and Cognitive Processes in the Quality of the Multisensory Perception of Synchrony

Contact Info

Product

Resources

About