A Psychophysical Investigation of Differences between Synchrony and Temporal Order Judgments

Love, Scott; Petrini, Karin; Cheng, Adam; Pollick, Frank E.

doi:10.1371/journal.pone.0054798

Cited by 92 publications

(157 citation statements)

References 45 publications

(139 reference statements)

Supporting

Mentioning

129

Contrasting

Order By: Relevance

“…The recalibration magnitude as well as the PSS obtained in the pretest are well in line with previous reports using a SJ task, in which perception of simultaneity tolerates greater vision leading auditory asynchronies [3], [6], [8], [33]–[35]. Remarkably, the present data demonstrate that, under conditions of multiple possible pairings in time, selective attention to particular stimuli during the adaptation can be effective to induce a PSS shift (attend leading vs. attend lagging flash).…”

Section: Discussionsupporting

confidence: 92%

Selective Attention Modulates the Direction of Audio-Visual Temporal Recalibration

Ikumi

Soto‐Faraco

2014

PLoS ONE

View full text Add to dashboard Cite

Temporal recalibration of cross-modal synchrony has been proposed as a mechanism to compensate for timing differences between sensory modalities. However, far from the rich complexity of everyday life sensory environments, most studies to date have examined recalibration on isolated cross-modal pairings. Here, we hypothesize that selective attention might provide an effective filter to help resolve which stimuli are selected when multiple events compete for recalibration. We addressed this question by testing audio-visual recalibration following an adaptation phase where two opposing audio-visual asynchronies were present. The direction of voluntary visual attention, and therefore to one of the two possible asynchronies (flash leading or flash lagging), was manipulated using colour as a selection criterion. We found a shift in the point of subjective audio-visual simultaneity as a function of whether the observer had focused attention to audio-then-flash or to flash-then-audio groupings during the adaptation phase. A baseline adaptation condition revealed that this effect of endogenous attention was only effective toward the lagging flash. This hints at the role of exogenous capture and/or additional endogenous effects producing an asymmetry toward the leading flash. We conclude that selective attention helps promote selected audio-visual pairings to be combined and subsequently adjusted in time but, stimulus organization exerts a strong impact on recalibration. We tentatively hypothesize that the resolution of recalibration in complex scenarios involves the orchestration of top-down selection mechanisms and stimulus-driven processes.

show abstract

Section: Discussionsupporting

confidence: 92%

Selective Attention Modulates the Direction of Audio-Visual Temporal Recalibration

Ikumi

Soto‐Faraco

2014

PLoS ONE

View full text Add to dashboard Cite

show abstract

“…5A, B). Consistent with previous reports on TOJ paradigms (Love et al, 2013;Van Eijk et al, 2008), the average PSS value in the zero-lag adaptation condition (S) was biased towards sound-leading asynchronies: on average, participants required the auditory event to lead the visual event by 38 ms to consider them as simultaneous (Fig. 5B).…”

Section: Non-stationarity Of the Entrained Neural Oscillations Duringsupporting

confidence: 89%

Encoding of event timing in the phase of neural oscillations

2014

View full text Add to dashboard Cite

a b s t r a c t a r t i c l e i n f oTime perception is a critical component of conscious experience. To be in synchrony with the environment, the brain must deal not only with differences in the speed of light and sound but also with its computational and neural transmission delays. Here, we asked whether the brain could actively compensate for temporal delays by changing its processing time. Specifically, can changes in neural timing or in the phase of neural oscillation index perceived timing? For this, a lag-adaptation paradigm was used to manipulate participants' perceived audiovisual (AV) simultaneity of events while they were recorded with magnetoencephalography (MEG). Desynchronized AV stimuli were presented rhythmically to elicit a robust 1 Hz frequency-tagging of auditory and visual cortical responses. As participants' perception of AV simultaneity shifted, systematic changes in the phase of entrained neural oscillations were observed. This suggests that neural entrainment is not a passive response and that the entrained neural oscillation shifts in time. Crucially, our results indicate that shifts in neural timing in auditory cortices linearly map participants' perceived AV simultaneity. To our knowledge, these results provide the first mechanistic evidence for active neural compensation in the encoding of sensory event timing in support of the emergence of time awareness.

show abstract

“…The two procedures that have been used most often are the simultaneity judgment task and the temporal order judgment task. Although both of these tasks can assess an observer’s perception of the temporal synchrony of audiovisual stimuli, it is thought that these tasks reflect different underlying mechanisms (Vatakis et al, 2008b; Love et al, 2013) and may be subject to different kinds of response biases (Schneider and Bavelier, 2003; Vatakis and Spence, 2007; Vatakis et al, 2008b). …”

Section: Discussionmentioning

confidence: 99%

Audiovisual Temporal Processing and Synchrony Perception in the Rat

Schormans

Scott

et al. 2017

Front. Behav. Neurosci.

View full text Add to dashboard Cite

Extensive research on humans has improved our understanding of how the brain integrates information from our different senses, and has begun to uncover the brain regions and large-scale neural activity that contributes to an observer’s ability to perceive the relative timing of auditory and visual stimuli. In the present study, we developed the first behavioral tasks to assess the perception of audiovisual temporal synchrony in rats. Modeled after the parameters used in human studies, separate groups of rats were trained to perform: (1) a simultaneity judgment task in which they reported whether audiovisual stimuli at various stimulus onset asynchronies (SOAs) were presented simultaneously or not; and (2) a temporal order judgment task in which they reported whether they perceived the auditory or visual stimulus to have been presented first. Furthermore, using in vivo electrophysiological recordings in the lateral extrastriate visual (V2L) cortex of anesthetized rats, we performed the first investigation of how neurons in the rat multisensory cortex integrate audiovisual stimuli presented at different SOAs. As predicted, rats (n = 7) trained to perform the simultaneity judgment task could accurately (~80%) identify synchronous vs. asynchronous (200 ms SOA) trials. Moreover, the rats judged trials at 10 ms SOA to be synchronous, whereas the majority (~70%) of trials at 100 ms SOA were perceived to be asynchronous. During the temporal order judgment task, rats (n = 7) perceived the synchronous audiovisual stimuli to be “visual first” for ~52% of the trials, and calculation of the smallest timing interval between the auditory and visual stimuli that could be detected in each rat (i.e., the just noticeable difference (JND)) ranged from 77 ms to 122 ms. Neurons in the rat V2L cortex were sensitive to the timing of audiovisual stimuli, such that spiking activity was greatest during trials when the visual stimulus preceded the auditory by 20–40 ms. Ultimately, given that our behavioral and electrophysiological results were consistent with studies conducted on human participants and previous recordings made in multisensory brain regions of different species, we suggest that the rat represents an effective model for studying audiovisual temporal synchrony at both the neuronal and perceptual level.

show abstract

A Psychophysical Investigation of Differences between Synchrony and Temporal Order Judgments

Cited by 92 publications

References 45 publications

Selective Attention Modulates the Direction of Audio-Visual Temporal Recalibration

Selective Attention Modulates the Direction of Audio-Visual Temporal Recalibration

Encoding of event timing in the phase of neural oscillations

Audiovisual Temporal Processing and Synchrony Perception in the Rat

Contact Info

Product

Resources

About