SummaryThe recent visual past has a strong impact on our current perception. Recent studies of serial dependence in perception show that low-level adaptation repels our current perception away from previous stimuli1–5 whereas post-perceptual decision attracts perceptual report toward the immediate past6–12. In their studies, these repulsive and attractive biases were observed with different task demands perturbing ongoing sequential process. Therefore, it is unclear whether the opposite biases arise naturally in navigating complex real-life environments. Here we only manipulated the environmental statistics to characterize how serially dependent perceptual decisions unfold in spatiotemporally changing visual environments. During sequential mean orientation adjustment task on the array of Gabor patches, we found that the repulsion effect dominated only when ensemble variance increased across consecutive trials whereas the attraction effect prevailed when ensemble variance decreased or remained the same. The observed attractive bias by high- to-low-variance stimuli and repulsive bias by low-to-high-variance stimuli were reinforced by the repeated exposure to the low and the high ensemble variance, respectively. Further, this variance-dependent differential pattern of serial dependence in ensemble representation remained the same regardless of whether observers had a prior knowledge of environmental statistics or not. We used a Bayesian observer model constrained by visual adaptation13,14 to provide a unifying account of both attractive and repulsive bias in perception. Our results establish that the temporal integration and segregation of visual information is flexibly adjusted through variance adaptation.

A small physical change in the eye influences the entire neural information process along the visual pathway, causing perceptual errors and behavioral changes. Astigmatism, a refractive error in which visual images do not evenly focus on the retina, modulates visual perception, and the accompanying neural processes in the brain. However, studies on the neural representation of visual stimuli in astigmatism are scarce. We investigated the relationship between retinal input distortions and neural bias in astigmatism and how modulated neural information causes a perceptual error. We induced astigmatism by placing a cylindrical lens on the dominant eye of human participants, while they reported the orientations of the presented Gabor patches. The simultaneously recorded electroencephalogram activity revealed that stimulus orientation information estimated from the multivariate electroencephalogram activity was biased away from the neural representation of the astigmatic axis and predictive of behavioral bias. The representational neural dynamics underlying the perceptual error revealed the temporal state transition; it was transiently dynamic and unstable (approximately 350 ms from stimulus onset) that soon stabilized. The biased stimulus orientation information represented by the spatially distributed electroencephalogram activity mediated the distorted retinal images and biased orientation perception in induced astigmatism.

Astigmatism is a prevalent optical problem in which two or more focal points blur the retinal image at a particular meridian. Although many features of astigmatic vision, including orientation perception, are impaired at the retinal image level, the visual system appears to partly restore perceptual impairment after an extended period of astigmatism. However, the mechanism of orientation perception restoration in chronic astigmatism has not yet been clarified. We investigated the notable reduction of perceptual error in chronic astigmatism by comparing the orientation perception of a chronic astigmatism group with the perception of a normal-vision group, in which astigmatism was transiently induced. We found that orientation perception in the chronic group was more accurate than in the normal vision group. Interestingly, the reduction of perceptual errors was automatic; it remained even after the optical refractive errors were fully corrected, and the orientation perception was much more stable across different orientations, despite the uneven noise levels of the retinal images across meridians. We provide here a mechanistic explanation for how the compensation of astigmatic orientation perception occurred, using neural adaptation to the biased distribution of orientations.