Neural activity evoked during perception is thought to be reactivated during later memory retrieval. While many studies have found evidence for memory reactivation in visual cortex, few have characterized differences between stimulus-driven and mnemonic activation. Here, we leveraged population receptive field (pRF) models to quantify spatial activity in the human visual system during perception and long-term memory retrieval. We found that mnemonic activity, like perceptual activity, was precisely retinotopically mapped. However, we also observed large, systematic differences between perceptual and mnemonic activity in measures of amplitude and precision. The magnitude of these differences varied according to position in the visual hierarchy, with the largest differences observed in early areas. These differences could not be accounted for by the fact that memory data had reduced signal-to-noise or the possibility that it contained a mixture of successful and failed retrieval trials. Finally, we explore predictions from several models, showing that a simple hierarchical model with reciprocal feedforward and feedback connections accounts for many of our observations. Our results reveal novel distinctions between perceptual and mnemonic activity in visual cortex and provide insight into the computational constraints governing memory reactivation.
1/21visual cortex during perception (Kay et al., 2013b). Using these models to quantify memory-triggered activity in the visual system offers the opportunity to precisely model reactivation in visual cortex and its relationship to visual perception. In particular, the fact that pRF models are stimulus-referred may aid in interpreting differences between perception and memory activation patterns by projecting these differences onto a small number of physical dimensions.Here, we used pRF models to characterize the properties of mnemonic activity in human visual cortex. We first trained human subjects to associate spatially localized stimuli with colored fixation cues. We then measured stimulus-triggered and memory-triggered activity in visual cortex using fMRI. Separately, we fit pRF models to independent fMRI data, which allowed us to estimate receptive field location and size within multiple visual field maps for each subject. Using pRF-based analyses, we quantified the location, amplitude, and precision of activity throughout these visual field maps during perception and memory retrieval. Finally, we explored what kind of cortical computations could account for our observations by simulating responses using a stimulus-referred pRF model and a simple hierarchical model of neocortex.
Results
BehaviorPrior to being scanned, subjects participated in a behavioral training session. During this session, subjects learned to associate four colored fixation dot cues with four stimuli. The four stimuli were unique radial frequency patterns presented at 45, 135, 225, or 315 degrees of polar angle and 2 degrees of eccentricity ( Fig. 1a,b). Subjects alternated between study and test ...