The potential for human neuroimaging to read out the detailed contents of a person's mental state has yet to be fully explored. We investigated whether the perception of edge orientation, a fundamental visual feature, can be decoded from human brain activity measured with functional magnetic resonance imaging (fMRI). Using statistical algorithms to classify brain states, we found that ensemble fMRI signals in early visual areas could reliably predict on individual trials which of eight stimulus orientations the subject was seeing. Moreover, when subjects had to attend to one of two overlapping orthogonal gratings, feature-based attention strongly biased ensemble activity toward the attended orientation. These results demonstrate that fMRI activity patterns in early visual areas, including primary visual cortex (V1), contain detailed orientation information that can reliably predict subjective perception. Our approach provides a framework for the readout of fine-tuned representations in the human brain and their subjective contents.

Visual working memory provides an essential link between perception and higher cognitive functions, allowing for the active maintenance of information regarding stimuli no longer in view1,2. Research suggests that sustained activity in higher-order prefrontal, parietal, inferotemporal and lateral occipital areas supports visual maintenance3-11, and may account for working memory’s limited capacity to hold up to 3-4 items9-11. Because higher-order areas lack the visual selectivity of early sensory areas, it has remained unclear how observers can remember specific visual features, such as the precise orientation of a grating, with minimal decay in performance over delays of many seconds12. One proposal is that sensory areas serve to maintain fine-tuned feature information13, but early visual areas show little to no sustained activity over prolonged delays14-16. Using fMRI decoding methods17, here we show that orientations held in working memory can be decoded from activity patterns in the human visual cortex, even when overall levels of activity are low. Activity patterns in areas V1-V4 could predict which of two oriented gratings was held in memory with mean accuracy levels upwards of 80%, even in participants exhibiting activity that fell to baseline levels after a prolonged delay. These orientation-selective activity patterns were sustained throughout the delay period, evident in individual visual areas, and similar to the responses evoked by unattended, task-irrelevant gratings. Our results demonstrate that early visual areas can retain specific information about visual features held in working memory, over periods of many seconds when no physical stimulus is present.

No abstract

We used functional magnetic resonance imaging (fMRI) to monitor stimulus-selective responses of the human fusiform face area (FFA) and parahippocampal place area (PPA) during binocular rivalry in which a face and a house stimulus were presented to different eyes. Though retinal stimulation remained constant, subjects perceived changes from house to face that were accompanied by increasing FFA and decreasing PPA activity; perceived changes from face to house led to the opposite pattern of responses. These responses during rivalry were equal in magnitude to those evoked by nonrivalrous stimulus alternation, suggesting that activity in the FFA and PPA reflects the perceived rather than the retinal stimulus, and that neural competition during binocular rivalry has been resolved by these stages of visual processing.