BackgroundClassic work on visual short-term memory (VSTM) suggests that people store a limited amount of items for subsequent report. However, when human observers are cued to shift attention to one item in VSTM during retention, it seems as if there is a much larger representation, which keeps additional items in a more fragile VSTM store. Thus far, it is not clear whether the capacity of this fragile VSTM store indeed exceeds the traditional capacity limits of VSTM. The current experiments address this issue and explore the capacity, stability, and duration of fragile VSTM representations.Methodology/Principal FindingsWe presented cues in a change-detection task either just after off-set of the memory array (iconic-cue), 1,000 ms after off-set of the memory array (retro-cue) or after on-set of the probe array (post-cue). We observed three stages in visual information processing 1) iconic memory with unlimited capacity, 2) a four seconds lasting fragile VSTM store with a capacity that is at least a factor of two higher than 3) the robust and capacity-limited form of VSTM. Iconic memory seemed to depend on the strength of the positive after-image resulting from the memory display and was virtually absent under conditions of isoluminance or when intervening light masks were presented. This suggests that iconic memory is driven by prolonged retinal activation beyond stimulus duration. Fragile VSTM representations were not affected by light masks, but were completely overwritten by irrelevant pattern masks that spatially overlapped the memory array.Conclusions/SignificanceWe find that immediately after a stimulus has disappeared from view, subjects can still access information from iconic memory because they can see an after-image of the display. After that period, human observers can still access a substantial, but somewhat more limited amount of information from a high-capacity, but fragile VSTM that is overwritten when new items are presented to the eyes. What is left after that is the traditional VSTM store, with a limit of about four objects. We conclude that human observers store more sustained representations than is evident from standard change detection tasks and that these representations can be accessed at will.

In masking, a stimulus is rendered invisible through the presentation of a second stimulus shortly after the first. Over the years, authors have typically explained masking by postulating some early disruption process. In these feedforward-type explanations, the mask somehow “catches up” with the target stimulus, disrupting its processing either through lateral or interchannel inhibition. However, studies from recent years indicate that visual perception—and most notably visual awareness itself—may depend strongly on cortico-cortical feedback connections from higher to lower visual areas. This has led some researchers to propose that masking derives its effectiveness from selectively interrupting these reentrant processes. In this experiment, we used electroencephalogram measurements to determine what happens in the human visual cortex during detection of a texture-defined square under nonmasked (seen) and masked (unseen) conditions. Electro-encephalogram derivatives that are typically associated with reentrant processing turn out to be absent in the masked condition. Moreover, extrastriate visual areas are still activated early on by both seen and unseen stimuli, as shown by scalp surface Laplacian current source-density maps. This conclusively shows that feedforward processing is preserved, even when subject performance is at chance as determined by objective measures. From these results, we conclude that masking derives its effectiveness, at least partly, from disrupting reentrant processing, thereby interfering with the neural mechanisms of figure-ground segmentation and visual awareness itself.

Diffusion tensor imaging allowed us to validate for the first time the hypothesis that hyperconnectivity causes the added sensations in synesthesia. Grapheme-color synesthetes (n = 18), who experience specific colors with particular letters or numbers (for example, 'R is sky blue'), showed greater anisotropic diffusion compared with matched controls. Greater anisotropic diffusion indicates more coherent white matter. Anisotropy furthermore differentiated subtypes of grapheme-color synesthesia. Greater connectivity in the inferior temporal cortex was particularly strong for synesthetes who see synesthetic color in the outside world ('projectors') as compared with synesthetes who see the color in their 'mind's eye' only ('associators'). In contrast, greater connectivity (as compared with non-synesthetes) in the superior parietal or frontal cortex did not differentiate between subtypes of synesthesia. In conclusion, we found evidence that increased structural connectivity is associated with the presence of grapheme-color synesthesia, and has a role in the subjective nature of synesthetic color experience.

Fronto-basal ganglia pathways play a crucial role in voluntary action control, including the ability to inhibit motor responses. Response inhibition might be mediated via a fast hyperdirect pathway connecting the right inferior frontal gyrus (rIFG) and the presupplementary motor area (preSMA) with the subthalamic nucleus or, alternatively, via the indirect pathway between the cortex and caudate. To test the relative contribution of these two pathways to inhibitory action control, we applied an innovative quantification method for effective brain connectivity. Functional magnetic resonance imaging data were collected from 20 human participants performing a Simon interference task with an occasional stop signal. A single right-lateralized model involving both the hyperdirect and indirect pathways best explained the pattern of brain activation on stop trials. Notably, the overall connection strength of this combined model was highest on successfully inhibited trials. Inspection of the relationship between behavior and connection values revealed that fast inhibitors showed increased connectivity between rIFG and right caudate (rCaudate), whereas slow inhibitors were associated with increased connectivity between preSMA and rCaudate. In compliance, connection strengths from the rIFG and preSMA into the rCaudate were correlated negatively. If participants failed to stop, the magnitude of experienced interference (Simon effect), but not stopping latency, was predictive for the hyperdirect-indirect model connections. Together, the present results suggest that both the hyperdirect and indirect pathways act together to implement response inhibition, whereas the relationship between performance control and the fronto-basal ganglia connections points toward a top-down mechanism that underlies voluntary action control.