Attention selects which aspects of sensory input are brought to awareness. To promote survival and well-being, attention prioritizes stimuli both voluntarily, according to context-specific goals (e.g., searching for car keys), and involuntarily, through attentional capture driven by physical salience (e.g., looking toward a sudden noise). Valuable stimuli strongly modulate voluntary attention allocation, but there is little evidence that high-value but contextually irrelevant stimuli capture attention as a consequence of reward learning. Here we show that visual search for a salient target is slowed by the presence of an inconspicuous, taskirrelevant item that was previously associated with monetary reward during a brief training session. Thus, arbitrary and otherwise neutral stimuli imbued with value via associative learning capture attention powerfully and persistently during extinction, independently of goals and salience. Vulnerability to such valuedriven attentional capture covaries across individuals with working memory capacity and trait impulsivity. This unique form of attentional capture may provide a useful model for investigating failures of cognitive control in clinical syndromes in which value assigned to stimuli conflicts with behavioral goals (e.g., addiction, obesity).E ffective deployment of attention is critical to the successful performance of any cognitive task. Attention determines what aspects of the sensory input are selected for cognitive processing, memory storage, and awareness. Two modes of attentional control are widely believed to determine perceptual priority: a voluntary, goal-directed mode, in which attention is guided by contextually appropriate goals and intentions, and an involuntary, stimulus-driven mode, in which attention is captured by physically salient stimuli (1-4) or by task-irrelevant stimuli that share identifying features with a searched-for target (5, 6). Each of these modes of control present concomitant benefits and costs: voluntary control of attention is goal-specific but potentially slower to implement; involuntary attentional capture can rapidly orient the organism to unexpected changes that could signal danger or opportunity, but has the potential to cause distraction from intended acts of perception.Goal-directed and stimulus-driven modes of attentional control have long been a focus of intense investigation, and much has been learned about the operating principles of each mode of control and their interaction (1, 4). However, there is growing evidence that these are not the only influences on attentional deployment. To promote survival and well-being, the brain is optimized to learn about perceptual stimuli that signal the potential for procuring reward (7,8). Voluntary attention to stimuli that predict reward is an effective mechanism for efficiently selecting valuable stimuli (9). Many studies have shown that reward facilitates voluntary attention to task-relevant stimuli, and that reward-based strategies and priorities strongly influence attentional perf...

Visual attention is captured by physically salient stimuli (termed salience-based attentional capture), and by otherwise task-irrelevant stimuli that contain goal-related features (termed contingent attentional capture). Recently, we reported that physically nonsalient stimuli associated with value through reward learning also capture attention involuntarily (Anderson, Laurent, & Yantis, PNAS, 2011). Although it is known that physical salience and goal-relatedness both influence attentional priority, it is unknown whether or how attentional capture by a salient stimulus is modulated by its associated value. Here we show that a physically salient, task-irrelevant distractor previously associated with a large reward slows visual search more than an equally salient distractor previously associated with a smaller reward. This magnification of salience-based attentional capture by learned value extinguishes over several hundred trials. These findings reveal a broad influence of learned value on involuntary attentional capture.

Goal-directed and stimulus-driven factors determine attentional priority through a well defined dorsal frontal-parietal and ventral temporal-parietal network of brain regions, respectively. Recent evidence demonstrates that reward-related stimuli also have high attentional priority, independent of their physical salience and goal-relevance. The neural mechanisms underlying such value-driven attentional control are unknown. Using human functional magnetic resonance imaging, we demonstrate that the tail of the caudate nucleus and extrastriate visual cortex respond preferentially to task-irrelevant but previously reward-associated objects, providing an attentional priority signal that is sensitive to reward history. The caudate tail has not been implicated in the control of goal-directed or stimulus-driven attention, but is well suited to mediate the value-driven control of attention. Our findings reveal the neural basis of value-based attentional priority.

The human ability to flexibly adapt to novel circumstances is extraordinary. Perhaps the most illustrative yet underappreciated form of this cognitive flexibility is rapid instructed task learning (RITL) – the ability to rapidly reconfigure our minds to perform new tasks from instruction. This ability is important for everyday life (e.g., learning to use new technologies), and is used to instruct participants in nearly every study of human cognition. We review the development of RITL as a circumscribed domain of cognitive neuroscience investigation, culminating in recent demonstrations that RITL is implemented via brain circuits centered on lateral prefrontal cortex. We then build on this and other insights to develop an integrative theory of cognitive flexibility and cognitive control, identifying theoretical principles and mechanisms that may make RITL possible in the human brain. Insights gained from this new theoretical account have important implications for further developments and applications of RITL research.

Attention is the mechanism by which important or salient stimuli are selected for perceptual and cognitive processing. Which stimuli are attended has important implications for effective goal-directed behaviour, survival, and well-being. A growing body of evidence suggests that reward-predicting stimuli capture attention involuntarily. In previous studies, value-based attentional priority has been observed only when the formerly reward-related stimuli themselves were presented as targets or distractors. Here we show that stimulus–reward associations learned in one task generalize to different stimuli that share a defining feature (colour) in another task. Our results reveal a broad and flexible role for reward learning in modulating attentional priority.