Individuals make choices and prioritize goals using complex processes that assign value to rewards and associated stimuli. During Pavlovian learning, previously neutral stimuli that predict rewards can acquire motivational properties, whereby they themselves become attractive and desirable incentive stimuli. But individuals differ in whether a cue acts solely as a predictor that evokes a conditional response, or also serves as an incentive stimulus, and this determines the degree to which a cue might bias choice or even promote maladaptive behavior. Here we use rats that differ in the incentive motivational properties they attribute to food cues to probe the role of the neurotransmitter dopamine in stimulus-reward learning. We show that intact dopamine transmission is not required for all forms of learning in which reward cues become effective predictors. Rather, dopamine acts selectively in a form of reward learning in which “incentive salience” is assigned to reward cues. In individuals with a propensity for this form of learning, reward cues come to powerfully motivate and control behavior. This work provides insight into the neurobiology of a form of reward learning that confers increased susceptibility to disorders of impulse control.

The dopamine-containing projection from the ventral tegmental area of the midbrain to the nucleus accumbens is critically involved in mediating the reinforcing properties of cocaine. Although neurons in this area respond to rewards on a subsecond timescale, neurochemical studies have only addressed the role of dopamine in drug addiction by examining changes in the tonic (minute-to-minute) levels of extracellular dopamine. To investigate the role of phasic (subsecond) dopamine signalling, we measured dopamine every 100 ms in the nucleus accumbens using electrochemical technology. Rapid changes in extracellular dopamine concentration were observed at key aspects of drug-taking behaviour in rats. Before lever presses for cocaine, there was an increase in dopamine that coincided with the initiation of drug-seeking behaviours. Notably, these behaviours could be reproduced by electrically evoking dopamine release on this timescale. After lever presses, there were further increases in dopamine concentration at the concurrent presentation of cocaine-related cues. These cues alone also elicited similar, rapid dopamine signalling, but only in animals where they had previously been paired to cocaine delivery. These findings reveal an unprecedented role for dopamine in the regulation of drug taking in real time.

The dopamine projection to the nucleus accumbens has been implicated in behaviors directed toward the acquisition and consumption of natural rewards. The neurochemical studies that established this link made time-averaged measurements over minutes, and so the precise temporal relationship between dopamine changes and these behaviors is not known. To resolve this, we sampled dopamine every 100 msec using fast-scan cyclic voltammetry at carbon-fiber microelectrodes in the nucleus accumbens of rats trained to press a lever for sucrose. Cues that signal the opportunity to respond for sucrose evoked dopamine release (67 Ϯ 20 nM) with short latency (0.2 Ϯ 0.1 sec onset). When the same cues were presented to rats naive to the cue-sucrose pairing, similar dopamine signals were not observed. Thus, cue-evoked increases in dopamine in trained rats reflected a learned association between the cues and sucrose availability. Lever presses for sucrose occurred at the peak of the dopamine surges. After lever presses, and while sucrose was delivered and consumed, no further increases in dopamine were detected. Rather, dopamine returned to baseline levels. Together, the results strongly implicate subsecond dopamine signaling in the nucleus accumbens as a real-time modulator of food-seeking behavior.

Predictions about future rewarding events have a powerful influence on behaviour. The phasic spike activity of dopamine-containing neurons, and corresponding dopamine transients in the striatum, are thought to underlie these predictions, encoding positive and negative reward prediction errors1–5. Many behaviours, however, are directed toward distant goals, for which transient signals might fail to provide sustained drive. Here we report a novel, extended mode of reward-predictive dopamine signalling in the striatum that emerged as rats moved toward distant goals. These dopamine signals, which were detected with fast-scan cyclic voltammetry (FSCV), gradually increased or--in rare instances--decreased as the animals navigated mazes to reach remote rewards, rather than having phasic or steady tonic profiles. These dopamine increases (ramps) scaled flexibly with both the distance and size of the rewards. During learning, these dopamine signals exhibited spatial preferences for goals in different locations and readily changed in magnitude to reflect changing values of the distant rewards. Such prolonged dopamine signalling could provide sustained motivational drive, a control mechanism that may be important for normal behaviour and that can be impaired in a range of neurologic and neuropsychiatric disorders.