The present investigation had two aims: (1) to study responses of dopamine neurons to stimuli with attentional and motivational significance during several steps of learning a behavioral task, and (2) to study the activity of dopamine neurons during the performance of cognitive tasks known to be impaired after lesions of these neurons. Monkeys that had previously learned a simple reaction time task were trained to perform a spatial delayed response task via two intermediate tasks. During the learning of each new task, a total of 25% of 76 dopamine neurons showed phasic responses to the delivery of primary liquid reward, whereas only 9% of 163 neurons responded to this event once task performance was established. This produced an average population response during but not after learning of each task. Reward responses during learning were significantly more numerous and pronounced in area A10, as compared to areas A8 and A9. Dopamine neurons also showed phasic responses to the two conditioned stimuli. These were the instruction cue, which was the first stimulus in each trial and indicated the target of the upcoming arm movement (58% of 76 neurons during and 44% of 163 neurons after learning), and the trigger stimulus, which was a conditioned incentive stimulus predicting reward and eliciting a saccadic eye movement and an arm reaching movement (38% of neurons during and 40% after learning). None of the dopamine neurons showed sustained activity in the delay between the instruction and trigger stimuli that would resemble the activity of neurons in dopamine terminal areas, such as the striatum and frontal cortex. Thus, dopamine neurons respond phasically to alerting external stimuli with behavioral significance whose detection is crucial for learning and performing delayed response tasks. The lack of sustained activity suggests that dopamine neurons do not encode representational processes, such as working memory, expectation of external stimuli or reward, or preparation of movement. Rather, dopamine neurons are involved with transient changes of impulse activity in basic attentional and motivational processes underlying learning and cognitive behavior.

1. Previous studies have shown that dopamine (DA) neurons respond to stimuli of behavioral significance, such as primary reward and conditioned stimuli predicting reward and eliciting behavioral reactions. The present study investigated how these responses develop and vary when the behavioral significance of stimuli changes during different stages of learning. Impulses from DA neurons were recorded with movable microelectrodes from areas A8, A9, and A10 in two awake monkeys during the successive acquisition of two behavioral tasks. Impulses of DA neurons were distinguished from other neurons by their long duration (1.8-5.0 ms) and low spontaneous frequency (0.5-7.0 imp/s). 2. In the first task, animals learned to reach in a small box in front of them when it opened visibly and audibly. Before conditioning, DA neurons were activated the first few times that the empty box opened and animals reacted with saccadic eye movements. Neuronal and behavioral responses disappeared on repeated stimulus presentation. Thus neuronal responses were related to the novelty of an unexpected stimulus eliciting orienting behavior. 3. Subsequently, the box contained a small morsel of apple in one out of six trials. Animals reacted with ocular saccades to nearly every box opening and reached out when the morsel was present. One-third of 49 neurons were phasically activated by every door opening. The response was stronger when food was present. Thus DA neurons responded simultaneously to the sight of primary food reward and to the conditioned stimulus associated with reward. 4. When the box contained a morsel of apple on every trial, animals regularly reacted with target-directed eye and arm movements, and the majority of 76 DA neurons responded to door opening. The same neurons lacked responses to a light not associated with task performance that was illuminated at the position of the food box in alternate sessions, thus demonstrating specificity for the behavioral significance of stimuli. 5. The second task employed the operant conditioning of a reaction time situation in which animals reached from a resting key toward a lever when a small light was illuminated. DA neurons lacked responses to the unconditioned light. During task acquisition lasting 2-3 days, one-half of 25 DA neurons were phasically activated when a drop of liquid reward was delivered for reinforcing the reaching movement. In contrast, neurons were not activated when reward was delivered at regular intervals (2.5-3.5 s) but a task was not performed.(ABSTRACT TRUNCATED AT 400 WORDS)

Projections from cortical and subcortical limbic structures to the basal ganglia are predominantly directed to the ventral striatum. The present study investigated how the expectation of external events with behavioral significance is reflected in the activity of ventral striatal neurons. A total of 420 neurons were studied in macaque monkeys performing in a delayed go-no-go task. Lights of different colors instructed the animal to do an arm-reaching movement or refrain from moving, respectively, when a trigger light was illuminated a few seconds later. Task performance was reinforced by liquid reward in both situations. A total of 60 ventral striatal neurons showed sustained increases of activity before the occurrence of individual task events. In 43 of these neurons, activations specifically preceded the delivery of reward, independent of the movement or no-movement reaction. In a series of additional tests, these activations were time locked to the subsequent reward, disappeared within a few trials when reward was omitted, and were temporally unrelated to mouth movements. Changes in the appetitive value of the reward liquid modified the magnitude of activations, suggesting a possible relationship to the hedonic properties of the expected event. Activations also occurred when reward was delivered in a predictable manner outside of any behavioral task. These data suggest that neurons in the ventral striatum are activated during states of expectation of individual environmental events that are predictable to the subject through its past experience. The prevalence of activations related to the expectation of reward suggests that ventral striatal neurons have access to central representations of reward and thereby participate in the processing of information underlying the motivational control of goal-directed behavior.

No abstract

The sources of input and the behavioral effects of lesions and drug administration suggest that the striatum participates in motivational processes. We investigated the activity of single striatal neurons of monkeys in response to reward delivered for performing in a go-nogo task. A drop of liquid was given each time the animal correctly executed or withheld an arm movement in reaction to a visual stimulus. Of 1593 neurons, 115 showed increased activity in response to delivery of liquid reward in both go and nogo trials. Responding neurons were predominantly located in dorsal and ventromedial parts of anterior putamen, in dorsal and ventral caudate, and in nucleus accumbens. They were twice as frequent in ventral as compared to dorsal striatal areas. Responses occurred at a median latency of 337 ms and lasted for 525 ms, with insignificant differences between dorsal and ventral striatum. Reward responses differed from activity recorded in the face area of posterior putamen which varied synchronously with individual mouth movements. Responses were directly related to delivery of primary liquid reward and not to auditory stimuli associated with it. Most of them also occurred when reward was delivered outside of the task. These results demonstrate that neurons of dorsal and particularly ventral striatum are involved in processing information concerning the attribution of primary reward.