Individuals make choices and prioritize goals using complex processes that assign value to rewards and associated stimuli. During Pavlovian learning, previously neutral stimuli that predict rewards can acquire motivational properties, whereby they themselves become attractive and desirable incentive stimuli. But individuals differ in whether a cue acts solely as a predictor that evokes a conditional response, or also serves as an incentive stimulus, and this determines the degree to which a cue might bias choice or even promote maladaptive behavior. Here we use rats that differ in the incentive motivational properties they attribute to food cues to probe the role of the neurotransmitter dopamine in stimulus-reward learning. We show that intact dopamine transmission is not required for all forms of learning in which reward cues become effective predictors. Rather, dopamine acts selectively in a form of reward learning in which “incentive salience” is assigned to reward cues. In individuals with a propensity for this form of learning, reward cues come to powerfully motivate and control behavior. This work provides insight into the neurobiology of a form of reward learning that confers increased susceptibility to disorders of impulse control.

Animal studies suggest the neurotransmitter dopamine (DA) plays an important role in decision-making. In rats, DA depletion decreases tolerance for effort and probability costs, while drugs enhancing DA increase tolerance for these costs. However, data regarding the effect of DA manipulations on effort and probability costs in humans remains scarce. The current study examined acute effects of d-amphetamine, an indirect DA agonist, on willingness of healthy human volunteers to exert effort for monetary rewards at varying levels of reward value and reward probability. Based on preclinical research, we predicted amphetamine would increase exertion of effort, particularly when reward probability was low. Over three sessions, 17 healthy normal adults received placebo, d-amphetamine 10 mg, and 20 mg under counterbalanced double-blind conditions and completed the Effort Expenditure for Rewards Task. Consistent with predictions, amphetamine enhanced willingness to exert effort, particularly when reward probability was lower. Amphetamine did not alter effects of reward magnitude on willingness to exert effort. Amphetamine sped task performance, but its psychomotor effects were not strongly related to its effects on decision-making. This is the first demonstration in humans that dopaminergic manipulations alter willingness to exert effort for rewards. These findings help elucidate neurochemical substrates of choice, with implications for neuropsychiatric diseases characterized by dopaminergic dysfunction and motivational deficits.

Post-traumatic stress disorder (PTSD) is a common, debilitating condition with limited treatment options. Extinction of fear memories through prolonged exposure therapy, the primary evidence-based behavioral treatment for PTSD, has only partial efficacy. In mice, pharmacological inhibition of fatty acid amide hydrolase (FAAH) produces elevated levels of anandamide (AEA) and promotes fear extinction, suggesting that FAAH inhibitors may aid fear extinction-based treatments. A human FAAH 385C->A substitution encodes an FAAH enzyme with reduced catabolic efficacy. Individuals homozygous for the FAAH 385A allele may therefore offer a genetic model to evaluate the impact of elevations in AEA signaling in humans, helping to inform whether FAAH inhibitors have the potential to facilitate fear extinction therapy for PTSD. To overcome the challenge posed by low frequency of the AA genotype (appr. 5%), we prospectively genotyped 423 individuals to examine the balanced groups of CC, AC, and AA individuals (n = 25/group). Consistent with its loss-of-function nature, the A allele was dose dependently associated with elevated basal AEA levels, facilitated fear extinction, and enhanced the extinction recall. Moreover, the A-allele homozygotes were protected against stress-induced decreases in AEA and negative emotional consequences of stress. In a humanized mouse model, AA homozygous mice were similarly protected against stress-induced decreases in AEA, both in the periphery, and also in the amygdala and prefrontal cortex, brain structures critically involved in fear extinction and regulation of stress responses. Collectively, these data suggest that AEA signaling can temper aspects of the stress response and that FAAH inhibition may aid the treatment for stress-related psychiatric disorders, such as PTSD.

BACKGROUND: Posttraumatic stress disorder, an area of large unmet medical needs, is characterized by persistence of fear memories and maladaptive stress responses. In rodents, elevation of the endocannabinoid anandamide due to inhibition of fatty acid amide hydrolase (FAAH) facilitates fear extinction and protects against the anxiogenic effects of stress. We recently reported that elevated anandamide levels in people homozygous for a loss-of-function FAAH mutation are associated with a similar phenotype, suggesting a translational validity of the preclinical findings. METHODS: In this double-blind, placebo-controlled experimental medicine study, healthy adults were randomized to an FAAH inhibitor (PF-04457845, 4 mg orally, once daily; n = 16) or placebo (n = 29) for 10 days. On days 9 and 10, participants completed a task battery assessing psychophysiological indices of fear learning, stress reactivity, and stress-induced affective responses. RESULTS: FAAH inhibition produced a 10-fold increase in baseline anandamide. This was associated with potentiated recall of fear extinction memory when tested 24 hours after extinction training. FAAH inhibition also attenuated autonomic stress reactivity, assessed via electrodermal activity, and protected against stress-induced negative affect, measured via facial electromyography. CONCLUSIONS: Our data provide preliminary human evidence that FAAH inhibition can improve the recall of fear extinction memories and attenuate the anxiogenic effects of stress, in a direct translation of rodent findings. The beneficial effects of FAAH inhibition on fear extinction, as well as stress-and affect-related behaviors, provide a strong rationale for developing this drug class as a treatment for posttraumatic stress disorder.

Drug-associated cues elicit conditioned responses in human drug users, and are thought to facilitate a drug-seeking behavior. Yet, little is known about how these associations are acquired, or about the specificity of the conditioned response modalities. In this study, healthy, nondependent volunteers (N ¼ 90) completed a conditioning paradigm in which they received a moderate dose of methamphetamine paired with one stimulus and placebo with another stimulus, each on two separate occasions. Their responses to these cues were measured with a behavioral preference, self-reported 'liking', emotional reactivity, and attentional bias measures, both before and after the conditioning. Following the conditioning procedure, subjects exhibited a behavioral preference, positive emotional reactivity, and attentional bias toward the methamphetamine-associated cue, compared with the placebo stimulus. In addition, subjects who reported greater positive subjective drug effects during the conditioning displayed a more robust conditioning. This work demonstrates that healthy nondependent volunteers readily acquire conditioned responses to neutral stimuli paired with a drug. The procedure has significant value to study individual variation in acquisition of conditioned responses as a possible risk factor for drug taking, and to study the neural basis of conditioned drug responses.