Catecholamines modulate the impact of motivational cues on action. Such motivational biases have been proposed to reflect cue-based, ‘Pavlovian’ effects. Here, we assess whether motivational biases may also arise from asymmetrical instrumental learning of active and passive responses following reward and punishment outcomes. We present a novel paradigm, allowing us to disentangle the impact of reward and punishment on instrumental learning from Pavlovian response biasing. Computational analyses showed that motivational biases reflect both Pavlovian and instrumental effects: reward and punishment cues promoted generalized (in)action in a Pavlovian manner, whereas outcomes enhanced instrumental (un)learning of chosen actions. These cue- and outcome-based biases were altered independently by the catecholamine enhancer melthylphenidate. Methylphenidate’s effect varied across individuals with a putative proxy of baseline dopamine synthesis capacity, working memory span. Our study uncovers two distinct mechanisms by which motivation impacts behaviour, and helps refine current models of catecholaminergic modulation of motivated action.DOI: http://dx.doi.org/10.7554/eLife.22169.001

The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to the current learning environment. To date, the neurobiological implementation of meta-learning remains unclear. A burgeoning literature argues for an important role for the catecholamines dopamine and noradrenaline in meta-learning. Here, we tested the hypothesis that enhancing catecholamine function modulates the ability to optimise a meta-learning parameter (learning rate) as a function of environmental volatility. 102 participants completed a task which required learning in stable phases, where the probability of reinforcement was constant, and volatile phases, where probabilities changed every 10–30 trials. The catecholamine transporter blocker methylphenidate enhanced participants’ ability to adapt learning rate: Under methylphenidate, compared with placebo, participants exhibited higher learning rates in volatile relative to stable phases. Furthermore, this effect was significant only with respect to direct learning based on the participants’ own experience, there was no significant effect on inferred-value learning where stimulus values had to be inferred. These data demonstrate a causal link between catecholaminergic modulation and the adjustment of the meta-learning parameter learning rate.

Acute stress has frequently been shown to impair cognitive flexibility. Most studies have examined the effect of stress on cognitive flexibility by measuring how stress changes performance in paradigms that require participants to switch between different task demands. These processes typically implicate pFC function, a region known to be impaired by stress. However, cognitive flexibility is a multifaceted construct. Another dimension of flexibility, updating to incorporate relevant information, involves the dorsal striatum. Function in this region has been shown to be enhanced by stress. Using a within-subject design, we tested whether updating flexibility in a DMS task would be enhanced by an acute stress manipulation (cold pressor task). Participants' cortisol response to stress positively correlated with a relative increase in accuracy on updating flexibility (compared with trials with no working memory interference). In contrast, in line with earlier studies, cortisol responses correlated with worse performance when switching between trials with different task demands. These results demonstrate that stress-related increases in cortisol are associated with both increases and decreases in cognitive flexibility, depending on task demands.

The catecholamines have long been associated with cognitive control and value-based decision-making. More recently, we proposed that the catecholamines might modulate value-based decision-making about whether or not to engage in cognitive control. We test this hypothesis by assessing effects of a catecholamine challenge in a large sample of young, healthy adults (n = 100) on the avoidance of a cognitively demanding control process: task switching. Prolonging catecholamine transmission by blocking reuptake with methylphenidate altered the avoidance, but not the execution of cognitive control. Crucially, these effects could be isolated by taking into account individual differences in trait impulsivity, so that participants with higher trait impulsivity became more avoidant of cognitive control, despite faster task performance. One implication of these findings is that performance-enhancing effects of methylphenidate may be accompanied by an undermining effect on the willingness to exert cognitive control. Taken together, these findings integrate hitherto segregated literatures on catecholamines’ roles in value-based learning/choice and cognitive control.

No abstract