Expected Value, Reward Outcome, and Temporal Difference Error Representations in a Probabilistic Decision Task

Rolls, Edmund T.; McCabe, Ciara; Redouté, Jérôme

doi:10.1093/cercor/bhm097

Cited by 214 publications

(148 citation statements)

References 70 publications

Supporting

Mentioning

134

Contrasting

Order By: Relevance

“…Consistent with the strong consensus in the adult literature (8), we observed activation of MPFC and DLPFC and adjacent cortical regions during EV computations. Our observation of decreased activation in insula in response to increasing EV is also supported by existing findings (23,26). However, we observed robust developmental differences in the VS, such that adolescents exhibited significantly greater activation than adults (who showed virtually no activation in this region), suggesting that maturational changes in neural representation of valuation during adolescence are most robust in the VS.…”

Section: Discussionsupporting

confidence: 90%

See 1 more Smart Citation

Neural representation of expected value in the adolescent brain

Barkley-Levenson

Galván

2014

Proc. Natl. Acad. Sci. U.S.A.

108

View full text Add to dashboard Cite

Previous work shows that the adolescent reward system is hyperactive, but this finding may be confounded by differences in how teens value money. To address this, we examined the neural ontogeny of objective value representation. Adolescent and adult participants performed a monetary gambling task in which they chose to accept or reject gambles of varying expected value. Increasing expected value had a stronger influence over gambling choices in adolescents relative to adults, an effect that was paralleled by greater activation in the ventral striatum in adolescents. This unique adolescent ventral striatum response remained even after matching groups on acceptance behavior. These behavioral and neural data suggest that the value of available options has a greater influence in adolescent versus adult choices, even when objective value and subjective choice are held constant. This research provides further evidence that hyperactivation of reward circuitry in adolescence may be a normative ontogenetic shift that is due to greater valuation in the adolescent brain.A dolescence is characterized by heightened sensitivity to rewards (1). This phenotype is subserved by exaggerated neural response in ventral striatum (VS) to the anticipation (2) and receipt of expected (3-5) and unexpected reward (6) in adolescents versus other age groups. The question remains, however, whether this effect is mediated by ontogenetic differences or simply a methodological consequence of using money as the rewarding stimulus. In other words, does the adolescent brain attribute greater value to available rewards, or is the effect driven by adolescents valuing money to a greater extent than adults because they typically have less access to and experience with it? The goal of this study was to disentangle these possibilities by examining subjective valuation (indexed by behavior) of objectively valued choices.Subjective value (SV) is defined as the value that an individual places on a stimulus (7). To make a choice, an organism determines the SV of each alternative and then selects the one with the greatest SV (8, 9). A recent metaanalysis of 206 studies of SV in adults identified the ventromedial prefrontal cortex (VMPFC) and VS as a "valuation system" (8). These regions represent SV during choice for monetary stimuli (10-14), charitable donations (15), consumer goods (16), and food (17)(18)(19). Despite the wealth of knowledge on the neural correlates of SV in adults, no previous studies have examined the neurobiological development of SV, which precludes ruling out the possibility that previous findings in support of a hyperactive adolescent reward system were confounded by differences in participant valuation.One approach to understanding the neural computation of SV is through measurement of expected value (EV), the sum of all of the possible outcomes of a particular choice multiplied by their probabilities (20). In adults, increasing EV yields parametric activation increases in bilateral VS, midbrain, medial prefrontal cortex (MPFC), an...

show abstract

Section: Discussionsupporting

confidence: 90%

“…In adults, increasing EV yields parametric activation increases in bilateral VS, midbrain, medial prefrontal cortex (MPFC), and dorsolateral prefrontal cortex (DLPFC) (21)(22)(23)(24)(25).…”

mentioning

confidence: 99%

Neural representation of expected value in the adolescent brain

Barkley-Levenson

Galván

2014

Proc. Natl. Acad. Sci. U.S.A.

108

View full text Add to dashboard Cite

show abstract

“…There is ample neuroimaging evidence of the involvement of these areas in tasks that tap the use of rewards to make decisions, especially the ventral striatum (Abler, Walter, Erk, Kammerer, & Spitzer, 2006;Knutson, Taylor, Kaufman, Peterson, & Glover, 2005;Liu, et al, 2011;O'Doherty, Deichmann, Critchley, & Dolan, 2002;Pagnoni, Zink, Montague, & Berns, 2002;Rolls, McCabe, & Redoute, 2008;Schott et al, 2008). In addition, there is recent support for the idea that these areas are functionally connected during reward tasks (Camara, Rodriguez-Fornells, & Munte, 2009;Krebs, Heipertz, Schuetze, & Duzel, 2011;Ye, Hammer, Camara, & Munte, 2011), and rest (Cauda et al, 2011).…”

Section: The Reward Network (Rn)mentioning

confidence: 99%

Age differences in default and reward networks during processing of personally relevant information

Grady

Grigg

2012

Neuropsychologia

View full text Add to dashboard Cite

We recently found activity in default mode and reward-related regions during self-relevant tasks in young adults. Here we examine the effect of aging on engagement of the default network (DN) and reward network (RN) during these tasks. Previous studies have shown reduced engagement of the DN and reward areas in older adults, but the influence of age on these circuits during selfrelevant tasks has not been examined. The tasks involved judging personality traits about one's self or a well known other person. There were no age differences in reaction time on the tasks but older adults had more positive Self and Other judgments, whereas younger adults had more negative judgments. Both groups had increased DN and RN activity during the self-relevant tasks, relative to non-self tasks, but this increase was reduced in older compared to young adults. Functional connectivity of both networks during the tasks was weaker in the older relative to younger adults. Intrinsic functional connectivity, measured at rest, also was weaker in the older adults in the DN, but not in the RN. These results suggest that, in younger adults, the processing of personally relevant information involves robust activation of and functional connectivity within these two networks, in line with current models that emphasize strong links between the self and reward. The finding that older adults had more positive judgments, but weaker engagement and less consistent functional connectivity in these networks, suggests potential brain mechanisms for the "positivity bias" with aging.

show abstract

“…Midbrain dopamine neurons encode reward prediction error in tasks in which the animal is cued to predict the reward and revise their predictions based on the reward prediction error (Waelti et al, 2001;Nakahara et al, 2004). The basal ganglia (Hikosaka et al, 2006) and cerebral cortices (Bray and O'Doherty, 2007;Rolls et al, 2008) are implicated in reward prediction. The computation of the reward prediction error requires a temporal memory of the predicted reward (established at cue onset and sustained until reward delivery) and subtraction of the actual reward from the predicted one.…”

Section: Introductionmentioning

confidence: 99%

Different Pedunculopontine Tegmental Neurons Signal Predicted and Actual Task Rewards

Okada

Toyama²,

Inoue³

et al. 2009

J. Neurosci.

103

145

View full text Add to dashboard Cite

The dopamine system has been implicated in guiding behavior based on rewards. The pedunculopontine tegmental nucleus (PPTN) of the brainstem receives afferent inputs from reward-related structures, including the cerebral cortices and the basal ganglia, and in turn provides strong excitatory projections to dopamine neurons. This anatomical evidence predicts that PPTN neurons may carry reward information. To elucidate the functional role of the PPTN in reward-seeking behavior, we recorded single PPTN neurons while monkeys performed a visually guided saccade task in which the predicted reward value was informed by the shape of the fixation target. Two distinct groups of neurons, fixation target (FT) and reward delivery (RD) neurons, carried reward information. The activity of FT neurons persisted between FT onset and reward delivery, with the level of activity associated with the magnitude of the expected reward. RD neurons discharged phasically after reward delivery, with the levels of activity associated with the actual reward. These results suggest that separate populations of PPTN neurons signal predicted and actual reward values, both of which are necessary for the computation of reward prediction error as represented by dopamine neurons.

show abstract

Expected Value, Reward Outcome, and Temporal Difference Error Representations in a Probabilistic Decision Task

Cited by 214 publications

References 70 publications

Neural representation of expected value in the adolescent brain

Neural representation of expected value in the adolescent brain

Age differences in default and reward networks during processing of personally relevant information

Different Pedunculopontine Tegmental Neurons Signal Predicted and Actual Task Rewards

Contact Info

Product

Resources

About