The neural correlates of temporal reward discounting

Abstract

Temporal reward discounting (TD) refers to the decrease in subjective value of a reward when the delay to that reward increases. In recent years, a growing number of studies on the neural correlates of temporal reward discounting have been conducted. This article focuses on functional magnetic resonance imaging (fMRI) studies on TD in humans. First, we describe the different types of tasks (also from behavioral studies) and the dependent variables. Subsequently, we discuss the evidence for three neurobiological models of TD: the dual-systems model, the single-system model and the self-control model. Further, studies in which nontraditional tasks (e.g., with nonmonetary rewards) were used to study TD are reviewed. Finally, we discuss the neural correlates of individual differences in discounting, and its development across the lifespan. We conclude that the evidence for each of the three neurobiological models of TD is mixed, in that all models receive (partial) support, and several studies provide support for multiple models. Because of large differences between studies in task design and analytical approach, it is difficult to draw a firm conclusion regarding which model provides the best explanation of the neural correlates of temporal discounting. We propose that some components of these models can complement each other, and future studies should test the predictions offered by different models against each other. Several future research directions are suggested, including studying the connectivity between brain regions in relation to discounting, and directly comparing the neural mechanisms involved in discounting of monetary and primary rewards. WIREs Cogn Sci 2013, 4:523-545. doi: 10.1002/wcs.1246 CONFLICT OF INTEREST: The authors have declared no conflicts of interest for this article. For further resources related to this article, please visit the WIREs website.

Attention-Deficit/Hyperactivity Disorder and Monetary Delay Discounting: A Meta-Analysis of Case-Control Studies

“…Scheres et al suggest that neural hypo-responsiveness to anticipated reward may result in compensatory increases of reward-seeking behavior - a key characteristic of ADHD and an elemental process within delay discounting decision making (47). Indeed, studies of delay discounting using fMRI have directly implicated the ventral striatum in delay discounting, among a number of other regions, including subunits of prefrontal cortex, posterior cingulate cortex, anterior insula, and anterior cingulate (24; 49). Among these active regions, multiple accounts for both integrated and opposing relationships have been proposed, although the data do not support any account definitively at this point (24).…”

“…Indeed, studies of delay discounting using fMRI have directly implicated the ventral striatum in delay discounting, among a number of other regions, including subunits of prefrontal cortex, posterior cingulate cortex, anterior insula, and anterior cingulate (24; 49). Among these active regions, multiple accounts for both integrated and opposing relationships have been proposed, although the data do not support any account definitively at this point (24). However, the regions implicated in neuroimaging studies, particularly the ventral striatum and prefrontal cortex, are highly compatible with findings from preclinical studies using animal models of delay discounting (50; 51).…”

“…Theoretically, steep delay discounting is considered a hallmark deficit of ADHD (19-21), akin to deficits in response inhibition and sustained attention(22; 23). The underlying deficit has been theorized to be hypoactivity in mesocortical dopamine neurotransmission based on preclinical and functional magnetic resonance imaging (fMRI) studies (19; 24), although characterizing these processes remains an active area of inquiry. In addition, steep temporal discounting may be a cause of the high comorbidity between ADHD and substance use disorders (SUDs) (25; 26).…”

Grit and the brain: spontaneous activity of the dorsomedial prefrontal cortex mediates the relationship between the trait grit and academic performance

“…In addition, many studies have consistently reported that the DMPFC is involved in various components of self-regulation, such as impulsiveness (Cho et al , 2013; Davis et al , 2013; Muhlert and Lawrence, 2015), emotional regulation (Buhle et al , 2014), cognitive control (Venkatraman et al , 2009; Taren et al , 2011) and delay discounting (Carter et al , 2010; Cho et al , 2013; Scheres et al , 2013). Moreover, evidence from lesion studies have shown that DMPFC dysfunction leads to an inability to make plans, to set and maintain goals, and to comprehend the complex intentions of others (Kain and Perner, 2003; Szczepanski and Knight, 2014).…”

New perspectives on self-control development: Highlighting the role of intentional inhibition

“…In adults a network of brain regions, including medial prefrontal cortex (mPFC), ventral striatum, and posterior cingulate cortex (PCC) regions involved in the valuation of immediate rewards, and posterior parietal cortex (PPC), dorsolateral prefrontal cortex (dlPFC), and ventrolateral prefrontal cortex (vlPFC) regions involved in the valuation of immediate and delayed rewards, is associated with hypothetical delay discounting (for a review, see Scheres, de Water, and Mies (2013)). In a study comparing adolescents and adults it was found that adults made more consistent decisions.…”