Heterogeneous Coding of Temporally Discounted Values in the Dorsal and Ventral Striatum during Intertemporal Choice

Cai, Xiaopan; Kim, Soyoun; Lee, Dongsoo

doi:10.1016/j.neuron.2010.11.041

Cited by 167 publications

(234 citation statements)

References 62 publications

Supporting

Mentioning

202

Contrasting

Order By: Relevance

“…7). This finding is in accordance with a recent study in nonhuman primates, which proposed the caudate nucleus to encode multiple computations during perceptual decisions (Ding and Gold, 2010;Cai et al, 2011). Thus, the caudate nucleus appears to play a major role in decision making as it integrates various signals relevant for the timing and the specificity of decisions.…”

Section: Discussionsupporting

confidence: 92%

Deciding When to Decide: Time-Variant Sequential Sampling Models Explain the Emergence of Value-Based Decisions in the Human Brain

Gluth

Rieskamp²,

Büchel³

2012

Journal of Neuroscience

172

View full text Add to dashboard Cite

The cognitive and neuronal mechanisms of perceptual decision making have been successfully linked to sequential sampling models. These models describe the decision process as a gradual accumulation of sensory evidence over time. The temporal evolution of economic choices, however, remains largely unexplored. We tested whether sequential sampling models help to understand the formation of value-based decisions in terms of behavior and brain responses. We used functional magnetic resonance imaging (fMRI) to measure brain activity while human participants performed a buying task in which they freely decided upon how and when to choose. Behavior was accurately predicted by a time-variant sequential sampling model that uses a decreasing rather than fixed decision threshold to estimate the time point of the decision. Presupplementary motor area, caudate nucleus, and anterior insula activation was associated with the accumulation of evidence over time. Furthermore, at the beginning of the decision process the fMRI signal in these regions accounted for trial-by-trial deviations from behavioral model predictions: relatively high activation preceded relatively early responses. The updating of value information was correlated with signals in the ventromedial prefrontal cortex, left and right orbitofrontal cortex, and ventral striatum but also in the primary motor cortex well before the response itself. Our results support a view of value-based decisions as emerging from sequential sampling of evidence and suggest a close link between the accumulation process and activity in the motor system when people are free to respond at any time.

show abstract

Section: Discussionsupporting

confidence: 92%

Deciding When to Decide: Time-Variant Sequential Sampling Models Explain the Emergence of Value-Based Decisions in the Human Brain

Gluth

Rieskamp²,

Büchel³

2012

Journal of Neuroscience

172

View full text Add to dashboard Cite

show abstract

“…Thus, would the activations coding social action and own reward rather reflect temporal discounting of reward value? To address this issue, we included a hyperbolic discounting model in the simultaneous testing procedure using a wide range of discounting parameters typical for rhesus monkeys (22)(23)(24) (SI Text). In 3 of 95 neuronal activations, we rejected the social action and own reward model in favor of the hyperbolic discounting model.…”

Section: Resultsmentioning

confidence: 99%

“…Our analysis of potential alternative interpretations included behavioral processes known to engage striatal neurons, including simple motor action, behavioral inhibition, eye position, eye velocity, reward delay, reward order, and effort (economic cost) (13,21,22,26). Remarkably, the combined evidence from these limited control analyses suggests that only a few of the observed striatal activations reflecting social processes could be explained by these behavioral alternatives.…”

Section: Discussionmentioning

confidence: 99%

Activity of striatal neurons reflects social action and own reward

Báez-Mendoza

Harris

Schultz

2013

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

Social interactions provide agents with the opportunity to earn higher benefits than when acting alone and contribute to evolutionary stable strategies. A basic requirement for engaging in beneficial social interactions is to recognize the actor whose movement results in reward. Despite the recent interest in the neural basis of social interactions, the neurophysiological mechanisms identifying the actor in social reward situations are unknown. A brain structure well suited for exploring this issue is the striatum, which plays a role in movement, reward, and goal-directed behavior. In humans, the striatum is involved in social processes related to reward inequity, donations to charity, and observational learning. We studied the neurophysiology of social action for reward in rhesus monkeys performing a reward-giving task. The behavioral data showed that the animals distinguished between their own and the conspecific's reward and knew which individual acted. Striatal neurons coded primarily own reward but rarely other's reward. Importantly, the activations occurred preferentially, and in approximately similar fractions, when either the own or the conspecific's action was followed by own reward. Other striatal neurons showed social action coding without reward. Some of the social action coding disappeared when the conspecific's role was simulated by a computer, confirming a social rather than observational relationship. These findings demonstrate a role of striatal neurons in identifying the social actor and own reward in a social setting. These processes may provide basic building blocks underlying the brain's function in social interactions.

show abstract

“…The striatal responses to reward-predicting cues undergo temporal discounting in close relationship to behavioural discounting. Cue responses in striatal neurons decrease with increasing delays to reward in parallel with decreasing preferences measured in binary behavioural choices [29]. Whereas the decreasing responses in caudate neurons reflect the differences in discounted reward value between the two choice options, the decreases in ventral striatal neurons reflect the sums of discounted choice values.…”

Section: Striatummentioning

confidence: 90%

Timing in reward and decision processes

Bermúdez

Schultz

2014

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

Sensitivity to time, including the time of reward, guides the behaviour of all organisms. Recent research suggests that all major reward structures of the brain process the time of reward occurrence, including midbrain dopamine neurons, striatum, frontal cortex and amygdala. Neuronal reward responses in dopamine neurons, striatum and frontal cortex show temporal discounting of reward value. The prediction error signal of dopamine neurons includes the predicted time of rewards. Neurons in the striatum, frontal cortex and amygdala show responses to reward delivery and activities anticipating rewards that are sensitive to the predicted time of reward and the instantaneous reward probability. Together these data suggest that internal timing processes have several well characterized effects on neuronal reward processing.

show abstract

Heterogeneous Coding of Temporally Discounted Values in the Dorsal and Ventral Striatum during Intertemporal Choice

Cited by 167 publications

References 62 publications

Deciding When to Decide: Time-Variant Sequential Sampling Models Explain the Emergence of Value-Based Decisions in the Human Brain

Deciding When to Decide: Time-Variant Sequential Sampling Models Explain the Emergence of Value-Based Decisions in the Human Brain

Activity of striatal neurons reflects social action and own reward

Timing in reward and decision processes

Contact Info

Product

Resources

About