Dopamine in Motivational Control: Rewarding, Aversive, and Alerting

Bromberg-Martin, Ethan S.; Matsumoto, Masayuki; Hikosaka, Okihide

doi:10.1016/j.neuron.2010.11.022

Cited by 1,964 publications

(1,792 citation statements)

References 262 publications

(446 reference statements)

Supporting

Mentioning

1,629

Contrasting

Unclassified

Order By: Relevance

Section: Interpretation Of the Electrophysiological Resultssupporting

confidence: 63%

“…Thus, as the balloon was inflating that involved more risk of balloon burst, the related positive feedback elicited larger reward positivity than those successful pumps at the beginning of the inflation process. This result may fit the assumption that the positive prediction error signal had a reinforcing effect on behavior by signaling that the outcome was better than expected and it promoted further steps to achieve a higher reward [15].When the reward positivity evoked by both the 'gain before burst' and the 'gain before cash-out' trials (last positive feedback before the termination of the trial) were compared in the two age groups, higher amplitudes for 'gain before cash-out' were found only in the young group. In the elderly, there were no differences between the amplitudes of reward positivity observed in these two conditions.…”

supporting

confidence: 57%

“…Although reward prediction error signals are assumed to provoke further reward seeking behavior, we found that the larger reward positivity in the young group was related to that level of sequential risk taking where the decision about cash-out occurred. Therefore, it could be possible that if the magnitude of the reward prediction error signal exceeds a certain threshold it may indicate that the evoking signal does not have a reinforcing value anymore [15]. This possibility would imply that participants had an internal model about the task structure and about outcome probabilities with which they could compare their current experiences [40].…”

Section: Interpretation Of the Electrophysiological Resultsmentioning

confidence: 99%

“…These expectations are assumed to have an effect on behavior through neural processes constantly signaling not only whether the outcome of actions reached the task goals or not but also to what extent these could fit the participants' preconceptions/predictions [14]. According to the theories concerning the brain's reward prediction system, unexpected reward or punishment elicits brief bursts of phasic dopamine signaling originating from the midbrain dopamine system [15,16]. This reward prediction error (RPE) signal is thought to have an interplay with prefrontal cortical areas such as the prefrontal cortex (PFC) and the anterior cingulate cortex (ACC) [14,17,18].…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Age-related characteristics of risky decision-making and progressive expectation formation

Kardos

Kóbor

Takács

et al. 2016

Behavioural Brain Research

View full text Add to dashboard Cite

During daily encounters, it is inevitable that people take risks. Investigating the sequential processing of risk hazards involve expectation formation about outcome contingencies. The present study aimed to explore risk behavior and its neural correlates in sequences of decision making, particularly in old age, which represents a critical period regarding risk-taking propensity. The Balloon Analogue Risk Task was used in an electrophysiological setting with young and elderly age groups. During the task each additional pump on a virtual balloon increased the likelihood of a balloon burst but also increased the chance to collect more reward. Event-related potentials associated with rewarding feedback were analyzed based on the forthcoming decisions (whether to continue or to stop) in order to differentiate between states of expectation towards gain or loss. In the young, the reward positivity ERP component increased as a function of reward contingencies with the largest amplitude for rewarding feedback followed by the decision to stop. In the elderly, however, reward positivity did not reflect the effect of reward structure. Behavioral indices of risk-taking propensity suggest that the performance of the young and the elderly were dissociable only with respect to response times: The elderly was characterized by hesitation and more deliberative decision making throughout the experiment. These findings signify that sequential tracking of outcome contingencies has a key role in cost-efficient action planning and progressive expectation formation.Keywords: Aging; Decision making; Feedback-related ERPs; Reward positivity; Risk-taking behavior Whether we are aware of the fact or not, risk-taking behavior occurs more frequently during our everyday actions than generally thought. Besides those simple and common examples like taking only one more drink before driving, a temporary excursion from one's self-regulatory goals, i.e., risking the long-term goals for short-term advantages such as making a cheat in a diet, can be considered as a more complex form of 'gambling' [1]. Risk-taking behavior can be defined as a decision making propensity motivated by gain reward beside the possible opportunity to lose [2][3][4]. Since natural circumstances usually include continuous fluctuations in risk, the ability of making decisions based on the acquisition of action-outcome contingencies is an essential part of adaptive risk behavior [5]. In particular, old age represents a critical period due to substantial neurocognitive changes having an effect on both frontal cortical and subcortical brain areas known to be involved in decision making [6,7]. The question remains, however, whether there is a specific inability of the acquisition of relevant information behind the possibly reduced decision quality of the elderly.From the perspective of self-report questionnaires, elderly are characterized by higher risk-avoidance tendency [8]. However, regarding risk behavior, results show evidence for both normal and altered patterns of ...

show abstract

Section: Interpretation Of the Electrophysiological Resultssupporting

confidence: 63%

supporting

confidence: 57%

Section: Interpretation Of the Electrophysiological Resultsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Age-related characteristics of risky decision-making and progressive expectation formation

Kardos

Kóbor

Takács

et al. 2016

Behavioural Brain Research

View full text Add to dashboard Cite

show abstract

“…Neutral, perceptually common, stimuli that are systematically associated with a reward can acquire positive affective relevance. Theories in the neuroscience of motivation have proposed that attention is automatically oriented toward reward-associated stimuli (e.g., Bromberg-Martin, Matsumoto, & Hikosaka, 2010). According to the incentive salience hypothesis (Berridge & Robinson, 1998), the organism attributes incentive salience to stimuli associated with the reward through learning.…”

Section: Introductionmentioning

confidence: 99%

Where is the chocolate? Rapid spatial orienting toward stimuli associated with primary rewards

et al. 2014

View full text Add to dashboard Cite

a b s t r a c tSome stimuli can orient attentional resources and access awareness even if they appear outside the focus of voluntary attention. Stimuli with low-level perceptual salience and stimuli with an emotional content can modulate attention independently of voluntary processes. In Experiment 1, we used a spatial cuing task to investigate whether stimuli that are controlled for their perceptual salience can modulate the rapid orienting of attention based exclusively on their affective relevance. Affective relevance was manipulated through a Pavlovian conditioning paradigm in which an arbitrary and affectively neutral perceptual stimulus was associated with a primary reward (i.e., a chocolate odor). Results revealed that, after conditioning, attentional resources were rapidly oriented toward the stimulus that was previously associated with the reward. In Experiment 2, we used the very same conditioning procedure, but we devaluated the reward after conditioning for half of the participants through a sensory-specific satiation procedure. Strikingly, when the reward was devaluated, attention was no longer oriented toward reward-associated stimuli. Our findings therefore suggest that reward associations rapidly modulate visual processing independently of both voluntary processing and the perceptual salience of the stimulus. This supports the notion that stimuli associated with primary rewards modulate rapid attention orienting on the basis of the affective relevance of the stimulus.

show abstract

Association of Habitual Checking Behaviors on Social Media With Longitudinal Functional Brain Development

et al. 2023

View full text Add to dashboard Cite

ImportanceSocial media platforms provide adolescents with unprecedented opportunities for social interactions during a critical developmental period when the brain is especially sensitive to social feedback.ObjectiveTo explore how adolescents’ frequency of checking behaviors on social media platforms is associated with longitudinal changes in functional brain development across adolescence.Design, Setting, and ParticipantsA 3-year longitudinal cohort study of functional magnetic resonance imaging (fMRI) among sixth- and seventh-grade students recruited from 3 public middle schools in rural North Carolina.ExposuresAt wave 1, participants reported the frequency at which they checked Facebook, Instagram, and Snapchat.Main Outcome or MeasureNeural responses to the Social Incentive Delay task when anticipating receiving social feedback, measured annually using fMRI for 3 years. Participants saw a cue that indicated whether the social feedback (adolescent faces with emotional expressions) would be a reward, punishment, or neutral; after a delay, a target appeared and students responded by pressing a button as quickly as possible; a display of social feedback depended on trial type and reaction time.ResultsOf 178 participants recruited at age 12 years, 169 participants (mean [SD] age, 12.89 [0.58] years; range, 11.93-14.52 years; 91 [53.8%] female; 38 [22.5%] Black, 60 [35.5%] Latinx, 50 [29.6%] White, 15 [8.9%] multiracial) met the inclusion criteria. Participants with habitual social media checking behaviors showed lower neural sensitivity to social anticipation at age 12 years compared with those with nonhabitual checking behaviors in the left amygdala, posterior insula (PI), and ventral striatum (VS; β, −0.22; 95% CI, −0.33 to −0.11), right amygdala (β, −0.19; 95% CI, −0.30 to −0.08), right anterior insula (AI; β, −0.23; 95% CI, −0.37 to −0.09), and left dorsolateral prefrontal cortex (DLPFC; β, −0.29; 95% CI, −0.44 to −0.14). Among those with habitual checking behaviors, there were longitudinal increases in the left amygdala/PI/VS (β, 0.11; 95% CI, 0.04 to 0.18), right amygdala (β, 0.09; 95% CI, 0.02 to 0.16), right AI (β, 0.15; 95% CI, 0.02 to 0.20), and left DLPFC (β, 0.19; 95% CI, 0.05 to 0.25) during social anticipation, whereas among those with nonhabitual checking behaviors, longitudinal decreases were seen in the left amygdala/PI/VS (β, −0.12; 95% CI, −0.19 to −0.06), right amygdala (β, −0.10; 95% CI, −0.17 to −0.03), right AI (β, −0.13; 95% CI, −0.22 to −0.04), and left DLPFC (β, −0.10, 95% CI, −0.22 to −0.03).Conclusions and RelevanceThe results of this cohort study suggest that social media checking behaviors in early adolescence may be associated with changes in the brain’s sensitivity to social rewards and punishments. Further research examining long-term associations between social media use, adolescent neural development, and psychological adjustment is needed to understand the effects of a ubiquitous influence on development for today’s adolescents.

show abstract

Dopamine in Motivational Control: Rewarding, Aversive, and Alerting

Cited by 1,964 publications

References 262 publications

Age-related characteristics of risky decision-making and progressive expectation formation

Age-related characteristics of risky decision-making and progressive expectation formation

Where is the chocolate? Rapid spatial orienting toward stimuli associated with primary rewards

Association of Habitual Checking Behaviors on Social Media With Longitudinal Functional Brain Development

Contact Info

Product

Resources

About