Cortical delta activity reflects reward prediction error and related behavioral adjustments, but at different times

Cavanagh, James F.

doi:10.1016/j.neuroimage.2015.02.007

Cited by 118 publications

(127 citation statements)

References 72 publications

(103 reference statements)

Supporting

Mentioning

102

Contrasting

Order By: Relevance

“…This effect occurred in the delta frequency, as demonstrated both by the similarity of the delta filtered waveform to the broad frequency parent, and the fact that a significant interaction of RPE size and valence was present in the delta filtered waveform but not the theta. This effect was also shown in a recent study by Cavanagh (2015), although the absence of a -RPE condition in that study means that a salience response cannot be ruled out. In theta, as can be seen in Figure 9, the oscillations of +RPE and -RPE waveforms are largely in phase, thus sensitivity to RPE size is same-signed at any given time, indicating a salience response.…”

Section: Discussionsupporting

confidence: 76%

Principal components analysis of reward prediction errors in a reinforcement learning task

Sambrook

Goslin

2016

NeuroImage

View full text Add to dashboard Cite

Models of reinforcement learning represent reward and punishment in terms of reward prediction errors (RPEs), quantitative signed terms describing the degree to which outcomes are better than expected (positive RPEs) or worse (negative RPEs). An electrophysiological component known as feedback related negativity (FRN) occurs at frontocentral sites 240-340 ms after feedback on whether a reward or punishment is obtained, and has been claimed to neurally encode an RPE. An outstanding question however, is whether the FRN is sensitive to the size of both positive RPEs and negative RPEs. Previous attempts to answer this question have examined the simple effects of RPE size for positive RPEs and negative RPEs separately. However, this methodology can be compromised by overlap from components coding for unsigned prediction error size, or "salience", which are sensitive to the absolute size of a prediction error but not its valence. In our study, positive and negative RPEs were parametrically modulated using both reward likelihood and magnitude, with principal components analysis used to separate out overlying components. This revealed a single RPE encoding component responsive to the size of positive RPEs, peaking at ~330 ms, and occupying the delta frequency band. Other components responsive to unsigned prediction error size were shown, but no component sensitive to negative RPE size was found.

show abstract

Section: Discussionsupporting

confidence: 76%

Principal components analysis of reward prediction errors in a reinforcement learning task

Sambrook

Goslin

2016

NeuroImage

View full text Add to dashboard Cite

show abstract

“…From this perspective, our finding that symptoms of DMDD were prospectively associated with an enhanced RewP in response to monetary reward is inconsistent with evidence suggesting that chronic irritability is associated with impaired reward learning (Adleman et al, 2011). However, there is emerging evidence in both adults (Cavanagh 2015) and children (Hämmerer et al 2010) to suggest that the RewP is specific to surprising rewarding events and may not be directly associated with behavioral adjustments. Rather, the RewP may encode and classify whether an outcome is beneficial to a predefined goal (Hämmerer et al 2010).…”

contrasting

confidence: 68%

Longitudinal Associations Between Preschool Disruptive Mood Dysregulation Disorder Symptoms and Neural Reactivity to Monetary Reward During Preadolescence

Kessel

Dougherty

Kujawa

et al. 2016

Journal of Child and Adolescent Psychopharmacology

View full text Add to dashboard Cite

Objective: Reward-processing abnormalities are thought to be a key feature of various psychiatric disorders and may also play a role in disruptive mood dysregulation disorder (DMDD), a new diagnosis in DSM-5. In the current study, we used eventrelated potentials (ERP) sensitive to monetary gains (i.e., the reward positivity [RewP]) and losses (i.e., the N200) to examine associations between symptoms of DMDD during early childhood and later reward processing during preadolescence. Methods: To assess early emerging DMDD symptoms in a large longitudinal community sample (n = 373) of 3-year old children, we administered a diagnostic interview, Preschool Age Psychiatric Assessment (PAPA) with parents. At a later assessment, *6 years later, children completed a monetary reward task while an electroencephalogram (EEG) was recorded. Children's lifetime history of psychopathology was also assessed at that time using Kiddie-Schedule of Affective Disorders and Schizophrenia (K-SADS) with the child and parent. Results: Multiple regression analyses revealed that age 3 DMDD symptoms predicted an enhanced RewP to monetary rewards in preadolescence. This association is independent of demographics and lifetime history of symptoms of depression, any anxiety disorder, attention-deficit disorder, oppositional defiant disorder, or conduct disorder Conclusions: Early manifestations of DMDD in children as young as 3 years old predicted enhanced reward processing later in development. These findings add to the growing corpus of literature on the pathophysiology of DMDD, and underscore the predictive validity of preschool DMDD on a neural level.

show abstract

“…Furthermore, the literature on the RewP and behavioral adjustment is mixed, with some studies reporting associations (Cohen & Ranganath, 2007) and other studies finding no relationship (Chase, Swainson, Durham, Benham, & Cools, 2011). Future attempts to replicate these findings should consider using experimental tasks that better assess reward-related behavioral adjustments (e.g., Cavanagh, 2015). The present study had several limitations that warrant consideration.…”

Section: Discussionmentioning

confidence: 79%

The impact of an unpredictable context and intolerance of uncertainty on the electrocortical response to monetary gains and losses

Nelson

Kessel

Jackson

et al. 2015

Cogn Affect Behav Neurosci

View full text Add to dashboard Cite

There is growing evidence that unpredictability and uncertainty can alter reward system functioning. The present study examined the impact of (1) a task-irrelevant unpredictable relative to predictable context and (2) individual differences in intolerance of uncertainty (IU) on the reward-related positivity (RewP), an event-related potential (ERP) response to monetary gains relative to losses. Specifically, 64 participants listened to predictable and unpredictable tone sequences while electroencephalography was recorded during a monetary gambling task. Participants also completed the Intolerance of Uncertainty Scale, which measures both cognitive distress (prospective IU) and behavioral inhibition (inhibitory IU) elicited by uncertainty, in addition to the Depression Anxiety Stress Scale-21 and Penn State Worry Questionnaire. Results indicated that the RewP was reduced during the unpredictable relative to the predictable context. Greater selfreported anxiety elicited by the unpredictable context was associated with a decreased RewP, and a decreased RewP was associated with poorer lose-shift behavioral adjustment. Furthermore, the RewP mediated the relationship between selfreported anxiety elicited by the unpredictable context and lose-shift behavioral adjustment. The IU subscales demonstrated the opposite relationship with the RewP across both contexts-inhibitory IU was associated with an attenuated RewP and prospective IU was associated with an enhanced RewP. In contrast, anxiety, depression, stress, and worry symptomatology were not associated with the RewP. This is the first study to demonstrate that an unpredictable context and individual differences in the degree to which people cannot tolerate uncertainty impact an ERP measure of reward system functioning.

show abstract

Cortical delta activity reflects reward prediction error and related behavioral adjustments, but at different times

Cited by 118 publications

References 72 publications

Principal components analysis of reward prediction errors in a reinforcement learning task

Principal components analysis of reward prediction errors in a reinforcement learning task

Longitudinal Associations Between Preschool Disruptive Mood Dysregulation Disorder Symptoms and Neural Reactivity to Monetary Reward During Preadolescence

The impact of an unpredictable context and intolerance of uncertainty on the electrocortical response to monetary gains and losses

Contact Info

Product

Resources

About