Neural mechanisms of credit assignment for inferred relationships in a structured world

Witkowski, Phillip; Park, Seongmin A.; Boorman, Erie D.

doi:10.1016/j.neuron.2022.05.021

Cited by 18 publications

(23 citation statements)

References 78 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…3). These findings were consistent with the previous proposal that the mOFC and lOFC collectively responded to the same decision-related variables (Suzuki et al, 2017;Witkowski et al, 2022;Xue et al, 2022) and this information influenced the final decisions (Kobayashi et al, 2022;Setogawa et al, 2019).…”

Section: Representation Of the Inferred Outcomes In The Mofc And Lofcsupporting

confidence: 92%

“…However, several studies did not find functional specializations of these two subregions in decision-making and showed that both subregions represent the subjective value (Suzuki et al, 2017) as well as the health/taste valuation (Xue et al, 2022). Moreover, several studies that did not intentionally distinguish between general and specific codings also found that both the OFC subregions represented and tracked inferred outcomes Witkowski et al, 2022). Therefore, the variability in the previous findings indicates that it is necessary to investigate the exact information representation of the mOFC and lOFC in decision-making.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Differential roles of the medial and lateral orbitofrontal cortex in decision-making

Qiu

Qiu²,

Liao³

et al. 2023

Preprint

View full text Add to dashboard Cite

Inferring potential outcomes and updating behavior are prerequisites for making flexible decisions. These abilities are highly associated with the functions of the orbitofrontal cortex (OFC). Previous studies proposed that the lateral OFC (lOFC) infers the potential outcomes and the medial OFC (mOFC) encodes the general information to guide behavior. However, recent works suggested that both these two subregions responded to the same decision-related variable. Therefore, the exact roles of mOFC and lOFC in decision-making remain unclear. To study this issue, we conducted an inference-based decision-making experiment combining with functional magnetic resonance imaging techniques. Here we found that both the mOFC and lOFC represented the inferred outcomes, but only the lOFC was responsible for the outcome inference. Although the inferred outcomes were decodable in both subregions, the outcome in the mOFC was context-general coding, whereas it was context-specific in lOFC. Moreover, the functional coupling analysis showed that the mOFC may update behavior through sensory mediation and motor execution, whereas the lOFC may update behavior through task rule retrieving, alertness maintaining, and motor planning. We concluded that the OFC subregions may be collectively activated in decision-making, but their exact roles can be dissociable.

show abstract

Section: Representation Of the Inferred Outcomes In The Mofc And Lofcsupporting

confidence: 92%

Section: Introductionmentioning

confidence: 99%

Differential roles of the medial and lateral orbitofrontal cortex in decision-making

Qiu

Qiu²,

Liao³

et al. 2023

Preprint

View full text Add to dashboard Cite

show abstract

“…The most flexible system for assigning utility to the environment or one's actions is model-based learning. At the computational level, model-based RL requires a more complete understanding of the environment structure [5][6][7][8]. Interactions between midbrain dopamine areas and the striatum are thought to provide the substrate for reward predictions (value), which could largely influence goal-directed processes.…”

Section: ½1mentioning

confidence: 99%

Goals, usefulness and abstraction in value-based choice

Martino

Cortese

2023

Trends in Cognitive Sciences

View full text Add to dashboard Cite

“…This type of error signal is distinct from reward prediction error, and encodes discrepancies between an agent's expectation about which stimulus will occur and which stimulus actually occurs, irrespective of the amount of reward or value involved. Such error signals have been found to be present in many brain areas in human fMRI studies, including a frontoparietal network encompassing dorsomedial prefrontal cortex, as well as in dopaminergic regions of the midbrain, the OFC and striatum (Gläscher et al 2010, Rushworth et al 2011, Lee et al 2014, Howard & Kahnt 2018, Witkowski et al 2022. In rodents, dopamine neurons themselves have been suggested to be sensitive to violations in predicted identity beyond value, and are even found to be necessary for the acquisition of learned predictions about stimulus identity (Chang et al 2017, Takahashi et al 2017.…”

Section: Introductionmentioning

confidence: 99%

“…Such error signals have been found to be present in many brain areas in human fMRI studies, including a frontoparietal network encompassing dorsomedial prefrontal cortex, as well as in dopaminergic regions of the midbrain, the OFC and striatum. 23,30,[32][33][34][35] In rodents, dopamine neurons themselves have been suggested to be sensitive to violations in predicted identity beyond value, and are even found to be necessary for the acquisition of learned predictions about stimulus identity. 29,36 The goal of the present study was to investigate neural representations of multiple forms of Pavlovian associative learning at the cellular level in humans.…”

Section: Introductionmentioning

confidence: 99%

Encoding of predictive associations in human prefrontal and medial temporal neurons during Pavlovian conditioning

Aquino

Courellis

Mamelak

et al. 2023

Preprint

View full text Add to dashboard Cite

Pavlovian conditioning is thought to involve the formation of learned associations between stimuli and values, and between stimuli and specific features of outcomes. Here we leveraged human single neuron recordings in ventromedial prefrontal, dorsomedial frontal, hippocampus and amygdala neurons while patients performed a sequential Pavlovian conditioning task containing both stimulus-value and stimulus-stimulus associations. Neurons in the ventromedial prefrontal cortex encoded predictive value along with the amygdala, but also encoded predictions about the identity of stimuli that would subsequently be presented, suggesting a role for neurons in this region in encoding predictive information beyond value. Unsigned error signals were found in dorsomedial prefrontal areas and hippocampus, potentially supporting learning of non-value related outcome features. Our findings implicate distinct human prefrontal and medial temporal neuronal populations in mediating predictive associations which could partially support model-based mechanisms during Pavlovian conditioning.

show abstract

Neural mechanisms of credit assignment for inferred relationships in a structured world

Cited by 18 publications

References 78 publications

Differential roles of the medial and lateral orbitofrontal cortex in decision-making

Differential roles of the medial and lateral orbitofrontal cortex in decision-making

Goals, usefulness and abstraction in value-based choice

Encoding of predictive associations in human prefrontal and medial temporal neurons during Pavlovian conditioning

Contact Info

Product

Resources

About