Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning

Schad, Daniel J.; Jünger, Elisabeth; Sebold, Miriam; Garbusow, Maria; Bernhardt, Nadine; Javadi, Amir‐Homayoun; Zimmermann, U.; Smolka, Michael N.; Heinz, Andreas; Rapp, Michael A.; Huys, Quentin J. M.

doi:10.3389/fpsyg.2014.01450

Cited by 79 publications

(100 citation statements)

References 56 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…This is in agreement with the human goaldirected system appearing more malleable by state factors ranging from stress (12) and dopamine (13) to trait variables such as IQ (14). To fully establish the suggestion that a shift toward bias is an endophenotype, it will be necessary to further disentangle and understand the antecedents of the tradeoff between goals and habits.…”

supporting

confidence: 53%

Failure Modes of the Will: From Goals to Habits to Compulsions?

Huys¹,

Petzschner²

2015

AJP

View full text Add to dashboard Cite

Time present and time past Are both perhaps present in time future, And time future contained in time past. -T.S. EliotGood decisions reflect the past and improve the future. Trouble ensues when the rewards of the past conflict with the goals of the future. New goals often fail to override behaviors reinforced in the past, for instance, when patients with obsessive-compulsive disorder (OCD) try to stop the counting behavior that has been their main strategy to avoid aversive intrusions.Decision-making theories that emphasize the existence of two decision systems working in parallel provide one fruitful multidisciplinary route for understanding the origin of this conflict (1, 2): while habits reflect rewards of the past lengthily accumulated over multiple repetitions, goal-directed decisions capture aims based on the current, more malleable understanding of the world (2). In certain disorders, such as those of impulsivity and compulsivity, an individual's explicit aims appear to repeatedly fall prey to his or her engrained behaviors, suggesting an alteration in the adaptive tradeoff between prospective goals and retrospective habits (3,4).In this issue of the Journal, Gillan et al. (5) add to an impressive catalog of studies on the im-balance between habitual and goal-directed decisions in OCD. Roughly speaking, these studies assess how easily we overcome habits-established through repeated pursuit of an old goal-when a novel goal arises. Gillan et al. have previously shown that patients with OCD have a tendency to establish habits faster than comparison subjects when pursuing rewards (6, 7) and, critically, also when avoiding punishments. Gillan et al. (8) first explained to participants that two visual stimuli, say L and R, would be followed by shocks to their left or right wrist, respectively. A third stimulus, S, signaled safety. Participants could avoid the shock to the wrist threatened by the stimulus by pressing a foot-key with the respective foot (e.g., the left key for stimulus L). A training period in which participants repeatedly avoided the shocks predicted for both wrists was then followed by an instructed devaluation, where the shock electrode was demonstratively disconnected from the left wrist. Participants were explicitly instructed that they would no longer be shocked on the left wrist and that their only goal was to avoid the remaining shocks. Habitual avoidance was measured by the tendency to continue pressing the left footkey when seeing the now devalued stimulus L, despite knowing that this effort was unnecessary because the electrode had been disconnected. OCD patients were more than four times as likely to continue avoiding, indicating that they had established stronger habits than comparison subjects over the training period. There was no difference in the understanding of the devaluation, suggesting that avoidance was not driven by a goal-directed response to an overestimated shock probability. In their present study in this issue, Gillan et al. replicate these findings and extend them wi...

show abstract

supporting

confidence: 53%

Failure Modes of the Will: From Goals to Habits to Compulsions?

Huys¹,

Petzschner²

2015

AJP

View full text Add to dashboard Cite

show abstract

“…Model-based control also depends on individual cognitive capacity (e.g. processing speed and dual task performance) (68,69). Outcome manipulations also appear to preferentially affect the model-based system.…”

Section: Characteristics Of Multi-step Tasksmentioning

confidence: 98%

Model-Based Control in Dimensional Psychiatry

Voon

Reiter

Sebold

et al. 2017

Biological Psychiatry

Self Cite

102

105

View full text Add to dashboard Cite

“…Furthermore, transient inactivation of DLPFC with transcranial magnetic stimulation -a manipulation known to impair norm-based decision-making [12] and amplify model-free striatal reward signals [49] -leads to a predominance of model-free over model-based choice behavior [59]. showing that processing speed, cognitive control, and other DLPFC-dependent executive capacities are positively associated with model-based behavioral control [60,61].…”

Section: Model-free and Model-based Decisionmakingmentioning

confidence: 98%