Nucleus accumbens dopamine depletions alter relative response allocation in a T-maze cost/benefit task

Cousins, Michael S.; Atherton, A.; Turner, Liliana Francis; Salamone, John D.

doi:10.1016/0166-4328(95)00151-4

Cited by 209 publications

(226 citation statements)

References 58 publications

Supporting

Mentioning

206

Contrasting

Unclassified

Order By: Relevance

“…Rats can choose between lever pressing on a FR5 schedule to obtain a preferred food or approaching and feeding upon a less preferred lab chow that is concurrently available. Untreated animals trained on this procedure generally receive most of their food by pressing the lever for food pellets and tend to eat little of the concurrently available but less preferred chow Cousins et al 1993Cousins et al , 1996Salamone et al 1995Nowend et al 2001;Farrar et al 2007). However, rats injected with low doses of DA antagonists or rats with accumbens DA depletions reallocate their behavior towards the less-effortful food-seeking behavior, i.e., animals with decreased lever pressing show a substantial increase in feeding upon the rodent chow Cousins et al 1993Sokolowski and Salamone 1998;Koch et al 2000;Nowend et al 2001).…”

Section: Discussionmentioning

confidence: 99%

“…For example, IP administration of CGS 21680 is likely to be stimulating neostriatal adenosine A 2A receptors, as well as those in nucleus accumbens. Several lines of evidence indicate that ventrolateral neostriatum (VLS) is a critical area in regulating orofacial and forepaw motor control (Heimer et al 1995;McGeorge and Faull 1989;Cousins et al 1996Cousins et al , 1999. Previous work has demonstrated that DA depletions in the VLS reduce both lever presses and chow consumption in rats responding on the concurrent FR5/chow intake task (Cousins et al 1993).…”

Section: Discussionmentioning

confidence: 99%

“…Furthermore, studies involving choice behavior have shown that rats administered DA receptor antagonists or rats with accumbens DA depletions reallocate their behavior away from food-reinforced tasks that have high response requirements and instead select less-effortful types of foodseeking behavior (Salamone et al , 1997(Salamone et al , 2003. Some of these studies utilized maze tasks to assess effort-related choice Cousins et al 1996;Denk et al 2005;Floresco et al 2007). In addition, several studies have employed a concurrent fixed ratio 5 (FR5)/chow-feeding procedure .…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Intra-accumbens injections of the adenosine A2A agonist CGS 21680 affect effort-related choice behavior in rats

et al. 2008

View full text Add to dashboard Cite

Rationale-Nucleus accumbens dopamine (DA) participates in the modulation of instrumental behavior, including aspects of behavioral activation and effort-related choice behavior. Rats with impaired accumbens DA transmission reallocate their behavior away from food-reinforced activities that have high response requirements and instead select less-effortful types of food-seeking behavior. Although accumbens DA is considered a critical component of the brain circuitry regulating effortrelated processes, emerging evidence also implicates adenosine A 2A receptors.Objective-The present work was undertaken to test the hypothesis that accumbens A 2A receptor stimulation would produce effects similar to those produced by DA depletion or antagonism.Materials and methods-Three experiments assessed the effects of the adenosine A 2A agonist CGS 21680 on performance of a concurrent choice task (lever pressing for preferred food vs. intake of less preferred chow) that is known to be sensitive to DA antagonists and accumbens DA depletions.Results-Systemic injections of CGS 21680 reduced lever pressing but did not increase feeding. In contrast, bilateral infusions of the adenosine A 2A receptor agonist CGS 21680 (6.0-24.0 ng) into the nucleus accumbens decreased lever pressing for the preferred food but substantially increased consumption of the less preferred chow. Injections of CGS 21680 into a control site dorsal to the accumbens were ineffective.Conclusions-Taken together, these results are consistent with the hypothesis that local stimulation of adenosine A 2A receptors in nucleus accumbens produces behavioral effects similar to those induced by accumbens DA depletions. Accumbens adenosine A 2A receptors appear to be a component of the brain circuitry regulating effort-related choice behavior.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Intra-accumbens injections of the adenosine A2A agonist CGS 21680 affect effort-related choice behavior in rats

et al. 2008

View full text Add to dashboard Cite

show abstract

“…We modeled the T-maze with barrier task in Cousins et al (1996) by assuming a single state, and two possible actions (left arm, right arm). The left arm choice deterministically provided r ϭ 4 pellets, while the right arm choice deterministically provided either r ϭ 0 or 2.…”

Section: Motivation and Incentive Effects On Effort-based Decision Mamentioning

confidence: 99%

“…LP ϭ lever press; DA ϭ dopamine; HD ϭ high density food; BL ϭ baseline; Veh ϭ group injected with vehicle; 6-OHDA ϭ group injected with 6-hydroxydopamine. Dayan, 2007, Psychopharmacology, 191, p. Salamone, 1996, Behavioural Brain Research, 74, p. 192. Copyright 1996 This document is copyrighted by the American Psychological Association or one of its allied publishers.…”

Section: Learning and Performance Interactive Effects On Motor Skillsmentioning

confidence: 99%

Opponent actor learning (OpAL): Modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive.

Collins¹,

Frank²

2014

Psychological Review

390

455

View full text Add to dashboard Cite

The striatal dopaminergic system has been implicated in reinforcement learning (RL), motor performance, and incentive motivation. Various computational models have been proposed to account for each of these effects individually, but a formal analysis of their interactions is lacking. Here we present a novel algorithmic model expanding the classical actor-critic architecture to include fundamental interactive properties of neural circuit models, incorporating both incentive and learning effects into a single theoretical framework. The standard actor is replaced by a dual opponent actor system representing distinct striatal populations, which come to differentially specialize in discriminating positive and negative action values. Dopamine modulates the degree to which each actor component contributes to both learning and choice discriminations. In contrast to standard frameworks, this model simultaneously captures documented effects of dopamine on both learning and choice incentive-and their interactions-across a variety of studies, including probabilistic RL, effort-based choice, and motor skill learning.Keywords: dopamine, striatum, reinforcement learning, choice incentive, computational model Dopamine plays a crucial role in human and animal cognition, substantially influencing a diversity of processes including reinforcement learning, motivation, incentive, working memory, and effort. Dopaminergic neurons in the substantial nigra and ventral tegmental area project to a very wide set of subcortical and cortical areas, with strongest innervation in the basal ganglia (BG), specifically in the ventral and dorsal striatum. Dysregulation of dopamine is present in a wide array of mental illnesses such as Parkinson's disease, attention-deficit/hyperactivity disorder (ADHD), schizophrenia, and Tourette's syndrome and is a central pharmaceutical target used to treat symptoms across these and numerous other pathologies.Although considerable progress has been made in our understanding of its various distinct roles, there remain fundamental debates concerning its precise mechanisms and functions, especially regarding their integration and interactions. In reward-based decision making in particular, two largely separate traditions have studied the reinforcement learning and the incentive theories of dopamine (Berridge, 2007). Despite solid evidence for both theories, theoretical and empirical studies tend to favor and focus on one or the other interpretation, with little attempt to unify them or to study their interaction. Here we develop an explicit computational analysis of the dual role of striatal dopamine in modulation of incentive motivation (affecting choice), reinforcement learning, and how these processes interact. This endeavor allows us not only to account for both types of findings alone but also those that could not be explained by either theory in isolation. RL Theory of DopamineOne widely accepted theory of dopamine function relates to its role in model-free reinforcement learning (RL). Specifically, phasic f...

show abstract

The nucleus accumbens and learning and memory

Setlow

1997

J. Neurosci. Res.

107

View full text Add to dashboard Cite

Recent research on the nucleus accumbens (NA) indicates that this brain region is involved in learning and memory processes in a way that is separable from its other well-known roles in behavior, such as motivation, reward, and locomotor activity. These findings have suggested that 1) the NA may be involved in declarative, or hippocampal formation-dependent learning and memory, and not in several other non-declarative forms of learning and memory, and 2) the NA may be selectively involved in certain stages of learning and memory. These characteristics suggest that the NA may be part of a larger striatal system which subserves acquisition and consolidation, but is not a site of long-term storage, of different forms of learning and memory.

show abstract

Nucleus accumbens dopamine depletions alter relative response allocation in a T-maze cost/benefit task

Cited by 209 publications

References 58 publications

Intra-accumbens injections of the adenosine A2A agonist CGS 21680 affect effort-related choice behavior in rats

Intra-accumbens injections of the adenosine A2A agonist CGS 21680 affect effort-related choice behavior in rats

Opponent actor learning (OpAL): Modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive.

The nucleus accumbens and learning and memory

Contact Info

Product

Resources

About