Intrinsic reinforcing properties of putatively neutral stimuli in an instrumental two-lever discrimination task

Reed, Phil; Mitchell, Chris; Nokes, T.

doi:10.3758/bf03198952

Cited by 63 publications

(37 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Others have reported an impact of cue modality on responding, where a light cue is capable of eliciting greater responding than a tone cue (Baron and Kish, 1962;Di Ciano and Everitt, 2003;Panlilio and Schindler, 1997;Reed et al, 1996;See et al, 1999). We found that a light was more effective than a tone during cocaine SA and reinstatement, as well as during training in the cue-only condition.…”

Section: Activation Of Action-outcome Habitssupporting

confidence: 54%

Novel Cues Reinstate Cocaine-Seeking Behavior and Induce Fos Protein Expression as Effectively as Conditioned Cues

Bastle

Kufahl

Turk

et al. 2012

Neuropsychopharmacol

View full text Add to dashboard Cite

Cue reinstatement of extinguished cocaine-seeking behavior is a widely used model of cue-elicited craving in abstinent human addicts. This study examined Fos protein expression in response to cocaine cues or to novel cues as a control for activation produced by test novelty. Rats were trained to self-administer cocaine paired with either a light or a tone cue, or received yoked saline and cue presentations, and then underwent daily extinction training. They were then tested for reinstatement of extinguished cocaine-seeking behavior elicited by response-contingent presentations of either the cocaine-paired cue or a novel cue (that is, tone for those trained with a light or vice versa). Surprisingly, conditioned and novel cues both reinstated responding and increased Fos similarly in most brain regions. Exceptions included the anterior cingulate, which was sensitive to test cue modality in saline controls and the dorsomedial caudate-putamen, where Fos was correlated with responding in the novel, but not conditioned, cue groups. In subsequent experiments, we observed a similar pattern of reinstatement in rats trained and tested for sucrose-seeking behavior, whereas rats trained and tested with the cues only reinstated to a novel, and not a familiar, light or tone. The results suggest that novel cues reinstate responding to a similar extent as conditioned cues regardless of whether animals have a reinforcement history with cocaine or sucrose, and that both types of cues activate similar brain circuits. Several explanations as to why converging processes may drive drug and novel cue reinforcement and seeking behavior are discussed.

show abstract

Section: Activation Of Action-outcome Habitssupporting

confidence: 54%

Novel Cues Reinstate Cocaine-Seeking Behavior and Induce Fos Protein Expression as Effectively as Conditioned Cues

Bastle

Kufahl

Turk

et al. 2012

Neuropsychopharmacol

View full text Add to dashboard Cite

show abstract

“…Second, also involving memory processing stages, the dopamine detection component is enhanced by stimulus novelty (conferring novelty salience) (322) or surprise (conferring surprise salience) (255,286,345). Although novelty may constitute outright reward (458), dopamine neurons are not activated by novelty per se but require stimuli with sufficient sensory impact. The neurons do not respond to small novel stimuli, even though they show prediction error responses to the same small stimuli after learning (597,618).…”

Section: Dopamine Event Detection Responsementioning

confidence: 99%

Neuronal Reward and Decision Signals: From Theories to Data

Schultz

2015

Physiological Reviews

926

765

View full text Add to dashboard Cite

LSchultz W. Neuronal Reward and Decision Signals: From Theories to Data. Physiol Rev 95: 853-951, 2015. Published June 24, 2015 doi:10.1152/physrev.00023.2014.-Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act.

show abstract

“…However, this activation extinguishes more or less quickly as the stimuli become familiar. This may underlie the fact that novelty itself has rewarding characteristics [7]. These connections are key components of our approach to intrinsically motivated RL.…”

Section: Supplementary Notesmentioning

confidence: 99%

Intrinsically Motivated Reinforcement Learning

2005

View full text Add to dashboard Cite

Psychologists call behavior intrinsically motivated when it is engaged in for its own sake rather than as a step toward solving a specific problem of clear practical value. But what we learn during intrinsically motivated behavior is essential for our development as competent autonomous entities able to efficiently solve a wide range of practical problems as they arise. In this paper we present initial results from a computational study of intrinsically motivated reinforcement learning aimed at allowing artificial agents to construct and extend hierarchies of reusable skills that are needed for competent autonomy.

show abstract

Intrinsic reinforcing properties of putatively neutral stimuli in an instrumental two-lever discrimination task

Cited by 63 publications

References 15 publications

Novel Cues Reinstate Cocaine-Seeking Behavior and Induce Fos Protein Expression as Effectively as Conditioned Cues

Novel Cues Reinstate Cocaine-Seeking Behavior and Induce Fos Protein Expression as Effectively as Conditioned Cues

Neuronal Reward and Decision Signals: From Theories to Data

Intrinsically Motivated Reinforcement Learning

Contact Info

Product

Resources

About