Postconditioning devaluation of a reinforcer affects instrumental responding.

Colwill, Ruth M.; Rescorla, Robert A.

doi:10.1037/0097-7403.11.1.120

Cited by 310 publications

(298 citation statements)

References 35 publications

Supporting

Mentioning

281

Contrasting

Unclassified

Order By: Relevance

“…Only these environments would activate the VTA units and motor-association units that are specific to the operant. Behavioral research is consistent with this prediction; revaluation effects are context specific (e.g., Colwill & Rescorla, 1985).…”

Section: Specificity Of Devaluationsupporting

confidence: 65%

“…As an example (Colwill & Rescorla, 1985; see also Holland & Rescorla, 1975), rats acquired a lever-pressing response, which was maintained with food pellets as the reinforcer, delivered according to a variable-interval (VI) schedule. Following conditioning, food pellets were delivered in the same test chamber but with the lever inaccessible.…”

Section: Revaluationmentioning

confidence: 99%

“…First, consider a finding described when devaluation was introduced at the outset of this theoretical note; namely, devaluation is relatively specific to the particular reinforcer with which the aversive stimulus has been paired (Colwill & Rescorla, 1985). According to a biobehavioral interpretation of revaluation, extraconditioning manipulations affect the strength of an operant if they change reinforcer feedback.…”

Section: Specificity Of Devaluationmentioning

confidence: 99%

See 2 more Smart Citations

Behavior Analysis and Revaluation

Donahoe

Burgos

2000

J Exper Analysis Behavior

View full text Add to dashboard Cite

Revaluation refers to phenomena in which the strength of an operant is altered by reinforcer-related manipulations that take place outside the conditioning situation in which the operant was selected. As an example, if lever pressing is acquired using food as a reinforcer and food is later paired with an aversive stimulus, the frequency of lever pressing decreases when subsequently tested. Associationist psychology infers from such findings that conditioning produces a response-outcome (i.e., reinforcer) association and that the operant decreased in strength because pairing the reinforcer with the aversive stimulus changed the value of the outcome. Here, we present an approach to the interpretation of these and related findings that employs neural network simulations grounded in the experimental analysis of behavior and neuroscience. In so doing, we address some general issues regarding the relations among behavior analysis, neuroscience, and associationism.

show abstract

Section: Specificity Of Devaluationsupporting

confidence: 65%

Section: Revaluationmentioning

confidence: 99%

Section: Specificity Of Devaluationmentioning

confidence: 99%

See 1 more Smart Citation

Behavior Analysis and Revaluation

Donahoe

Burgos

2000

J Exper Analysis Behavior

View full text Add to dashboard Cite

show abstract

“…Subsequently, back 'online', a test is conducted in which choice between the two actions is assessed in the absence of the outcome. Typically, when given this choice, humans and other animals decrease their performance of the action that previously delivered the now devalued outcome, demonstrating that such actions reflect both the relationship to their consequences and the value of those consequences [6].…”

Section: Introductionmentioning

confidence: 99%

Habits as action sequences: hierarchical action control and changes in outcome value

Dezfouli

Lingawi

Balleine

2014

Phil. Trans. R. Soc. B

131

118

View full text Add to dashboard Cite

One contribution of 18 to a Theme Issue 'The principles of goal-directed decisionmaking: from neural mechanisms to computation and robotics'. Goal-directed action involves making high-level choices that are implemented using previously acquired action sequences to attain desired goals. Such a hierarchical schema is necessary for goal-directed actions to be scalable to real-life situations, but results in decision-making that is less flexible than when action sequences are unfolded and the decision-maker deliberates step-by-step over the outcome of each individual action. In particular, from this perspective, the offline revaluation of any outcomes that fall within action sequence boundaries will be invisible to the high-level planner resulting in decisions that are insensitive to such changes. Here, within the context of a two-stage decisionmaking task, we demonstrate that this property can explain the emergence of habits. Next, we show how this hierarchical account explains the insensitivity of over-trained actions to changes in outcome value. Finally, we provide new data that show that, under extended extinction conditions, habitual behaviour can revert to goal-directed control, presumably as a consequence of decomposing action sequences into single actions. This hierarchical view suggests that the development of action sequences and the insensitivity of actions to changes in outcome value are essentially two sides of the same coin, explaining why these two aspects of automatic behaviour involve a shared neural structure.

show abstract

“…Modern theories of learning have a strong cognitive component, with many experiments designed to examine the content of animals' knowledge and the information that animals acquire as a result of experience (e.g. Colwell & Rescorla 1985;Kamil 1987;Rescorla 1988;Lieberman 2003).…”

mentioning

confidence: 99%

The central importance of information in studies of animal communication

et al. 2010

View full text Add to dashboard Cite

Keywords:animal communication animal signal information information transmission language meaningThe concept of information plays a central role in studies of animal communication. Animals' responses to the calls of different individuals, to food calls, alarm calls, and to signals that predict behaviour, all suggest that recipients acquire information from signals and that this information affects their response. Some scientists, however, want to replace the concept of information with one based on the 'manipulation' of recipients by signallers through the induction of nervous-system responses. Here we review both theory and data that argue against hypotheses based exclusively on manipulation or on a fixed, obligatory link between a signal's physical features and the responses it elicits. Results from dozens of studies indicate that calls with 'arousing' or 'aversive' features may also contain information that affects receivers' responses; that acoustically similar calls can elicit different responses; acoustically different calls can elicit similar responses; and 'eavesdropping' animals respond to the relationship instantiated by signal sequences. Animal signals encode a surprisingly rich amount of information. The content of this information can be studied scientifically.

show abstract

Postconditioning devaluation of a reinforcer affects instrumental responding.

Cited by 310 publications

References 35 publications

Behavior Analysis and Revaluation

Behavior Analysis and Revaluation

Habits as action sequences: hierarchical action control and changes in outcome value

The central importance of information in studies of animal communication

Contact Info

Product

Resources

About