Overlearning and Reversal of a Spatial Discrimination by Rats

Clayton, Keith N.

doi:10.2466/pms.1963.17.1.83

Cited by 15 publications

(3 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In fact, experiments following Reid's initial demonstration presented a more complex picture (see [34] for review). While some learning studies replicated the ORE [48], others found no effect of overtraining on reversal [49] and some found that overtraining did indeed slow reversal [50]. Such mixed results highlighted the critical dependence of the ORE on factors such as the size of reward and criterion of learning [51].…”

Section: The Overtraining Reversal Effectmentioning

confidence: 99%

Context-dependent decision-making: a simple Bayesian model

Lloyd

Leslie

2013

J. R. Soc. Interface.

View full text Add to dashboard Cite

Many phenomena in animal learning can be explained by a context-learning process whereby an animal learns about different patterns of relationship between environmental variables. Differentiating between such environmental regimes or 'contexts' allows an animal to rapidly adapt its behaviour when context changes occur. The current work views animals as making sequential inferences about current context identity in a world assumed to be relatively stable but also capable of rapid switches to previously observed or entirely new contexts. We describe a novel decision-making model in which contexts are assumed to follow a Chinese restaurant process with inertia and full Bayesian inference is approximated by a sequential-sampling scheme in which only a single hypothesis about current context is maintained. Actions are selected via Thompson sampling, allowing uncertainty in parameters to drive exploration in a straightforward manner. The model is tested on simple two-alternative choice problems with switching reinforcement schedules and the results compared with rat behavioural data from a number of T-maze studies. The model successfully replicates a number of important behavioural effects: spontaneous recovery, the effect of partial reinforcement on extinction and reversal, the overtraining reversal effect, and serial reversal-learning effects.

show abstract

Section: The Overtraining Reversal Effectmentioning

confidence: 99%

Context-dependent decision-making: a simple Bayesian model

Lloyd

Leslie

2013

J. R. Soc. Interface.

View full text Add to dashboard Cite

show abstract

“…access to food. But Clayton (1963) used 10-sec. access to food in a spatial study and found no ORE; while Mackintosh (1965b), also using 10-sec.…”

Section: Reward Size and Frustrationmentioning

confidence: 99%

Further analysis of the overtraining reversal effect.

Mackintosh¹

1969

Journal of Comparative and Physiological Psychology

View full text Add to dashboard Cite

An analysis of previous studies of overtraining and reversal learning in rats suggests that overtraining has only facilitated reversal when the discrimination has been a relatively difficult one and the reward used has been relatively large. The results of three experiments support this conclusion. In the first, overtraining had no significant effect on the reversal of an easy position problem, whether a small or a large reward was used; while in the second, using the same procedures and large reward, overtraining facilitated reversal of a visual problem. In the third experiment, rats were trained on an easy or on a hard visual problem with either a small or large reward; only /Ss trained on the hard problem with the large reward reversed faster after overtraining. A two-stage attentional model is better able to explain these results than are either frustration theory or a combination of attention and frustration theories.

show abstract

“…Nine of these agreed with the general correlation in the simulations, in that slow original learning led to an ORE, while fast original learning led to the opposite of an ORE (Brookshire, Warren, & Ball, 1961;Bruner, Handler, O'Dowd, & Wallach, 1958;Hill & Spear, 1963;Komaki, 1961;Mackintosh, 1962Mackintosh, , 1963aPubols, 1956;Reid, 1953;Williams, 1942). Five experiments did not support the correlation (Clayton, 1963;D'Amato & Jagoda, 1961D'Amato & Schiff, 1964;Erlebacher, 1963). In addition, eight other experiments offer support to the simulation on ORE, although their designs make the interpretation somewhat more uncertain than for those previously cited (Capaldi, 1963;Hill, Spear, & Clayton, 1962;Ison & Birch, 1961;Mackintosh, 1963bMackintosh, , 1965North & Clayton, 1959;Theios & Blosser, 1965;Wike, Blocher, & Knowles, 1963).…”

Section: Resultsmentioning

confidence: 60%