Sensitivity to pre- and post-reinforcer delays in self-control choice

Yamaguchi, Tetsuo; Saeki, Daisuke; Ito, Masato

doi:10.1016/j.beproc.2015.09.012

Cited by 4 publications

(4 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although there are only few studies on post-reinforcer delays, some previous studies did report that the post-reinforcer delay affects choice (Mazur, 2006;Yamaguchi et al, 2015). Mazur (2006) concluded that short choice periods increased the sensitivity to post-reinforcer delays in concurrent-chains schedules.…”

Section: Discussionmentioning

confidence: 99%

“…Accumulating evidence clearly indicates that the length of choice periods and pre-reinforcer delay have a major impact on choice (Fantino, 1969;MacEwen, 1972;Williams and Fantino, 1978). On the other hand, it has been scarcely examined the effect of post-reinforce delays (Mazur, 2006;Yamaguchi, Saeki, and Ito, 2015). In fact, researchers have assumed that post-reinforcement delays have little effect on choice, and they are thus often used to control the reinforcement rate between alternatives.…”

Section: Introductionmentioning

confidence: 99%

“…In fact, researchers have assumed that post-reinforcement delays have little effect on choice, and they are thus often used to control the reinforcement rate between alternatives. However, Yamaguchi et al (2015) compared the effects of pre-and postreinforcement delays on choice using a concurrent-chains schedule in rats. Their results revealed show that the post-reinforcement delay did affect choice, although its effect was smaller than that of the pre-reinforcer delay.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Effect of initial-link length on the sensitivity of the post-reinforcer delay

Hata¹

2020

Preprint

View full text Add to dashboard Cite

For a long time, post-reinforcer delays have been considered to have no effect on choice. The most influential choice models therefore do not consider such delays. Recently, however, some studies reported that post-reinforcer delays affect choice behavior in pigeons. One such study (Mazur, 2006) concluded that a short initial link increases the sensitivity to post-reinforcer delays in concurrent-chains schedules. However, this study did not use typical concurrent-chains schedule procedures, in which the number of reinforcements differs between alternatives, and did not systematically analyze the effect of the systematic post-reinforcer delay. The current study therefore examined whether the length of the initial link modulates the post-reinforcer delay effect on choice with standard concurrent-chains schedules and by systematically varying both the initial link and the post-reinforcer delay. As the results, the shorter the initial link length, the larger the effect of the post-reinforcer delay. Models with post-reinforcer delays predicted choice behavior better than models without, but pigeons were more insensitive to delays than the model prediction for long initial links. These findings provide important information for models on choice, and suggest that experiments should be designed with more caution with regards to post-reinforcer delays.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Effect of initial-link length on the sensitivity of the post-reinforcer delay

Hata¹

2020

Preprint

View full text Add to dashboard Cite

show abstract

“…This is in line with observations that several animal species exhibit a level of self-control that is best explained by maximization of the short-term reward rate, which is insensitive to PRD and ITI (i.e., reward amount divided by reward delay; starlings [ Sturnus vulgaris ]: Bateson & Kacelnik, 1996; blue jays [ Cyanocitta cristata ]: Stephens & Anderson, 2001; tamarins [ Saguinus oedipus ]: Stevens et al, 2005). Indeed, some studies have shown that animals are sensitive to PRD to some extent, but the sensitivity to PRD is much smaller than the sensitivity to the reward amount and delay (e.g., pigeons [ Columba livia ]: Hata & Saeki, 2018; Logue et al, 1985; rats [ Rattus norvegicus ]: Yamaguchi et al, 2015). If the difference in PRD between two options is ignored, the long-term reward rate obtained by choosing either option would be misestimated, which may be consistent with the hyperbolically discounted value derived from ITC behavior in many species (Hwang et al, 2009; Kirby & Maraković, 1995; Mazur & Biondi, 2009).…”

mentioning

confidence: 99%

Computerized intertemporal choice task in chimpanzees (Pan troglodytes) with/without postreward delay.

Sato¹,

Sakai²,

Hirata³

2021

Journal of Comparative Psychology

View full text Add to dashboard Cite

In intertemporal choice (ITC) tasks, animals are presented with alternative choices between a smaller reward that becomes available sooner and a larger reward that becomes available later. To equate the duration of a trial across the 2 options, postreward delays (PRDs) are inserted after the delivery of the reward. Animals need to incorporate this to increase the long-term reward rate. However, recent studies suggest that they have difficulty understanding the contingency associated with PRDs. Previous research indicates that chimpanzees exhibit particularly great self-control in ITC tasks, but it remains unclear whether chimpanzees do so when considering PRDs. Therefore, we used touchscreen experiments to explore chimpanzee intertemporal preferences when trial duration was equated by a PRD as well as when the PRD was eliminated. The computerized setting was used to try to control delay length flexibly and precisely while reducing the impact of the interaction with human experimenters. Moreover, choice options were presented on touchscreens using symbolic cues. This may reduce the impact of seeing food rewards on making a choice (i.e., the animals' robust tendency to reach for the larger amount of food). In an ITC task in which the trial duration was equated, 4 chimpanzees preferred larger rewards but chose smaller rewards more often when the ratio of the reward amount was smaller. In an ITC task with no PRDs, 2 of 4 chimpanzees did switch their preference to smaller rewards and enhanced the reward rate although this result should be interpreted in light of some methodological limitations.

show abstract

Choice between post-reinforcer delays in pigeons: Effects of stimulus continuity and response requirement

Saeki,

Yamaguchi

2024

Learning and Motivation

View full text Add to dashboard Cite

Sensitivity to pre- and post-reinforcer delays in self-control choice

Cited by 4 publications

References 17 publications

Effect of initial-link length on the sensitivity of the post-reinforcer delay

Effect of initial-link length on the sensitivity of the post-reinforcer delay

Computerized intertemporal choice task in chimpanzees (Pan troglodytes) with/without postreward delay.

Choice between post-reinforcer delays in pigeons: Effects of stimulus continuity and response requirement

Contact Info

Product

Resources

About