Pigeons' responses in the presence of two concurrently available (initial-link) stimuli produced one of two different (terminal-link) stimuli. Entrance into the mutually exclusive terminal links was arranged by different and independent variable-interval schedules for each key, while responses during the mutually exclusive terminal-link stimuli produced a single food reinforcement according to identical and independent variable-interval schedules. The pigeons emitted more initial-link responses on the key with the shorter average interreinforcement interval in the initial link. This difference in initial-link response rates varied directly with the difference between the average inter-reinforcement intervals of the initial-link schedules and decreased when the initial-link schedule with the longer average interreinforcement interval was followed by several consecutive food reinforcements on the variable-interval schedule in the terminal link on that key. These results are incompatible with previous formulations of choice behavior with the concurrent-chains procedure. A modified formulation with a multiplier for the overall rate of primary reinforcement obtained on each key provides a better description of choice. In addition, the new formulation applies to behavior in simple (concurrent) choice situations, an advantage not achieved by previous formulations.Since the concurrent-chains procedure was introduced by Autor (1960), the effects of several variables on choice behavior have been studied. In this procedure the organism responds on two concurrently available keys, each of which is illuminated by the stimulus associated with the initial link of one of the chains. Responses on each key occasionally produce the stimulus for the terminal link of the chain on that key. Responses in the presence of either of the mutually exclusive terminal-link stimuli are reinforced with food. The dependent variable has generally been the distribution of choice responses in the initial links as a function of some difference between the events occurring during the two terminal links.Both Autor (1960), using variable-interval (VI), variable-ratio (VR) and response-independent schedules in the terminal links, and Herrnstein (1964a) using VI and VR schedules, found that the relative rates of choice responding (the number of choice responses on one

The sunk cost effect is the increased tendency to persist in an endeavor once an investment of money, effort, or time has been made. To date, humans are the only animal in which this effect has been observed unambiguously. We developed a behavior-analytic model of the sunk cost effect to explore the potential for this behavior in pigeons as well as in humans. Each trial started out with a short expected ratio, but on some trials assumed a longer expected ratio part way through the trial. Subjects had the (usually preferable) option of "escaping" the trial if the longer expected ratio had come into effect in order to bring on a new trial that again had a short expected ratio. In Experiments 1 through 3, we manipulated two independent variables that we hypothesized would affect the pigeons' ability to discriminate the increase in the expected ratio within a trial: (a) the presence or absence of stimuli that signal an increase in the expected ratio, and (b) the severity of the increase in the expected ratio. We found that the pigeons were most likely to persist nonoptimally through the longer expected ratios when stimulus changes were absent and when the increase in the expected ratio was less severe. Experiment 4 employed a similar procedure with human subjects that manipulated only the severity of the increase in the expected ratio and found a result similar to that of the pigeon experiment. In Experiment 5, we tested the hypothesis that a particular history of reinforcement would induce pigeons to persist through the longer expected ratios; the results suggested instead that the history of reinforcement caused the pigeons to persist less compared to pigeons that did not have that history.

Behaving organisms are continually choosing. Recently the theoretical and empirical study of decision making by behavioral ecologists and experimental psychologists have converged in the area of foraging, particularly food acquisition. This convergence has raised the interdisciplinary question of whether principles that have emerged from the study of decision making in the operant conditioning laboratory are consistent with decision making in naturally occurring foraging. One such principle, the “parameter-free delay-reduction hypothesis, ” developed in studies of choice in the operant conditioning laboratory, states that the effectiveness of a stimulus as a reinforcer may be predicted most accurately by calculating the decrease in time to food presentation correlated with the onset of the stimulus, relative to the length of time to food presentation measured from the onset of the preceding stimulus. Since foraging involves choice, the delay-reduction hypothesis may be extended to predict aspects of foraging. We discuss the strategy of assessing parameters of foraging with operant laboratory analogues to foraging. We then compare the predictions of the delay-reduction hypothesis with those of optimal foraging theory, developed by behavioral ecologists, showing that, with two exceptions, the two positions make comparable predictions. The delay-reduction hypothesis is also compared to several contemporary pscyhological accounts of choice. Results from several of our experiments with pigeons, designed as operant conditioning simulations of foraging, have shown the following: The more time subjects spend searching for or traveling between potential food sources, the less selective they become, that is, the more likely they are to accept the less preferred outcome; increasing time spent procuring (“handling”) food increases selectivity; how often the preferred outcome is available has a greater effect on choice then how often the less preferred outcome is available; subjects maximize reinforcement whether it is the rate, amount, or probability of reinforcement that is varied; there are no significant differences between subjects performing under different types of deprivation (open vs. closed economies). These results are all consistent with the delay-reduction hypothesis. Moreover, they suggest that the technology of the operant conditioning laboratory may have fruitful application in the study of foraging, and, in doing so, they underscore the importance of an interdisciplinary approach to behavior.

In a choice between an immediate, small reward and a delayed, large reward, an organism may be said to exhibit "self-control" if it chooses the large reward. Given an opportunity in advance to avoid this choice, pigeons may commit themselves to the large reward, but if the choice is encountered they will almost always select the immediate, small reward. This preference reversal as a function of temporal distance from reinforcement is compatible with some general theories of choice. The present study tested one such model, developed by Rachlin and his co-workers, which assumes that (a) relative choice responses "match" the relative values of the outcomes; and (b) outcome values equal the product of rate and amount of reinforcement. Pigeons chose between 4.5 and 1.5 sec access to grain with equal or unequal delays of reinforcement. When delays consisted of unequal fixed-interval schedules the shorter delay terminated with the smaller reward, and preference for the large reward tended to increase with the absolute size of the delays (consistent with the matching model). However, preference for the large reward increased with delay size even when the delays were equal, a violation of the model. It is shown that both findings are derivable from either models of choice (developed by Logan and by Rachlin and Ainslie) based on gradients of reinforcing value, or from a more general model, previously applied to other choice situations, which assumes preference to depend on the reduction in time to reinforcement correlated with the alternatives.

Pigeons chose between fixed-interval schedules of different durations presented in the terminal links of concurrent-chains schedules. The pair of schedules was always in the ratio of 2:1, but the absolute duration of the fixed intervals varied. In one set of conditions, the different terminal-link schedules were associated with different keylight stimuli (cued conditions). In a second set of conditions, the different terminal-link schedules were associated with the same stimulus (uncued conditions). Results from the cued conditions replicated previous findings that preference for the shorter fixed-interval schedule increased with fixed-interval duration. Preferences in the uncued conditions were lower than in the corresponding cued conditions but also increased with fixed-interval length. In addition, the degree of control under the uncued conditions was correlated with the extent to which the schedule during the terminal link was discriminated immediately upon entry into the terminal link. The pattern of results in both conditions was inconsistent with the notion that choice behavior matches relative immediacy of reinforcement. Reanalysis of previous evidence for matching (Chung and Herrnstein, 1967) showed that matching in fact did not occur, as the preferences of their subjects for the shorter of two delays also increased with the absolute size of the delays.