-The failure of certain species to learn a particular task while others learn it easily can help identify the learning mechanisms involved. In the ephemeral reward task, animals are given a choice between two distinctive stimuli, A and B, each containing an identical bit of food. If they choose A they get the food on A and the trial is over. If they choose B they get the food on B and they are allowed to get the food on A before the trial is over. Thus, it is optimal to choose B. Although cleaner fish (wrasse) and parrots acquire the optimal response easily, several primate species do not. Furthermore, pigeons and rats also appear to be unable learn to choose optimally. The failure of primates, pigeons, and rats to learn this task and the ease with which cleaner fish and parrots learn it raises important questions about the learning mechanisms involved in those differences. To account for these paradoxical findings, we proposed that certain species may have difficulty with this task because they tend to respond impulsively to the initial choice which has similar immediate outcomes and they do not associate the choice and reinforcement with the second reinforcement. To test this hypothesis, we temporally separated the initial choice from the first reinforcement by imposing a 20-s delay between the choice and its outcome. Under these conditions both pigeons and rats gradually acquired the optimal choice response. We suggest that impulsive choice may make it difficult to acquire certain tasks and imposing a delay between choice and outcome may decrease impulsivity and allow for closer to optimal task performance.
Keywords -Ephemeral choice task, Suboptimal choice, Prior commitment, Delay of reinforcementWhen animals fail to acquire what appears to be a relatively simple task, it raises questions that can lead to a better understanding of principles of learning that may apply more generally to other tasks and to other species. Such a task is one we refer to as the ephemeral reward task.Psychologists have been studying the acquisition of relatively simple tasks by animals for over 100 years; from their escape from puzzle boxes (Thorndike, 1898) to simple conditioned reflexes (Pavlov, 1927). More recently the ability to show improvement with the learning in a serial reversal of a simple discrimination has been used as a proxy for the assessment of animal intelligence (Bitterman, 1965). In many cases intuition about animal intelligence has been confirmed with animals deemed to be more like humans doing better on these measures than those that are less like us. Thus, apes tend to show more improvement over reversals than monkeys, monkeys more improvement than rats, rats more improvement than pigeons and so on (Bitterman, 1965(Bitterman, , 1975. But as we will see, this is not always the case.