The method of Pawlow in animal psychology.

Yerkes, Robert M.; Morgulis, Sergius

doi:10.1037/h0070886

Cited by 75 publications

(30 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Neuroscientific evidence from lesion studies, pharmacological manipulations and electrophysiological recordings in behaving animals have further provided tentative links to neural structures underlying key computational constructs in these models. Most notably, much evidence suggests that the neuromodulator dopamine provides basal ganglia target structures with phasic signals that convey a reward prediction error that can influence learning and action selection, particularly in stimulus-driven habitual instrumental behavior (Barto, 1995;Schultz et al, 1997;Wickens & Kötter, 1995).1 From a computational perspective, Pavlovian conditioning (Yerkes & Morgulis, 1909) is considered as a prototypical instance of prediction learning -learning the predictive relationships between events in the environment such as the fact that the scent of home-cooking usually predicts a tasty meal (eg. .…”

mentioning

confidence: 99%

See 1 more Smart Citation

Reinforcement learning in the brain

Niv¹

2009

Journal of Mathematical Psychology

640

549

View full text Add to dashboard Cite

A wealth of research focuses on the decision-making processes that animals and humans employ when selecting actions in the face of reward and punishment. Initially such work stemmed from psychological investigations of conditioned behavior, and explanations of these in terms of computational models. Increasingly, analysis at the computational level has drawn on ideas from reinforcement learning, which provide a normative framework within which decision-making can be analyzed. More recently, the fruits of these extensive lines of research have made contact with investigations into the neural basis of decision making. Converging evidence now links reinforcement learning to specific neural substrates, assigning them precise computational roles. Specifically, electrophysiological recordings in behaving animals and functional imaging of human decision-making have revealed in the brain the existence of a key reinforcement learning signal, the temporal difference reward prediction error. Here, we first introduce the formal reinforcement learning framework. We then review the multiple lines of evidence linking reinforcement learning to the function of dopaminergic neurons in the mammalian midbrain and to more recent data from human imaging experiments. We further extend the discussion to aspects of learning not associated with phasic dopamine signals, such as learning of goal-directed responding that may not be dopamine-dependent, and learning about the vigor (or rate) with which actions should be performed that has been linked to tonic aspects of dopaminergic signaling. We end with a brief discussion of some of the limitations of the reinforcement learning framework, highlighting questions for future research.A fundamental question in behavioral neuroscience concerns the decision-making processes by which animals and humans select actions in the face of reward and punishment, and their neural realization. In behavioral psychology, this question has been investigated in detail through the paradigms of Pavlovian (classical) and instrumental (operant) conditioning, and much evidence has accumulated regarding the associations that control different aspects of learned behavior. The computational field of reinforcement learning (Sutton & Barto, 1998) has provided a normative framework within which such conditioned behavior can be understood. In this, optimal action selection is based on predictions of long-run future consequences, such that decision making is aimed at maximizing rewards and minimizing punishment. Neuroscientific evidence from lesion studies, pharmacological manipulations and electrophysiological recordings in behaving animals have further provided tentative links to neural structures underlying key computational constructs in these models. Most notably, much evidence suggests that the neuromodulator dopamine provides basal ganglia target structures with phasic signals that convey a reward prediction error that can influence learning and action selection, particularly in stimulus-driven habitual ins...

show abstract

mentioning

confidence: 99%

“…1 From a computational perspective, Pavlovian conditioning (Yerkes & Morgulis, 1909) is considered as a prototypical instance of prediction learning -learning the predictive relationships between events in the environment such as the fact that the scent of home-cooking usually predicts a tasty meal (eg. .…”

mentioning

confidence: 99%

Reinforcement learning in the brain

Niv¹

2009

Journal of Mathematical Psychology

640

549

View full text Add to dashboard Cite

show abstract

“…For example, in the first American psychology textbook James (1890) presented a kymograph record (or kymogram) to illustrate reaction time. The famous diagram of Pavlov's preparation for classical conditioning shown by Yerkes and Morgulis (1909, their Figure 2) prominently depicts a kymograph as part of the apparatus. And the British psychologist Grindley (1932), whose independent experiments on the instrumental conditioning of head movements of guinea pigs closely parallels some of Skinner's early operant conditioning work, described in detail the use of a kymograph to record the head movements of his subjects, albeit not as cumulative responses.…”

Section: Ludwig's Drummentioning

confidence: 99%

Steps and Pips in the History of the Cumulative Recorder

Lattal

2004

J Exper Analysis Behavior

View full text Add to dashboard Cite

From its inception in the 1930s until very recent times, the cumulative recorder was the most widely used measurement instrument in the experimental analysis of behavior. It was an essential instrument in the discovery and analysis of schedules of reinforcement, providing the first real-time analysis of operant response rates and patterns. This review traces the evolution of the cumulative recorder from Skinner's early modified kymographs through various models developed by Skinner and his colleagues to its perfection in the 1950s, and then into the 1960s when it proliferated as different scientific instrument companies began marketing their own models of the cumulative recorder. With the rise of digital computers, the demise of the cumulative recorder as a scientific instrument was inevitable; however, the value of the cumulative record as a monitoring device to assess schedule control of behavior continues. The cumulative recorder remains, along with the operant conditioning chamber, an icon of Skinner's approach to psychology.

show abstract

“…Many years ago, when Yerkes & Morgulis (1909) presented some of the early results from Pavlov's laboratory, the "salivary reflex method" (p. 257) was a simple quantitative strategy to measure changes in the salivary reflex produced by 'psychic processes' in the central nervous system. Pavlov (1927) noticed that the salivary reflex in his dogs was elicited under two very distinct circumstances, in the presence of a specific stimulus for secretion (e.g., food in the mouth; which he labeled unconditioned stimulus [US]), and when the animal was stimulated by events that were previously presented in connection with the US (e.g., lights, sounds, odors; which he labeled conditioned stimulus [CS]).…”

Section: Beyond the Drooling Dog: The Pavlovian Contribution To Expermentioning

confidence: 99%

Animal models of psychopathology: Historical models and the pavlovian contribution

et al. 2012

View full text Add to dashboard Cite

ResumenLa investigación con animales no humanos como sujetos experimentales, para entender el comportamiento humano, se basa en la noción darwiniana de la continuidad de las especies. En este marco encontramos modelos análogos para entender la biología y el comportamiento humanos en especies no humanas. En psicología, los modelos animales han probado ser una herramienta efectiva para el entendimiento del comportamiento humano, tanto normal como anormal. En la presente revisión discutimos cómo los modelos animales han sido usados al investigar la psicopatología. Luego de revisar tres modelos animales históricos de psicopatologías específicas, discutimos cómo los fenómenos descubiertos al estudiar el condicionamiento pavloviano han contribuido a nuestra comprensión de la etiología y mantención de la psicopatología humana, cómo la tradición pavloviana ha contribuido al desarrollo de mejores formas de tratamiento para desórdenes del comportamiento, y de forma más general, cómo los fenómenos pavlovianos se encuentran implicados en casi todas las interacciones entre un organismo y su ambiente.Palabras clave: Condicionamiento pavloviano, modelos animales, psicopatología experimental. AbstractResearch using non-human animals as experimental subjects to understand human behavior have been based on the Darwinian notion of continuity between species. In this framework, we find analogous models to understand human biology and behavior in nonhuman species. In the scientific study of psychology, animal models have proven to be an effective tool for understanding both normal and abnormal human behaviors.In the present review, we discuss how animal models have been used in investigating psychopathology. After reviewing three historical animal models of specific psychopathologies, we discuss how phenomena discovered while studying Pavlovian conditioning have contributed to our understanding of the etiology and maintenance of human psychopathology, how the Pavlovian tradition has contributed to the development of better ways to treat these behavioral disorders, and more generally, how Pavlovian phenomena are implicated in almost all interactions between an organism and its environment.

show abstract

The method of Pawlow in animal psychology.

Cited by 75 publications

References 1 publication

Reinforcement learning in the brain

Reinforcement learning in the brain

Steps and Pips in the History of the Cumulative Recorder

Animal models of psychopathology: Historical models and the pavlovian contribution

Contact Info

Product

Resources

About