Delayed reinforcement hinders subsequent extinction

Shibata, Yusuke; Yoshimoto, Airi; Yamashiro, Kotaro; Ikegaya, Yuji; Matsumoto, Nobuyoshi

doi:10.1016/j.bbrc.2021.12.101

Cited by 8 publications

(9 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The experiments were performed in 12 experimental boxes (300 mm wide × 400 mm long × 395 mm tall; made of vinyl chloride; OP-3802De, O’Hara, Tokyo, Japan), and each was placed inside a soundproof box (500 mm wide × 600 mm long × 500 mm tall; BrainScience-idea, Osaka, Japan), in a windowless room on the basement floor 11 , 12 . An LED panel (maximum illuminance, 1,500 lx; color temperature, 6000 K) was placed on the top of each experimental box.…”

Section: Methodsmentioning

confidence: 99%

Lengthened circadian rhythms in mice with self-controlled ambient light intensity

Ogasawara,

Matsumoto,

Takeuchi

et al. 2024

Sci Rep

Self Cite

View full text Add to dashboard Cite

Laboratory animals are typically maintained under 12-h light and 12-h dark (12:12 LD) conditions with a daytime light intensity of ~ 200 lx. In this study, we designed an apparatus that allowed mice to self-select the room light intensity by nose poking. We measured the behavioral rhythms of the mice under this self-controlled light regimen. The mice quickly learned the relationship between their nose pokes and the resulting changes in the light intensity. Under these conditions, the mice exhibited free-running circadian behavior with a period of 24.5 ± 0.4 h. This circadian period was ~ 1 h longer than that of the same strain of mice when they were kept in constant darkness (DD) after 12:12 LD entrainment, and the lengthened period lasted for at least 30 days. The rhythm of the light intensity controlled by the mice also exhibited a similar period, but the phase of the illuminance rhythm preceded the phase of the locomotor activity rhythm. Mice that did not have access to the light controller were also entrained to the illuminance cycle produced by the mice that did have access to the light controller, but with a slightly delayed phase. The rhythm was likely controlled by the canonical circadian clock because mice with tau mutations in the circadian clock gene CSNK1E exhibited short periods of circadian rhythm under the same conditions. These results indicate that the free-running period of mice in the wild may differ from what they exhibit if they are attuned by forced light cycles in laboratories because mice in their natural habitats can self-control their exposure to ambient light, similar to our experimental conditions.

show abstract

Section: Methodsmentioning

confidence: 99%

Lengthened circadian rhythms in mice with self-controlled ambient light intensity

Ogasawara,

Matsumoto,

Takeuchi

et al. 2024

Sci Rep

Self Cite

View full text Add to dashboard Cite

show abstract

“…Bipolar stimulating electrodes were made from pairs of stainless-steel insulated wires (TOG217-049c, Unique Medical). The distal end of the stimulation electrode was soldered to a two-pin connector protected by epoxy glue to prepare a stimulating electrode assembly ( Shibata et al, 2022 ).…”

Section: Methodsmentioning

confidence: 99%

Enhancement of Motor Cortical Gamma Oscillations and Sniffing Activity by Medial Forebrain Bundle Stimulation Precedes Locomotion

Yoshimoto

Shibata

Kudara

et al. 2022

eNeuro

Self Cite

View full text Add to dashboard Cite

The medial forebrain bundle (MFB) is a white matter pathway that traverses through mesolimbic structures and includes dopaminergic neural fibers ascending from the ventral tegmental area (VTA). Since dopaminergic signals represent hedonic responses, electrical stimulation of the MFB in animals has been used as a neural reward for operant and spatial tasks. MFB stimulation strongly motivates animals to rapidly learn to perform a variety of behavioral tasks to obtain a reward. Although the MFB is known to connect various brain regions and MFB stimulation dynamically modulates animal behavior, how central and peripheral functions are affected by MFB stimulation per se is poorly understood. To address this question, we simultaneously recorded electrocorticograms (ECoGs) in the primary motor cortex (M1), primary somatosensory cortex (S1), and olfactory bulb (OB) of behaving rats while electrically stimulating the MFB. We found that MFB stimulation increased the locomotor activity of rats. Spectral analysis confirmed that immediately after MFB stimulation, sniffing activity was facilitated and the power of gamma oscillations in the M1 was increased. After sniffing activity and motor cortical gamma oscillations were facilitated, animals started to move. These results provide insight into the importance of sniffing activity and cortical gamma oscillations for motor execution and learning facilitated by MFB stimulation.

show abstract

“…‘Reinforcement’ refers to the process whereby an animal acquires one specific behavior which will bring about a positive outcome in a specific state and learns to link behavior and outcome ( Shibata et al, 2022 ). During this process, the neutral stimuli are referred to as ‘conditioned reinforcer’.…”

Section: Reward Prediction Error and Behaviormentioning

confidence: 99%

“…The reward prediction error guides decision-making during reinforcement learning as the brain compares the predicted and actual reward value and calculates the disparity between them ( Garrison et al, 2013 ). For the same reason, the response learned through reinforcement will tend to extinguish when the reinforcer is no longer paired with reinforced behavioral responses, and this process is known as reinforcement learning extinction ( Staddon and Cerutti, 2003 ; Shibata et al, 2022 ).…”

Section: Reward Prediction Error and Behaviormentioning

confidence: 99%

Reward prediction error in learning-related behaviors

Deng,

Song,

et al. 2023

Front. Neurosci.

View full text Add to dashboard Cite

Learning is a complex process, during which our opinions and decisions are easily changed due to unexpected information. But the neural mechanism underlying revision and correction during the learning process remains unclear. For decades, prediction error has been regarded as the core of changes to perception in learning, even driving the learning progress. In this article, we reviewed the concept of reward prediction error, and the encoding mechanism of dopaminergic neurons and the related neural circuities. We also discussed the relationship between reward prediction error and learning-related behaviors, including reversal learning. We then demonstrated the evidence of reward prediction error signals in several neurological diseases, including Parkinson’s disease and addiction. These observations may help to better understand the regulatory mechanism of reward prediction error in learning-related behaviors.

show abstract

Delayed reinforcement hinders subsequent extinction

Cited by 8 publications

References 27 publications

Lengthened circadian rhythms in mice with self-controlled ambient light intensity

Lengthened circadian rhythms in mice with self-controlled ambient light intensity

Enhancement of Motor Cortical Gamma Oscillations and Sniffing Activity by Medial Forebrain Bundle Stimulation Precedes Locomotion

Reward prediction error in learning-related behaviors

Contact Info

Product

Resources

About