Conditions affecting acquisition of observing responses in the absence of differential reward.

Mitchell, Kevin M.; Perkins, Nancy P.; Perkins, Charles C.

doi:10.1037/h0022578

Cited by 22 publications

(22 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Just such an increase in observing was shown by Roper and Zentall [12] as reward schedules thinned. While some studies have also manipulated the size of the reward [36]–[38], our model does not make any direct predictions about this. It is possible that adaptation would scale the response to the overall sizes of available rewards (as indeed found for phasic dopamine activity in [39]), and the metrics of this would have to be known in order to make predictions about disengagement.…”

Section: Resultsmentioning

confidence: 99%

Pavlovian-Instrumental Interaction in ‘Observing Behavior’

Beierholm

Dayan

2010

PLoS Comput Biol

View full text Add to dashboard Cite

Subjects typically choose to be presented with stimuli that predict the existence of future reinforcements. This so-called ‘observing behavior’ is evident in many species under various experimental conditions, including if the choice is expensive, or if there is nothing that subjects can do to improve their lot with the information gained. A recent study showed that the activities of putative midbrain dopamine neurons reflect this preference for observation in a way that appears to challenge the common prediction-error interpretation of these neurons. In this paper, we provide an alternative account according to which observing behavior arises from a small, possibly Pavlovian, bias associated with the operation of working memory.

show abstract

Section: Resultsmentioning

confidence: 99%

Pavlovian-Instrumental Interaction in ‘Observing Behavior’

Beierholm

Dayan

2010

PLoS Comput Biol

View full text Add to dashboard Cite

show abstract

“…We therefore introduced a second task that equalized the opportunity for simple physical preparation (Mitchell et al, 1965) (“information delay task”, Figure 2A). Monkeys again chose between informative and random cues, but afterward a second cue appeared that was always informative on every trial.…”

Section: Resultsmentioning

confidence: 99%

Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards

Bromberg-Martin

Hikosaka

2009

Neuron

463

472

View full text Add to dashboard Cite

SUMMARY The desire to know what the future holds is a powerful motivator in everyday life, but it is unknown how this desire is created by neurons in the brain. Here we show that when macaque monkeys are offered a water reward of variable magnitude, they seek advance information about its size. Furthermore, the same midbrain dopamine neurons that signal the expected amount of water also signal the expectation of information, in a manner that is correlated with the strength of the animal’s preference. Our data shows that single dopamine neurons process both primitive and cognitive rewards, and suggests that current theories of reward-seeking must be revised to include information-seeking.

show abstract

“…Indeed, contemporary proponents of the Law of Effect (Rachlin and Herrnstein, 1969) would predict similar results for both positive and negative situations. A number of studies (Hendry, 1969;Mitchell, Perkins, and Perkins, 1965;Prokasy, 1956;Wyckoff, 1952) found that animals preferred signalled to unsignalled positive reinforcers. Hendry, for example, using pigeons and a concurrent chain procedure, found a decided preference for a multiple fixed-ratio fixed-ratio schedule to a mixed fixed-ratio fixed-ratio (mixed FR FR) schedule, with probability of reinforcement held constant.…”

Section: Discussionmentioning

confidence: 99%

Comparisons Between Variable‐interval and Fixed‐interval Schedules of Electric Shock Delivery

Hymowitz

1973

J Exper Analysis Behavior

View full text Add to dashboard Cite

Responding maintained in rats under a variable-interval 35-sec food schedule was suppressed more by 60-sec and 240-sec fixed-interval schedules of shock delivery than by 60-sec and 240-sec variable-interval schedules of shock delivery. When the delivery of shock was preceded by a 5-sec visual stimulus, little overall response suppression was found with either fixed-interval or variable-interval schedules. In a third experiment, the percentage of occasions on which a cue preceded each shock delivery was varied from 0% to 100%. For the fixed-interval shock condition, the most suppression occurred with the 0% treatment, the least with 100%, and an intermediate amount with the 50% treatment. For the variable-interval groups, the most suppression occurred in the 50% condition, the least in the 100% group, and an intermediate amount with 0%.

show abstract

Conditions affecting acquisition of observing responses in the absence of differential reward.

Cited by 22 publications

References 7 publications

Pavlovian-Instrumental Interaction in ‘Observing Behavior’

Pavlovian-Instrumental Interaction in ‘Observing Behavior’

Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards

Comparisons Between Variable‐interval and Fixed‐interval Schedules of Electric Shock Delivery

Contact Info

Product

Resources

About