Paradoxical choice in rats: Subjective valuation and mechanism of choice

Ojeda, Andrés; Murphy, Robin A.; Kacelnik, Alex

doi:10.1016/j.beproc.2018.03.024

Cited by 34 publications

(48 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It could be that the trial-based, forced choice structure of many tasks forces the apparent direct trade-off between exploration and exploitation. Our results suggest that the decision-making processes that arbitrate exploration and exploitation may not inherently be in competition; rather, they may run in parallel with action selection arising from the winning decision made 47 . This is analogous to the current understanding of goal-directed and habitual action control systems as parallel processes, either of which may contribute to action control at a given time point 15 .…”

Section: Discussionmentioning

confidence: 87%

Orbital Frontal Cortex Projections to Secondary Motor Cortex Mediate Exploitation of Learned Rules

Schreiner

Gremel

2018

Sci Rep

View full text Add to dashboard Cite

Animals face the dilemma between exploiting known opportunities and exploring new ones, a decision-making process supported by cortical circuits. While different types of learning may bias exploration, the circumstances and the degree to which bias occurs is unclear. We used an instrumental lever press task in mice to examine whether learned rules generalize to exploratory situations and the cortical circuits involved. We first trained mice to press one lever for food and subsequently assessed how that learning influenced pressing of a second novel lever. Using outcome devaluation procedures we found that novel lever exploration was not dependent on the food value associated with the trained lever. Further, changes in the temporal uncertainty of when a lever press would produce food did not affect exploration. Instead, accrued experience with the instrumental contingency was strongly predictive of test lever pressing with a positive correlation between experience and trained lever exploitation, but not novel lever exploration. Chemogenetic attenuation of orbital frontal cortex (OFC) projection into secondary motor cortex (M2) biased novel lever exploration, suggesting that experience increases OFC-M2 dependent exploitation of learned associations but leaves exploration constant. Our data suggests exploitation and exploration are parallel decision-making systems that do not necessarily compete.

show abstract

Section: Discussionmentioning

confidence: 87%

Orbital Frontal Cortex Projections to Secondary Motor Cortex Mediate Exploitation of Learned Rules

Schreiner

Gremel

2018

Sci Rep

View full text Add to dashboard Cite

show abstract

“…The results demonstrated that differences in discrimination performance were primarily influenced by cage and not by cohort (Nachev, in prep.). Thus, the sound cue associated with reward delivery may be an important confounding factor in probability discrimination in mice, as it provides a signal for the reward outcome (Ojeda, Murphy, and Kacelnik 2018).…”

Section: Discussionmentioning

confidence: 99%

Two-dimensional reward evaluation in mice

Nachev

Rivalan

Winter

2020

Preprint

View full text Add to dashboard Cite

8When choosing among multi-attribute options, integrating the full information may be computationally costly 9 and time-consuming. So-called noncompensatory decision rules only rely on partial information, for example 10 when a difference on a single attribute overrides all others. Such rules may be ecologically more advantageous, 11 despite deviations from economical optimality. Here we present a study that investigates to what extent 12 animals rely on integration versus noncompensatory rules when choosing where to forage. Groups of mice 13 were trained to obtain water from dispensers varying along two reward dimensions: probability and volume.14 The choices of the mice over the course of the experiment suggested an initial reliance on integrative rules, 15 later displaced by a sequential rule, in which volume was evaluated before probability. Our results also 16 demonstrate that while the evaluation of probability differences may depend on the reward volumes, the 17 evaluation of volume differences is seemingly unaffected by the reward probabilities.

show abstract

“…It provides a unique perspective on many aspects of economic choice and has recently come to influence the neuroscience and psychology of decision-making (Pearson et al 2014; Calhoun and Hayden 2015; Mobbs et al 2018; Hayden et al, 2011). A core idea in foraging theory is that natural decisions are fundamentally structured around accepting vs. rejecting – taking or passing up a single option that is the sole or primary focus of attention (Shapiro et al 2008; Vasconcelos et al 2010; Kacelnik et al 2011; Pirrone et al 2017; Ojeda et al 2018). Even ostensibly binary economic choices, in this view, reflect a pair of (potentially interacting) accept-reject choices.…”

Section: Introductionmentioning

confidence: 99%

Shared neuronal bases of inhibition and economic choice in orbitofrontal cortex

Balasubramani

Hayden

2020

Preprint

View full text Add to dashboard Cite

Economic choice and inhibition are two important elements of our cognitive repertoires that may be closely related. We and others have noted that during economic choice, options are typically considered serially; this fact provides important constraints on our understanding of choice. Notably, asynchronous contemplation means that each individual option is subject to an accept-reject decision. We have proposed that these component accept-reject decisions may have some kinship with stopping decisions. One prediction of this idea is that stopping and choice may reflect similar neural processes occurring in overlapping brain circuits. To test the idea, we recorded neuronal activity in orbitofrontal cortex (OFC) Area 13 while macaques performed a stop signal task interleaved with a structurally matched choice task. Using neural network decoders, we find that OFC ensembles have overlapping codes for stopping and choice: the decoder that was only trained to identify accept vs. reject trials performed with higher efficiency even when tested on the stop trials. These results provide tentative support for the idea that mechanisms underlying inhibitory control and choice selection may be subject to theoretical unification.

show abstract

Paradoxical choice in rats: Subjective valuation and mechanism of choice

Cited by 34 publications

References 24 publications

Orbital Frontal Cortex Projections to Secondary Motor Cortex Mediate Exploitation of Learned Rules

Orbital Frontal Cortex Projections to Secondary Motor Cortex Mediate Exploitation of Learned Rules

Two-dimensional reward evaluation in mice

Shared neuronal bases of inhibition and economic choice in orbitofrontal cortex

Contact Info

Product

Resources

About