Psychopharmacological studies have implicated the mesolimbic dopamine (DA) system in the mediation of cost/benefit evaluations about delay or effort-related costs associated with larger rewards. However, the role of DA in risk-based decision making remains relatively unexplored. The present study investigated the effects of systemic manipulations of DA transmission on risky choice using a probabilistic discounting task. Over discrete trials, rats chose between two levers; a press on the 'small/certain' lever always delivered one reward pellet, whereas a press on the other, 'large/risky' lever delivered four pellets, but the probability of receiving reward decreased across the four trial blocks (100, 50, 25, 12.5%). In separate groups of well-trained rats we assessed the effects of the DA releaser amphetamine, as well as receptor selective agonists and antagonists. Amphetamine consistently increased preference for the large/risky lever; an effect that was blocked or attenuated by co-administration of either D 1 (SCH23390) or D 2 (eticlopride) receptor antagonists. Blockade of either of these receptors alone induced risk aversion. Conversely, stimulation of D 1 (SKF81297) or D 2 (bromocriptine) receptors also increased risky choice. In contrast, activation of D 3 receptors with PD128,907 reduced choice of the large/risky lever. Likewise, D 3 antagonism with nafadotride potentiated the amphetamine-induced increase in risky choice. Blockade or stimulation of D 4 receptors did not reliably alter behavior. These findings indicate that DA has a critical role in mediating risk-based decision making, with increased activation of D 1 and D 2 receptors biasing choice toward larger, probabilistic rewards, whereas D 3 receptors appear to exert opposing effects on this form of decision making.

No abstract

Impairments in decision making about risks and rewards have been observed in patients with amygdala damage. Similarly, lesions of the basolateral amygdala (BLA) in rodents disrupts cost/benefit decision making, reducing preference for larger rewards obtainable after a delay or considerable physical effort. We assessed the effects of inactivation of the BLA on risk-and effort-based decision making, using discounting tasks conducted in an operant chamber. Separate groups of rats were trained on either a risk-or effort-discounting task, consisting of four blocks of 10 free-choice trials. Selection of one lever always delivered a smaller reward (one or two pellets), whereas responding on the other delivered a larger, four pellet reward. For risk discounting, the probability of receiving the larger reward decreased across trial blocks (100 -12.5%), whereas on the effort task, the larger reward was delivered after a ratio of presses that increased across blocks (2-20). Infusions of GABA agonists baclofen/muscimol into the BLA disrupted risk discounting, inducing a risk-averse pattern of choice, and increased response latencies and trial omissions, most prominently during trial blocks that provided the greatest uncertainty about the most beneficial course of action. Similar inactivations also increased effort discounting, reducing the preference for larger yet more costly rewards, even when the relative delays to reward delivery were equalized across response options. These findings point to a fundamental role for the BLA in different forms of cost/benefit decision making, facilitating an organism's ability to overcome a variety of costs (work, uncertainty, delays) to promote actions that may yield larger rewards.

Choices between certain and uncertain rewards of different magnitudes have been proposed to be mediated by both the frontal lobes and the mesocorticolimbic dopamine (DA) system. In rats, systemic manipulations of DA activity or inactivation of the medial prefrontal cortex (PFC) disrupt decision making about risks and rewards. However, it is unclear how PFC DA transmission contributes to these processes. We addressed this issue by examining the effects of pharmacological manipulations of D 1 and D 2 receptors in the medial (prelimbic) PFC on choice between small, certain and large, yet probabilistic rewards. Rats were trained on a probabilistic discounting task where one lever delivered one pellet with 100% probability, and the other delivered four pellets, but the probability of receiving reward decreased across blocks of trials (100, 50, 25, 12.5%). D 1 blockade (SCH23390) in the medial PFC decreased preference for the large/risky option. In contrast, D 2 blockade (eticlopride) reduced probabilistic discounting and increased risky choice. The D 1 agonist SKF81297 caused a slight, nonsignificant increase in preference for the large/risky lever. However, D 2 receptor stimulation (quinpirole) induced a true impairment in decision making, flattening the discounting curve and biasing choice away from or toward the risky option when it was more or less advantageous, respectively. These findings suggest that PFC D 1 and D 2 receptors make dissociable, yet complementary, contributions to risk/reward judgments. By striking a fine balance between D 1 /D 2 receptor activity, DA may help refine these judgments, promoting either exploitation of current favorable circumstances or exploration of more profitable ones when conditions change.

Damage to various regions of the prefrontal cortex (PFC) impairs decision making involving evaluations about risks and rewards. However, the specific contributions that different PFC subregions make to risk-based decision making are unclear. We investigated the effects of reversible inactivation of 4 subregions of the rat PFC (prelimbic medial PFC, orbitofrontal cortex [OFC], anterior cingulate, and insular cortex) on probabilistic (or risk) discounting. Rats were well trained to choose between either a "Small/Certain" lever that always delivered 1 food pellet, or another, "Large/Risky" lever, which delivered 4 pellets, but the probability of receiving reward decreased across 4 trial blocks (100%, 50%, 25%, and 12.5%). Infusions of gama-aminobutyric acid agonists muscimol/baclofen into the medial PFC increased risky choice. However, similar medial PFC inactivations decreased risky choice when the Large/Risky reward probability increased over a session. OFC inactivation increased response latencies in the latter trial blocks without affecting choice. Anterior cingulate or insular inactivations were without effect. The effects of prelimbic inactivations were not attributable to disruptions in response flexibility or judgments about the relative value of probabilistic rewards. Thus, the prelimbic, but not other PFC regions, plays a critical role in risk discounting, integrating information about changing reward probabilities to update value representations that facilitate efficient decision making.