Foraging is a fundamental behavior, and many types of animals appear to have solved foraging problems using a shared set of mechanisms. Perhaps the most common foraging problem is the choice between exploiting a familiar option for a known reward and exploring unfamiliar options for unknown rewards-the so-called explore/exploit trade-off. This trade-off has been studied extensively in behavioral ecology and computational neuroscience, but is relatively new to the field of psychiatry. Explore/exploit paradigms can offer psychiatry research a new approach to studying motivation, outcome valuation, and effort-related processes, which are disrupted in many mental and emotional disorders. In addition, the explore/exploit trade-off encompasses elements of risk-taking and impulsivity-common behaviors in psychiatric disorders-and provides a novel framework for understanding these behaviors within an ecological context. Here we explain relevant concepts and some common paradigms used to measure explore/exploit decisions in the laboratory, review clinically relevant research on the neurobiology and neuroanatomy of explore/exploit decision making, and discuss how computational psychiatry can benefit from foraging theory.

Caffeine is a commonly used neurostimulant that also produces cerebral vasoconstriction by antagonizing adenosine receptors. Chronic caffeine use results in an adaptation of the vascular adenosine receptor system presumably to compensate for the vasoconstrictive effects of caffeine. We investigated the effects of caffeine on cerebral blood flow (CBF) in increasing levels of chronic caffeine use. Low (mean = 45 mg/day), moderate (mean = 405 mg/day), and high (mean = 950 mg/day) caffeine users underwent quantitative perfusion magnetic resonance imaging on four separate occasions: twice in a caffeine abstinent state (abstained state) and twice in a caffeinated state following their normal caffeine use (native state). In each state there were two drug conditions: participants received either caffeine (250 mg) or placebo. Gray matter CBF was tested with repeated-measures analysis of variance using caffeine use as a between-subjects factor, and correlational analyses were conducted between CBF and caffeine use. Caffeine reduced CBF by an average of 27% across both caffeine states. In the abstained placebo condition, moderate and high users had similarly greater CBF than low users; but in the native placebo condition, the high users had a trend towards less CBF than the low and moderate users. Our results suggest a limited ability of the cerebrovascular adenosine system to compensate for high amounts of daily caffeine use.

There are important considerations when choosing among formulation sizes for use in Trp manipulation studies, and the complete 7-h time-course data set of the typical plasma Trp measures presented here may help researchers decide which methodology best suits their needs.

Little is known regarding the underlying neurobiology of smoking cessation. Neuroimaging studies indicate a role for the insula in connecting the interoceptive awareness of tobacco craving with a larger brain network that motivates smoking. We investigated differences in insula-based functional connectivity between smokers who did not relapse during a quit attempt vs those who relapsed. Smokers (n=85) underwent a resting-state functional connectivity scan and were then randomized into two groups (either smoking usual brand cigarettes or smoking very low nicotine cigarettes plus nicotine replacement therapy) for 30 days before their target quit date. Following the quit date, all participants received nicotine replacement therapy and their smoking behavior was observed for 10 weeks. Participants were subsequently classified as nonrelapsed (n=44) or relapsed (i.e., seven consecutive days of smoking ⩾1 cigarette/day; n=41). The right and left insula, as well as insula subdivisions (posterior, ventroanterior, and dorsoanterior) were used as seed regions of interest in the connectivity analysis. Using the right and left whole-insula seed regions, the nonrelapsed group had greater functional connectivity than the relapsed group with the bilateral pre- and postcentral gyri. This effect was isolated to the right and left posterior insula seed regions. Our results suggest that relapse vulnerability is associated with weaker connectivity between the posterior insula and primary sensorimotor cortices. Perhaps greater connectivity in this network improves the ability to inhibit a motor response to cigarette cravings when those cravings conflict with a goal to remain abstinent. These results are consistent with recent studies demonstrating a positive relationship between insula-related functional connectivity and cessation likelihood among neurologically intact smokers.

The ventral and dorsal striatum are critical substrates of reward processing and motivation and have been repeatedly linked to addictive disorders, including nicotine dependence. However, little is known about how functional connectivity between these and other brain regions is modulated by smoking withdrawal and may contribute to relapse vulnerability. In the present study, 37 smokers completed resting state fMRI scans during both satiated and 24-h abstinent conditions, prior to engaging in a 3-week quit attempt supported by contingency management. We examined the effects of abstinence condition and smoking outcome (lapse vs non-lapse) on whole-brain connectivity with ventral and dorsal striatum seed regions. Results indicated a significant condition by lapse outcome interaction for both right and left ventral striatum seeds. Robust abstinence-induced increases in connectivity with bilateral ventral striatum were observed across a network of regions implicated in addictive disorders, including insula, superior temporal gyrus, and anterior/mid-cingulate cortex among non-lapsers; the opposite pattern was observed for those who later lapsed. For dorsal striatum seeds, 24-h abstinence decreased connectivity across both groups with several regions, including medial prefrontal cortex, posterior cingulate cortex, hippocampus, and supplemental motor area. These findings suggest that modulation of striatal connectivity with the cingulo-insular network during early withdrawal may be associated with smoking cessation outcomes.