Transitive inference (the ability to infer that B > D given that B > C and C > D) is a widespread characteristic of serial learning, observed in dozens of species. Despite these robust behavioral effects, reinforcement learning models reliant on reward prediction error or associative strength routinely fail to perform these inferences. We propose an algorithm called betasort, inspired by cognitive processes, which performs transitive inference at low computational cost. This is accomplished by (1) representing stimulus positions along a unit span using beta distributions, (2) treating positive and negative feedback asymmetrically, and (3) updating the position of every stimulus during every trial, whether that stimulus was visible or not. Performance was compared for rhesus macaques, humans, and the betasort algorithm, as well as Q-learning, an established reward-prediction error (RPE) model. Of these, only Q-learning failed to respond above chance during critical test trials. Betasort’s success (when compared to RPE models) and its computational efficiency (when compared to full Markov decision process implementations) suggests that the study of reinforcement learning in organisms will be best served by a feature-driven approach to comparing formal models.

An emerging approach with potential in improving the treatment of neurodegenerative diseases and brain tumors is the use of focused ultrasound (FUS) to bypass the blood–brain barrier (BBB) in a non-invasive and localized manner. A large body of pre-clinical work has paved the way for the gradual clinical implementation of FUS-induced BBB opening. Even though the safety profile of FUS treatments in rodents has been extensively studied, the histological and behavioral effects of clinically relevant BBB opening in large animals are relatively understudied. Here, we examine the histological and behavioral safety profile following localized BBB opening in non-human primates (NHPs), using a neuronavigation-guided clinical system prototype. We show that FUS treatment triggers a short-lived immune response within the targeted region without exacerbating the touch accuracy or reaction time in visual-motor cognitive tasks. Our experiments were designed using a multiple-case-study approach, in order to maximize the acquired data and support translation of the FUS system into human studies. Four NHPs underwent a single session of FUS-mediated BBB opening in the prefrontal cortex. Two NHPs were treated bilaterally at different pressures, sacrificed on day 2 and 18 post-FUS, respectively, and their brains were histologically processed. In separate experiments, two NHPs that were earlier trained in a behavioral task were exposed to FUS unilaterally, and their performance was tracked for at least 3 weeks after BBB opening. An increased microglia density around blood vessels was detected on day 2, but was resolved by day 18. We also detected signs of enhanced immature neuron presence within areas that underwent BBB opening, compared to regions with an intact BBB, confirming previous rodent studies. Logistic regression analysis showed that the NHP cognitive performance did not deteriorate following BBB opening. These preliminary results demonstrate that neuronavigation-guided FUS with a single-element transducer is a non-invasive method capable of reversibly opening the BBB, without substantial histological or behavioral impact in an animal model closely resembling humans. Future work should confirm the observations of this multiple-case-study work across animals, species and tasks.

Noninvasive brain stimulation using transcranial focused ultrasound (FUS) has many potential applications as a research and clinical tool, including incorporation into neural prosthetics for cognitive rehabilitation. To develop this technology, it is necessary to evaluate the safety and efficacy of FUS neuromodulation for specific brain targets and cognitive functions. It is also important to test whether repeated long-term application of FUS to deep brain targets improves or degrades behavioral and cognitive function. To this end, we investigated the effects of FUS in the dorsal striatum of nonhuman primates (NHP) performing a visual-motor decision-making task for small or large rewards. Over the course of 2 years, we performed 129 and 147 FUS applications, respectively, in two NHP. FUS (0.5 MHz @ 0.2e0.8 MPa) was applied to the putamen and caudate in both hemispheres to evaluate the effects on movement accuracy, motivation, decision accuracy, and response time. Sonicating the caudate or the putamen unilaterally resulted in modest but statistically significant improvements in motivation and decision accuracy, but at the cost of slower reaction times. The effects were dose (i.e., FUS pressure) and reward dependent. There was no effect on reaching accuracy, nor was there long-term behavioral impairment or neurological trauma evident on T1-weighted, T2-weighted, or susceptibility-weighted MRI scans. Sonication also resulted in significant changes in resting state functional connectivity between the caudate and multiple cortical regions. The results indicate that applying FUS to the dorsal striatum can positively impact the motivational and cognitive aspects of decision making. The capability of FUS to improve motivation and cognition in NHPs points to its therapeutic potential in treating a wide variety of human neural diseases, and warrants further development as a novel technique for noninvasive deep brain stimulation.

Understanding the neural mechanisms of action potential generation is critical to establish the way neural circuits generate and coordinate activity. Accordingly, we investigated the dynamics of action potential initiation in the GABAergic thalamic reticular nucleus (TRN) using in vivo intracellular recordings in cats in order to preserve anatomically-intact axo-dendritic distributions and naturally-occurring spatiotemporal patterns of synaptic activity in this structure that regulates the thalamic relay to neocortex. We found a wide operational range of voltage thresholds for action potentials, mostly due to intrinsic voltage-gated conductances and not synaptic activity driven by network oscillations. Varying levels of synchronous synaptic inputs produced fast rates of membrane potential depolarization preceding the action potential onset that were associated with lower thresholds and increased excitability, consistent with TRN neurons performing as coincidence detectors. On the other hand the presence of action potentials preceding any given spike was associated with more depolarized thresholds. The phase-plane trajectory of the action potential showed somato-dendritic propagation, but no obvious axon initial segment component, prominent in other neuronal classes and allegedly responsible for the high onset speed. Overall, our results suggest that TRN neurons could flexibly integrate synaptic inputs to discharge action potentials over wide voltage ranges, and perform as coincidence detectors and temporal integrators, supported by a dynamic action potential threshold.

Transitive inference (TI) is a classic learning paradigm for which the relative contributions of experienced rewards and representation-driven inference have been vigorously debated, particularly with regard to the notion that animals are capable of logic and reasoning. Rhesus macaque subjects and human participants performed a TI task in which, prior to learning a seven-item list ABCDEFG, a block of trials presented exclusively the pair FG. Contrary to the expectation of associative models, the high prior rate of reward for F did not disrupt learning of the entire list. Monkeys (who each completed many sessions) learned to anticipate that novel stimuli should be preferred over F. We interpret this as evidence of a task representation of TI that generalizes beyond learning about specific stimuli. Humans (who were task-naïve) showed a transitory bias to F when it was paired with novel stimuli, but very rapidly unlearned that bias. Performance with respect to the remaining stimuli was consistent with past reports of TI in both species. These results are difficult to reconcile with any account that seeks to assign the strength of association between individual stimuli and rewards. Instead, they support both sophisticated cognitive processes in both species, albeit with some species differences.