Game theory outlines optimal response strategies during mixed-strategy competitions. The neural processes involved in choosing individual strategic actions, however, remain poorly understood. Here, we tested whether the superior colliculus (SC), a brain region critical for generating sensory-guided saccades, is also involved in choosing saccades under strategic conditions. Monkeys were free to choose either of two saccade targets as they competed against a computer opponent during the mixed-strategy game "matching pennies." The accuracy with which presaccadic SC activity predicted upcoming choice gradually increased in the time leading up to the saccade. Probing the SC with suprathreshold stimulation demonstrated that these evolving signals were functionally involved in preparing strategic saccades. Finally, subthreshold stimulation of the SC increased the likelihood that contralateral saccades were selected. Together, our results suggest that motor regions of the brain play an active role in choosing strategic actions rather than passively executing those prespecified by upstream executive regions.

In learning models of strategic game play, an agent constructs a valuation (action value) over possible future choices as a function of past actions and rewards. Choices are then stochastic functions of these action values. Our goal is to uncover a neural signal that correlates with the action value posited by behavioral learning models. We measured activity from neurons in the superior colliculus (SC), a midbrain region involved in planning saccadic eye movements, while monkeys performed two saccade tasks. In the strategic task, monkeys competed against a computer in a saccade version of the mixed-strategy game ”matching-pennies”. In the instructed task, saccades were elicited through explicit instruction rather than free choices. In both tasks neuronal activity and behavior were shaped by past actions and rewards with more recent events exerting a larger influence. Further, SC activity predicted upcoming choices during the strategic task and upcoming reaction times during the instructed task. Finally, we found that neuronal activity in both tasks correlated with an established learning model, the Experience Weighted Attraction model of action valuation (Camerer and Ho, 1999). Collectively, our results provide evidence that action values hypothesized by learning models are represented in the motor planning regions of the brain in a manner that could be used to select strategic actions.

Microsaccades are small-amplitude (typically <1°), ballistic eye movements that occur when attempting to fixate gaze. Initially thought to be generated randomly, it has recently been established that microsaccades are influenced by sensory stimuli, attentional processes, and certain cognitive states. Whether decision processes influence microsaccades, however, is unknown. Here, we adapted two classic economic tasks to examine whether microsaccades reflect evolving saccade decisions. Volitional saccade choices of monkey and human subjects provided a measure of the subjective value of targets. Importantly, analyses occurred during a period of complete darkness to minimize the known influence of sensory and attentional processes on microsaccades. As the time of saccadic choice approached, microsaccade direction became the following: 1) biased toward targets as a function of their subjective value and 2) predictive of upcoming, voluntary choice. Our results indicate that microsaccade direction is influenced by and is a reliable tell of evolving saccade decisions. Our results are consistent with dynamic decision processes within the midbrain superior colliculus; that is, microsaccade direction is influenced by the transition of activity toward caudal saccade regions associated with high saccade value and/or future saccade choice.

Game theory can predict the distribution of choices in aggregate during mixed-strategy games, yet the neural process mediating individual probabilistic choices remains poorly understood. Here, we examined the role of frontal eye field (FEF) in a decision-making task when macaques were trained to play a mixed-strategic game Matching Pennies against a computer opponent. Neuronal activities of FEF neurons predicted the animals' upcoming saccadic choices and these activities became increasingly more selective as the choice deadline approached. Subthreshold electrical micro-stimulation applied in FEF also biased choices. Extended stimulation biased choices towards the preferred FEF vector whereas early termination of stimulation biased choices away from the preferred FEF vector. By contrast, micro-stimulation biased choices in the preferred direction during a non-strategic perceptual luminance discrimination task. We conclude that FEF is causally contributing to mixed-strategy decision-making process although the timing of FEF activation contributes to the decision process in a more non-linear manner during strategic compared to perceptual decision-making.