The integration of auditory and visual stimuli is crucial for recognizing objects, communicating effectively, and navigating through our

Romanski, Lizabeth M., Bruno B. Averbeck, and Mark Diltz. Neural representation of vocalizations in the primate ventrolateral prefrontal cortex.

1. Inferotemporal, hippocampal, and parahippocampal units were recorded while monkeys were alert (as judged by eye movements) but resting, in both light and dark. 2. Spontaneous saccadic eye movements produced significant changes in unit activity for 108 of 308 cells. This activity is shown to be extraretinal either because it occurred in complete darkness or because of its timing relative to the eye movement. 3. The total saccadic modulation in the ventral temporal lobe is estimated to be over ten million action potentials.

Neuronal activity in single prefrontal neurons has been correlated with behavioral responses, rules, task variables and stimulus features. In the non-human primate, neurons recorded in ventrolateral prefrontal cortex (VLPFC) have been found to respond to species-specific vocalizations. Previous studies have found multisensory neurons which respond to simultaneously presented faces and vocalizations in this region. Behavioral data suggests that face and vocal information are inextricably linked in animals and humans and therefore may also be tightly linked in the coding of communication calls in prefrontal neurons. In this study we therefore examined the role of VLPFC in encoding vocalization call type information. Specifically, we examined previously recorded single unit responses from the VLPFC in awake, behaving rhesus macaques in response to 3 types of species-specific vocalizations made by 3 individual callers. Analysis of responses by vocalization call type and caller identity showed that ∽ 19 % of cells had a main effect of call type with fewer cells encoding caller. Classification performance of VLPFC neurons was ∽ 42% averaged across the population. When assessed at discrete time bins, classification performance reached 70 percent for coos in the first 300 ms and remained above chance for the duration of the response period, though performance was lower for other call types. In light of the sub-optimal classification performance of the majority of VLPFC neurons when only vocal information is present, and the recent evidence that most VLPFC neurons are multisensory, the potential enhancement of classification with the addition of accompanying face information is discussed and additional studies recommended. Behavioral and neuronal evidence has shown a considerable benefit in recognition and memory performance when faces and voices are presented simultaneously. In the natural environment both facial and vocalization information is present simultaneously and neural systems no doubt evolved to integrate multisensory stimuli during recognition.

Working-memory tasks often lead to elevated delay-period discharge rates in cortical neurons. When this altered neuronal discharge rate, called delay activity, shows stimulus specificity, it is a good candidate for a neuronal mechanism of working memory. If the delay activity is indeed the carrier of memory, then experimental manipulation during the delay period that disrupts delay activity should also disrupt behavioral performance. We tested this hypothesis in two macaque monkeys with a delayed matching-to-sample task (delay time: 8 or 10 s) in which only two visual images were used. In each trial, one of the images was randomly chosen as the sample. In control trials (without disruptive stimulation), the monkeys performed at the level of 74.3% correct recognition. Three electrical stimulation levels (mild: a 0.25-s train of electrical pulses; medium: 1-s train; strong: 4 s), delivered to the hippocampal formation or to the orbito-frontal and inferotemporal cortices during delay period, decreased the performance to 71.4, 66.8, and 58.0% respectively (all are significantly less than control performance, P < 0.05 for mild stimulation and P < 0.0001 for other stimulation levels). Three hundred and thirty-four cells were recorded from inferotemporal (211 cells) and prefrontal (123 cells) cortices. Significant (P < 0.05) stimulus-specific delay activity was found in about one-third of recorded cells. For these cells in control trials, the mean difference in delay-period spike rates between preferred and nonpreferred images was 26%. The electrical stimulation reduced this difference to 20% (not a statistically significant reduction) in trials with mild stimulation, to 14% (P < 0.05) with medium stimulation, and just to 4% (P < 0.0005) with strong stimulation. These results, that increasing electrical stimulation reduced neuronal selectivity and at the same time reduced behavioral performance, directly support the hypothesis that delay activity is the carrier of memory through the delay period.