Abstract& Processing of complex visual stimuli comprising facial movements, hand actions, and body movements is known to occur in the superior temporal sulcus (STS) of humans and nonhuman primates. The STS is also thought to play a role in the integration of multimodal sensory input. We investigated whether STS neurons coding the sight of actions also integrated the sound of those actions. For 23% of neurons responsive to the sight of an action, the sound of that action significantly modulated the visual response. The sound of the action increased or decreased the visually evoked response for an equal number of neurons. In the neurons whose visual response was increased by the addition of sound (but not those neurons whose responses were decreased), the audiovisual integration was dependent upon the sound of the action matching the sight of the action. These results suggest that neurons in the STS form multisensory representations of observed actions. &

It is well established that the responses of neurons in the lateral geniculate nucleus (LGN) can be modulated by feedback from visual cortex, but it is still unclear how cortico-geniculate afferents regulate the flow of visual information to the cortex in the primate. Here we report the effects, on the gain of LGN neurons, of differentially stimulating the extraclassical receptive field, with feedback from the striate cortex intact or inactivated in the marmoset monkey, Callithrix jacchus. A horizontally oriented grating of optimal size, spatial frequency, and temporal frequency was presented to the classical receptive field. The grating varied in contrast (range: 0–1) from trial to trial, and was presented alone, or surrounded by a grating of the same or orthogonal orientation, contained within either a larger annular field, or flanks oriented either horizontally or vertically. V1 was ablated to inactivate cortico-geniculate feedback. The maximum firing rate of LGN neurons was greater with V1 intact, but was reduced by visually stimulating beyond the classical receptive field. Large horizontal or vertical annular gratings were most effective in reducing the maximum firing rate of LGN neurons. Magnocellular neurons were most susceptible to this inhibition from beyond the classical receptive field. Extraclassical inhibition was less effective with V1 ablated. We conclude that inhibition from beyond the classical receptive field reduces the excitatory influence of V1 in the LGN. The net balance between cortico-geniculate excitation and inhibition from beyond the classical receptive field is one mechanism by which signals relayed from the retina to V1 are controlled.

No abstract

Abstract& Prolonged exposure to visual stimuli, or adaptation, often results in an adaptation ''aftereffect'' which can profoundly distort our perception of subsequent visual stimuli. This technique has been commonly used to investigate mechanisms underlying our perception of simple visual stimuli, and more recently, of static faces. We tested whether humans would adapt to movies of hands grasping and placing different weight objects. After adapting to hands grasping light or heavy objects, subsequently perceived objects appeared relatively heavier, or lighter, respectively. The aftereffects increased logarithmically with adaptation action repetition and decayed logarithmically with time. Adaptation aftereffects also indicated that perception of actions relies predominantly on view-dependent mechanisms. Adapting to one action significantly influenced the perception of the opposite action. These aftereffects can only be explained by adaptation of mechanisms that take into account the presence/absence of the object in the hand. We tested if evidence on action processing mechanisms obtained using visual adaptation techniques confirms underlying neural processing. We recorded monkey superior temporal sulcus (STS) single-cell responses to hand actions. Cells sensitive to grasping or placing typically responded well to the opposite action; cells also responded during different phases of the actions. Cell responses were sensitive to the view of the action and were dependent upon the presence of the object in the scene. We show here that action processing mechanisms established using visual adaptation parallel the neural mechanisms revealed during recording from monkey STS. Visual adaptation techniques can thus be usefully employed to investigate brain mechanisms underlying action perception. &