Neural Correlates for Perception of 3D Surface Orientation from Texture Gradient

Tsutsui, Ken; Sakata, Hideo; Naganuma, Tomoka; Taira, Masato

doi:10.1126/science.1074128

Cited by 195 publications

(163 citation statements)

References 19 publications

Supporting

Mentioning

143

Contrasting

Unclassified

Order By: Relevance

“…AIP receives input from parietal visual areas (in particular LIP, CIP, and V6a) and from the inferior temporal cortex (TEa, TEm) (Nakamura et al, 2001;Borra et al, 2008). These areas represent spatial and object orientation information of visible objects (Sakata et al, 1997;Tsutsui et al, 2001Tsutsui et al, , 2002Galletti et al, 2003). Also, AIP receives connections from the prefrontal cortex (areas 46v and 12l) (Borra et al, 2008), which might convey contextual information, as we have observed in AIP.…”

Section: Discussionmentioning

confidence: 80%

Context-Specific Grasp Movement Representation in the Macaque Anterior Intraparietal Area

Baumann¹,

Fluet²,

Scherberger³

2009

J. Neurosci.

226

237

View full text Add to dashboard Cite

To perform grasping movements, the hand is shaped according to the form of the target object and the intended manipulation, which in turn depends on the context of the action. The anterior intraparietal cortex (AIP) is strongly involved in the sensorimotor transformation of grasping movements, but the extent to which it encodes context-specific information for hand grasping is unclear. To explore this issue, we recorded 571 single-units in AIP of two macaques during a delayed grasping task, in which animals were instructed by an external context cue (LED) to perform power or precision grips on a handle that was presented in various orientations. While 55% of the recorded neurons encoded the object orientation from the cue epoch on, the number of cells encoding the grip type increased from 25% during the cue epoch to 58% during movement execution. Furthermore, a classification of cells according to the time of their tuning onset revealed differences in the function and anatomical location of early-versus late-tuned cells. In a cue separation task, when the object was presented first, neurons representing power or precision grips were activated simultaneously until the actual grip type was instructed. In contrast, when the grasp type instruction was presented before the object, type information was only weakly represented in AIP, but was strongly encoded after the grasp target was revealed. We conclude that AIP encodes context specific hand grasping movements to perceived objects, but in the absence of a grasp target, the encoding of context information is weak.

show abstract

Section: Discussionmentioning

confidence: 80%

Context-Specific Grasp Movement Representation in the Macaque Anterior Intraparietal Area

Baumann¹,

Fluet²,

Scherberger³

2009

J. Neurosci.

226

237

View full text Add to dashboard Cite

show abstract

“…3D vision mechanisms then could ''read off'' the anticipated 3D orientation from the depth cues in the anticipated 2D map. Alternatively, a direct mechanism could act on the high-level neural representations of 3D surface orientation that are known to exist in the brain (41). Although these representations originally are extracted from the retinal image, they may be updated directly in anticipation of a saccade without relying on remapped retinotopic arrays.…”

Section: Discussionmentioning

confidence: 99%

“…A plausible neural mechanism draws inspiration from the anticipatory remapping of 2D neuronal receptive fields in the intraparietal sulcus of monkeys (20)(21)(22) and elsewhere (23)(24)(25). Recently, a population of neurons has been discovered in area CIP of the intraparietal sulcus of monkeys that codes the 3D orientation of surfaces (and in particular, tilt) in a way that seems to be independent of the underlying depth cues (41). Other such maps probably exist elsewhere in the primate brain (44,45).…”

Section: Discussionmentioning

confidence: 99%

Anticipating the three-dimensional consequences of eye movements

Wexler

2005

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

Rapid eye movements called saccades give rise to sudden, enormous changes in optic information arriving at the eye; how the world nonetheless appears stable is known as the problem of spatial constancy. One consequence of saccades is that the directions of all visible points shift uniformly; directional or 2D constancy, the fact that we do not perceive this change, has received extensive study for over a century. The problems raised by 3D consequences of saccades, on the other hand, have been neglected. When the eye rotates in space, the 3D orientation of all stationary surfaces undergoes an equal-and-opposite rotation with respect to the eye. When presented with a an optic simulation of a saccade but with the eyes still, observers readily perceive this depth rotation of surfaces; when simultaneously performing the corresponding saccade, the 3D orientations of surfaces are perceived as stable, a phenomenon I propose calling 3D spatial constancy. In experiments presented here, observers viewed ambiguous 3D rotations immediately before, during, or after a saccade. The results show that before the eyes begin to move the brain anticipates the 3D consequences of saccades, preferring to perceive the rotation opposite to the impending eye movement. Further, the anticipation is absent when observers fixate while experiencing optically simulated saccades, and therefore must be evoked by extraretinal signals. Such anticipation could provide a mechanism for 3D spatial constancy and transsaccadic integration of depth information.depth perception ͉ vision ͉ saccades ͉ spatial constancy D irectional or 2D spatial constancy holds insofar as the uniform, 2D shifts of the retinal image accompanying each eye movement (see Fig. 1a) do not lead to perceptions either of change in direction of individual points or of 2D motion. This type of spatial constancy was noted by Descartes in his Traité de l'Homme and has been studied systematically since the 19th century (refs. 1-3 and see refs. 4-8 for reviews). Distortions in spatial vision in the temporal vicinity of saccades are considered as signs of processes that give rise to constancy. For example, the threshold for perceiving motion rises just before a saccade (9, 10), which may be why motion is usually not perceived after saccade-induced retinal shifts, and may allow for optimal transsaccadic integration of information (11). Furthermore, points flashed around the time of a saccade are systematically mislocalized in a way that suggests slow build-up of compensation for retinal shifts (12)(13)(14)(15)(16)(17)(18)(19). The dynamic properties of neurons that remap their receptive fields in the anticipation of saccades may be closely connected with these distortions and contribute to spatial constancy (7). Such neurons have been found in posterior parietal cortex (20)(21)(22), superior colliculus (23), and the frontal eye field (24) of monkeys; recently, neuroimaging has demonstrated similar spatial updating in human parietal cortex (25).An aspect of the spatial constancy problem that h...

show abstract

“…Early neurophysiological recordings revealed selectivity for binocular disparity at multiple levels of the visual hierarchy: V1 (Barlow et al 1967;Poggio and Fischer 1977), V2 (Thomas et al 2002;von der Heydt et al 2000), V3 (Adams and Zeki 2001;Felleman and Van Essen 1987;Poggio et al 1988), V4 (Hegde and Van Essen 2005;Connor 2002, 2005;Tanabe et al 2004;Watanabe et al 2002), MT/V5 (DeAngelis and Newsome 1999; Krug et al 2004;Palanca and DeAngelis 2003;DeAngelis 2004, 2006), MST (Eifuku and Wurtz 1999;Takemura et al 2002), IT (Janssen et al 2000(Janssen et al , 2001(Janssen et al , 2003Liu et al 2004;Tanaka et al 2001;Uka et al 2000Uka et al , 2005, and in regions of the parietal (caudal intraparietal sulcus) cortex (Taira et al 2000;Tsutsui et al 2002). Complementary evidence from human brain imaging implicated several areas across the visual, object-related, motion-related, and parietal cortex in the processing of disparity information (for reviews see Neri 2005;Orban et al 2006a,b).…”

Section: Disparity Processing and 3d Shape Perceptionmentioning

confidence: 99%

“…Complementary evidence from human brain imaging implicated several areas across the visual, object-related, motion-related, and parietal cortex in the processing of disparity information (for reviews see Neri 2005;Orban et al 2006a,b). Further, several recent studies suggest that areas involved in disparity processing primarily in the temporal and parietal cortex are also engaged in the processing of monocular cues to depth (e.g., texture, motion, shading) (James et al 2002;Kourtzi et al 2003;Liu et al 2004;Murray et al 2003;Orban et al 2006a;Peuskens et al 2004;Sakata et al 2005;Sereno et al 2002;Shikata et al 2001;Taira et al 2001;Tsutsui et al 2002;Vanduffel et al 2002).…”

Section: Disparity Processing and 3d Shape Perceptionmentioning

confidence: 99%

Neural Correlates of Disparity-Defined Shape Discrimination in the Human Brain

Chandrasekaran

Canon

Dahmen³

et al. 2007

Journal of Neurophysiology

View full text Add to dashboard Cite

Chandrasekaran C, Canon V, Dahmen JC, Kourtzi Z, Welchman AE. Neural correlates of disparity-defined shape discrimination in the human brain. J Neurophysiol 97: [1553][1554][1555][1556][1557][1558][1559][1560][1561][1562][1563][1564][1565] 2007. First published December 6, 2006; doi:10.1152/jn.01074.2006. Binocular disparity, the slight differences between the images registered by our two eyes, provides an important cue when estimating the three-dimensional (3D) structure of the complex environment we inhabit. Sensitivity to binocular disparity is evident at multiple levels of the visual hierarchy in the primate brain, from early visual cortex to parietal and temporal areas. However, the relationship between activity in these areas and key perceptual functions that exploit disparity information for 3D shape perception remains an important open question. Here we investigate the link between human cortical activity and the perception of disparity-defined shape, measuring fMRI responses concurrently with psychophysical shape judgments. We parametrically degraded the coherence of shapes by shuffling the spatial position of dots whose disparity defined the 3D structure and investigated the effect of this stimulus manipulation on both cortical activity and shape discrimination. We report significant relationships between shape coherence and fMRI response in both dorsal (V3, hMTϩ/V5) and ventral (LOC) visual areas that correspond to the observers' discrimination performance. In contrast to previous suggestions of a dichotomy of disparity-related processes in the ventral and dorsal streams, these findings are consistent with proposed interactions between these pathways that may mediate a continuum of processes important in perceiving 3D shape from coarse contour segmentation to fine curvature estimation. I N T R O D U C T I O NEveryday human behavior depends on the brain estimating the depth structure of the nearby environment so that we can avoid dangers and exploit opportunities. A powerful source of information to depth structure is provided by the slight differences between the retinal images registered by our two eyes (binocular disparity). The brain's use of binocular disparity has been studied extensively Howard and Rogers 2002), largely because of the quantitative relation between disparity and the depth structure of the environment (Longuet-Higgins 1982), the exquisite sensitivity of the brain to disparity (Westheimer and McKee 1978), and the observation that horizontal binocular disparity provides a powerful impression of depth even under impoverished viewing conditions (Julesz 1971).Neurophysiological and imaging studies revealed selectivity for binocular disparity at multiple levels of the visual hierarchy in the monkey and the human brain from early visual areas, to object-and motion-selective areas and the parietal cortex (for reviews see Cumming and DeAngelis 2001;Neri 2005; Orban et al. 2006a,b;Parker 2004). However, understanding how activity in these multiple disparity-selectivity regions relates to k...

show abstract

Neural Correlates for Perception of 3D Surface Orientation from Texture Gradient

Cited by 195 publications

References 19 publications

Context-Specific Grasp Movement Representation in the Macaque Anterior Intraparietal Area

Context-Specific Grasp Movement Representation in the Macaque Anterior Intraparietal Area

Anticipating the three-dimensional consequences of eye movements

Neural Correlates of Disparity-Defined Shape Discrimination in the Human Brain

Contact Info

Product

Resources

About