Fast Recurrent Processing via Ventrolateral Prefrontal Cortex Is Needed by the Primate Ventral Stream for Robust Core Visual Object Recognition

Kar, Kohitij; DiCarlo, James J.

doi:10.1016/j.neuron.2020.09.035

Cited by 120 publications

(124 citation statements)

References 44 publications

Supporting

Mentioning

113

Contrasting

Order By: Relevance

“…The familiar face subspace was shifted relative to the unfamiliar face subspace at short latencies and was then further distorted at long latencies, leading to greatly increased distances between familiar faces. Inactivation of PR did not affect these memory-related dynamics in AM, suggesting that the dynamics arise from intrinsic recurrent processes within IT cortex or interactions with downstream regions outside the medial temporal lobe ( 30, 31 ). Overall, our findings reveal the network code for visual memory of faces, showing that familiar faces trigger a distinct long-latency representation optimized to distinguish familiar identities.…”

Section: Figurementioning

confidence: 88%

The neural code for face memory

She

Benna

Shi

et al. 2021

Preprint

View full text Add to dashboard Cite

The ability to recognize familiar visual objects is critical to survival. Neurons in inferotemporal (IT) cortex represent the percept of visual objects using a distributed axis code. However, the network code for the memory of visual objects remains elusive. Here, we measured neuronal responses to familiar and unfamiliar faces in two face patches, AM and PR. In both areas, familiar and unfamiliar faces were represented in distinct subspaces. The familiar face subspace was shifted relative to the unfamiliar face subspace at short latency and then distorted to increase neural distances between familiar faces at long latency. Our results suggest that memories of familiar faces are represented in IT and perirhinal cortex by a distinct long-latency code that is optimized to distinguish familiar identities.

show abstract

Section: Figurementioning

confidence: 88%

The neural code for face memory

She

Benna

Shi

et al. 2021

Preprint

View full text Add to dashboard Cite

show abstract

“…Theoretical studies assume that the visual system constantly integrates top-down predictions with sensory inputs to resolve perceptual ambiguity (7,11,12). Recurrent processing has been shown to be important for robustly perceiving degraded stimuli such as occluded or unclear images (39,40). In early infancy, such predictive mechanisms may be immature, and perception could be vulnerable to degradation and ambiguity.…”

Section: Discussionmentioning

confidence: 99%

Perception of invisible masked objects in early infancy

Nakashima

Kanazawa

Yamaguchi

2021

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

Recurrent loops in the visual cortex play a critical role in visual perception, which is likely not mediated by purely feed-forward pathways. However, the development of recurrent loops is poorly understood. The role of recurrent processing has been studied using visual backward masking, a perceptual phenomenon in which a visual stimulus is rendered invisible by a following mask, possibly because of the disruption of recurrent processing. Anatomical studies have reported that recurrent pathways are immature in early infancy. This raises the possibility that younger infants process visual information mainly in a feed-forward manner, and thus, they might be able to perceive visual stimuli that adults cannot see because of backward masking. Here, we show that infants under 7 mo of age are immune to visual backward masking and that masked stimuli remain visible to younger infants while older infants cannot perceive them. These results suggest that recurrent processing is immature in infants under 7 mo and that they are able to perceive objects even without recurrent processing. Our findings indicate that the algorithm for visual perception drastically changes in the second half of the first year of life.

show abstract

“…Therefore, future experimental investigations should dissect the role of IT cortex and how it functionally influences the VF and VS neurons, which are likely part of a complimentary coding scheme. Furthermore, it will be essential to examine how the IT cortical activity is driven by feedback projections from the amygdala, given that evidence for the importance of such connections from ventrolateral PFC has been demonstrated for object recognition 40 .…”

Section: Modeling Results Imply the Need For More Fine Grain Neural Measurements In The Primate It Cortex And Amygdalamentioning

confidence: 99%

A computational probe into the behavioral and neural markers of atypical facial emotion processing in autism

Kar

2021

Preprint

Self Cite

View full text Add to dashboard Cite

Despite ample behavioral evidence of atypical facial emotion processing in individuals with autism (IwA), the neural underpinnings of such behavioral heterogeneities remain unclear. Here, I have used brain-tissue mapped artificial neural network (ANN) models of primate vision to probe candidate neural and behavior markers of atypical facial emotion recognition in IwA at an image-by-image level. Interestingly, the ANNs' image-level behavioral patterns better matched the neurotypical subjects' behavior than those measured in IwA. This behavioral mismatch was most remarkable when the ANN behavior was decoded from units that correspond to the primate inferior temporal (IT) cortex. ANN-IT responses also explained a significant fraction of the image-level behavioral predictivity associated with neural activity in the human amygdala, strongly suggesting that the previously reported facial emotion intensity encodes in the human amygdala could be primarily driven by projections from the IT cortex. Furthermore, in silico experiments revealed how learning under noisy sensory representations could lead to atypical facial emotion processing that better matches the image-level behavior observed in IwA. In sum, these results identify primate IT activity as a candidate neural marker and demonstrate how ANN models of vision can be used to generate neural circuit-level hypotheses and guide future human and non-human primate studies in autism.

show abstract

Fast Recurrent Processing via Ventrolateral Prefrontal Cortex Is Needed by the Primate Ventral Stream for Robust Core Visual Object Recognition

Cited by 120 publications

References 44 publications

The neural code for face memory

The neural code for face memory

Perception of invisible masked objects in early infancy

A computational probe into the behavioral and neural markers of atypical facial emotion processing in autism

Contact Info

Product

Resources

About