The essential role of feedback processing for figure-ground perception in mice

Kirchberger, Lisa; Mukherjee, Sreedeep; Uh, Schnabel; Eh, van Beest; Barsegyan, Areg; Cn, Levelt; Ja, Heimel; Jam, Lorteije; C, van der Togt; Mw, Self; Roelfsema, Pieter R.

doi:10.1101/456459

Cited by 6 publications

(6 citation statements)

References 89 publications

(94 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Our finding that figure-ground signals exist in mouse visual cortex ( Figures 3e, f , 4 , and 5d, i ), but are strongly dependent on texture ( Figures 4 and 5a, b, e, i–k ), is consistent with previous studies ( Schnabel et al, 2018a ; Kirchberger et al, 2020 ; Schnabel et al, 2018b ; Keller et al, 2020b ). Optogenetic perturbation studies have further demonstrated that these signals are behaviorally relevant for figure detection ( Kirchberger et al, 2020 ) and require feedback ( Kirchberger et al, 2020 ; Keller et al, 2020a ). Thus overall, it seems clear that mouse visual cortex shows orientation-dependent surround modulation ( Self et al, 2014 ; Keller et al, 2020a ) which can support texture-based figure-ground segmentation behavior.…”

Section: Discussionsupporting

confidence: 92%

“…Behaviorally, mice are capable of texture-based segmentation, in which figure and background are defined by grating patterns with different orientation and/or phase ( Kirchberger et al, 2020 ; Schnabel et al, 2018a ). Consistent with this behavioral capability, cells in mouse V1 show iso-orientation surround suppression ( Self et al, 2014 ; Keller et al, 2020a ) and have been reported to be modulated by figure versus ground ( Schnabel et al, 2018a ; Kirchberger et al, 2020 ; Keller et al, 2020b ). However, all these studies have used texture-based cues, which are fundamentally ambiguous for solving segmentation ( Figure 1b ).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Mice and primates use distinct strategies for visual segmentation

Luongo

Liu

et al. 2023

eLife

View full text Add to dashboard Cite

The rodent visual system has attracted great interest in recent years due to its experimental tractability, but the fundamental mechanisms used by the mouse to represent the visual world remain unclear. In the primate, researchers have argued from both behavioral and neural evidence that a key step in visual representation is 'figure-ground segmentation', the delineation of figures as distinct from backgrounds (Nakayama, He, and Shimojo 1995; Lamme 1995; Poort et al. 2012; Qiu and Heydt 2005). To determine if mice also show behavioral and neural signatures of figure-ground segmentation, we trained mice on a figure-ground segmentation task where figures were defined by gratings and naturalistic textures moving counterphase to the background. Unlike primates, mice were severely limited in their ability to segment figure from ground using the opponent motion cue, with segmentation behavior strongly dependent on the specific carrier pattern. Remarkably, when mice were forced to localize naturalistic patterns defined by opponent motion, they adopted a strategy of brute force memorization of texture patterns. In contrast, primates, including humans, macaques, and mouse lemurs, could readily segment figures independent of carrier pattern using the opponent motion cue. Consistent with mouse behavior, neural responses to the same stimuli recorded in mouse visual areas V1, RL, and LM also did not support texture-invariant segmentation of figures using opponent motion. Modeling revealed that the texture dependence of both the mouse's behavior and neural responses could be explained by a feedforward neural network lacking explicit segmentation capabilities. These findings reveal a fundamental limitation in the ability of mice to segment visual objects compared to primates.

show abstract

Section: Discussionsupporting

confidence: 92%

Section: Introductionmentioning

confidence: 99%

Mice and primates use distinct strategies for visual segmentation

Luongo

Liu

et al. 2023

eLife

View full text Add to dashboard Cite

show abstract

“…The visual system of the primate is somewhat different from that of the rodent, however. The primate has forward-looking eyes, and the movements of the eyes are conjugate, allowing for stereovison, and disjunctive when changing depth planes (Carpenter 1988, Schiller & Tehovnik 2015, Zhou & King 1998. In the rodent, however, the laterally placed eyes offer extended coverage of the visual field, which is important for predator avoidance (De Franceschi et al 2016, Ellard & Chapman 1991, Meister & Cox 2013, Wallace et al 2013, Yilmaz & Meister 2013.…”

Section: From Primate To Rodent Brainmentioning

confidence: 99%

The Visual Cortex in Context

Froudarakis

Fahey

Reimer

et al. 2019

Annu. Rev. Vis. Sci.

View full text Add to dashboard Cite

In this article, we review the anatomical inputs and outputs to the mouse primary visual cortex, area V1. Our survey of data from the Allen Institute Mouse Connectivity project indicates that mouse V1 is highly interconnected with both cortical and subcortical brain areas. This pattern of innervation allows for computations that depend on the state of the animal and on behavioral goals, which contrasts with simple feedforward, hierarchical models of visual processing. Thus, to have an accurate description of the function of V1 during mouse behavior, its involvement with the rest of the brain circuitry has to be considered. Finally, it remains an open question whether the primary visual cortex of higher mammals displays the same degree of sensorimotor integration in the early visual system.

show abstract

“…Optogenetic perturbation studies have further demonstrated that these signals are behaviorally relevant for 10 figure detection [29] and require feedback [29,31]. Thus overall, it seems clear that mouse visual cortex shows orientation-dependent surround modulation [15,16] which can support texture-based figure-ground segmentation behavior.…”

Section: Discussionmentioning

confidence: 95%

“…Behaviorally, mice are capable of texture-based segmentation, in which figure and background are defined by grating patterns and have different orientation or phase [29,30]. Consistent with this behavioral capability, cells in mouse V1 show iso-orientation surround suppression [15,16] and have been reported to be modulated by figure versus ground [29][30][31]. However, all of these studies have used texture-based cues, which are fundamentally ambiguous for solving segmentation (Fig.…”

Section: How Could the Brain Solve Visual Segmentation?mentioning

confidence: 87%

Mice and primates use distinct strategies for visual segmentation

Liu

Cla

et al. 2021

Preprint

View full text Add to dashboard Cite

The rodent visual system has attracted great interest in recent years due to its experimental tractability, but the fundamental mechanisms used by the mouse to represent the visual world remain unclear. In the primate, researchers have argued from both behavioral and neural evidence that a key step in visual representation is "figure-ground segmentation," the delineation of figures as distinct from backgrounds [1-4]. To determine if mice also show behavioral and neural signatures of figure-ground segmentation, we trained mice on a figure-ground segmentation task where figures were defined by gratings and naturalistic textures moving counterphase to the background. Unlike primates, mice were severely limited in their ability to segment figure from ground using the opponent motion cue, with segmentation behavior strongly dependent on the specific carrier pattern. Remarkably, when mice were forced to localize naturalistic patterns defined by opponent motion, they adopted a strategy of brute force memorization of texture patterns. In contrast, primates, including humans, macaques, and mouse lemurs, could readily segment figures independent of carrier pattern using the opponent motion cue. Consistent with mouse behavior, neural responses to the same stimuli recorded in mouse visual areas V1, RL, and LM also did not support texture-invariant segmentation of figures using opponent motion. Modeling revealed that the texture dependence of both the mouse's behavior and neural responses could be explained by a feedforward neural network lacking explicit segmentation capabilities. These findings reveal a fundamental limitation in the ability of mice to segment visual objects compared to primates.

show abstract

The essential role of feedback processing for figure-ground perception in mice

Cited by 6 publications

References 89 publications

Mice and primates use distinct strategies for visual segmentation

Mice and primates use distinct strategies for visual segmentation

The Visual Cortex in Context

Mice and primates use distinct strategies for visual segmentation

Contact Info

Product

Resources

About