Learning neural codes for perceptual uncertainty

Abstract

Perception is an inferential process, in which the state of the immediate environment must be estimated from sensory input. Inference in the face of noise and ambiguity requires reasoning with uncertainty, and much animal behaviour appears close to Bayes optimal. This observation has inspired hypotheses for how the activity of neurons in the brain might represent the distributional beliefs necessary to implement explicit Bayesian computation. While previous work has focused on the sufficiency of these hypothesised codes for computation, relatively little consideration has been given to optimality in the representation itself. Here, we adopt an encoder-decoder approach to study representational optimisation within one hypothesised belief encoding framework: the distributed distributional code (DDC). We consider a setting in which typical belief distribution functions take the form of a sparse combination of an underlying set of basis functions, and the corresponding DDC signals are corrupted by neural variability. We estimate the conditional entropy over beliefs induced by these DDC signals using an appropriate decoder. Like other hypothesised frameworks, a DDC representation of a belief depends on a set of fixed encoding functions that are usually set arbitrarily. Our approach allows us to seek the encoding functions that minimise the decoder conditional entropy and thus optimise representational accuracy in an information theoretic sense. We apply the approach to show how optimal encoding properties may adapt to represent beliefs in new environments, relating the results to experimentally reported neural responses.

How does V1 population activity inform perceptual certainty?

“…Likewise, given that response variability and inferential uncertainty are intimately related, spatio temporal fluctuations in neural responsiveness may provide a useful indication of perceptual uncertainty ( Hoyer & Hyvärinen, 2003 ; Savin & Denève, 2014 ; Orbán, Berkes, Fiser, & Lengyel, 2016 ; Hénaff, Boundy-Singer, Meding, Ziemba, & Goris, 2020 ; Festa, Aschner, Davila, Kohn, & Coen-Cagli, 2021 ). And perhaps there are less intuitive aspects of sensory population activity that provide an even better indication of downstream uncertainty ( Zemel, Dayan, & Pouget, 1998 ; Sahani & Dayan, 2003 ; Salmasi & Sahani, 2022 ; Walker, Cotton, Ma, & Tolias, 2020 ). Here, we examined these questions in macaque primary visual cortex (V1).…”

How does V1 population activity inform perceptual certainty?

“…Likewise, given that response variability and inferential uncertainty are intimately related, spatiotemporal fluctuations in neural responsiveness may provide a useful indication of perceptual uncertainty [17][18][19][20][21] . And perhaps there are less intuitive aspects of sensory population activity that provide an even better indication of downstream uncertainty [22][23][24][25] .…”