Spontaneous eye movements reflect the representational geometries of conceptual spaces

The eyes are considered a ‘window’ into the mind, shedding light on the cognitive processes leading to explicit decisions. Yet, eye movements are also a distinct oculomotor decision that is the outcome of an independent cognitive system. When exploring novel environments, the convergence and divergence of gaze and explicit decisions highlights the eyes’ dual role. However, the computational mechanisms underlying this interplay and its contribution to adaptative behavior remains unclear. Combining virtual reality based associative learning paradigms with computational modeling across one exploratory and two pre-registered experiments (Total N = 115), we examine learning as multi-system process encompassing explicit decisions and ocular expectations. The two exhibited a partial overlap in their learning. On the one hand, participants’ explicit predictions about target location and their subsequent anticipatory gaze direction robustly converged, and gaze reveals the latent probability of the explicit choice. Moreover, gaze exhibited computational hallmarks of confidence, reflecting an oculomotor assessment of the explicit prediction. On the other hand, ocular and explicit decisions consistently diverged indicating an independent computation reflected in gaze. Although the two systems learn and ascribe value similarly, they utilize different decision mechanisms. Oculomotor decisions were less driven by choice consistency across trials enabling increased exploration. Under uncertainty explicit and oculomotor decisions tended to diverge, enabling a hedging of one’s decision. These findings highlight how together, explicit and oculomotor systems’ learning enables adaptive embodied behavior.Significance StatementThe eyes often reveal additional information beyond one’s explicit decision, offering a ‘window into the mind’ (e.g., leading poker players to wear sunglasses). Yet, eye movements are the product of a distinct system, occasionally diverging from explicit decisions. However, what additional information is conveyed by gaze, and what leads to its occasional divergence remain unclear. Using virtual reality and computational modeling, this study demonstrates a partial overlap between the two. Generally, they robustly converge, and gaze reflects a confidence-like assessment of explicit decisions. Yet they also diverge due to distinct decision mechanisms. Their divergence enables a ‘hedging’ of one’s decision under uncertainty. This demonstrates a multimodal decision process, where different action systems make overlapping but independent choices.

show abstract

Neural and behavioral reinstatement jointly reflect retrieval of narrative events

Nau,

Greene,

Tarder-Stoll

et al. 2024

Preprint

View full text Add to dashboard Cite

When recalling past events, patterns of gaze position and neural activity resemble those observed during the original experience. We hypothesized that these two phenomena, known as gaze reinstatement and neural reactivation, are linked through a common process that underlies the reinstatement of past experiences during memory retrieval. Here, we tested this proposal based on the viewing and recall of a narrative movie, which we assessed through fMRI, deep learning-based gaze prediction, and language modeling of spoken recall. In line with key predictions, gaze behavior adhered to the same principles as neural activity; it was event-specific, robust across individuals, and generalized across viewing and recall. Additionally, gaze-dependent brain activity overlapped substantially across tasks. Collectively, these results suggest that retrieval engages mechanisms that direct our eyes during natural vision, reflecting common constraints within the functional organization of the nervous system. Moreover, they highlight the importance of considering behavioral and neural reinstatement together in our understanding of remembering.

show abstract

Spontaneous eye movements reflect the representational geometries of conceptual spaces

Cited by 4 publications

References 71 publications

Dimensions of a hyper memory: investigating the factors modulating exceptional retrieval in a single case of highly superior autobiographical memory (HSAM)

Dimensions of a hyper memory: investigating the factors modulating exceptional retrieval in a single case of highly superior autobiographical memory (HSAM)

Gaze reflects confidence in explicit decisions while relying on a distinct computational mechanism

Neural and behavioral reinstatement jointly reflect retrieval of narrative events

Contact Info

Product

Resources

About