“The eyes are the window to the representation”: Linking gaze to memory precision and decision weights in object discrimination tasks.

Abstract

Humans selectively attend to task-relevant information in order to make accurate decisions. However, selective attention incurs consequences if the learning environment changes unexpectedly. This trade-off has been underscored by studies that compare learning behaviors between adults and young children: broad sampling during learning comes with a breadth of information in memory, often allowing children to notice details of the environment that are missed by their more selective adult counterparts. The current work extends the exemplar-similarity account of object discrimination to consider both the intentional and consequential aspects of selective attention when predicting choice. In a novel direct input approach, we used trial-level eyetracking data from training and test to replace the otherwise freely estimated attention dynamics of the model. We demonstrate that only a model imbued with gaze correlates of memory precision in addition to decision weights can accurately predict key behaviors associated with (a) selective attention to a relevant dimension, (b) distributed attention across dimensions, and (c) flexibly shifting strategies between tasks. Although humans engage in selective attention with the intention of being accurate in the moment, our findings suggest that its consequences on memory constrain the information that is available for making decisions in the future.