Modeling semantic aspects of gaze behavior while catalog browsing

Abstract

Gaze behavior is one of crucial clues to understand human mental states. The goal of this study is to build a probabilistic model that represents relationships between users' gaze behavior and user states while catalog browsing. In the proposed model, users' gaze behavior is interpreted based on semantic and spatial relationships among objects constituting displayed contents, which is referred to as designed structures. Moreover, a method for estimating users' mental states is also proposed based on the model to evaluate the model by measuring the performance of user state estimation. The results from preliminary experiments show that the proposed model improved estimation accuracies of user states compared to other baseline methods.