Physiological heatmaps: a tool for visualizing users’ emotional reactions

Abstract

Practitioners in many fields of human-computer interaction are now using physiological data to measure different aspects of user experience. The dynamic nature of physiological data offers a continuous window to the users and allows a better understanding of their experience while interacting with a system. However, in order to be truly informative, physiological signals need to be closely linked to users' behaviors and interaction states. This paper presents an analysis method that provides a direct visual interpretation of users' physiological signals when interacting with an interface. The proposed physiological heatmap tool uses eyetracking data along with physiological signals to identify regions where users are experiencing different emotional and cognitive states with a higher frequency. The method was evaluated in an experiment with 44 participants. Results show that physiological heatmaps are able to identify emotionally significant regions within an interface better than standard gaze heatmaps. Applications of the method to different fields of HCI research are also discussed.

Recommendation Agent Adoption: How Recommendation Presentation Influences Employees’ Perceptions, Behaviors, and Decision Quality

“…Hence, future research should replicate this study with a larger sample size to confirm our findings. Also, the techniques proposed by Léger et al [58] and Courtemanche et al [59] could be used to understand the emotional and cognitive states of an employee at the time of fixation on the recommendations of an RA.…”

Towards Agility and Speed in Enriched UX Evaluation Projects

“…The triangulation of measures also makes it possible to anticipate the potentially interesting results that will answer the client's questions. This triangulation is achieved through a mosaic of proven collection methods [5,30,31]. The use of several data collection technologies of variable nature (physiological, psychological, and behavioral) ensures an enriched data collection.…”

“…By aggregating and triangulating the arsenal of empirical data collected, the laboratory's researchers have succeeded in creating a methodology for simplifying and making the data more accessible. The results of this methodology are the visualizations of the interactions through the creation of UX heatmaps [5,30,31]. These heatmaps offer an "easy to interpret UX evaluation tool which contextualizes users' signals while interacting with a system.…”

“…In order to better understand and get an overall picture of user interaction and satisfaction regarding a product, enriched UX measures arising from psychophysiological and neurophysiological data-that is, cognitive and emotional measures from lived experiences-have been proposed in recent research [5,6]. However, we know from experience that analyzing such measures is time-consuming and complex; hence, they may not always be available promptly to inform product development [7,8].…”

Survey and Co-Design the Urban Landscape. Innovative Digital Path for Perception Analysis and Data-Driven Project

“…In this way, it is possible to record which elements the observer looks at and where he focuses most. It allows identifying in an objective way what are the most perceived elements in a given environment, and which consequently characterize it (Crosby and Hermens, 2018;Dufresne et al, 2017;Q. Li et al, 2016;Pieters and Warlop, 1999;Santos et al, 2015Santos et al, , 2015Schiessl et al, 2003;Weichbroth et al, 2016).…”