MLGaze: Machine Learning-Based Analysis of Gaze Error Patterns in Consumer Eye Tracking Systems

Abstract

Analyzing the gaze accuracy characteristics of an eye tracker is a critical task as its gaze data is frequently affected by non-ideal operating conditions in various consumer eye tracking applications. In previous research on pattern analysis of gaze data, efforts were made to model human visual behaviors and cognitive processes. What remains relatively unexplored are questions related to identifying gaze error sources as well as quantifying and modeling their impacts on the data quality of eye trackers. In this study, gaze error patterns produced by a commercial eye tracking device were studied with the help of machine learning algorithms, such as classifiers and regression models. Gaze data were collected from a group of participants under multiple conditions that commonly affect eye trackers operating on desktop and handheld platforms. These conditions (referred here as error sources) include user distance, head pose, and eye-tracker pose variations, and the collected gaze data were used to train the classifier and regression models. It was seen that while the impact of the different error sources on gaze data characteristics were nearly impossible to distinguish by visual inspection or from data statistics, machine learning models were successful in identifying the impact of the different error sources and predicting the variability in gaze error levels due to these conditions. The objective of this study was to investigate the efficacy of machine learning methods towards the detection and prediction of gaze error patterns, which would enable an in-depth understanding of the data quality and reliability of eye trackers under unconstrained operating conditions. Coding resources for all the machine learning methods adopted in this study were included in an open repository named MLGaze to allow researchers to replicate the principles presented here using data from their own eye trackers.

Implementation of Eye-Tracking Recording Tool into Narupa iMD VR Environment for Application in Chemistry Education

“…Further studies should improve the quality of the eye tracking data recording. Moreover, future research can implement machine learning techniques, which can effectively assess the presence of artifacts and noise, and make more accurate inferences from the resulting data, similarly to techniques that are already used for EEG …”

“…Further studies should improve the quality of the eye tracking data recording. Moreover, future research can implement machine learning techniques, which can effectively assess the presence of artifacts and noise, 89 and make more accurate inferences from the resulting data, similarly to techniques that are already used for EEG. 90 Furthermore, it seems to us that the use of eye tracking and electroencephalography (EEG) data in machine learning systems can be used to recognize a student's functional state during a task and further assist with providing more individualized recommendations and/or tasks during the learning process.…”

Application of Eye Tracking Technology in Aviation, Maritime, and Construction Industries: A Systematic Review

“… Example of the different types of eye tracking devices: ( a ) eye tracking glasses [ 75 ]; ( b ) headband [ 92 ]; ( c ) helmet-mounted [ 130 , 131 ]; ( d ); remote or table [ 132 ]; ( e ) tower-mounted [ 133 , 134 ]. …”

“…Eye tracking systems can be categorised as remote, mobile, or tower-mounted based on how they interface with the user and environment, as presented in Figure 7 [129]. [92]; (c) helmetmounted [130,131]; (d); remote or table [132]; (e) tower-mounted [133,134].…”

How to Handle Health-Related Small Imbalanced Data in Machine Learning?

“…Beside the considerations to design research studies in an interdisciplinary project and the criteria explained before, there are for each domain, data size and task different possibilities to explore the data, e. g., image analysis [56], game measure analysis [34,44], or eye-tracking data [29].…”