Webcam-based eye tracking to detect mind wandering and comprehension errors

Hutt, Stephen; Wong, Aaron Y.; Papoutsaki, Alexandra; Baker, Ryan S.; Gold, Joshua I.; Mills, Caitlin

doi:10.3758/s13428-022-02040-x

Cited by 20 publications

(7 citation statements)

References 55 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These authors already used a broader set of eye tracking features for the subsequent analyses. For example, Hutt et al (2022) used Webgazer.js and converted the total gaze raw data into global gaze features (general eye movement data independent of the presented stimuli, e.g., number of gaze samples, number of unique gaze samples, and variance of gaze points), and local gaze features (dependent on predefined AOIs). The AOIs approach was also chosen by Wong et al (2023) to examine the validity and usability of webcam eye tracking as an aid tool for neurodivergent learners.…”

Section: Unraveling the Gaze: Essential Eye Tracking Aspects And Methodsmentioning

confidence: 99%

“…Reading is a complex cognitive ability, and the reading tasks were also applied by Guan et al (2022) pointing out the importance of low-cost eye tracking data gathering in natural conditions, especially in the era of digital and online learning, using webcam eye tracking to explore the relationship between reading behavior and reading performance. Cognitive processes related to reading comprehension and mind wandering during an online reading comprehension task are also discussed by Hutt et al (2022). In the case of a specific reading disorder, learning how to read and the reading itself can be a very challenging task.…”

Section: Exploring Educational Horizons: Webcam Eye Trackers and Lear...mentioning

confidence: 99%

See 1 more Smart Citation

A Scoping Review of Webcam Eye Tracking in Learning and Education

Dostálová,

Plch

2024

Studia paedagogica

View full text Add to dashboard Cite

The use of eye tracking in educational research has shown great potential in recent decades. There are various approaches to the usage of eye tracking technology in this area, including investigation of self-regulated learning from different types of learning environments. Nonetheless, the majority of published research studies have one tremendous limitation: using expensive remote or tower-based eye trackers to provide high-quality data in laboratory conditions. Now, new webcam eye trackers may offer an easily affordable approach allowing eye tracking measurements in the real environment, such as the investigation of learning behavior in online learning environments. The main aim of this scoping review is to explore the use of webcam eye tracking technology in the field of learning and education. We established three specific purposes: 1) to introduce educational topics being explored using webcam eye tracking, 2) to discuss the methodological aspects when exploring educational topics with webcam eye tracking, and 3) to investigate the eye tracking aspects used for the analysis. To do this, we analyzed 16 studies that used webcam eye tracking. The results of the scoping review show that 1) selected studies focus mainly on students’ behavior in online learning environments, such as engagement, lack of attention, cheating and others; 2) a wide range of studies aimed at the development of automatized detection tools; and 3) studies are mainly focused on extracting raw and event data features using them mostly for automatized detection purposes.

show abstract

Section: Unraveling the Gaze: Essential Eye Tracking Aspects And Methodsmentioning

confidence: 99%

Section: Exploring Educational Horizons: Webcam Eye Trackers and Lear...mentioning

confidence: 99%

A Scoping Review of Webcam Eye Tracking in Learning and Education

Dostálová,

Plch

2024

Studia paedagogica

View full text Add to dashboard Cite

show abstract

“…This also explains the dwell of the field to concentrate on log data, such as time-based measures and action sequences based on test-taker input through common devices (e.g., keyboard, mouse, stylus, touchscreen), which are readily available in computer-based assessments and do not require specific equipment. However, current advancements in the field make it plausible that especially in the case of eye tracking, there will be more scalable solutions in the near future (see, e.g., Hutt et al, 2023).…”

Section: Process Data In Assessments: Potential and Challengesmentioning

confidence: 99%

Process Data in Computer-Based Assessment

Lindner

Greiff

2023

European Journal of Psychological Assessment

View full text Add to dashboard Cite

This editorial provides a comprehensive framework and overview of potential uses and next steps in research on process data in computer-based assessments, expanding toward broad perspectives on the field and an exploration of future directions and emerging trends. After briefly reflecting on the evolution of process data use in research and assessment practice, we discuss three key challenges, namely (1) the theoretical grounding and validation of process data indicators, (2) assessment design for process data, and (3) ethical standards. By considering best practice approaches in all three areas and current discussions in the literature, we conclude that a focus is needed on the following three areas: (1) strong, holistic theoretical frameworks for validating process data, (2) reliable, standardized data collections, preferably with a top-down approach to developing test items and preregistered hypotheses, and (3) ethical norms for data collection, data use, and guidelines for responsible inference, including restraints in decisions based on process data.

show abstract

“…Mind wandering is closely connected to learning, and many research studies have investigated its impact during lectures. [1,2] The two most widely recognized techniques for gathering data on mind wandering in the literature are the "self-report" and "probe-caught" methods. [3,4] The "probe-caught" approach involves interrupting participants and inquiring about their mental state at that moment, while the "self-report" technique requires participants to self-report their mind-wandering experiences.…”

Section: Introductionmentioning

confidence: 99%

Exploring the Elusive Mind: A Multimodal Wearable Sensor Solution for Measuring Mind Wandering in University Students

Khosravi,

Li,

Khan

et al. 2023

Advanced Sensor Research

View full text Add to dashboard Cite

Mind‐wandering is a typical daily phenomenon during which attention shifts from external stimuli to internal trains of thought. It affect students' learning by impairing comprehension, diminishing academic achievement, impeding critical thinking, and encouraging a lack of attention and engagement in classroom activities. This study aims to introduce a new method of detecting and tracking mind wandering in university students. This approach involves using wearable sensors, including galvanic skin response (GSR), photoplethysmography (PPG), and eye‐trackers, along with machine learning techniques. The study provides a proof of concept for this multisensory approach. The association between longer fixation duration and mind wandering, and the influence of an instructor's presence on fixation allocation, and, consequently, the frequency and occurrence of mind wandering is investigated. Furthermore, the feasibility of using eye‐trackers in conjunction with GSR and PPG sensors for detecting mind wandering through a wearable multisensory data collection system is assessed. The wearable multisensory device is evaluated by ten participants (university students, males/females aged between 21‐30). Two distinct machine learning methods, support vector machine (SVM) and gated recurrent unit (GRU), are used as classification models. With sensor fusion, the SVM and GRU models yielded maximum accuracies of 86.53% and 89.86%, respectively. Moreover, participants are observed to fixate on instructors more often, just before instances of mind wandering.

show abstract

Webcam-based eye tracking to detect mind wandering and comprehension errors

Cited by 20 publications

References 55 publications

A Scoping Review of Webcam Eye Tracking in Learning and Education

A Scoping Review of Webcam Eye Tracking in Learning and Education

Process Data in Computer-Based Assessment

Exploring the Elusive Mind: A Multimodal Wearable Sensor Solution for Measuring Mind Wandering in University Students

Contact Info

Product

Resources

About