The Incomplete Tyranny of Dynamic Stimuli: Gaze Similarity Predicts Response Similarity in Screen‐Captured Instructional Videos

Abstract

Although eye tracking has been used extensively to assess cognitions for static stimuli, recent research suggests that the link between gaze and cognition may be more tenuous for dynamic stimuli such as videos. Part of the difficulty in convincingly linking gaze with cognition is that in dynamic stimuli, gaze position is strongly influenced by exogenous cues such as object motion. However, tests of the gaze‐cognition link in dynamic stimuli have been done on only a limited range of stimuli often characterized by highly organized motion. Also, analyses of cognitive contrasts between participants have been mostly been limited to categorical contrasts among small numbers of participants that may have limited the power to observe more subtle influences. We, therefore, tested for cognitive influences on gaze for screen‐captured instructional videos, the contents of which participants were tested on. Between‐participant scanpath similarity predicted between‐participant similarity in responses on test questions, but with imperfect consistency across videos. We also observed that basic gaze parameters and measures of attention to centers of interest only inconsistently predicted learning, and that correlations between gaze and centers of interest defined by other‐participant gaze and cursor movement did not predict learning. It, therefore, appears that the search for eye movement indices of cognition during dynamic naturalistic stimuli may be fruitful, but we also agree that the tyranny of dynamic stimuli is real, and that links between eye movements and cognition are highly dependent on task and stimulus properties.

Toward fine‐grained access control and privacy protection for video sharing in media convergence environment

“…For blockchain token transactions, these are also defined for resources such as functions and data of other media items. [31][32][33] Levin et al 34 introduced a technique to classify a video as regular or screencaptured, which video sharing websites can use to prevent the illegal distribution of screen-captured videos. That studies have analyzed the characteristics of blockchain-based online media platforms, but research has not addressed user authentication and access control mechanisms using blockchain technology nor access policies.…”

How to train students to engage in text‐picture integration for multimedia lessons

“…Eye movements reflect one's strategy for cognitive processing (eg, Jarodzka, 2022; Levin et al., 2021; Scholz et al., 2015). Watching others' eye gaze such as in EMMEs helped regulate learners' processing behaviour and thereby helped them to acquire new processing strategies (Brennan et al., 2008; Litchfield et al., 2010).…”

Narrative Comprehension Guides Eye Movements in the Absence of Motion

“…A common assumption in visual cognition is that top‐down processes (e.g., tasks, scene semantics, and comprehension) override bottom‐up image salience to guide attentional selection during a variety of active vision tasks including reading (for review Rayner, 1998), static scene viewing (for review Henderson, 2017; Tatler, Hayhoe, Land, & Ballard, 2011; Williams & Castelhano, 2019), instructional videos (Levin et al., 2021), and even real‐world activities (e.g., making a cup of tea; see Tatler et al., 2011). Consistent with this assumption, theories of text comprehension assume that top‐down effects of the mental model can have strong effects on processing (e.g., Kintsch, 1998) and guide attention during reading (Radvansky & Zacks, 2014).…”