Eye Got It: A System for Automatic Calculation of the Eye-Voice Span

Abstract

Over the past decade, eye movement has been widely looked into for describing and analyzing several cognitive processes and especially for human-document interaction, such as estimating reading ability and document understanding. Most of the existing applications have been done for silent reading but we propose to explore reading aloud interaction through a powerful measurement named the "eye-voice span" which measures the distance between the eyes and the voice. In this paper we present an open-source platform named "Eye got it" and the underlying algorithms that can be used for processing eye-tracking and voice data in order to compute automatically the eye-voice span.

Speech and Eye Tracking Features for L2 Acquisition: A Multimodal Experiment

“…We collected speech and eye-tracking data from 40 French native speakers. We used "Eye Got it" [7], a platform developed for the project that permits to record both eye-tracking and audio, while associating a forced aligner for speech. Data was recorded in natural indoor conditions in a silent room.…”