Objective
Tobii eye tracking was compared to webcam-based observer scoring on an animation viewing measure of attention (ECVT) to evaluate the feasibility of automating measurement and scoring. Outcomes from both scoring approaches were compared to the Mullen Scales of Early Learning (MSEL), Color-Object Association Test (COAT), and Behavior Rating Inventory of Executive Function for preschool children (BRIEF-P).
Method
44 children 44 to 65 months of age were evaluated with the ECVT, COAT, MSEL, and BRIEF-P. Tobii X2-30 portable infrared cameras were programmed to monitor pupil direction during the ECVT 6-minute animation, and compared to observer-based PROCODER webcam scoring.
Results
Children watched 78% of the cartoon (Tobii) compared to 67% (webcam scoring), although the two measures were highly correlated (r=0.90,P=0.001). It is possible for two such measures to be highly correlated even if one is consistently higher than the other (Bergemann et al., 2012). Both ECVT Tobii and webcam ECVT measures significantly correlated with COAT immediate recall (r=0.37,P=0.02 versus r=0.38,P=0.01 respectively) and total recall (r=0.33,P=0.06 versus r=0.42,P=0.005) measures. However, neither the Tobii eye tracking nor PROCODER webcam ECVT measures of attention correlated with MSEL composite cognitive performance or BRIEF-P global executive composite.
Conclusion
ECVT scoring using Tobii eye tracking is feasible with at-risk very young African children and consistent with webcam-based scoring approaches in their correspondence to one another and other neurocognitive performance-based measures. By automating measurement and scoring, eye tracking technologies can improve the efficiency and help better standardize ECVT testing of attention in younger children. This holds promise for other neurodevelopmental tests where eye movements, tracking, and gaze length can provide important behavioral markers of neuropsychological and neurodevelopmental processes associated with such tests.