Evaluation of the Total Eyes-off-Road Time Glance Criterion in the NHTSA Visual-Manual Guidelines

Abstract

NHTSA issued a 12-s total eyes-off-road time (TEORT) glance criterion for its visual-manual guidelines simulator test. This criterion relied on NHTSA’s analysis of manual radio-tuning data from its simulator study using a 2010 Toyota Prius premium radio and its test-track study of five 2005 to 2010 vehicles using various radio-tuning control types. However, this 12-s criterion was biased falsely downward. First, NHTSA oversampled the youngest participants (with the shortest TEORT scores) in the simulator study and oversampled the newest radios (with the shortest TEORT scores) in the test track study. Second, NHTSA incorrectly assumed that track and simulator metrics had a one-to-one correspondence, but the track TEORT was substantially shorter than the simulator TEORT for a matched Prius task with matched older participant ages. Third, NHTSA set its criterion at exactly the 85th percentile of the TEORT data rather than its upper confidence limit; hence, traditional radio-tuning tasks would fail repeated tests simply because of random test-to-test variation. The current study, after adjusting for these and other biases, estimated a criterion of 21.4 s from the identical NHTSA data sets. Emerging knowledge that relies on naturalistic driving studies suggests that cumulative glance metrics such as TEORT have low predictive validity for crashes compared with other metrics. A new test should be developed with metrics of higher predictive validity for relative crash risk on the basis of a growing scientific consensus about the relationship—both positive and negative—between eye glances, relative crash risk, and secondary task performance while driving.

Using Glance Behaviour to Inform the Design of Adaptive HMI for Partially Automated Vehicles

“…In recent times, eye tracking has become more frequently used and consequently there has been a focus on how more readily available technology can be used to facilitate eye-tracking, such as webcams [34] and mobile apps [35]. In the automotive context, eye tracking has been used to assess HMI against measures such as Total Eyes Off-Road Time (TEORT), Long Glance Proportion (LGP) and Mean Single Glance Duration (MSGD) [36]- [39]. Another common metric is the assessment of glance behaviour to the roadway [40], [41].…”

Comparative Evaluation of Twelve Automotive CMS Display Layout Designs in Two Lane Change Task Scenarios

“…Since eye glance behavior has been used to evaluate driver distraction while driving, this study recorded the participants' eye movement during the experiment (Dingus et al, 1989). In particular, the Total Eyes-Off-Road Time (TEORT) for each of the four repetitive task trials was analyzed in this study since it was highly associated with a crash and near-crash in driving (Young, 2016). The percentage of TEORT (hereafter, TEORT (%)) is calculated as the number of samples (time frames) where the driver's eye gaze was off the forward roadway divided by the total number of samples.…”