A user-friendly system that yields operational benefit results from data-driven prototype evaluations and benefits analyses that iteratively feed back into the prototype design and development. In this study, initial requirements development and field evaluations were conducted using a shadow operations technique at the center tower backup Dallas-Fort Worth International Airport air traffic control tower (ATCT). Results are discussed in reference to the design process of the Tower Flight Data Manager (TFDM) prototype. Nonintrusive measures for quantitatively validating human-systems design issues were identified for this study, including visual gaze analysis and verbal command sequence analysis. Behavioral validation of design issues simplifies the process to prioritize beneficial design changes. The iterative process used resulted in an interim TFDM prototype that was rated by active air traffic controllers as both beneficial and usable in an operational ATCT environment.

This paper presents two methods of analyzing air traffic controller activity: cognitive workload measurement through the novel comparison of controller-pilot verbal communications, and visual attention quantification through manual eye gaze analysis. These analyses were performed as part of an evaluation of the Tower Flight Data Manager (TFDM) prototype system. Cognitive workload analyses revealed that, when comparing participant controllers utilizing TFDM to a control group utilizing existing air traffic control (ATC) equipment, participants issued commands sooner than the control, and thus were perceived to have a lower workload. While visual attention data were not available for the control group, analyses of participant gaze data revealed 81.9% of time was spent in a head-down position, and 17.2% of time was spent head-up. Results are related back to system inefficiencies to find potential areas of improvement in design.