Aptitude and Trait Predictors of Manned and Unmanned Aircraft Pilot Job Performance

Abstract

Previous research has shown that the same aptitude and trait measures that predict success in US Air Force (USAF) manned aircraft pilot training predict remotely-piloted aircraft (RPA) pilot training outcomes with generally similar levels of validity (Carretta, 2013; Rose, Barron, Carretta, Arnold, & Howse, 2014). However, because USAF RPA pilots initially train in manned aircraft, validation of aptitude and traits predicative of RPA pilot success has thus far been limited to RPA pilot training outcomes that actually require manned flight. Hence, thus far there has been no basis for determining the aptitudes and traits predictive of success in environments in which pilots actually fly RPAs. To address this gap, the present study evaluated pre-accession trait (Big Five personality domains) and aptitude (spatial, quantitative, and aviation knowledge) measures as predictors of manned and unmanned aircraft pilot performance on-the-job, as measured by supervisor and senior rater stratification on three years of Officer Performance Reports (OPRs). Results were generally consistent in showing that the same aptitudes, knowledge, and personality traits that predict successful job performance for manned aircraft pilots also predict successful job performance for RPA pilots. However, results also showed pre-accession aviation knowledge to be a stronger predictor of job performance for RPA pilots than for manned aircraft pilots. These findings and their implications for attracting and selecting RPA pilots are discussed.

Multiple test batteries as predictors for pilot performance: A meta‐analytic investigation

“…Despite the continued revision and improvement of this TB across several forms, studies show generally a small magnitude for the test‐criterion correlations barely exceeding .10 (e.g., Arth, Steuck, Sorrentino, & Burke, ; Carretta, ; Carretta & Ree, , ; Duke & Ree, ). Observed correlations, however, show a substantial increase when they are corrected for attenuations such as measurement error and range restriction (Barron et al, ; Carretta, ; Olea & Ree, ). Nevertheless, for very expensive training programs like flight programs (Carretta et al, ; King et al, ), even a small increase in predictive power of the selection tests is viewed as an important economic factor.…”

“…show a substantial increase when they are corrected for attenuations such as measurement error and range restriction (Barron et al, 2016;Carretta, 2011;Olea & Ree, 1994). Nevertheless, for very expensive training programs like flight programs (Carretta et al, 2014;King et al, 2012), even a small increase in predictive power of the selection tests is viewed as an important economic factor.…”

“…To illustrate the typical mixed structure of composite test scores, we present two examples from military and civilian settings. The Pilot composite of the U.S. Air Force (USAF) Officer Qualification Test (AFOQT; Form S) was constructed using five tests from several ability domains (Barron, Carretta, & Rose, ): quantitative ability (Math Knowledge and Arithmetic Reasoning tests), perceptual speed (Table Reading test), and aircrew aptitude (Instrument Comprehension and Aviation Information tests). Similarly, the selection test battery used by the German Aerospace Center (DLR) yields composite scores for pilot selection that consist of seven cognitive ability tests and four knowledge‐based test scores (Zierke, ).…”

“…To illustrate the typical mixed structure of composite test scores, we present two examples from military and civilian settings. The Pilot composite of the U.S. Air Force (USAF) Officer Qualification Test (AFOQT; Form S) was constructed using five tests from several ability domains (Barron, Carretta, & Rose, 2016) Clearly, it is these composite scores, rather than the individual test scores, that are most important for recruiting centers and that are used for making overall assessment and selection decisions (e.g., Cowan, Barrett, & Wegner, 1990). The TBs' composite scores have more potential for comprehensively representing individuals' latent abilities, and therefore warrant at least as much attention as that given to the individual ability scores.…”

If It Were Only That Easy: The Use of Meta-Analytic Research by Organizational Scholars

“…Researchers sometimes extrapolate findings from an MA to a research context or sample that was not included in the original MA. For example, we found two studies using military samples that state that Barrick and Mount (1991) found a relationship between job performance and conscientiousness and neuroticism in civilian and military samples (i.e., Barron, Carretta, & Rose, 2016; Colodro, Garces-de-los-Fayos, Lopez-Garcia, & Colodro-Conde, 2016). However, military samples were expressly excluded from Barrick and Mount’s MA.…”