Validation of Measures Designed to Maximize 21st-Century Army NCO Performance

Development of Experimental Army Enlisted Personnel Selection and Classification Tests and Job Performance Criteria

“…As shown, inter-rater reliability estimates for the ratings including the mail-back data are comparable to those calculated using only on-site ratings. This result is similar to earlier findings in the NCO21 project (Knapp, McCloy, & Heffner, 2004) and confirmed the appropriateness of combining the on-site and mail-back ratings in subsequent analyses. Tables 3.5 and 3.6 show estimated reliabilities for different numbers of supervisor and peer raters, respectively.…”

“…These models were tested against the one-factor model that specifies only one general factor underlying all the performance dimensions. Though this one-factor model has often been found to be underlying rating data in past research (e.g., Knapp et al, 2004), it is likely that the halo effect inherent in the ratings made it impossible to discover the "true" factor structure of performance ratings. In Select2l, we attempted to control for halo effect by specifying two rater effects for all the models.…”

Future Soldiers: Analysis of Entry-Level Performance Requirements and Their Predictors

“…Here, NCO21 performance requirements served as a useful starting point. However, in the NCO21 project the correlation between scores on the current performance rating scales and future performance rating scales were very high (Knapp, McCloy, & Heffner, 2004). This result is consistent with the theory that individuals tend to behave consistently over time.…”

Remote Excavation of Heavily Contaminated UXO Sites. The Range Master

“…Findings in Project A (J.P. Campbell & Knapp, 2001), NCO21 (Knapp, McCloy, & Heffner, 2004), and Select2l (Knapp & Tremble, 2006) all confirm that criteria matter and that validation results differ substantially by the criteria of choice. Recent research, supporting policy decisions, has sought to go beyond indices of training success by using SQT scores-to validate ASVAB classification composites.…”