We used hierarchical confirmatory factor analysis to test alternative latent structures underlying performance in multiple dimensions as measured by work samples and three rating sources. The model receiving strongest support was one that specified multidimensional trait (performance dimension) and measurement method second-order factors (SOFs). This model exhibited significant convergent and discriminant validity, showed significant measurement method effects, and indicated that different measurement methods assess somewhat different aspects of the total criterion construct space. Significant correlations between measurement method SOFs and performance predictors suggest the need to reconsider the interpretation of method factors, not as bias, but as possibly representing different overall perspectives on performance.

No abstract