The Incremental Validity of Psychological Testing and Assessment: Conceptual, Methodological, and Statistical Issues.

Abstract

There has been insufficient effort in most areas of applied psychology to evaluate incremental validity. To further this kind of validity research, the authors examined applicable research designs, including those to assess the incremental validity of test instruments, of test-informed clinical inferences, and of newly developed measures. The authors also considered key statistical and measurement issues that can influence incremental validity findings, including the entry order of predictor variables, how to interpret the size of a validity increment, and possible artifactual effects in the criteria selected for incremental validity research. The authors concluded by suggesting steps for building a cumulative research base concerning incremental validity and by describing challenges associated with applying nomothetic research findings to individual clinical cases.

Postmission Altruistic Identity Disruption Questionnaire (PostAID/Q): Identifying humanitarian-related distress during the reintegration period following international humanitarian aid work.

“…Future research should compare different samples in accordance with existing methods of establishing reliability (Conybeare, Behar, Solomon, Newman et al, 2012;Hunsley & Meyer, 2003;Joseph, Maltby, Wood et al;. Similarly, for clinical relevance,…”

“…An important component of incremental validity is cost and time considerations (Hunsley & Meyer, 2003).…”

The factor structure and psychometric properties of the Spanish version of the Mayer-Salovey-Caruso Emotional Intelligence Test.

“…According to Cohen (1988), in the social and behavioral sciences, a large effect explains 25% of the variance, a medium effect is approximately 9%, and a small effect is approximately 1%. To correctly interpret the semipartial correlations, we followed the recommendation of Hunsley and Meyer (2003). According to these authors, semipartial correlations are a very suitable measure of a variable's contribution to criterion prediction.…”

Gratitude uniquely predicts lower depression in chronic illness populations: A longitudinal study of inflammatory bowel disease and arthritis.

“…From the perspective of incremental validity, these effects can be considered somewhat consequential, as an effect size (R) of .15 is suggested to make "a reasonable contribution" (p. 451; Hunsley & Meyer, 2003) to explaining the variance when other closely related variables are controlled as they were in the current analyses. In the IBD sample, psychological thriving remained a significant covariate once gratitude was entered into the model.…”