Differential validity and differential prediction analyses have come to conflicting conclusions regarding whether the relationship between cognitive ability tests and performance is the same across racial/ethnic subgroups. A prominent criticism of differential validity analyses is that they are confounded by subgroup differences in the ratio of criterion-to-test standard deviations (SDs). We investigated whether subgroup differences in these ratios can account for this conflicting evidence. Drawing on data from over 1 million participants, we find that subgroup differences in criterion-to-test SD ratios in general only account for a relatively small portion of subgroup differences in test-criterion correlations.
Practitioner pointsCognitive ability tests exhibit differential validity for Asian, Black, Hispanic, and White subgroups. In most domains, subgroup differences in criterion-to-test SD ratios only account for a relatively small portion of these validity differences and thus do not explain why validities differ across subgroups.Still, because a portion of the already-small validity differences are accounted for by SD ratios, the magnitude of any subgroup regression slope differences is small and is unlikely to result in underprediction of criterion performance for Asian, Black, and Hispanic subgroups.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.