Highlights  The link between computer-based training and high-stakes assessments was investigated.  Training and selection test data of 15,752 pilot trainee applicants was analyzed.  The amount of training predicted test performance in curvilinear fashion as expected.  The ability test scores' structure was invariant across different amounts of training.  Free training was not linked to the psychometric structure of the high-stakes tests. LST ANALYSIS OF COGNITIVE ABILITY ASSESSMENTS 3 Measurement and structural invariance of cognitive ability tests after computer-based training LST ANALYSIS OF COGNITIVE ABILITY ASSESSMENTS 4

No abstract

No abstract

When subjects are repeatedly tested in cognitive assessments, systematic score gains occur. Such retest effects become even greater when test preparation is provided between assessments. In the context of personnel selection, retest gains are often increased by commercial test training, which threatens the fairness of psychological testing because not all candidates can afford such offers. In the present study, computer-based training was freely offered to all candidates as part of the personnel selection procedure. We examined the relationship between repeated cognitive ability measurements in high-stakes settings and the amount of computer-based training before each measurement. Analyses of 212 candidates showed that cognitive ability scores and the amount of prior training were only related on the first assessment but not on the second. There were still retest effects, but the magnitude of score gains was negatively correlated with the amount of initial training and was unrelated to training between assessments.Only the change in training amount was positively correlated with retest effects.We conclude that providing all candidates with preparatory training already before the first assessment substantially increases assessment fairness in the personnel selection process.

No abstract