Recruiting a Person-Centered Direct Care Workforce Through Situational Judgement Tests: A Pilot Study in the Community Support of Older People in England

Abstract

Background and Objectives Studies have found that older people value care workers’ character traits and interpersonal judgement even more highly than their technical skills. Yet identifying these traits at recruitment is challenging. This study aimed to evaluate the first Situational Judgement Tests (STJs) for direct care workers. Research Design and Methods Online tests were conducted with 251 care workers and members of the public in England. Participants evaluated the appropriateness of 61 potential behavioural responses to 11 ‘critical incidents’, each depicting challenging care work scenarios. Data collection included a measure of personality traits. A subsample of 72 participants completed a second ‘test-retest’ assessment. Results A majority of test-takers (53%) found the test easy/very easy to complete, and most (55%) participants who worked in care reported the scenarios were highly realistic. Psychometric tests were positive. Test scores were unidimensional under a Confirmatory Factor Analysis (RMSEA=0.038), and items broadly fit Rasch assumptions. Test-retest reliability (rho=0.77) was acceptable, and for the general public sample, a modest increase in perceptions of the social standing of care work was observed. Test scores were positively correlated with two personality traits: agreeableness (r=0.250, p<0.01) and openness to experience (r=0.179, p=0.005). Test scores were not related to age, gender, or education level. Discussion and Implications The findings indicate support for the use of SJTs in direct care work. Its psychometric properties appear satisfactory, and collectively give confidence in the use of SJTs for assessing the suitability of candidates during recruitment. Further research should corroborate these findings in a new sample, and examine the relationship between test scores and job performance.