This paper takes an exploratory approach to analyze reactions to game-based assessments (GBAs) by examining users' reviews of GBA mobile applications. In this study, we explore 3146 user reviews and 1253 comments from 10 GBA applications found on the two most popular mobile application distribution platforms using a natural language processing tool. Findings suggest that candidates generally perceive GBAs as novel and have varying reactions to specific game, assessment, and application elements. As this study contributes to the limited body of research available on candidates' reactions to GBA mobile applications, findings and research directions are discussed to expand our understanding of this growing area of assessment.game-based assessment, mobile applications, natural language processing, reactions
Practitioner points• Game-based assessment (GBA) mobile applications are generally viewed by applicants as novel and interesting, and as a favorable method of assessment.• However, some users are hesitant to place full trust in GBA mobile applications, perceiving them as less face-valid than traditional assessment methods.• Users also react negatively to technical issues such as mobile application glitches or crashes.• Organizations seeking to use GBA mobile applications in their employee selection system should carefully design the assessment by selecting psychometrically valid and useful game elements, and should also incorporate user-tested feedback.
| INTRODUCTIONEmployee selection has experienced several changes over its more than 100-year history (Ryan & Ployhart, 2014). Technology has driven this evolution in many ways and is often considered one of the biggest influences on how we recruit, select, train, and evaluate employees (Tippins, 2015). While validating and assessing employee selection systems is critical, many organizations have been increasingly concerned with the usability of employee selection procedures and applicants' engagement with the process. Applicant reactions are important to employers because of influences on the applicants' perceptions of the organization, validity, and utility of the procedures, influences on the employee selection process, and potential ethical and legal issues (Smither et al., 1993).Recently, game-based assessments (GBAs) have been promoted for use in employee selection as a potential method to improve the user experience (Chamorro-Premuzic et al., 2017). A scan of the literature reveals that research on applicant reactions to GBAs is