Insights Into Using TOEIC^® Test Scores to Inform Human Resource Management Decisions

Abstract

This report explores the ways in which human resource (HR) managers use TOEIC® scores to inform hiring, promotion, and training decisions in an international workplace. Two data sources were used (a) previously collected test users' testimonials that described managers' use of TOEIC scores to inform HR decisions and (b) test‐use examples collected from HR managers and TOEIC representatives specifically for this project. Our analysis of test‐use examples provided insight into how companies use TOEIC scores to inform HR decisions related to hiring, promotion, and training of employees in international businesses. To conclude, we provide suggestions for future research such as providing services to test users (e.g., assessment literacy, the development of assessments measuring additional components of workplace English, or algorithms to help analyze the various variables relevant to informing HR decisions) to continue to support meaningful and relevant score‐based HR decisions and score interpretations.

The role of informal digital learning of English and a high-stakes English test on perceptions of English as an international language

“…To date, however, there is no empirical research that investigates altogether the relationship among IDLE practice, high-stakes international English test (TOEIC scores), English productive levels (English speaking and productive vocabulary levels), and EIL perceptions among contemporary EFL learners. In addition, while prior research has reported a link between TOEIC score and IDLE practice (Lee, 2019;Tagashira et al, 2010), IDLE practice and EIL perception (Lee & Lee, 2019a, 2019b, and TOEIC score and EIL perception (Oliveri & Tannenbaum, 2017), it remains to be seen whether IDLE practice plays a mediating role in the relationship between TOEIC scores and perceptions of EIL. The current study aimed to address these research gaps in the literature.…”

“…The current ETS official home page also asserts that people who take TOEIC tests can demonstrate "[their] English communication skills needed in today's global workplace ... organizations can be confident they are using a test that measures a range of skills relevant and necessary for success in global workplace communications" (ETS, 2018c). Employers in multinational businesses, such as Shanghai Expo in mainland China (Oliveri & Tannenbaum, 2017) and multinational military units, such as the Joint Security Area between North and South Korea (International Communication Foundation, 2005) have adopted TOEIC tests to select potential professionals who have global mindsets and who seek to improve their cross-cultural communication skills.…”

“…In this model, TOEIC ( = .33, p < .05) and IDLE ( = .24, p < .05) contributed significantly as predictor variables, while a student's particular major was no longer a significant predictor of EIL perceptions. To answer the second research question, based on previous studies that have reported a link between TOEIC score and IDLE practice (Lee, 2019;Tagashira et al, 2010), IDLE practice and EIL perception (Lee & Lee, 2019a, 2019b, and TOEIC score and EIL perception (Oliveri & Tannenbaum, 2017), the model-IDLE practice mediates the relationship between TOEIC scores and perceptions of EIL-was constructed and tested using structural equation modelling. Expressed differently, it was hypothesised that students with higher TOEIC scores may engage more in IDLE activities, and that, in turn, increased engagement in IDLE activities may help students have more positive attitudes about EIL.…”

“…Additionally, major test developers, such as ETS, have recently integrated EIL perspectives into high-stakes international English tests (e.g., TOEIC) by including Australian and British accents to the listening tests (Kang et al, 2019;Ke, 2019). Furthermore, in several EFL countries TOEIC scores, along with English productive skills, are generally indicative of one's global mindset as well as skillful use of cross-cultural communication strategies (Oliveri & Tannenbaum, 2017). To date, however, there is no empirical research that investigates altogether the relationship among IDLE practice, high-stakes international English test (TOEIC scores), English productive levels (English speaking and productive vocabulary levels), and EIL perceptions among contemporary EFL learners.…”

Articulating and Evaluating Validity Arguments for the TOEIC® Tests

“…Research is critical for supporting claims about the measurement quality and intended use of tests, but all test developers have limited resources. Based on critical evaluations of fully specified TOEIC AUAs, one area of research that the TOEIC program has pursued over the last several years has been focused on the uses of TOEIC tests and their potential impact on various stakeholder groups; several chapters in the third edition of the TOEIC Compendium address these focal issues (e.g., Hsieh, ; Oliveri & Tannenbaum, ).…”