In this study, 249 users of the TOEFL ITP® assessment series (e.g., admissions officers, English‐language teachers, academic staff) in Japan, Mexico, and Indonesia were surveyed about their uses and opinions of TOEFL ITP scores, followed by in‐depth interviews with 21 of these users. Overall, the most common use of the test was as an exit requirement from English‐language programs to demonstrate proficiency in English listening and reading. The majority of participants saw TOEFL ITP scores as very useful indicators of students' English‐language proficiency. Interviews helped clarify the user needs met by this assessment and how test scores were actually applied. Study participants indicated that they need a relatively inexpensive and practical English‐language assessment that also provides them with enough information to make decisions about test takers' proficiency in all relevant skill areas. Some of the ways interviewees talked about using TOEFL ITP scores were consistent with the recommendations of Educational Testing Service (ETS), while other uses (e.g., for workplace applications) were more questionable, as they might imply potentially higher stakes than were intended for this test. The results of the study highlight areas where TOEFL ITP users might need additional informational support with regard to score interpretation and use.
Since its 1947 founding, ETS has conducted and disseminated scientific research to support its products and services, and to advance the measurement and education fields. In keeping with these goals, ETS is committed to making its research freely available to the professional community and to the general public. Published accounts of ETS research, including papers in the ETS Research Report series, undergo a formal peer-review process by ETS staff to ensure that they meet established scientific and professional standards. All such ETS-conducted peer reviews are in addition to any reviews that outside organizations may provide as part of their own publication processes. Peer review notwithstanding, the positions expressed in the ETS Research Report series and other published accounts of ETS research are those of the authors and not necessarily those of the Officers and Trustees of Educational Testing Service.The Daniel Eignor Editorship is named in honor of Dr. Daniel R. Eignor, who from 2001 until 2011 served the Research and Development division as Editor for the ETS Research Report series. The Eignor Editorship has been created to recognize the pivotal leadership role that Dr. Eignor played in the research publication process at ETS.
ETS Research Report Series ISSN 2330-8516 R E S E A R C H R E P O R T
A Framework for the Dual Language Assessment of Young Dual Language Learners in the United StatesDanielle Guzman-Orth, Alexis A. Lopez, & Florencia TolentinoEducational Testing Service, Princeton, NJ Dual language learners (DLLs) and the various educational programs that serve them are increasing in number across the country. This framework lays out a conceptual approach for dual language assessment tasks designed to measure the language and literacy skills of young DLLs entering kindergarten in the United States. Although our examples focus on Spanish-English DLLs, we anticipate that our recommendations could be broadly applied to other language combinations with appropriate adaptations for each language.
We present a tool that provides automated feedback to students studying Spanish writing. The feedback is given for four categories: topic development, coherence, writing conventions, and essay organization. The tool is made freely available via a Google Docs add-on. A small user study with post-secondary level students in Mexico shows that students found the tool generally helpful and that most of them plan to continue using it as they work to improve their writing skills. In an analysis of 6 months of user data, we see that a small number of users continue to engage with the app, even outside of planned user studies.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.