Large-Scale Assessments of Adult Literacy

Abstract

Educational Testing Service's (ETS's) work in large-scale adult literacy assessments has been an ongoing and evolving effort, beginning in 1984 with the Young Adult Literacy Survey in the United States. This work has been designed to meet policy needs, both in the United States and internationally, based on the growing awareness of literacy as human capital. The impact of these assessments has grown as policy makers and other stakeholders have increasingly come to understand the critical role that foundational skills play in allowing individuals to maintain and enhance their ability to meet changing work conditions and societal demands. For example, findings from these surveys have provided a wealth of information about how the distribution of skills is related to social and economic outcomes. Of equal importance, the surveys and associated research activities have contributed to large-scale assessment methodology, the development of innovative item types and delivery systems, and methods for reporting survey data in ways that ensure its utility to a range of stakeholders and audiences.The chronology of ETS's large-scale literacy assessments, as shown in Fig. 9.1, spans more than 30 years. ETS served as the lead contractor in the development of these innovative assessments, while the prime clients and users of the assessment outcomes were representatives of either governmental organizations such as the National Center for Education Statistics (NCES) and Statistics Canada, or transgovernmental entities such as the Organisation for Economic Co-operation and Development (OECD). These instruments have evolved from a single-language, paper-based assessment focusing on a U.S. population of 16-to 25-year-olds to an adaptive, computer-based assessment administered in almost 40 countries and close to 50 languages to adults through the age of 65. By design, the assessments have been linked at the item level, with sets of questions from previous assessments

Effects of Desk Pedaling Work Rate on Concurrent Work Performance among Physically Inactive Adults: A Randomized Experiment

“… a By design, the sample was half younger (20–44) vs older (45–65), half male vs female, and half normal weight (18.5–24.9) vs overweight/obese (25.0–35.0).…”

“… a By design, the sample was half younger (20–44) vs older (45–65), half male vs female, and half normal weight (18.5–24.9) vs overweight/obese (25.0–35.0). b Objectively measured BMI. c Based on International Standard Classification of Occupations (42). d Based on International Physical Activity Questionnaire, Short Form (22).…”

“…Participants were given up to 5 min to read an approximately 290-word passage and answer five multiple-choice reading comprehension questions by computer. Three equivalent-form reading passages, each written at the average U.S. eighth grade reading level (30), were selected from Reading for Comprehension Level H (Continental Press Inc.; approved by New York State Textbook Law) and were randomized across the pedaling and nonpedaling conditions. Scoring was based on the number of seconds to read the passage and answer the questions (speed) and the percentage of questions answered correctly (accuracy/comprehension).…”

PIAAC: a new design for a new era

“…In both the workplace and everyday life, it has become increasingly important that adults are able to navigate, critically analyze, and problem solve in data-intensive, complex digital environments-and PIAAC has made it possible to measure such skills. In addition, PIAAC has introduced methodological innovations such as multistage adaptive testing and flexible routing for the background questionnaire that have improved the design and delivery of the survey and laid the foundation for future assessments (Kirsch et al 2017). …”

Navigating Food and Drug Administration Mandated Breast Implant Patient Literature

“…In the modern, and increasingly digital era of healthcare, text readability plays a significant role in dictating the extent of a patient's participation within their own care. As the average American adult reads at an eighth-grade level, 3 the National Institutes of Health (NIH) and American Medical Association (AMA) have recommended that all patient education materials be written at or below a sixth-grade reading level to increase both health literacy and health access for the average patient 4 . A plethora of research has shown that providers significantly overestimate the level of patient understanding during the informed consent process 5–7 and a wide array of patient reading materials across all sectors of medicine have been demonstrated to be far too complex for most patients to understand 8–15 .…”