Critical thinking is one of the most important skills deemed necessary for college graduates to become effective contributors in the global workforce. The first part of this article provides a comprehensive review of its definitions by major frameworks in higher education and the workforce, existing assessments and their psychometric qualities, and challenges surrounding the design, implementation, and use of critical thinking assessment. In the second part, we offer an operational definition that is aligned with the dimensions of critical thinking identified from the reviewed frameworks and discuss the key assessment considerations when designing a next‐generation critical thinking assessment. This article has important implications for institutions that are currently using, planning to adopt, or designing an assessment of critical thinking.

No abstract

Since its 1947 founding, ETS has conducted and disseminated scientific research to support its products and services, and to advance the measurement and education fields. In keeping with these goals, ETS is committed to making its research freely available to the professional community and to the general public. Published accounts of ETS research, including papers in the ETS Research Report series, undergo a formal peer-review process by ETS staff to ensure that they meet established scientific and professional standards. All such ETS-conducted peer reviews are in addition to any reviews that outside organizations may provide as part of their own publication processes. Peer review notwithstanding, the positions expressed in the ETS Research Report series and other published accounts of ETS research are those of the authors and not necessarily those of the Officers and Trustees of Educational Testing Service.The Daniel Eignor Editorship is named in honor of Dr. Daniel R. Eignor, who from 2001 until 2011 served the Research and Development division as Editor for the ETS Research Report series. The Eignor Editorship has been created to recognize the pivotal leadership role that Dr. Eignor played in the research publication process at ETS. The work described in this report is the first phase of a project to provide easy-to-use tools for authoring and rendering secondary-school algebra-level math expressions in synthesized speech that is useful for students with blindness or low vision. This report describes the initial development, software implementation, and evaluation of the ClearSpeak speech style-implemented for initial testing purposes using prerecorded synthetic speech, and implemented later in the project as a collection of predefined rules and in some cases variations (called preferences in ClearSpeak)-for automatically generated synthetic speech. In addition to wording, speech styles can specify pausing (or other prosodic cues) within the speech. The ClearSpeak style focuses on speech for secondary school algebra. The evaluation compares a prototype of the ClearSpeak style to two pre-existing speech styles: MathSpeak and SimpleSpeak. The primary parameters evaluated are students' success in drawing conclusions about the content and structure of math expressions and their perceptions regarding the familiarity, helpfulness, and understandability of the expressions as spoken. Please see Appendix E for information on obtaining a version of this report that is fully accessible using the tools described. ETS Research Report Series ISSN 2330-8516 R E S E A R C H R E P O R T Development and Initial Evaluation of the ClearSpeak Style for Automated Speaking of AlgebraKeywords math; accessibility; blindness; visual impairment; text-to-speech; MathML; algebra; STEM; ClearSpeak; assistive technology; screen reader doi:10. 1002/ets2.12103 There is a great need to improve mathematics achievement in students with visual impairments (SVIs), for whom there is a large achievement gap compared to students without disabilit...

The work described in this report is the second phase of a project to provide easy‐to‐use tools for authoring and rendering secondary‐school algebra‐level math expressions in synthesized speech that is useful for students with blindness or low vision. This report describes the development and results of the second feedback study performed for our project, Expanding Audio Access to Mathematics Expressions by Students With Visual Impairments via MathML. That study focused on the use of certain prosodic and lexical elements in the ClearSpeak speech style and served as a basis for further refinements in that style's definition and implementation in the MathPlayer software. The primary parameters evaluated are students' success in drawing conclusions about the content and structure of certain math expressions and their perceptions regarding the helpfulness of the pace and wording of different text‐to‐speech renditions of the same or similar mathematical expressions. Please see Appendix A for information on obtaining a version of this report that is fully accessible using the tools described.

Since its 1947 founding, ETS has conducted and disseminated scientific research to support its products and services, and to advance the measurement and education fields. In keeping with these goals, ETS is committed to making its research freely available to the professional community and to the general public. Published accounts of ETS research, including papers in the ETS Research Report series, undergo a formal peer-review process by ETS staff to ensure that they meet established scientific and professional standards. All such ETS-conducted peer reviews are in addition to any reviews that outside organizations may provide as part of their own publication processes. Peer review notwithstanding, the positions expressed in the ETS Research Report series and other published accounts of ETS research are those of the authors and not necessarily those of the Officers and Trustees of Educational Testing Service.The Daniel Eignor Editorship is named in honor of Dr. Daniel R. Eignor, who from 2001 until 2011 served the Research and Development division as Editor for the ETS Research Report series. The Eignor Editorship has been created to recognize the pivotal leadership role that Dr. Eignor played in the research publication process at ETS. This report describes the pilot conducted in the final phase of a project, Expanding Audio Access to Mathematics Expressions by Students With Visual Impairments via MathML, to provide easy-to-use tools for authoring and rendering secondary-school algebra-level math expressions in synthesized speech that is useful for students with blindness or low vision. The pilot evaluated the authoring and speech-rendition tools, including interactive navigation. Teachers participated in the portion of the study that evaluated the authoring tools. Secondary school students with blindness or low vision participated in the portion that evaluated the speech-rendition and navigation tools, comparing those tools to each student's usual method (braille or print) for working with math. The teachers received an interactive authoring tutorial and the students received an interactive navigation tutorial before using the tools studied. Prior to the pilot, feedback studies on authoring and navigation gathered information that was used to fine-tune the tutorials and the functionalities being evaluated. In the pilot we attempted to simulate a likely use-case for each group. In the students' case, the tools for reading and navigating spoken mathematics were compared directly with the methods each student typically used for reading math (braille or print in a size appropriate for the student). Teachers and content providers were instructed to author math expressions that matched those used in the pilot instruments given to the students. The studies showed that the authoring tools were easy for teachers to use as intended and that little observable difference existed between students' success in answering math and math-parsing questions when using the spoken math tools and their success in answering parallel qu...