To explore the relationship between theory and practice in evaluation, we focus on the perspectives and experiences of student evaluators, as they move from the classroom to an engagement with the social, political, and cultural dynamics of evaluation in the field. Through reflective journals, postcourse interviews, and facilitated group discussions, we involve students in critical thinking around the relationship between evaluation theory and practice, which for many was unexpectedly tumultuous and contextually dynamic and complex. In our exploration, we are guided by the following questions: How do novice practitioners navigate between the world of the classroom and the world of practice? What informs their evaluation practice? More specifically, how can we understand the relationship between theory and practice in evaluation? A thematic analysis leads to three interconnected themes. We conclude with implications for thinking about the relationship between theory and practice in evaluation.
This mini review summarizes the current state of knowledge about automatic item generation in the context of educational assessment and discusses key points in the item generation pipeline. Assessment is critical in all learning systems and digitalized assessments have shown significant growth over the last decade. This leads to an urgent need to generate more items in a fast and efficient manner. Continuous improvements in computational power and advancements in methodological approaches, specifically in the field of natural language processing, provide new opportunities as well as new challenges in automatic generation of items for educational assessment. This mini review asserts the need for more work across a wide variety of areas for the scaled implementation of AIG.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.