Barriers to collecting student participation and completion data for a national STEM education grant program in the United States: a multiple case study

Abstract

Background Billions of dollars are spent annually on grant-funded STEM (science, technology, engineering, and mathematics) education programs. These programs help students stay on track toward STEM careers when standard educational practices do not adequately prepare them for these careers. It is important to know that reliable and accurate student participation and completion data are being collected about these programs. This multiple case study investigates how student data are collected and reported for a national STEM education program in the United States, the National Science Foundation (NSF) Advanced Technological Education (ATE) program. Our overall aim is to provide insights to funding agencies, STEM education faculty, and others who are interested in addressing issues related to the collection and reporting of student participation and completion data within their own contexts. Emphasis is placed on the barriers encountered in collecting participation and completion data, particularly with regard to unduplicated participation counts and marketable credential data. The ATE program was selected for this study because there is already a mechanism (known as the ATE Survey) in place for annually collecting systematic data across all projects within the program. Results A multiple case study, including interviews of primary investigators, allowed for in-depth analysis of the ATE Survey’s point-in-time data on project-level participation in various activities, and for identification of the following barriers to tracking student-level data: lack of time and help to gather these data, lack of a consistent system for tracking students across different institutions, and a perceived lack of guidance from the funding agency about what data to track. We also saw that different data are needed from different projects to determine a project’s true impact. Defining “success” the same way across all projects is inadequate. Conclusions Although, due to the limited sample size, these findings cannot be generalized to the larger ATE population, they provide specific insights into the various barriers that projects encounter in collecting participation and completion data.

Application of Artificial Intelligence in Online Education: Influence of Student Participation on Academic Retention in Virtual Courses

“…This approach is justified based on the need to capture the dynamics of student participation in online environments without interfering with their normal learning activities. Additionally, an automated tracking system allows data to be collected from multiple cohorts of students over various semesters, providing us with a representative sample and longitudinal data for trend analysis [26], [27].…”

Educación STEM en la infancia: percepciones del profesorado

“…Este supuesto es la base de nuestras acciones enfocadas en la elaboración del programa para niños pequeños destinado a desarrollar su pensamiento científico a través de la experimentación en la cocina. Sin embargo, existen barreras u obstáculos que, a menudo impiden al profesorado planificar actividades para el fomento de la educación STEM (Ruhf, Williams & Zelinsky, 2022).…”

Learning and Teaching Styles in a Public School with a Focus on Renewable Energies

“…Although students are known to have difficulties in achieving the desired learning objectives in relation to the development of enquiry skills and knowledge related to engineering and renewable energies [16,17], the Maria Inmaculada School has been implementing in recent years the science, technology, engineering, and mathematics (STEM) approach to education, which allows for the availability of subjects that ensure the early exposure of students to the relevance, perspectives, and implications of science and renewable energy in the global scenario [12]. Thus, this increases the students' interest and motivation in STEM-based careers, due to their early exposure to basic knowledge [18].…”