Use of mixed methods research in intervention studies to increase young people’s interest in STEM: A systematic methodological review

Abstract

IntroductionMixed methods research intervention studies integrate quantitative evaluation approaches, such as randomized controlled trials and quasi-experimental designs, with qualitative research to evaluate the effectiveness, efficacy, or other results of an intervention or program. These types of studies, which have attracted growing attention in recent years, enhance the scope and rigor of the evaluation. While various frameworks that summarize the justifications for carrying out these types of studies and provide implementation guidance have been published in the last few years in the health sciences, we do not know whether such frameworks have been properly implemented in the social and educational sciences. This review examined the methodological features and reporting practices of mixed methods intervention studies aimed at increasing young people’s interest in STEM.MethodsA systematic search was carried out in APA PsycNET, ERIC, ProQuest, Scopus, and Web of Science, and a hand search in 20 journals. We included peer-reviewed English-language articles that reported intervention studies with a quantitative component measuring outcomes specific to increasing secondary school students’ interest in STEM fields, a qualitative component conducted before, during, or after the quantitative component, and evidence of integration of both components. Qualitative content analysis and ideal-type analysis were used to synthesize the findings.ResultsWe found 34 studies; the majority published in the last ten years. Several patterns of mixed methods application were described in these studies, illustrating the unique insights that can be gained by employing this methodology. The reporting quality of the included studies was generally adequate, especially regarding the justification for using a mixed methods intervention design and the integration of the quantitative and qualitative components. Nonetheless, a few reporting issues were observed, such as a lack of detail in the presentation of the mixed methods design, an inadequate description of the qualitative sampling and analysis techniques, and the absence of joint displays for representing integration.DiscussionAuthors must pay attention to these issues to ensure that the insights obtained by the use of mixed methods research are effectively communicated.

Effectiveness of Health Promotion Interventions in Primary Schools—A Mixed Methods Literature Review

“…In this context, particularly ethical issues on the reverse and unintended consequences, potential harm, and other ethical issues of the school-based HPIs need to be exposed. Finally, this review emphasized a strong need to develop a common standard to implement, report, and evaluate school-based HPIs; the mixed methods evaluation protocol is highly recommended to enhance the scope and rigor of the intervention [ 93 ].…”

Fostering Digital Transformations in Military Engineering Education: Introduction of a Technology-Enhanced Learning Environment

“…Previously, a literature review was conducted to identify relevant theories, concepts, and previous research findings related to the use of digital technologies in military engineering education that has become a basis for the development of close-open-ended questions. These questions helped researchers gather quantitative and qualitative data that offered a more comprehensive understanding of the research problem, contextualization, complementarity, and enhanced validity (Dawadi et al, 2021;Fàbregues et al, 2023).…”