Exploring the Learning Process and Effectiveness of STEM Education via Learning Behavior Analysis and the Interactive-Constructive- Active-Passive Framework

Abstract

Given the inadequacy of assessed outcomes (e.g., final exam) and the importance of evaluating the learning process in STEM education, we use deep learning to develop the STEM learning behavior analysis system (SLBAS) to assess the behavior of learners in STEM education. We map learner behavior to the ICAP (interactive, constructive, active, passive) framework, helping instructors to better understand the learning process of learners. The results show that SLBAS exhibits high accuracy. Moreover, Cohen’s kappa coefficient between expert coding and SLBAS is high enough to support replacing expert coding in the observation method with SLBAS to recognize the learning process of learners during STEM activities. Finally, statistical analysis establishes a correlation between the learning process and learning effectiveness. The results of this study are in line with most previous studies, demonstrating that STEM education differs from traditional teacher-centered courses in that it helps learners to improve the process of knowledge construction with practice and hands-on opportunities rather than simply receiving knowledge passively.

Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction

“…The platform's design requires more intensive student interaction, reflecting the "learning-by-doing" pedagogy that is vital in higher learning environments. Students in these settings must not only understand theoretical concepts but also apply them in practical scenarios (Lee et al, 2023a(Lee et al, , 2023bLee et al, 2023aLee et al, , 2023bWu et al, 2023b). This is consistent with the findings of Dellatola et al (2020) and Kuo et al (2020), who reported that active engagement practices, such as collaborative problem-solving and peer feedback, improved students' learning outcomes and satisfaction in blended learning courses.…”

Using multimodal learning analytics to model students’ learning behavior in animated programming classroom

“…Based on the assumptions of the engagement model, the passive state refers to classroom situations where students quietly assimilate information and knowledge, but with little behavioral engagement with the learning experience (Lee et al, 2023). These students are more likely to direct their attention to the lesson content but less likely to engage in off-point discussion, take important notes, or contribute to dialogue (Chi et al, 2014;Michel et al, 2009;Russell, 2021).…”

Integrating Computational Thinking Into Scaffolding Learning: An Innovative Approach to Enhance Science, Technology, Engineering, and Mathematics Hands-On Learning

“…Hands-on learning is known for significantly enhancing learning engagement (Lee et al, 2023a; May et al, 2023). It spurs interest and motivation, providing richer learning experiences than conventional teaching methods and improving outcomes (Chen et al, 2020a).…”