Online Learning Engagement Recognition Using Bidirectional Long-Term Recurrent Convolutional Networks

Abstract

Background: Online learning is currently adopted by educational institutions worldwide to provide students with ongoing education during the COVID-19 pandemic. However, online learning has seen students lose interest and become anxious, which affects learning performance and leads to dropout. Thus, measuring students’ engagement in online learning has become imperative. It is challenging to recognize online learning engagement due to the lack of effective recognition methods and publicly accessible datasets. Methods: This study gathered a large number of online learning videos of students at a normal university. Engagement cues were used to annotate the dataset, which was constructed with three levels of engagement: low engagement, engagement, and high engagement. Then, we introduced a bi-directional long-term recurrent convolutional network (BiLRCN) for online learning engagement recognition in video. Result: An online learning engagement dataset has been constructed. We evaluated six methods using precision and recall, where BiLRCN obtained the best performance. Conclusion: Both category balance and category similarity of the data affect the performance of the results; it is more appropriate to consider learning engagement as a process-based evaluation; learning engagement can provide intervention strategies for teachers from a variety of perspectives and is associated with learning performance. Dataset construction and deep learning methods need to be improved, and learning data management also deserves attention.

Novel Bilinear Fusion Network Based on Multimodal Data for Student Distracted Behavior Recognition

“…Che et al (2022) collected real intelligent classroom environment video data, made students' class action recognition database, and conducted benchmark experiments on the database by using traditional machine learning methods and convolutional neural network. Ma et al (2022) used C3D (Convolution 3D) network to recognize actions of students on the self-built classroom learning database. This kind of method does not make use of attitude information and interactive object information, so there are not many kinds of behavior recognition, low accuracy and slow processing speed.…”

Learning analytics with correlation-based SAN-LSTM mechanism for formative evaluation and improved online learning

“…Using online tools and resources like LMS, students obtain a degree through distant learning after passing the examination [15]. Students benefit from methods of instruction in online learning, and teachers assist students in restoring interest for studying in a variety of ways, such as by providing educational resources [16]. Self-regulation is essentially needed for promising online learning sessions that enable students to handle their learning without the guidance of instructors [17].…”