A Cognitive Level Evaluation Method Based on a Deep Neural Network for Online Learning: From a Bloom’s Taxonomy of Cognition Objectives Perspective

Abstract

The evaluation of the learning process is an effective way to realize personalized online learning. Real-time evaluation of learners’ cognitive level during online learning helps to monitor learners’ cognitive state and adjust learning strategies to improve the quality of online learning. However, most of the existing cognitive level evaluation methods use manual coding or traditional machine learning methods, which are time-consuming and laborious. They cannot fully mine the implicit cognitive semantic information in unstructured text data, making the cognitive level evaluation inefficient. Therefore, this study proposed the bidirectional gated recurrent convolutional neural network combined with an attention mechanism (AM-BiGRU-CNN) deep neural network cognitive level evaluation method, and based on Bloom’s taxonomy of cognition objectives, taking the unstructured interactive text data released by 9167 learners in the massive open online course (MOOC) forum as an empirical study to support the method. The study found that the AM-BiGRU-CNN method has the best evaluation effect, with the overall accuracy of the evaluation of the six cognitive levels reaching 84.21%, of which the F1-Score at the creating level is 91.77%. The experimental results show that the deep neural network method can effectively identify the cognitive features implicit in the text and can be better applied to the automatic evaluation of the cognitive level of online learners. This study provides a technical reference for the evaluation of the cognitive level of the students in the online learning environment, and automatic evaluation in the realization of personalized learning strategies, teaching intervention, and resources recommended have higher application value.

English Education Tutoring Teaching System Based on MOOC

“…The most significant feature of MOOCs is the two-way flow of information as compared to the traditional teaching methods available in literature. It is due to the fact that in the MOOC teaching method, students can discuss the difficulties they have encountered in their own learning or the areas of the teaching that they do not understand [ 9 , 10 ]. The problems or issues are conveyed to the teacher in the form of a message, and the teacher can understand the students' learning situation.…”

Exploring the impact of language models, such as ChatGPT, on student learning and assessment

“…Language models can also play a role in evaluating and scoring student responses to assessment material (Cheng et al., 2021; Cotton et al., 2023; Lee, 2023). However, the focus is on ‘play a role’ rather than the whole role (Cotton et al., 2023; Rahm & Rahm‐Skågeby, 2023).…”

“…Educators, among other uses such as exercises and classroom discussions, can use language models to generate teaching and assessment material (Dhruv et al., 2018; Roy & Rambo‐Hernandez, 2021). Language models such as ChatGPT and Perplexity AI can contribute to student learning and achievement through personalised learning strategies, teaching interventions, and recommended resources (Cheng et al., 2021; Farrokhnia et al., 2023).…”

Impact of Deep Learning Strategy in Mathematics Achievement and Practical Intelligence among High School Students

“…Linking the learned concepts with the concepts of daily life inside and outside the school. Extensive reading of vocabulary outside the textbook [26,27]. Several studies indicated that educational games develop this strategy and through it academic achievement can be predicted.…”