Analyzing online discussion data for understanding the student's critical thinking

Abstract

PurposeCritical thinking is considered important in psychological science because it enables students to make effective decisions and optimizes their performance. Aiming at the challenges and issues of understanding the student's critical thinking, the objective of this study is to analyze online discussion data through an advanced multi-feature fusion modeling (MFFM) approach for automatically and accurately understanding the student's critical thinking levels.Design/methodology/approachAn advanced MFFM approach is proposed in this study. Specifically, with considering the time-series characteristic and the high correlations between adjacent words in discussion contents, the long short-term memory–convolutional neural network (LSTM-CNN) architecture is proposed to extract deep semantic features, and then these semantic features are combined with linguistic and psychological knowledge generated by the LIWC2015 tool as the inputs of full-connected layers to automatically and accurately predict students' critical thinking levels that are hidden in online discussion data.FindingsA series of experiments with 94 students' 7,691 posts were conducted to verify the effectiveness of the proposed approach. The experimental results show that the proposed MFFM approach that combines two types of textual features outperforms baseline methods, and the semantic-based padding can further improve the prediction performance of MFFM. It can achieve 0.8205 overall accuracy and 0.6172 F1 score for the “high” category on the validation dataset. Furthermore, it is found that the semantic features extracted by LSTM-CNN are more powerful for identifying self-introduction or off-topic discussions, while the linguistic, as well as psychological features, can better distinguish the discussion posts with the highest critical thinking level.Originality/valueWith the support of the proposed MFFM approach, online teachers can conveniently and effectively understand the interaction quality of online discussions, which can support instructional decision-making to better promote the student's knowledge construction process and improve learning performance.

Linguistic markers for major depressive disorder: a cross-sectional study using an automated procedure

“…LIWC 2015 “all fields” search key criteria indicates 54 studies, 16 of which with specific focus on LIWC-2015. From these, 7 are of interest for health and education ( Stanton et al, 2017 ; Chippendale and Gentile, 2021 ; Monzani et al, 2021 ; Ansari and Du, 2022 ; Yang et al, 2022 ; Sengun et al, 2023 ; Wu et al, 2023 ). Moreover, 7 studies ( Toma and D’Angelo, 2015 ; Coello-Guilarte et al, 2019 ; Kimball et al, 2019 ; Berkout et al, 2020 ; McDonnell et al, 2020 ; Dudău and Sava, 2022 ; Meyerhoff et al, 2023 ) focus on the use of LIWC in connection with depression, all of them relevant for the topic of this study.…”

A novel deep learning method to use feature complementarity for review helpfulness prediction

“…Unlike CNN, RNN imitates human reading behavior by extracting semantic representations from left to right of the entire review text. However, as RNN are not ideal for capturing long-distance semantic connections and face vanishing gradient problems (Yang et al , 2022), their variation, known as long short-term memory (LSTM), is more commonly applied. For example, Luo and Xu (2021) applied LSTM to predict the sentiments of online restaurant reviews and demonstrated that the DL technique has a better ability to perform prediction tasks.…”

Engklek Game Ethnoscience-Based Learning Material (EGEBLM) to Improve Students’ Conceptual Understanding and Learning Motivation

“…Discussion is an excellent technique to learn and build conceptual understanding because it involves an exchange of viewpoints that students can consider and reject or embrace (Zarifsanaiey et al, 2016;Bean & Melzer, 2021;Shuhong, 2023). In addition, through discussion, students can reduce disagreements between themselves and other students (Kager et al, 2022;Yang et al, 2022). Due to the integration between these learning models by considering the cultural and ecological environment along with the community values contained in the Engklek game to produce a science-literate generation with innovative skills and scientific attitudes (Sudarmin, 2014).…”