A Study on the Construction of Emotion Recognition Based on Multimodal Information Fusion in English Learning Cooperative and Competitive Mode

Tu, Haihua

doi:10.3389/fpsyg.2021.767844

Cited by 3 publications

(1 citation statement)

References 23 publications

(22 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…erefore, it is an important way to correctly adjust the educational method and improve the teaching e ciency to do a good job of mental state assessment in the classroom in time. It is in this context that this paper aims to support the English teaching based on the emotional analysis of students' expressions and speeches during the English teaching classes to obtain their corresponding mental states [1][2][3].…”

Section: Introductionmentioning

confidence: 99%

Mental State Assessment in College English Teaching Courses Based on Deep Learning

Bei-bei

2022

Mathematical Problems in Engineering

View full text Add to dashboard Cite

College English teaching aims at students with different foundations and characteristics. Also, it is necessary to grasp the mental state of students in time during the teaching process. Based on the bimodal information of facial expressions and speech of classroom students, this paper designs a mental state assessment method based on deep learning. For bimodal emotion recognition of facial expressions and speech, a feature fusion method based on sparse canonical correlation analysis (SCCA) is proposed in this paper. First, the emotional features of the facial expression and speech are extracted, respectively. Then, SCCA is used to fuse the emotional features of the two modalities. Finally, the sparse representation-based classification (SRC) is used as the classifier for emotional prediction. Based on the prediction results, the mental state of different students can be grasped, so as to adjust the teaching strategy in a targeted manner. Experiments are carried out based on public datasets. First, the proposed method achieves the average classification accuracy of 92.4%, which is higher than those from the present methods for comparison. Second, under the condition of noise corruption, the proposed method keeps the superior robustness over the comparison methods. The results show that the proposed bimodal emotion recognition method based on SCCA and SRC can achieve higher recognition rates than some present methods.

show abstract

Section: Introductionmentioning

confidence: 99%

Mental State Assessment in College English Teaching Courses Based on Deep Learning

Bei-bei

2022

Mathematical Problems in Engineering

View full text Add to dashboard Cite

show abstract

Integrating Design Thinking into Basic Medical Innovation Projects: A Qualitative Study from the Perspective of Clinical Medicine Undergraduates

Wang,

Gao,

et al. 2024

Preprint

View full text Add to dashboard Cite

In the reform of medical education, innovative teaching methods are increasingly valued. Integrating design thinking (DT) into basic medical courses is seen as a key approach to fostering students' innovation and practical skills. The "Creative Histology and Embryology Learning Skills Expansion Competition," an interdisciplinary project, aims to explore new teaching models, promote comprehensive student development, and provide a practical example for innovative basic medical education. This study used qualitative research methods to conduct interviews with 15 award-winning students, gathering their learning experiences and feedback. We applied grounded theory to analyze the interview data through three levels of coding (open coding, axial coding, and selective coding) to reveal how DT integration in basic medical courses impacts students' innovation awareness and abilities. Open coding clearly identified the primary experiences and feelings of the students. Axial coding grouped these experiences into key themes, and selective coding developed a theoretical framework to explain these experiences and feelings. The three-level coding revealed that clinical undergraduates participating in the interdisciplinary competition had rich experiences and profound insights, particularly in terms of motivation, preparation, collaboration, and gains. DT is an effective tool for improving medical education, particularly in histology and embryology courses. It significantly enhances students' innovation awareness and abilities. This finding confirmed the effectiveness of DT in medical education and supported the transformation of basic medical education models. Future medical education practices should emphasize the integration of DT to cultivate students with innovation and practical skills. This will promote the reform and development of medical education.

show abstract

Course evaluation of preschoolhygiene under the multimodal learning model

Wang

2024

Applied Mathematics and Nonlinear Sciences

View full text Add to dashboard Cite

In traditional learning situations, teachers mainly evaluate students’ behavioral changes, emotional changes, and interactions to ensure teaching quality. The Random Forest algorithm is employed in this paper to determine the characteristics of students’ body postures and observe their behavioral changes. The geometric analysis method is used to recognize students’ head posture, and the image test classification module is used to capture students’ facial expressions. Analyze the teacher-student learning interactions in the classroom by examining the student’s question-answering records from the interactive cloud platform. A multimodal information fusion model was constructed to combine students’ multimodal performance data to complete the evaluation of the preschool hygiene course. The results of the case study of five students showed that the fusion results of the ratings of students 1-5 under the multimodal information fusion model of the course evaluation were 0.56, 0.888, 0.083, 0.452, and 0.957, respectively. The results of the fusion of the ratings of students 2 and 5 were very serious in learning the course, and the percentage of their time spent in attentive behavior was 0.452. Student 2 and Student 5 studied the course very seriously, spent 90% and 89% of their time engaged in attentive behaviors, respectively, and maintained an emotion of interest for 66% and 70% of the time, respectively. Furthermore, Student 2 answered all the questions in the interactive session, while Student 5 answered all the questions correctly. The median integration rating of the 40 participating students was 0.706, and the majority of the students rated the integration of the course in the middle to high range, which means that the content and format of this pre-school hygiene course were excellent and stimulating for the students.

show abstract

A Study on the Construction of Emotion Recognition Based on Multimodal Information Fusion in English Learning Cooperative and Competitive Mode

Cited by 3 publications

References 23 publications

Mental State Assessment in College English Teaching Courses Based on Deep Learning

Mental State Assessment in College English Teaching Courses Based on Deep Learning

Integrating Design Thinking into Basic Medical Innovation Projects: A Qualitative Study from the Perspective of Clinical Medicine Undergraduates

Course evaluation of preschoolhygiene under the multimodal learning model

Contact Info

Product

Resources

About