The first steps for adapting an artificial intelligence emotion expression recognition software for emotional management in the educational context

Abstract

To test the suitability of an automatic system for emotional management in the classroom following the control‐value theory of achievement emotions (CVT) framework, the performance of an emotional expression recognition software of our creation is evaluated in an online synchronous context. Sixty students from the Faculty of Education at the University of Alicante participated in 16 educational activities recording close‐ups of their faces and completing the AEQ emotional self‐report, as well as detailed reports from the subsequent review of their videos. In addition, they completed the VCQ‐36 test to measure their volitional competencies and relate their influence on their emotional response. The results indicate a high coherence between the emotional expressions detected by the automatic system and the detailed emotional self‐reports, but insufficient precision to meet the CVT requirements. On the other hand, both the AEQ test results and the emotion expression recognition software suggest students' preference for participative activities as opposed to passive ones. Meanwhile, statistical analysis results indicate that volitional competencies seem to influence the emotional response of students in the educational context, although the AI system does not show sufficient sensitivity in this field. Implications and limitations of this study for future work are discussed. Practitioner notesWhat is already known about this topic Student motivation and involvement in the learning process are highly related to appropriate emotional regulation, which can be associated with particular educational activities, strategies and methodologies. Deep learning technology based on convolutional neural networks feeds automatic systems focused on facial expression recognition from image analysis. What this paper adds There is high coherence between the emotional expressions detected by the AI system and the students' emotional self‐reports, but the AI system provides just emotional valences, insufficient to meet the CVT framework. Both emotional self‐reports and the emotion recognition software suggest students' preference for active educational activities as opposed to passive ones. Volitional competencies seem to influence the emotional response of students in the educational context. Implications for practice and/or policy It is possible to use automatic systems to effectively monitor the emotional response of students in the learning process. Only if sensitivity improved, a real‐time, easy‐to‐interpret emotional expression recognition software interface could be implemented to assist teachers with the emotional management of their classes within the CVT framework, maximizing their motivation and engagement.

Enhancing Emotion Recognition in College Students' Online Learning: A Research on Integrating Feature Fusion and Attention Mechanisms

“…Among them, deep learning has shown excellent results in many fields such as computer vision and pattern recognition, such as face recognition, head pose estimation, etc. [5,6], and many researchers have developed a series of advanced methods for emotion recognition [7][8][9][10], achieving excellent experimental results. Deep learning applications in emotion recognition in the field of education are also gradually developing, but there are few databases for student learning emotions, and there is no unified standard for database classification, with significant differences in expression categories.…”

Una mirada hacia la Inteligencia emocional y el desempeño docente en una universidad pública en Perú

“…La implantación de sistemas de evaluación basados en uno o varios modelos teóricos ha ayudado a varias naciones a avanzar en este ámbito (Torres et al, 2020). Dicho esto, se observa que los procedimientos de aplicación se ocultan con frecuencia bajo una máscara de autoridad y aprobación (Fernández Herrero et al, 2023).…”