Closed-Loop Tracking and Regulation of Emotional Valence State From Facial Electromyogram Measurements

Abstract

Affective studies provide essential insights to address emotion recognition and tracking. In traditional open-loop structures, a lack of knowledge about the internal emotional state makes the system incapable of adjusting stimuli parameters and automatically responding to changes in the brain. To address this issue, we propose to use facial electromyogram measurements as biomarkers to infer the internal hidden brain state as feedback to close the loop. In this research, we develop a systematic way to track and control emotional valence, which codes emotions as being pleasant or obstructive. Hence, we conduct a simulation study by modeling and tracking the subject's emotional valence dynamics using state-space approaches. We employ Bayesian filtering to estimate the person-specific model parameters along with the hidden valence state, using continuous and binary features extracted from experimental electromyogram measurements. Moreover, we utilize a mixed-filter estimator to infer the secluded brain state in a real-time simulation environment. We close the loop with a fuzzy logic controller in two categories of regulation: inhibition and excitation. By designing a control action, we aim to automatically reflect any required adjustments within the simulation and reach the desired emotional state levels. Final results demonstrate that, by making use of physiological data, the proposed controller could effectively regulate the estimated valence state. Ultimately, we envision future outcomes of this research to support alternative forms of self-therapy by using wearable machine interface architectures capable of mitigating periods of pervasive emotions and maintaining daily well-being and welfare.

Bayesian Inference of Hidden Cognitive Performance and Arousal States in Presence of Music

“…This type of decoder conforms to the Yerkes-Dodson law. The ultimate goal of this performance-based arousal decoder is to be implemented within safe closed-loop systems, and the proposed decoder can be further investigated in different behavioral experiments [46]- [48]. In the future, we aim to test decoders in different experiments and quantify the arousal and performance in various environments.…”

Unveiling productivity: The interplay of cognitive arousal and expressive typing in remote work

“…These technological advancements facilitate deeper insights into the interaction between physiological signals and cognitive processes, opening new avenues for research in productivity, especially in remote work settings [50][51][52][53]. Additionally, these insights have the potential to inform the development of innovative closed-loop control systems for performance regulation and mental health monitoring [54][55][56][57][58][59][60].…”

Regulation of brain cognitive states through auditory, gustatory, and olfactory stimulation with wearable monitoring

“…Hence, cognitive performance can be maximized by maintaining the internal arousal state in an optimal range 7 , 8 . Besides cognitive performance enhancement, over the last few years, a growing interest in human emotion regulation arises in various areas such as education 9 , 10 , neural rehabilitation 11 , 12 , physiological disorder treatments 13 , and brain–computer interfaces 14 , 15 . Thus, it is crucial to regulate the arousal state and keep it within the optimal range 16 .…”