Affective brain-computer interfaces (BCI) harness Neuroscience knowledge to develop affective interaction from first principles. In this article, we explore affective engagement with a virtual agent through Neurofeedback (NF). We report an experiment where subjects engage with a virtual agent by expressing positive attitudes towards her under a NF paradigm. We use for affective input the asymmetric activity in the dorsolateral prefrontal cortex (DL-PFC), which has been previously found to be related to the high-level affective-motivational dimension of approach/avoidance. The magnitude of left-asymmetric DL-PFC activity, measured using functional near infrared spectroscopy (fNIRS) and treated as a proxy for approach, is mapped onto a control mechanism for the virtual agent’s facial expressions, in which action units (AUs) are activated through a neural network. We carried out an experiment with 18 subjects, which demonstrated that subjects are able to successfully engage with the virtual agent by controlling their mental disposition through NF, and that they perceived the agent’s responses as realistic and consistent with their projected mental disposition. This interaction paradigm is particularly relevant in the case of affective BCI as it facilitates the volitional activation of specific areas normally not under conscious control. Overall, our contribution reconciles a model of affect derived from brain metabolic data with an ecologically valid, yet computationally controllable, virtual affective communication environment.
Volitional neural modulation using neurofeedback has been indicated as a potential treatment for chronic conditions that involve peripheral and central neural dysregulation. Here we utilized neurofeedback in patients suffering from Fibromyalgia-a chronic pain syndrome that involves sleep disturbance and emotion dysregulation. These ancillary symptoms, which have an amplification effect on pain, are known to be mediated by heightened limbic activity. In order to reliably probe limbic activity in a scalable manner fit for EEG-neurofeedback training, we utilized an Electrical Finger Print (EFP) model of amygdala-BOLD signal (termed Amyg-EFP), that has been successfully validated in our lab in the context of volitional neuromodulation. We anticipated that Amyg-EFP-neurofeedback training aimed at limbic down modulation should improve chronic pain in patients suffering from Fibromyalgia, by balancing disturbed indices for sleep and affect. We further expected that improved clinical status would correspond to successful training as indicated by improved down modulation of the Amygdala-EFP signal. Thirty-Four Fibromyalgia patients (31F; age 35.6±11.82) participated in a randomized placebo-controlled trial with biweekly Amyg-EFP-neurofeedback sessions and placebo of sham neurofeedback (n=9) for a total duration of five consecutive weeks. Following training, participants in the Real-neurofeedback group were divided into good (n=13) or poor (n=12) modulators according to their success in the neurofeedback training. Before and after treatment, self-reports on pain, depression, anxiety, fatigue and sleep quality were obtained, as well as objective sleep Indices. Long-term clinical follow-up was made available, within up to three years of the neurofeedback training completion. REM latency and objective sleep quality index were robustly improved following the treatment course only in the Real-neurofeedback group (both time*group p<0.05) and to a greater extent among good modulators (both time*sub-group p<0.05). In contrast, self-report measures did not reveal a treatment-specific response at the end of the treatment. However, the follow-up assessment revealed a delayed improvement
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.