Humanoid robots versus humans: How is emotional valence of facial expressions recognized by individuals with schizophrenia? An exploratory study

Raffard, Stéphane; Bortolon, Catherine; Khoramshahi, Mahdi; Salesse, Robin N.; Burca, Marianna; Marín, Ludovic; Bardy, Benoît G.; Billard, Aude; Macioce, Valérie; Capdevielle, Delphine

doi:10.1016/j.schres.2016.06.001

Cited by 34 publications

(21 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This highlights how social robots can give insight which is not accessible otherwise as ASD patients regularly avoid eye-contact with other humans but seem to gravitate socially toward therapeutic robots. Conversely, patients with schizophrenia show higher amounts of variability than neurotypicals in perceiving social robots as intentional agents (Gray et al, 2011;Raffard et al, 2018) and show distinct and complex deficits in processing facial expressions in robots (Raffard et al, 2016;Cohen et al, 2017). Application of the paradigm used here to these clinical populations may thus be valuable for identifying how behaviors and expressions associated with eye-contact in robots and in people impact processing and exacerbate or improve dysfunction.…”

Section: Conclusion and Discussionmentioning

confidence: 99%

Comparison of Human Social Brain Activity During Eye-Contact With Another Human and a Humanoid Robot

et al. 2021

View full text Add to dashboard Cite

Robot design to simulate interpersonal social interaction is an active area of research with applications in therapy and companionship. Neural responses to eye-to-eye contact in humans have recently been employed to determine the neural systems that are active during social interactions. Whether eye-contact with a social robot engages the same neural system remains to be seen. Here, we employ a similar approach to compare human-human and human-robot social interactions. We assume that if human-human and human-robot eye-contact elicit similar neural activity in the human, then the perceptual and cognitive processing is also the same for human and robot. That is, the robot is processed similar to the human. However, if neural effects are different, then perceptual and cognitive processing is assumed to be different. In this study neural activity was compared for human-to-human and human-to-robot conditions using near infrared spectroscopy for neural imaging, and a robot (Maki) with eyes that blink and move right and left. Eye-contact was confirmed by eye-tracking for both conditions. Increased neural activity was observed in human social systems including the right temporal parietal junction and the dorsolateral prefrontal cortex during human-human eye contact but not human-robot eye-contact. This suggests that the type of human-robot eye-contact used here is not sufficient to engage the right temporoparietal junction in the human. This study establishes a foundation for future research into human-robot eye-contact to determine how elements of robot design and behavior impact human social processing within this type of interaction and may offer a method for capturing difficult to quantify components of human-robot interaction, such as social engagement.

show abstract

Section: Conclusion and Discussionmentioning

confidence: 99%

Comparison of Human Social Brain Activity During Eye-Contact With Another Human and a Humanoid Robot

et al. 2021

View full text Add to dashboard Cite

show abstract

“…These physical pose and behavior might have affected participants' impression more than PALRO's speech. In experiments with schizophrenic patients and humanoid robots, the robot's facial expressions successfully conveyed emotions [17]. People with schizophrenia responded faster with negative facial expressions than with positive facial expressions.…”

Section: Discussionmentioning

confidence: 97%

“…To similarly support schizophrenic patients, it is necessary for robots to understand a patient's characteristics and have a trusting relationship that allows the patient to recognize a robot as a partner. A study on the relationship between schizophrenic patients and humanoid robots showed that the facial expressions of robots could convey emotions [17]. However, there are few studies on the interaction between schizophrenic patients and robots.…”

Section: Introductionmentioning

confidence: 99%

Use of communication robots to converse with people suffering from schizophrenia

et al. 2020

View full text Add to dashboard Cite

Background: Medication is an important approach of treatment for patients with schizophrenia; however, the availability of visiting nurses and other human-related support is limited. This study aims to build a system in which service robots support the treatment of individuals with schizophrenia with medication at home. Moreover, medical staff can seamlessly monitor the status of their patients through the robots using this system. In this study, to develop a support system, interactions between a communication robot and patients were surveyed, with a focus on the patients' impression of the robot and actual utterance times. Methods: Communication between a commercially available communication robot and schizophrenic patients was investigated, particularly the participants' feelings about the robot. In addition, the utterance data between the participants and the robot were extracted and the durations of the conversations were assessed. Results: The examined interaction mode of a robot (talkative or not talkative) and whether the participant spoke or not (spoke or did not speak) revealed no significant association in all adjectives. A co-occurrence network graph showed differences in the participants' impressions of the robot depending on how talkative the robot was. That is, when the robot did not initiate conversation often, the patient was more likely to initiate interactions and use longer phrases than when the robot initiated conversation frequently. Conversations also lasted longer when the participant, not the robot, initiated conversation.

show abstract

“…Alternatively, the lack of a facilitatory effect of social cues in schizophrenia participants may be due to specific cognitive deficits, such as an impaired ability to perceive and interpret facial social cues (i.e., smiles). In a preliminary study, we showed that patients with schizophrenia were able to accurately recognize the valence of facial emotion elicited by the same iCub robot 40 . This speaks against the concern expressed above.…”

Section: Discussionmentioning

confidence: 99%

Influence of facial feedback during a cooperative human-robot task in schizophrenia

Cohen

Khoramshahi

Salesse

et al. 2017

Sci Rep

Self Cite

View full text Add to dashboard Cite

Rapid progress in the area of humanoid robots offers tremendous possibilities for investigating and improving social competences in people with social deficits, but remains yet unexplored in schizophrenia. In this study, we examined the influence of social feedbacks elicited by a humanoid robot on motor coordination during a human-robot interaction. Twenty-two schizophrenia patients and twenty-two matched healthy controls underwent a collaborative motor synchrony task with the iCub humanoid robot. Results revealed that positive social feedback had a facilitatory effect on motor coordination in the control participants compared to non-social positive feedback. This facilitatory effect was not present in schizophrenia patients, whose social-motor coordination was similarly impaired in social and non-social feedback conditions. Furthermore, patients’ cognitive flexibility impairment and antipsychotic dosing were negatively correlated with patients’ ability to synchronize hand movements with iCub. Overall, our findings reveal that patients have marked difficulties to exploit facial social cues elicited by a humanoid robot to modulate their motor coordination during human-robot interaction, partly accounted for by cognitive deficits and medication. This study opens new perspectives for comprehension of social deficits in this mental disorder.

show abstract

Humanoid robots versus humans: How is emotional valence of facial expressions recognized by individuals with schizophrenia? An exploratory study

Abstract: Individuals do not respond similarly to human facial emotion and to non-anthropomorphic emotional signals. Humanoid robots have the potential to convey emotions to patients with schizophrenia, but their appearance seems of major importance for human-robot interactions.

Cited by 34 publications

References 38 publications

Comparison of Human Social Brain Activity During Eye-Contact With Another Human and a Humanoid Robot

Comparison of Human Social Brain Activity During Eye-Contact With Another Human and a Humanoid Robot

Use of communication robots to converse with people suffering from schizophrenia

Influence of facial feedback during a cooperative human-robot task in schizophrenia

Contact Info

Product

Resources

About