Impact of Expressive Wrinkles on Perception of a Virtual Character’s Facial Expressions of Emotions

Courgeon, Matthieu; Buisine, Stéphanie; Martin, Jean‐Claude

doi:10.1007/978-3-642-04380-2_24

Cited by 38 publications

(24 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Nonverbal Behavior Synthesis: MACH has been developed on an existing life-like 3D character platform called Multimodal Affective Reactive Characters (MARC) [28]. In order to provide users with a realistic interview experience, MACH must appear and behave humanlike, adapting its behaviors to changes in the interaction.…”

Section: If X I = Max (X I+n ) (N =-2… + 2) or X I = Min (X I+n ) (N mentioning

confidence: 99%

Mach

Hoque

Courgeon

Martin

et al. 2013

Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Self Cite

226

View full text Add to dashboard Cite

MACH-My Automated Conversation coacH-is a novel system that provides ubiquitous access to social skills training. The system includes a virtual agent that reads facial expressions, speech, and prosody and responds with verbal and nonverbal behaviors in real time. This paper presents an application of MACH in the context of training for job interviews. During the training, MACH asks interview questions, automatically mimics certain behavior issued by the user, and exhibit appropriate nonverbal behaviors. Following the interaction, MACH provides visual feedback on the user's performance. The development of this application draws on data from 28 interview sessions, involving employment-seeking students and career counselors. The effectiveness of MACH was assessed through a weeklong trial with 90 MIT undergraduates. Students who interacted with MACH were rated by human experts to have improved in overall interview performance, while the ratings of students in control groups did not improve. Postexperiment interviews indicate that participants found the interview experience informative about their behaviors and expressed interest in using MACH in the future.

show abstract

Section: If X I = Max (X I+n ) (N =-2… + 2) or X I = Min (X I+n ) (N mentioning

confidence: 99%

Mach

Hoque

Courgeon

Martin

et al. 2013

Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Self Cite

226

View full text Add to dashboard Cite

show abstract

“…Nonverbal behavior synthesis: MACH has been developed on an existing life-like 3D character platform called Multimodal Affective Reactive Characters (MARC) [1]. It was designed to appear and behave human-like by adjusting Figure 1.…”

Section: Technical Systemmentioning

confidence: 99%

“…We would like to acknowledge Jean-Claude Martin and Matthieu Courgeon for allowing us to build our system on their Multimodal Affective Reactive Characters (MARC) [1] Platform. Special acknowledgements to Sumit Gogia and Alex Sugurel for helping with the UI design, and Eunice Lin, Nicole Pan, Kristi Tausk, Abra Shen, Tamanna Urmi for helping with the study.…”

Section: Acknowledgmentmentioning

confidence: 99%

Automated Coach to Practice Conversations

Hoque

Picard

2013

2013 Humaine Association Conference on Affective Computing and Intelligent Interaction

View full text Add to dashboard Cite

Abstract-We present a real-time system including a 3D character that can converse, capture, analyze and interpret subtle and multidimensional human nonverbal behaviors for possible applications such as job interviews, public speaking, or even automated speech therapy. The system works in a personal computer and senses nonverbal data from video (i.e., facial expressions) and audio (i.e., speech recognition and prosody analysis) using a standard webcam. We contextualized the development and evaluation of our system as a training scenario for job interviews. Using user-centered design and iterations, we determine how the nonverbal data could be presented to the user in an intuitive and educational manner. We tested efficacy of the system in the context of job interviews with 90 MIT undergraduate students. Our results suggest that the participants who used our system to improve their interview skills were perceived to be better candidates by human judges. Participants reported that the most useful feature was being given feedback on their speaking rate, and overall they reported strong agreement that they would consider using this system again for self-reflection. Virtual agent; nonverbal behaviors; feedback; prosody; facial expressions.

show abstract

“…In two preliminary performances, we augmented the dance performance with a virtual character that expresses emotions with its facial expressions using the MARC platform [7]. In a second experiment, we were willing to 1) use an embodied device in the real world with which the dancer could play with, and 2) use bodily expressions of emotions so as to be symmetrical with the dancer.…”

Section: Expressive Pose Generationmentioning

confidence: 99%

Interactions and systems for augmenting a live dance performance

Clay

Couture

Nigay³

et al. 2012

2012 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH)

Self Cite

View full text Add to dashboard Cite

The context of this work is to develop, adapt and integrate augmented reality related tools to enhance the emotion involved in cultural performances. Part of the work was dedicated to augmenting a stage in a live performance, with dance as an application case. In this paper, we present a milestone of this work, an augmented dance show that brings together several tools and technologies that were developed over the project's lifetime. This is the result of mixing an artistic process with scientific research and development. This augmented show brings to stage issues from the research fields of Human-Machine Interaction (HMI) and Augmented Reality (AR). Virtual elements are added on stage (visual and audio) and the dancer is able to interact with them in real-time, using different interaction techniques. The originality of this work is threefold. Firstly, we propose a set of movement-based interaction techniques that can be used independently on stage or in another context. In this set, some techniques are direct, while others go through a high level of abstraction. Namely, we performed movement-based emotion recognition on the dancer, and used the recognized emotions to generate emotional music pieces and emotional poses for a humanoid robot. Secondly, those interaction techniques rely on various interconnected systems that can be reassembled. We hence propose an integrated, interactive system for augmenting a live performance, a context where system failure is not tolerated. The final system can be adapted following the artist's preferences. Finally, those systems were validated through an on field experiment -the show itself -after which we gathered and analyzed the feedback from both the audience and the choreographer.

show abstract

Impact of Expressive Wrinkles on Perception of a Virtual Character’s Facial Expressions of Emotions

Cited by 38 publications

References 28 publications

Mach

Mach

Automated Coach to Practice Conversations

Interactions and systems for augmenting a live dance performance

Contact Info

Product

Resources

About