Expressing Personality Through Non-verbal Behaviour in Real-Time Interaction

Abstract

The attribution of traits plays an important role as a heuristic for how we interact with others. Many psychological models of personality are analytical in that they derive a classification from reported or hypothesised behaviour. In the work presented here, we follow the opposite approach: Our personality model generates behaviour that leads an observer to attribute personality characteristics to the actor. Concretely, the model controls all relevant aspects of non-verbal behaviour such as gaze, facial expression, gesture, and posture. The model, embodied in a virtual human, affords to realistically interact with participants in real-time. Conceptually, our model focuses on the two dimensions of extra/introversion and stability/neuroticism. In the model, personality parameters influence both, the internal affective state as well as the characteristic of the behaviour execution. Importantly, the parameters of the model are based on empirical findings in the behavioural sciences. To evaluate our model, we conducted two types of studies. Firstly, passive experiments where participants rated videos showing variants of behaviour driven by different personality parameter configurations. Secondly, presential experiments where participants interacted with the virtual human, playing rounds of the Rock-Paper-Scissors game. Our results show that the model is effective in conveying the impression of the personality of a virtual character to users. Embodying the model in an artificial social agent capable of real-time interactive behaviour is the only way to move from an analytical to a generative approach to understanding personality, and we believe that this methodology raises a host of novel research questions in the field of personality theory.

Understanding Embodied Effects of Posture: A Qualitative Study

“…The dominance dimension describes the degree to which one feels they are in control over their life circumstances (i.e., power over one's situation). The PAD model has previously been used to study non-verbal communication in psychology [30,31]. However, this is not a complete model for examining the effects of posture, as research has shown effects on other outcomes, such as information processing and creativity [32,33].…”

A Conversational Agent Framework with Multi-modal Personality Expression

“…Multi-modal communication elements are essential for expressing desired personality traits in digital characters. Nonverbal behavior elements are commonly used in affective virtual agents to convey these traits [42]- [45]. Studies leverage high-level meanings of motion to express the target personality type [46].…”

The Attractiveness of Dark Triad Characteristics in Facial Composites with Respect to Gender

“…The attractiveness of the people we meet is influenced by a number of factors. In the initial stages of interpersonal interactions, we mainly focus on non-verbal cues (Saberi et al, 2021), many of which come from our perceptions of human faces. We often rely on the opinions we form from our perception of the facial features of another person.…”