No abstract

This study investigates how an onscreen virtual agent's dialog capability and facial animation affect survey respondents' comprehension and engagement in “face-to-face” interviews, using questions from US government surveys whose results have far-reaching impact on national policies. In the study, 73 laboratory participants were randomly assigned to respond in one of four interviewing conditions, in which the virtual agent had either high or low dialog capability (implemented through Wizard of Oz) and high or low facial animation, based on motion capture from a human interviewer. Respondents, whose faces were visible to the Wizard (and videorecorded) during the interviews, answered 12 questions about housing, employment, and purchases on the basis of fictional scenarios designed to allow measurement of comprehension accuracy, defined as the fit between responses and US government definitions. Respondents answered more accurately with the high-dialog-capability agents, requesting clarification more often particularly for ambiguous scenarios; and they generally treated the high-dialog-capability interviewers more socially, looking at the interviewer more and judging high-dialog-capability agents as more personal and less distant. Greater interviewer facial animation did not affect response accuracy, but it led to more displays of engagement—acknowledgments (verbal and visual) and smiles—and to the virtual interviewer's being rated as less natural. The pattern of results suggests that a virtual agent's dialog capability and facial animation differently affect survey respondents' experience of interviews, behavioral displays, and comprehension, and thus the accuracy of their responses. The pattern of results also suggests design considerations for building survey interviewing agents, which may differ depending on the kinds of survey questions (sensitive or not) that are asked.

Facial attractiveness is associated with a variety of positive social characteristics including trustworthiness. Variations in smiling, such as the appearance of the Duchenne marker and increased intensity of expression, have likewise been linked with positive judgments of trustworthiness. The study investigated the interaction of the effects of models' attractiveness and their smiling intensity on impressions of perceived trustworthiness. Participants rated the attractiveness and expressivity of neutral, low intensity, and high intensity smiling images of 45 women models. These images were also presented to a second group of participants who rated trustworthiness. Repeated measures analysis of covariance of the effects of attractiveness and manipulated smile intensity on trustworthiness indicated a main effect for smile intensity: increased smile intensity was associated with greater trustworthiness. Attractiveness also contributed to rated trustworthiness independently of smiling intensity. Results suggested there is an additional contribution of facial expression in creating social impressions of trustworthiness.

The context of voluntary movement during facial assessment has significant effects on the activity of facial muscles. Using automated facial analysis, we found that healthy subjects instructed to blow produced lip movements that were longer in duration and larger in amplitude than when subjects were instructed to pucker. We also determined that lip movement for puckering expressions was more asymmetric than lip movement in blowing. Differences in characteristics of lip movement were noted using facial movement analysis and were associated with the context of the movement. The impact of the instructions given for voluntary movement on the characteristics of facial movement might have important implications for assessing the capabilities and deficits of movement control in individuals with facial movement disorders. If results generalize to the clinical context, assessment of generally focused voluntary facial expressions might inadequately demonstrate the full range of facial movement capability of an individual patient.

No abstract