Designing an Expressive Avatar of a Real Person

Lee, Sang Yoon; Carlson, Gordon; Jones, Steve; Johnson, Andrew; Leigh, Jason; Renambot, Luc

doi:10.1007/978-3-642-15892-6_8

Cited by 19 publications

(6 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…31 Upon Institutional Review Board approval for development, photos of four African American boys, aged 9 to 11, were used to form base head models for the four virtual humans (Figure 2). To achieve recognizable facial expressions, we collaborated with an expert certified in the Facial Action Coding System (FACS), a reliable method of detecting and measuring facial movements.…”

Section: Developmentmentioning

confidence: 99%

Development and Validation of a Virtual Human Vignette to Compare Nurses’ Assessment and Intervention Choices for Pain in Critically Ill Children

LaFond

Vincent

Lee

et al. 2015

Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare

Self Cite

View full text Add to dashboard Cite

Introduction As virtual experiences are increasingly used in healthcare training and research, it is important that adequate processes are applied for developing valid scenarios. We describe the development and validation of virtual human (VH) vignettes, computer-generated scenarios with animated patients and clinical information, for a mixed-methods study regarding nurses’ assessment and intervention choices for critically-ill children’s pain. Methods We followed the Case Development and Review Process for High-Fidelity Simulation Case Scenarios, including use of validated written vignettes and content experts. Forty nurses described their pain assessment and intervention choices for the newly derived VH vignettes and completed a pain questionnaire. Nurses’ reports of VH vignette consistency with their professional experience and recognition of VH facial expressions were evaluated to establish face validity. Their pain ratings for the VH and written (questionnaire) vignettes were evaluated for convergent validity. Qualitative content analysis, descriptive statistics, correlations, and paired t-tests were employed. Results Most nurses (68.4%) supported vignette consistency with their professional experience. Facial expression recognition was 98.4%. Smiling children’s pain was rated significantly lower than grimacing children in both VH and written vignettes. Pain was rated significantly lower for grimacing children in the VH vignettes than the written vignettes. VH vignette pain ratings were strongly correlated with their written counterparts. Conclusions This process was effective for developing VH vignettes that demonstrated good face validity with participants and convergent validity with written vignettes. VH vignettes may be useful in studying the influence of facial actions on nurses’ choices for children’s pain assessment and treatment.

show abstract

Section: Developmentmentioning

confidence: 99%

Development and Validation of a Virtual Human Vignette to Compare Nurses’ Assessment and Intervention Choices for Pain in Critically Ill Children

LaFond

Vincent

Lee

et al. 2015

Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare

Self Cite

View full text Add to dashboard Cite

show abstract

“…A virtual talking character is a challenging task because it should provide control on all articulatory movements and must be synchronized with the speech signal ( [31]; Lee et al [21]; [33]; Taylor et al [38]; Leuski and Richmond [25]; Wei and Deng [43]). Lee et al [22] designed an expressive avatar of real human process for the Lifelike Responsive Avatar Framework (LRAF), which was implemented to analyze the efficiency of expressive avatars. Shapiro [34] achieved a high level of realism and control by describing a system for the movement of virtual characters by incorporating a set of important aspects of simulated character models and games.…”

Section: Previous Studiesmentioning

confidence: 99%

Lip syncing method for realistic expressive 3D face model

Ali

Kolivand

Alkawaz

2017

Multimed Tools Appl

View full text Add to dashboard Cite

Lip synchronization of 3D face model is now being used in a multitude of important fields. It brings a more human, social and dramatic reality to computer games, films and interactive multimedia, and is growing in use and importance. High level of realism can be used in demanding applications such as computer games and cinema. Authoring lip syncing with complex and subtle expressions is still difficult and fraught with problems in terms of realism. This research proposed a lip syncing method of realistic expressive 3D face model. Animated lips requires a 3D face model capable of representing the myriad shapes the human face experiences during speech and a method to produce the correct lip shape at the correct time. The paper presented a 3D face model designed to support lip syncing that align with input audio file. It deforms using Raised Cosine Deformation (RCD) function that is grafted onto the input facial geometry. The face model was based on MPEG-4 Facial Animation (FA) Standard. This paper proposed a method to animate the 3D face model over time to create animated lip syncing using a canonical set of visemes for all pairwise combinations of a reduced phoneme set called ProPhone. The proposed research integrated emotions by the consideration of Ekman model and Plutchik's wheel with emotive eye movements by implementing Emotional Eye Movements Markup Language (EEMML) to produce realistic 3D face model.

show abstract

“…al. presented the design of the development for their Lifelike Responsive Avatar Framework (LRAF), which used a virtual representation of a real human [16].…”

Section: Virtual Humans (Vhs)mentioning

confidence: 99%

Maintaining and Enhancing Human-Surrogate Presence in Augmented Reality

Kim

Welch

2015

2015 IEEE International Symposium on Mixed and Augmented Reality Workshops

View full text Add to dashboard Cite

We present some background and ideas related to a human's sense of presence with a human surrogate (a stand-in for a human) in an augmented reality (AR) setting. In particular we examine several factors related to human surrogates that are common to robotics, virtual reality, and augmented reality; and some challenges that are unique to AR. We then discuss the roles of surrogate characteristics and behaviors in maintaining and perhaps enhancing a sense of presence with a surrogate. We conclude by sharing some ideas for intentionally employing particular surrogate characteristics/behaviors that could simultaneously address the AR-specific challenges while maintaining and perhaps even enhancing the sense of co-presence/social presence with human surrogates in AR.

show abstract

Designing an Expressive Avatar of a Real Person

Cited by 19 publications

References 12 publications

Development and Validation of a Virtual Human Vignette to Compare Nurses’ Assessment and Intervention Choices for Pain in Critically Ill Children

Development and Validation of a Virtual Human Vignette to Compare Nurses’ Assessment and Intervention Choices for Pain in Critically Ill Children

Lip syncing method for realistic expressive 3D face model

Maintaining and Enhancing Human-Surrogate Presence in Augmented Reality

Contact Info

Product

Resources

About