Time-offset interaction with a holocaust survivor

Artstein, Ron; Traum, David; Alexander, Oleg; Leuski, Anton; Jones, Andrew; Georgila, Kallirroi; Debevec, Paul; Swartout, William; Maio, Heather; Smith, Stephen

doi:10.1145/2557500.2557540

Cited by 20 publications

(11 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Most of these QA systems are text-based information retrieval system though the corpus may be text, speech or videos in single language or cross-lingual. There is only one ongoing project (Artstein et al 2014) allowing multimodal conversation based on video testimonies and spoken question answering, for which the production costs are high.…”

Section: Question Answering (Qa) About the Holocaustmentioning

confidence: 99%

Question-Answering Virtual Humans Based on Pre-recorded Testimonies for Holocaust Education

Coward

Walker³

2017

Serious Games and Edutainment Applications

View full text Add to dashboard Cite

In this chapter we present Interact-a project which builds questionanswering virtual humans based on pre-recorded video testimonies for Holocaust education. It was created to preserve the powerful and engaging experience of listening to, and interacting with, Holocaust survivors, allowing future generations of audience access to their unique stories. Interact demonstrates how advanced filming techniques, 3D graphics and natural language processing can be integrated and applied to specially recorded testimonies to enable users to ask questions and receive answers from virtualised individuals. This provides a new and rich interactive narrative of remembrance to engage with primary testimony. We briefly reviewed the literature of conversational natural language interfaces, discussed the design and development of Interact, including how we mapped the current proceedings of testimony and question answering session to human computer interaction, how we generated/predicted questions for each survivor using a lifeline chart, the 3D data capture process, generating 3D human, natural language processing, and argue that this new form of mixed reality is promising media to overcome the uncanny valley. Subjective and objective evaluation is also reported. The chapter is a longer version of a short paper presented at the ACM OzCHI conference (Ma, Coward and Walker, 2015).

show abstract

Section: Question Answering (Qa) About the Holocaustmentioning

confidence: 99%

Question-Answering Virtual Humans Based on Pre-recorded Testimonies for Holocaust Education

Coward

Walker³

2017

Serious Games and Edutainment Applications

View full text Add to dashboard Cite

show abstract

“…Most of these QA systems are text-based. Only one ongoing project (Artstein et al 2014) allowing multimodal conversation based on video testimony and spoken question answering, at a high production cost.…”

Section: Question Answering About the Holocaustmentioning

confidence: 99%

Interact

Coward

Walker³

2015

Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction

View full text Add to dashboard Cite

In this paper we present Interact-a mixed reality virtual survivor for Holocaust education. It was created to preserve the powerful and engaging experience of listening to, and interacting with, Holocaust survivors, allowing future generations of audience access to their unique stories. Interact demonstrates how advanced filming techniques, 3D graphics and natural language processing can be integrated and applied to speciallyrecorded testimonies to enable users to ask questions and receive answers from that virtualised individuals. This provides a new and rich interactive narratives of remembrance to engage with primary testimony. We discuss the design and development of Interact, and argue that this new form of mixed reality is promising media to overcome the uncanny valley.

show abstract

“…New Dimensions in Testimonies (NDT) is a dialogue system that allows for two-way communication with a person who is not available for conversation in real time: a large set of statements is prepared in advance, and users access these statements through natural conversation that mimics face-to-face interaction (Artstein et al, 2014). Users interact with a recording of Holocaust survivor Pinchas Gutter.…”

Section: Introductionmentioning

confidence: 99%

Lessons in Dialogue System Deployment

Leuski

Artstein

2017

Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue

Self Cite

View full text Add to dashboard Cite

We analyze deployment of an interactive dialogue system in an environment where deep technical expertise might not be readily available. The initial version was created using a collection of research tools. We summarize a number of challenges with its deployment at two museums and describe a new system that simplifies the installation and user interface; reduces reliance on 3rd-party software; and provides a robust data collection mechanism.

show abstract

Time-offset interaction with a holocaust survivor

Cited by 20 publications

References 7 publications

Question-Answering Virtual Humans Based on Pre-recorded Testimonies for Holocaust Education

Question-Answering Virtual Humans Based on Pre-recorded Testimonies for Holocaust Education

Interact

Lessons in Dialogue System Deployment

Contact Info

Product

Resources

About