Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents 2019
DOI: 10.1145/3308532.3329473
|View full text |Cite
|
Sign up to set email alerts
|

An End-to-End Conversational Style Matching Agent

Abstract: We present an end-to-end voice-based conversational agent that is able to engage in naturalistic multi-turn dialogue and align with the interlocutor's conversational style. The system uses a series of deep neural network components for speech recognition, dialogue generation, prosodic analysis and speech synthesis to generate language and prosodic expression with qualities that match those of the user. We conducted a user study (N=30) in which participants talked with the agent for 15 to 20 minutes, resulting … Show more

Help me understand this report
View preprint versions

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

0
16
0
1

Year Published

2019
2019
2024
2024

Publication Types

Select...
5
5

Relationship

2
8

Authors

Journals

citations
Cited by 44 publications
(20 citation statements)
references
References 27 publications
0
16
0
1
Order By: Relevance
“…We selected Tannen's classification of style to define conversational styles of agents, since recent work has shown its suitability in understanding styles in human-human conversations, and also in human-agent conversations [34]. Moreover, Tannen's classification has served as the basis for aligning the style of an end-to-end voice-based agent with that of an interlocutor [17].…”
Section: )mentioning
confidence: 99%
“…We selected Tannen's classification of style to define conversational styles of agents, since recent work has shown its suitability in understanding styles in human-human conversations, and also in human-agent conversations [34]. Moreover, Tannen's classification has served as the basis for aligning the style of an end-to-end voice-based agent with that of an interlocutor [17].…”
Section: )mentioning
confidence: 99%
“…Prior work on human-machine lexical entrainment looked at conversations between humans and physical robots in a shared space, or conversational agents (Hoegen et al, 2019). More generally, the entrainment phenomenon is usually studied over the course of a conversation, to determine if conversation participants imitate each other's conversation styles.…”
Section: Discussionmentioning
confidence: 99%
“…We argue that incorporating such data into the modeling component of a virtual agent and using it to explicitly model these aspects will improve the support agents can giveÐnot only in terms of what it recommends, but also in its interaction with the user (e.g. presenting as an agent with a compatible personality, using an uplifting or comforting voice, and presenting information in a manner that supports the user's decision-making style [13]). Taken one step further, a łhuman digital twinž that mimics users' own preferences decision practices could offer users a transformative reflective lens to support exploration and understanding [3,22].…”
Section: The Visionmentioning
confidence: 99%