Design and validation of ECA gestures to improve dialogue system robustness

López, Beatriz; Hernández, Álvaro; Díaz, David Araujo; Fernández, R.; Hernández, Luis; Torre, Doroteo

doi:10.3115/1610065.1610074

Cited by 5 publications

(5 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We inductively categorize the secondary studies under six classes, based on the focus of the research. The most common research goal is (1) the analysis of design and technical implementation of software systems based on the integration of conversational agents (9/28, 32% [34,52,60,98,131,132] and the Special Interest Group on Discourse and Dialogue (SIGdial) Fig. 6.…”

Section: Research Methods Findingsmentioning

confidence: 99%

“…Some examples include analysis on healthcare rhetorical structure theory [68], digital health coaching programs [154] or behavioural change in patients using medical chatbots [53]. On a secondary basis, up to 11 studies matching EC2 were focused on embodied conversational agents [98,153] or physical modelling features [16]. Finally, we still excluded 19 additional studies applying the rest of ECs.…”

Section: Inclusion and Exclusion Criteriamentioning

confidence: 99%

See 1 more Smart Citation

Software-Based Dialogue Systems: Survey, Taxonomy, and Challenges

Motger¹,

Franch

Marco

2022

ACM Comput. Surv.

View full text Add to dashboard Cite

The use of natural language interfaces in the field of human-computer interaction is undergoing intense study through dedicated scientific and industrial research. The latest contributions in the field, including deep learning approaches like recurrent neural networks, the potential of context-aware strategies and user-centred design approaches, have brought back the attention of the community to software-based dialogue systems, generally known as conversational agents or chatbots. Nonetheless, and given the novelty of the field, a generic, context-independent overview on the current state of research of conversational agents covering all research perspectives involved is missing. Motivated by this context, this paper reports a survey of the current state of research of conversational agents through a systematic literature review of secondary studies. The conducted research is designed to develop an exhaustive perspective through a clear presentation of the aggregated knowledge published by recent literature within a variety of domains, research focuses and contexts. As a result, this research proposes a holistic taxonomy of the different dimensions involved in the conversational agents’ field, which is expected to help researchers and to lay the groundwork for future research in the field of natural language interfaces.

show abstract

Section: Research Methods Findingsmentioning

confidence: 99%

Section: Inclusion and Exclusion Criteriamentioning

confidence: 99%

Software-Based Dialogue Systems: Survey, Taxonomy, and Challenges

Motger¹,

Franch

Marco

2022

ACM Comput. Surv.

View full text Add to dashboard Cite

show abstract

“…Some examples include analysis on healthcare rhetorical structure theory [51], digital health coaching programs [118] or behavioural change in patients using medical chatbots [40]. On a secondary basis, up to 11 studies matching EC2 were focused on embodied conversational agents [77,117] or physical modelling features [16]. Finally, we still excluded 14 additional studies applying the rest of ECs.…”

Section: Inclusion and Exclusion Criteriamentioning

confidence: 99%

Conversational Agents in Software Engineering: Survey, Taxonomy and Challenges

Motger¹,

Franch²,

Marco³

2021

Preprint

View full text Add to dashboard Cite

The use of natural language interfaces in the field of human-computer interaction is undergoing intense study through dedicated scientific and industrial research. The latest contributions in the field, including deep learning approaches like recurrent neural networks, the potential of context-aware strategies and user-centred design approaches, have brought back the attention of the community to software-based dialogue systems, generally known as conversational agents or chatbots. Nonetheless, and given the novelty of the field, a generic, context-independent overview on the current state of research of conversational agents covering all research perspectives involved is missing. Motivated by this context, this paper reports a survey of the current state of research of conversational agents through a systematic literature review of secondary studies. The conducted research is designed to develop an exhaustive perspective through a clear presentation of the aggregated knowledge published by recent literature within a variety of domains, research focuses and contexts. As a result, this research proposes a holistic taxonomy of the different dimensions involved in the conversational agents' field, which is expected to help researchers and to lay the groundwork for future research in the field of natural language interfaces. CCS Concepts: • General and reference → Surveys and overviews; • Human-centered computing → Natural language interfaces.

show abstract

“…The interaction is multimodal, intertwining speech utterances and finger pointing. The ECA, modelled as a photorealistic human, includes some advanced gesturing capabilities that have been demonstrated to make the avatar both more engaging and understandable (López Mencía et al, 2006;López et al, 2007López et al, , 2008.…”

Section: Cooking Companion Interfacementioning

confidence: 99%

Multimodal and mobile conversational Health and Fitness Companions

Turunen

Hakulinen

Ståhl

et al. 2011

Computer Speech & Language

View full text Add to dashboard Cite

Multimodal conversational spoken dialogues using physical and virtual agents provide a potential interface to motivate and support users in the domain of health and fitness. In this paper we present how such multimodal conversational Companions can be implemented to support their owners in various pervasive and mobile settings. We present concrete system architectures, virtual, physical and mobile multimodal interfaces, and interaction management techniques for such companions. In particular, we present how knowledge representation and separation of low-level interaction modelling from high-level reasoning at the domain level makes it possible to implement distributed, but still coherent, interaction with Companions. The distribution is enabled by using a dialogue plan to communicate information from domain level planner to dialogue management and from there to a separate mobile interface. The model enables each part of the system to handle the same information from its own perspective without containing overlapping * Corresponding author Email addresses: mturunen@cs.uta.fi (Markku Turunen), jh@cs.uta.fi (Jaakko Hakulinen), olovs@sics.se (Olov Ståhl), gamback@sics.se (Björn Gambäck), preben@sics.se (Preben Hansen), mcrg@tid.es (Mari C. Rodríguez Gancedo), e.rsai@tid.es (Raúl Santos de la Cámara), c.g.smith@tees.ac.uk 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 logic, and makes it possible to separate task-specific and conversational dialogue management from each other. In addition to technical descriptions, we present results from the first evaluations of the Companions interfaces.

show abstract

Design and validation of ECA gestures to improve dialogue system robustness

Cited by 5 publications

References 20 publications

Software-Based Dialogue Systems: Survey, Taxonomy, and Challenges

Software-Based Dialogue Systems: Survey, Taxonomy, and Challenges

Conversational Agents in Software Engineering: Survey, Taxonomy and Challenges

Multimodal and mobile conversational Health and Fitness Companions

Contact Info

Product

Resources

About