A General, Abstract Model of Incremental Dialogue Processing

Schlangen, David; Skantze, Gabriel

doi:10.5087/dad.2011.105

Cited by 56 publications

(27 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The incremental unit (iu) framework [23] is a conceptual approach to incremental processing which we build on for alignment. Following [15], the iu framework consists of a network of processing modules.…”

Section: The Iu Frameworkmentioning

confidence: 99%

Temporal alignment using the incremental unit framework

Kennington

Han

Schlangen

2017

Proceedings of the 19th ACM International Conference on Multimodal Interaction

Self Cite

View full text Add to dashboard Cite

We propose a method for temporal alignmentśa precondition of meaningful fusionśof multimodal systems, using the incremental unit dialogue system framework, which gives the system flexibility in how it handles alignment: either by delaying a modality for a specified amount of time, or by revoking (i.e., backtracking) processed information so multiple information sources can be processed jointly. We evaluate our approach in an offline experiment with multimodal data and find that using the incremental framework is flexible and shows promise as a solution to the problem of temporal alignment in multimodal systems.

show abstract

Section: The Iu Frameworkmentioning

confidence: 99%

Temporal alignment using the incremental unit framework

Kennington

Han

Schlangen

2017

Proceedings of the 19th ACM International Conference on Multimodal Interaction

Self Cite

View full text Add to dashboard Cite

show abstract

“…However, human communication is intrinsically incremental. Some outstanding research is currently focusing on this topic (Schlangen & Skantze, 2011; EUfunded Parlance project 5 ).…”

Section: Meta-cognition and Incrementalitymentioning

confidence: 99%

Review of spoken dialogue systems

López-Cózar

Callejas

Griol

et al. 2014

loquens

View full text Add to dashboard Cite

Spoken dialogue systems are computer programs developed to interact with users employing speech in order to provide them with specific automated services. The interaction is carried out by means of dialogue turns, which in many studies available in the literature, researchers aim to make as similar as possible to those between humans in terms of naturalness, intelligence and affective content.In this paper we describe the fundaments of these systems including the main technologies employed for their development. We also present an evolution of this technology and discuss some current applications. Moreover, we discuss development paradigms, including scripting languages and the development of conversational interfaces for mobile apps.The correct modelling of the user is a key aspect of this technology. This is why we also describe affective, personality and contextual models. Finally, we address some current research trends in terms of verbal communication, multimodal interaction and dialogue management.Keywords: dialogue; language understanding; dialogue management; natural language generation; speech synthesis. RESUMEN:Sistemas de diálogo: una revisión.-Los sistemas de diálogo son programas de ordenador desarrollados para interaccionar con los usuarios mediante habla, con la finalidad de proporcionarles servicios automatizados. La interacción se lleva a cabo mediante turnos de un tipo de diálogo que, en muchos estudios existentes en la literatura, los investigadores intentan que se parezca lo más posible al diálogo real que se lleva a cabo entre las personas en lo que se refiere a naturalidad, inteligencia y contenido afectivo.En este artículo describimos los fundamentos de esta tecnología, incluyendo las tecnologías básicas que se utilizan para implementar este tipo de sistemas. También presentamos una evolución de la tecnología y comentamos algunas aplicaciones actuales. Asimismo, describimos paradigmas de interacción, incluyendo lenguajes de script y desarrollo de interfaces conversacionales para aplicaciones móviles.Un aspecto clave de esta tecnología consiste en realizar un correcto modelado del usuario. Por este motivo, discutimos diversos modelos afectivos, de personalidad y contextuales. Finalmente, comentamos algunas líneas de investigación actuales relacionadas con la comunicación verbal, interacción multimodal y gestión del diálogo.Palabras clave: diálogo; comprensión del lenguaje; gestión del diálogo; generación del lenguaje natural; síntesis del habla.

show abstract

“…The minimal unit of processing in such systems is the "utterance", which is processed in whole by each module of the system before it is handed on to the next. Contrary to this, Jindigo processes the dialog incrementally, word by word, allowing the system to respond more quickly and to give and receive feedback in the middle of utterances [28].…”

Section: Dialog Systemmentioning

confidence: 99%

Enhanced directional self-assembly based on active recruitment and guidance

Christensen¹,

O’Grady²,

Retornaz³

et al. 2011

2011 IEEE/RSJ International Conference on Intelligent Robots and Systems

View full text Add to dashboard Cite

We propose a novel human-robot-interaction framework for robust visual scene understanding. Without any a-priori knowledge about the objects, the task of the robot is to correctly enumerate how many of them are in the scene and segment them from the background. Our approach builds on top of state-of-the-art computer vision methods, generating object hypotheses through segmentation. This process is combined with a natural dialog system, thus including a 'human in the loop' where, by exploiting the natural conversation of an advanced dialog system, the robot gains knowledge about ambiguous situations. We present an entropy-based system allowing the robot to detect the poorest object hypotheses and query the user for arbitration. Based on the information obtained from the human-robot dialog, the scene segmentation can be re-seeded and thereby improved. We present experimental results on real data that show an improved segmentation performance compared to segmentation without interaction.

show abstract

A General, Abstract Model of Incremental Dialogue Processing

Cited by 56 publications

References 14 publications

Temporal alignment using the incremental unit framework

Temporal alignment using the incremental unit framework

Review of spoken dialogue systems

Enhanced directional self-assembly based on active recruitment and guidance

Contact Info

Product

Resources

About