A Multimodal In-Car Dialogue System That Tracks The Driver's Attention

Kousidis, Spyros; Kennington, Casey; Baumann, Timo; Buschmeier, Hendrik; Kopp, Stefan; Schlangen, David

doi:10.1145/2663204.2663244

Cited by 19 publications

(9 citation statements)

References 23 publications

(17 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Such approaches are characterised by utilising dedicated system actions to deal with certain conditions, such as reacting to a angry user by asking what is wrong. Gnjatović et al [5], for example, present a DM that adjusts the kind of support given to the user to their emotional state, and an in-car dialogue system implemented by Kousidis et al [7] adapts to situations that require the full attention of the driver by pausing the conversation entirely. Saerbeck et al [8] vary the social supportiveness of a robotic tutor by using motivational sentences such as 'It was not easy for me either'.…”

Section: Introductionmentioning

confidence: 99%

Exploring the Applicability of Elaborateness and Indirectness in Dialogue Management

Pragst

Minker

Ultes

2018

Lecture Notes in Electrical Engineering

View full text Add to dashboard Cite

In this paper, we investigate the applicability of soft changes to the system behaviour, namely changing the amount of elaborateness and indirectness displayed. To this end, we examine the impact of elaborateness and indirectness on the perception of human-computer communication in a user study. Here, we show that elaborateness and indirectness influence the user's impression of a dialogue and discuss the implications of our results for adaptive dialogue management. We conclude that elaborateness and indirectness offer valuable possibilities for adaptation and should be incorporated in adaptive dialogue management.

show abstract

Section: Introductionmentioning

confidence: 99%

Exploring the Applicability of Elaborateness and Indirectness in Dialogue Management

Pragst

Minker

Ultes

2018

Lecture Notes in Electrical Engineering

View full text Add to dashboard Cite

show abstract

“…Moreover, more descriptive messages that were explicit about upcoming conditions were perceived more positively than shorter, more general messages. Kousidis et al (2014) also investigated dialogue systems in driving simulation tasks, when testing a situationally aware system that refrained from interruptions when higher driver attention was required.…”

Section: Research Topic Sub-topic Totalmentioning

confidence: 99%

The State of Speech in HCI: Trends, Themes and Challenges

Clark

Doyle

Garaialde

et al. 2019

Interacting With Computers

152

View full text Add to dashboard Cite

Speech interfaces are growing in popularity. Through a review of 68 research papers this work maps the trends, themes, findings and methods of empirical research on speech interfaces in HCI. We find that most studies are usability/theory-focused or explore wider system experiences, evaluating Wizard of Oz, prototypes, or developed systems by using self-report questionnaires to measure concepts like usability and user attitudes. A thematic analysis of the research found that speech HCI work focuses on nine key topics: system speech production, modality comparison, user speech production, assistive technology & accessibility, design insight, experiences with interactive voice response (IVR) systems, using speech technology for development, people's experiences with intelligent personal assistants (IPAs) and how user memory affects speech interface interaction. From these insights we identify gaps and challenges in speech research, notably the need to develop theories of speech interface interaction, grow critical mass in this domain, increase design work, and expand research from single to multiple user interaction contexts so as to reflect current use contexts. We also highlight the need to improve measure reliability, validity and consistency, in the wild deployment and reduce barriers to building fully functional speech interfaces for research. Author Keywords Speech interfaces; speech HCI; review; speech technology; voice user interfaces Research Highlights• Most papers focused on usability/theory-based or wider system experience research with a focus on Wizard of Oz and developed systems, though a lack of design work • Questionnaires on usability and user attitudes often used but few were reliable or validated • Thematic analysis showed nine primary research topics • Gaps in research critical mass, speech HCI theories, and multiple user contexts

show abstract

“…Architectural models for multimodal interactive systems have been presented in research papers [38] and [39] as a way of explaining the various components of a given system. More generic ones have also been presented, but they are usually bound to one type of modality such as touch interaction [37] or speech interaction [21].…”

Section: Related Work 21 Software Side Of Interactive Systems Architmentioning

confidence: 99%

MIODMIT: A Generic Architecture for Dynamic Multimodal Interactive Systems

Cronel

Dumas

Palanque

et al. 2018

Lecture Notes in Computer Science

View full text Add to dashboard Cite

This paper proposes a generic interactive system architecture describing in a structured way, both hardware and software components of an interactive system. It makes explicit all the components that play a role in the information processing from input devices to the interactive application and back to the output devices. Along with the generic interactive system architecture the paper proposes a process for selecting and connecting those components in order to tune the generic interactive system architecture for a specific interactive application. This select, connect and tune-on-demand approach helps handle complexity of interactive applications featuring innovative interaction techniques by splitting the interactive software into dedicated functional components. It also supports design flexibility by making explicit the components impacted when the interaction design evolves. This interactive system architecture and its related process have been applied to the development of several real-life interactive systems and we illustrate their application on an interactive application offering multi-mice, multi-touch and leap motion interactions in the context of interactive cockpits of large civil aircrafts.

show abstract

A Multimodal In-Car Dialogue System That Tracks The Driver's Attention

Cited by 19 publications

References 23 publications

Exploring the Applicability of Elaborateness and Indirectness in Dialogue Management

Exploring the Applicability of Elaborateness and Indirectness in Dialogue Management

The State of Speech in HCI: Trends, Themes and Challenges

MIODMIT: A Generic Architecture for Dynamic Multimodal Interactive Systems

Contact Info

Product

Resources

About