Enabling accessibility through multimodality?

Himmelsbach, Julia; Garschall, Markus; Egger, Sebastian; Steffek, Susanne; Tscheligi, Manfred

doi:10.1145/2836041.2836060

Cited by 13 publications

(4 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When considering architectural perspectives for textual personalization, the realization of the information can vary greatly both across different individuals and within the same individual. In their work, following a survey on communication preferences in adults, Himmelsbach et al (2015) concluded the due to high variation, it is generally recommended to support several modalities of communication, showing that there is no one size fits all approach.…”

Section: Architectures For Personalizationmentioning

confidence: 99%

Refocusing on Relevance: Personalization in NLG

Dudy¹,

Bedrick²,

Webber³

2021

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing

View full text Add to dashboard Cite

Many NLG tasks such as summarization, dialogue response, or open domain question answering focus primarily on a source text in order to generate a target response. This standard approach falls short, however, when a user's intent or context of work is not easily recoverable based solely on that source texta scenario that we argue is more of the rule than the exception. In this work, we argue that NLG systems in general should place a much higher level of emphasis on making use of additional context, and suggest that relevance (as used in Information Retrieval) be thought of as a crucial tool for designing user-oriented text-generating tasks. We further discuss possible harms and hazards around such personalization, and argue that value-sensitive design represents a crucial path forward through these challenges.

show abstract

Section: Architectures For Personalizationmentioning

confidence: 99%

Refocusing on Relevance: Personalization in NLG

Dudy¹,

Bedrick²,

Webber³

2021

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing

View full text Add to dashboard Cite

show abstract

“…Multimodal interfaces have been considered to improve accessibility for a number of users and usage contexts (Obrenovic, Abascal, and Starcevic 2007), including the diverse needs of older users (Himmelsbach et al 2015;Munteanu and Salah 2017).…”

Section: Multimodal Interaction For Older Usersmentioning

confidence: 99%

“…Multimodal systems can integrate a wider range of modalities (such as speech, writing, gaze, touch or mid-air gestures) and potentially better accommodate users' preferences with respect to unimodal interfaces. Furthermore, people who have little or no experience with common computer devices can find multimodal interfaces more user-friendly since they offer the possibility to use multiple interaction channels instead of relying on a single source of input (Himmelsbach et al 2015). However, other studies point out that multimodality must be carefully introduced since it might require more cognitive effort to coordinate different input modalities (especially when more than two modalities are involved) and additional physical demand (Naumann, Wechsung, and Hurtienne 2010).…”

Section: Multimodal Interaction For Older Usersmentioning

confidence: 99%

Trade-offs in the design of multimodal interaction for older adults

Schiavo

Mich

Ferron

et al. 2020

Behaviour & Information Technology

View full text Add to dashboard Cite

This paper presents key aspects and trade-offs that designers and Human-Computer Interaction practitioners might encounter when designing multimodal interaction for older adults. The paper gathers literature on multimodal interaction and assistive technology, and describes a set of design challenges specific for older users. Building on these main design challenges, four trade-offs in the design of multimodal technology for this target group are presented and discussed. To highlight the relevance of the trade-offs in the design process of multimodal technology for older adults, two of the four reported trade-offs are illustrated with two user studies that explored mid-air and speech-based interaction with a tablet device. The first study investigates the design trade-offs related to redundant multimodal commands in older, middle-aged and younger adults, whereas the second one investigates the design choices related to the definition of a set of mid-air one-hand gestures and voice input commands. Further reflections highlight the design trade-offs that such considerations bring in the process, presenting an overview of the design choices involved and of their potential consequences.

show abstract

“…In fact, some previous studies explored the factors influencing the choice among different modalities such as speech, text, and gestures. Factors such as efficiency, accuracy, privacy and security (Himmelsbach et al, 2015), user characteristics (Dumas et al, 2009;Ghosh and Joshi, 2013;Schüssel et al, 2013;Schaffer et al, 2015), attitudes toward technology, and quality perceptions and personality factors (Wechsung, 2014) have been shown to impact modality selection. Jian et al (2013) demonstrated the potential of multimodal interaction (interacting with multiple modalities such as text and speech) for older adults.…”

mentioning

confidence: 99%

Older adults' perspectives on multimodal interaction with a conversational virtual coach

El Kamali,

Angelini,

Lalanne

et al. 2023

Front. Comput. Sci.

View full text Add to dashboard Cite

IntroductionThe use of multiple interfaces may improve the perception of a stronger relationship between a conversational virtual coach and older adults. The purpose of this paper is to show the effect of output combinations [single-interface (chatbot, tangible coach), multi-interface (assignment, redundant-complementary)] of two distinct conversational agent interfaces (chatbot and tangible coach) on the eCoach-user relationship (closeness, commitment, complementarity) and the older adults' feeling of social presence of the eCoach.MethodsOur study was conducted with two different study settings: an online web survey and a face to face experiment.ResultsOur online study with 59 seniors shows that the output modes in multi-interface redundant-complementary manner significantly improves the eCoach-user relationship and social presence of the eCoach compared to only using single-interfaces outputs. Whereas in our face to face experiment with 15 seniors, significant results were found only in terms of higher social presence of multi-interface redundant complementary manner compared to chatbot only.DiscussionWe also investigated the effect of each study design on our results, using both quantitative and qualitative methods.

show abstract

Enabling accessibility through multimodality?

Cited by 13 publications

References 18 publications

Refocusing on Relevance: Personalization in NLG

Refocusing on Relevance: Personalization in NLG

Trade-offs in the design of multimodal interaction for older adults

Older adults' perspectives on multimodal interaction with a conversational virtual coach

Contact Info

Product

Resources

About