Designing Mobile Multimodal Applications

Sá, Marco de; Duarte, Carlos; Carriço, Luís; Reis, Tiago

doi:10.4018/978-1-60566-978-6.ch005

Cited by 7 publications

(4 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In particular, feedback multimodality in mobile device operation improves usability and expressiveness [8]. It also provides a more flexible way for users to better perceive and avoid errors [9]. Research has shown that multimodal feedback positively impacts performance, perceived effort, error correction/avoidance, and error reaction time [10][11][12][13].…”

Section: Related Work and Contextualizationmentioning

confidence: 99%

Assessing the Influence of Multimodal Feedback in Mobile-Based Musical Task Performance

Clement

Bernardes

2022

MTI

View full text Add to dashboard Cite

Digital musical instruments have become increasingly prevalent in musical creation and production. Optimizing their usability and, particularly, their expressiveness, has become essential to their study and practice. The absence of multimodal feedback, present in traditional acoustic instruments, has been identified as an obstacle to complete performer–instrument interaction in particular due to the lack of embodied control. Mobile-based digital musical instruments present a particular case by natively providing the possibility of enriching basic auditory feedback with additional multimodal feedback. In the experiment presented in this article, we focused on using visual and haptic feedback to support and enrich auditory content to evaluate the impact on basic musical tasks (i.e., note pitch tuning accuracy and time). The experiment implemented a protocol based on presenting several musical note examples to participants and asking them to reproduce them, with their performance being compared between different multimodal feedback combinations. Collected results show that additional visual feedback was found to reduce user hesitation in pitch tuning, allowing users to reach the proximity of desired notes in less time. Nonetheless, neither visual nor haptic feedback was found to significantly impact pitch tuning time and accuracy compared to auditory-only feedback.

show abstract

Section: Related Work and Contextualizationmentioning

confidence: 99%

Assessing the Influence of Multimodal Feedback in Mobile-Based Musical Task Performance

Clement

Bernardes

2022

MTI

View full text Add to dashboard Cite

show abstract

“…The obtrusiveness level determines the type of interaction that has to be offered to the user. Thus, the appropriate use of a modality or modality combinations can play a crucial role, attenuating the required attention [37]. To define the interaction variability of the mobile device according to the obtrusiveness levels, we use a feature model (FM) [38].…”

Section: Linking To Interaction Resourcesmentioning

confidence: 99%

Self-adaptive unobtrusive interactions of mobile computing systems

Gil

Pelechano

2017

AIS

View full text Add to dashboard Cite

In Pervasive Computing environments, people are surrounded by a lot of embedded services. Since pervasive devices, such as mobile devices, have become a key part of our everyday life, they enable users to always be connected to the environment, making demands on one of the most valuable resources of users: human attention. A challenge of the mobile computing systems is regulating the request for users' attention. In other words, service interactions should behave in a considerate manner by taking into account the degree to which each service intrudes on the user's mind (i.e., the degree of obtrusiveness). The main goal of this paper is to introduce self-adaptive capabilities in mobile computing systems in order to provide non-disturbing interactions. We achieve this by means of an software infrastructure that automatically adapts the service interaction obtrusiveness according to the user's context. This infrastructure works from a set of high-level models that define the unobtrusive adaptation behavior and its implication with the interaction resources in a technology-independent way. Our infrastructure has been validated through several experiments to assess its correctness, performance, and the achieved user experience through a user study.

show abstract

“…Several policy measures have been proposed for promoting multimodal transportation, mainly by disincentivising private vehicle usage and promoting public transport and active mobility [20], while many research projects and initiatives have been led to foster modal interchange in the European context [21]. Moreover, the role of technological enablers for enhancing multimodal transport (e.g., ICT-enabled web, mobile, and big data applications) has been largely investigated, underlining the interest of research in this field [22][23][24].…”

Section: Introductionmentioning

confidence: 99%

Assessing the Performance of Modal Interchange for Ensuring Seamless and Sustainable Mobility in European Cities

et al. 2021

View full text Add to dashboard Cite

In the European Union, more than 70% of the population lives in urban areas. Achieving more efficient and low-carbon mobility is crucial to ensuring urban systems are sustainable and tackling important challenges, such as reduction of CO2 emissions, air and noise pollution, and traffic congestion. Identifying effective strategies and design solutions that boost multimodal mobility and effective interchange among different sustainable means of transport can be a significant contribution in this area. This paper presents an easy-to-use methodology to assess the performance of policy measures and design solutions-oriented to foster modal interchange, with special regard to the configuration of the interchange hubs. The methodology is based on identifying key factors necessary to ensure an efficient multimodal interchange and the different types of interchanges that are frequently present in the urban realm. By grouping the key factors into nine different domains, and by weighing the key factors in relation to their importance, the methodology creates a decision support system to assess the performance of the current interchange, as well as of different planning and design scenarios. This methodology has been developed in the framework of the Interreg Europe MATCH-UP project and is conceived to support both designers and decision-makers whenever they have to reorganise existing transport hubs and policies, or design and plan new ones.

show abstract

Designing Mobile Multimodal Applications

Cited by 7 publications

References 38 publications

Assessing the Influence of Multimodal Feedback in Mobile-Based Musical Task Performance

Assessing the Influence of Multimodal Feedback in Mobile-Based Musical Task Performance

Self-adaptive unobtrusive interactions of mobile computing systems

Assessing the Performance of Modal Interchange for Ensuring Seamless and Sustainable Mobility in European Cities

Contact Info

Product

Resources

About