Adapting Multimodal Fission to User’s Abilities

Costa, David; Duarte, Carlos

doi:10.1007/978-3-642-21672-5_38

Cited by 19 publications

(2 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…But most research in multimodal systems [12] focus more on the fusion than the fission. We can support our point by "There isn't much research done on fission of output modalities because most application use few different output modalities therefore simple and direct output mechanism are often used" [13]. Also the allocation of output modalities was rather hard coded than based on intelligent system for the early multimodal system.…”

Section: Related Workmentioning

confidence: 77%

Modeling Rules Fission and Modality Selection Using Ontology

Zaguia¹,

Wahbi²,

Miraoui³

et al. 2013

JSEA

View full text Add to dashboard Cite

Researchers in computer science and computer engineering devote a significant part of their efforts on communication and interaction between man and machine. Indeed, with the advent of multimedia and multimodal processing in real time, the computer is no longer considered only as a computational tool, but as a machine for processing, communication, collection and control. Many machines assist and support many activities in daily life. The main objective of this paper is to propose a new methodological solution by modeling an architecture that facilitates the work of multimodal system especially for a fission module. To realize such systems, we rely on ontology to integrate data semantically. Ontologies provide a structured vocabulary usedas support for data representation. This paper provides a better understanding of the fission system and multimodal interaction. We present our architecture and the description of the detection of optimal modalities. This is done by using an ontological model that contains different applicable scenarios and describes the environment where a multimodal system exists.

show abstract

Section: Related Workmentioning

confidence: 77%

Modeling Rules Fission and Modality Selection Using Ontology

Zaguia¹,

Wahbi²,

Miraoui³

et al. 2013

JSEA

View full text Add to dashboard Cite

show abstract

“…The second area of multimodal output generation concerns the use of different modalities and affordances to accommodate different environments, situations, or user tasks and needs. For example, Costa and Duarte (2011) describe a multimodal fission module that adapts the presentation of content through video, audio and haptic outputs for impaired users. Teixeira et al ( 2011) introduce a general architecture for adaptive multimodal fission and its application to a tele-rehabilitation service for the elderly.…”

Section: Agent Output: Coordination Of Multimodal Agent Behaviorsmentioning

confidence: 99%

Report from the NSF Future Directions Workshop, Toward User-Oriented Agents: Research Directions and Challenges

Eskenazi,

Zhao

2020

Preprint

View full text Add to dashboard Cite

This USER Workshop was convened with the goal of defining future research directions for the burgeoning intelligent agent research community and to communicate them to the National Science Foundation. It took place in Pittsburgh Pennsylvania on October 24 and 25, 2019 and was sponsored by National Science Foundation Grant Number IIS-1934222. Any opinions, findings and conclusions or future directions expressed in this document are those of the authors and do not necessarily reflect the views of the National Science Foundation. The 27 participants presented their individual research interests and their personal research goals. In the breakout sessions that followed, the participants defined the main research areas within the domain of intelligent agents and they discussed the major future directions that the research in each area of this domain should take.

show abstract