Multimodal Fusion and Fission within W3C Standards for Nonverbal Communication with Blind Persons

Schnelle-Walka, Dirk; Radomski, Stefan; Mühlhäuser, Max

doi:10.1007/978-3-319-08596-8_33

Cited by 3 publications

(1 citation statement)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Also supporting our viewpoint are [17]: "Multimodal fission is a research topic that is not often addressed in the scientific community.". In the few cases where the fission process is presented, the systems are very simple [18] and the user is limited to some predefined instructions.…”

Section: Related Workmentioning

confidence: 99%

Prototyping using a Pattern Technique and a Context-Based Bayesian Network in Multimodal Systems

Zaguia

Tadj

Ramdane-Chérif

2015

International Journal on Smart Sensing and Intelligent Systems

View full text Add to dashboard Cite

Abstract-Today, technology allows us to produce extensive multimodal systems which are totally under human control. These systems are equipped with multimodal interfaces, which enable more natural and more efficient interaction between man and machine. End users can take advantage of natural modalities (e.g. audio, eye gaze, speech, gestures, etc.) to communicate or exchange information with applications. In this work, we assume that a number of these modalities are available to the user. In this paper, we present a prototype of a multimodal architecture, and show how modality selection and fission algorithms are implemented in such a system. We use a pattern technique to divide a complex command into elementary subtasks and select suitable modalities for each of them. We integrate a context-based method using a Bayesian network to resolve ambiguous or uncertain situations.

show abstract

Section: Related Workmentioning

confidence: 99%

Prototyping using a Pattern Technique and a Context-Based Bayesian Network in Multimodal Systems

Zaguia

Tadj

Ramdane-Chérif

2015

International Journal on Smart Sensing and Intelligent Systems

View full text Add to dashboard Cite

show abstract

Multimodal Fusion and Fission within the W3C MMI Architectural Pattern

Schnelle-Walka

Duarte

Radomski

2016

Multimodal Interaction With W3C Standards

View full text Add to dashboard Cite

Modern Standards for VoiceXML in Pervasive Multimodal Applications

Schnelle-Walka

Radomski

Mühlhäuser

Advances in Wireless Technologies and Telecommunication

View full text Add to dashboard Cite

In this chapter, we will consider the language support of VoiceXML 2.1 to express flexible dialogs in pervasive environments. Missing information about the environment and the inability to react to external events lead to rigid and verbose dialogs. But building upon the recently defined W3C MMI architecture we present an approach where dialog authors can adapt their dialogs' behavior with regard to the users' surroundings and incorporate available information and devices from the pervasive environment. Adding these features extends the expressiveness of VoiceXML 2.1, and allows for an integration into a multimodal and mobile interaction as anticipated in the, as of now, dormant VoiceXML 3.0 standard.

show abstract

Multimodal Fusion and Fission within W3C Standards for Nonverbal Communication with Blind Persons

Cited by 3 publications

References 10 publications

Prototyping using a Pattern Technique and a Context-Based Bayesian Network in Multimodal Systems

Prototyping using a Pattern Technique and a Context-Based Bayesian Network in Multimodal Systems

Multimodal Fusion and Fission within the W3C MMI Architectural Pattern

Modern Standards for VoiceXML in Pervasive Multimodal Applications

Contact Info

Product

Resources

About