Modeling Rules Fission and Modality Selection Using Ontology

Abstract

<p class="MsoNormal"> <span lang="EN-US">Researchers in computer science and computer engineering devote a significant part of their efforts on communication and interaction between man and machine. Indeed, with the advent of multimedia and multimodal processing in real time, the computer is no longer considered only as a computational tool, but as a machine for processing, communi</span><span lang="EN-US">cation, collection and control. Many machines assist and support many activities in daily life. The main objective of this paper is to propose a new methodological solution by modeling an architecture that facilitates the work of multimodal system especially for a fission module. To realize such systems, we rely on ontology to integrate data semantically. Ontologies provide a structured vocabulary usedas support for data representation. This paper provides a better understanding of the fission system and multimodal interaction. We present our architecture and the description of the detection of optimal modalities. This is done by using an ontological model that contains different applicable scenarios and describes the environment where a multimodal system exists.</span><span lang="EN-US"><o:p></o:p></span> </p

Building a dynamic context aware approach for smart e-learning system

“…In this section we present our proposed approach in which modalities [28] invoked by an application are not predefined. A smart selection "interaction context" module is integrated in the context aware model to determine which modalities are suitable to the current user's situation and learning capabilities.…”

Prototyping using a Pattern Technique and a Context-Based Bayesian Network in Multimodal Systems

“…System context: This component detects the computing device that the user is currently using, as well as the important parameters of the computing resource, such as the currently available bandwidth, the network to which the computer is connected, the computer's available memory, the specifications of the battery, and the type of processor and its activities. The fission process is based on the use of the pattern fission technique [20]. These patterns are generally defined as having two parts: problem and solution ( Figure 2).…”

“…Once the fission process is completed, the system sends the result to the appropriate application -stage (7) -and the result is presented to the user in stage (8). The files are transferred from one module to another using the Socket class implemented in Java [20]. Two graphic interfaces are created for the implementation of the prototype: robot control interface ( Figure 8, corresponding to B in Figure 7) and GPS interface ( Figure 9, corresponding to A in Figure 7).…”

“…We present these challenges summary form only in this paper. For more details, please refer to [19], [20], and [21].…”

“…The fission process is based on the use of the pattern fission technique [20]. These patterns are generally defined as having two parts: problem and solution (Figure 2).…”