Multimodal instantiation of assistance services

Abstract

Our research focuses in a multimodal model of services for the dynamic composition of interactive features in multimedia. These services primarily do complex multimedia compositions in pervasive semantics systems. We propose a new protocol to enhance UPnP [14] and Bonjour [15] device descriptions with semantic multimodal descriptions and to extend the service discovery to high-level SOA services. This protocol bases on the upper-level ontology DOLCE+DnS Ultralite in conjunction with OWL-S and provides a flexible mean for multimodal rich media composition and context-aware presentation in a SOA architecture based on W3C's Multimodal interaction framework (MMIF).