SmartWeb Handheld — Multimodal Interaction with Ontological Knowledge Bases and Semantic Web Services

Abstract

SMARTWEB aims to provide intuitive multimodal access to a rich selection of Web-based information services. We report on the current prototype with a smartphone client interface to the Semantic Web. An advanced ontology-based representation of facts and media structures serves as central description for rich media content. Underlying content is accessed through conventional web service middleware to connect the ontological knowledge base and an intelligent web service composition module for external web services, which is able to translate between ordinary XML-based data structures and explicit semantic representations for user queries and system responses. The presentation module renders the media content and the results generated from the services and provides a detailed description of the content and its layout to the fusion module. The user is then able to employ multiple modalities, like speech and gestures, to interact with the presented multimedia material in a multimodal way.

Adaptive systems in the era of the semantic and social web, a survey

“…Appendix B: List of the adaptive systems we considered in the survey ADAPT2 framework (Brusilovsky et al 2005) AutoTag (Mishne 2006) Bibster (Haase et al 2005) Carmagnola and Dimitrova (2008) Cena and Furnari (2008) CHIME framework (Chepegin et al 2003) Schwarzkopf et al (2007) SenSee framework and iFanzy application (Bellekens et al 2007) Smart Tag Recommender (Basile et al 2007) SmartWeb (Sonntag et al 2007) Shepitsen et al (2008) Szomszor et al (2008 TANGRAM (Jovanovic et al 2006) TBCF Trust-Aware Recommender (Ziegler and Lausen 2004) TrustProject (Golbeck and Mannes 2006) UbisWord/GUMO (Heckmann 2005) Wang et al (2008 Yahoo! MyWeb 2.0 (Xu et al 2006) …”

“…The descriptions of the Web Services, expressed in WSDL, are extended with OWL. SmartWeb (Sonntag et al 2007), a follow-up of SmartKom (Wahlster 2006), is a wide-range project that focuses on the development of multimodal user interfaces to distributed and composable Semantic Web Services on mobile devices. The ontological infrastructure is composed of a Top-Level Ontology (SUMO plus DOLCE), coupled to domain-specific ontologies.…”

OntoWiki Mobile – Knowledge Management in Your Pocket

“…There are a few publications which review the state of the mobile Semantic Web and the possibilities thereof to improve mobile Web (e. g. [3]). Also, there are publications on more complex topics like Semantic Web system for mobile devices named SmartWeb [11] which uses semantic technologies in combination with device specific input capabilities (e. g. voice input) to enhance mobile web services. On the frontend side there are semantic mobile applications like DBpedia Mobile [1] or mSpace Mobile [14] that implement or utilize the Semantic Web technologies directly on mobile devices.…”

“…There are already a number of mobile semantic applications ranging from semantic backend services [11] for mobile devices to applications covering very specific use cases (e. g. DBpedia Mobile [1] or mSpace Mobile [14]). OntoWiki Mobile, however, is a generic, application domain agnostic tool, which can be utilized in a wide range of very different usage scenarios ranging from instance acquisition to browsing of semantic data on the go.…”

A Discourse and Dialogue Infrastructure for Industrial Dissemination

“…Thereby, hub-and-spoke dialogue frameworks played a major role [18]. We also learned some lessons which we use as guidelines in the development of semantic dialogue systems [12,23]; over the last years, we have adhered strictly to the developed rule "No presentation without representation." The idea is to implement a generic, and semantic, dialogue shell that can be configured for and applied to domain-specific dia-logue applications.…”