Context-Aware Querying for Multimodal Search Engines

Etzold, Jonas; Brousseau, Arnaud; Grimm, Paul; Steiner, Thomas

doi:10.1007/978-3-642-27355-1_77

Cited by 8 publications

(6 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Of course, a lot of effort is being made to integrate various elements of interaction and develop new protocols and architectures that allow their use [2,5,8]. In fact, the W3C has a specific group for this work [7,12].…”

Section: State Of the Artmentioning

confidence: 99%

Multimodal human-machine interface devices in the cloud

Estrany

Marín

Mascaró

et al. 2017

J Multimodal User Interfaces

View full text Add to dashboard Cite

In an increasingly connected and multidisciplinary world, we propose a new paradigm of web application development. It makes the whatever modal input to use the same interface to connect to the applications. It can essentially free the web application programmers and the end users from the need of physically handling the data input devices when they are building a multimodal system. The same application can be used for a whole range of physically different peripherals, but similar from the logical point of view of data entry. This paper discusses the implementation of a pilot project, currently in a local network environment, where all the devices in the LAN are identified and described in an interface server. Users in the local network may, upon request, make use of such devices. The communication of these peripherals with the web applications will be carried out by a network of modules that run under the websocket technology. The whole process of communication and connection establishment is automatic and guided by the existing configurations in the interface server. The entire platform runs under SOA strategy and is fully scalable and configurable. Its use is not limited to games because it has much wider possibilities, interactivity in teaching, accessibility for

show abstract

Section: State Of the Artmentioning

confidence: 99%

Multimodal human-machine interface devices in the cloud

Estrany

Marín

Mascaró

et al. 2017

J Multimodal User Interfaces

View full text Add to dashboard Cite

show abstract

“…It uses a JavaScript-based component called UIIFace [4], which enables the user to interact with I-SEARCH via a wide range of modern input modalities like touch, gestures, or speech. Therefore it provides an adaptive algorithm for gesture recognition along with support for novel input devices like Microsofts Kinect in a web environment.…”

Section: Fig 3 Automatic Adaption Of I-search Gui To Different Devimentioning

confidence: 99%

“…Therefore it provides an adaptive algorithm for gesture recognition along with support for novel input devices like Microsofts Kinect in a web environment. The GUI also provides a WebSocket-based collaborative search tool called CoFind [4] that enables users to search collaboratively via a shared results basket, and to exchange messages throughout the search process. A third component called pTag [4] produces personalized tag recommendations to create search queries, filter results and add tags to retrieved result items.…”

Section: Fig 3 Automatic Adaption Of I-search Gui To Different Devimentioning

confidence: 99%

I-SEARCH: A Unified Framework for Multimodal Search and Retrieval

Αξενόπουλος

Daras

Malassiotis

et al. 2012

The Future Internet

Self Cite

View full text Add to dashboard Cite

Abstract. In this article, a unified framework for multimodal search and retrieval is introduced. The framework is an outcome of the research that took place within the I-SEARCH European Project. The proposed system covers all aspects of a search and retrieval process, namely low-level descriptor extraction, indexing, query formulation, retrieval and visualisation of the search results. All I-SEARCH components advance the state of the art in the corresponding scientific fields. The I-SEARCH multimodal search engine is dynamically adapted to end-user's devices, which can vary from a simple mobile phone to a high-performance PC.

show abstract

“…The I-SEARCH graphical user interface (GUI) is implemented with the objective of sharing one common code base for all possible input devices (Subfigure 1b shows mobile devices of different screen sizes and operating systems). It uses a JavaScript-based component called UIIFace [8], which enables the user to interact with I-SEARCH via a wide range of modern input modalities like touch, gestures, or speech. The GUI also provides a WebSocket-based collaborative search tool called CoFind [8] that enables users to search collaboratively via a shared results basket, and to exchange messages throughout the search process.…”

Section: Graphical User Interfacementioning

confidence: 99%

“…It uses a JavaScript-based component called UIIFace [8], which enables the user to interact with I-SEARCH via a wide range of modern input modalities like touch, gestures, or speech. The GUI also provides a WebSocket-based collaborative search tool called CoFind [8] that enables users to search collaboratively via a shared results basket, and to exchange messages throughout the search process. A third component called pTag [8] produces personalized tag recommendations to create, tag, and filter search queries and results.…”

Section: Graphical User Interfacementioning

confidence: 99%