Spatial ontology for semantic integration in 3D multimodal interaction framework

Irawati, Sylvia; Calderón, Daniela; Ko, Heedong

doi:10.1145/1128923.1128944

Cited by 15 publications

(11 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…It's also used dated events and a synchronization system to process them adequately. Irawati et al also proposed a multimodal framework [5] and they defined one interesting component: the interaction manager. The interaction manager has been designed to integrate the interpretation results of multimodal to be a single complete interpretation.…”

Section: Related Workmentioning

confidence: 99%

A Framework for Designing Adaptative Systems in VR Applications

Boudoin

Otmane

Mallem

et al. 2009

2009 6th IEEE Consumer Communications and Networking Conference

View full text Add to dashboard Cite

Abstract-VR systems need more and more sensors to provide the most efficient 3D interaction in the virtual world. With the multiplication of sensors in these systems, new constraints emerged, especially how to process the huge amount of incoming data and how to estimate a correct interpretation from it. However data processing is often a complex approach. In this paper, we present to you a framework that can be used such an upper-layer on the hardware layer to provide data processing and data fusion to a virtual reality application.

show abstract

Section: Related Workmentioning

confidence: 99%

A Framework for Designing Adaptative Systems in VR Applications

Boudoin

Otmane

Mallem

et al. 2009

2009 6th IEEE Consumer Communications and Networking Conference

View full text Add to dashboard Cite

show abstract

“…The Sylvia Irawati's team [1] proposed a complete framework. The most interesting part is their using of objects ontology to make the interaction more natural and user-friendly.…”

Section: Related Workmentioning

confidence: 99%

“…IBISC laboratory owns a semi-immersive VR/AR multimodal platform called EVR@ 1 . It permits stereoscopic display, wireless hand/head gesture tracking and force feedback.…”

Section: System Description 31 Hardware and Software Of The Evr@ Plamentioning

confidence: 99%

See 1 more Smart Citation

Towards multimodal human-robot interaction in large scale virtual environment

Boudoin

Domingues

Otmane

et al. 2008

Proceedings of the 3rd ACM/IEEE International Conference on Human Robot Interaction

View full text Add to dashboard Cite

Human Operators (HO) of telerobotics systems may be able to achieve complex operations with robots. Designing usable and effective Human-Robot Interaction (HRI) is very challenging for system developers and human factors specialists. The search for new metaphors and techniques for HRI adapted to telerobotics systems emerge on the conception of Multimodal HRI (MHRI). MHRI allows to interact naturally and easily with robots due to combination of many devices and an efficient Multimodal Management System (MMS). A system like this should bring a new user's experience in terms of natural interaction, usability, efficiency and flexibility to HRI system. So, a good management of multimodality is very. Moreover, the MMS must be transparent to user in order to be efficient and natural.Empirical evaluation is necessary to have an idea about the goodness of our MMS. We will use an Empirical Evaluation Assistant (EEA) designed in the IBISC laboratory. EEA permits to rapidly gather significant feedbacks about the usability of interaction during the development lifecycle. However the HRI would be classically evaluated by ergonomics experts at the end of its development lifecycle.Results from a preliminary evaluation on a robot teleoperation tasks using the ARITI software framework for assisting the user in piloting the robot, and the IBISC semi-immersive VR/AR platform EVR@, are given. They compare the use of a Flystick and Data Gloves for the 3D interaction with the robot. They show that our MMS is functional although multimodality used in our experiments is not sufficient to provide an efficient Human-Robot Interaction. The EVR@ SPIDAR force feedback will be integrated in our MMS to improve the user's efficiency.

show abstract

“…Therefore, depending on the application a new speech grammar has to be created. (Irawati, Calderón, & Ko, 2005;Irawati, Calderón, & Ko, 2006) use semantic virtual environment information which is divided into domain dependent and independent information, which is represented through ontologies. The authors claim that in their solution domain dependent information is specific to the application while their domain independent information remains static.…”

Section: Related Workmentioning

confidence: 99%