Mixed reality participants in smart meeting rooms and smart home environments

Abstract

Human-computer interaction requires modeling of the user. A user profile typically contains preferences, interests, characteristics, and interaction behavior. However, in its multimodal interaction with a smart environment the user displays characteristics that show how the user, not necessarily consciously, verbally and nonverbally provides the smart environment with useful input and feedback. Especially in ambient intelligence environments we encounter situations where the environment supports interaction between the environment, smart objects (e.g., mobile robots, smart furniture) and human participants in the environment. Therefore it is useful for the profile to contain a physical representation of the user obtained by multi-modal capturing techniques. We discuss the modeling and simulation of interacting participants in a virtual meeting room, we discuss how remote meeting participants can take part in meeting activities and they have some observations on translating research results to smart home environments.

iWorlds: Building Mixed Reality Intelligent Environments Using Customisable 3D Virtual Worlds

“…In the case of an intelligent building, using a three-dimensional simulation allows users to view the virtual world from a first-person perspective, rather than a top-down third-person view [5]. Alternatively a three-dimensional world could be viewed from a third-person perspective but from an angle placing the observer inside the environment, (as used in worlds such as virtual meeting rooms [12]). Both methods take advantage of the immersive properties of a three-dimensional virtual world, increasing realism by providing the sensation of being in a physical intelligent environment.…”

Adaptive Architecture: regulating human building interaction

“…His seminal text also ushered in a new era of computing research called Ambient Intelligence. As stated, for example, by (Nijholt, Zwiers, and Peciva 2009), Ambient Intelligence requires the constant creation and maintenance of user profiles, which typically contain the user's "preferences, interests, characteristics, and interaction behaviour". Obtaining such personal data can be achieved through active input by the user, remote sensing, and machine learning.…”

iWorlds: Generating artificial control systems for simulated humans using virtual worlds and intelligent environments

“…If necessary the three dimensional world could also be viewed from a thirdperson perspective, with a camera angle set behind a virtual embodiment of the user, allowing the immersive impression of being 'inside' the environment to be preserved. This approach is commonly used in projects such as virtual meeting rooms, where it is necessary for a person to know the location of other world users relative to their own position [25].…”