Using Augmented Virtuality for Remote Collaboration

Abstract

This paper describes the concept, prototypical implementation, and usability evaluation of the Augmented Virtuality (AV)-based videoconferencing (VC) system cAR/PE!. We present a solution that allows three participants at different locations to communicate over a network in an environment simulating a traditional face-to-face meeting. Integrated into the AV environment are live video streams of the participants spatially arranged around a virtual table, a large virtual presentation screen for 2D display and application sharing, and 3D geometry (models) within the room and on top of the table. We describe the general concept and application scenario as well as the actual hardware setup, the implementation, and the use of the system in its current state. Results of two usability studies with 87 subjects are presented that show the general usability of our approach as well as good overall satisfaction. Parts of the work described here were presented as a poster at the second International Symposium on Mixed and Augmented Reality (Regenbrecht, Ott, Wagner, Lum, Kohler, et al., 2003. An Augmented Virtuality Approach to 3D Videoconferencing. Poster at 2nd Int. Symp. on Mixed and Aug. Reality, Tokyo.).

Mutually Augmented Virtual Environments for Architectural Design and Collaboration

“…The AR example (Wang et al 2005) shown in Figure 2 actually corresponds to the node "a" (RV) in the Figure 3 because a virtual mechanical design is inserted into the designers' common real working/viewing environment. The AV example (Regenbrecht et al 2004) in Figure 2, actually fits to the case of node "b" + "e" (VR+VV) on the same level, but under the same previous mega-space because there are two types of subspaces inserted into the base environment "d": real video image of remote collaborators for node "b" (VR) and virtual car product design for node "e" (VV). Two segmented spaces in two independent/individual mega-spaces could also metaphorically augment with each other although they are not structurally located along one path in the recursive hierarchical MA construction.…”

“…This paper presents a systematic framework of exploring Mutual Augmentation and applying this concept to support collaboration, communication, and coordination of architectural design beyond single real/virtual space. Augmented Virtuality system (Regenbrecht et al 2004) The concept of structured MA mega-space also opens up a key direction for future research into collaborative virtual environments (CVEs), AR and AV. This paper seeks to investigate how the concept of Mutual Augmentation could be integrated into the traditional CVEs concepts and development to improve the practice of designing in virtual environments.…”

An experimental study of spatial sound usefulness in searching and navigating through AR environments

“…Findings, reported by Regenbrecht et al (2004), showed also that 3D sound was an important element of a video conferencing system (cAR/PE!). Authors presented a prototype which comprises live video streams of the participants arranged around a virtual table with spatial sound support.…”

Shared Design Space: Sketching Ideas Using Digital Pens and a Large Augmented Tabletop Setup

“…Researchers such as Ishii [7] have explored the use of tangible object interfaces for tabletop collaboration, while Streitz et al [8] use natural gesture and object based interaction in their i-Land smart space. Regenbrecht et al extend the idea of tangible user interfaces and demonstrates the benefits in novel video conference system [9]. In many interfaces there is a shared projected display visible by all participants; however, collaborative spaces can also support private data viewing.…”