Incorporating dynamic real objects into immersive virtual environments

Lok, Benjamin; Naik, Srikanth M.; Whitton, Mary C.; Brooks, Frederick P.

doi:10.1145/882262.882332

Cited by 11 publications

(12 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, only [6,5,7] actually run at frame-rates which allow interactivity. Other researchers have focused on implicitly computing the visual hull [8][9][10][11][12]. The main difference to the explicit systems is that they only generate an image of the visual hull from a novel viewpoint without recovering an explicit 3D reconstruction.…”

Section: Related Workmentioning

confidence: 99%

Real-Time 3D Reconstruction for Occlusion-Aware Interactions in Mixed Reality

Ladikos

Navab

2009

Advances in Visual Computing

View full text Add to dashboard Cite

Abstract. In this paper, we present a system for performing real-time occlusion-aware interactions in a mixed reality environment. Our system consists of 16 ceiling-mounted cameras observing an interaction space of size 3.70 m x 3.20 m x 2.20 m. We reconstruct the shape of all objects inside the interaction space using a visual hull method at a frame rate of 30 Hz. Due to the interactive speed of the system, the users can act naturally in the interaction space. In addition, since we reconstruct the shape of every object, the users can use their entire body to interact with the virtual objects. This is a significant advantage over marker-based tracking systems, which require a prior setup and tedious calibration steps for every user who wants to use the system. With our system anybody can just enter the interaction space and start interacting naturally. We illustrate the usefulness of our system through two sample applications. The first application is a real-life version of the well known game Pong. With our system, the player can use his whole body as the pad. The second application is concerned with video compositing. It allows a user to integrate himself as well as virtual objects into a prerecorded sequence while correctly handling occlusions.

show abstract

Section: Related Workmentioning

confidence: 99%

Real-Time 3D Reconstruction for Occlusion-Aware Interactions in Mixed Reality

Ladikos

Navab

2009

Advances in Visual Computing

View full text Add to dashboard Cite

show abstract

“…Lok, Naik, Whitton, and Brooks (2003) performed a study that investigated how handling real objects affects performance and sense of presence in the context of a manual spatial cognitive task. Their results showed better task performance under haptic feedback conditions.…”

Section: Haptic Feedback Presence and Taskmentioning

confidence: 99%

The Influence of Passive Haptic Feedback and Difference Interaction Metaphors on Presence and Task Performance

Viciana-Abad

Reyes‐Lecuona²,

Poyade

2010

Presence: Teleoperators and Virtual Environments

View full text Add to dashboard Cite

This paper explores the influence of passive haptic feedback on presence and task performance using two important interaction metaphors. We compared direct interaction with the user's hand with interaction using a stylus. Twenty-four participants performed a simple selection task consisting of pressing buttons while playing a memory game, with haptic feedback and interaction metaphor as the independent variables. We measured task performance by computing errors and time between button presses. We measured presence with questionnaires and through a new method based on users' involuntary movements. Our results suggest that passive haptic feedback improves both presence and task performance. However, small but significant differences related to the interaction metaphor were only apparent when haptic feedback was not provided.

show abstract

“…In order to achieve this goal, some researchers reconstruct a 3D model of the actor, more in particular a visual hull [11,7]. Others try to avoid creating this virtual structure and perform image based interaction [8,18]. For these techniques, silhouette extraction is an important step and this will be our primary focus.…”

Section: Related Workmentioning

confidence: 99%