Multimodal prop-based interaction with virtual mock-up

Abstract

This paper presents a methodology for the efficient integration of CAD models in a physical-based virtual reality simulation that provides the user with multi-modal feedback. User interacts with virtual mock-up using a string-based haptic interface. Hand tracking is realized using a motion capture system. Stereoscopic images are displayed on a 2m x 2.5m retro-projected screen and viewed using polarized glasses. The proposed methodology implemented in a low-cost system, has been validated through an experimental study. Six participants were instructed to remove a car lamp from the virtual mockup and replace it in correct position. A prop was used to provide local haptic sensation related to the car lamp. Three experimental conditions were tested concerning sensory feedback from collisions: (1) no feedback (graphics only), (2) visual feedback and (3) haptic feedback. Results show that visual and haptic feedback allowed to increase performance, as compared with the open-loop case (no feedback), by respectively 17.8 % and 35.2 %.