Physically Plausible Realistic Grip-Lift Interaction Based on Hand Kinematics in VR

Abstract

Immersive technology, refers to various novel ways of creating and interacting with applications and experiences, e.g., virtual reality (VR), has been used in various simulations and training where preparing real/physical settings is not ideal or possible, or where the use of virtual contents is otherwise beneficial. Realizing realistic interactions with virtual content is crucial for a quality experience and the effectiveness of such simulation and training. In this paper, we propose a kinematics-based realistic hand interaction method to enable a physically plausible grip-lifting experience in VR. The method reflects three kinematic characteristics of the hand: the force at contact points, finger flexion, and the speed of hand/finger motion, and we developed a grip-lift interaction prototype using the proposed method. To examine the sense of realism and hand poses during the grip-lift interaction, we conducted a human subjects experiment using the prototype, resulting in positive effects on the perceived realism and usefulness of the interaction. Grip-lifting is a fundamental interaction technique that is involved in most embodied interaction scenarios. Our method would contribute to the design and development of realistic virtual experiences, of which we will discuss the implications and potential based on our findings.