VR-Based Job Training System Using Tangible Interactions

Abstract

Virtual training systems are in an increasing demand because of real-world training, which requires a high cost or accompanying risk, and can be conducted safely through virtual environments. For virtual training to be effective for users, it is important to provide realistic training situations; however, virtual reality (VR) content using VR controllers for experiential learning differ significantly from real content in terms of tangible interactions. In this paper, we propose a method for enhancing the presence and immersion during virtual training by applying various sensors to tangible virtual training as a way to track the movement of real tools used during training and virtualizing the entire body of the actual user for transfer to a virtual environment. The proposed training system connects virtual and real-world spaces through an actual object (e.g., an automobile) to provide the feeling of actual touch during virtual training. Furthermore, the system measures the posture of the tools (steam gun and mop) and the degree of touch and applies them during training (e.g., a steam car wash.) User-testing is conducted to validate the increase in the effectiveness of virtual job training.

Digital twin for multi-scenario emergency of railway passenger stations

“…The advancement of computer technology has facilitated the integration of 3D technology in skill training programs, including automobile maintenance training [37], railway axle disc brake maintenance [38], tunnel fire emergency drills [39], ship fire emergency drills [40], railway workers' skill training [41], and train crew management [42]. The use of 3D technology enables the creation of a natural world in the information space that dynamically simulates disaster occurrences with negative outcomes, such as damages, losses, injuries, and fatalities.…”

Physics-Based Simulation of Soft-Body Deformation Using RGB-D Data

“…Providing interactions between an observed object and a virtual model in an immersive environment in real time has drawn considerable attention in the virtual training fields [ 1 ]. For example, the use of virtual training simulations enables users to practice operations in an efficient and safe way [ 2 , 3 ]. However, most current systems simulate only flat and solid objects.…”