Interacting With a Large Virtual Environment by Combining a Ground-Based Haptic Device and a Mobile Robot Base

Abstract

Ground-based haptic devices provide the capability of adding force feedback to virtual environments; however, the physical workspace of such devices is very limited due to the fixed base. By mounting a haptic device on a mobile robot, rather than a fixed stand, the reachable volume can be extended to function in fullscale virtual environments. This work presents the hardware, software, and integration developed to use such a mobile base with a Haption Virtuose™ 6D35-45. A mobile robot with a Mecanum-style omni-directional drive base and an Arduino-compatible microcontroller development board communicates with software on a host computer to provide a VRPN-based control and data acquisition interface. The position of the mobile robot in the physical space is tracked using an optical tracking system. The SPARTA virtual assembly software was extended to 1) apply transformations to the haptic device data based on the tracked base position, and 2) capture the error between the haptic device's end effector and the center of its workspace and command the robot over VRPN to minimize this error. The completed system allows use of the haptic device in a wide area projection screen or head-mounted display virtual environment, providing smooth free-space motion and stiff display of forces to the user throughout the entire space. The availability of haptics in large immersive environments can contribute to future advances in virtual assembly planning, factory simulation, and other operations where haptics is an essential part of the simulation experience. Disciplines Graphics and Human Computer Interfaces | Mechanical Engineering ABSTRACTGround-based haptic devices provide the capability of adding force feedback to virtual environments; however, the physical workspace of such devices is very limited due to the fixed base. By mounting a haptic device on a mobile robot, rather than a fixed stand, the reachable volume can be extended to function in full-scale virtual environments. This work presents the hardware, software, and integration developed to use such a mobile base with a Haption Virtuose™ 6D35-45. A mobile robot with a Mecanum-style omni-directional drive base and an Arduino-compatible microcontroller development board communicates with software on a host computer to provide a VRPNbased control and data acquisition interface. The position of the mobile robot in the physical space is tracked using an optical tracking system. The SPARTA virtual assembly software was extended to 1) apply transformations to the haptic device data based on the tracked base position, and 2) capture the error between the haptic device's end effector and the center of its workspace and command the robot over VRPN to minimize this error. The completed system allows use of the haptic device in a wide area projection screen or head-mounted display virtual environment, providing smooth free-space motion and stiff display of forces to the user throughout the entire space. The availability of haptics in large immersive environments can cont...

Virtual assembly with physical information: a review

“…On the other hand, the haptic feedback comes in a very limited fidelity. Despite efforts to expand the haptic effect scope made by researchers (Pavlik et al, 2013), in most systems, only a small part of the body can be involved in the haptic interaction. The force is usually calculated for one single point and outputted through the end effector to the whole hand.…”

Interacting With Grasped Objects in Expanded Haptic Workspaces Using the Bubble Technique

“…Some devices, such as the SPIDAR, are specifically designed for large workspaces without modification [3]. Other techniques involve physical modifications to the haptic device, which allow the device to travel within the virtual environment [4][5][6][7][8][9][10]. The focus of this paper is on increasing the haptic workspace of a fixed-base haptic device, such as the Haption Virtuose TM 6D35-45 in a CAVE with displays on two walls plus the floor as shown in Fig.…”

Exploring the role of large-scale immersive computing environments in collaboration between engineering and design students

“…LSICEs have seen notable adoption at many educational institutions including the C6 (Kihonge et al, 2002) and METaL (Pavlik et al, 2013) at Iowa State University, Immersia 3 (Pontonnier et al, 2014) at The University of Rennes, CAVE2 (Febretti et al, 2013) at the University of Illinois at Chicago, AlloSphere (Amatriain et al, 2009) at the University of California, Santa Barbara, StarCAVE (DeFanti et al, 2009) at the University of California, San Diego, Reality…”