HapTwist

Zhu, Kening; Chen, Taizhou; Han, Feng; Wu, Yi-Shiun

doi:10.1145/3290605.3300923

Cited by 47 publications

(5 citation statements)

References 44 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Arora et al proposed VirtualBrics technology, a variety of controllers that facilitates a physical operation in a VR environment though LEGO-based tools [9]. Zhu et al compared real tools and a VR controller to confirm whether the tangible interaction is the highest in real tools and developed haptic tools that were like real tools [10]. Shigeyama et al developed Transcalibur, a portable VR controller that can render shapes by changing the mass properties on a two-dimensional plane to provide a realistic tool feeling [11].…”

Section: Related Workmentioning

confidence: 99%

“…Hence, studies have been introduced to add appropriate physical objects for the virtual environment and use them for interaction with users to increase the immersion and situational awareness of the users [4][5][6]. Studies using haptic tools or hand tracking have also been actively conducted to enhance the interaction effect of the user [7][8][9][10][11][12][13]. Some studies have been published to improve the coexistence and mutual dependence between users and other objects in a virtual environment based on the presence of user avatars [14,15].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

VR-Based Job Training System Using Tangible Interactions

Baek

Gil

Kim

2021

Sensors

View full text Add to dashboard Cite

Virtual training systems are in an increasing demand because of real-world training, which requires a high cost or accompanying risk, and can be conducted safely through virtual environments. For virtual training to be effective for users, it is important to provide realistic training situations; however, virtual reality (VR) content using VR controllers for experiential learning differ significantly from real content in terms of tangible interactions. In this paper, we propose a method for enhancing the presence and immersion during virtual training by applying various sensors to tangible virtual training as a way to track the movement of real tools used during training and virtualizing the entire body of the actual user for transfer to a virtual environment. The proposed training system connects virtual and real-world spaces through an actual object (e.g., an automobile) to provide the feeling of actual touch during virtual training. Furthermore, the system measures the posture of the tools (steam gun and mop) and the degree of touch and applies them during training (e.g., a steam car wash.) User-testing is conducted to validate the increase in the effectiveness of virtual job training.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

VR-Based Job Training System Using Tangible Interactions

Baek

Gil

Kim

2021

Sensors

View full text Add to dashboard Cite

show abstract

“…A primary limitation of these devices is their continuous contact with the user's hand, which could detract from the sensation of free-hand interactions and require occasional placement aside for physical-world hand usage. Physical proxies, or encounter-type haptics, are another approach for creating haptic sensations in virtual environments (Zhu et al, 2019 ). However, this method either limits scripted experiences or necessitates expensive and large machinery for dynamic positioning, such as robotic arms (Araujo et al, 2016 ), moving platforms (Jin et al, 2021 ), or multiple human helpers.…”

Section: Introductionmentioning

confidence: 99%

Wearable teleoperation controller with 2-DoF robotic arm and haptic feedback for enhanced interaction in virtual reality

Zhang

Qian

2023

Front. Neurorobot.

View full text Add to dashboard Cite

IntroductionTeleoperation is an essential component in fields such as medicine and manufacturing, enabling human operators to interact with remote robotic systems. A wearable device has been designed and manufactured to enhance sensitivity, wearability, and synchronization, providing users with the ability to experience the sensation of grasping virtual objects.MethodsThe device incorporates a 2-DoF robotic arm, haptic sensors for finger gestures, and a Unity-powered virtual scene system. Its effectiveness was evaluated through user experiments, where participants were asked to rank the weights of three virtual balls and identify the direction of force applied to a virtual ball in separate tests. Additionally, the device's ability to render various shapes was also examined.ResultsThe experiments showed that 73.3% of participants accurately ranked the balls by mass, and an overall correctness rate of 87.3% was achieved for force direction identification. For shape rendering, the device yielded more accurate results for simple objects like spheres, whereas rendering more complex objects such as cups and cones was challenging.DiscussionThe findings indicate that this wearable device has potential applications in haptic feedback and virtual reality contexts. Despite the challenges with complex shape rendering, the device shows promising capability in enhancing the user's immersive experience in virtual environments.

show abstract

“…distances. Considering the reusability of physical haptic proxies [20], [21], it would be helpful to use one or fewer physical objects to support the haptic experience of multiple virtual objects with the same physical dimension, but perhaps different textured surfaces. Directly applying vibrotactile stimuli on physical proxies can modify the perceived textures [22], but this approach requires mounting the vibrators on the physical materials.…”

Section: Introductionmentioning

confidence: 99%

Multi-modal Transformer-based Tactile Signal Generation for Haptic Texture Simulation of Materials in Virtual and Augmented Reality

Cai

Zhu

2022

2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)

View full text Add to dashboard Cite

Extensive research has been done in haptic feedback for texture simulation in virtual reality (VR). However, it is challenging to modify the perceived tactile texture of existing physical objects which usually serve as anchors for virtual objects in mixed reality (MR). In this paper, we present ViboPneumo, a finger-worn haptic device that uses vibratory-pneumatic feedback to modulate (i.e., increase and decrease) the perceived roughness of the material surface contacted by the user's fingerpad while supporting the perceived sensation of other haptic properties (e.g., temperature or stickiness) in MR. Our device includes a silicone-based pneumatic actuator that can lift the user's fingerpad on the physical surface to reduce the contact area for roughness decreasing, and an on-finger vibrator for roughness increasing. Our user-perception experimental results showed that the participants could perceive changes in roughness, both increasing and decreasing, compared to the original material surface. We also observed the overlapping roughness ratings among certain haptic stimuli (i.e., vibrotactile and pneumatic) and the originally perceived roughness of some materials without any haptic feedback. This suggests the potential to alter the perceived texture of one type of material to another in terms of roughness (e.g., modifying the perceived texture of ceramics as glass). Lastly, a user study of MR experience showed that ViboPneumo could significantly improve the MR user experience, particularly for visual-haptic matching, compared to the condition of a bare finger. We also demonstrated a few application scenarios for ViboPneumo.

show abstract

HapTwist

Cited by 47 publications

References 44 publications

VR-Based Job Training System Using Tangible Interactions

VR-Based Job Training System Using Tangible Interactions

Wearable teleoperation controller with 2-DoF robotic arm and haptic feedback for enhanced interaction in virtual reality

Multi-modal Transformer-based Tactile Signal Generation for Haptic Texture Simulation of Materials in Virtual and Augmented Reality

Contact Info

Product

Resources

About