Haptic Feedback Helps Me? A VR-SAR Remote Collaborative System with Tangible Interaction

Wang, Peng; Bai, Xiangzhi; Billinghurst, Mark; Zhang, Shusheng; Han, Dechuan; Sun, Mengmeng; Wang, Zhuo; Lv, Hao; Han, Shu

doi:10.1080/10447318.2020.1732140

Cited by 38 publications

(17 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the future, we would like to investigate one-many VR/AR remote collaboration (e.g., one remote expert and two or more local workers) on assembly training using different devices such as PCs and mobile phones. Furthermore, although our results are encouraging and indicate that our research is heading in the right direction, it would be interesting to investigate whether the interface could support haptic feedback and a multiscale MR telepresence interface as shown by recent research [ 32 – 34 ].…”

Section: Conclusion Limitations and Future Workmentioning

confidence: 83%

A novel AR remote collaborative platform for sharing 2.5D gestures and gaze

Wang

Luo

et al. 2022

Int J Adv Manuf Technol

Self Cite

View full text Add to dashboard Cite

Although sharing gestures and gaze can improve AR remote collaboration, most current systems only enable collaborators to share 2D or 3D gestures, and the unimodal HCI interface remains dominant. To address this problem, we describe a novel remote collaborative platform based on 2.5D gestures and gaze (2.5DGG), which supports an expert who collaborates with a worker (e.g., during assembly or training tasks). We investigate the impact of sharing the remote site’s 2.5DGG using spatial AR (SAR) remote collaboration in manufacturing. Compared to other systems, there is a key advantage that it can provide more natural and intuitive multimodal interaction based on 2.5DGG. We track the remote experts’ gestures and eye gaze using Leap Motion and aGlass, respectively, in a VR space displaying the live video stream of the local physical workspace and visualize them onto the local work scenario by a projector. The results of an exploratory user study demonstrate that 2.5DGG has a clear difference in performance time and collaborative experience, and it is better than the traditional one.

show abstract

Section: Conclusion Limitations and Future Workmentioning

confidence: 83%

A novel AR remote collaborative platform for sharing 2.5D gestures and gaze

Wang

Luo

et al. 2022

Int J Adv Manuf Technol

Self Cite

View full text Add to dashboard Cite

show abstract

“…Among these, human-RO interactions, which are interactions between a human and a real object, is difficult to apply to various remote collaborations since they require a physical object in the real world. Therefore, as a result of an investigation into research on remote collaboration based on MR, virtual reality (VR), and augmented reality (AR) conducted over the past three years on the other two interactions, the human-VO interaction was used more frequently than the human-human interaction [14][15][16][17][18]. These results seem to be due to the purpose of applying MR to remote collaboration.…”

Section: Related Work 21 Interactions In Remote Mr Collaborationmentioning

confidence: 99%

“…The human-VO interaction can be applied to various types of remote collaboration application scenarios [19]. Oyekan et al [14], Wang et al [15] and Kwon et al [16] conducted a remote collaboration application study of the remote expert scenario focusing on collaborations between remote experts and workers. In the remote expert scenario, the human-VO interaction was performed for the remote expert to manipulate the shared virtual object and to give work instructions to field workers.…”

Section: Related Work 21 Interactions In Remote Mr Collaborationmentioning

confidence: 99%

A Study on Interaction Prediction for Reducing Interaction Latency in Remote Mixed Reality Collaboration

Choi

Son

Kim³

2021

Applied Sciences

View full text Add to dashboard Cite

Various studies on latency in remote mixed reality collaborations (remote MR collaboration) have been conducted, but studies related to interaction latency are scarce. Interaction latency in a remote MR collaboration occurs because action detection (such as contact or collision) between a human and a virtual object is required for finding the interaction performed. Therefore, in this paper, we propose a method based on interaction prediction to reduce the time for detecting the action between humans and virtual objects. The proposed method predicts an interaction based on consecutive joint angles. To examine the effectiveness of the proposed method, an experiment was conducted and the results were given. From the experimental results, it was confirmed that the proposed method could reduce the interaction latency compared to the one obtained by conventional methods.

show abstract

Section: Introductionmentioning

confidence: 99%

“…The limited research that does exist for the inclusion of haptics in AR environments is scattered over a wide range of applications such as rehabilitation [9], remote collaboration [13], and virtual training [3]. These studies tend to conclude a positive influence of haptic feedback in AR environments in terms of completion time [3,7,9], accuracy [3], user experience [13], and interaction [11]. However, to our knowledge, these experiments are very limited in terms of general applicability and do not take into account the possible effects of networks on the experience and interactivity, which is the purpose of this work.…”

Section: Introductionmentioning

confidence: 99%

Effects of Haptic Feedback on User Perception and Performance in Interactive Projected Augmented Reality

Damme

Legrand

Heyse

et al. 2022

Proceedings of the 1st Workshop on Interactive eXtended Reality

View full text Add to dashboard Cite

By means of vibrotactile and force feedback, i.e., haptics, users are given the sensation of touching and manipulating virtual objects in interactive Extended Reality (XR) environments. However, research towards the influence of this feedback on the users' perception and performance in interactive XR is currently still scarce. In this work, we present an experimental evaluation of the effects of haptic feedback in interactive immersive applications. By means of a Projected Augmented Reality (PAR) setup, users were asked to interact with a projected environment by completing three different tasks based on finger-tracking and in the presence of visual latency. Evaluations were performed both subjectively (questionnaire) and objectively (i.e. duration and accuracy). We found out that while haptic feedback does not enhance the performance for simple tasks, it substantially improves it for more complex ones. This effect is more evident in presence of network degradation, such as latency. However, the subjective questionnaires showed a general skepticism about the potential of incorporating haptic information into immersive applications. As such, we believe that this paper provides an important contribution toward the understanding and assessment of the influence of haptic technology in interactive immersive systems.

show abstract

Haptic Feedback Helps Me? A VR-SAR Remote Collaborative System with Tangible Interaction

Cited by 38 publications

References 41 publications

A novel AR remote collaborative platform for sharing 2.5D gestures and gaze

A novel AR remote collaborative platform for sharing 2.5D gestures and gaze

A Study on Interaction Prediction for Reducing Interaction Latency in Remote Mixed Reality Collaboration

Effects of Haptic Feedback on User Perception and Performance in Interactive Projected Augmented Reality

Contact Info

Product

Resources

About