Wearable RemoteFusion: A Mixed Reality Remote Collaboration System with Local Eye Gaze and Remote Hand Gesture Sharing

Sasikumar, Prasanth; Gao, Lei; Bai, Huidong; Billinghurst, Mark

doi:10.1109/ismar-adjunct.2019.000-3

Cited by 27 publications

(23 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[45]- [48] Epson Moverio BT-200 1 [49] custom -Empathic Glasses 1 [43] VR HMD BinaryVR 1 [50] HTC Vive 12 [40]- [43], [51]- [57] Vive Pro Eye 2 [37], [45] Vive Pro 4 [25], [46], [48], [58] Oculus Rift 7 [53], [59]- [64] Oculus Quest 3 [53], [59], [65] Oculus Go 1 [66] NVIS nVisor SX111 Non immersive screen based VRE 7…”

Section: Extended Reality Technologymentioning

confidence: 99%

A state of the art and scoping review of embodied information behavior in shared, co-present extended reality experiences

Kathryn¹,

Arturo²,

Lydia³

et al. 2022

View full text Add to dashboard Cite

We present a state of the art and scoping review of the literature to examine embodied information behaviors, as reflected in shared gaze interactions, within co-present extended reality experiences. Recent proliferation of consumer-grade head-mounted XR displays, situated at multiple points along the Reality-Virtuality Continuum, has increased their application in social, collaborative, and analytical scenarios that utilize data and information at multiple scales. Shared gaze represents a modality for synchronous interaction in these scenarios, yet there is a lack of understanding of the implementation of shared eye gaze within co-present extended reality contexts. We use gaze behaviors as a proxy to examine embodied information behaviors. This review examines the application of eye tracking technology to facilitate interaction in multiuser XR by sharing a user's gaze, identifies salient themes within existing research since 2013 in this context, and identifies patterns within these themes relevant to embodied information behavior in XR. We review a corpus of 50 research papers that investigate the application of shared gaze and gaze tracking in XR generated using the SALSA framework and searches in multiple databases. The publications were reviewed for study characteristics, technology types, use scenarios, and task types. We construct a state-of-the field and highlight opportunities for innovation and challenges for future research directions.

show abstract

Section: Extended Reality Technologymentioning

confidence: 99%

A state of the art and scoping review of embodied information behavior in shared, co-present extended reality experiences

Kathryn¹,

Arturo²,

Lydia³

et al. 2022

View full text Add to dashboard Cite

show abstract

“…Wearable RemoteFusion [122] shares eye gaze and hand gestures in an MR environment. The local user can see in AR the hand gestures of the remote user guiding him, while the remote user has a view of the local worker's eye gaze in VR.…”

Section: Behavior Detectionmentioning

confidence: 99%

A Review on Methods and Systems for Remote Collaboration

et al. 2021

View full text Add to dashboard Cite

Due to the appearance of COVID-19 in 2019, person-to-person interactions were drastically reduced. The impact of these restrictions on the economic environment was significant. For example, technical assistance for commissioning or adjusting the parameters of some complex machines/installations had to be postponed. Economic operators became interested in the possibility of remote collaboration, depending on the manufactured products and the performance of the production lines that they owned. This bibliographic research was undertaken to address these needs. The purpose of this review was to analyze the current solutions, approaches, and technologies that workers and specialists can implement to obtain a reliable remote collaboration system. This survey focuses on techniques, devices, and tools that are being used in different contexts to provide remote guidance. We present communication cues and methods being employed, the implemented technological support, and the areas that benefit from remote collaboration. We hope that our effort will be useful to those who develop such systems and people who want to learn about the existence of collaborative solutions, and that it will increase awareness about the applications and the importance of the domain. We are convinced that, with the development of communication systems, the advancement of remote support systems will be a goal for many economic operators.

show abstract

“…The study of Tait et al [98] suggests that implementing view independence between local and remote user improves task completion time. Sasikumar et al [82] combined AR and VR users together and enabled view frustum sharing which is visible to the local user as a grey cuboid. The goal of their work was to convey nonverbal communication cues such as eye gaze and hand gestures.…”

Section: Ar Viewport Sharingmentioning

confidence: 99%

A Survey on Synchronous Augmented, Virtual and Mixed Reality Remote Collaboration Systems

Schäfer¹,

Reis²,

Stricker³

2021

Preprint

View full text Add to dashboard Cite

Remote collaboration systems have become increasingly important in today's society, especially during times where physical distancing is advised. Industry, research and individuals face the challenging task of collaborating and networking over long distances. While video and teleconferencing are already widespread, collaboration systems in augmented, virtual, and mixed reality are still a niche technology. We provide an overview of recent developments of synchronous remote collaboration systems and create a taxonomy by dividing them into three main components that form such systems: Environment, Avatars, and Interaction. A thorough overview of existing systems is given, categorising their main contributions in order to help researchers working in different fields by providing concise information about specific topics such as avatars, virtual environment, visualisation styles and interaction. The focus of this work is clearly on synchronised collaboration from a distance. A total of 82 unique systems for remote collaboration are discussed, including more than 100 publications and 25 commercial systems.

show abstract

Wearable RemoteFusion: A Mixed Reality Remote Collaboration System with Local Eye Gaze and Remote Hand Gesture Sharing

Cited by 27 publications

References 1 publication

A state of the art and scoping review of embodied information behavior in shared, co-present extended reality experiences

A state of the art and scoping review of embodied information behavior in shared, co-present extended reality experiences

A Review on Methods and Systems for Remote Collaboration

A Survey on Synchronous Augmented, Virtual and Mixed Reality Remote Collaboration Systems

Contact Info

Product

Resources

About