The Impact of Sharing Gaze Behaviours in Collaborative Mixed Reality

Jing, Allison; May, Kieran; Matthews, Brandon; Lee, Gun; Billinghurst, Mark

doi:10.1145/3555564

Cited by 22 publications

(7 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…While this method creates a sense of physical engagement, establishing a shared gaze state is still challenging when all participants are wearing VR HMDs [18]. To address this challenge, recent research in mixed reality (MR) has introduced promising solutions for two collaborators by incorporating built-in eye-trackers when one user is wearing a VR HMD and the other user is wearing an AR HMD [19].…”

Section: Multi-hmdmentioning

confidence: 99%

CoVR+: Design of Visual Effects for Promoting Joint Attention During Shared VR Experiences via a Projection of HMD User's View

SHINDO,

FUKUSHIMA,

HAUTASAARI

et al. 2024

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

A user wearing a Head-Mounted Display (HMD) is likely to feel isolated when sharing virtual reality (VR) experiences with Non-HMD users in the same physical space due to not being able to see the real space outside the virtual world. This research proposes a method for an HMD user to recognize the Non-HMD users' gaze and attention via a projector attached to the HMD. In the proposed approach, the projected HMD user's view is filtered darker than default, and when Non-HMD users point controllers towards the projected view, the filter is removed from a circular area for both HMD and Non-HMD users indicating which region the Non-HMD users are viewing. We conducted two user studies showing that the Non-HMD users' gaze can be recognized with the proposed method, and investigated the preferred range for the alpha value and the size of the area for removing the filter for the HMD user.

show abstract

Section: Multi-hmdmentioning

confidence: 99%

CoVR+: Design of Visual Effects for Promoting Joint Attention During Shared VR Experiences via a Projection of HMD User's View

SHINDO,

FUKUSHIMA,

HAUTASAARI

et al. 2024

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

show abstract

“…This evaluation of gaze sharing techniques in complex domains has not yet been recorded in the literature, which allows us to target this gap and open opportunities for future research to look into gaze sharing in real-life scenarios. We expect that our gaze visualizations will help improve performance (Jing et al, 2022; Li et al, 2019).…”

Section: Related Workmentioning

confidence: 99%

“…A commonly used visualization technique recently is the coordinate-based dot symbol that has mostly been adopted for its simplicity and minimal mental load (Li et al, 2019). Jing et al (2022) studied gaze behavior to detect overlapping gaze between teammates. For instance, two overlapping gaze points turned green to inform the users of their mutual gaze.…”

Section: Related Workmentioning

confidence: 99%

Can Real-Time Gaze Sharing Help Team Collaboration? A Preliminary Examination of its Effectiveness with Pairs

Atweh,

Hazimeh,

Riggs

2023

Proceedings of the Human Factors and Ergonomics Society Annual

View full text Add to dashboard Cite

Complex and dynamic domains rely on operators to collaborate on multiple tasks and cope with changes in task demands. Gaze sharing is a means of communication used to exchange visual information by allowing teammates to view each other’s gaze points on their displays. Existing work on gaze sharing focuses on relatively simple task-specific domains and no work-to-date addresses how to use gaze sharing in data-rich environments. For this study, nine pairs of participants completed a UAV search and rescue command-and- control task with three visualization techniques: no gaze sharing, gaze sharing using the real-time dot, and gaze sharing using the real-time fixation trail. Our preliminary results show that performance scores using the real-time fixation trail were statistically significantly higher than when no gaze sharing was present. This suggests that the real-time fixation trail is a promising tool to better understand operators’ strategies and could form the basis of an adaptive display.

show abstract

“…Piumsomboon et al [33] and Lee et al [34] used eye gaze to represent collaborators' points of interest (POIs) in the task space and explored how the increased awareness of collaborators' POIs influenced the collaboration. Jing et al extended the use of the eye-gaze pointer by integrating speech recognition with the gaze pointer [35] and suggesting a visual representation of linking multiuser gaze pointers [19].…”

Section: B Augmented/virtual Reality Collaboration Systemmentioning

confidence: 99%

“…The position of it is the first collision point of the ray at the front head direction of an HMD. The starting position of the ray is the center of the viewpoint as several previous studies did [33]- [35]. For handgesture cues, we adopted direct hand-gesture interaction that synchronizes real-world hand gestures into virtual hands and supports hand-object holding, translation, and releasing interactions.…”

Section: B Prototype Developmentmentioning

confidence: 99%

Effect of Auto-Erased Sketch Cue in Multiuser Surgical Planning Virtual Reality Collaboration System

Park,

Suh,

Kim

et al. 2023

IEEE Access

Self Cite

View full text Add to dashboard Cite

Many researchers have introduced Virtual Reality (VR) systems for various medical applications. One of the typical applications is a medical collaboration system that helps users collaborate in a virtual reality environment while physically staying in different places. In this research, we explore the effect of the using 3-second sketch communication cue in a collaborative VR system for two surgeons planning surgery, when a head-gaze pointer and hand-gesture are available as the baseline communication cues. We conducted a user study comparing four conditions according to the availability of the auto-erased sketch cue by two collaborators: the message provider and receiver. The results demonstrated the benefits of the 3-second sketch communication cue that increased the level of usability and message understanding between two collaborators and decreased the required task load. We additionally found that the sketch cue would be more beneficial if it was erased after finishing each collaborator's communication turn rather than after three seconds. With the lesson learned from the user study, we propose six design principles for the multiuser planning surgery VR system: 1) 3D reconstructed body model should be supported, 2) the crosssectional view at any angle and position should be supported, 3) visual communication cues, such as sketches, pointers, and hand gestures, are crucial for communication, 4) the erasing sketch should occur when the next sketch starts being drawn 5) the system should support permanent annotations, 6) the system should control the transparency of the hand gestures and head-gaze pointers to mitigate the effect of occlusions.

show abstract

The Impact of Sharing Gaze Behaviours in Collaborative Mixed Reality

Cited by 22 publications

References 29 publications

CoVR+: Design of Visual Effects for Promoting Joint Attention During Shared VR Experiences via a Projection of HMD User's View

CoVR+: Design of Visual Effects for Promoting Joint Attention During Shared VR Experiences via a Projection of HMD User's View

Can Real-Time Gaze Sharing Help Team Collaboration? A Preliminary Examination of its Effectiveness with Pairs

Effect of Auto-Erased Sketch Cue in Multiuser Surgical Planning Virtual Reality Collaboration System

Contact Info

Product

Resources

About