eyemR-Vis: Using Bi-Directional Gaze Behavioural Cues to Improve Mixed Reality Remote Collaboration

Jing, Allison; May, Kieran; Naeem, Mahnoor; Lee, Gun; Billinghurst, Mark

doi:10.1145/3411763.3451844

Cited by 23 publications

(21 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[45]- [48] Epson Moverio BT-200 1 [49] custom -Empathic Glasses 1 [43] VR HMD BinaryVR 1 [50] HTC Vive 12 [40]- [43], [51]- [57] Vive Pro Eye 2 [37], [45] Vive Pro 4 [25], [46], [48], [58] Oculus Rift 7 [53], [59]- [64] Oculus Quest 3 [53], [59], [65] Oculus Go 1 [66] NVIS nVisor SX111 Non immersive screen based VRE 7…”

Section: Extended Reality Technologymentioning

confidence: 99%

“…The Octave -fully immersive display 1 [79] OmniGlobeVR 1 [51] OmniGlobe 360 1 [51] REFLCT, a head mounted projective display 1 [80] withyou, projection-based octave display 1 [76] CollaboVR 1 [64] 360 Camera Richo Theta V1 2 [37], [51] 360-degree video 1 [71] Table 2. Extended reality technologies utilized within our corpus…”

Section: Extended Reality Technologymentioning

confidence: 99%

“…Eye Trackers Tobii Eye Tracker 11 22% [27], [35], [38], [43], [57], [61], [64], [72], [74], [75], [78] Pupil Labs eyetracker 7 14% [38], [41]- [43], [49], [71], [73] aGlass Eye Tracker 4 8% [44], [53], [55], [56] Advanced realtime tracking (ART) system 1 2% [77] Ergoneers Dikablis gaze tracker 1 2% [67] Eye Tracking Enabled HMDs HTC Vive Pro & Pro Eye 13 26% [25], [37], [41]- [43], [45], [46], [48], [54]- [58] Microsoft HoloLens 12 24% [26], [34]- [37], [39]- [44], [47] Magic Leap 3 6% [46]- [48] FOVE VR 2 4% [50], [70] BinaryVR HMD 1 2% [50] Other Approaches Gaze estimation from head position 6 12% [52], [59], [60], [62],…”

Section: # % Sourcesmentioning

confidence: 99%

“…% Sources FOV 14 28% [35], [39], [40], [48], [51], [57], [59], [60], [63], [68], [70], [78], [79] Region of Interest 14 28% [27], [34], [36], [46], [52], [54], [61], [66], [69], [74]- [76], [80] Fixations 8 16% [26], [41], [44], [50], [55], [58], [72], [73] Ray cast line 6 12% [41]- [43], [45], [65], [77] Point of focus 5 10% [25], [26], [38], [56], [62] Frustrum 4 8% [41]- [43], [45] Saccades 3 6% [37], [49], [53] Heatmap 3 6% [47], …”

mentioning

confidence: 99%

See 3 more Smart Citations

A state of the art and scoping review of embodied information behavior in shared, co-present extended reality experiences

Kathryn¹,

Arturo²,

Lydia³

et al. 2022

View full text Add to dashboard Cite

We present a state of the art and scoping review of the literature to examine embodied information behaviors, as reflected in shared gaze interactions, within co-present extended reality experiences. Recent proliferation of consumer-grade head-mounted XR displays, situated at multiple points along the Reality-Virtuality Continuum, has increased their application in social, collaborative, and analytical scenarios that utilize data and information at multiple scales. Shared gaze represents a modality for synchronous interaction in these scenarios, yet there is a lack of understanding of the implementation of shared eye gaze within co-present extended reality contexts. We use gaze behaviors as a proxy to examine embodied information behaviors. This review examines the application of eye tracking technology to facilitate interaction in multiuser XR by sharing a user's gaze, identifies salient themes within existing research since 2013 in this context, and identifies patterns within these themes relevant to embodied information behavior in XR. We review a corpus of 50 research papers that investigate the application of shared gaze and gaze tracking in XR generated using the SALSA framework and searches in multiple databases. The publications were reviewed for study characteristics, technology types, use scenarios, and task types. We construct a state-of-the field and highlight opportunities for innovation and challenges for future research directions.

show abstract

Section: Extended Reality Technologymentioning

confidence: 99%

Section: Extended Reality Technologymentioning

confidence: 99%

Section: # % Sourcesmentioning

confidence: 99%

mentioning

confidence: 99%

See 2 more Smart Citations

A state of the art and scoping review of embodied information behavior in shared, co-present extended reality experiences

Kathryn¹,

Arturo²,

Lydia³

et al. 2022

View full text Add to dashboard Cite

show abstract

“…In collaborative settings, gaze is seen as a vital cue for efficient communication and collaboration and can be used to predict collaborators' intention [Baron-Cohen et al 1997], seek approval [Efran 1968], or understand the desire to communicate [Ho et al 2015]. Gaze cues that show the current gaze position to collaborators are usually visualized through a cursor [Jing et al 2021;Kim et al 2020;Lee et al 2017] or a ray [Bai et al 2020;Jing et al 2021; in augmented and virtual reality (AR/VR) settings, and have been extensively studied to improve collaboration and communication. These works, together with results in desktop settings, have shown that gaze-based cues can be effective for establishing mutual orientation Hindmarsh et al 1998;Jing et al 2021;Li et al 2016], enhancing the feeling of co-presence [Bai et al 2020;Gupta et al 2016], and improving the awareness of collaborators' attention and actions [Jing et al 2021;Kuhn et al 2009;Lee et al 2017;Newn et al 2017].…”

Section: Introduction and Related Workmentioning

confidence: 99%

Real-time head-based deep-learning model for gaze probability regions in collaborative VR

Bovo

Giunchi

Sidenmark

et al. 2022

2022 Symposium on Eye Tracking Research and Applications

View full text Add to dashboard Cite

Figure 1: a) The head rotational velocity direction (θ ) and magnitude (ρ) are extracted during a VR session. b) Probability density functions are extracted from eye-gaze distributions that correspond to the head rotational velocity and are converted into a series of percentile-based contours (η). c) Our real-time model uses the three parameters (θ ,ρ,η) to provide a novel representation of visual attention for VR collaboration or interaction.

show abstract

A Survey of Computer-Supported Remote Collaboration on Physical Objects

Letter,

George,

Wolf

2023

Lecture Notes in Computer Science

View full text Add to dashboard Cite

eyemR-Vis: Using Bi-Directional Gaze Behavioural Cues to Improve Mixed Reality Remote Collaboration

Cited by 23 publications

References 30 publications

A state of the art and scoping review of embodied information behavior in shared, co-present extended reality experiences

A state of the art and scoping review of embodied information behavior in shared, co-present extended reality experiences

Real-time head-based deep-learning model for gaze probability regions in collaborative VR

A Survey of Computer-Supported Remote Collaboration on Physical Objects

Contact Info

Product

Resources

About