Extended Reality (XR) Remote Research: a Survey of Drawbacks and Opportunities

Abstract

Extended Reality (XR) technology -such as virtual and augmented reality -is now widely used in Human Computer Interaction (HCI), social science and psychology experimentation. However, these experiments are predominantly deployed in-lab with a co-present researcher. Remote experiments, without co-present researchers, have not flourished, despite the success of remote approaches for non-XR investigations. This paper summarises findings from a 30-item survey of 46 XR researchers to understand perceived limitations and benefits of remote XR experimentation. Our thematic analysis identifies concerns common with non-XR remote research, such as participant recruitment, as well as XR-specific issues, including safety and hardware variability. We identify potential positive affordances of XR technology, including leveraging data collection functionalities builtin to HMDs (e.g. hand, gaze tracking) and the portability and reproducibility of an experimental setting. We suggest that XR technology could be conceptualised as an interactive technology and a capable data-collection device suited for remote experimentation. CCS CONCEPTS• Human-centered computing → Mixed / augmented reality; Virtual reality.

Exploring the Embodiment of a Virtual Hand in a Spatially Augmented Respiratory Biofeedback Setting

“…• User experience studies (in laboratory and in remote contexts) on the SARB setting would initially help to improve the usability of the setup, making the task easier and more engaging (possibly personalizing the target RR through adaptive and co-adaptive features) for the participants in upcoming remote online sessions (even as daily game-like training) (Ratcliffe et al, 2021). The visual scene will be improved with further graphic details to achieve a more compelling experience (e.g., substituting the black area around the right hole with a more realistic texture).…”

There is Always a Way: Organizing VR User Tests with Remote and Hybrid Setups during a Pandemic—Learnings from Five Case Studies

“…To conclude, despite the potential of remote research practices, they were not widely adopted [7] before a recent shift towards research and work from home due to COVID-19 pandemic restrictions. In the case of academic research, various practices and tools were presented prior to the pandemic to address the challenges of remote research, which in turn could involve a wider audience and positively affect research outcomes.…”

“…To address these and further discover remote methods, multiple papers proposed a variability of tools and methods to maintain remote testing procedure [38][39][40] and demonstrated how to maximize the number of participants via crowdsourcing [41,42] or via making the research prototypes public on app stores [43]. Despite the potential of remote research methods, the research practitioners still preferred traditional experiments and moderated in-lab user studies, especially in the research projects with XR technologies [7].…”

“…While the regulations to follow "work from home" and, similarly, "research from home" [5] come from the governmental level, academia and industry research organizations have faced several challenges in managing their traditional workflows. Restrictions on physical contact and social isolation have massively affected the research projects related to the use of Extended Reality (XR) and immersive environments, where in-lab experiments with the presence of a moderator and a participant in one space accounted for more than 70% of the overall user study methods [6,7]. Similarly, other research activities, for instance based on the usage of mobile devices, have faced similar complications, and require additional efforts to be conducted.…”

“…The results are further discussed from the perspective of (5) general insights on user testing, and things related to (6) testing new, fascinating technology. Furthermore, we describe (7) hygiene and safety protocols for conducting VR user tests during a pandemic.…”