Virtual Reality Observations: Using Virtual Reality to Augment Lab-Based Shoulder Surfing Research

Abstract

Figure 1: We explore the use of virtual reality (VR) for shoulder surfing research in the authentication research domain. We compare the impact of non-immersive/immersive VR observations on participants' observation performance and behaviour while shoulder surfing authentications. We demonstrate the strengths of VR-based shoulder surfing research by exploring three different authentication scenarios: (➊) automated teller machine (ATM), (➋) smartphone PIN, and (➌) smartphone pattern authentication.

Stay Home! Conducting Remote Usability Evaluations of Novel Real-World Authentication Systems Using Virtual Reality

“…Researchers can scale up their sample sizes, recruit user study subjects from different countries, and adjust their systems without being required to purchase or build special hardware. However, despite prior works that validated VR's use for empirical real-world research [27,29,31,56], it is important to 1) acknowledge potential technical limitations and 2) have a clear vision of what can be expected from evaluations that are conducted on virtual artefacts. For example, investigating Tap 's usability in the lab using better hand tracking technology (e.g., an OptiTrack system [39]) may impact participants' usability perception.…”

Re-Evaluating VR User Awareness Needs During Bystander Interactions

“…We suggest such critical moments be incorporated into evaluation scenarios (e.g. through insitu evaluations, acted out bystander interactions, nested simulated realities [26][27][28]), or be assessed after-the-fact (e.g. think aloud approaches where participants reflect on the suitability of the proposed approach versus standardised baselines across these critical moments -replicating our Assessing Awareness Needs evaluation design).…”

The Feet in Human-Centred Security: Investigating Foot-Based User Authentication for Public Displays

“…Others argued that VR combines the internal validity of controlled lab studies with the external validity of field studies [17,36,40]. There is a plethora of additional works that commented on using VR as a research platform (e.g., [3,38,40,42,61,63]).…”

“…We implemented a VR prototype of FeetAuth in Unity 3D (C#). Previous work by Mäkelä et al [36] and Mathis et al [38][39][40] showed that using VR as a research method to conduct user studies on public displays and to evaluate real-world prototype authentication systems is feasible. A VR-powered research approach also enabled us to conduct research in a relatively realistic environment, which is challenging to replicate in a physical lab.…”