In-the-Wild Experiences with an Interactive Glanceable AR System for Everyday Use

Lu, Feiyu; Pavanatto, Leonardo; Bowman, Doug A.

doi:10.1145/3607822.3614515

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Other2

Article1

Relationship

Self Cite0

Independent3

Authors

Journals

Cited by 3 publications

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

MRTranslate: Bridging Language Barriers in the Physical World Using a Mixed Reality Point-and-Translate System

Mathis,

Sun,

Preussner

2024

Proceedings of the 2024 International Conference on Advanced Visual Interfaces

View full text Add to dashboard Cite

MRTranslate: Bridging Language Barriers in the Physical World Using a Mixed Reality Point-and-Translate System

Mathis,

Sun,

Preussner

2024

Proceedings of the 2024 International Conference on Advanced Visual Interfaces

View full text Add to dashboard Cite

ShouldAR: Detecting Shoulder Surfing Attacks Using Multimodal Eye Tracking and Augmented Reality

Corbett,

David-John,

Shang

et al. 2024

Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.

View full text Add to dashboard Cite

Shoulder surfing attacks (SSAs) are a type of observation attack designed to illicitly gather sensitive data from "over the shoulder" of victims. This attack can be directed at mobile devices, desktop screens, Personal Identification Number (PIN) pads at an Automated Teller Machine (ATM), or written text. Existing solutions are generally focused on authentication techniques (e.g., logins) and are limited to specific attack scenarios (e.g., mobile devices or PIN Pads). We present ShotjldAR, a mobile and usable system to detect SSAs using multimodal eye gaze information (i.e., from both the potential attacker and victim). ShouldAR uses an augmented reality headset as a platform to incorporate user eye gaze tracking, rear-facing image collection and eye gaze analysis, and user notification of potential attacks. In a 24-participant study, we show that the prototype is capable of detecting 87.28% of SSAs against both physical and digital targets, a two-fold improvement on the baseline solution using a rear-facing mirror, a widely used solution to the SSA problem. The ShouldAR approach provides an AR-based, active SSA defense that applies to both digital and physical information entry in sensitive environments.

show abstract

VR Headsets In-The-Wild: Qualitative Insights on Safety, Awareness, and Social Challenges from Real Train Journeys

Bajorunaite,

Williamson,

Brewster

2024

Proceedings of the International Conference on Mobile and Ubiquitous Multimedia

View full text Add to dashboard Cite

In-the-Wild Experiences with an Interactive Glanceable AR System for Everyday Use

Cited by 3 publications

References 41 publications

MRTranslate: Bridging Language Barriers in the Physical World Using a Mixed Reality Point-and-Translate System

MRTranslate: Bridging Language Barriers in the Physical World Using a Mixed Reality Point-and-Translate System

ShouldAR: Detecting Shoulder Surfing Attacks Using Multimodal Eye Tracking and Augmented Reality

VR Headsets In-The-Wild: Qualitative Insights on Safety, Awareness, and Social Challenges from Real Train Journeys

Contact Info

Product

Resources

About