Combining Virtual and Augmented Reality to improve daily autonomy for people with Autism Spectrum Disorder

Abstract

Cognitive rigidity and behavioral and communication problems are the most common symptoms that characterize Autism Spectrum Disorder (ASD). In fact, people with ASD face complications in everyday life, from interacting with other persons to being autonomous in the most ordinary daily tasks. To overcome these limitations and improve their quality of life, we developed 5A. 5A exploits cutting-edge technologies such as Virtual Reality (VR), Augmented Reality (AR), and Conversational Agents (CA), combining smartphones and wearable headsets to offer new forms of intervention to persons with ASD. Virtual reality experiences enable learning common tasks, such as using public transport, through simulation in a safe environment. When people are in similar reallife situations, AR can help them generalize the skills they have learned in VR by overlaying interactive media assets on top of the view of the physical world around them. A customizable conversational assistant provides individualized prompts and feedback in both VR and AR to provide maximum user support. CCS CONCEPTS• Human-centered computing → Virtual reality; Mixed / augmented reality.