Eye gaze as a biomarker in the recognition of autism spectrum disorder using virtual reality and machine learning: A proof of concept for diagnosis

Abstract

The core symptoms of autism spectrum disorder (ASD) mainly relate to social communication and interactions. ASD assessment involves expert observations in neutral settings, which introduces limitations and biases related to lack of objectivity and does not capture performance in real-world settings. To overcome these limitations, advances in technologies (e.g., virtual reality) and sensors (e.g., eye-tracking tools) have been used to create realistic simulated environments and track eye movements, enriching assessments with more objective data than can be obtained via traditional measures. This study aimed to distinguish between autistic and typically developing children using visual attention behaviors through an eye-tracking paradigm in a virtual environment as a measure of attunement to and extraction of socially relevant information. The 55 children participated. Autistic children presented a higher number of frames, both overall and per scenario, and showed higher visual preferences for adults over children, as well as specific preferences for adults' rather than children's faces on which looked more at bodies. A set of multivariate supervised machine learning models were developed using recursive feature selection to recognize ASD based on extracted eye gaze features. The models achieved up to 86% accuracy (sensitivity = 91%) in recognizing autistic children. Our results should be taken as preliminary due to the relatively small sample size and the lack of an external replication dataset. However, to our knowledge, this constitutes a first proof of concept in the combined use of virtual reality, eye-tracking tools, and machine learning for ASD recognition. Lay SummaryCore symptoms in children with ASD involve social communication and interaction. ASD assessment includes expert observations in neutral settings, which show limitations and biases related to lack of objectivity and do not capture performance in real settings. To overcome these limitations, this work aimed to distinguish between autistic and typically developing children in visual attention behaviors through an eye-tracking paradigm in a virtual environment as a measure of attunement to, and extraction of, socially relevant information.

Social Virtual Reality: Neurodivergence and Inclusivity in the Metaverse

“…Recent studies have confirmed that the use of avatars in virtual reality reduces anxiety in various populations [12][13][14]. While all demographics in studies reported being at ease in engaging with avatars in immersive social environments, introverts, and those with social anxiety disorders, PTSD, and ASD were better able to engage in social virtual reality more effectively than in person [15][16][17][18].…”

Gaze Fixation and Visual Searching Behaviors during an Immersive Virtual Reality Social Skills Training Experience for Children and Youth with Autism Spectrum Disorder: A Pilot Study

“…Related research has demonstrated that eye gaze patterns and visual attention in an IVR simulated environment may be a useful biomarker for ASD diagnosis [ 16 ]. Outside of the IVR environment, gaze preferences between social scenes and non-social scenes [ 17 ], as well as pupillary responses during visual scanning activities have also been suggested as potentially useful in diagnostics for ASD [ 18 ].…”

C1q/TNF-related protein-1: Potential biomarker for early diagnosis of autism spectrum disorder

“…62 Despite this, ASD diagnosis is usually delayed until school age especially in mild to moderate cases of ASDs 63,64 ; since the early signs, such as repetitive movements or delayed talking might be misleading and considered normal by the parents or caregivers, or it may be misdiagnosed with attention deficit hyperactivity disorder (ADHD). [65][66][67][68] Although early diagnosis of ASD even in infancy is crucial for the proper management of this condition, there are limited to no accepted clinical biomarkers for its accurate diagnosis; instead, the current global approach being practiced for ASD diagnosis is majorly made based on interviews and standard questioners such as the DSM5 rather than laboratory tests. 10,65 Since the awareness for ASD has been raised in the world and especially in developing countries, finding a reliable diagnostic biomarker has been the focus of researchers in the field.…”