Gaze Interactive and Attention Aware Low Vision Aids as Future Smart Glasses

Abstract

We present a working paper on integrating eye tracking with mixed and augmented reality for the benefit of low vision aids. We outline the current state of the art and relevant research and point to further research and development required in order to adapt to individual user, environment, and current task. We outline key technical challenges and possible solutions including calibration, dealing with variant eye data quality, measuring and adapting image processing to low vision within current technical limitations, and outline an experimental approach to designing data-driven solutions using machine learning and artificial intelligence. CCS CONCEPTS• Human-centered computing → Accessibility technologies; Mixed / augmented reality.

Artificial intelligence enabled smart digital eye wearables

“…Notably, contextual awareness built into the smart eyewear can drive agile behavior modifications for improved interventional outcomes [29,30]. Lastly, smart eyewear also serves as an assistive technology for people with visual impairments [20,31] and helps physicians with telehealth consultations [32]. The augmented reality features allow for easy, unobtrusive means of information retrieval and consumption during surgery [33,34 penalization.…”

“…Also, by using special lenses and filters that enhance color perception, they can correct color blindness. Furthermore, eye tracking with augmented reality can greatly benefit low-vision aids [31]. Commercially available smart eyewear for low-vision includes AceSigght, NuEyes, eSight, and Eyedaptic.…”