Glow in the dark: Using a heat-sensitive camera for blind individuals with prosthetic vision

Sadeghi, Roksana; Kartha, Arathy; Bradley, Chris; Gibson, Paul; Caspi, Avi; Roy, Arup; Dagnelie, Gislin

doi:10.1016/j.visres.2021.02.009

Cited by 10 publications

(11 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…While 76 studies (

) used BLV end users to evaluate performance, most prosthetic vision studies (

) did not. Of the six studies that recruited bionic eye users, none consulted with BLV users about their information needs, and only two studies based their work on previous findings about the information needs of prosthesis users ( Sadeghi et al., 2021 ; Rachitskaya et al., 2020 ). Additionally, while many studies used BLV participants, very few conducted poststudy qualitative assessments.…”

Section: Research Areasmentioning

confidence: 99%

“…This includes thermal imaging ( Zagar & Baggarly, 2010 ; He, Huang, Caspi, Roy, & Montezuma, 2019 ), audiovisual cross-modal mapping ( Stiles, Patel, & Weiland, 2021 ), and depth detection with object segmentation ( Kartha et al., 2020 ). For example, Sadeghi et al. (2021) tested the ability of bionic eye users to perform a series of practical tasks (e.g., identifying hot objects, estimating the distance to a nearby person) while using a thermal camera.…”

Section: Research Areasmentioning

confidence: 99%

See 1 more Smart Citation

A systematic review of extended reality (XR) for understanding and augmenting vision loss

et al. 2023

View full text Add to dashboard Cite

Over the past decade, extended reality (XR) has emerged as an assistive technology not only to augment residual vision of people losing their sight but also to study the rudimentary vision restored to blind people by a visual neuroprosthesis. A defining quality of these XR technologies is their ability to update the stimulus based on the user’s eye, head, or body movements. To make the best use of these emerging technologies, it is valuable and timely to understand the state of this research and identify any shortcomings that are present. Here we present a systematic literature review of 227 publications from 106 different venues assessing the potential of XR technology to further visual accessibility. In contrast to other reviews, we sample studies from multiple scientific disciplines, focus on technology that augments a person’s residual vision, and require studies to feature a quantitative evaluation with appropriate end users. We summarize prominent findings from different XR research areas, show how the landscape has changed over the past decade, and identify scientific gaps in the literature. Specifically, we highlight the need for real-world validation, the broadening of end-user participation, and a more nuanced understanding of the usability of different XR-based accessibility aids.

show abstract

“…While 76 studies (

) used BLV end users to evaluate performance, most prosthetic vision studies (

Section: Research Areasmentioning

confidence: 99%

Section: Research Areasmentioning

confidence: 99%

A systematic review of extended reality (XR) for understanding and augmenting vision loss

et al. 2023

View full text Add to dashboard Cite

show abstract

“…It is therefore unclear how these findings would translate to real prosthesis patients. Only a handful studies have validated their computer vision algorithm on sighted subjects viewing prosthetic vision simulations (e.g., , Sanchez-Garcia et al, 2020b, Han et al, 2021, and even fewer have tested their setup with real prosthesis patients (two notable examples: He et al, 2019;Sadeghi et al, 2021).…”

Section: Towards a Smart Bionic Eyementioning

confidence: 99%

“…isolation (e.g., Al-Atabany et al, 2010, Parikh et al, 2010, Horne et al, 2016, but more research is needed to compare these approaches side-byside (Han et al, 2021) and to test their ability to support real-world tasks (He et al, 2019;Sadeghi et al, 2021) A so-far unexplored application domain concerns the use of visual question answering (VQA) to help a user retrieve misplaced items or orient themselves in their environment (Fig. 3D).…”

Section: Visual Augmentations Tomentioning

confidence: 99%

“…It is easy to see how the above deep learning techniques could become an integral part of the Smart Bionic Eye once they reach a certain maturity that allows them to be used in unstructured environments. In the future, these visual augmentations could Towards a Smart Bionic Eye 10 be combined with GPS to give directions, warn users of impending dangers in their immediate surroundings, or even extend the range of "visible" light with the use of an infrared sensor (Sadeghi et al, 2021). Once the quality of the generated artificial vision experience reaches a certain threshold, there are a lot of exciting avenues to pursue.…”

Section: Visual Augmentations Tomentioning

confidence: 99%

See 1 more Smart Citation

Towards a Smart Bionic Eye: AI-powered artificial vision for the treatment of incurable blindness

Beyeler¹,

Sanchez-Garcia²

2022

J. Neural Eng.

View full text Add to dashboard Cite

Objective. How can we return a functional form of sight to people who are living with incurable blindness? Despite recent advances in the development of visual neuroprostheses, the quality of current prosthetic vision is still rudimentary and does not differ much across different device technologies. Approach. Rather than aiming to represent the visual scene as naturally as possible, a Smart Bionic Eye could provide visual augmentations through the means of artificial intelligence (AI)-based scene understanding, tailored to specific real-world tasks that are known to affect the quality of life of people who are blind, such as face recognition, outdoor navigation, and self-care. Main results. Complementary to existing research aiming to restore natural vision with these devices, we propose a patient-centered iterative approach to provide visual augmentations designed to support a range of patient-relevant real-world tasks. Significance. The ability of a visual prosthesis to support everyday tasks might make the difference between abandoned technology and a widely adopted next-generation neuroprosthetic device.

show abstract

Adaptive Interfacial Materials and Implants for Visual Restoration

Zhu,

Wang,

Zhao

et al. 2024

Adv Funct Materials

View full text Add to dashboard Cite

Blindness is a globally critical challenge for public health, affecting more than 43 million individuals worldwide. Retinal degenerative diseases including retinitis pigmentosa and age‐related macular degeneration, involving degeneration of retinal pigment epithelium (RPE) and thereby the dysfunction of retina, are primary causes of blindness. For treating these retinal degeneration diseases, emerging interfacial materials and implants that can adapt to nerve tissues and stimulate residual neurons within the visual pathway have shown particular promise, where some issued products are approved for commercialization. Given the attractive opportunities and challenges of the interfacial materials and implants for visual restoration, a comprehensive and state‐of‐the‐art review that provides insight into their design principle and biological performances will be urgently required yet missing. In this review, the latest progress of these adaptive interfacial materials and implants for visual restoration will be summarized, and their challenges and opportunities for clinical use will be further discussed.

show abstract

Glow in the dark: Using a heat-sensitive camera for blind individuals with prosthetic vision

Cited by 10 publications

References 34 publications

A systematic review of extended reality (XR) for understanding and augmenting vision loss

A systematic review of extended reality (XR) for understanding and augmenting vision loss

Towards a Smart Bionic Eye: AI-powered artificial vision for the treatment of incurable blindness

Adaptive Interfacial Materials and Implants for Visual Restoration

Contact Info

Product

Resources

About