A Dynamic AI System for Extending the Capabilities of Blind People

Grayson, Martin; Thieme, Anja; Marques, Rita Faia; Massiceti, Daniela; Cutrell, Ed; Morrison, Cecily

doi:10.1145/3334480.3383142

Cited by 24 publications

(9 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When designing their systems, researchers had to find the right balance between those points, depending on the purpose at which they were aiming. One of the most common solutions is to use smartphones equipped with RGB-D or monocular cameras and position sensors (accelerometers, gyroscopes, and magnetometers), as shown in examples [27][28][29]33,42,44]. Another solution is the introduction of infra-red or laser sensors in the acquisition system, a choice made in articles [23,32,45].…”

Section: Data-acquisition Toolsmentioning

confidence: 99%

A Survey on Recent Advances in AI and Vision-Based Methods for Helping and Guiding Visually Impaired People

et al. 2022

View full text Add to dashboard Cite

We present in this paper the state of the art and an analysis of recent research work and achievements performed in the domain of AI-based and vision-based systems for helping blind and visually impaired people (BVIP). We start by highlighting the recent and tremendous importance that AI has acquired following the use of convolutional neural networks (CNN) and their ability to solve image classification tasks efficiently. After that, we also note that VIP have high expectations about AI-based systems as a possible way to ease the perception of their environment and to improve their everyday life. Then, we set the scope of our survey: we concentrate our investigations on the use of CNN or related methods in a vision-based system for helping BVIP. We analyze the existing surveys, and we study the current work (a selection of 30 case studies) using several dimensions such as acquired data, learned models, and human–computer interfaces. We compare the different approaches, and conclude by analyzing future trends in this domain.

show abstract

Section: Data-acquisition Toolsmentioning

confidence: 99%

A Survey on Recent Advances in AI and Vision-Based Methods for Helping and Guiding Visually Impaired People

et al. 2022

View full text Add to dashboard Cite

show abstract

“…Proita et al reported that wearable devices have more social acceptability if it visually indicates that the device is being used for assistive purposes [107]. Grayson et al suggested using diferent light indicators to alert bystanders of the type of information the system is recording [64]. We also observed similar ideas from our visually impaired participants, who felt more comfortable receiving information if the camera were visible to sighted bystanders, e.g., łas the camera is visible to others, I would feel comfortable getting the information as there's no deception going on here (PV73)ž.…”

Section: Ethical Considerations Of Detecting Gender Race and Emotionmentioning

confidence: 99%

Shared Privacy Concerns of the Visually Impaired and Sighted Bystanders with Camera-Based Assistive Technologies

Akter

Ahmed

Kapadia

et al. 2022

ACM Trans. Access. Comput.

View full text Add to dashboard Cite

Camera based assistive technologies can provide people with visual impairments (PVIs) visually derived information about people in their vicinity. Furthermore, the advent of smart glasses offers the possibility of not only analyzing visual information in front of the wearer, but also behind them through an extended field of view. Although such ‘visually available’ information can enhance one’s social interactions, the privacy and ethical implications for automated judgments about bystanders especially from the perspective of PVIs remains underexplored. To study the concerns of both bystanders and PVIs with such technologies, we conducted two online surveys with visually impaired participants as wearers (N=128) and sighted participants as bystanders (N=136). Although PVIs found some types of information to be improper or impolite (such as someone’s weight), our overarching finding is the shared ethical concern between PVIs and bystanders related to the fallibility of AI, where bystanders can be misrepresented (algorithmically) by the devices. These mischaracterizations can range from occasional, unexpected algorithmic errors (e.g., errors in facial recognition) to the questionable use of AI for determining subjective, social constructs (such as gender). Based on our findings, we discuss the design implications and directions for future work in the development of camera based assistive technologies while mitigating the ethical concerns of PVIs and bystanders.

show abstract

“…The relative spatial representation of nearby people with respect to a user has been proposed elsewhere (e.g. [1,21]). Here, though, a particular investment could be put into exploring ways to track the relative location and distance between a user and a guide.…”

Section: Ruptures and Repairsmentioning

confidence: 99%

Interdependence in Action

Vincenzi

Taylor

Stumpf

2021

Proc. ACM Hum.-Comput. Interact.

View full text Add to dashboard Cite

Prior work on AI-enabled assistive technology (AT) for people with visual impairments (VI) has treated navigation largely as an independent activity. Consequently, much effort has focused on providing individual users with wayfinding details about the environment, including information on distances, proximity, obstacles, and landmarks. However, independence is also achieved by people with VI through interacting with others, such as in collaboration with sighted guides. Drawing on the concept of interdependence, this research presents a systematic analysis of sighted guiding partnerships. Using interaction analysis as our primary mode of data analysis, we conducted an empirical, qualitative study with 4 couples, each made up of person with a vision impairment and their sighted guide. Our results show how pairs used interactional resources such as turn-taking and body movements to both co-constitute a common space for navigation, and repair moments of rupture to this space. This work is used to present an exemplary case of interdependence and draws out implications for designing AI-enabled AT that shifts the emphasis away from independent navigation, and towards the carefully coordinated actions between people navigating together.CCS Concepts: • Human-centered computing → Accessibility; Accessibility technologies; Accessibility design and evaluation methods; Empirical studies in accessibility;

show abstract

A Dynamic AI System for Extending the Capabilities of Blind People

Cited by 24 publications

References 5 publications

A Survey on Recent Advances in AI and Vision-Based Methods for Helping and Guiding Visually Impaired People

A Survey on Recent Advances in AI and Vision-Based Methods for Helping and Guiding Visually Impaired People

Shared Privacy Concerns of the Visually Impaired and Sighted Bystanders with Camera-Based Assistive Technologies

Interdependence in Action

Contact Info

Product

Resources

About