Audio–Vision Substitution for Blind Individuals: Addressing Human Information Processing Capacity Limitations

Brown, David; Proulx, Michael J.

doi:10.1109/jstsp.2016.2543678

Cited by 26 publications

(14 citation statements)

References 66 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…On the one hand, recent studies demonstrated that object recognition through VASSD is affected by capacity and resolution limitations related to the processing of auditory stimuli (Brown et al, 2014; Brown and Proulx, 2016). On the other hand, the description of supramodal responses recently moved from simpler perceptual to more cognitive stimuli, such as actions or events, to emotion and social functioning (Bedny et al, 2009; Ricciardi et al, 2009; Klinge et al, 2010; Mahon et al, 2010).…”

Section: A Contribution To Visual Rehabilitation and Future Challengesmentioning

confidence: 99%

Are Supramodality and Cross-Modal Plasticity the Yin and Yang of Brain Development? From Blindness to Rehabilitation

Cecchetti

Kupers

Ptito

et al. 2016

Front. Syst. Neurosci.

View full text Add to dashboard Cite

Research in blind individuals has primarily focused for a long time on the brain plastic reorganization that occurs in early visual areas. Only more recently, scientists have developed innovative strategies to understand to what extent vision is truly a mandatory prerequisite for the brain’s fine morphological architecture to develop and function. As a whole, the studies conducted to date in sighted and congenitally blind individuals have provided ample evidence that several “visual” cortical areas develop independently from visual experience and do process information content regardless of the sensory modality through which a particular stimulus is conveyed: a property named supramodality. At the same time, lack of vision leads to a structural and functional reorganization within “visual” brain areas, a phenomenon known as cross-modal plasticity. Cross-modal recruitment of the occipital cortex in visually deprived individuals represents an adaptative compensatory mechanism that mediates processing of non-visual inputs. Supramodality and cross-modal plasticity appears to be the “yin and yang” of brain development: supramodal is what takes place despite the lack of vision, whereas cross-modal is what happens because of lack of vision. Here we provide a critical overview of the research in this field and discuss the implications that these novel findings have for the development of educative/rehabilitation approaches and sensory substitution devices (SSDs) in sensory-impaired individuals.

show abstract

Section: A Contribution To Visual Rehabilitation and Future Challengesmentioning

confidence: 99%

Are Supramodality and Cross-Modal Plasticity the Yin and Yang of Brain Development? From Blindness to Rehabilitation

Cecchetti

Kupers

Ptito

et al. 2016

Front. Syst. Neurosci.

View full text Add to dashboard Cite

show abstract

“…htm). Some researches from cognitive science also tried to explain how the brain processes the sound of VOICE [22,23]. The main drawback of VOICE is that it conveys color images to VIP, which is a very low level sonification, and they usually need a long time to learn how to infer 3D environments from the sound.…”

Section: Related Workmentioning

confidence: 99%

A Comparative Study in Real-Time Scene Sonification for Visually Impaired People

Wang

Yang

et al. 2020

Sensors

View full text Add to dashboard Cite

In recent years, with the development of depth cameras and scene detection algorithms, a wide variety of electronic travel aids for visually impaired people have been proposed. However, it is still challenging to convey scene information to visually impaired people efficiently. In this paper, we propose three different auditory-based interaction methods, i.e., depth image sonification, obstacle sonification as well as path sonification, which convey raw depth images, obstacle information and path information respectively to visually impaired people. Three sonification methods are compared comprehensively through a field experiment attended by twelve visually impaired participants. The results show that the sonification of high-level scene information, such as the direction of pathway, is easier to learn and adapt, and is more suitable for point-to-point navigation. In contrast, through the sonification of low-level scene information, such as raw depth images, visually impaired people can understand the surrounding environment more comprehensively. Furthermore, there is no interaction method that is best suited for all participants in the experiment, and visually impaired individuals need a period of time to find the most suitable interaction method. Our findings highlight the features and the differences of three scene detection algorithms and the corresponding sonification methods. The results provide insights into the design of electronic travel aids, and the conclusions can also be applied in other fields, such as the sound feedback of virtual reality applications.

show abstract

“…More recent, and highly promising, is the auditory device The vOICe [65]. It has been studied extensively for localization [66] and object identification [67]. There have been numerous neuroscience studies showing that The vOICe activates visual cortex in the blind as they perform tasks with images -suggesting that one can truly 'see' with the sound output of the device [68].…”

Section: Assistive Devices For Blind and Visually Impaired Personsmentioning

confidence: 99%

An Overview of Assistive Devices for Blind and Visually Impaired People

Hu¹,

Chen²,

Zhai³

et al. 2019

International Journal of Robotics and Automation

View full text Add to dashboard Cite

Across the world, there are approximately 253 million people with vision impairments, and assistive devices have constantly been in demand. Advanced research has led to the development of numerous assistive devices for blind people and visually impaired people (VIP) to improve their quality of life. An overview of these different types of assistive devices such as canes, glasses, hats and gloves is presented in this survey. A FCBPSS (F: function, C: context, B: behaviour, P: principle, S: state, S: structure) architecture of visual impairment assistance system is preliminarily proposed to allow other researchers to design the assistive devices with the good experience and the high performance for blind people and VIPs in the future. As VIPs and blind people may have different behaviour patterns, a criterion for classifying different types of vision impairments is presented. Subsequently, we classify the substitutive senses for visual perception into five categories: vision enhancement, audition, somatosense, visual prosthesis, and olfactory and gustation. Two commonly used feedback forms, namely audition and vibration, are elaborated.Based on literature survey, we also present a summary prospective of the development of assistive devices: add more sensing and feedback modules, use the knowledge of perception mechanism and behaviour pattern as the design guideline and design more reliable validation experiments.

show abstract

Audio–Vision Substitution for Blind Individuals: Addressing Human Information Processing Capacity Limitations

Cited by 26 publications

References 66 publications

Are Supramodality and Cross-Modal Plasticity the Yin and Yang of Brain Development? From Blindness to Rehabilitation

Are Supramodality and Cross-Modal Plasticity the Yin and Yang of Brain Development? From Blindness to Rehabilitation

A Comparative Study in Real-Time Scene Sonification for Visually Impaired People

An Overview of Assistive Devices for Blind and Visually Impaired People

Contact Info

Product

Resources

About