Visual experiences in the blind induced by an auditory sensory substitution device

Ward, Jamie; Meijer, Peter

doi:10.1016/j.concog.2009.10.006

Cited by 169 publications

(161 citation statements)

References 28 publications

Supporting

Mentioning

155

Contrasting

Unclassified

Order By: Relevance

“…However, the primary blind, had a more straight forward audio to image matching; without getting involved with the algorithm and definitions, relating the sounds to configurations. Thus, an intuition of light and darkness is expected by long term use of the device [4].…”

Section: Resultsmentioning

confidence: 99%

“…In the environmental use of the device is involved with depth, motion and color perception. Considering high resolution, ease of training procedure, fast processing for dynamic objects and ability of depth perception, vOICe takes precedence over the other [4].…”

Section: Figure 1 General Overview Of Sensory Substitution Prototypementioning

confidence: 99%

“…In PSVA, each pixel refers to a specific sinusoidal wave frequency and the pixel luminance is assigned to the sound loudness [2]. While, vOICe and EyeMusic encode vertical coordination to individual frequencies [4,6,7]. The image in vOICe is gray scaled, whereas EyeMusic can demonstrate colors by using musical instruments such as Reggae Organ, Rapman's Reed, choir, string and Brass instruments in pentatonic scales.…”

mentioning

confidence: 99%

“…The prosthesis is substituting vision by audition (PSVA) [2], vOICe [4] and EyeMusic [6,7,1] are the well-known devices in vision to the auditory conversion field which contain a set of camera and speaker as a connection to the environment. Figure 1 is an illustration of this connection.…”

mentioning

confidence: 99%

See 3 more Smart Citations

VBTones a visual to auditory device for the blind

Riahi¹,

Mirhoseini²,

Mehrbani³

2017

IJACR

View full text Add to dashboard Cite

Section: Resultsmentioning

confidence: 99%

Section: Figure 1 General Overview Of Sensory Substitution Prototypementioning

confidence: 99%

mentioning

confidence: 99%

mentioning

confidence: 99%

See 2 more Smart Citations

VBTones a visual to auditory device for the blind

Riahi¹,

Mirhoseini²,

Mehrbani³

2017

IJACR

View full text Add to dashboard Cite

“…Users may report visual phenomenology to sounds or touch (Ward & Meijer, 2010) and have been shown to be susceptible to visual illusions delivered via a substituting sense (Renier, et al, 2005). Despite these impressive findings there remains a lack of knowledge concerning how visual images should be converted into sounds to enable efficient perception and learning.…”

Section: Articlementioning

confidence: 99%

The evolution of a visual-to-auditory sensory substitution device using interactive genetic algorithms

Wright

Ward

2013

Quarterly Journal of Experimental Psychology

Self Cite

View full text Add to dashboard Cite

Sensory substitution is a promising technique for mitigating the loss of a sensory modality. Sensory substitution devices (SSDs) work by converting information from the impaired sense (e.g., vision) into another, intact sense (e.g., audition). However, there are a potentially infinite number of ways of converting images into sounds, and it is important that the conversion takes into account the limits of human perception and other user-related factors (e.g., whether the sounds are pleasant to listen to). The device explored here is termed “polyglot” because it generates a very large set of solutions. Specifically, we adapt a procedure that has been in widespread use in the design of technology but has rarely been used as a tool to explore perception—namely, interactive genetic algorithms. In this procedure, a very large range of potential sensory substitution devices can be explored by creating a set of “genes” with different allelic variants (e.g., different ways of translating luminance into loudness). The most successful devices are then “bred” together, and we statistically explore the characteristics of the selected-for traits after multiple generations. The aim of the present study is to produce design guidelines for a better SSD. In three experiments, we vary the way that the fitness of the device is computed: by asking the user to rate the auditory aesthetics of different devices (Experiment 1), and by measuring the ability of participants to match sounds to images (Experiment 2) and the ability to perceptually discriminate between two sounds derived from similar images (Experiment 3). In each case, the traits selected for by the genetic algorithm represent the ideal SSD for that task. Taken together, these traits can guide the design of a better SSD.

show abstract

Wearables

Kane¹

2019

Human–Computer Interaction Series

View full text Add to dashboard Cite

Visual experiences in the blind induced by an auditory sensory substitution device

Cited by 169 publications

References 28 publications

VBTones a visual to auditory device for the blind

VBTones a visual to auditory device for the blind

The evolution of a visual-to-auditory sensory substitution device using interactive genetic algorithms

Wearables

Contact Info

Product

Resources

About