Previous brain imaging studies have demonstrated responses to tactile and auditory stimuli in visual cortex of blind subjects, suggesting that removal of one sensory modality leads to neural reorganization of the remaining modalities. To investigate whether similar 'cross-modal' plasticity occurs in human auditory cortex, we used functional magnetic resonance imaging (fMRI) to measure visually evoked activity in auditory areas of both early-deafened and hearing individuals. Here we find that deaf subjects exhibit activation in a region of the right auditory cortex, corresponding to Brodmann's areas 42 and 22, as well as in area 41 (primary auditory cortex), demonstrating that early deafness results in the processing of visual stimuli in auditory cortex.

Maintaining close proximity between the electrode array and the retinal surface is critical in developing a successful retinal implant. With the development of chronic electrode arrays that are stable and flush on the retinal surface, it is likely that the influence of other factors such as electrode size, retinal degeneration, and subject age will become more apparent. (ClinicalTrials.gov number, NCT00279500.).

Degenerative retinal diseases such as retinitis pigmentosa and macular degeneration cause irreversible vision loss in more than 10 million people worldwide. Retinal prostheses, now implanted in over 250 patients worldwide, electrically stimulate surviving cells in order to evoke neuronal responses that are interpreted by the brain as visual percepts (‘phosphenes’). However, instead of seeing focal spots of light, current implant users perceive highly distorted phosphenes that vary in shape both across subjects and electrodes. We characterized these distortions by asking users of the Argus retinal prosthesis system (Second Sight Medical Products Inc.) to draw electrically elicited percepts on a touchscreen. Using ophthalmic fundus imaging and computational modeling, we show that elicited percepts can be accurately predicted by the topographic organization of optic nerve fiber bundles in each subject’s retina, successfully replicating visual percepts ranging from ‘blobs’ to oriented ‘streaks’ and ‘wedges’ depending on the retinal location of the stimulating electrode. This provides the first evidence that activation of passing axon fibers accounts for the rich repertoire of phosphene shape commonly reported in psychophysical experiments, which can severely distort the quality of the generated visual experience. Overall our findings argue for more detailed modeling of biological detail across neural engineering applications.