A Device for Human Ultrasonic Echolocation

Abstract

Objective-We present a device that combines principles of ultrasonic echolocation and spatial hearing to provide human users with environmental cues that are 1) not otherwise available to the human auditory system and 2) richer in object, and spatial information than the more heavily processed sonar cues of other assistive devices. The device consists of a wearable headset with an ultrasonic emitter and stereo microphones with affixed artificial pinnae. The goal of this study is to describe the device and evaluate the utility of the echoic information it provides.Methods-The echoes of ultrasonic pulses were recorded and time-stretched to lower their frequencies into the human auditory range, then played back to the user. We tested performance among naive and experienced sighted volunteers using a set of localization experiments in which the locations of echo-reflective surfaces were judged using these time stretched echoes.Results-Naive subjects were able to make laterality and distance judgments, suggesting that the echoes provide innately useful information without prior training. Naive subjects were generally unable to make elevation judgments from recorded echoes. However trained subjects demonstrated an ability to judge elevation as well.Conclusion-This suggests that the device can be used effectively to examine the environment and that the human auditory system can rapidly adapt to these artificial echolocation cues.

Energy landscapes for machine learning

“…The ambition to develop more fundamental connections between machine learning disciplines and computational chemical physics could be very productive. For example, there have recently been many physics-inspired contributions in machine learning, including thermodynamics-based models for rational decision-making 130 , generative models from nonequilibrium simulations 131 . The hope is that such connections can provide better intuition about the machine learning problems in question, and perhaps also the underlying physical theories used to understand them.…”

Echolocation in humans: an overview

“…Over the years various technological assistive devices for people with vision impairments have been developed based on the echolocation principle . Some of these devices are distance measures or localization devices; that is, these devices send out an ultrasonic pulse and then transform the incoming information into a secondary signal about distance and location, which is then fed back to the user.…”

The Task of Walking Straight as an Interactive Serious Game for Blind Children

“…Many sensory substitution devices have been proposed to help blind people's navigation by transforming images into sound (for example Sonic Eye [16]) or haptic output [17]. Nevertheless, these devices suffer of a very low user acceptance due to invasiveness, cognitive load, need of specific training, lack of multisensory integration and action perception link, lack of clinical validations [18].…”