Two-dimensional shape discrimination by sighted people using simulated virtual echoes

Fujitsuka, Yumi; Sumiya, Miwa; Ashihara, Kaoru; Yoshino, Katsumi; Nagatani, Yoshiki; Kobayasi, Kohta I.; Hiryu, Shizuko

doi:10.1121/10.0003194

Cited by 5 publications

(2 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…5 b and see Additional file 2 : Movie S2 and Additional file 3 : Movie S3). In other words, in sound-based object recognition, solely information from the direct wave and diffracted wave from the edge is contained in the echoes [ 21 ]. In this study, the direct wave from the surface and the diffracted wave from the edge of the acrylic sheet were returned as echoes, and the echo localization point appeared on both sides.…”

Section: Discussionmentioning

confidence: 99%

Analysis of echolocation behavior of bats in “echo space” using acoustic simulation

et al. 2022

Self Cite

View full text Add to dashboard Cite

Background Echolocating bats use echo information to perceive space, control their behavior, and adjust flight navigation strategies in various environments. However, the echolocation behavior of bats, including echo information, has not been thoroughly investigated as it is technically difficult to measure all the echoes that reach the bats during flight, even with the conventional telemetry microphones currently in use. Therefore, we attempted to reproduce the echoes received at the location of bats during flight by combining acoustic simulation and behavioral experiments with acoustic measurements. By using acoustic simulation, echoes can be reproduced as temporal waveforms (including diffracted waves and multiple reflections), and detailed echo analysis is possible even in complex obstacle environments. Results We visualized the spatiotemporal changes in the echo incidence points detected by bats during flight, which enabled us to investigate the “echo space” revealed through echolocation for the first time. We then hypothesized that by observing the differences in the “echo space” before and after spatial learning, the bats’ attentional position would change. To test this hypothesis, we examined how the distribution of visualized echoes concentrated at the obstacle edges after the bats became more familiar with their environment. The echo incidence points appeared near the edge even when the pulse direction was not toward the edge. Furthermore, it was found that the echo direction correlated with the turn rate of the bat’s flight path, revealing for the first time the relationship between the echo direction and the bat’s flight path. Conclusions We were able to clarify for the first time how echoes space affects echolocation behavior in bats by combining acoustic simulations and behavioral experiments.

show abstract

Section: Discussionmentioning

confidence: 99%

Analysis of echolocation behavior of bats in “echo space” using acoustic simulation

et al. 2022

Self Cite

View full text Add to dashboard Cite

show abstract

“…In humans, echolocation-based object recognition is far less well understood, although both blind and sighted individuals have demonstrated some ability to use echoes to discriminate material textures ( Hausfeld et al, 1982 ; Milne et al, 2015b ; Sumiya et al, 2019 ) and gross object or surface shape ( Thaler et al, 2011 ; Arnott et al, 2013 ; Milne et al, 2014 ; Sumiya et al, 2019 ), with down-pitched artificial ultrasonic echoes potentially facilitating performance ( Sumiya et al, 2019 ; Fujitsuka et al, 2021 ). Because these tasks probed unisensory echoacoustic discrimination, it remains largely unknown how this echoic object information is encoded, e.g., as a strictly echoacoustic representation or a more abstracted representation useful in real-world multisensory scenarios (e.g., echolocating an object to grasp or move it).…”

Section: Introductionmentioning

confidence: 99%

Object recognition via echoes: quantifying the crossmodal transfer of three-dimensional shape information between echolocation, vision, and haptics

Teng,

Danforth,

Paternoster

et al. 2024

Front. Neurosci.

View full text Add to dashboard Cite

Active echolocation allows blind individuals to explore their surroundings via self-generated sounds, similarly to dolphins and other echolocating animals. Echolocators emit sounds, such as finger snaps or mouth clicks, and parse the returning echoes for information about their surroundings, including the location, size, and material composition of objects. Because a crucial function of perceiving objects is to enable effective interaction with them, it is important to understand the degree to which three-dimensional shape information extracted from object echoes is useful in the context of other modalities such as haptics or vision. Here, we investigated the resolution of crossmodal transfer of object-level information between acoustic echoes and other senses. First, in a delayed match-to-sample task, blind expert echolocators and sighted control participants inspected common (everyday) and novel target objects using echolocation, then distinguished the target object from a distractor using only haptic information. For blind participants, discrimination accuracy was overall above chance and similar for both common and novel objects, whereas as a group, sighted participants performed above chance for the common, but not novel objects, suggesting that some coarse object information (a) is available to both expert blind and novice sighted echolocators, (b) transfers from auditory to haptic modalities, and (c) may be facilitated by prior object familiarity and/or material differences, particularly for novice echolocators. Next, to estimate an equivalent resolution in visual terms, we briefly presented blurred images of the novel stimuli to sighted participants (N = 22), who then performed the same haptic discrimination task. We found that visuo-haptic discrimination performance approximately matched echo-haptic discrimination for a Gaussian blur kernel σ of ~2.5°. In this way, by matching visual and echo-based contributions to object discrimination, we can estimate the quality of echoacoustic information that transfers to other sensory modalities, predict theoretical bounds on perception, and inform the design of assistive techniques and technology available for blind individuals.

show abstract

Auditory orientation and distance estimation of sighted humans using virtual echolocation with artificial and self-generated sounds

Steffens

Schütte

Ewert

2022

JASA Express Letters

View full text Add to dashboard Cite

Active echolocation of sighted humans using predefined synthetic and self-emitted sounds, as habitually used by blind individuals, was investigated. Using virtual acoustics, distance estimation and directional localization of a wall in different rooms were assessed. A virtual source was attached to either the head or hand with realistic or increased source directivity. A control condition was tested with a virtual sound source located at the wall. Untrained echolocation performance comparable to performance in the control condition was achieved on an individual level. On average, the echolocation performance was considerably lower than in the control condition, however, it benefitted from increased directivity.

show abstract

Two-dimensional shape discrimination by sighted people using simulated virtual echoes

Cited by 5 publications

References 16 publications

Analysis of echolocation behavior of bats in “echo space” using acoustic simulation

Analysis of echolocation behavior of bats in “echo space” using acoustic simulation

Object recognition via echoes: quantifying the crossmodal transfer of three-dimensional shape information between echolocation, vision, and haptics

Auditory orientation and distance estimation of sighted humans using virtual echolocation with artificial and self-generated sounds

Contact Info

Product

Resources

About