Effectiveness of Multisensory Methods in Learning Onomatopoeia for the Hearing-Impaired

Namatame, Miki; Kanebako, Junichi; Kusunoki, Fusako; Inagaki, Shigenori

doi:10.1007/978-3-030-21151-6_1

Cited by 3 publications

(2 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In such a situation, DHH people have difficulty receiving environmental sound information, which makes it difficult for them to perform environmental sound recognition (ESR) in their everyday life and make decisions based on auditory information, as is the case for people with normal hearing. For some cochlear implant patients, environmental rehabilitation may be beneficial [3], with the potential for low-cost and effective rehabilitation using ESR [4], and the application of sound visualization techniques using onomatopoeia [5] have been developed. Pick-by-Vision, which uses smart glasses to visually assist order pickers in their work tasks, has also been demonstrated [3][4][5][6].…”

Section: Introduction Background and Previous Researchmentioning

confidence: 99%

“…For some cochlear implant patients, environmental rehabilitation may be beneficial [3], with the potential for low-cost and effective rehabilitation using ESR [4], and the application of sound visualization techniques using onomatopoeia [5] have been developed. Pick-by-Vision, which uses smart glasses to visually assist order pickers in their work tasks, has also been demonstrated [3][4][5][6].…”

Section: Introduction Background and Previous Researchmentioning

confidence: 99%

See 1 more Smart Citation

Augmented-Reality Presentation of Household Sounds for Deaf and Hard-of-Hearing People

Asakura

2023

Sensors

View full text Add to dashboard Cite

Normal-hearing people use sound as a cue to recognize various events that occur in their surrounding environment; however, this is not possible for deaf and hearing of hard (DHH) people, and in such a context they may not be able to freely detect their surrounding environment. Therefore, there is an opportunity to create a convenient device that can detect sounds occurring in daily life and present them visually instead of auditorily. Additionally, it is of great importance to appropriately evaluate how such a supporting device would change the lives of DHH people. The current study proposes an augmented-reality-based system for presenting household sounds to DHH people as visual information. We examined the effect of displaying both the icons indicating sounds classified by machine learning and a dynamic spectrogram indicating the real-time time–frequency characteristics of the environmental sounds. First, the issues that DHH people perceive as problems in their daily lives were investigated through a survey, suggesting that DHH people need to visualize their surrounding sound environment. Then, after the accuracy of the machine-learning-based classifier installed in the proposed system was validated, the subjective impression of how the proposed system increased the comfort of daily life was obtained through a field experiment in a real residence. The results confirmed that the comfort of daily life in household spaces can be improved by combining not only the classification results of machine learning but also the real-time display of spectrograms.

show abstract

Section: Introduction Background and Previous Researchmentioning

confidence: 99%

Section: Introduction Background and Previous Researchmentioning

confidence: 99%

Augmented-Reality Presentation of Household Sounds for Deaf and Hard-of-Hearing People

Asakura

2023

Sensors

View full text Add to dashboard Cite

show abstract

Miruoto : Sports event atmosphere visual rendering through real-time image and sound processing system

Gourmelen,

Toriya,

Miya

et al. 2024

Special Interest Group on Computer Graphics and Interactive Techniques Conference Emerging Technologies

View full text Add to dashboard Cite

Recent Developments in Haptic Devices Designed for Hearing-Impaired People: A Literature Review

Ramones

Rio

2023

Sensors

View full text Add to dashboard Cite

Haptic devices transmit information to the user, using tactile stimuli to augment or replace sensory input. People with limited sensory abilities, such as vision or hearing can receive supplementary information by relying on them. This review analyses recent developments in haptic devices for deaf and hard-of-hearing individuals by extracting the most relevant information from each of the selected papers. The process of finding relevant literature is detailed using the PRISMA guidelines for literature reviews. In this review, the devices are categorized to better understand the review topic. The categorization results have highlighted several areas of future research into haptic devices for hearing-impaired users. We believe this review may be useful to researchers interested in haptic devices, assistive technologies, and human–computer interaction.

show abstract

Effectiveness of Multisensory Methods in Learning Onomatopoeia for the Hearing-Impaired

Cited by 3 publications

References 17 publications

Augmented-Reality Presentation of Household Sounds for Deaf and Hard-of-Hearing People

Augmented-Reality Presentation of Household Sounds for Deaf and Hard-of-Hearing People

Miruoto : Sports event atmosphere visual rendering through real-time image and sound processing system

Recent Developments in Haptic Devices Designed for Hearing-Impaired People: A Literature Review

Contact Info

Product

Resources

About