Effects of Scene and Human Action Auditory Icons in Stereophonic Image Sonification System

Mashiba, Yuichi; Salih, Hisham Elser Bilal; Wakatsuki, Naoto; Mizutani, Koichi; Zempo, Keiichi

doi:10.1109/icce-taiwan55306.2022.9869092

Search citation statements

Order By: Relevance

Paper Sections

Select...

Introduction1

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2022

Publication Types

Select...

Article1

Relationship

Self Cite1

Independent0

Authors

Journals

Cited by 1 publication

(1 citation statement)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The results of these experiments suggest that our method is useful. Furthermore, we have developed an image sonification system that adds scene sounds and human action sounds as auditory elements and have reported the effect of the added sounds in improving the sense of presence 14) . The underlying reason is that the images we usually share are clipped scenes and do not include sound sources that characterize the scene.…”

Section: Introductionmentioning

confidence: 99%

[Paper] Image Sonification System Based on Auditory Icons and Stereophonic Presentation Considering Image Scenes and Human Action

Mashiba

Salih

Wakatsuki

et al. 2022

MTA

Self Cite

View full text Add to dashboard Cite

In this paper, we develop an automatic image sonification system using auditory icons and their stereophonic presentation. We evaluated the effects of scene sounds and action sounds on the understanding of the scene and the sense of presence. The results showed that the scene sounds contributed to the understanding of the scene and the sense of presence and that action sounds also improved the sense of presence. On the other hand, it was confirmed that object sounds alone can convey scene information in images and have a high index of sense of presence. Our sonification system is expected to provide not only a more immersive experience for sighted people through images but also an opportunity for people with visual impairments to share the experience through social networking services (SNSs).

show abstract

Section: Introductionmentioning

confidence: 99%