Spot-Presentation of Stereophonic Earcons to Assist Navigation for the Visually Impaired

Mashiba, Yuichi; Iwaoka, Ryunosuke; Salih, Hisham Elser Bilal; Kawamoto, Masayuki; Wakatsuki, Naoto; Mizutani, Koichi; Zempo, Keiichi

doi:10.3390/mti4030042

Cited by 6 publications

(2 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Figure 2(d) shows an interpersonal situation that can occur only in VE. A situation in which only sound exists cannot occur in RE unless the illusionary phenomenon of acoustic AR devices such as [89]- [91] is used. In RE, a sound source does not suddenly appear from a single point in an empty space; there is always an object that can be visually confirmed as a sound source.…”

Section: Research Questionsmentioning

confidence: 99%

Mouth-in-the-Door: The Effect of a Sound Image of an Avatar Intruding on Personal Space That Deviates in Position From the Visual Image

et al. 2022

View full text Add to dashboard Cite

In this paper, we examine the audiovisual experience in virtual reality (VR) service context that enables a more effective interaction between a user immersed in a virtual environment (VE) and an avatar as a store staff. By utilizing the characteristics of VE experiences, we find the effects of this unrealistic relationship between the visual and auditory positions of the avatar presented to the user variable rather than uniformly presented in the same position. In this study, we conducted an experiment to investigate how the positional deviation between the sound and visual images can be tolerated in VE, the effect of positional deviation on the interpersonal distance to the avatar, and the possibility of manipulating the impression of the avatar by deviating the sound image from the visual image. For the experiment, we prepared a space resembling a VE store and conducted proximity experiments with 16 gender-balanced participants and six types of avatars. By utilizing the superiority of visual information over auditory information revealed in the experiments, we constructed an interpersonal situation with an avatar playing the role of store staff in which only the sound image intruded into the user's personal space, and we investigated users' impressions of the avatar. We also investigated users' impressions of the avatar. We found the following two phenomena in the experimental conditions where the positional difference was allowed: 1) Even when the positional difference was allowed, it caused an "uncanny valley"-like phenomenon that led to a decrease in rapport; and 2) In the conditions where the positional difference was allowed when the sound image was closer than the visual image to the participant, the rapport was greater with the avatar playing the role of the store staff. This phenomenon is similar to the "foot-in-the-door" phenomenon in which small unconscious consent (i.e., allowing a sound image to intrude on one's personal space) leads to an improvement in the evaluation of the other person (i.e., the rapport with another person). The techniques proposed in this paper, such as the positional difference between the sound and visual images, significantly improve the value of the service experiences obtained through interaction with others in VE.INDEX TERMS interaction, interpersonal service, personal space, service on metaverse, ventriloquism effect I. INTRODUCTION A. BACKGROUNDServices such as stores and offices in virtual environments (VEs) currently exist, and it is expected that the use of VE and communication based on the metaverse will become mainstream in the future [1]. The virtual reality (VR) market

show abstract

Section: Research Questionsmentioning

confidence: 99%

Mouth-in-the-Door: The Effect of a Sound Image of an Avatar Intruding on Personal Space That Deviates in Position From the Visual Image

et al. 2022

View full text Add to dashboard Cite

show abstract

“…Generally, the indoor navigation system navigates the users within certain environment such as home and smart campus. [13][14][15] Data analysis is generally taken place in the smart device (can be electronic cane), local systems (can be laptop or smartphone) or cloud data storage. 16 Each method has some limitation as: (i) device based analysis lacks since the smart devices have only limited resources and (ii) cloud based data analysis increases latency and delay.…”

Section: Introductionmentioning

confidence: 99%

Multi-obstacle aware smart navigation system for visually impaired people in fog connected IoT-cloud environment

Mueen

Awedh

Zafar

2022

Health Informatics J

View full text Add to dashboard Cite

Design of smart navigation for visually impaired/blind people is a hindering task. Existing researchers analyzed it in either indoor or outdoor environment and also it’s failed to focus on optimum route selection, latency minimization and multi-obstacle presence. In order to overcome these challenges and to provide precise assistance to visually impaired people, this paper proposes smart navigation system for visually impaired people based on both image and sensor outputs of the smart wearable. The proposed approach involves the upcoming processes: (i) the input query of the visually impaired people (users) is improved by the query processor in order to achieve accurate assistance. (ii) The safest route from source to destination is provided by implementing Environment aware Bald Eagle Search Optimization algorithm in which multiple routes are identified and classified into three different classes from which the safest route is suggested to the users. (iii) The concept of fog computing is leveraged and the optimal fog node is selected in order to minimize the latency. The fog node selection is executed by using Nearest Grey Absolute Decision Making Algorithm based on multiple parameters. (iv) The retrieval of relevant information is performed by means of computing Euclidean distance between the reference and database information. (v) The multi-obstacle detection is carried out by YOLOv3 Tiny in which both the static and dynamic obstacles are classified into small, medium and large obstacles. (vi) The decision upon navigation is provided by implementing Adaptive Asynchronous Advantage Actor-Critic (A3C) algorithm based on fusion of both image and sensor outputs. (vii) Management of heterogeneous is carried out by predicting and pruning the fault data in the sensor output by minimum distance based extended kalman filter for better accuracy and clustering the similar information by implementing Spatial-Temporal Optics Clustering Algorithm to reduce complexity. The proposed model is implemented in NS 3.26 and the results proved that it outperforms other existing works in terms of obstacle detection and task completion time.

show abstract

Spatialphonic360: Accuracy of the Arbitrary Sound Image Presentation using Surrounding Parametric Speakers

Kuratomo

Uchida

Ebihara

et al. 2022

Companion Proceedings of the 2022 Conference on Interactive Surfaces and Spaces

View full text Add to dashboard Cite

Spot-Presentation of Stereophonic Earcons to Assist Navigation for the Visually Impaired

Cited by 6 publications

References 29 publications

Mouth-in-the-Door: The Effect of a Sound Image of an Avatar Intruding on Personal Space That Deviates in Position From the Visual Image

Mouth-in-the-Door: The Effect of a Sound Image of an Avatar Intruding on Personal Space That Deviates in Position From the Visual Image

Multi-obstacle aware smart navigation system for visually impaired people in fog connected IoT-cloud environment

Spatialphonic360: Accuracy of the Arbitrary Sound Image Presentation using Surrounding Parametric Speakers

Contact Info

Product

Resources

About