Visualization system for sound field using see-through head-mounted display

Inoue, Atsuto; Ikeda, Yusuke; Yatabe, Kohei; Oikawa, Yasuhiro

doi:10.1250/ast.40.1

Cited by 17 publications

(3 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Such a technology blends physical and digital worlds for providing natural and intuitive interactions between humans, computers, and the environment. In recent years, MR, which blends real and virtual worlds, has been attracting attention as a visualization method for improving landscape management [13,14]. Van Krevelen et al applied MR-based landscape visualization is achieved by superimposing a three-dimensional computer graphics model based on planning and design onto live images captured by a web camera or similar device [15].…”

Section: Mixed Reality (Mr) In Landscapementioning

confidence: 99%

Intelligent Construction and Management of Landscapes through Building Information Modeling and Mixed Reality

Zhao

Sun

et al. 2022

Applied Sciences

View full text Add to dashboard Cite

Intelligent construction and management processes are essential to ensure the efficiency of planting and maintenance of landscapes in large-scale projects. Unfortunately, various challenges still exist for achieving such a vision. For instance, creating detailed models of various plants to precisely capture the spatiotemporal changes is challenging. Moreover, transmitting massive plant-related data in time for project coordination and remote maintenance is also difficult through traditional landscape management practices. Integrated use of building information modeling (BIM) and mixed reality (MR) techniques could help establish digital representations of various plants with semantic information. Such integration of BIM and MR offers instinctual interactions by blending the physical and digital worlds. This study proposed an intelligent construction and management framework through BIM and MR to (1) establish detailed models of various plants, (2) capture spatiotemporal changes of plants across four seasons for model updating, and (3) establish a real-time data transmission method for effective project coordination and remote maintenance of various plants. The authors used the Jinhu Park project in the Xiong’an New District of China as a case study to validate the proposed method. Results show that the proposed method could support the sustainable development of landscapes in real practice.

show abstract

Section: Mixed Reality (Mr) In Landscapementioning

confidence: 99%

Intelligent Construction and Management of Landscapes through Building Information Modeling and Mixed Reality

Zhao

Sun

et al. 2022

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…Inoue and Kataoka et al proposed a real-time visualization system of sound intensities using MR and a handheld microphone array. 3,4 This system makes it easier to observe the flow of sound energy by scanning a steady sound field in real space using an MR device.…”

Section: Introductionmentioning

confidence: 99%

Interactive MR visualization system of 3D sound field with physical model of sound propagation

Uchida,

Tsunokuni,

Ikeda

et al. 2024

International Workshop on Advanced Imaging Technology (IWAIT) 2024

View full text Add to dashboard Cite

Sound field visualization helps us understand and analyze sound propagation. To visualize the sound field in an actual room, the sound pressures at all observed points should be measured. However, the number of measurement points significantly increases as the resolution and area of visualization are increased. Moreover, the large amount of data makes it difficult to display all the information in the 3D sound field. In this study, we propose an interactive Mixed Reality (MR) visualization system of the 3D sound field in a room. We estimate the sound field in a room using a small number of microphones based on a physical model of sound propagation and then visualize the sound field by interactively changing the visualization region by hand gesture.

show abstract

“…In addition, a case study has been conducted to investigate user preferences regarding wearable or smart device environmental sound presentation technologies [21]. The visualization of auditory information has been investigated in various fields, including the study of physically visualizing the intensity of sound generated by sound sources using a see-through head-mounted display [22], as well as in music, education, consumer electronics, marine science, medicine, and ecosystems [23][24][25][26][27][28]. By visualizing sound, it may be possible to obtain a variety of information that cannot be obtained simply by hearing.…”

Section: Introduction Background and Previous Researchmentioning

confidence: 99%

Augmented-Reality Presentation of Household Sounds for Deaf and Hard-of-Hearing People

Asakura

2023

Sensors

View full text Add to dashboard Cite

Normal-hearing people use sound as a cue to recognize various events that occur in their surrounding environment; however, this is not possible for deaf and hearing of hard (DHH) people, and in such a context they may not be able to freely detect their surrounding environment. Therefore, there is an opportunity to create a convenient device that can detect sounds occurring in daily life and present them visually instead of auditorily. Additionally, it is of great importance to appropriately evaluate how such a supporting device would change the lives of DHH people. The current study proposes an augmented-reality-based system for presenting household sounds to DHH people as visual information. We examined the effect of displaying both the icons indicating sounds classified by machine learning and a dynamic spectrogram indicating the real-time time–frequency characteristics of the environmental sounds. First, the issues that DHH people perceive as problems in their daily lives were investigated through a survey, suggesting that DHH people need to visualize their surrounding sound environment. Then, after the accuracy of the machine-learning-based classifier installed in the proposed system was validated, the subjective impression of how the proposed system increased the comfort of daily life was obtained through a field experiment in a real residence. The results confirmed that the comfort of daily life in household spaces can be improved by combining not only the classification results of machine learning but also the real-time display of spectrograms.

show abstract

Visualization system for sound field using see-through head-mounted display

Cited by 17 publications

References 25 publications

Intelligent Construction and Management of Landscapes through Building Information Modeling and Mixed Reality

Intelligent Construction and Management of Landscapes through Building Information Modeling and Mixed Reality

Interactive MR visualization system of 3D sound field with physical model of sound propagation

Augmented-Reality Presentation of Household Sounds for Deaf and Hard-of-Hearing People

Contact Info

Product

Resources

About