Acoustic Rendering and Auditory–Visual Cross‐Modal Perception and Interaction

Hulusić, Vedad; Harvey, Carlo; Debattista, Kurt; Tsingos, Nicolas; Walker, Steve; Howard, David M.; Chalmers, Alan

doi:10.1111/j.1467-8659.2011.02086.x

Cited by 48 publications

(32 citation statements)

References 195 publications

(320 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Cross-modal effects refer to the impact on the perceptual experience of one sensory input that the presentation of an additional sensory input can have [19]. Previous work has demonstrated that cross-modal effects can be considerable to the extent that large amounts of detail of one sense may be ignored in the presence of other sensory inputs (see [18] and [20], and for a more recent summary see also [21]). …”

Section: Sound and Multimodal Interactionsmentioning

confidence: 96%

The Effect of Sound on Visual Fidelity Perception in Stereoscopic 3-D

Rojas

Kapralos

Hogue

et al. 2013

IEEE Trans. Cybern.

View full text Add to dashboard Cite

Visual and auditory cues are important facilitators of user engagement in virtual environments and video games. Prior research supports the notion that our perception of visual fidelity (quality) is influenced by auditory stimuli. Understanding exactly how our perception of visual fidelity changes in the presence of multimodal stimuli can potentially impact the design of virtual environments, thus creating more engaging virtual worlds and scenarios. Stereoscopic 3-D display technology provides the users with additional visual information (depth into and out of the screen plane). There have been relatively few studies that have investigated the impact that auditory stimuli have on our perception of visual fidelity in the presence of stereoscopic 3-D. Building on previous work, we examine the effect of auditory stimuli on our perception of visual fidelity within a stereoscopic 3-D environment.

show abstract

Section: Sound and Multimodal Interactionsmentioning

confidence: 96%

The Effect of Sound on Visual Fidelity Perception in Stereoscopic 3-D

Rojas

Kapralos

Hogue

et al. 2013

IEEE Trans. Cybern.

View full text Add to dashboard Cite

show abstract

“…As shown in Figure 3, an MTS series of universal testing machines with a 100N load cell was used to conduct a lab scale table top 3PB test for SBS data collection [32]. The load cell accuracy is ±1% of the indicated test force range of interest in this paper.…”

Section: Methodsmentioning

confidence: 99%

Experimental evaluation on the silicon mechanical performance of electronic packaging

Fong¹,

Koay²,

Azid³

2017

J. MECH. ENG. SCI.

View full text Add to dashboard Cite

Semiconductor packaging is trending towards a miniaturisation in size but an increase in functionality. Hence, the thickness of the silicon wafer has decreased dramatically with a concern on the possible degradation of the strength of the thinned wafer. In this paper, 3-point bend (3PB) on bare silicon is selected as the preferred silicon break strength (SBS) test methodology due to its setup effectiveness and subsequent application in the prediction study. This experimental testing study focused on evaluating the SBS from different thickness ranges. The study was then followed by evaluating the influence of a possible impact from flaw creation with laser marking on silicon surfaces. The results show that the SBS is consistent although with significant differences in the silicon thickness ranges. It is also revealed that the onset breaking load may not be a suitable metric and could be over sensitive on gauging the SBS comparison. The flaw creation from the engraving process revealed a significant drop of 75% SBS although with an approximate depth removal of <10% from the total thickness. The consistence failure mode is clearly visible and this left the silicon very vulnerable to catastrophic failure. This indicates that extra care is needed on ultra-thin silicon during the assembly process as fractures may happen even before any reliability stress test is conducted. Furthermore, the completion of the package level 3PB failure mode verification has helped to demonstrate that an SBS study can be conducted with a simplified bare silicon level testing. In short, the study with this simplified 3PB has successfully proven its usefulness in SBS estimation. The observed ultra-thin silicon SBS has degraded and strongly depended on the critical flaws especially from the surface defect and impact from the assembly handling.

show abstract

“…In other words, the hearing mechanism is sensitive only to a certain restricted range of phenomena in the physical world [Fry 1979]. Hearing is one of the fundamental attributes humans use for a wide variety of reasons: from spatially locating and identifying objects to acting as a reaction mechanism [Hulusic et al 2012]. Sensations are themselves part of the psychological world and thus, the study of sounds inevitably links the areas of psychology and physics.…”

Section: The Physicality Of Amplitude and Frequencymentioning

confidence: 99%

Randomized psychoacoustic model for mobile, panoramic, heritage-viewing applications

Lim

Tan

et al. 2012

Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry

View full text Add to dashboard Cite

In preservation of heritage, lately there has been a phenomenal growth in digital audio preservation. A well-preserved virtual heritage does not include only the visual images of the heritage sites, but should ideally include also the audio surroundings of the heritage site that are incorporated into the virtual heritage applications as a whole. An acoustical heritage comprises the audio elements which surround the heritage sites. Psychoacoustic heritage is the extra significant psychological audio characteristic that adds to the surroundings of the heritage sites.In this paper, a randomized psychoacoustic model is proposed in 360 0 panoramic view on mobile platform. User interaction using multi-gesture tap is vital in delivering the psychoacoustic effects to the user. The contribution and the novelty of this research is in proposing and deploying a new psychoacoustic model mainly for the environment of 360 0 panoramic view in virtual heritage. In the proposed model, audio interaction design includes the changes in acoustical characteristics such as amplitude, frequency as well as the velocity within the various balanced panorama's azimuthal zones. Simulations have been carried out on a model of the Town Hall, one of the UNESCO heritage sites in George Town, Penang, Malaysia. The experimental data sets are also collected and have been found to produce promising psychoacoustic effects in panoramic view.

show abstract

Acoustic Rendering and Auditory–Visual Cross‐Modal Perception and Interaction

Cited by 48 publications

References 195 publications

The Effect of Sound on Visual Fidelity Perception in Stereoscopic 3-D

The Effect of Sound on Visual Fidelity Perception in Stereoscopic 3-D

Experimental evaluation on the silicon mechanical performance of electronic packaging

Randomized psychoacoustic model for mobile, panoramic, heritage-viewing applications

Contact Info

Product

Resources

About