Perception of Material from Contact Sounds

Abstract

Contact sounds can provide important perceptual cues in virtual environments. We investigated the relation between material perception and variables that govern the synthesis of contact sounds. A shape-invariant, auditory-decay parameter was a powerful determinant of the perceived material of an object. Subjects judged the similarity of synthesized sounds with respect to material (Experiment 1 and 2) or length (Experiment 3). The sounds corresponded to modal frequencies of clamped bars struck at an intermediate point, and they varied in fundamental frequency and frequency-dependent rate of decay. The latter parameter has been proposed as reflecting a shape-invariant material property: damping. Differences between sounds in both decay and frequency affected similarity judgments (magnitude of similarity and judgment duration), with decay playing a substantially larger role. Experiment 2, which varied the initial sound amplitude, showed that decay rate—rather than total energy or sound duration—was the critical factor in determining similarity. Experiment 3 demonstrated that similarity judgments in the first two studies were specific to instructions to judge material. Experiment 4, in which subjects assigned the sounds to one of four material categories, showed an influence of frequency and decay, but confirmed the greater importance of decay. Decay parameters associated with each category were estimated and found to correlate with physical measures of damping. The results support the use of a simplified model of material in virtual auditory environments.

Cross-sensory correspondences and cross talk between dimensions of connotative meaning: Visual angularity is hard, high-pitched, and bright

“…21 First, there is a natural co-occurrence between angularity and hardness, because angular (sharp/ pointy) objects tend to be formed from relatively hard materials. Second, this co-occurrence could, in turn, mediate an association between angularity and pitch, because objects made from harder materials tend to make higher-pitched sounds when struck (Freed, 1990;Klatzky, Pai, & Krotkov, 2000;van den Doel & Pai, 1998). It is proposed here, however, that any cross-sensory correspondences acquired through exposure to such natural co-occurrences will be semantic, rather than nonsemantic, in nature, which would take them outside Spence's (2011) account of statistical correspondences.…”

Do we hear size or sound? Balls dropped on plates

“…Power may be the acoustic clue linking actual and subjective size of the NSO. However, only studies in which acoustic features are directly manipulated (e.g., Grassi, 2002) or environmental sounds are investigated by means of synthetic stimuli (e.g., Klatzky, Pai, & Krotkov, 2000;Lutfi, 2001;Lutfi & Oh, 1997;McAdams, Chaigne, & Roussarie, 2004) can provide final confirmation of this hypothesis.…”

Sound synthesis and evaluation of interactive footsteps for virtual reality applications

“…Sonic interactions between solid surfaces have been extensively investigated, and results are available which describe the relationship between physical and perceptual parameters of objects in contact [16,27]. Such sounds are typically short in duration, with a sharp temporal onset and relatively rapid decay.…”