Integrating multimodal information about surface texture via a probe: relative contributions of haptic and touch-produced sound sources

The Effect of Auditory Cues on the Audiotactile Roughness Perception: Modulation Frequency and Sound Pressure Level

“…One of the reasons for the difference between the results of the present study and the results of Lederman [4] could be that in the present study all sound-pressure-levels are 10 dB above the physically accurate value and this amplification results an increase of the contribution of the auditory information on the bimodal judgments. The results of Lederman et al [7] on the assessment of bimodal roughness judgments using a rigid probe confirm this argument. With rigid contact between surface and end effector, the amplitude of the accompanying sounds is usually considerably greater and their results show that the subjects used not only tactile information, but also auditory information on the bimodal judgments.…”

“…Therefore, our attention is directed to the tactile modality. This argument was somehow confirmed in another study by Lederman et al [7]. They experimentally assessed the relative contributions of tactile and auditory information to bimodal judgments of surface roughness using a rigid probe.…”

“…To calculate a measure of the relative contributions of tactile and audition conditions to the bimodal (auditory & tactile) estimates, a technique, which is proposed by [7] for the multi-sensory perception of the surface roughness, was used. This statistic, which indicates the percent weighting of the tactile information in the bimodal judgments, was calculated related to the distances between three different conditions: …”

Integrating physically based sound models in a multimodal rendering architecture

“…Participants were allowed to interact with each condition as long as desired. Perceived stiffness was determined through an absolute magnitude-estimation procedure (similarly to the approach reported by Lederman et al 7 ): participants were instructed to assign the non-zero, positive number that best described the magnitude of the perceived stiffness of the stimulus, along a scale ranging from 1 to 8. Verbal labels were associated to each point of the scale, ranging from 'extremely soft' (1) to 'extremely stiff' (8).…”

“…5 Many studies on bimodal (auditory and haptic) perception in contact interaction are focused on continuous contact (i.e., scraping or sliding). Lederman and coworkers have provided many results 6,7 on the relative contributions of tactile and auditory information to judgments of surface roughness. Guest et al 8 have also focused on audio-tactile interactions in roughness perception.…”