A Pseudo-Haptic Method Using Auditory Feedback: The Role of Delay, Frequency, and Loudness of Auditory Feedback in Response to a User’s Button Click in Causing a Sensation of Heaviness

Kaneko, Seitaro; Yokosaka, Takumi; Kajimoto, Hiroyuki; Kawabe, Takahiro

doi:10.1109/access.2022.3172324

Cited by 7 publications

(3 citation statements)

References 57 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When humans interact with objects, auditory stimuli play an important role in material recognition [13]- [15], enhancing interaction immersion [16], [17], and improving task performance [16], [18], alongside visual and tactile stimuli. Several studies have reported that, even in VR or MR scenarios where haptic feedback is not available, auditory feedback can convey a sense of touching virtual objects and their tactile properties [9], [10], [19], [20].…”

Section: Related Work a Auditory Feedback For Hand-object Interactionmentioning

confidence: 99%

“…In this phenomenon, when users rub their hands together, the illusion of feeling a dry, parchment-like texture is created by enhancing the high-frequency components of the generated sound [25], [26]. Besides, Kanek et al reported that various factors related to button click sounds, such as sound pressure and frequency, can influence a user's perception of the weight or heaviness of the button click [10].…”

Section: Related Work a Auditory Feedback For Hand-object Interactionmentioning

confidence: 99%

“…This enables users to perceive the tactile sensation of the object. Alternatively, in VR and MR research, various methods aim to offer tactile sensations to users, not solely through visual stimuli but also through auditory cues [9], [10]. Auditory stimuli can be easily presented to users using common audio devices such as headphones or speakers, making them highly applicable in Concept of perceiving the touching sensation of objects through sound texture feedback.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Sound Texture Feedback for a Projected Extended Hand Interface

Sato,

Iwai,

Sato

2024

IEEE Access

View full text Add to dashboard Cite

The ExtendedHand interface projects a computer graphics (CG) hand that synchronizes with a user's physical hand movements onto a real environment, visually extending the user's reach. This paper focuses on enhancing the user's tactile perception of an object through cross-modal phenomena by providing a sound texture (auditory information that matches the object) when the CG hand touches it. Here, ExtendedHand enables users to touch objects beyond their physical reach, an experience that cannot be achieved with their physical body. In such situations, the appropriateness of adjusting sound pressure based on physical laws according to distance for users is unclear. Additionally, we have empirical knowledge that the speed at which we touch objects with our hands results in different sounds. Within ExtendedHand, since the movement of the user's physical hand is amplified and reflected in the CG hand's movement, the physical hand's speed does not match the CG hand's speed. This raises the question of whether sound texture feedback should align with the visual information of the CG hand or the proprioceptive sensory information of the physical hand. In this paper, we conducted two user studies to explore appropriate sound texture feedback for the projected CG hand. The results indicate that when the CG hand touches objects at various distances, the sound pressure should follow the same sound pressure attenuation as observed in physical phenomena. Additionally, the results suggest that despite swift tracing actions with the CG hand, users perceive sounds produced at a slower pace to be more suitable.INDEX TERMS Augmented reality, body augmentation, sound texture feedback, tactile sensation.

show abstract