Audio-Haptic Simulation of Walking on Virtual Ground Surfaces to Enhance Realism

Abstract

Abstract. In this paper we describe two experiments whose goal is to investigate the role of physics-based auditory and haptic feedback provided at feet level to enhance realism in a virtual environment. To achieve this goal, we designed a multimodal virtual environment where subjects could walk on a platform overlooking a canyon. Subjects were asked to visit the environment wearing an head-mounted display and a custom made pair of sandals enhanced with sensors and actuators. A 12-channels surround sound system delivered a soundscape which was consistent with the visual environment. In the first experiment, passive haptics was provided by having a physical wooden platform present in the laboratory. In the second experiment, no passive haptics was present. In both experiments, subjects reported of having a more realistic experience while auditory and haptic feedback are present. However, measured physiological data and post-experimental presence questionnaire do not show significant differences when audio-haptic feedback is provided.

Manipulating Underfoot Tactile Perceptions of Flooring Materials in Augmented Virtuality

“…As we walk, we constantly receive information about the material beneath our feet through audio cues or their absence. Research by [49][50][51] investigated foot-based tactile devices that deliver audio vibrotactile haptic feedback for walking in virtual spaces. While the added feedback did not significantly alter the overall perception, user experience was enhanced with a preference towards the added feedback and improved realism.…”

Walking on paintings: Assessment of passive haptic feedback to enhance the immersive experience

“…Vibrations around the ankle have also been shown to help with gait control (Aimonetti et al, 2007;Mildren and Bent, 2016). The sole of the foot is the most common location by either having participants standing on a vibrating platform (Lovreglio et al, 2018;Zwoliński et al, 2022) or wearing shoes that have small vibrating motors while standing or sitting on a chair (Nilsson et al, 2012;Turchet et al, 2012;Kruijff et al, 2016). Other researchers opted for fluid actuators on shoes to offer more realistic VR walking experiences by feeling different ground structures (Son et al, 2018a;Son et al, 2019;Yang et al, 2020).…”