Multimodal Rendering of Walking Over Virtual Grounds

Marchal, Maud; Cirio, Gabriel; Visell, Yon; Fontana, Federico; Serafin, Stefania; Cooperstock, Jeremy R.; Lécuyer, Anatole

doi:10.1007/978-1-4419-8432-6_12

Cited by 10 publications

(10 citation statements)

References 83 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Furthermore, non-directional tactile cues have been shown to provide some self-motion cues (Terziman et al, 2012;Feng et al, 2016) while directional cues can be used to aid directional guidance, e.g., by using higher density grids of vibrotactors under the foot sole (Velázquez et al, 2012). In some studies, vibration and audio cues have been studied in concert and showed cross-modal benefits in ground-surface perception (Marchal et al, 2013) and selfmotion perception (vection) (Riecke et al, 2009).…”

Section: Haptic Feedback To Locations Other Than the Handsmentioning

confidence: 99%

First insights in perception of feet and lower-body stimuli for proximity and collision feedback in 3D user interfaces

Kruijff

Riecke²,

Trepkowski³

et al. 2022

Front. Virtual Real.

View full text Add to dashboard Cite

The visual and auditory quality of computer-mediated stimuli for virtual and extended reality (VR/XR) is rapidly improving. Still, it remains challenging to provide a fully embodied sensation and awareness of objects surrounding, approaching, or touching us in a 3D environment, though it can greatly aid task performance in a 3D user interface. For example, feedback can provide warning signals for potential collisions (e.g., bumping into an obstacle while navigating) or pinpointing areas where one’s attention should be directed to (e.g., points of interest or danger). These events inform our motor behaviour and are often associated with perception mechanisms associated with our so-called peripersonal and extrapersonal space models that relate our body to object distance, direction, and contact point/impact. We will discuss these references spaces to explain the role of different cues in our motor action responses that underlie 3D interaction tasks. However, providing proximity and collision cues can be challenging. Various full-body vibration systems have been developed that stimulate body parts other than the hands, but can have limitations in their applicability and feasibility due to their cost and effort to operate, as well as hygienic considerations associated with e.g., Covid-19. Informed by results of a prior study using low-frequencies for collision feedback, in this paper we look at an unobtrusive way to provide spatial, proximal and collision cues. Specifically, we assess the potential of foot sole stimulation to provide cues about object direction and relative distance, as well as collision direction and force of impact. Results indicate that in particular vibration-based stimuli could be useful within the frame of peripersonal and extrapersonal space perception that support 3DUI tasks. Current results favor the feedback combination of continuous vibrotactor cues for proximity, and bass-shaker cues for body collision. Results show that users could rather easily judge the different cues at a reasonably high granularity. This granularity may be sufficient to support common navigation tasks in a 3DUI.

show abstract

Section: Haptic Feedback To Locations Other Than the Handsmentioning

confidence: 99%

First insights in perception of feet and lower-body stimuli for proximity and collision feedback in 3D user interfaces

Kruijff

Riecke²,

Trepkowski³

et al. 2022

Front. Virtual Real.

View full text Add to dashboard Cite

show abstract

“…Particularly, the somatosensory pressure receptors inform the walker about physical contact with objects on the path (Waller and Hodgson 2013). Haptic feedback is intended to provide such information by reproducing forces, movements, and other cutaneous sensations felt via the sense of touch (Marchal et al 2013). In a manner similar to Lindeman et al (1999), we distinguish between two approaches for supplying individuals with cutaneous information during virtual walking.…”

Section: Haptic Feedbackmentioning

confidence: 99%

“…With respect to active-haptic feedback, Marchal et al (2013) stated that the addition of even low-fidelity tactile feedback may increase the sensation of presence in an audiovisual virtual environment. Along similar lines, Srinivasan and Basdogan (1997) suggested that the potential gains of adding such tactile feedback may be larger than improving the quality of the feedback delivered to an existing modality (e.g., the visual display).…”

Section: Haptic Feedbackmentioning

confidence: 99%

“…In fact, much recent research on auditory and haptic feedback for virtual walking has been performed in parallel using multimodal interfaces. Marchal et al (2013) describe that because the haptic and auditory stimuli share the same origin (i.e., physical contact between the foot and the ground), the high-frequency information in the mechanical signals of the two are often closely related. For that reason, the same physics-based algorithms have been used to produce the signals fed to both auditory and haptic displays (Nordahl et al 2012b).…”

Section: Haptic Feedbackmentioning

confidence: 99%

See 1 more Smart Citation

Natural Walking in Virtual Reality

et al. 2018

Self Cite

View full text Add to dashboard Cite

Recent technological developments have finally brought virtual reality (VR) out of the laboratory and into the hands of developers and consumers. However, a number of challenges remain. Virtual travel is one of the most common and universal tasks performed inside virtual environments, yet enabling users to navigate virtual environments is not a trivial challenge—especially if the user is walking. In this article, we initially provide an overview of the numerous virtual travel techniques that have been proposed prior to the commercialization of VR. Then we turn to the mode of travel that is the most difficult to facilitate, that is, walking. The challenge of providing users with natural walking experiences in VR can be divided into two separate, albeit related, challenges: (1) enabling unconstrained walking in virtual worlds that are larger than the tracked physical space and (2) providing users with appropriate multisensory stimuli in response to their interaction with the virtual environment. In regard to the first challenge, we present walking techniques falling into three general categories: repositioning systems, locomotion based on proxy gestures, and redirected walking. With respect to multimodal stimuli, we focus on how to provide three types of information: external sensory information (visual, auditory, and cutaneous), internal sensory information (vestibular and kinesthetic/proprioceptive), and efferent information. Finally, we discuss how the different categories of walking techniques compare and discuss the challenges still facing the research community.

show abstract

“…Among others, presence is increased through high realism in the VE [28], which can be achieved through multimodal stimuli [25], e.g. by applying physical laws, environmental sounds, haptic feedback [37] and the correct rendering of walking over virtual grounds [42]. As, by definition, mindful practice increases the awareness of oneself and the surrounding of the present moment [32], low presence through mismatches of visual, tactile and auditory cues could distract while high presence could support attention to body and mind.…”

Section: Introductionmentioning

confidence: 99%

Influence of Passive Haptic and Auditory Feedback on Presence and Mindfulness in Virtual Reality Environments

Wagener

Ackermann

Savino

et al. 2022

Proceedings of the 2022 International Conference on Multimodal Interaction

View full text Add to dashboard Cite

Virtual Reality (VR) is increasingly being used to promote mindfulness practice. However, the impact of virtual and multimodal interactive spaces on mindfulness practice and presence is still underexplored. To address this gap, we conducted a mixed-method user study (𝑁 =12). We explored the impact of various multimodal feedback, in particular tactile feedback (passive haptic feedback by artificial grass) and auditory feedback (footstep sound) at feet level on both mindfulness and presence. We conducted semi-structured interviews and collected quantitative data through three validated questionnaires (SMS, IPQ, WSPQ). We found a significant effect of passive haptic feedback on presence and mindfulness. Tactile

show abstract

Multimodal Rendering of Walking Over Virtual Grounds

Cited by 10 publications

References 83 publications

First insights in perception of feet and lower-body stimuli for proximity and collision feedback in 3D user interfaces

First insights in perception of feet and lower-body stimuli for proximity and collision feedback in 3D user interfaces

Natural Walking in Virtual Reality

Influence of Passive Haptic and Auditory Feedback on Presence and Mindfulness in Virtual Reality Environments

Contact Info

Product

Resources

About