Data-Driven Spatio-Temporal Analysis via Multi-Modal Zeitgebers and Cognitive Load in VR

Liao, Haodong; Xie, Ning; Li, Huiyuan; Li, Yuhang; Su, Jianping; Jiang, Feng; Huang, Wenyan; Shen, Heng Tao

doi:10.1109/vr46266.2020.1581136928898

Cited by 2 publications

(2 citation statements)

References 49 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Similarly, Huang et al [77] proposed a system that automatically adds spatialized sounds to create more realistic environments (see Figure 3, right), validating by means of user studies the overall preference of this solution in terms of realism. Indeed, different soundscapes (a sound or combination of sounds created from an immersive environment) are able to increase the sense of presence in VR [190], and as Liao et al [104] studied, combining visual and auditory zeitgebers (periodically occurring natural phenomena which act as cues in the regulation of biological rhythms), which act like synchronizers, could actually enhance presence, even influencing time perception. All these previous works suggest that using auditory information, either spatialized or not, enhances the realism of the experience, although some of them warn about the potential backfire of increasing the cognitive load, which can negatively impact users' confidence [86].…”

Section: Perception Of the Environmentmentioning

confidence: 99%

Multimodality in VR: A Survey

et al. 2022

View full text Add to dashboard Cite

Virtual reality (VR) is rapidly growing, with the potential to change the way we create and consume content. In VR, users integrate multimodal sensory information they receive, to create a unified perception of the virtual world. In this survey, we review the body of work addressing multimodality in VR, and its role and benefits in user experience, together with different applications that leverage multimodality in many disciplines. These works thus encompass several fields of research, and demonstrate that multimodality plays a fundamental role in VR; enhancing the experience, improving overall performance, and yielding unprecedented abilities in skill and knowledge transfer.

show abstract

Section: Perception Of the Environmentmentioning

confidence: 99%

Multimodality in VR: A Survey

et al. 2022

View full text Add to dashboard Cite

show abstract

“…[160] as opposed to unimodal (i.e., only visual) systems [74]. Different soundscapes increased the sense of presence in VR [166], and as Liao et al [94] studied, combining visual and auditory zeitgebers, which act like syncrhonizers, enhances presence, and even influences time perception. Normand et al [130], studied the effects of other modalities, showing that it is possible to induce a body distortion illusion by synchronous visual-tactile and visual-motor correlations (see Figure 4).…”

Section: Perception Of the Selfmentioning

confidence: 99%

Multimodality in VR: A survey

Martin,

Malpica,

Gutierrez

et al. 2021

Preprint

View full text Add to dashboard Cite

Virtual reality has the potential to change the way we create and consume content in our everyday life. Entertainment, training, design and manufacturing, communication, or advertising are all applications that already benefit from this new medium reaching consumer level. VR is inherently different from traditional media: it offers a more immersive experience, and has the ability to elicit a sense of presence through the place and plausibility illusions. It also gives the user unprecedented capabilities to explore their environment, in contrast with traditional media. In VR, like in the real world, users integrate the multimodal sensory information they receive to create a unified perception of the virtual world. Therefore, the sensory cues that are available in a virtual environment can be leveraged to enhance the final experience. This may include increasing realism, or the sense of presence; predicting or guiding the attention of the user through the experience; or increasing their performance if the experience involves the completion of certain tasks. In this state-of-the-art report, we survey the body of work addressing multimodality in virtual reality, its role and benefits in the final user experience. The works here reviewed thus encompass several fields of research, including computer graphics, human computer interaction, or psychology and perception. Additionally, we give an overview of different applications that leverage multimodal input in areas such as medicine, training and education, or entertainment; we include works in which the integration of multiple sensory information yields significant improvements, demonstrating how multimodality can play a fundamental role in the way VR systems are designed, and VR experiences created and consumed.

show abstract

Data-Driven Spatio-Temporal Analysis via Multi-Modal Zeitgebers and Cognitive Load in VR

Cited by 2 publications

References 49 publications

Multimodality in VR: A Survey

Multimodality in VR: A Survey

Multimodality in VR: A survey

Contact Info

Product

Resources

About