Virtual Reality and Embodiment in Multimodal Meaning Making

Mills, Kathy A.; Scholes, Laura; Brown, Alinta

doi:10.1177/07410883221083517

Cited by 26 publications

(9 citation statements)

References 49 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Moreover, multimodal integration has also been investigated in the field of embodied cognition. Studies showed that individuals use their body and their senses as different sources of information and that they integrate them to communicate more effectively ( Price and Jewitt, 2013 ; Mills et al, 2022 ). However, no study has investigated the integration of bodily resonances in the perception of emotional prosody in a multimodal context.…”

Section: Introductionmentioning

confidence: 99%

Influence of bodily resonances on emotional prosody perception

Selosse

Grandjean²,

Ceravolo³

2022

Front. Psychol.

View full text Add to dashboard Cite

IntroductionEmotional prosody is defined as suprasegmental and segmental changes in the human voice and related acoustic parameters that can inform the listener about the emotional state of the speaker. While the processing of emotional prosody is well represented in the literature, the mechanism of embodied cognition in emotional voice perception is very little studied. This study aimed to investigate the influence of induced bodily vibrations—through a vibrator placed close to the vocal cords—in the perception of emotional vocalizations. The main hypothesis was that induced body vibrations would constitute a potential interoceptive feedback that can influence the auditory perception of emotions. It was also expected that these effects would be greater for stimuli that are more ambiguous.MethodsParticipants were presented with emotional vocalizations expressing joy or anger which varied from low-intensity vocalizations, considered as ambiguous, to high-intensity ones, considered as non-ambiguous. Vibrations were induced simultaneously in half of the trials and expressed joy or anger congruently with the voice stimuli. Participants had to evaluate each voice stimulus using four visual analog scales (joy, anger, and surprise, sadness as control scales).ResultsA significant effect of the vibrations was observed on the three behavioral indexes—discrimination, confusion and accuracy—with vibrations confusing rather than facilitating vocal emotion processing.ConclusionOver all, this study brings new light on a poorly documented topic, namely the potential use of vocal cords vibrations as an interoceptive feedback allowing humans to modulate voice production and perception during social interactions.

show abstract

Section: Introductionmentioning

confidence: 99%

Influence of bodily resonances on emotional prosody perception

Selosse

Grandjean²,

Ceravolo³

2022

Front. Psychol.

View full text Add to dashboard Cite

show abstract

“…VR technologies offer different affordances for embodied writing and multimodal communication, distinguished from previous forms of virtual technology with the advent of HMDs that have become prominent since 2013 (Jensen & Konradsen, 2018). These affordances account for multimodal and sensorial ways of interacting with sophisticated, three-dimensional virtual environments and objects, orchestrating vision, sound, haptics (touch to interact with the environment), and head and body movements, in fully immersive environments [4].…”

Section: The Embodiment Of Multimodal Concept In Virtual Reality Devicesmentioning

confidence: 99%

Research on the Design of Tea Culture Exhibition Stand Based on Multimodal Concept in Interactive Device Art

2024

artpl

View full text Add to dashboard Cite

In recent years, with the increasing emphasis on personal health among young people and China's continuous efforts to enhance its external exchanges, more and more people are beginning to accept and understand Chinese tea culture. According to data provided by the General Administration of Customs of China, in 2021, the tea export volume reached 369,400 tons, with an export value of 2.299 billion US dollars. China has always been a major exporter of tea in the world, but mostly in the form of raw tea materials. This article aims to combine the concept of multimodal theory with emerging interactive technologies to integrate interactive art installations with virtual reality technology for design and practice, allowing people to experience and understand the traditional Chinese tea-making process.

show abstract

“…For example, the floor texture of the exhibition hall is depicted by maps [16] . The mapping of the model generally requires UV unwrapping through Maya, and then the mapping is completed in Photoshop [17] . In order to improve the system performance, it is necessary to minimize the number and amount of maps.…”

Section: Mapping Of Basic Model Librarymentioning

confidence: 99%

A Cloud Exhibition Hall System of Extended Reality Using Apriori Algorithm

2024

AJCIS

View full text Add to dashboard Cite

Traditional exhibition halls have many disadvantages, and the exhibition effect is not ideal. For example, large equipment cannot be transported and displayed due to the limitation of display space and cost, and it is difficult to convey the use scenario and experience of products to customers; Offline exhibition booths are limited, so more products cannot be displayed, and high-end products are not convenient to enter the site; For the raw materials, functions, structures, and specifications of products, there is a lack of real application cases to show the products; The cost of field investigation is high. If the process, production line, and production capacity cannot be investigated in depth, the customer cannot be trusted. Given Because of the numerous pain points in traditional exhibition halls, this paper proposes an XR display method based on the Apriori algorithm. Through this method, a cloud exhibition hall system is designed and implemented, which can effectively solve the problems of limited space in traditional exhibition halls, single exhibition means, inability to display the details of exhibits, inability to effectively collect customer opinions, and inability to mine and analyze customer data. The experiment shows that the system can feel the pain points of traditional exhibition halls, improve the exhibition effect of exhibition halls, and better promote the promotion of products.

show abstract

Virtual Reality and Embodiment in Multimodal Meaning Making

Cited by 26 publications

References 49 publications

Influence of bodily resonances on emotional prosody perception

Influence of bodily resonances on emotional prosody perception

Research on the Design of Tea Culture Exhibition Stand Based on Multimodal Concept in Interactive Device Art

A Cloud Exhibition Hall System of Extended Reality Using Apriori Algorithm

Contact Info

Product

Resources

About