Virtual Reality’s New Synesthetic Possibilities

Ross, Miriam

doi:10.1177/1527476418805240

Cited by 27 publications

(8 citation statements)

References 57 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Miriam Ross, for instance, has noted that VR requires ‘doubled embodiment’, an argument similar to ours. Discussing Richie’s Plank Experience (2016), a popular VR simulation in which one walks off of a plank, falling off of the side of a building, Ross suggests that there’s a fundamental liminality to virtual reality, a ‘tension between the user investing fully in the thickness of the virtual space by moving limbs and muscles through that space in tandem with how the virtual world suggests they should move…and the ability of their body to disregard the synesthetic qualities of the environment and move through it at their own pace and without limitation’ (2020: 304). Further, in a discussion of VR pornography, Ross emphasizes that this lack of connection between the viewer’s body and the avatar becomes an extreme problem, producing ‘a continuous flow back and forth between embodiment and disembodiment, the material and the virtual’ (2019: 565).…”

Section: Hands Avatars and The Impossibility Of A Disembodied Immersi...mentioning

confidence: 99%

Embodied parallelism and immersion in virtual reality gaming

Bollmer

Suddarth

2022

Convergence: The International Journal of Research into New Med

View full text Add to dashboard Cite

This article argues that virtual reality produces a sense of immersion through embodied parallelism – a technical mediation in which the embodied gestures and movements of a player must correspond to what is represented within a VR game, a correspondence which relies on, but exceeds the visual and requires strange requirements for both player (in terms of their gestures and movements) and game (in terms of including particular limits that police the movements of the player’s body). Attending to embodied parallelism refuses several longstanding assumptions about how virtual reality technologies, and media in general, generate the feeling of immersion – namely, the idea that immersion ‘disembodies’ in some way, or denies the existence of physical space beyond the boundary of a mediated simulation. Immersivity is premised on an explicit engagement with – and not exclusion of – both the physicality of the body and the physicality of a medium, if in deeply contradictory ways. As a case study to develop this concept, this article discusses the emerging virtual reality genre of ‘physics games’, games including, but not limited to, Blade & Sorcery, Boneworks and Half-Life: Alyx. These games take great lengths to simulate the physics of objects – they require simultaneously intrusive and yet ‘natural’ interfaces, in which the game demands the body to move as if it were manipulating objects that have a specific mass. Becoming ‘good’ at these games depends on the ability to discipline the body and conform to the demands of movement required by the simulation. Immersion, in this context, depends on a willingness to submit to these machinic, embodied demands, relying both explicitly on technical form but deliberately forgetting the materiality of gesture and mediation at the same time. This seeming contradiction, an engagement with both the materiality of gesture and the materiality of medium, is ‘solved’ through embodied parallelism and how it links player and game.

show abstract

Section: Hands Avatars and The Impossibility Of A Disembodied Immersi...mentioning

confidence: 99%

Embodied parallelism and immersion in virtual reality gaming

Bollmer

Suddarth

2022

Convergence: The International Journal of Research into New Med

View full text Add to dashboard Cite

show abstract

“…Not yet stabilized as a narrative medium and symbolizing the evolution of cinematographic language over two centuries, VR attracts both practitioners and scholars due to its visual, aural, kinetic, haptic possibilities, and, more than separately, due to the "synesthetic encounters" it allows (Ross, 2020) with its considerable plasticity in terms of digital representation conventions and genres (Murray, 2020). Nevertheless, two normative paradoxes have been pointed in 360-degree journalism: the first, the consideration that a 360-degree view provides a more accurate representation of events, while at the same time allowing viewers to freely choose a field of view that can lead to a less accurate picture of the story; the second, the expectation it generates more objective reporting, while greatly depending on staging scenes and image processing in post-production (Aitamurto, 2019), as well on industry standards and practices (LaRocco, 2020).…”

Section: Virtual Reality and 360-degree Videomentioning

confidence: 99%

Spatial audio and immersive journalism: production, narrative design, and sense of presence

Vicente

Pérez-Seijo

2022

EPI

View full text Add to dashboard Cite

This article presents the findings from an experimental study on the use of binaural audio in two long-form journalistic features broadcast on Portuguese radio. From a production and narrative design perspective, our objective is to examine whether/how binaural audio implies a transformation of previously established news radio production work principles and practices, as well as of storytelling ideation and techniques. From a user experience viewpoint, we examine whether the use of binaural audio translates into higher levels of self-reported immersion and place illusion (n = 77). Despite the spread of new audio journalism formats, media and communication studies have until now largely neglected the role of spatial audio in the construction of immersion and the illusion of place. We argue that this epistemic omission translates into an image-centric conception and operationalization of the immersive journalism proposal, which stands out as a knowledge gap regarding the work of journalistic storytellers and relating to participants’ actual experience. The original contribution of this article is threefold: (1) conceptual, by broadening the perspective of journalism studies’ scholars and media professionals on the concept of immersive journalism, which, in our view, is often incorrectly considered to be synonymous with that of virtual reality journalism; (2) practical, by generating a more nuanced understanding of how actual practitioners perceive and employ immersive journalism; (3) phenomenological, by developing an examination of the factors that influence listeners’ ultimate perception of the immersive experience.

show abstract

“…This paper proposes a synesthetic design concept for digital elderly products based on big data, using the parallelism of the five senses of the elderly to synesthesia design for digital elderly products [13,14]. In the design process, this research uses the data mining technology in big data and the image recognition and intelligent voice interaction technology of complex intelligent systems to realize the synesthesia effect of the product and bring convenience to the elderly to use digital products [15,16]. In the market analysis of synesthesia design for digital products for the elderly, this article also conducts market research and statistical analysis.…”

Section: Related Work and Innovations In Thismentioning

confidence: 99%

Synesthetic Design of Digital Elderly Products Based on Big Data

2021

Wireless Communications and Mobile Computing

View full text Add to dashboard Cite

With the development of digital information technology, digital products have been integrated into people’s lives. The advent of the era of big data and the application of artificial intelligence have greatly accelerated this process. However, the increasingly high-end technology of these digital products brings more and more complex operations. The use and operation of these digital products have become a huge problem for the elderly who have a low level of acceptance of digital products or even a little out of touch. The purpose of this article is to study the influence of synesthetic design of digital senior products based on big data on the development of digital senior products. This article first understands the current problems in the development of digital elderly products and the design concepts and design processes of these digital elderly products through questionnaire surveys and market research. Then, this article analyzes the importance of synesthesia design for digital product design for the elderly through literature research and related product design cases. Then, this article combines the application of big data technology and complex intelligent system to carry out the synesthesia design of digital elderly products, the most important of which is to use the image recognition technology of complex intelligent system and intelligent voice interaction technology to achieve the synesthesia effect of these product designs. Finally, this paper uses the mathematical model of maximum utility and some statistical methods to analyze the effect of the product synesthesia design experiment in this research. Studies have shown that synesthesia design can maximize the utility of digital products for the elderly. This result is more than 95% confident in statistical analysis. Therefore, synesthesia design plays an important role in the popularization and development of digital elderly products in the elderly consumer groups.

show abstract

Virtual Reality’s New Synesthetic Possibilities

Cited by 27 publications

References 57 publications

Embodied parallelism and immersion in virtual reality gaming

Embodied parallelism and immersion in virtual reality gaming

Spatial audio and immersive journalism: production, narrative design, and sense of presence

Synesthetic Design of Digital Elderly Products Based on Big Data

Contact Info

Product

Resources

About