Director’s Cut - Analysis of Aspects of Interactive Storytelling for VR Films

Fearghail, Colm O; Özçinar, Çağrı; Knorr, Sebastian; Smolić, Aljoša

doi:10.1007/978-3-030-04028-4_34

Cited by 27 publications

(21 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The idea of SD came from previous VR experiments where users would have appreciated more time to get their bearings before too much action unfolds, hence suggesting that temporarily slowing down a scene might help to better immerse into the environment. It is also corroborated by Fearghail et al in [16] who found that longer shots were less disorientating because the user had enough time to explore the environment at their own pace. By lowering the playback speed, a SD gives more time for the playback buffer to fill with high quality video segments, thereby preserving the visual quality and improving the impression of reality.…”

Section: Slow Downsupporting

confidence: 55%

New interactive strategies for virtual reality streaming in degraded context of use

Sassatelli

Winckler

Fisichella

et al. 2020

Computers & Graphics

View full text Add to dashboard Cite

Virtual reality videos are an important element in the range of immersive contents as they open new perspectives for story-telling, journalism or education. Accessing these immersive contents through Internet streaming is however much more difficult owing to the required data rates much higher than for regular videos. While current streaming strategies rely on video compression, in this paper we investigate a radically new stance: we posit that degrading the visual quality is not the only choice to reduce the required data rate, and not necessarily the best. Instead, we propose two new impairments, Virtual Walls (VWs) and Slow Downs (SDs), that change the way the user can interact with the 360 degree video in an environment with insufficient available bandwidth. User experiments with a double-stimulus approach show that, when triggered in proper time periods, these impairments are better perceived than visual quality degradation from video compression. We confirm with network simulations the usefulness of these new types of impairments: incorporated into a FoV-based adaptation, they can enable reduction in stalls and startup delay, and increase quality in FoV, even in the presence of substantial playback buffers.

show abstract

Section: Slow Downsupporting

confidence: 55%

New interactive strategies for virtual reality streaming in degraded context of use

Sassatelli

Winckler

Fisichella

et al. 2020

Computers & Graphics

View full text Add to dashboard Cite

show abstract

“…In order to bridge the gap between traditional and 360°cinematography, Mateer [18] discusses how different existing film directing techniques could be applied in this new emerging field. Focusing on the field of cinematography for 360°content, Knorr et al [12] and Fearghail et al [23] analyze users' behavior while watching 360 • movies by taking into account the intended viewing orientation designed by the director, to verify whether users follow this intended path when watching the film. Fearghail et al [6] use the same dataset to identify the scene elements attracting users' attention.…”

Section: Related Workmentioning

confidence: 99%

“…Focusing on the field of cinematography for 360°content, Knorr et al [12] and Fearghail et al [23] analyze users' behavior while watching 360 • movies by taking into account the intended viewing orientation designed by the director, to verify whether users follow this intended path when watching the film. Fearghail et al [6] use the same dataset to identify the scene elements attracting users' attention. They analyze how cuts affect storytelling and derive some insights about how to redirect users' attention to the main action of the scene, such as using graphical elements and matching the orientation of interesting parts of the story across transitions.…”

Section: Related Workmentioning

confidence: 99%

Exploring the impact of 360° movie cuts in users’ attention

Marañes

Gutiérrez

Serrano

2020

2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)

View full text Add to dashboard Cite

Figure 1: Example frame from the movie The People's House produced by Felix & Paul Studios used to study how people explore professionally edited 360°movies. For analyzing how users behave across movie cuts, we start from head orientation data (left), and we take into account visual attention priors in order to compute saliency maps (right) describing users' gaze. ABSTRACTVirtual Reality (VR) has grown since the first devices for personal use became available on the market. However, the production of cinematographic content in this new medium is still in an early exploratory phase. The main reason is that cinematographic language in VR is still under development, and we still need to learn how to tell stories effectively. A key element in traditional film editing is the use of different cutting techniques, in order to transition seamlessly from one sequence to another. A fundamental aspect of these techniques is the placement and control over the camera. However, VR content creators do not have full control of the camera. Instead, users in VR can freely explore the 360 • of the scene around them, which potentially leads to very different experiences. While this is desirable in certain applications such as VR games, it may hinder the experience in narrative VR. In this work, we perform a systematic analysis of users' viewing behavior across cut boundaries while watching professionally edited, narrative 360 • videos. We extend previous metrics for quantifying user behavior in order to support more complex and realistic footage, and we introduce two new metrics that allow us to measure users' exploration in a variety of different complex scenarios. From this analysis, (i) we confirm that previous insights derived for simple content hold for professionally edited content, and (ii) we derive new insights that could potentially influence VR content creation, informing creators about the impact of different cuts in the audience's behavior.

show abstract

“…A HMD-based Director's Cut dataset has been proposed in Knorr et al [24] to evaluate the users' attention in storyteller ODV. An interactive storytelling perspective was then presented in [15,16]. More recently, Nasrabadi et al [31] investigated the impact of camera motion on HMD navigation trajectories using the clique-based clustering presented in [44].…”

Section: Studies Related To Odv Dataset and User Behaviour Analysismentioning

confidence: 99%

Do Users Behave Similarly in VR? Investigation of the User Influence on the System Design

Rossi

Özçinar

Smolić

et al. 2020

ACM Trans. Multimedia Comput. Commun. Appl.

Self Cite

View full text Add to dashboard Cite

With the overarching goal of developing user-centric Virtual Reality (VR) systems, a new wave of studies focused on understanding how users interact in VR environments has recently emerged. Despite the intense efforts, however, current literature still does not provide the right framework to fully interpret and predict users trajectories while navigating in VR scenes. This work advances the state-of-the-art on both the study of users' behaviour in VR and the user-centric system design. In more details, we complement current datasets by presenting a public available dataset that provides navigation trajectories acquired for heterogeneous omnidirectional videos and different viewing platforms, namely, head-mounted display, tablet and laptop. We then present an exhaustive analysis on the collected data, to better understand navigation in VR across users, content, and for the first time across viewing platforms. The novelty lies in the user-affinity metric, proposed in this work to investigate users' similarities when navigating within the content. The analysis reveals useful insights on the effect of device and content on the navigation, which could be precious considerations from the system design perspective. As a case study of the importance of studying users' behaviour when designing VR systems, we finally propose an user-centric server optimisation. We formulate an integer linear program that seeks the best stored set of omnidirectional content that minimises encoding and storage cost while maximises the user's experience. This is posed while taking into account network dynamics, type of video content, but also user population interactivity. Experimental results prove that our solution outperforms commonly company recommendations in terms of experienced quality but also in terms of encoding and storage, achieving a saving up to 70%. More importantly, we highlight a strong correlation between the storage cost and the user-affinity metric, showing the impact of the latter in the system architecture design.

show abstract

Director’s Cut - Analysis of Aspects of Interactive Storytelling for VR Films

Cited by 27 publications

References 20 publications

New interactive strategies for virtual reality streaming in degraded context of use

New interactive strategies for virtual reality streaming in degraded context of use

Exploring the impact of 360° movie cuts in users’ attention

Do Users Behave Similarly in VR? Investigation of the User Influence on the System Design

Contact Info

Product

Resources

About