State-of-the-Art in 360° Video/Image Processing: Perception, Assessment and Compression

Xu, Mai; Li, Chen; Zhang, Shanyi; Callet, Patrick Le

doi:10.1109/jstsp.2020.2966864

Cited by 230 publications

(105 citation statements)

References 144 publications

Supporting

Mentioning

104

Contrasting

Unclassified

Order By: Relevance

“…We now describe the latest contributions mostly related to our work, which are focused on: i) analysis of users' behaviour within ODV; ii) user-depended streaming strategies for ODV. For a comprehensive literature review on ODV analysis and communication, we refer the reader to [55] and [14], respectively.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Do Users Behave Similarly in VR? Investigation of the User Influence on the System Design

Rossi

Özçinar

Smolić

et al. 2020

ACM Trans. Multimedia Comput. Commun. Appl.

View full text Add to dashboard Cite

With the overarching goal of developing user-centric Virtual Reality (VR) systems, a new wave of studies focused on understanding how users interact in VR environments has recently emerged. Despite the intense efforts, however, current literature still does not provide the right framework to fully interpret and predict users trajectories while navigating in VR scenes. This work advances the state-of-the-art on both the study of users' behaviour in VR and the user-centric system design. In more details, we complement current datasets by presenting a public available dataset that provides navigation trajectories acquired for heterogeneous omnidirectional videos and different viewing platforms, namely, head-mounted display, tablet and laptop. We then present an exhaustive analysis on the collected data, to better understand navigation in VR across users, content, and for the first time across viewing platforms. The novelty lies in the user-affinity metric, proposed in this work to investigate users' similarities when navigating within the content. The analysis reveals useful insights on the effect of device and content on the navigation, which could be precious considerations from the system design perspective. As a case study of the importance of studying users' behaviour when designing VR systems, we finally propose an user-centric server optimisation. We formulate an integer linear program that seeks the best stored set of omnidirectional content that minimises encoding and storage cost while maximises the user's experience. This is posed while taking into account network dynamics, type of video content, but also user population interactivity. Experimental results prove that our solution outperforms commonly company recommendations in terms of experienced quality but also in terms of encoding and storage, achieving a saving up to 70%. More importantly, we highlight a strong correlation between the storage cost and the user-affinity metric, showing the impact of the latter in the system architecture design.

show abstract

Section: Related Workmentioning

confidence: 99%

“…This allows us to move a step forward in the direction of better understanding how users interact with the VR technology, with a substantial impact on the efficiency of VR systems. Our study is therefore vital for the community to design reliable user-centric systems, as the recently proposed coding and streaming strategies for ODV [55].…”

Section: Introductionmentioning

confidence: 99%

Do Users Behave Similarly in VR? Investigation of the User Influence on the System Design

Rossi

Özçinar

Smolić

et al. 2020

ACM Trans. Multimedia Comput. Commun. Appl.

View full text Add to dashboard Cite

show abstract

“…Due to their potential, significant efforts have been devoted in the last years to devising improved solutions in terms of relevant aspects for VR360 video, like capturing and consumption hardware, compression and streaming strategies, and display solutions (e.g. [2,3,4]). Likewise, the demand for production and consumption of VR360 videos has been significantly increasing in the last few years.…”

Section: Introductionmentioning

confidence: 99%

VR360 Subtitling: Requirements, Technology and User Experience

et al. 2021

View full text Add to dashboard Cite

“…This quest for reliability is exacerbated by the recent trend/near-future interest in integrating autonomous driving mechanisms in automotive or unmanned flying vehicles [3]. Indeed, such systems rely on the perception functionality; it processes images of the surrounding environment taken from cameras to extract features that are then transmitted to the control application to take driving decisions [4].…”

Section: Introductionmentioning

confidence: 99%

Error Modeling for Image Processing Filters accelerated onto SRAM-based FPGAs

Bolchini

Cassano

Mazzeo

et al. 2020

2020 IEEE 26th International Symposium on on-Line Testing and Robust System Design (IOLTS)

View full text Add to dashboard Cite

Image processing is today employed in a variety of application fields, including safety-and mission-critical ones. In these scenarios it is vital to carefully analyse the reliability of the designed system before deployment and, if necessary, to adopt specific hardening techniques. Two are the techniques generally employed: circuit-level fault injection and applicationlevel functional error simulation. In this paper we present a set of functional error models specific for a number of convolutionbased filters that are the basic building blocks for a wide range of image processing applications. The presented error models, derived through a number of circuit-level fault injection experiments, may be integrated into application-level functional error simulators, bridging the gap between the two strategies. The presented error models are the first step towards combining the accuracy of fault injection and the flexibility of error simulation into a widely adopted reliability analysis tool.

show abstract

State-of-the-Art in 360° Video/Image Processing: Perception, Assessment and Compression

Cited by 230 publications

References 144 publications

Do Users Behave Similarly in VR? Investigation of the User Influence on the System Design

Do Users Behave Similarly in VR? Investigation of the User Influence on the System Design

VR360 Subtitling: Requirements, Technology and User Experience

Error Modeling for Image Processing Filters accelerated onto SRAM-based FPGAs

Contact Info

Product

Resources

About