FTV (free-viewpoint television)

Tanimoto, Masayuki

doi:10.1017/atsip.2012.5

Cited by 27 publications

(15 citation statements)

References 49 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In that sense, interactivity problem cannot be solved by simply sending reference viewpoints at strategical places. Other methods introduce high redundancy in the scene description by using a light field representation [27], [28]. They sample the navigation domain very finely, concatenate all the images and finally model the light rays of the scene.…”

Section: Introductionmentioning

confidence: 99%

Navigation Domain Representation For Interactive Multiview Imaging

Maugey

Daribo

Cheung

et al. 2013

IEEE Trans. on Image Process.

View full text Add to dashboard Cite

Abstract-Enabling users to interactively navigate through different viewpoints of a static scene is a new interesting functionality in 3D streaming systems. While it opens exciting perspectives toward rich multimedia applications, it requires the design of novel representations and coding techniques to solve the new challenges imposed by the interactive navigation. In particular, the encoder must prepare a priori a compressed media stream that is flexible enough to enable the free selection of multiview navigation paths by different streaming media clients. Interactivity clearly brings new design constraints: the encoder is unaware of the exact decoding process, while the decoder has to reconstruct information from incomplete subsets of data since the server generally cannot transmit images for all possible viewpoints due to resource constrains. In this paper, we propose a novel multiview data representation that permits us to satisfy bandwidth and storage constraints in an interactive multiview streaming system. In particular, we partition the multiview navigation domain into segments, each of which is described by a reference image (color and depth data) and some auxiliary information. The auxiliary information enables the client to recreate any viewpoint in the navigation segment via view synthesis. The decoder is then able to navigate freely in the segment without further data request to the server; it requests additional data only when it moves to a different segment. We discuss the benefits of this novel representation in interactive navigation systems and further propose a method to optimize the partitioning of the navigation domain into independent segments, under bandwidth and storage constraints. Experimental results confirm the potential of the proposed representation; namely, our system leads to similar compression performance as classical inter-view coding, while it provides the high level of flexibility that is required for interactive streaming. Because of these unique properties, our new framework represents a promising solution for 3D data representation in novel interactive multimedia services.

show abstract

Section: Introductionmentioning

confidence: 99%

Navigation Domain Representation For Interactive Multiview Imaging

Maugey

Daribo

Cheung

et al. 2013

IEEE Trans. on Image Process.

View full text Add to dashboard Cite

show abstract

“…The videos in this database are generated by simulating exploring trajectories that the observers may use in real scenarios, which are set by the Hypothetical Rendering Trajectory (HRT), defined in the following subsection. This database is named as 'Image, Perception and Interaction group Free-viewpoint video database' (IPI-FVV) 1 .…”

Section: On Perceived Qualitymentioning

confidence: 99%

“…patches with only smooth texture. One can calculate p 151 with 1 − i∈ (1,150) p i , since i∈(1,151) p i = 1. Finally, the output of these 151 classifiers are concatenated to form the ST vector so that with a given pixel (x, y), the corresponding patch can be represented as V (x, y) = (p 1 , p 2 , ..., p 151 ) and the set of classifiers as the universal codebook.…”

Section: B Sketch-token Based Spatial Dissimilaritymentioning

confidence: 99%

Prediction of the Influence of Navigation Scan-Path on Perceived Quality of Free-Viewpoint Videos

Ling

Gutiérrez

et al. 2019

IEEE J. Emerg. Sel. Topics Circuits Syst.

View full text Add to dashboard Cite

Free-Viewpoint Video (FVV) systems allow the viewers to freely change the viewpoints of the scene. In such systems, view synthesis and compression are the two main sources of artifacts influencing the perceived quality. To assess this influence, quality evaluation studies are often carried out using conventional displays and generating predefined navigation trajectories mimicking the possible movement of the viewers when exploring the content. Nevertheless, as different trajectories may lead to different conclusions in terms of visual quality when benchmarking the performance of the systems, methods to identify critical trajectories are needed. This paper aims at exploring the impact of exploration trajectories (defined as Hypothetical Rendering Trajectories: HRT) on perceived quality of FVV subjectively and objectively, providing two main contributions. Firstly, a subjective assessment test including different HRTs was carried out and analyzed. The results demonstrate and quantify the influence of HRT in the perceived quality. Secondly, we propose a new objective video quality assessment measure to objectively predict the impact of HRT. This measure, based on Sketch-Token representation, models how the categories of the contours change spatially and temporally from a higher semantic level. Performance in comparison with existing quality metrics for FVV, highlight promising results for automatic detection of most critical HRTs for the benchmark of immersive systems.

show abstract

“…Thomas Maugey and Aline Roumy are with Inria Rennes Bretagne-Atlantique, Campus Universitaire de Beaulieu, 35042 Rennes Cedex, France, e-mail: {thomas.maugey,aline.roumy}@inria.fr Elsa Dupraz is with IMT Atlantique, Lab-STICC, UMR CNRS 6285, F-29238, Technopôle Brest-Iroise, CS 83818, 29238 Brest cedex 03, France, e-mail: elsa.dupraz@imt-atlantique.fr Michel Kieffer is with Université Paris-Saclay, CNRS, Centrale-Supélec, L2S, 3 rue Joliot-Curie, 91192 Gif-sur-Yvette, France, e-mail: michel.kieffer@l2s.centralesupelec.fr Examples of MRA applications are free-viewpoint television (FTV) [2], access to data collected by a network of sensors [3] or a crowd-sensing platform [4]. In these applications, the items of the database (e.g., the frames of a video, or the frames of the different views in multiview video, or the signals captured by different sensors) show strong correlations with each other.…”

Section: Introductionmentioning

confidence: 99%

Incremental Coding for Extractable Compression in the Context of Massive Random Access

Maugey

Roumy

Dupraz

et al. 2020

IEEE Trans. on Signal and Inf. Process. over Networks

View full text Add to dashboard Cite

In this paper, we study the problem of source coding with Massive Random Access (MRA). A set of correlated sources is encoded once for all and stored on a server while a large number of clients access various subsets of these sources. Due to the number of concurrent requests, the server is only able to extract a bitstream from the stored data: no re-encoding can be performed before the transmission of the data requested by the clients.First, we formally define the MRA framework and propose to model the constraints on the way subsets of sources may be accessed by a navigation graph. We introduce both storage and transmission costs to characterize the performance of MRA. We then propose an Incremental coding Based Extractable Compression (IBEC) scheme. We first show that this scheme is optimal in terms of achievable storage and transmission costs. Second, we propose a practical implementation of our IBEC scheme based on rate-compatible LDPC codes. Experimental results show that our IBEC scheme can almost reach the same transmission costs as in traditional point-to-point source coding schemes, while having a reasonable overhead in terms of storage cost.

show abstract

FTV (free-viewpoint television)

Cited by 27 publications

References 49 publications

Navigation Domain Representation For Interactive Multiview Imaging

Navigation Domain Representation For Interactive Multiview Imaging

Prediction of the Influence of Navigation Scan-Path on Perceived Quality of Free-Viewpoint Videos

Incremental Coding for Extractable Compression in the Context of Massive Random Access

Contact Info

Product

Resources

About