FVV Live: A Real-Time Free-Viewpoint Video System With Consumer Electronics Hardware

Carballeira, Pablo; Carmona, Carlos; Díaz, César; Berjón, Daniel; Quesada, Julian Cabrera; Morán, F.; Doblado, Carmen; Arnaldo, Sergio; Martin, M del Mar; García, Narciso

doi:10.1109/tmm.2021.3079711

Cited by 25 publications

(10 citation statements)

References 53 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The proposed system builds upon an existing portable FVV prototype called FVV Live, conceived for simple videoconferencing scenarios under controlled lighting [17]. Based on it, the 5G-RECORDS use case targets, among other possibilities, the real-time immersive capture of sport or entertainment events (e.g., a basketball game, a dance performance, or a concert), the aim being that the cameras be easily deployed at the event location, and then connected to the rest of the production pipeline using 5G.…”

Section: A Live Immersive Media Production In 5g-recordsmentioning

confidence: 99%

“…Fig. 2 shows the architecture of the FVV system we are using: FVV Live [17]. It consists of three processing modules (capture servers, view renderer, delivery server) and a control module (view control) interconnected using a high-speed IP network, usually Gbps Ethernet.…”

Section: B Fvv Systemmentioning

confidence: 99%

“…Extensive QoE tests have been conducted to assess the FVV Live visual quality, thus, evaluate the depth data preserving strategy. The discussion and results of these QoE tests have been recently published in [17] showing that FVV Live is always preferred over state-of-the-art DIBR alternatives.…”

Section: B Fvv Systemmentioning

confidence: 99%

“…In the project, we have addressed this challenge. We have started from a FVV system able to work in real time, FVV Live [17], that we have adapted to work within a mobile network. Then, we have connected the cameras to the 5G network through mmWave frequencies, virtualized the graphic processing functionality into the edge cloud, and ensured the end-to-end availability of network resources using slicing.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Live Free-Viewpoint Video in Immersive Media Production Over 5G Networks

Pérez

Corregidor²,

Garrido

et al. 2022

IEEE Trans. on Broadcast.

Self Cite

View full text Add to dashboard Cite

5G is a key tool for the cloud-based wireless production of audio-visual contents. By providing higher throughput and lower latency than previous mobile network technologies, as well as flexible allocation of network resources, it enables that some content production pipelines, which are currently implemented using wired connectivity, are provided on top of a 5G network. This brings down production costs, reduces environmental impact and increases operational efficiency. In particular, live immersive production services, such as free-viewpoint video (FVV), can be provided in a much more efficient way. In this paper, we address the challenge of producing and streaming FVV services in real time through 5G networks. We have adapted a state-of-the-art FVV system to integrate it within a 5G architecture, using three key technological enablers: mmWave radio access network to support the uplink traffic requirements from FVV cameras, multi-access edge computing to run video processing algorithms with minimum latency, and end-to-end slicing to guarantee a sufficient quality of service (QoS) within the production pipeline. We have built a field trial over the production network of a telecommunication operator, including a mmWave pilot deployment, edge cloud processing, and remote content production, involving three different locations across Spain. We have measured the key performance indicators at the relevant parts of our trial deployment, showing that, with existing 5G technology, it is possible to achieve live FVV production, although with some limitations. We have also analyzed such limitations, obtaining some insights on how the next generation of 5G networks can overcome them to achieve higher quality of experience (QoE).

show abstract

Section: A Live Immersive Media Production In 5g-recordsmentioning

confidence: 99%

Section: B Fvv Systemmentioning

confidence: 99%

Section: B Fvv Systemmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Live Free-Viewpoint Video in Immersive Media Production Over 5G Networks

Pérez

Corregidor²,

Garrido

et al. 2022

IEEE Trans. on Broadcast.

Self Cite

View full text Add to dashboard Cite

show abstract

“…This way, Google Startline ensures stereopsis, motion parallax, and spatialized audio. Other related factors and systems are under development within academic research groups, such as showing the remote partner near the user gaze point (Kim et al, 2019b), or aiming at allowing real-time communication and exploration of the remote environment through Free Viewpoint Video systems (FVV) (Carballeira et al, 2021). All these systems have as their final aim to maximize the face to face communication.…”

Section: Overview Of Systemsmentioning

confidence: 99%

Emerging Immersive Communication Systems: Overview, Taxonomy, and Good Practises for QoE Assessment

Pérez,

Gonzalez-Sosa,

Gutiérrez

et al. 2022

Preprint

View full text Add to dashboard Cite

Several technological and scientific advances have been achieved recently in the fields of immersive systems (e.g., 360-degree/multiview video systems, augmented/mixed/virtual reality systems, immersive audio-haptic systems, etc.), which are offering new possibilities to applications and services in different communication domains, such as entertainment, virtual conferencing, working meetings, social relations, healthcare, and industry. Users of these immersive technologies can explore and experience the stimuli in a more interactive and personalized way than previous technologies (e.g., 2D video). Thus, considering the new technological challenges related to these systems and the new perceptual dimensions and interaction behaviors involved, a deep understanding of the users' Quality of Experience (QoE) is required to satisfy their demands and expectations. In this sense, it is essential to foster the research on evaluating the QoE of immersive communication systems, since this will provide useful outcomes to optimize them and to identify the factors that can deteriorate the user experience. With this aim, subjective tests are usually performed following standard methodologies (e.g., ITU recommendations), which are designed for specific technologies and services. Although numerous user studies have been already published, there are no recommendations or standards that define common testing methodologies to be applied to evaluate immersive communication systems, such as those developed for images and video. Taking this into account, a revision of the QoE evaluation methods designed for previous technologies is required to develop robust and reliable methodologies for immersive communication systems. Thus, the objective of this paper is to provide an overview of existing immersive communication systems and related user studies, which can help on the definition of basic guidelines and testing methodologies to be used when performing user tests of immersive communication systems, such as 360-degree video-based telepresence, avatar-based social VR, cooperative AR, etc.

show abstract

Is Free-Viewpoint Video the Future of Online TV?

Boulanger

2022

Lecture Notes in Networks and Systems

View full text Add to dashboard Cite

FVV Live: A Real-Time Free-Viewpoint Video System With Consumer Electronics Hardware

Cited by 25 publications

References 53 publications

Live Free-Viewpoint Video in Immersive Media Production Over 5G Networks

Live Free-Viewpoint Video in Immersive Media Production Over 5G Networks

Emerging Immersive Communication Systems: Overview, Taxonomy, and Good Practises for QoE Assessment

Is Free-Viewpoint Video the Future of Online TV?

Contact Info

Product

Resources

About