Efficient Resource Allocation of Mobile Multi-View 3D Videos with Depth-Image-Based Rendering

Ho, Ting-Yu; Yang, De-Nian; Liao, Wanjiun

doi:10.1109/tmc.2014.2321401

Cited by 6 publications

(8 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The transmission system adopts feedback for viewpoint requests, and the texture and depth streams are transmitted to each viewer individually. A similar transmission system is adopted in [9], in which multiple multiview 3-D videos are transmitted to multiple viewers. A game-theoretical framework is developed to efficiently allocate resources to the different multiview streams.…”

Section: A Related Workmentioning

confidence: 99%

“…Furthermore, the FTV broadcast system presented in [7] still requires feedback channels and transmits FTV data on different networks and hence may suffer from time synchronization issues. Other studies focus on FTV transmission over unreliable wireless channels [8] and on efficient resource allocation between multiview streams [9]. In these cases, although the mobile terminals receive texture and depth data to render the desired viewpoint, these methods require feedback and a separate stream for each viewer, rendering such frameworks inappropriate for broadcast transmission.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Broadcasting Free-Viewpoint Television Over Long-Term Evolution Networks

Zarb

Debono

2016

IEEE Systems Journal

View full text Add to dashboard Cite

Recent advances in mobile device technology, cellular networks, and multimedia coding have paved the way for a wide range of innovative multimedia services that can be delivered to mobile users. An interesting application is free-viewpoint television (FTV), which allows the viewer to interactively select the scene viewing angle. Conveying this service over cellular networks is very challenging due to the large bandwidth requirements and limitations in computational power, memory, and battery resources on mobile terminals. Moreover, providing FTV over mobile systems necessitates new means for quality evaluation, which consider cellular network parameters. To address these challenges, we propose a scalable FTV broadcast architecture for long-term evolution cellular networks. To alleviate complex processing on mobile receivers, depth maps are estimated in the cloud and transmitted along the multiview video. Moreover, a novel depth image-based rendering technique is developed to improve quality while minimizing processing load on the mobile terminal, giving typical peak signal-to-noise ratio gains of 2 dB. Experimental results reveal that, for a satisfactory rendering quality, bit-rate savings of more than 70% are achieved compared with simulcast transmission. Furthermore, subjective tests indicate that this solution improves the perceived quality considerably. Finally, we study the impact of handovers induced in mobile systems on the quality of experience.Index Terms-Depth image-based rendering (DIBR), free-viewpoint television (FTV), long-term evolution (LTE), multiview video coding (MVC), multiview video plus depth (MVD), quality of experience (QoE), 3-D video.

show abstract

Section: A Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Broadcasting Free-Viewpoint Television Over Long-Term Evolution Networks

Zarb

Debono

2016

IEEE Systems Journal

View full text Add to dashboard Cite

show abstract

“…Most of studies based on DIBR in recent years is some improvements based on the framework proposed Do [24], for example, depth image preprocessing [27], improved hole-filling algorithm [28], allocation of resources [9], and parallelization acceleration. So in this experiment, we selected a DIBR synthesis algorithm proposed by Do [24].…”

Section: Experiments 2: Simulated Datasetmentioning

confidence: 99%

“…The holes [2,3], artifacts [4,5], deformation [6], and abnormal edge [7] will appear after image warping; repair works for these issues, such as inpainting, have high computational complexity. Although there are a lot of recent work on improving imaging quality in real time [8], Ho [9] and Xiao [10] reduced the computational complexity and improved operational efficiency in their work but still cannot achieve real-time performance. Mori [11] and Zinger [12] enhanced imaging quality in their work but further increased computational complexity.…”

Section: Introductionmentioning

confidence: 99%

Real-time virtual view synthesis using light field

Yao

Liu

2016

J Image Video Proc.

View full text Add to dashboard Cite

Virtual view synthesis technique renders a virtual view image from several pre-collected viewpoint images. The hotspot on virtual view synthesis area is depth image-based rendering (DIBR), which has low one-time imaging quality. To achieve high imaging quality artifacts, the holes must be inpainted after image warping which means high computational complexity. This paper proposed a real-time virtual view synthesis method from light field. Then the light field is transformed into frequency domain. The light field is parameterized and reconstructed from image array. The virtual view is rendered by resampling the light field in frequency domain. After resampling the image by performing Fourier slice, the virtual view image is obtained by inverse Fourier transform. Experiments show that our method can get high one-time imaging quality in real time.

show abstract

“…Here, , The logarithmic function is used to describe the user satisfaction related to bandwidth [14]. Then, we have , , ,…”

Section: B Utility Functionsmentioning

confidence: 99%

Dynamic bandwidth allocation in mobile social networks with multiple homing access

Shen

2015

2015 International Conference on Wireless Communications &Amp; Signal Processing (WCSP)

View full text Add to dashboard Cite

In this paper, we propose a dynamic bandwidth allocation scheme based on Stackelberg game for a heterogeneous network to simultaneously offer mobile social users with bandwidth via multiple homing access. In specific, network operators in the heterogeneous network compete with each other to determine the price of the bandwidth based on the prediction of mobile social users' demands. Then, mobile social users with the same interests form a social community as a coalition to dynamically request bandwidth and share the cost with each other. We formulate the bandwidth allocation problem as a Stackelberg game to model the interactions among mobile social users and network operators. In addition, with a backward induction, an iterative algorithm is proposed to obtain the Stackelberg equilibrium. Finally, simulation results show that the proposed scheme can improve both the efficiency ratio of bandwidth allocation and load balance of networks compared with uniform bandwidth allocation, random bandwidth allocation, and single access scheme.Index Terms-Mobile social networks (MSNs), bandwidth allocation, Stackelberg game, multiple homing access.

show abstract

Efficient Resource Allocation of Mobile Multi-View 3D Videos with Depth-Image-Based Rendering

Cited by 6 publications

References 36 publications

Broadcasting Free-Viewpoint Television Over Long-Term Evolution Networks

Broadcasting Free-Viewpoint Television Over Long-Term Evolution Networks

Real-time virtual view synthesis using light field

Dynamic bandwidth allocation in mobile social networks with multiple homing access

Contact Info

Product

Resources

About