Rate-distortion optimized streaming of fine-grained scalable video sequences

Abstract

We present optimal schemes for allocating bits of fine-grained scalable video sequences among multiple senders streaming to a single receiver. This allocation problem is critical in optimizing the perceived quality in peer-to-peer and distributed multi-server streaming environments. Senders in such environments are heterogeneous in their outgoing bandwidth and they hold different portions of the video stream. We first formulate and optimally solve the problem for individual frames, then we generalize to the multiple frame case. Specifically, we formulate the allocation problem as an optimization problem, which is nonlinear in general. We use rate-distortion models in the formulation to achieve the minimum distortion in the rendered video, constrained by the outgoing bandwidth of senders, availability of video data at senders, and incoming bandwidth of receiver. We show how the adopted rate-distortion models transform the nonlinear problem to an integer linear programming (ILP) problem. We then design a simple rounding scheme that transforms the ILP problem to a linear programming (LP) one, which can be solved efficiently using common optimization techniques such as the Simplex method. We prove that our rounding scheme always produces a feasible solution, and the solution is within a negligible margin from the optimal solution. We also propose a new algorithm (FGSAssign) for the single-frame allocation problem that runs in O(n log n) steps, where n is the number of senders. We prove that FGSAssign is optimal. Furthermore, we propose a heuristic algorithm (mFGSAssign) that produces near-optimal solutions for the multiple-frame case, and runs an order of magnitude faster than the optimal one. Because of its short running time, mFGSAssign can be used in real time. Our experimental study validates our analytical analysis and shows the effectiveness of our allocation algorithms in improving the video quality.

Live peer-to-peer streaming with scalable video coding and networking coding

“…To address these issues, number of works have proposed P2P streaming systems with scalable video streams, e.g. [6,12,17,24,30]. Cui and Nahrstedt [6] present an algorithm to decide for each peer how to request video layers from a given set of senders.…”

“…They assume layers have equal bitrate and provide equal video quality. Hefeeda and Hsu [12] study this problem for Fine-Grained Scalable (FGS) videos, taking into account the rate-distortion model of the video for maximizing the perceived quality. Rejaie and Ortega [30] present a framework for layered P2P streaming, where a receiver coordinates the transmission of video packets from multiple senders using a TCP-friendly congestion control mechanism.…”

Efficient allocation of seed servers in peer-to-peer streaming systems with scalable videos

“…An algorithm is presented in [15] to be run on each peer independently that decides how to request video layers from a given set of heterogeneous senders, assuming layers have equal bitrate and provide equal video quality. Hefeeda et al [17] study this problem for Fine-Grained Scalable (FGS) videos, taking into account the rate-distortion model of the video for maximizing the perceived quality, which is more accurate than assuming all layers have equal quality enhancements as supposed in [15]. We too consider video layers with heterogenous rates and quality enhancements.…”

Video communication systems with heterogeneous clients

“…In [1,2], we consider optimal streaming of scalable video streams from multi-senders to a single receiver. Streaming from multiple senders is necessary in peer-to-peer (P2P) streaming environments, because of the limited capacity and unreliability of peers.…”