Block DCT Based Optimization for Wireless SoftCast of Depth Map

Abstract

With the recent emergence of naked-eye 3D mobile devices, the 3D video-based applications on the mobile terminal are showing great potential. However, the conventional transmission scheme based on separate source coding and channel coding may fail in the broadcast and mobile scenarios due to the drastic changes in wireless channel condition. Recently, an uncoded transmission scheme called SoftCast was introduced, which shows efficient performance for wireless 2D video transmission. However, it may not work well for 3D video wireless transmission, especially for the depth maps. Based on the piecewise smoothness of depth maps, we propose an uncoded wireless depth map transmission scheme, which incorporates three customized components of optimization into the SoftCast framework. First, compared with the framelevel discrete cosine transform (DCT) used in 2D video SoftCast, the mean removed block-based DCT is preferred as the decorrelation transform for depth maps to accommodate its piecewise smooth property, which also facilitates the following subsequent optimization. Second, view synthesis distortion-based chunk dropping is utilized for more efficient power allocation in the case of limited bandwidth, where the block DCT provides a better estimation for synthesis distortion. Third, inter-block DCT coefficients are rearranged to form chunks in terms of minimizing the intra-chunk variance, further enhancing the chunk-level power allocation efficiency. The experimental results demonstrate that the proposed scheme can provide superior performance than the state-of-the-art SoftCast methods while achieving graceful synthesis quality transition within a wide channel signal-to-noise ratio range.

Soft Delivery: Survey on A New Paradigm for Wireless and Mobile Multimedia Streaming

“…Some studies [120]- [124] designed a soft delivery scheme for a free-viewpoint video. Specifically, FreeCast in [120]- [122] is the first scheme for a free-viewpoint video.…”

Synthesis-Distortion-Aware Hybrid Digital Analog Transmission for 3D Videos

“…Very recently, for 3D Softcast, Laplacian multipliers were used in [16] to find the closed-form expression of the distortion by transforming the power allocation problem into an optimization problem. The mean-removed block-based discrete cosine transform (DCT) and view synthesis distortion were used in [17] to remove correlations and enhance the effectiveness of energy allocation. Additionally, power allocation was performed to scale the interblock DCT coefficients.…”

“…Additionally, power allocation was performed to scale the interblock DCT coefficients. However, [16] and [17] focused on Softcast, not HDA, and there has not been any work reported on 3D-HDA.…”