Architecture of a Low Latency Image Rectification Engine for Stereoscopic 3-D HDTV Processing

A low-complexity depth-reliability-based stereomatching algorithm and an efficient scanline memory-merging implementation scheme are proposed in this paper. The developed algorithm analyzes the accuracy of disparity results by using simple local window-based methods and preserves reliable information only. A bidirectional depth propagation flow is then adopted to fill the unreliable segments by using reliable information. Moreover, a set of predefined function-specific reliability variables are extracted to further improve depth quality in the occluded and smooth regions, which can reduce 39% bad pixels obtained by applying the basic 7 × 7 window-based matching. The proposed scanline memory-merging scheme along with data prefetching can lead to 32.7% savings on the scanline memory area and relax the requirements of external frame buffer size and bandwidth. Experimental results show that the implemented stereo-matching hardware has a gate count of 223 k including the scanline memory, and can achieve up to 70 frames/s for 480 × 540 resolution (2 × 2 downsampling of FullHD side-by-side 3-D format) with 56 disparity levels.Index Terms-Reliability-based computation, stereo-matching, window-based sum of absolute differences (SAD) architecture.

show abstract

“…The input stereo pairs in our experiments are assumed rectified [21]. Table IV shows a comparison of image quality metrics [4], [22].…”

Section: Experimental Results and Performance Comparisonmentioning

confidence: 99%

Depth-Reliability-Based Stereo-Matching Algorithm and Its VLSI Architecture Design

Yang

Chu

Chen

et al. 2015

IEEE Trans. Circuits Syst. Video Technol.

View full text Add to dashboard Cite

show abstract

“…The systematic latency was analyzed in head‐mounted virtual reality device or 3D tele‐immersion system, and the latency effect can be partially overcome by improving the strategy of image rendering or motion prediction . For a DB3D system, such analysis of the latency and the control scenario are not yet available.…”

Section: Introductionmentioning

confidence: 99%

Overcoming latency with motion prediction in directional autostereoscopic displays

Zhang

Chen

et al. 2019

J Soc Info Display

View full text Add to dashboard Cite

Imaging delivering to correct retina assisted with tracking technique is a common practice for autostereoscopic displays with stereo two‐view data format. Due to various latencies produced in camera buffering, computer processing, data transmission, and illumination refreshing, delayed image delivery will give rise to a substantial degradation of the 3D display experience. This is particularly obvious for directional backlight 3D displays where significant flickering is resulted as a result of the inherent latency. This work systematically analyzes the source of latency by quantitatively measuring the exact latency value in a typical directional backlight autostereoscopic display. Based on accurate measurement, a motion prediction solution is proposed to improve the synchronization between the backlight illumination and viewer's eye location. Motion prediction helps overcome the lag between the center of illumination and viewer's eye, providing a flicker‐free viewing experience for both a stationary and a moving viewer.

show abstract

“…The stereo-vision or plural camera views have been used in order to express real-scenes in applications such as 3D video processing [1], ortho-photo map development [2], laparoendoscopic surgery [3,4], around-view monitoring systems [5,6], and intelligent industrial robots [7] and vehicles [8,9]. Rectification for a plural camera view system is an essential calibration process to align with epipolar lines [10][11][12].…”

Section: Introductionmentioning

confidence: 99%

Efficient Hardware Implementation of Real-time Rectification using Adaptively Compressed LUT

Kim

Oh³

et al. 2016

JSTS:Journal of Semiconductor Technology and Science

View full text Add to dashboard Cite

Abstract-Rectification is used as a preprocessing to reduce the computation complexity of disparity estimation. However, rectification also requires a complex computation. To minimize the computing complexity, rectification using a lookup-table (R-LUT) has been introduced. However, since, the R-LUT consumes large amount of memory, rectification with compressed LUT (R-CLUT) has been introduced. However, the more we reduce the memory consumption, the more we need decoding overhead. Therefore, we need to attain an acceptable trade-off between the size of LUT and decoding overhead. In this paper, we present such a trade-off by adaptively combining simple coding methods, such as differential coding, modified run-length coding (MRLE), and Huffman coding. Differential coding is applied to transform coordinate data into a differential form in order to further improve the coding efficiency along with Huffman coding for better stability and MRLE for better performance. Our experimental results verified that our coding scheme yields high performance with maintaining robustness. Our method showed about ranging from 1 % to 16 % lower average inverse of compression ratio than the existing methods. Moreover, we maintained low latency with tolerable hardware overhead for realtime implementation.

show abstract

Architecture of a Low Latency Image Rectification Engine for Stereoscopic 3-D HDTV Processing

Cited by 15 publications

References 14 publications

Depth-Reliability-Based Stereo-Matching Algorithm and Its VLSI Architecture Design

Depth-Reliability-Based Stereo-Matching Algorithm and Its VLSI Architecture Design

Overcoming latency with motion prediction in directional autostereoscopic displays

Efficient Hardware Implementation of Real-time Rectification using Adaptively Compressed LUT

Contact Info

Product

Resources

About