Improved LUT-Based Image Warping for Video Cameras

Luo, Lei; Wang, Chang-shuai; An, Sangwoo; Jeung, Yeumcheul; Chong, Jong‐Wha

doi:10.1109/cse.2011.83

Cited by 6 publications

(4 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this paper, extending our previous work [20], we proposed an ILUT-based image warping scheme for video camera applications. Utilizing the characteristics of image warping for video applications, the proposed ILUT drastically compresses the basic LUT and allows it to be stored in onchip memory.…”

Section: Discussionmentioning

confidence: 86%

An Improved Look-Up Table-Based FPGA Implementation of Image Warping for CMOS Image Sensors

Luo

Chong

2012

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

SUMMARYImage warping is usually used to perform real-time geometric transformation of the images captured by the CMOS image sensor of video camera. Several existing look-up table (LUT)-based algorithms achieve real-time performance; however, the size of the LUT is still large, and it has to be stored in off-chip memory. To reduce latency and bandwidth due to the use of off-chip memory, this paper proposes an improved LUT (ILUT) scheme that compresses the LUT to the point that it can be stored in on-chip memory. First, a one-step transformation is adopted instead of using several on-line calculation stages. The memory size of the LUT is then reduced by utilizing the similarity of neighbor coordinates, as well as the symmetric characteristic of video camera images. Moreover, an elaborate pipeline hardware structure, cooperating with a novel 25-point interpolation algorithm, is proposed to accelerate the system and reduce further memory usage. The proposed system is implemented by a fieldprogrammable gate array (FPGA)-based platform. Two different examples show that the proposed ILUT achieves real-time performance with small memory usage and low system requirements.

show abstract

Section: Discussionmentioning

confidence: 86%

An Improved Look-Up Table-Based FPGA Implementation of Image Warping for CMOS Image Sensors

Luo

Chong

2012

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

show abstract

“…Omni-vision systems developed by Bistry and Zhang [17] used multiple mono cameras, whereas Weissig et al [18] used multiple 3D stereo cameras for creating 3D, 360°FOV panorama on a cylindrical screen. Luo et al [19] used compressed LUT based technique to warp camera frames on FPGAs in real time. For input image resolution of 3200 Â 768, Luo et al [19] achieved much smaller sized LUTs i.e.…”

Section: Related Workmentioning

confidence: 99%

“…Luo et al [19] used compressed LUT based technique to warp camera frames on FPGAs in real time. For input image resolution of 3200 Â 768, Luo et al [19] achieved much smaller sized LUTs i.e. 25 kb, which were stored in on-chip memory.…”

Section: Related Workmentioning

confidence: 99%

A unified panoramic stitching and multi-projector rendering scheme for immersive panoramic displays

et al. 2015

View full text Add to dashboard Cite

“…The LUT presents the pixel-level mapping relationship between input and output images. The LUT-based design significantly reduces the complexity of implementing the AVM system since the expensive implementation of complex matrix multiplications can be avoided as in the case of [12]- [15]. Fig.…”

Section: B Lut-based Implementation Of Avm Systemmentioning

confidence: 99%

A Memory-Efficient Architecture of Full HD Around View Monitor Systems

Jeon

Park²,

Lee³

et al. 2014

IEEE Trans. Intell. Transport. Syst.

View full text Add to dashboard Cite

The around view monitor (AVM) is one of the representative features of smart vision systems adopted in various application areas, e.g., advanced driver assistance systems. The design of AVM systems with full high-definition (HD)-level resolution presents significant technical challenges. In particular, a high-memory performance is required to process full HD images obtained from multiple cameras. Specifically, a full HD AVM system requires a high-memory bandwidth (six times higher than D1 image-based systems) and is characterized by a significant amount of single writes, which degrades the effective performance of modern DRAM. To address these problems, two methods are proposed in this paper. The first method reduces the required memory bandwidth by storing in the memory only the input pixel data that will be used in the final processing step, and the second improves the single-write performance of a DRAM subsystem by DRAM-aware data mapping. The effectiveness of the proposed methods is proved by designing an AVM system incorporating field-programmable gate arrays and DDR2-200 SDRAMs. The proposed methods reduce the memory bandwidth requirement by 51%, allowing a full HD AVM system to run at over 24 frames per second.Index Terms-Advanced driver assistance system (ADAS), around view monitor (AVM), full high definition (HD), memory bandwidth.

show abstract

Improved LUT-Based Image Warping for Video Cameras

Cited by 6 publications

References 17 publications

An Improved Look-Up Table-Based FPGA Implementation of Image Warping for CMOS Image Sensors

An Improved Look-Up Table-Based FPGA Implementation of Image Warping for CMOS Image Sensors

A unified panoramic stitching and multi-projector rendering scheme for immersive panoramic displays

A Memory-Efficient Architecture of Full HD Around View Monitor Systems

Contact Info

Product

Resources

About