High Performance Low Cost Video Analysis Core for Smart Camera Chips in Distributed Surveillance Network

Abstract

Conventional smart camera cannot achieve realtime processing for high-performance video content analysis algorithms with only RISCs. In literatures, DSPs or coprocessors are employed to implement video content analysis functions. In this paper, a video content analysis core with specially-designed hardware accelerators is proposed to realize the content analysis functions in smart camera with low cost. The resulting smart camera in this paper can then provide high performance content analysis functions, including video segmentation, video object description, and video object tracking, for real-time surveillance applications. Moreover, design techniques such as frame-level pipelining and subword level parallelism are also applied on the design of these special hardware accelerators in order to achieve high throughput rate, high hardware utilization, and saving the bus bandwidth. When considering the total hardware cost of smart camera chip, the proposed video analysis core is very low cost and is suitable to be integrated in the next generation surveillance systems.

Image Processing Units on Ultra-low-cost Embedded Hardware: Algorithmic Optimizations for Real-time Performance

“…Both PC-based and embedded IPUs find applications in industrially-relevant areas: machine vision, video surveillance, and human-computer interfaces. Improving their performance [5], and reducing their cost [6] and power consumption [7] has been a research focus.…”