On-chip signal processing configurations for focal plane arrays

Abstract

Third generation Focal Plane Arrays (FPAs) are being designed to incorporate numerous sophisticated "smart" functions, useful in the preprocessing and filtering ofreal-time image data. Designers at Nova Research, Inc. have developed ROIC designs which have increased the capabilities of these devices in the area of signal and image processing. These new FPAs are more versatile than their predecessors through the implementation of a variety of programmable modes of operation. This paper will discuss a variety of such processing functions and modes.Design configurations for such FPAs will be discussed with regard to the incorporation ofgeneral and specific signal processing functions. Such functions will include but not be limited to: edge enhancement and edge extraction, accommodating high and low signal flux environments, high speed windowing and foveated pixel arrangements.

CMOS image sensor with contour enhancement

“…For the two-dimensional filtering resistive network, the circuit could implement the image contour enhancing. Since the image edge (V ada -V res ) is just the difference of original signal V ada from smoothed signal V res output from the filtering resistive network [8] , the resulted image signal is the sum of the image edge and the original signal V ada . Different effects of enhancing image contour could be achieved in that the smoothing effect of the filtering resistive network is adjustable.…”

FPGA-based processor for high framerate target detection on cluttered backgrounds using LVASITMsensors

“…Nova Sensors has developed a novel two-dimensional imaging chip [1] - [3] whose design is based on properties exhibited by biological retinas. The VASI™ imager permits the user to program a unique spatial arrangement of "superpixels" that may be updated in real time and at the operational frame rate.…”

“…In our previous papers, the FPGA-based processing package [4] and the co-processor board [5] have been introduced for numerous commercial and military applications including motion detection, optical flow, background velocimetry, and target tracking. The processing package [4] is being continually upgraded by new point-and area-applied algorithms [6]- [9] for variety of real-time digital video camera systems including foveal sensors [1] - [3]. The goal of this paper is to demonstrate the FPGA-based processing package for the high frame-rate target detection on a cluttered background using variable acuity sensors (see Section 3).…”

“…In contrast to full-resolution sensors, foveal sensors provide a wide field of view at high frame rates with one or more very high spatial resolution regions (i.e., foveae) on areas of interest. The foveal sensors are based on Nova's VASI™ [1] and LVASI™ (frame size of 1024 x 1024 pixels) technologies [2], [3].…”