Application of heterogeneous multiple camera system with panoramic capabilities in a harbor environment

Abstract

In a harbor environment threats like explosives-packed rubber boats, mine-carrying swimmers and divers must be detected in an early stage. This paper describes the integration and use of a heterogeneous multiple camera system with panoramic observation capabilities for detecting these small vessels in the Den Helder New Harbor in the Netherlands. Results of a series of experiments with different targets are presented. An outlook to a future sensor package containing panoramic vision is discussed. We also investigated several aspects of the use of electro-optical systems. As for classification, this paper concentrates on discriminating classes of small vessels with different electro-optical systems (visual and infrared) as part of the larger process involving an operator. It addresses both selection of features (based on shape and texture) and ways of using these in a system to assess threats. Results are presented on data recorded in coastal and harbor environments for several small targets.

Task-specific sensor settings for electro-optical systems in a marine environment

“…In a previous paper 3 we used two color representations to visualize a multi-band image of a scene observed during the harbor trial. The multi-band image consisted of four images of a frigate docked in the harbor with a group of people standing on the bow (figure 5).…”

“…A multi-sensor concept could use a sensor with large field-of-regard, such as a 360 degree staring IR system or radar, for automatic detection 3 . After detection, clutter reduction and tracking, a higher resolution camera system could be queued to tracks and allow determination of features for type classification and finally identification.…”