SeeCoast extends the US Coast Guard Port Security and Monitoring system by adding capabilities to detect, classify, and track vessels using electro-optic and infrared cameras, and also uses learned normalcy models of vessel activities in order to generate alert cues for the watch-standers when anomalous behaviors occur. SeeCoast fuses the video data with radar detections and Automatic Identification System (AIS) transponder data in order to generate composite fused tracks for vessels approaching the port, as well as for vessels already in the port. Then, SeeCoast applies rule-based and learning-based pattern recognition algorithms to alert the watch-standers to unsafe, illegal, threatening, and other anomalous vessel activities. The prototype SeeCoast system has been deployed to Coast Guard sites in Virginia. This paper provides an overview of the system and outlines the lessons learned to date in applying data fusion and automated pattern recognition technology to the port security domain.Keywords: Port security, video surveillance, track fusion, alerts, anomaly detection, homeland security
GOALS AND ARCHITECTUREAutomated scene understanding is a common issue throughout the Department of Homeland Security, including Coast Guard, Border Patrol, Transportation Security, and Infrastructure Protection. Numerous sensors have been deployed for these Agencies, engendering watch-stander manning as a growing problem. The goal of automated scene understanding is to reduce operator workload while maintaining effectiveness and improving detection of anomalous behaviors.SeeCoast builds upon the USCG Hawkeye system, which uses a combination of surface surveillance radar and Automatic Identification System (AIS) beacons to track vessels and generate zone-incursion alerts. Hawkeye also includes manually-controlled and radar-slaved video cameras, an integrated command center, and a web-based information client. Hawkeye has been deployed to more than six operational US Coast Guard (USCG) Sector Command Centers. It allows watch-standers to surveil all vessel arrivals, departures, and transits within a port-centered area of interest.Currently, watch-standers attempt to detect and assess possible anomalous behaviors using a large number of video cameras, radars, and AIS track data. SeeCoast has two goals: to increase the effectiveness of the watch-standers, and to increase their efficiency in surveillance operations. SeeCoast increases watch-stander effectiveness by adding capabilities to process video and infrared camera streams to detect, classify (small, medium, large vessel size), and track vessels; to fuse video tracks with radar & AIS tracks; to maintain seamless 24/7 vigilance on the track scene; to provide consistent alerting using established rules and learned normalcy models; and to free the surveillance system operators to assess behaviors rather than spending their time detecting behaviors. SeeCoast increases the efficiency of maritime surveillance operations by simultaneously examining data and tracks from many...
