A Hybrid Method for Inland Ship Recognition Using Marine Radar and Closed-Circuit Television

Abstract

Vessel recognition plays important role in ensuring navigation safety. However, existing methods are mainly based on a single sensor, such as automatic identification system (AIS), marine radar, closed-circuit television (CCTV), etc. To this end, this paper proposes a coarse-to-fine recognition method by fusing CCTV and marine radar, called multi-scale matching vessel recognition (MSM-VR). This method first proposes a novel calibration method that does not use any additional calibration target. The calibration is transformed to solve an N point registration model. Furthermore, marine radar image is used for coarse detection. A region of interest (ROI) area is computed for coarse detection results. Lastly, we design a novel convolutional neural network (CNN) called VesNet and transform the recognition into feature extraction. The VesNet is used to extract the vessel features. As a result, the MVM-VR method has been validated by using actual datasets collected along different waterways such as Nanjing waterway and Wuhan waterway, China, covering different times and weather conditions. Experimental results show that the MSM-VR method can adapt to different times, different weather conditions, and different waterways with good detection stability. The recognition accuracy is no less than 96%. Compared to other methods, the proposed method has high accuracy and great robustness.

Enhancing Maritime Cybersecurity through Operational Technology Sensor Data Fusion: A Comprehensive Survey and Analysis

“…12 Accuracy Kalman filters [113,115] 13. Decision support Several [58,68,76,89,92,93,105,108,128,130,161,254,255] 14.…”

Artificial Intelligence in Marine Science and Engineering

“…[8]. To this end, paper [9] proposed a coarse-to-fine recognition method by fusing CCTV and marine radar, called multi-scale matching vessel recognition (MSM-VR). This method first proposes a novel calibration method that does not use any additional calibration target.…”

Association of AIS and Radar Data in Intelligent Navigation in Inland Waterways Based on Trajectory Characteristics

“…In addition to the fusion of CCTV and AIS data, it is also employed for radar data integration to facilitate ship target detection. Liu proposed a method of multi-scale matching vessel recognition (MSM-VR) by fusing CCTV and marine radar to ensure navigation safety [17]. CCTV surveillance systems are susceptible to adverse weather conditions, such as rain, fog, and strong winds.…”