Ship tracking provides crucial on-site microscopic kinematic traffic information which benefits maritime traffic flow analysis, ship safety enhancement, traffic control, etc., and thus has attracted considerable research attentions in the maritime surveillance community. Conventional ship tracking methods yield satisfied results by exploring distinct visual ship features in maritime images, which may fail when the target ship is partially or fully sheltered by obstacles (e.g., ships, waves, etc.) in maritime videos. To overcome the difficulty, we propose an augmented ship tracking framework via the kernelized correlation filter (KCF) and curve fitting algorithm. First, the KCF model is introduced to track ships in the consecutive maritime images and obtain raw ship trajectory dataset. Second, the data anomaly detection and rectification procedure are implemented to rectify the contaminated ship positions. For the purpose of performance evaluation, we implement the proposed framework and another three popular ship tracking models on the four typical ship occlusion videos. The experimental results show that our proposed framework successfully tracks ships in maritime video clips with high accuracy (i.e., the average root mean square error (RMSE), root mean square percentage error (RMSPE), mean absolute deviation (MAD) and mean absolute percentage error (MAPE) are less than 10), which significantly outperforms the other popular ship trackers.INDEX TERMS Smart ship, curve fitting, kernelized correlation filter, visual ship tracking, ship occlusion.