Learning the model update with local trusted templates for visual tracking

Abstract

Existing Siamese trackers usually do not update templates or adopt single‐updating strategies. However, historical information cannot be effectively utilized when using these strategies, and model drift from complex tracking challenges cannot be addressed. To address this issue, a novel tracking framework that learns the model update with local trusted templates is proposed in this paper. The authors propose a complementary confidence evaluation method to select local trusted templates in a sliding window. This provides high‐confidence historical information. The authors also propose a method including linear learning and deep learning to learn to model updates. Different from traditional update strategies, the authors’ method combines non‐linear and linear updates to obtain reliable templates with the most abundant historical information, which solves the complex tracking challenges to a certain extent. Finally, the adaptive fusion response maps of the two strategies determine the final tracking based on the confidence evaluation. Experimental results on NFS, UAVDT, UAV123, UAV20L and VOT2016 show that our method performs favourably when compared with current state‐of‐the‐art methods.

Robust object tracking via ensembling semantic‐aware network and redetection

“…Tracking long videos is a good test of the robustness of a tracker. We compare our method with 9 related trackers: TransT [18], LMU_LTT [48], HiFT [19], SiamBAN [44], ADTrack_v2 [50], AutoTrack [45], MSCF [46], AMCF [51], and SiamRPN++ [27]. As shown in Figure 8, our method outperforms the top tracker TransT [18] with relative gains of (4.4%, 4.9%) in the precision score and success rate respectively.…”

“…The dataset includes 123 video sequences with an average sequence length of 915 frames. We compare our method with some representative trackers, namely, LMU_LTT [48], SiamGAT [49], SiamCAR [43], SiamBAN [44], ADTrack_v2 [50], AutoTrack [45], MSCF [46], AMCF [51], and SiamRPN++ [27]. Figure 7 illustrates the precision and success rate plots of the compared trackers.…”