Deep Ensemble Object Tracking Based on Temporal and Spatial Networks

Abstract

In recent years, correlation filtering and deep learning have achieved good performance in object tracking. Correlation filtering is an efficient and real-time method because its formula provides a fast solution in the Fourier domain, but it does not benefit from end-to-end training. Although deep learning is an effective method for learning object representations, training deep networks online with one or a few examples is challenging. To address these problems, we propose a deep ensemble object tracking algorithm that fuses temporal and spatial information to improve algorithm precision and robustness. The framework of our algorithm includes four aspects: feature extraction, a baseline network, a branch network and adaptive ensemble learning. Feature extraction extracts the general object representation. The baseline network integrates feature extraction and a correlation filtering algorithm into a convolutional neural network for end-to-end training. The branch network is composed of a temporal network and a spatial network. The temporal and spatial networks capture the object temporal and spatial information and further refine the object position. Our algorithm only needs an initial frame to train all networks. Adaptive ensemble learning compensates for the object information deficiency and improves tracking accuracy. Many experiments on tracking benchmark datasets demonstrate that our algorithm performs favourably compared with state-ofthe-art tracking algorithms. INDEX TERMS Object tracking, feature extraction, baseline network, temporal and spatial networks, adaptive ensemble learning.

Ensemble Learning-Based Multi-Cues Fusion Object Tracking in Complex Surveillance Environment

“…On the other hand, statistical mistakes could arise if the amount of training data that is provided is insufficient in comparison with the scope of the object space. In this situation, we may lessen the likelihood of selecting "weak" classifiers by utilizing the framework of ensemble learning [24][25][26][27] to cast votes for a number of different hypothetical outcomes. is will allow us to lower the danger of selecting "weak" classifiers.…”

Siamese Visual Tracking With Residual Fusion Learning

“…In reality, multi-layer feature fusion is a kind of ensemble learning technique, for which one of the most important issues is to design an ensemble module to combine several weak sub-learners into a stronger learner. The technique has been widely discussed and proved to be effective in some previous trackers [34], [35]. For a Siamese network, every decision block can be regarded as a sub-learner, while the fusion approach plays the role of ensemble module.…”

Novel Monitoring System for Low-Voltage DC Distribution Network Using Deep-Learning- Based Disaggregation

“…Deep learning is an appropriate technology to solve this type of problem [16,17]. Generationsource tracking and disaggregation technology using deep learning have greatly improved in terms of robustness and generalization ability compared with traditional tracking methods [18][19][20][21]. In this work, two approaches are used for DER output tracking in an LVDC distribution system.…”