Object tracking is a fundamental computer vision problem and is required for many high-level tasks such as activity recognition, behavior analysis and surveillance. The main challenge in the object tracking problem is the dynamic change in object/background appearance, illumination, shape and occlusion. We present an online learning neural tracker (OLNT) to differentiate the object from the background and also adapt to changes in object/background dynamics. In the proposed tracking system, we propose a new mobile object detection module which identifies new mobile objects in the scene and then OLNT faithfully locates them in subsequent frames. The OLNT extracts region-based features like region-based color moments for larger mobile objects and color and texture features at pixel level for smaller mobile objects.For target modeling and object tracking, new neural classifier algorithm based on risk sensitive loss function is proposed to handle issues related to sample imbalance and change in characteristic of object class in future frames. The proposed neural classifier automatically determines the number of neurons required to estimate the posterior probability map. In the online learning neural classifier, only one neuron parameter is updated per tracker to reduce the computational burden during online adaptation.The tracked object is represented using an estimated posterior probability map. The signature of the posterior probability map is used to adapt the bounding box to handle the scale change and improper initialization.For illustrating the advantage of the proposed OLNT under rapid illumination variation, change in appearance, scale/size change, and occlusion, we present results from benchmark video sequences. The results clearly highlight the advantages of the proposed OLNT. Finally, we also present the comparison with well-known ensemble tracker in one the sequence and highlight the advantage of the proposed tracker.
Index TermsObject tracking, neural classifier, Gaussian activation function, posterior probability map, signature in 2D, risk sensitive hinge loss function.