Most target tracking is based on a lot of samples training to build the model of the target, which is then carried on the tracking processing. This will need to choose a lot of tracked target samples for learning and training. However, there are all kinds of deformation of the training samples, including variety of light and scale, and so on, causing the long computation time, high computational complexity, and less robustness. The traditional kernel correlation filtering (KCF) tracking is through online learning of the first frame in the target vide. It then uses cyclic matrix to strengthen samples robustness, reducing the complexity of the calculation and time. But, the traditional KCF nuclear is unsatisfactory used for complex scenarios and quick treatment. In this paper, under the framework of the KCF, the target context information is introduced to make the tracking have better robustness and a better effect to deal with complex scenarios.