The realization of target tracking includes many technologies, among which the most critical and core element is the target tracking algorithm. Based on this, this paper first uses an omnidirectional vision image enhancement algorithm to identify the target and then designs an adaptive target recognition algorithm based on SVM to identify the actual target. The results show that, in the case of different illuminance, the fluctuation range of the four evaluation indexes after image enhancement is smaller than that of the original image, indicating that the brightness distribution of the image after enhancement is more uniform, which eliminates interference factors for the subsequent image recognition and tracking. The difference of recognition rate between the two algorithms is small when the illumination value is medium. When the illumination value is high or low, the recognition rate of the adaptive algorithm is much higher than that of the threshold method.