Tracking objects is a crucial problem in image processing and machine vision, involving the representation of position changes of an object and following it in a sequence of video images. Though it has a history in military applications, tracking has become increasingly important since the 1980s due to its wide-ranging applications in different areas. This study focuses on tracking moving objects with human identity and identifying individuals through their appearance, using an Artificial Neural Network (ANN) classification algorithm. The Kalman filter is an important tool in this process, as it can predict the movement trajectory and estimate the position of moving objects. The tracking error is reduced by weighting the filter using a fuzzy logic algorithm for each moving human. After tracking people, they are identified using the features extracted from the histogram of images by ANN. However, there are various challenges in implementing this method, which can be addressed by using Genetic Algorithm (GA) for feature selection. The simulations in this study aim to evaluate the convergence rate and estimation error of the filter. The results show that the proposed method achieves better results than other similar methods in tracking position in three different datasets. Moreover, the proposed method performs 8% better on average than other similar algorithms in night vision, cloud vision, and daylight vision situations.