The behavior of spacecraft in tracking game is studied by using the theory of differential game. This study is based on the premise that both sides of the game have continuous small thrusts, and the terminal distance is set as the payoff function. Since the altitude of the two sides of the orbit is time-varying, the proposed model has time-varying characteristics. Finally, the problem is transformed into a two-point boundary value problem with high dimensional timevarying nonlinear. In order to solve the two-point boundary value problem, the multi-shooting method is usually adopted, but this method is very sensitive to the initial value problem, and the model has large error. To solve this problem, a hybrid algorithm combining multi-shooting method and particle swarm algorithm is proposed and numerical solutions are given. In the method, the initial value of the co-state variable is estimated by the particle swarm algorithm, and then it is brought into the multiple shooting method to obtain the solution of the problem. The simulation example shows that the hybrid algorithm has high calculation accuracy for the tracking game problem, and the calculation example finally gives the trajectories of both sides of the game.