Mass sports has become a world trend, setting off a new health revolution in the world. Mass fitness programs not only enrich people's lives. It not only relieves the psychological pressure of modern people but also promotes people's health and improves people's quality of life. According to the time-consuming stability of neural network algorithm, this paper proposes a sports video recognition algorithm based on BP neural network. The static and dynamic features are classified by BP neural network, and the basic probability assignment is constructed according to the preliminary recognition results. At the same time, we use evidence theory to fuse the preliminary results and get the results of motion video recognition. It can be applied to the generation model of the feasible scheme of mass sports fitness. Relevant experiments show that the whole model that generates the feasible mass sports fitness scheme can accurately generate the sports fitness scheme of multiple patient users and ensure the rationality and safety of the sports fitness scheme.