This paper adopts virtual reality technology to conduct in-depth research and analysis on sports rehabilitation training, designs a corresponding sports rehabilitation training program, and applies it to practice. An AR algorithm based on dynamic target tracking under VSLAM is proposed. The algorithm can effectively reject dynamic targets in static scenes while ensuring that the virtual objects registered based on dynamic template target tracking are still in the world coordinate system of VSLAM. To facilitate patients’ hand function rehabilitation training, this paper uses OpenPose for 2D gesture pose recognition, combines camera pose information and depth information provided by VSLAM to map key points of the hand into the world coordinate system, and then completes the interaction by collision detection algorithm. The virtual interaction module is implemented in this paper to meet the demand for multiuser off-site interaction in virtual training. This paper uses the Unity3D software and Photon Server server to create a VR virtual scene and design a user interaction mechanism to realize a system that supports multiple users to train together online, which effectively extends the application scope of the VR training system. The module utilizes Unity3D’s VR development capabilities to develop VR virtual basketball gym scenes and single-player offline interaction mechanisms such as virtual user single shooter and shooter; then, Photon Server is used to design and implement a multiuser remote login system and a multiuser interpass mechanism, thus achieving the effect of multiplayer remote online interaction in the same VR space. Finally, the proposed module was validated, and the results proved the effectiveness of the sports rehabilitation training program.