Firstly, the improved OpenPose is used to obtain the skeletal point coordinate data and normalized, and then the human gesture features are extracted according to the spatial geometric relationship of human morphology to improve the differentiation degree of the gesture features on similar actions in the basic sports actions, which is used for the gesture matching of the basic sports actions. On this basis, the DTW posture matching algorithm based on human differentiated posture features is proposed, which realizes the posture matching and carries out the evaluation and result feedback of students’ sports movements. Finally, we construct a sports movement evaluation system based on the aforementioned method, which compares the movement video with the standard movement from the template library and provides feedback on the movement’s evaluation results. The system allows teachers to access the learning situations of numerous students’ movements, while the system provides feedback for movement learners to adjust their movements, thereby facilitating a convenient and informative interaction in sports movement teaching. After seven weeks of experimentation, there is a significant difference between the assessment scores of the experimental group and the control group, and 90% of the students are satisfied with the application of the sports movement assessment teaching system to assist teaching. It proves that the intelligent teaching structure and diversified teaching methods promote students’ learning efficiency and performance, significantly improve students’ motivation to learn physical education courses, and further improve the demand for an information-based teaching environment.