The multifaceted sources of physical education teaching factors and the uncertainty of evaluation have an impact on the qualitative and quantitative evaluation results of teaching effects. In order to improve the evaluation accuracy of the physical education teaching effect, the evaluation model of the physical education teaching effect was designed based on the AHP algorithm. The evaluation model is based on monitoring the whole process of teaching. Based on the multifaceted sources of physical education teaching factors and the uncertainty of evaluation, the overall objectives and selects three-level evaluation indicators were analyzed. The AHP algorithm was used to establish the hierarchical structure and obtained the total ranking and comprehensive score of the hierarchy. The test results show that the teaching evaluation model designed in this paper has an RMSE mean value of 1.923, which has higher evaluation accuracy and is conducive to the improvement of teaching quality.