For physical education (PE) in colleges, the evaluation of the teaching quality is affected by various fuzzy and uncertain factors. Therefore, this paper probes deep into the fuzzy evaluation of the teaching quality of college PE, using analytic hierarchy process (AHP), fuzzy system theory and grey theory. Firstly, the factors affecting the teaching quality of college PE were analyzed theoretically, and the keys to improving that teaching quality were clarified. On this basis, the authors established an evaluation index system and a fuzzy evaluation model for the teaching quality of college PE. The proposed fuzzy evaluation model serves an innovative tool to evaluate the teaching quality of college PE. Apart from effective measurement of the teaching quality, the proposed model provides an important reference for improving the teaching quality of college PE.