Before the advent of the new era, my country has completed the popularization of higher education, and the country has gradually begun to pay attention to the quality of higher education. Under the background of Healthy China, the quality of physical education teaching in colleges and universities has become a hot topic of social concern. The quality of physical education teaching in colleges and universities directly determines the quality of physical education talents. A reasonable, complete, and scientific evaluation system of physical education teaching quality in colleges and universities is an effective measure to improve the quality of physical education teaching and the training of physical education talents. The physical education teaching quality evaluation in colleges and universities is frequently viewed as the multiple attribute group decision-making (MAGDM) issue. In such paper, taxonomy method is designed for solving the MAGDM under single-valued neutrosophic sets (SVNSs). First, the score function of SVNSs and criteria importance through intercriteria correlation (CRITIC) method is used to derive the attribute weights. Second, then, the optimal choice is obtained through calculating the smallest single-valued neutrosophic number development attribute values from the single-valued neutrosophic number positive ideal solution (SVNNPIS). Finally, a numerical example for physical education teaching quality evaluation in colleges and universities is given to illustrate the built method.