The evaluation of undergraduate teaching levels by the Ministry of Education has greatly promoted the construction of software and hardware in universities. After the evaluation, it will be a long-term task to build a long-term decision-making mechanism to guarantee the continuous improvement of teaching quality. As an important part of university education, physical education (PE) has always played an irreplaceable role in improving current students’ physical quality and cultivating their awareness of lifelong physical exercise. How to establish and improve the quality evaluation information system of PE to guarantee the quality of PE is not only related to the awareness of physical education workers about their own teaching work but also to the effective means to regulate the quality monitoring of PE. An effective PE quality evaluation system depends not only on the teaching management department but also on the evaluation of teaching by students and teachers themselves. Only in this way can PE classroom teaching quality be comprehensively and truly reflected. The evaluation of PE quality in higher education is often considered as a multiattribute group decision-making (MAGDM) problem. In this article, the EDAS model is extended to the single-valued neutrosophic sets (SVNSs) setting to deal with MAGDM and the computational steps, for all designs are listed. Finally, the PE quality evaluation is given to prove the SVNN-EDAS model and some good comparative analysis is done to demonstrate the advantages of SVNN-EDAS. It is shown that the SVNN-EDAS method emphasizes the expectation value of the SVNN average alternative. Compared with different methods mentioned, the SVNN-EDAS method is more practical and efficient because the calculation steps are simpler and easier to apply in practice.