In the field of engineering management, teaching emphasizes the cultivation of applied talents within the context of new engineering disciplines. Evaluating the effectiveness of this cultivation is particularly necessary. The evaluation system for teaching effectiveness plays a crucial role in enhancing teaching quality, promoting students’ comprehensive development, and driving educational reforms. In recent years, there have been numerous research achievements on the evaluation system for practice-oriented teaching quality. However, compared with other disciplines, the field of engineering management remains in its infancy. Therefore, this study clarified the ability goals that talents in this major should possess by studying the evaluation indicators of teaching effectiveness in the field. Based on an emphasis on cultivating different abilities, a practical teaching effectiveness evaluation system was constructed. This study used the Delphi method and the analytic hierarchy process (AHP) to construct a teaching evaluation indicator system for engineering management majors. The system assigns weights to each indicator based on the “Four Abilities”, including professional competence, practical skills, innovation abilities, and employability. This results in the establishment of a relatively scientific and reasonable teaching effectiveness evaluation system. Furthermore, based on the research results, teaching reform studies related to ability cultivation in the “Building Structures” course were carried out. The teaching effectiveness was verified through post-class student feedback, and a student assessment method was established. This study contributes to a better understanding of the path of practical teaching reform and provides a reference value for teaching practice research in related majors.