Highly three–dimensional and complex flow structures are closely related to the aerodynamic losses occurring in the transonic axial–flow compressor. The large eddy simulation (LES) approach was adopted to study the aerodynamic performance of the NASA rotor 37 for the cases at the design, the near stall (NS), and the near choke (NC) flow rate. The internal flow vortex topology was analyzed by the Q–criterion method, the omega (Ω) vortex identification method, and the Liutex identification method. It was observed that the Q–criterion method was vulnerable to being influenced by the flow with high–shear deformation rate, especially near the end–wall regions. The Ω method was adopted to recognize the three–dimensional vortex structure with a higher precision than that of the Q–criterion method. Meanwhile, the Liutex vortex identification method showed a good performance in vortex identification, and the corresponding contribution of Liutex components in the vortex topology was analyzed. The results show that the high–vortex fields around the separation line and reattachment line had high vortex components in the x–axis, the tip clearance vortices presented a high–vortex component in the y–axis, and the suction side corner vortex possessed high–vortex components in the y– and z–axes.