With the rapid development of modern power systems, it is imperative to establish an evaluation index system for monitoring power utilities. Previous researches have mainly focused on the evaluation of power system operation regarding to a few aspects, lack of an integrated evaluation to assess the overall performance of power industry. This paper presents a new comprehensive evaluation index system. The index system contains five categories covering the assessment on reliability, economy, power quality, energy efficiency and fairness, and provides a reference for achieving optimal dispatching and management of power systems.