Abstract-This paper is combined with successful cases of the Chinese typical city governments purchase pension service, and on this basis, analyzing the present situations、advantages and disadvantages of social organizations provide pension service quality supervision and evaluation in actual operation. The developed countries mature management experience for reference, using the theory of system engineering to construct suitable for Chinese government purchase pension service quality management effectiveness index system from four aspects, which is the life care services, physical and mental health services, leisure and recreation services and safety and hygiene services, and to evaluate each factor priority of the index system's criterion layer and the index layer with quantitative fuzzy comprehensive method. Evaluation result for guarantee elderly pension life quality, improve allocation efficiency of the public service resource, and perfect the pension service management processes, thus promoting the development of social organizations, expanding public management theory and research method has a very important practical and theoretical significance.