A comprehensive evaluation system for rural building energy consumption from an innovative composite perspective was established, suitable for southwest of China. The index system was established by brainstorming and the Delphi method, the weights of the comprehensive evaluation model were calculated by the analytic network process (ANP) method, and the scoring criteria of all evaluation indexes were levelled based on fuzzy evaluation theory. The system model was verified by case analysis, in the countryside around Chengdu Second Circle. Taking into account the highest weight, lowest comprehensive score, and widest range of comprehensive scores, three key factors were identified, namely percentage of clean energy use, thermal performance of exterior walls, and implementation rate of energy-saving measures. The distribution of comprehensive indicators and evaluation factors had certain spatial distribution characteristics, and the overall spatial distribution was characteristically high in the southeast and low in the northwest. Finally, based on key factors and regional distribution characteristics, energy-saving measures are proposed from three aspects: increasing sunrooms, adding wall insulation layers, and standardizing air conditioning temperature settings.