Digital rural construction is a key strategic direction to promote China’s rural revitalization and alleviate global climate problems. In order to put forward feasible suggestions for the subsequent development and ensure the smooth development of digital village construction, how to reflect the development level of the digital village through scientific and reasonable comprehensive evaluation has become an urgent problem to be solved. This paper establishes a comprehensive evaluation index system through the Delphi method and principal component analysis method, then assigns weights to the evaluation indicators based on the improved CRITIC-G1 method, and then grades the development level of digital villages according to the extension matter element method. Finally, taking Jiangxi Province in China as an example, the overall development level of digital villages in Jiangxi Province is evaluated from the provincial level according to the proposed method. And put forward the corresponding countermeasures and suggestions. Results: Firstly, the development level of digital villages in Jiangxi Province is good, and there is a trend of excellent development level. Secondly, from different aspects of digital rural development, the digitalization of infrastructure, services, economy, and green production in Jiangxi Province is at a good level, and the digitalization of life has reached an excellent level. Thirdly, from the perspective of development trends, the digitization of infrastructure has a progressive trend towards an excellent level of development, while the digitization of services, economy and green production has signs of development regression. According to the analysis results, the relevant countermeasures and suggestions are put forward from four aspects: talent, capital, governance system and development planning. Other regions can evaluate the development level of the digital village according to the evaluation model proposed in this paper so as to analyze the existing problems and put forward targeted solutions to promote the construction of the digital village.