Evaluating the effectiveness of ecological civilization policies is the basis from which policymakers can optimize policies. From the perspective of the overall effectiveness of regional policies, and taking Jiangsu Province as an example, this study constructed a quantitative evaluation model of eco-civilization policy text and an eco-civilization evaluation index system. Using these tools, this paper evaluates the effectiveness of 53 ecological civilization policies issued by Jiangsu Province during 2004–2019 to promote the construction of ecological civilization in the four fields of resource utilization, environmental protection, economic development, and social life. There are three key findings. (1) During the period of 2004–2019, the effectiveness of the textual content of ecological civilization policies in Jiangsu Province generally showed a fluctuating upward trend. (2) The construction effectiveness indexes of the four fields of eco-civilization all showed a growth trend, but the construction effect varied greatly. The index of economic development had grown rapidly, while environmental protection had grown slowly. (3) Ecological civilization policies in Jiangsu Province were effective in promoting the construction of ecological civilization. However, the effects of different policy dimensions on ecological civilization development in the four fields were significantly different. Finally, based on these results, powerful recommendations are provided for the optimization of eco-civilization policies in Jiangsu Province. Moreover, Jiangsu is the first province in China to launch a provincial-level ecological civilization construction plan. Its policy optimization to promote ecological civilization construction can also provide an example and realistic basis for reference for the construction of eco-civilization in other provinces in China.