As a comprehensive benefit coordination mechanism, ecological protection compensation has received increasing attention internationally. China has also introduced a series of policies to promote ecological protection compensation mechanism improvement. The evaluation of ecological protection compensation policies is the main basis for the formulation, adjustment and improvement of the policy. Based on the front-end perspective of policy formulation, this paper selects 10 ecological protection compensation policies issued by the State Council and various ministries in China from 2006 to 2021. A text mining-based PMC index evaluation system using the ROSTCM tool is constructed to quantitatively evaluate these 10 typical policies, and four representative policies are selected for comparative analysis. The overall design of China’s ecological protection compensation policies is reasonable, and 5 out of 10 policies have good PMC index scores, which are: P1, P2, P5, P7 and P9; and 5 are at acceptable levels, which are: P3, P4, P6, P8 and P10. However, the PMC surface and the concavity index indicate that there are still some limitations that need to be improved, including the obvious internal differentiation of the policies, the single effectiveness of the policies, and the insufficient incentive and guarantee measures. Finally, this paper provides suggestions for the optimization of ecological protection compensation policies accordingly.