With the challenge to reach targets of carbon emission reduction at the regional level, it is necessary to analyze the regional differences and influencing factors on China’s carbon emission efficiency. Based on statistics from 2005 to 2015, carbon emission efficiency and the differences in 30 provinces of China were rated by the Modified Undesirable Epsilon-based measure (EBM) Data Envelopment Analysis (DEA) Model. Additionally, we further analyzed the influencing factors of carbon emission efficiency’s differences in the Tobit model. We found that the overall carbon emission efficiency was relatively low in China. The level of carbon emission efficiency is the highest in the East region, followed by the Central and West regions. As for the influencing factors, industrial structure, external development, and science and technology level had a significant positive relationship with carbon emission efficiency, whereas government intervention and energy intensity demonstrated a negative correlation with carbon emission efficiency. The contributions of this paper include two aspects. First, we used the Modified Undesirable EBM DEA Model, which is more accurate than traditional methods. Secondly, based on the data’s unit root testing and cointegration, the paper verified the influencing factors of carbon emission efficiency by the Tobit model, which avoids the spurious regression. Based on the results, we also provide several policy implications for policymakers to improve carbon emission efficiency in different regions.