PM2.5 not only affects air visibility, but also can enter the lungs and blood through the respiratory tract, causing important damage to the human respiratory system, cardiovascular and cerebrovascular system. Infants, children, the elderly, patients with cardiovascular disease and chronic lung disease have become more sensitive to it, and has become an important factor endangering public health. Identifying PM2.5 spatial and temporal characteristics and influencing factors can provide key information for urban atmospheric environmental governance and public health improvement. Previous studies have only explored the influencing factors of PM2.5, while ignoring which is the more important factors. Firstly, this study explores the spatial-temporal evolution characteristics and spatial correlation characteristics of PM2.5 distribution in 285 cities in China. Then, a selection model---Bayesian model average method is applied to identify which variables are more likely to affect PM2.5 in China. We find that (1) From 2000 to 2018, the high-value concentration areas of PM2.5 distribution in China were mainly distributed in the central and eastern regions, and showed the trend of "moving eastward". (2) Among all variables in this study, population density, utilization rate of common industrial solid wastes, per capita Gross Domestic Product (GDP), proportion of secondary industry to GDP, centralized treatment rate of sewage treatment plant and industrial emission of sulfur dioxide are the most important drivers to predict PM2.5 in China. In addition, we found that the relationship between the selected variables and PM2.5 tends to change over time. In addition, we also show that the influence of selected variables on PM2.5 depends on the distribution of PM2.5, that is, there is a heterogeneous effect.