(1) Background: although mumps vaccines have been introduced in most countries around the world in recent years, mumps outbreaks have occurred in countries with high vaccination rates. At present, China remains the focus of the global fight against mumps. This study aims to observe the epidemic characteristics and spatial clustering patterns of mumps and to investigate the potential factors affecting the disease incidence, which could provide novel ideas and avenues for future research as well as the prevention and control of mumps. (2) Methods: we used ArcGIS software to visualize the spatial distribution and variation of mumps. Spatial autocorrelation analysis was applied to detect the spatial dependence and clustering patterns of the incidence. We applied the Spatial Durbin Panel Model (SDPM) to explore the spatial associations of ecological environmental factors with mumps. (3) Results: overall, the incidence rate showed a significant upward trend from 2014 to 2018, with the highest number of cases in the 10–15-year age group and from May to June. Geographically, the high incidence clusters were concentrated in southern regions, including Hunan, Hubei, Chongqing, Guizhou, Guangdong, and Guangxi. This study also found that mumps has a positive spatial spillover effect in the study area. The average temperature and GDP of the local and adjacent areas have a significant impact on mumps. The increase in PM2.5 contributes to the rise in the incidence of mumps in this region. (4) Conclusions: these results can offer some novel ideas for policymakers and researchers. Local meteorological conditions and economic levels can extend to surrounding areas to affect the occurrence of mumps, so regional cooperation becomes particularly important. We recommend investment of public health funds in areas with a high incidence of mumps and developing economies to reduce and control the incidence of mumps.