The heavy metals (HMs) usually have high natural background levels in lead-zinc mines. Strengthening the ecological risk assessment and accurate identification sources of HMs is an important component of land resource utilization and food security. A total of 795 soil samples (with a depth of 0~20 cm) were collected in Hezhang County, an area of typical high background levels of HMs with more than 18 large lead-zinc deposits. In this study, inductively coupled plasma emission spectrometry (ICP-OES), inductively coupled plasma mass spectrometry (ICP-MS), atomic fluorescence spectrometry (AFS), and the potentiometric method (POT) were used to test the total concentration of HMs and pH values. The geographic information system was used to model the concentration distribution of HMs, and the ecological risk was assessed according to the source analysis results. The results suggest that: (1) the mean concentration of As, Cd, Cr, Cu, Hg, Ni, Pb, and Zn were 24.55, 2.25, 176.4, 89.6, 0.19, 64.2, 102, and 257 mg·kg−1, respectively, which exceeded the average background value of soils in Guizhou Province by 1.23, 3.41, 1.84, 2.80, 1.73, 1.64, 2.90, and 2.58 times, respectively, and the average concentrations of Cd, Cr, Cu, Ni, Pb and Zn exceed the screening values specified in soil contamination risk in agricultural land; (2) the results of enrichment factor (EF) showed that 29.73% of Cd are moderately polluted, and other HMs were slightly polluted in a small area or near the baseline value (EF ≈ 1); and (3) PMF analysis showed that there are five main sources, pyrite, lead-zinc ore, basalt, carbonate rock, and agricultural production, with the risk contribution ratios of 5.25%, 27.37%, 28.94%, 17.91%, and 20.53%, respectively.