Yunnan Province is rich in mineral resources. Early mining, processing, metallurgy, and other mining activities produce three industrial wastes (waste water, waste gas, and waste residue) causing environmental pollution. Considering the legacy site of a mineral processing plant in Yunnan as the research object, 21 sampling points in the study area and 12 control sampling points in the periphery were set up to determine the contents of the heavy metal(loid)s As, Hg, Cd, Cu, Ni, Pb, and Cr in the soil. The spatial distribution of heavy metal(loid)s was interpolated and analyzed using Arcmap10.8, and combined with the single-factor index, Nemero Comprehensive Pollution Index, and the health risk assessment method for the heavy metal(loid) pollution status and health risk of the soil were evaluated. The soil in the study area was acidic, with the largest average value of elemental As and the largest percentages of control and screening values. The results of the single-factor and Nemero composite pollution index showed the following trend: As > Pb > Cd > Cu > Ni > Hg. Cd, Cu, and Pb mainly originate from mining and metallurgy and Hg from the combustion of fossil fuels, while soil-forming substrates are the main sources of Ni. Pollution by As was the most prominent element, whereas pollution by Cd, Cu, and Pb in some areas also cannot be ignored to prevent negative impacts on residents. It is recommended to remediate and treat the soil on site for public events; therefore, this study fills the gap in studying potential ecological risks, human health risk assessments, and sources of exposure (oral ingestion, respiratory ingestion, dermal contact).