Understanding the contamination and sources of heavy metal(loid)s (HMs) at historical sites is vital for safeguarding human health and the ecological environment. This study focused on As, Hg, Cd, Cu, Pb, Ni, and Cr concentrations in the residual soil, groundwater, and surface water around a mineral processing plant. The sources of these elements and the human health risks posed by them were evaluated using various indexes. Soil HM concentrations exceeded background values for Yunnan Province, ranked as As > Pb > Cd > Cu > Hg > Ni. The river water met China's Class II waterbody standard; however, Cd, Cu, Pb, and pH exceeded the maximum permissible sewage discharge concentrations in the accumulated water. The groundwater showed severe HM pollution, meeting China's Class III water quality standard. The average value of the Nemerow pollution index was consistent with that of the single-factor pollution index in the following order: As > Pb > Cd > Ni > Cu > Hg. Children face heightened risk through the oral ingestion of As, Cd, and Pb, particularly in high-value sampling points in the residue deposit area. The main sources of these pollutants are anthropogenic activities and the soil formation matrix.