The quality of soils in rehabilitated small-scale mined sites needs thorough investigation since a lot of changes do occur. The study assessed the impacts of small-scale mining activities on concentration and distribution of soil physicochemical properties and heavy metals. The soil samples were collected from 120 (50 m × 50 m) plots. The concentrations of soil physicochemical properties (Ca, Mg, Na, N, P, K, and OC and EC) varied significantly (
p
< 0.05) between unmined and mined soils. However, there were no statistically, significant differences (
p
< 0.05) observed in the concentrations of Cd, Hg, Pb, As, and Cu between the unmined and mined soils. Despite the generally poor (33.8%) soil quality in the study area, mining activities further reduced it by 24.2%. Soils from mined sites with unfilled/partially filled pits had higher levels of K, Mg, and Na. As mined sites fallow period increased, concentrations of OC and Cd increased, while Ca, Mg, pH, Cu, Pb, and As and value of EC decreased. The number of years that mined land remained fallow, and whether the pits were filled or unfilled during this period should be factored into the mined land rehabilitation processes.