This study aimed at determining the concentration and possibility of migration of potentially harmful elements (PHEs) in soils and mining and metallurgical waste in the Silesian-Cracow region. Our research was carried out in selected locations of Ruda Śląska, Świętochłowice, Bytom, and in the Olkusz region (Bukowno) in southern Poland. The concentrations of metals (e.g., Ag, Ba, Ca, Cd, Cu, Fe, Mg, Mn, Pb, Sr, Zn), metalloids (As, Sb), and sulphur were determined in 33 soil samples (with a depth range of 0.0–0.3 m) and 12 slag samples. These studies show an increased concentration of metals, metalloids, and sulphur, exceeding the level of regional geochemical background. The research results indicate that the degree of the chemical transformation of soils in the analysed regions of Ruda Śląska, Bytom, and Bukowno is advanced. This highlights the high concentrations of most metals, i.e., arsenic, antimony, and sulphur, in the surface layer of soils (topsoil) due to historic Zn-Pb ore mining and Zn and Fe metallurgy. The presence of both primary and secondary metal sulphides, sulphates, carbonates, oxides/hydroxides, silicates, and aluminosilicates was found in the mineral composition of soils and slags.