Medicinal plants accumulate heavy metals from contaminated soil, and their consumption can cause poisoning. Our objective was to determine the levels of Pb, Cd, Zn, Cu, Fe, and Mn in four medicinal plant species (Achillea millefolium, Hypericum perforatum, Plantago lanceolata, and Urtica dioica) and their native soil, all sampled at a former smelter. The highest soil Cd, Pb, and Zn levels surpassed the maximum allowed limit 75-fold, 48-fold, and 14-fold, respectively. Their soil levels correlated with those in the plants, but this was not the case with Cu, Fe, and Mn. Heavy metal accumulation seems to depend on the plant species, yet even so, medicinal herbs should be cultivated and gathered only from controlled (uncontaminated) areas. Polluted areas should be monitored on a regular basis, while further research should investigate the connection between the heavy metal levels in the soil, their levels available for plants, and the levels extractable from plants.