Arbuscular Mycorrhizal Fungi (AMF) play major roles in ecosystem functioning such as carbon sequestration, nutrient cycling, and plant growth promotion. It is important to know how this ecologically important soil microbial player is affected by soil abiotic factors particularly heavy metal and metalloid (HMM). The objective of this study was to understand the impact of soil HMM concentration on AMF abundance and community structure in the contaminated sites of South Korea. Soil samples were collected from the vicinity of an abandoned smelter and the samples were subjected to three complementary methods such as spore morphology, terminal restriction fragment length polymorphism (T-RFLP) and denaturing gradient gel electrophoresis (DGGE) for diversity analysis. Spore density was found to be significantly higher in highly contaminated soil compared to less contaminated soil. Spore morphological study revealed that Glomeraceae family was more abundant followed by Acaulosporaceae and Gigasporaceae in the vicinity of the smelter. T-RFLP and DGGE analysis confirmed the dominance of Funneliformis mosseae and Rhizophagus intraradices in all the study sites. Claroideoglomus claroideum, Funneliformis caledonium, Rhizophagus clarus and Funneliformis constrictum were found to be sensitive to high concentration of soil HMM. Richness and diversity of Glomeraceae family increased with significant increase in soil arsenic, cadmium and zinc concentrations. Our results revealed that the soil HMM has a vital impact on AMF community structure, especially with Glomeraceae family abundance, richness and diversity.