Arbuscular mycorrhizal fungi (AMFs) play a vital role in ecosystems, especially in ecosystem variability, diversity, and function. Understanding the AMF diversity, distribution, and their driver at different altitudinal gradients is a benefit for understanding the ecological function of AMF in mountain ecosystems. In this study, we explored the AMF molecular diversity and their distribution from 660 to 3,500 m a.s.l. in Mount Taibai of Qinling Mountains based on high-throughput sequencing technology. A total of 702 operational taxonomic units (OTUs) in 103 species of AMF are isolated from soil samples, which belong to 18 identified and 1 unidentified genus in 10 families. The fungi in the genus of Glomus is the most dominant, with the occurrence frequency of 100% and the relative abundance of 42.268% and 33.048% on the species and OTU level, respectively. The AMF colonization in root could be simulated by a cubic function with the change of altitudes with the peak and trough at a.s.l. 1,170 and 2,850 m, respectively. Further, AMF diversity indices including Sob, Shannon diversity, and Pielou evenness also showed the same cubic function change trends with increasing altitude at OTU and species levels. However, the average values of diversity indices at OTU level are always higher than these at the species level. Based on the OTU level, the highest and lowest values of Shannon and Pielou indices are observed at the altitudes of 1,400 and 2,800 m, respectively. The pattern of AMF community distribution in Mt. Taibai is driven by altitude with the characteristics of more abundance in the medium- to low-altitude than high-altitude areas. In general, abundant AMF molecular diversity and species exit in different elevations of Mt. Taibai, which indicate gradient changes with elevations.