Soybean is an S-loving crop, and continuous cropping might cause soil sulfur shortage. The primary objectives of this study are to determine whether Funneliformis mosseae (F. mosseae) can enhance the content of available S in S-deficient soil and thereby improve the sulfur utilization rate in soybean. The experiment used Heinong 48 (HN48), a soybean variety with a vast planting area in Heilongjiang Province, and F. mosseae was inoculated in the soil of soybean that had been continuously cropped for 0 and 3 years. The results of the barium sulfur turbidimetric assay show that the sulfur content in the soil and soybean was reduced by continuous cropping and increased by inoculation with F. mosseae; the results of the macro-genome sequencing technology, show that the diversity and abundance of bacteria in the soil was decreased by continuous cropping and increased by inoculation with F. mosseae. The sulfur-oxidizing bacteria (SOB) activity and sulfur-related gene expression levels were lower in the continuous crop group compared to the control group and higher in the F.mosseae-inoculated group compared to the control group. Continuous cropping reduced the sulfur content and ratio of soybean rhizosphere soil, affecting soil flora activity and thus soybean growth; F. mosseae inoculation increased the sulfur content of soybean root-perimeter soil and plants, increased the diversity and abundance of rhizosphere soil microorganisms, increased the expression of genes for sulfur transport systems, sulfur metabolism, and other metabolic functions related to elemental sulfur, and increased the species abundance and metabolic vigor of most SOB. In summary, continuous cropping inhibits soil sulfur uptake and utilization in soybean while the inoculation with F. mosseae can significantly improve this situation. This study offers a theoretical research foundation for using AMF as a bio-fungal agent to enhance soil sulfur use. It also supports the decrease of chemical fertilizers, their substitution, and the protection of native soil.