The understanding of the response of arbuscular mycorrhizal fungi (AMF) community composition to fertilization is of great significance in sustainable agriculture. However, how fertilization influences AMF diversity and composition is not well-established yet. A field experiment located in northeast China in typical black soil (Chernozem) was conducted and high-throughput sequencing approach was used to investigate the effects of different fertilizations on the variation of AMF community in the rhizosphere soil of maize crop. The results showed that AMF diversity in the maize rhizosphere was significantly altered by different fertilization regimes. As revealed by redundancy analysis, the application of organic manure was the most important factor impacting AMF community composition between samples with and without organic manure, followed by N fertilizer and P fertilizer inputs. Moreover, the organic matter composition in the rhizosphere, determined by GC–MS, was significantly altered by the organic manure amendment. Many of the chemical components displayed significant relationships with the AMF community composition according to the Mantel test, among those, 2-ethylnaphthalene explained the highest percentage (54.2%) of the variation. The relative contents of 2-ethylnaphthalene and 2, 6, 10-trimethyltetradecane had a negative correlation with Glomus relative abundance, while the relative content of 3-methylbiphenyl displayed a positive correlation with Rhizophagus. The co-occurrence patterns in treatments with and without organic manure amendment were analyzed, and more hubs were detected in the network of soils with organic manure amendment. Additionally, three operational taxonomic units (OTUs) belonging to Glomerales were identified as hubs in all treatments, indicating these OTUs likely occupied broad ecological niches and were always active for mediating AMF species interaction in the maize rhizosphere. Taken together, impacts of fertilization regimes on AMF community composition were correlated with organic matter composition in maize rhizosphere soil and the application of manure could activate more AMF species to interact with other species in the maize rhizosphere. This knowledge can be valuable in regulating the symbiotic system of plants and AMF, maintaining the health and high yields of crops and providing a primary basis for rational fertilization.