How fungi respond to long‐term fertilization in Chinese Mollisols as sensitive indicators of soil fertility has received limited attention. To broaden our knowledge, we used high‐throughput pyrosequencing and quantitative PCR to explore the response of soil fungal community to long‐term chemical and organic fertilization strategies. Soils were collected in a 35‐year field experiment with four treatments: no fertilizer, chemical phosphorus, and potassium fertilizer (PK), chemical phosphorus, potassium, and nitrogen fertilizer (NPK), and chemical phosphorus and potassium fertilizer plus manure (MPK). All fertilization differently changed soil properties and fungal community. The MPK application benefited soil acidification alleviation and organic matter accumulation, as well as soybean yield. Moreover, the community richness indices (Chao1 and ACE) were higher under the MPK regimes, indicating the resilience of microbial diversity and stability. With regards to fungal community composition, the phylum Ascomycota was dominant in all samples, followed by Zygomycota, Basidiomycota, Chytridiomycota, and Glomeromycota. At each taxonomic level, the community composition dramatically differed under different fertilization strategies, leading to different soil quality. The NPK application caused a loss of Leotiomycetes but an increase in Eurotiomycetes, which might reduce the plant–fungal symbioses and increase nitrogen losses and greenhouse gas emissions. According to the linear discriminant analysis (LDA) coupled with effect size (LDA score > 3.0), the NPK application significantly increased the abundances of fungal taxa with known pathogenic traits, such as order Chaetothyriales, family Chaetothyriaceae and Pleosporaceae, and genera Corynespora, Bipolaris, and Cyphellophora. In contrast, these fungi were detected at low levels under the MPK regime. Soil organic matter and pH were the two most important contributors to fungal community composition.