Fertilization is an essential aspect of tea plantation management that supports a sustainable tea production and drastically influences soil microbial communities. However, few research studies have focused on the differences of microbial communities and the variation in tea quality in response to different fertilization treatments. In this work, the soil fertility, tea quality, and soil microbial communities were investigated in two domestic tea plantations following the application of chemical and organic fertilizers. We determined the content of mineral elements in the soil, including nitrogen, phosphorus, and potassium, and found that the supplementation of chemical fertilizer directly increased the content of mineral elements. However, the application of organic fertilizer significantly improved the accumulation of tea polyphenols and reduced the content of caffeine. Furthermore, amplicon sequencing results showed that the different ways of applying fertilizer have limited effect on the alpha diversity of the microbial community in the soil while the beta diversity was remarkably influenced. This work also suggests that the bacterial community structure and abundance were also relatively constant while the fungal community structure and abundance were dramatically influenced; for example, Chaetomiaceae at the family level, Hypocreaceae at the order level, Trichoderma at the genus level, and Fusarium oxysporum at the species level were predominantly enriched in the tea plantation applying organic fertilizer. Moreover, the bacterial and fungal biomarkers were also analyzed and it was found that Proteobacteria and Gammaproteobacteria (bacteria) and Tremellomycetes (fungi) were potentially characterized as biomarkers in the plantation under organic fertilization. These results provide a valuable basis for the application of organic fertilizer to improve the soil of tea plantations in the future.