Soil microbial communities play a key role in maintaining ecosystem functions; however, little is known about the specific changes in microbial communities in the Rhizosphere soil and Original soil of ginseng under different years of cultivation. We utilized Illumina MiSeq sequencing technology to investigate the differential effects of years of ginseng cultivation on the microbial communities in Rhizosphere Soil and Original soil. The physicochemical properties of the soil were analyzed using one-way analysis of variance (ANOVA). The results showed that the alpha-diversity of soil microorganisms showed a significant trend in both in Rhizosphere Soil and Original soil with the years of ginseng cultivation. Through NMDS analysis, we further found significant differences in soil microbial community composition between Rhizosphere Soil and Original soil. In order to visualize these differences, the top-ranked soil bacterial and fungal genera in Rhizosphere Soil and Original soil at different cropping years were depicted with the help of stacking diagrams. Soil bacteria and fungi in Rhizosphere Soil and Original soil were differentially analyzed using Kruskal-Wallis test. The complex relationship between soil physicochemical properties and different bacterial and fungal genera was deeply explored by correlation heatmap, RDA redundancy analysis and Mantel analysis. Therefore, this study not only sheds light on the specific effects of ginseng planting years on soil microbial communities in rhizosphere soils and primary soils, but also provides new scientific perspectives for further understanding the role of soil microbial communities in ecosystems.