Nearly all tree species develop symbiotic relationships with either arbuscular mycorrhizal (AM) or ectomycorrhizal (EM) fungi to acquire nutrients from soils, and hence influence soil carbon (C) and nitrogen (N) cycles in terrestrial ecosystems. It is crucial to understand the differences in soil C and N cycles between AM and EM forests and the underlying mechanisms. In this review, we first compared the differences in the soil C and N cycles between AM and EM forests, and synthesized the underlying mechanisms from perspectives of the inputs, stabilization, and outputs of soil C and N in forest ecosystems. We also compared the responses of soil C and N cycles between AM and EM forests to global changes. In this field, one major research priority is comparing the structure and function (including the soil C and N cycles) between AM and EM forest ecosystems to provide theoretical basis and solid data for improving forest productivity and ecosystem services. The second research focus is deepening the understanding of the effects of interactions between aboveground litter and belowground mycorrhiza and free-living microbes on soil C and N cycles to reveal the potential underlying mechanisms in forests with different mycorrhizal symbioses. Third, the research methodology and new techniques need refining and applying to explicitly focus on scaling up the fine-scale measurements to better expound and predict the C and N cycles in forest ecosystems. Finally, more studies on the stability of soil organic matter among different mycorrhizal forests are needed to precisely assess responses of the structure and function of forest ecosystems to global changes.