Rhizosphere effects (REs) play important roles in regulating carbon (C) and nutrient cycling in terrestrial ecosystems. However, little is known about the REs of mature trees in the field, especially at the ecosystem scale. This study aimed to explore the variation and patterns of REs in natural ecosystems. Here, combining soil monoliths with an adhering soil (shaking fine roots) method was adopted to sample paired rhizosphere soil and bulk soil along an altitudinal gradient. Based on the relative REs and the percentage of rhizosphere soil mass, the REs on soil C and net nitrogen mineralization rates (Cmin and net Nmin) at the ecosystem scale were estimated. Our results showed that the REs on soil processes, soil microbial biomass C and extracellular enzyme activities (β-glucosidase and N-acetyl-glucosaminidase activities), and soil chemical properties (total C, total N, inorganic N, extractable P, K, Ca, Mg, Fe, and Mn) were significantly positive across altitudinal sites, while soil pH was significantly negative. Although the relative REs on investigated variables varied significantly among altitudes, the relative REs did not show a clear trend with the increased altitudes. Across altitudes, the mean magnitude of ecosystem-level REs on Cmin and net Nmin were 19% (ranging from 4% to 48%) and 16% (ranging from 3% to 34%), respectively. Furthermore, the magnitude of ecosystem-level rhizosphere effects increased linearly with the increased altitudes. The altitudinal patterns of ecosystem-level RE mainly depend on the percentage of rhizosphere soil mass. In conclusion, our results provided a set of new evidence for the REs, and highlighted the need to incorporate REs into land C and N models.