Fine root (diameter < 2 mm) distribution influences the potential for resource acquisition in soil profiles, which defines how plants interact with local soil environments; however, a deep understanding of how fine root vertical distribution varies with soil structural variations and across growth years is lacking. We subjected four xerophytic species native to an arid valley of China, Artemisia vestita, Bauhinia brachycarpa, Sophora davidii, and Cotinus szechuanensis, to increasing rock fragment content (RFC) treatments (0%, 25%, 50%, and 75%, v v−1) in an arid environment and measured fine root vertical profiles over 4 years of growth. Fine root depth and biomass of woody species increased with increasing RFC, but the extent of increase declined with growth years. Increasing RFC also increased the degree of interannual decreases in fine root diameter. The limited supply of soil resources in coarse soils explained the increases in rooting depth and variations in the pattern of fine root profiles across RFC. Fine root depth and biomass of the non‐woody species (A. vestita) in soil profiles decreased with the increase in RFC and growth years, showing an opposite pattern from the other three woody species. Within woody species, the annual increase in fine root biomass varied with RFC, which led to large interannual differences in the patterns of fine root profiles. Younger or non‐woody plants were more susceptible to soil environmental changes than the older or woody plants. These results reveal the limitations of dry and rocky environments on the growth of different plants, with woody and non‐woody plants adjusting their root vertical distribution through opposite pathways to cope with resource constraints, which has management implications for degraded agroforest ecosystems.