The effect of conversion of grassland to woodland on organic carbon (OC) and total nitrogen (TN) has significance for global change, land resource use and ecosystem management. However, these effects are always variable. Here, we show results of a study in an arid area in China on profile distribution of OC and TN in soils covered by two different woody tree canopies and outer canopy space (grassland between woody plant canopies). The soils were at various slope positions (upper, middle and lower slopes) for Chinese pine (Pinus tabulaeformis) and Korshrinsk peashrub (Caragana korshinskii) lands, and of different soil orders (Castanozems, Skeletal, Loessial and Aeolian soils). The objectives were to relate the effects of land use change on OC and TN to slope position and soil order. Soil OC and TN were significantly larger at Korshrinsk peashrub slope locations than at Chinese pine slope locations. Soil OC and TN were small at the lower slope position for Korshrinsk peashrub, however, they were largest at the middle slope for Chinese pine. Korshrinsk peashrub always increased soil OC and TN under brush canopy at the three slope positions, while Chinese pine increased them at lower slopes and decreased them at upper slopes. For the soil types, OC and TN in Korshrinsk peashrub land were in the order of Castanozems > Skeletal > Loessial > Aeolian soils. Korshrinsk peashrub also increased OC and TN under brush canopy in the four soils. Our results indicated that soil OC and TN in canopy soils differed greatly from associated values in the outer canopy soils, and the effects of grassland afforestation varied significantly with tree species, slope position, and soil type. Therefore, we suggest that differentiating such factors can be an effective approach for explaining variances in OC and N changes caused by land use conversion.