Soil erosion is a key factor in soil quality degradation and carbon balance in arid ecosystems. However, many models ignore the soil erosion process in arid regions, which may lead to limits in our understanding of ecosystem processes in arid regions. In this study, we added the soil erosion process according to field observed data of soil hydrothermal regimes and carbon flux. We validated this coupling version of IBIS (Integrated Biosphere Simulator) and RUSLE (RU–IBIS) by examining four different vegetation types and the carbon budget in the arid region on the Loess Plateau (LP). Our results indicated that the coupling model (RU–IBIS) produced more reliable simulations of the soil water content (with the r from 0.23–0.90 to 0.71–0.97) and evaporation (ET) (the average r was 0.76) and significantly improved the simulation of the leaf area index (LAI) (the average r was 0.95) and net primary production (NPP) (the average r was 0.95). We also conducted sensitivity experiments to determine how soil texture and aerodynamic roughness (Z0m) affect the soil water content. Moreover, it was revealed that specific leaf area (SLA) plays a key role in the simulation of NPP and NEE. Our study suggests that the coupled soil erosion process and parameterization can effectively improve the performance of IBIS in arid regions. These results need to be considered in future Earth system models.