The effects of water on vegetation have always been a concern. It is an important support as well as a major limiting factor with respect to vegetation growth. By analysing the spatiotemporal changes and correlations between precipitation (PRE), soil moisture (SM), vapour pressure deficit (VPD) and normalized difference vegetation index (NDVI) in the Yellow River Basin, we explored the different effects of three water elements on vegetation in different climatic regions. Our findings reveal the following: (1) NDVI and the three water elements report an increasing trend in the Yellow River Basin, with NDVI increasing most significantly. 92.1% of the Yellow River Basin showed an increase in NDVI. (2) Vegetation in the Yellow River Basin was most positively affected by PRE, followed by SM and VPD. PRE mainly affected the natural vegetation on both sides of the boundary between the arid and semi‐arid regions and the semi‐humid regions. SM mainly affected the natural vegetation in the arid and semi‐arid regions, whereas VPD mainly affected the crops in the irrigation areas, and the irrigation areas in arid regions were affected the most. These findings contribute to a deeper understanding of the relationship between water elements and vegetation.