To more precisely monitor drought, a new remote sensing-based drought index, the Vapor Pressure Deficit–Soil Moisture–Sun-Induced Chlorophyll fluorescence Dryness Index (VMFDI), with a spatial resolution of 1 km based on vapor pressure deficit (VPD), soil moisture (SM), and sun-induced chlorophyll fluorescence (SIF) data was constructed via a three-dimensional spatial distance model, and it was used to monitor dryness in the Yellow River Basin during 2003–2020. The spatiotemporal variations in and main factors of the VMFDI and agroecosystem responses were analyzed via the Theil–Sen median and Mann–Kendall tests and Liang–Kleeman information flow. The results revealed the following: (1) The VMFDI effectively monitors regional drought and is more sensitive than other indices like the standardized precipitation evapotranspiration index (SPEI) and GRACE drought severity index and single variables. (2) VMFDI values fluctuated seasonally in the Yellow River Basin, peaking in August and reaching their lowest in March. The basin becomes drier in winter but wetter in spring, summer, and autumn, with the middle and lower reaches, particularly Shaanxi and Gansu, being drought-prone. The VMFDI values in the agroecosystem were lower. (3) SM and VPD dominated drought at the watershed and agroecosystem scales, respectively. Key agroecosystem indicators, including greenness (NDVI), gross primary productivity (GPP), water use efficiency (WUE), and leaf area index (LAI), were negatively correlated with drought (p < 0.05). When VPD exceeded a threshold range of 7.11–7.17 ha, the relationships between these indicators and VPD shifted from positive to negative. The specific VPD thresholds in maize and wheat systems were 8.03–8.57 ha and 7.15 ha, respectively. Suggestions for drought risk management were also provided. This study provides a new method and high-resolution data for accurately monitoring drought, which can aid in mitigating agricultural drought risks and promoting high-quality agricultural development.