Sediment connectivity is a valuable metric that characterizes the relationship between sediment transport from the source to the sink, and the ease of sediment erosion. Over the past four decades, changes in land use types and vegetation cover have significantly altered sediment dynamics in the Wei River basin. In this study, we used the index of connectivity (IC) to assess the temporal changes in sediment connectivity at a watershed scale. We employed Landsat images to analyse the relationship between changes in vegetation cover or land use type and sediment connectivity. We used factor detector and interaction detector in Geodetector to analyse the importance and impact of vegetation and slope on IC changes. We assessed the correlation of sediment yield and connectivity to validate our results and it shows that IC has strong or moderate positive correlation with sediment yield from eight out of nine stations in the Wei River Basin. Our findings demonstrate that soil and water conservation measures, as well as the grain for green project, have led to the transformation of cropland and grassland into woodland. This change is reflected in the decrease of the maximum IC value from 6.24 to 5.72 in the Beiluo sub‐basin, indicating a decreasing trend in sediment connectivity. Although the maximum IC value increased from 5.76 to 5.08 in the Jing sub‐basin, driven by human activity, showing an increasing trend. Furthermore, the IC value decreased in the western part of the Wei sub‐basin. Overall, sediment connectivity exhibits a weak decreasing trend in most regions of the Wei River basin, while it shows an increasing trend slightly in the Jing sub‐basin. The correlation coefficients ranged from 0.47 to 0.86, with sediment yield being moderately or strongly correlated with IC. Our study identified vegetation, human activity, and slope as the main influencing factors of IC. The results of factor detector showed that the q value of vegetation was 0.63 and the slope was 0.1, Vegetation played a major role in the change of IC. The results of interaction detector showed that interaction between vegetation and slope was greater than the single factor. The temporal variability of sediment connectivity in the basin provides valuable insights for sediment transport management. Our research highlights the importance of studying sediment connectivity and offers proposals for measures that can be taken to address sediment transport challenges in the Wei River basin.