Soil conservation measures are widely used to control soil erosion and sediment loss; however, their proper usage relies on a deep understanding of the responses of runoff and sediment loss to land management and rainfall characteristics. In the present study, a long-term (2014–2020) monitored dataset derived from ten runoff plots in the upstream catchment of the Miyun Reservoir in Beijing, China, was used to study runoff and sediment loss responses to land use management and rainfall characteristics. The study results show that plots with no soil conservation measures had the highest runoff depth of 75 mm and suffered the highest sediment loss, at a rate of 3200 t km−2 yr−1. The terraced and vegetated plots generated lower runoff depths, with soil loss rates less than 213.0 t km−2 yr−1. With the exception of the contour tillage plots on steep slopes, the vegetation and engineering measures can efficiently reduce runoff and sediment loss, with both runoff and sediment reduction efficiencies higher than 76%. Statistical analyses indicate that, on the plots of bare soil and cultivation without soil conservation measures, runoff and sediment loss were mainly affected by the maximum 30 min rainfall intensity. However, on the plots with soil conservation measures, they were mainly determined by rainfall amount and duration. The sediment loss rate can be well fitted with the runoff depth using a power function. Based on the analyses, water-saving soil conservation measures are recommended for the study area. In addition, the size of terraces should be reconsidered on gentle slopes, and the coverage of forest, shrubs, and grass on slopes should be reduced, thus allowing for more surface runoff generation to ensure drinking water safety. In general, for the study area, soil conservation measures are required on the bare soil and cultivated slopes.