Fish-scale pits, as one of the most important ecological engineering in semi-arid areas, especially in the Loess Plateau, China, effectively reduced water and soil loss by intercepting runoff. However, the water saved by the pits is mainly accumulated in the upper soil layer and thus easily loosed by ineffective evaporation. In this study, soil column simulation experiments were conducted to observe the effects of diversion holes on soil evaporation and soil water distribution in the loessial soil under two rainfall depths and different soil surface treatments. The soil samples were passed through a 2-mm sieve. The soil filling height and the soil volume was 140 cm and 54,652.17 cm 3 in each soil column, respectively. For each treatment, there were three replicates. The results showed that gravel-mulching (GM), straw-mulching (SM), and diversion hole (DH) significantly decreased soil water evaporation compared with non-mulching (CK) under the different rainfall depths (P < 0.05). Under rainfall of 100 mm, the DH, GM, and SM caused an increase in the soil water content (SWC) in the 80-120 cm layer by 101.0%, 23.6%, and 65.5%, respectively. Under rainfall of 30 mm, CK increased SWC in the 0-40 cm layer, both GM and SM increased the SWC in the 0-60 cm layer, and the DH treatment allowed an increase in the 0-120 cm layer. Our results suggest that DH was a better measure to reduce soil evaporation and improve rainfall resource utilization, especially under high rainfall events. Our research provides scientific basis for the technology of soil deep spatiotemporal control and is of great significance to the balance and restoration of the ecological environment in the semi-arid Loess Plateau.