Characterized by a topography of thousands of ravines, the Loess Plateau has highly complex spatial variability in terms of soil nutrients. Therefore, it is of considerable importance to study the soil nutrient spatial distribution, driving factors of precise fertilizer management, and the strategic use of soil nutrient resources. In 2017, 242 soil samples were taken from the semiarid Anding district farming region in northern China. The spatial variability and factors influencing soil nutrients were studied using statistical and geostatistical methods. The results showed that the mean soil organic matter (SOM), total nitrogen (TN), available phosphorus (AP), available potassium (AK), and pH values were averaged at 12.64 g·kg−1, 0.84 g·kg−1, 23.20 mg·kg−1, 188.87 mg·kg−1, and 8.60, respectively. The nugget-to-sill ratios for the semi-variograms of SOM, TN, AP, and AK varied from 25.84 to 49.93%, while the coefficients of variation varied from 24.53 to 69.44%, revealing that all four indicators exhibited considerable variability, and that the samples’ geographical variability was produced by a combination of random and structural factors. Overall increasing trends were exhibited from the middle to the northeast and southwest in the distributions of SOM, TN, and AP. The spatial distribution of AK displayed the opposite trend, increasing from the southwest to north and southeast. The texture of the tillage layer was the main factor directly affecting SOM, and explained 8% of its variation. The distribution of TN was mainly influenced by the irrigation method and water source type. AP and AK contents differed significantly between the two parent materials, three textures, and three topography types at the level of p < 0.01. In conclusion, the regional soil fertility was poor, spatial heterogeneity was moderate, and influencing factors were complex, highlighting the need to adopt precise fertilization management and adopting land management measures according to the actual influencing factors of each nutrient, thereby contributing to the enhancement of regional fertility.