Ammonia-oxidizing archaea (AOA) and ammonia-oxidizing bacteria (AOB) are key drivers of nitrification in rainfed soil ecosystems. However, within a semi-arid region, the influence of different soil amendments on the composition of soil AOA and AOB communities and soil properties of rainfed maize is still unclear. Therefore, in this study, the abundance, diversity, and composition of AOA and AOB communities and the potential nitrification activity (PNA) was investigated across five soil treatments: no fertilization (NA), urea fertilizer (CF), cow manure (SM), corn stalk (MS), and cow manure + urea fertilizer (SC). The AOB amoA gene copy number was influenced significantly by fertilization treatments. The AOB community was dominated by Nitrosospira cluster 3b under the CF and SC treatments, and the AOA community was dominated by Nitrososphaera Group I.1b under the CF and NA amendments; however, manure treatments (SM, MS, and SC) did not exhibit such influence. Network analysis revealed the positive impact of some hub taxonomy on the abundance of ammonia oxidizers. Soil pH, NO3−-N, Module 3, biomass, and AOB abundance were the major variables that influenced the potential nitrification activity (PNA) within structural equation modeling. PNA increased by 142.98–226.5% under the treatments CF, SC, SM, and MS compared to NA. In contrast to AOA, AOB contributed dominantly to PNA. Our study highlights the crucial role of bacterial communities in promoting sustainable agricultural production in calcareous soils in semi-arid loess plateau environments.