Nitrification inhibitor is essential for increasing the nitrogen utilization efficiency of agricultural plants, thus reducing environmental pollution and increasing crop yield. However, the easy volatilization and limited functional property is still the bottleneck of nitrification inhibitors. Herein, a novel water-soluble polymeric nitrification inhibitor was synthesized through the copolymerization of acrylamide and bio-based acrylic acid, which was synthesized from biomass-derived furfural, and the complexation of carboxyl groups and 3,4-dimethylpyrazole. The results showed that the nitrification inhibitor was an amorphous polymer product with a glass transition temperature of 146 °C and a thermal decomposition temperature of 176 °C, and the content of 3,4-dimethylpyrazole reached 2.81 wt%, which was 115% higher than our earlier product (1.31 wt%). The polymeric nitrification inhibitor can inhibit the activity of ammonia-oxidizing bacteria effectively, thus inhibiting the conversion of ammonium nitrogen to nitrate nitrogen and converting the insoluble phosphate into soluble and absorbable phosphate. By introducing a copolymer structure with a strong flocculation capacity, the polymeric nitrification inhibitor is further endowed with a soil-loosening function, which can increase the porosity of soil to improve the soil environment. Therefore, the nitrification inhibitor can be used in water-soluble and liquid fertilizers, as well as in high tower melting granulated compound fertilizers.