In this study, the potential application of slag-fly ash-based geopolymers as stabilizers for soft soil in sulfate erosion areas was investigated to promote environmental protection and waste residue recycling. The changes in the physical and mechanical properties and microstructure characteristics of cement-stabilized soil/geopolymer-stabilized soil under sulfate erosion were comparatively studied through tests such as appearance change, mass change, strength development, and microscopic examination. The results show that the sulfate resistance of stabilized soil is significantly affected by the stabilizer type. In the sulfate environment, the cement-stabilized soil significantly deteriorates with erosion age due to the expansion stress induced by AFt, while the geopolymer-stabilized soil exhibits excellent sulfate resistance. The slag-fly ash ratio (10:0, 9:1, 8:2 and 7:3) is an important factor affecting the sulfate resistance of geopolymer-stabilized soils, and the preferred value occurs at 9:1 (G-2). When immersed for 90 d, the unconfined compressive strength value of G-2 is 7.13 MPa, and its strength retention coefficient is 86.6%. The N-A-S-H gel formed by the polymerization in the geopolymer contributes to hindering the intrusion of sulfate ions, thereby improving the sulfate resistance of stabilized soil. The research results can provide a reference for technology that stabilizes soil with industrial waste in sulfate erosion areas.