Nowadays, several techniques have been utilized to remove sulfate from industrial sewage. The method using ZrO(OH)2 to adsorb sulfate is highly efficient and environmentally friendly, however, nano‐powdered ZrO(OH)2 is hard to be recycled owing to its great loss in the adsorption process, which brings enormous difficulties to industrial applications. In this research, to prevent adsorbents from losing, Y‐zeolite was modified with zirconium, including the incorporation of zirconium as heteroatoms into zeolite frameworks and ion‐exchange of Zr4+ into the cages of zeolite, and then used as carrier to load ZrO(OH)2 to fabricate adsorbent via the stepwise impregnation treatment. The as‐prepared supported adsorbent ZrO(OH)2/Y‐zeolite has a high SO42− adsorption capacity, a strong adsorption selectivity to SO42− and good adsorption‐regeneration circulation performances. The saturated SO42− adsorption capacity of 284.22 mg/g can be obtained under the following adsorption conditions: SO42− concentration of 10 g/L, the pH value of 1.5, the temperature of 25 °C. After five adsorption‐regeneration circulations, its adsorption capacity has decreased only about 10%. The adsorption‐ desorption of sulfate over ZrO(OH)2/Y‐zeolite adsorbent proceeds according to the ion‐exchange mechanism between sulfate and the surface hydroxyl groups.