In order to study the durability of concrete materials subjected to sulfate attack, in a sulfate attack environment, a series of concrete tests considering different fly ash contents and erosion times were conducted. The mechanical properties and the micro-structure of concrete under sulfate attack were studied based on the following: uniaxial compressive strength test, split tensile test, ultrasonic impulse method, scanning electron microscopy (SEM) and X-ray diffraction (XRD). The mechanical properties were compressive strength, splitting tensile strength, and relative dynamic elastic modulus, respectively. Additionally, according to the damage mechanical theory, experimental results and micro-structure analysis, the damage evolution process of concrete under a sulfate attack environment were studied in detail. Finally, according to the sulfate attack time and fly ash content, a damage model of the sulfate attack of the binary surface was established. The specific results are as follows: under the action of sulfate attack, the change law of the rate of mass change, relative dynamic modulus of elasticity, corrosion resistance coefficient of compressive strength, and the corrosion resistance coefficient of the splitting tensile strength of concrete all increase first and then decrease. Under the same erosion time, concrete mixed with 10% fly ash content has the best sulfate resistance. Through data regression, the damage evolution equation of the sulfate attack was developed and there is an exponential function relationship among the different damage variables. The binary curved surface regression effect of the concrete damage and the erosion time and the amount of fly ash is significant, which can predict deterioration of concrete damage under sulfate attack. During the erosion time, the combined expansion of ettringite and gypsum caused micro cracks. With an increase of corrosion time, micro cracks developed and their numbers increased.