Sulfate attack is a major cause of the deterioration of concrete structures.Accurately predicting the temporal and spatial distribution of sulfate ions in concrete is the basis for revealing the mechanism of concrete performance deterioration caused by sulfate attack. In this article, based on the pore change caused by sulfate damage to cement mortar, a diffusion model of sulfate ions in cement mortar considering changes in surface concentration was established. Furthermore, a two-dimensional mesoscopic concrete model composed of cement mortar, coarse aggregate, the intrafacial transition zone (ITZ) and macroscopic defects, which can reflect the real aggregate shape, was constructed to study the diffusion of sulfate ions in concrete. The correctness of the model is verified with existing experimental data, and the model is further studied. The results show the following. (1) The average value of the calculation results of multiple sets of models can be used to eliminate the influence of the randomness of the construction of the two-dimensional mesoscopic concrete model. ( 2) With increasing stone content, the corrosion depth increases, but the average concentration at a given location decreases. (3) With increasing sulfate solution concentration and water-cement ratio, the sulfate ion concentration and the corrosion depth in concrete increase.