Concrete naturally contains a large number of circular-like stochastic pores which weaken the tensile strength of concrete and change the crack propagation path. This study investigates the influences of the size distribution and the spatial distribution of stochastic pores on the fracture behavior of concrete based on the splitting tensile test. The mesoscale model of concrete containing coarse aggregate, mortar, interface transition zone (ITZ), and circular pores is established to simulate the crack initiation, propagation, and coalescence of concrete. Concrete samples with a single hole are prepared to verify the effectiveness of the numerical simulation method. Numerical tests are conducted on numerous mesoscale concrete samples with various porosities, pore size distributions, and pore spatial distributions. The numerical simulation results indicate that the tensile strength decreases with the increase of pore size at the same porosity. Based on multifractal theory, a quantitative indicator to describe the spatial distribution uniformity of concrete stochastic pores is proposed. There is a positive correlation between the spatial distribution uniformity of stochastic pores and the tensile strength. The stochastic circular pores can have a profound effect on the concrete’s fracture pattern, which results in three typical macro-crack patterns in the numerical simulation of the splitting tensile test. The presented results deepen the understanding of the influence of stochastic circular pores on the tensile mechanical properties of concrete and provide a reference for the design of concrete structures.