To obtain the macroscale Young’s modulus of glutenite under gravel inclusions, a numerical simulation of macroscale Young’s modulus prediction based on the mesoscale characteristics of glutenite was carried out. Firstly, the micron indentation test was used to obtain the meso-mechanical parameters of gravel and matrix in glutenite to ensure the reasonableness of the numerical simulation parameter settings; secondly, a two-dimensional glutenite physical model generation method based on the secondary development of Python was put forward; and then, the macroscale Young’s modulus variation rule of glutenite under different gravel sizes, particle size ratios, and content characteristics were analyzed using the finite element method (FEM). The results show that Young’s modulus of gravel is larger than Young’s modulus of the matrix, and Young’s modulus of different gravel and matrix has some differences. The gravel content is the main controlling factor affecting the macroscale Young’s modulus of glutenite; the gravel content and Young’s modulus of glutenite show a strong positive correlation, and the gravel size and particle size ratio have less influence on the macroscale Young’s modulus of glutenite. The difference in Young’s modulus between gravel and matrix causes the formation of local stress concentrations during loading and compression of glutenite. The smaller the gravel grain size, the higher the degree of non-uniformity of the grain size, the more likely it is to form higher local stresses. The results of the study provide a new prediction method for the prediction of the macroscale Young’s modulus of a glutenite reservoir.