This paper numerically investigates the deformability of granular materials with emphasis on the influence of particle size polydispersity. Triaxial compression tests are simulated using distinct element method (DEM) on a set of samples consisting of uncrushable spheres following a variety of grain size distributions. The compressibility under isotropic compression and deformation modulus during triaxial shearing are examined to correlate with the size polydispersity. The results show that, given the same relative density, the compressibility and deformation modulus is insensitive to the grain-size conditions under consideration, but the void ratio is significantly influenced by the size polydispersity. A grading index proposed by the authors is employed to quantify the size polydispersity and correlate with the deformation parameters. Compared with the more conventional coefficient of uniformity, this grading index exhibits a better performance for faithfully representing size polydispersity. An empirical prediction model for the deformation modulus is developed to account for the effect of the size polydispersity, in addition to the confining pressure and void ratio. Although this model exhibits a fair performance for predicting the deformation modulus, it is considered promising in accounting for the effect of size polydispersity. At the microscale, a unique correlation is found between the deformation modulus and the mechanical average coordination number, which can be estimated from the effective void ratio.