To effectively identify the key material parameters of different zones of concrete face rockfill dams and improve the efficiency of parameter optimization, a global sensitivity analysis method of parameters based on sparse polynomial chaotic expansion (sPCE) is proposed in this paper. The latin hypercube sampling method is used to select multiple groups of material parameters, and then finite element method is used to calculate the displacement of dam characteristic nodes in dam body. On this basis, the displacement is expanded by sPCE, and the polynomial basis function is reconstructed by orthogonal matching pursuit to improve the construction and analysis efficiency of the proxy model. According to the chaos coefficients, Sobol’ indices are calculated to evaluate the influence of the material parameters and their interaction on different displacements of the dam. The results show that the sPCE model can accurately simulate dam displacement and its statistical characteristics with a relatively small sample size. The sensitivity of the same parameter has spatial variability, and under the influence of parameter levels and spatial distribution of different materials, the parameter sensitivity ranking of different zones has certain differences. The proposed method provides a new reference to sensitivity analysis and uncertainty analysis for practical engineering.