The density of underwater dumping materials plays a major role in cofferdam engineering designs. However, it is difficult to accurately measure the density of underwater dumping materials. This study investigated the influence of particle size distribution of granular materials on the density of underwater filling materials. Considering the underwater dumping project of a hydropower station dam in the Han River as the prototype condition, several underwater dumping density centrifugal tests were conducted on sand gravel and sand mixtures. Based on the CKY200 large-scale geotechnical centrifuge, a single-embankment vertical-blockage underwater filling test device in a centrifuge field was developed. The results demonstrated the relationship between the compactness of the dumping body and the grading of loose particles, depth of dumping, and height of the upper loading. This indicates that the underwater filling material has a higher compactness and can reach a dense state. When the grading is poor, the compactness decreases. The greater the depth of filling, the greater the compactness. When vertical compression was applied to the upper part of the backfill, the compactness of the backfill, particularly in shallow areas, was significantly improved. These results provide insights for the design and construction of underwater dumping water conservation systems.