Adsorption of particles on soft hydrogels, which plays an important role in various scientific and industrial fields, has often been studied using interactions such as hydrogen bonding. Here, we demonstrate that submicron-sized colloidal particles can be adsorbed onto gels, solely by van der Waals (vdW) attraction, without any special interaction. We investigated the adsorption of silica, polystyrene, and titania particles on polyacrylamide (PAAm) and polydimethylacrylamide (PDMA) hydrogels. The vdW force was tuned by the refractive index of media. Previously, we studied the particle adsorption on gels (N. Sato et al., Sci. Rep. 7(1), 2017) and concluded that the vdW force is a strong driving force. However, the influence of the medium viscosity on the adsorption rate and the contribution of interactions other than the vdW force needed to be clarified. The PDMA linear polymer adsorbed strongly on the silica particles, but the PAAm polymer did not. On the other hand, both PDMA and PAAm hydrogels strongly adsorbed silica and all other particles in water. The amount of adsorption varied with the magnitude of Hamaker constant. These results indicate that the vdW force is a sufficiently strong driving force for the particle adsorption to polymer hydrogel surfaces in water.