The development of microbial biofilms increases the survival of microorganisms in the extreme conditions of ecosystems contaminated with components of liquid radioactive waste (LRW) and may contribute to the successful bioremediation of groundwater. The purpose of this work was to compare the composition of the microorganisms and the exopolysaccharide matrix of the biofilms formed on sandy loams collected at the aquifer from a clean zone and from a zone with nitrate and radionuclide contamination. The aquifer is polluted from the nearby surface repository for liquid radioactive waste (Russia). The phylogenetic diversity of prokaryotes forming biofilms on the sandy loams’ surface was determined during 100 days using high-throughput sequencing of the V4 region of the 16S rRNA genes. Scanning electron microscopy was used to study the development of microbial biofilms on the sandy loams. The ratio of proteins and carbohydrates in the biofilms changed in the course of their development, and the diversity of monosaccharides decreased, depending on the contamination of the sites from which the rocks were selected. The presence of pollution affects biofilm formation and EPS composition along with the dominant taxa of microorganisms and their activity. Biofilms establish a concentration gradient of the pollutant and allow the microorganisms involved to effectively participate in the reduction of nitrate and sulfate; they decrease the risk of nitrite accumulation during denitrification and suppress the migration of radionuclides. These biofilms can serve as an important barrier in underground water sources, preventing the spread of pollution. Pure cultures of microorganisms capable of forming a polysaccharide matrix and reducing nitrate, chromate, uranyl, and pertechnetate ions were isolated from the biofilms, which confirmed the possibility of their participation in the bioremediation of the aquifer from nonradioactive waste components and the decrease in the radionuclides’ migration.