Stormwater ponds are a common way to handle stormwater and are used to retain pollutants through sedimentation. The ponds resemble small natural lakes and will be colonized by flora and fauna. How design with respect to age, ratio between wet volume and reduced catchment area and land use influences the retention and how biodiversity is affected was examined. Age and ratio were determined in 135 and 59 ponds, respectively, and 12 of these ponds were selected for studies of dry weight (DW), organic matter (OM), total phosphorus (TP) and aluminum (Al), zinc (Zn), copper (Cu), chromium (Cr), cadmium (Cd) and lead (Pb) in the sediment. Invertebrate biodiversity was determined by Shannon–Wiener index (H’) and Pielou Evenness (J). DW, OM, TP and metals in the sediment close to the outlet of the ponds were influenced by pond age and the volume/area ratio whereas the sediment in the inlet area was more affected by the catchment type. Biodiversity increased with increasing ratio, while age had no effect on the sediment biodiversity but some effect on the water phase biodiversity. Biodiversity decreased with higher OM and TP and tend to decrease with increasing metal content. Higher volume/area ratio results in less sediment accumulation which improves the biodiversity. More pollutants are accumulating with age, which negatively affects the biodiversity. In conclusion, pond ratio, catchment type and, to some extent, age effect the load of contaminants in the sediment and the pond biodiversity. Proper design and management are recommended as a mitigating measure.