Empty mollusk shells may act as colonization surfaces for sclerobionts depending on the physical, chemical, and biological attributes of the shells. However, the main factors that can affect the establishment of an organism on hard substrates and the colonization patterns on modern and time-averaged shells remain unclear. Using experimental and field approaches, we compared sclerobiont (i.e., bacteria and invertebrate) colonization patterns on the exposed shells (internal and external sides) of three bivalve species (Anadara brasiliana, Mactra isabelleana, and Amarilladesma mactroides) with different external shell textures. In addition, we evaluated the influence of the host characteristics (mode of life, body size, color alteration, external and internal ornamentation and mineralogy) of sclerobionts on dead mollusk shells (bivalve and gastropod) collected from the Southern Brazilian coast. Finally, we compared field observations with experiments to evaluate how the biological signs of the present-day invertebrate settlements are preserved in molluscan death assemblages (incipient fossil record) in a subtropical shallow coastal setting. The results enhance our understanding of sclerobiont colonization over modern and paleoecology perspectives. The data suggest that sclerobiont settlement is enhanced by (i) high(er) biofilm bacteria density, which is more attracted to surfaces with high ornamentation; (ii) heterogeneous internal and external shell surface; (iii) shallow infaunal or attached epifaunal life modes; (iv) colorful or post-mortem oxidized shell surfaces; (v) shell size (<50 mm2 or >1,351 mm2); and (vi) calcitic mineralogy. Although the biofilm bacteria density, shell size, and texture are considered the most important factors, the effects of other covarying attributes should also be considered. We observed a similar pattern of sclerobiont colonization frequency over modern and paleoecology perspectives, with an increase of invertebrates occurring on textured bivalve shells. This study demonstrates how bacterial biofilms may influence sclerobiont colonization on biological hosts (mollusks), and shows how ecological relationships in marine organisms may be relevant for interpreting the fossil record of sclerobionts.