Substrate composition has been widely recognised as a primary variable shaping lotic macroinvertebrate communities at the habitat unit level. However, fundamental understanding of how communities inhabiting mineralogical habitats (i.e., gravel, sand and silt) are structured across differing rivers is lacking. Moreover, research largely focusses on gravel beds and fine sediment in general (<2 mm) and as a result detailed field observations specifically of the sand and silt fractions are lacking. Using data from five UK streams collated from published studies, we assess taxonomic and functional biodiversity (alpha and beta diversity) at the habitat unit level (as defined by substrate composition of sand, silt and gravel). We found that the composition of taxonomic communities were clearly different in all habitat units for each individual stream (and at the landscape scale), with comparable, but less strong, distinctions between substrates for functional macroinvertebrate community composition. However, alpha diversity metrics and Local Contribution to Beta Diversity (LCBD) recorded among the different habitat units varied significantly across individual rivers, and the amount of variation explained by the habitat unit for taxonomic and functional composition demonstrated considerable differences suggesting strong context dependence. The depositional fine sediment habitats of sand and silt were found to support a discrete community composition and differing levels of alpha and beta diversity within and between rivers. We advocate that care should be taken when seeking to generalise biodiversity patterns at a landscape scale as our study highlights the high degree of context dependency when considering the role of the habitat template. Moreover, our results provide evidence that discriminating between the size fractions of fine sediment habitats (sand or silt) is important to fully elucidate the wider ecological importance of these habitats and the distinct taxonomic and functional biodiversity they support.