Community assembly is a result of dispersal, abiotic and biotic characteristics of the habitat as well as stochasticity. A direct comparison between the assembly of microbial and ‘macrobial’ organisms is hampered by the sampling of these communities in different studies, at different sites, or on different scales. In a glacier forefield in the Austrian Alps, we recorded the soil and plant microbiome (bacteria and fungi) and plants that occurred in the same landscape and in close proximity in the same plots. We tested five predictions deduced from assembly processes and revealed deviating patterns of assembly in these community types. In short, microbes appeared to be less dispersal limited than plants, soil microbes and plants strongly responded to abiotic factors whereas the leaf microbiome was plant species-specific and well buffered from environmental conditions. The observed differences in community assembly processes may be attributed to the organisms’ dispersal abilities, the exposure of the habitats to airborne propagules, and habitat characteristics. The finding that assembly is conditional to the characteristics of the organisms, the habitat, and the spatial scale under consideration is thus central for our understanding about the establishment and the maintenance of biodiversity.