Dormancy is thought to promote biodiversity within microbial communities, but how assembly of the active community responds to changes in environmental conditions is unclear. To measure the active and dormant communities of bacteria and fungi colonizing decomposing litter in maple forests, we targeted ribosomal genes and transcripts across a natural environmental gradient. Within bacterial and fungal communities, the active and dormant communities were phylogenetically distinct, but patterns of phylogenetic clustering varied. For bacteria, active communities were significantly more clustered than dormant communities, while the reverse was found for fungi. The proportion of operational taxonomic units (OTUs) classified as active and the degree of phylogenetic clustering of the active bacterial communities declined with increasing pH and decreasing C/N. No significant correlations were found for the fungal community. The opposing pattern of phylogenetic clustering in dormant and active communities and the differential response of active communities to environmental gradients suggest that dormancy differentially structures bacterial and fungal communities.