Saltmarshes are typically dominated by perennial grasses with large underground rhizome systems that can change local sediment conditions and be important in shaping the sediment microbial community. Factors such as salinity that control plant zonation in saltmarshes are also likely to influence the microbial community, but little is known as to whether microbial communities share distribution patterns with plants in these systems. To determine the extent to which microbial assemblages are influenced by saltmarsh plant communities, as well as to examine patterns in microbial community structure at local and regional scales, we sampled sediments at three saltmarshes in Louisiana, USA. All three systems exhibit a patchy distribution of Juncus roemerianus stands within a Spartina alterniflora marsh. Sediment samples were collected from the interior of several J. roemerianus stands as well as from the S. alterniflora matrix. Samples were assayed for extracellular enzyme activity and DNA extracted to determine microbial community composition. Denaturing gradient gel electrophoresis of rRNA gene fragments was used to determine regional patterns in bacterial, archaeal, and fungal assemblages, while Illumina sequencing was used to examine local, vegetation-driven, patterns in community structure at one site. Both enzyme activity and microbial community structure were primarily influenced by regional site. Within individual saltmarshes, bacterial and archaeal communities differed between J. roemerianus and S. alterniflora vegetated sediments, while fungal communities did not. These results highlight the importance of the plant community in shaping the sediment microbial community in saltmarshes but also demonstrate that regional scale factors are at least as important.