Most multicellular organisms harbor microbial colonizers that provide various benefits to their hosts. Although these microbial communities may be host species- or even genotype-specific, the associated bacterial communities can respond plastically to environmental changes. In this study, we estimated the relative contribution of environment and host genotype to bacterial community composition in Nematostella vectensis, an estuarine cnidarian. We isolated N. vectensis polyps from five different populations along a north-south gradient on the Atlantic coast of the United States and Canada at three different times of the year. While half of the polyps were immediately analyzed for their bacterial composition by 16S rRNA gene sequencing, the remaining polyps were cultured under laboratory conditions for one month. Bacterial community comparison analyses revealed that laboratory maintenance reduced bacterial diversity by fourfold, but maintained a population-specific bacterial colonization. Interestingly, the differences between bacterial communities correlated strongly with seasonal variations, especially with ambient water temperature. To decipher the contribution of both ambient temperature and host genotype to bacterial colonization, we generated 12 clonal lines from six different populations in order to maintain each genotype at three different temperatures for three months. The bacterial community composition of the same N. vectensis clone differed greatly between the three different temperatures, highlighting the contribution of ambient temperature to bacterial community composition. To a lesser extent, bacterial community composition varied between different genotypes under identical conditions, indicating the influence of host genotype. In addition, we identified a significant genotype x environment interaction determining microbiota plasticity in N. vectensis. From our results we can conclude that N. vectensis-associated bacterial communities respond plastically to changes in ambient temperature, with the association of different bacterial taxa depending in part on the host genotype. Future research will reveal how this genotype-specific microbiota plasticity affects the ability to cope with changing environmental conditions.