Characterization of microbial communities in stressful conditions at a field level is rather scarce, especially when considering fungal communities from aboveground habitats. We aimed at characterizing fungal communities from different poplar habitats at a Hg-contaminated phytomanagement site by using Illumina-based sequencing, network analysis approach, and direct isolation of Hg-resistant fungal strains. The highest diversity estimated by the Shannon index was found for soil communities, which was negatively affected by soil Hg concentration. Among the significant correlations between soil operational taxonomic units (OTUs) in the co-occurrence network, 80% were negatively correlated revealing dominance of a pattern of mutual exclusion. The fungal communities associated with Populus roots mostly consisted of OTUs from the symbiotic guild, such as members of the Thelephoraceae, thus explaining the lowest diversity found for root communities. Additionally, root communities showed the highest network connectivity index, while rarely detected OTUs from the Glomeromycetes may have a central role in the root network. Unexpectedly high richness and diversity were found for aboveground habitats, compared to the root habitat. The aboveground habitats were dominated by yeasts from the Lalaria, Davidiella, and Bensingtonia genera, not detected in belowground habitats. Leaf and stem habitats were characterized by few dominant OTUs such as those from the Dothideomycete class producing mutual exclusion with other OTUs. Aureobasidium pullulans, one of the dominating OTUs, was further isolated from the leaf habitat, in addition to Nakazawaea populi species, which were found to be Hg resistant. Altogether, these findings will provide an improved point of reference for microbial research on inoculation-based programs of tailings dumps.