Biotic and abiotic factors influence the formation of fungal–algal pairings in lichen symbiosis. However, the specific determinants of these associations, particularly when distantly related fungi are involved, remain poorly understood. In this study, we investigated the impact of different drivers on the association patterns between taxonomically diverse lichenized fungi and their trebouxioid symbiotic partners. We collected 200 samples from four biomes and identified 41 species of lichenized fungi, associating them with 16 species of trebouxioid green algae, of which 62% were previously unreported. The species identity of both the fungal and algal partners had the most significant effect on the outcome of the symbiosis, compared to abiotic factors like climatic variables and geographic distance. Some obviously specific associations were observed in the temperate zone; however, the nestedness value was lower in arid regions than in cold, polar, and temperate regions according to interaction network analysis. Cophylogenetic analyses revealed congruent phylogenies between trebouxioid algae and associated fungi, indicating a tendency to reject random associations. The main evolutionary mechanisms contributing to the observed phylogenetic patterns were “loss” and “failure to diverge” of the algal partners. This study broadens our knowledge of fungal–algal symbiotic patterns in view of Trebouxia-associated fungi.