Ectomycorrhizal (ECM) symbioses are indispensable for the establishment of host trees, yet available information of ECM symbiosis in alpine forests is scarce. Pinus pumila is a typical ice age relict tree species in Japan and often forms monodominant dwarf vegetation above the tree line in mountains. We studied ECM fungi colonizing P. pumila on Mt. Norikura, Japan, with reference to host developmental stages, i.e., from current-year seedlings to mature trees. ECM fungal species were identified based on rDNA ITS sequences. Ninety-two ECM fungal species were confirmed from a total of 2480 root tips examined. Species in /suillus-rhizopogon and /wilcoxina were dominant in seedling roots. ECM fungal diversity increased with host development, due to the addition of species-rich fungal lineages (/cenococcum, /cortinarius, and /russula-lactarius) in late-successional stages. Such successional pattern of ECM fungi is similar to those in temperate pine systems, suggesting the predominant role of /suillus-rhizopogon in seedling establishment, even in relict alpine habitats fragmented and isolated for a geological time period. Most of the ECM fungi detected were also recorded in Europe or North America, indicating their potential Holarctic distribution and the possibility of their comigration with P. pumila through land bridges during ice ages. In addition, we found significant effects of soil properties on ECM fungal communities, which explained 34.1% of the total variation of the fungal communities. While alpine vegetation is regarded as vulnerable to the ongoing global warming, ECM fungal communities associated with P. pumila could be altered by the edaphic change induced by the warming.