Soil microorganisms play key roles in ecosystem functioning and are known to be influenced by biotic and abiotic factors, such as plant cover or edaphic parameters. New Caledonia, a biodiversity hotspot located in the southwest Pacific, is one-third covered by ultramafic substrates. These types of soils are notably characterised by low nutrient content and high heavy metal concentrations. Ultramafic outcrops harbour diverse vegetation types and remarkable plant diversity. In this study, we aimed to assess soil bacterial and fungal diversity in New Caledonian ultramafic substrates and to determine whether floristic composition, edaphic parameters and geographical factors affect this microbial diversity. Therefore, four plant formation types at two distinct sites were studied. These formations represent different stages in a potential chronosequence. Soil cores, according to a given sampling procedure, were collected to assess microbial diversity using a metagenomic approach, and to characterise the physico-chemical parameters. A botanical inventory was also performed. Our results indicated that microbial richness, composition and abundance were linked to the plant cover type and the dominant plant species. Furthermore, a large proportion of Ascomycota phylum (fungi), mostly in non-rainforest formations, and Planctomycetes phylum (bacteria) in all formations were observed. Interestingly, such patterns could be indicators of past disturbances that occurred on different time scales. Furthermore, the bacteria and fungi were influenced by diverse edaphic parameters as well as by the interplay between these two soil communities. Another striking finding was the existence of a site effect. Differences in microbial communities between geographical locations may be explained by dispersal limitation in the context of the biogeographical island theory. In conclusion, each plant formation at each site possesses is own microbial community resulting from multiple interactions between abiotic and biotic factors.