The harsh environmental conditions in alpine tundra exert a significant influence on soil macro-arthropod communities, yet few studies have been performed regarding the effects of vegetation heterogeneity on these communities. In order to better understand this question, a total of 96 soil macro-arthropod samples were collected from four habitats in the Changbai Mountains in China, namely, the Vaccinium uliginosum habitat, Sanguisorba sitchensis habitat, Rhododendron aureum habitat, and Deyeuxia angustifolia habitat. The results revealed that the taxonomic composition of the soil macro-arthropods varied among the habitats, and that dissimilarities existed in these communities. The abundance, richness and diversity in the D. angustifolia habitat were all at their maximum during the sampling period. The vegetation heterogeneity affected the different taxa of the soil macro-arthropods at various levels. In addition, the vegetation heterogeneity had direct effects not only on soil macro-arthropod communities, but also indirectly impacted the abundance, richness and diversity by altering the soil fertility and soil texture. Overall, our results provide experimental evidence that vegetation heterogeneity can promote the abundance, richness and diversity of soil macro-arthropods, yet the responses of soil macro-arthropods to vegetation heterogeneity differed among their taxa.