Amentotaxus argotaenia (Hance) Pilg. is a threatened conifer with a wide distribution range from North to Central Vietnam due to habitat loss and over-exploitation. To provide information for its conservation and sustainable management, in the present study, genetic diversity and population genetic structure for 200 trees from eight populations, representing the natural distribution range of this species were estimated using nuclear microsatellites. The results showed a moderate genetic diversity of A. argotaenia (HO = 0.331, HE = 0.358). Significant heterozygosity deficits were detected in three populations in the Northeast area. Genetic differentiation was low in the same distribution area and high in different areas. However, the gene flow among the studied populations was relatively high (Nm = 1.17). Habitat fragmentation, geographical distance and high mountain range can be the major factors that reduce gene exchange between different areas. Various clustering analyses distinguished three major genetic groups related to the three distribution areas of this species in Vietnam. Based on the study results, we propose that some populations could be prioritized for in situ conservation due to their high genetic diversity with high allelic richness or private alleles, meanwhile other populations should be collected for ex situ conservation as genetic resources in the future.