Potato (Solanum tuberosum L.) is an important staple food and economic crop in many countries. It is of critical importance to understand the genetic diversity and population structure for effective collection, conservation, and utilization of potato germplasm. Thus, the objective of the present study was to investigate the genetic diversity and population structure of potato germplasm conserved in the National Agrobiodiversity Center (NAC) of South Korea to provide basic data for future preservation and breeding of potato genetic resources. A total of 24 simple sequence repeat (SSR) markers were used to assess the genetic diversity and population structure of 482 potato accessions. A total of 257 alleles were detected, with an average of 10.71 alleles per locus. Analysis of molecular variance showed that 97% of allelic diversity was attributed to individual accessions within the population, while only 3% was distributed among populations. Results of genetic structure analysis based on STRUCTURE and discriminant analysis of principal components revealed that 482 potato accessions could be divided into two main subpopulations. Accessions of subpopulation 1 mainly belonged to cultivars and breeding lines. Accessions of subpopulations 2 basically corresponded to wild relatives of potatoes. Results of this study provide useful information for potato improvement and conservation programs, although further studies are needed for a more accurate evaluation of genetic diversity and phenotypic traits of potatoes.