Characterization of genetic resources maintained at genebanks has important implications for future utilization and collection activities. A total of 49 simple sequence repeat (SSR) or microsatellite markers were used to study genetic diversity and relationships among 376 barley landraces collected from different barley producing parts of Ethiopia and eight cultivars. Overall, 478 alleles with an average of 9.755 alleles per locus were obtained of which 97.07% of the loci were observed to be polymorphic. Nei’s genetic diversity index (h) was 0.654, and the Shannon diversity index (I) was 0.647, indicating that the genetic diversity in barley genotypes studies was moderately high. At the population level, the percentage of polymorphic loci (PPL) averaged 98.37%, h = averaged 0.388, and I = averaged 0.568. The highest level of genetic diversity was observed in the AR population (PPL =100%, h = 0.439, I = 0.624); the lowest was observed in the JM population (PPL = 75.51%, h = 0.291, I =0.430). AMOVA revealed significant genetic differentiation within and between populations (P < 0.001), with 84.21% of the variation occurring within populations and 15.79% occurring among populations. Genetic variation analysis showed a coefficient of gene differentiation of 0.053 and a gene flow value of 4.467 among populations. The 384 barley genotypes were divided into seven genetic clusters according to STRUCTURE, Neighbour joining tree and principal coordinate analysis, correlating significantly with geographic distribution. These results will assist with the formulation of conservation strategies, such as genetic rescue and on-farm in situ and ex situ conservation.