Previous studies have suggested that the H haplome in Elymus could originate from different diploid Hordeum species, however, which diploid species best represent the parental species remains unanswered. The focus of this study seeks to pinpoint the origin of the H genome in Elymus. Allopolyploid Elymus species that contain the StH genome were analyzed together with diploid Hordeum species and a broad sample of diploid genera in the tribe Triticeae using DMC1 sequences. Both parsimony and maximum likelihood analyses well separated the American Hordeum species, except Hordeum brachyantherum subsp. californicum, from the H genome of polyploid Elymus species. The Elymus H-genomic sequences were formed into different groups. Our data suggested that the American Horedeum species, except H. brachyantherum subsp. californicum, are not the H-genomic donor to the Elymus species. Hordeum brevisubulatum subsp. violaceum was the progenitor species to Elymus virescens, Elymus confusus, Elymus lanceolatus, Elymus wawawaiensis, and Elymus caninus. Furthermore, North American H. brachyantherum subsp. californicum was a progenitor of the H genome to Elymus hystrix and Elymus cordilleranus. The H genomes in Elymus canadensis, Elymus sibiricus, and Elymus multisetus were highly differentiated from the H genome in Hordeum and other Elymus species. The H genome in both North American and Eurasian Elymus species was contributed by different Hordeum species.