It is very important to confirm and understand the genetic background of cultivated plants used in multiple applications. The genetic background is the history of crossing between maternal and paternal plants to generate a cultivated plant. If the plant in question was generated from a simple origin and not complicated crossing, we can easily confirm the history using a phylogenetic tree based on molecular data. This study was conducted to trace the origin of “Tottori Fujita 1gou” and “Tottori Fujita 2gou”, which are registered as cultivars originating from Phedimus kamtschaticus. To investigate the phylogenetic position of these cultivars, the backbone tree of the genus Phedimus needed to be further constructed because it retains inarticulate phylogenetic relationships among the wild species. We performed molecular phylogenetic analysis for P. kamtschaticus, Phedimus takesimensis, Phedimus aizoon, and Phedimus middendorffianus, which are assumed as the species of origin for “Tottori Fujita 1gou” and “Tottori Fujita 2gou”. The molecular phylogenetic tree based on the internal transcribed spacer (ITS) and psbA-trnH sequences showed the monophyly of the genus Phedimus, with P. takesimensis forming a single clade. However, P. kamtschaticus and P. aizoon were scattered in the tree. It was verified that “Tottori Fujita 1gou” and “Tottori Fujita 2gou” were embedded in a clade with P. takesimensis and not P. kamtschaticus. Therefore, origination from P. takesimensis was strongly supported. Based on these results, molecular phylogenetic analysis is suggested as a powerful tool for clearly tracing the origin of cultivated plants.