Peach and nectarine cultivars have been released worldwide according to regional preference and local adaptability. However, few reports have provided statistical analyses and comprehensive comparisons of Eastern and Western cultivars. In this study, 22 phenotypic characteristics of 120 peach and nectarine cultivars collected from various countries were examined to determine their diversity and relationships. Based on phenological traits, Western cultivars bloomed earlier than Eastern cultivars, with no difference in ripening time. Fruit shape of Eastern cultivars was close to oblate, while fruit weights were similar. In addition, higher soluble solids concentration (SSC) and lower titratable acidity were observed in Eastern cultivars. In health benefit traits, such as total flavonoid concentration, total phenol concentration, and antioxidant capacity, there was no difference between Eastern and Western type. Positive correlation between chilling unit (CU) and latitude of origin was also found. In addition, the CU was closely associated with flowering date. Relationships among the phenotypic characteristics were also found. Ripening date showed significant and positive correlations with fruit development period, fruit weight, and SSC. In general, cultivars with late ripening times tend to produce high-quality fruit with a sweet taste and large size. The evaluation of a large number of cultivars from various regions with phenotypic variability could provide valuable information on regional preference or local adaptability.