Peucedanum japonicum (Umbelliferae) is widely distributed throughout Southeast Asian countries. The root of this plant is used in traditional medicine to treat colds and pain, whereas the young leaves are considered an edible vegetable. In this study, the differences in coumarin profiles for different parts of P. japonicum including the flowers, roots, leaves, and stems were compared using ultra-performance liquid chromatography time-of-flight mass spectrometry. Twenty-eight compounds were tentatively identified, including three compounds found in the genus Peucedanum for the first time. Principal component analysis using the data set of the measured mass values and intensities of the compounds exhibited distinct clustering of the flower, leaf, stem, and root samples. In addition, their anticancer activities were screened using an Aldo–keto reductase (AKR)1C1 assay on A549 human non-small-cell lung cancer cells and the flower extract inhibited AKR1C1 activity. Based on these results, seven compounds were selected as potential markers to distinguish between the flower part versus the root, stem, and leaf parts using an orthogonal partial least-squares discriminant analysis. This study is the first to provide information on the comparison of coumarin profiles from different parts of P. japonicum as well as their AKR1C1 inhibitory activities. Taken together, the flowers of P. japonicum offer a new use related to the efficacy of overcoming anticancer drug resistance, and may be a promising source for the isolation of active lead compounds.