Botanical medicines have been utilized for centuries, but it remains challenging to identify bioactive constituents from complex botanical extracts. Bioassay-guided fractionation is often biased towards abundant or easily-isolatable compounds. To comprehensively evaluate active botanical mixtures, methods that allow for the prioritization of active compounds are needed. To this end, a method integrating bioassay-guided fractionation, biochemometric selectivity ratio analysis, and molecular networking was devised and applied to Angelica keiskei Koidzumi to comprehensively evaluate its antimicrobial activity against Staphylococcus aureus. This approach enabled the identification of putative active constituents early in the fractionation process, and provided structural information for these compounds. A subset of chalcone analogs were prioritized for isolation, yielding 4-hydroxyderricin (1, MIC ≤ 4.6 µM, IC50 = 2.0 µM), xanthoangelol (2, MIC ≤ 4.0 µM, IC50 = 2.3) and xanthoangelol K (4, IC50 = 168 µM). This approach allowed for the identification of a low abundance compound (xanthoangelol K) that has not been previously reported to possess antimicrobial activity, and facilitated a more comprehensive understanding of the compounds responsible for A. keiskei’s antimicrobial activity.