This study aimed to establish the phytochemical profile of Glochidion velutinum and its cytotoxic activity against prostate cancer (PC-3) and breast cancer (MCF-7) cell lines. The phytochemical composition of G. velutinum leaf extract and its fractions was established with the help of total phenolic and flavonoid contents and LC-MS/MS-based metabolomics analysis. The crude methanolic extract and its fractions were studied for pharmacological activity against PC-3 and MCF-7 cell lines using the MTT assay. The total phenolic content of the crude extract and its fractions ranged from 44 to 859 µg GAE/mg of sample whereas total flavonoid contents ranged from 20 to 315 µg QE/mg of sample. A total of forty-eight compounds were tentatively dereplicated in the extract and its fractions. These phytochemicals included benzoic acid derivatives, flavans, flavones, O-methylated flavonoids, flavonoid O- and C-glycosides, pyranocoumarins, hydrolysable tannins, carbohydrate conjugates, fatty acids, coumarin glycosides, monoterpenoids, diterpenoids, and terpene glycosides. The crude extract (IC50 = 89 µg/mL), the chloroform fraction (IC50 = 27 µg/mL), and the water fraction (IC50 = 36 µg/mL) were found to be active against the PC-3 cell line. However, the crude extract (IC50 = 431 µg/mL), the chloroform fraction (IC50 = 222 µg/mL), and the ethyl acetate fraction (IC50 = 226 µg/mL) have shown prominent activity against breast cancer cells. Moreover, G. velutinum extract and its fractions presented negligible toxicity to normal macrophages at the maximum tested dose (600 µg/mL). Among the compounds identified through LC-MS/MS-based metabolomics analysis, epigallocatechin gallate, ellagic acid, isovitexin, and rutin were reported to have anticancer activity against both prostate and breast cancer cell lines and might be responsible for the cytotoxic activities of G. velutinum extract and its bioactive fractions.