The authors of this paper conducted a comparative metabolomic analysis of Ophiocordyceps sinensis (OS), providing the metabolic profiles of the stroma (OSBSz) and sclerotia (OSBSh) of OS by widely targeted metabolomics and untargeted metabolomics. The results showed that 778 and 1449 metabolites were identified by the widely targeted metabolomics and untargeted metabolomics approaches, respectively. The metabolites in OSBSz and OSBSh are significantly differentiated; 71 and 96 differentially expressed metabolites were identified by the widely targeted metabolomics and untargeted metabolomics approaches, respectively. This suggests that these 71 metabolites (riboflavine, tripdiolide, bromocriptine, lumichrome, tetrahymanol, citrostadienol, etc.) and 96 metabolites (sancycline, vignatic acid B, pirbuterol, rubrophen, epalrestat, etc.) are potential biomarkers. 4-Hydroxybenzaldehyde, arginine, and lumichrome were common differentially expressed metabolites. Using the widely targeted metabolomics approach, the key pathways identified that are involved in creating the differentiation between OSBSz and OSBSh may be nicotinate and nicotinamide metabolism, thiamine metabolism, riboflavin metabolism, glycine, serine, and threonine metabolism, and arginine biosynthesis. The differentially expressed metabolites identified using the untargeted metabolomics approach were mainly involved in arginine biosynthesis, terpenoid backbone biosynthesis, porphyrin and chlorophyll metabolism, and cysteine and methionine metabolism. The purpose of this research was to provide support for the assessment of the differences between the stroma and sclerotia, to furnish a material basis for the evaluation of the physical effects of OS, and to provide a reference for the selection of detection methods for the metabolomics of OS.