Polycyclic aromatic hydrocarbons (PAHs) are hydrophobic organic contaminants that have a highly carcinogenic and mutagenic nature. This study aimed to develop and validate a sensitive analytical method to determine 8 PAHs in 51 herbal medicines (HMs) using gas chromatography (GC)-tandem mass spectrometry (MS/MS). Liquid––liquid extraction and florisil SPE cartridge purification were basically adopted for pretreatment. For the samples containing essential oil, starch grain, etc., N,N-dimethyl formamide/water mixture (9:1, v/v) was added in the extraction step. The multiple reaction monitoring (MRM) conditions were newly obtained by the infusion of reference solutions of the targeted compounds at a concentration of 100 ng/mL into the GC-MS/MS system used in this study. The 51 items were classified according to whether or not they contained essential oil. Eight PAHs were not detected in 39 (8.3%) of the 459 samples monitored. The total content of 8 PAHs ranged from 0.45 μg/kg in Anemarrhenae Rhizoma to 270.94 μg/kg in Zingiberis Rhizoma. The average content of those ranged from 0.9 μg/kg in Araliae Continentalis Radix to 110.8 μg/kg in Coptidis Rhizoma Preparata cum Vinum. The results of this study prove that the proposed method is useful for determining 8 PAHs in HMs.