The aim of the study was to investigated the mechanism of Strychnos nux-vomica L. (Semen Strychni, SS) against papillary carcinoma thyroid (PTC) by combined of network pharmacology and experimental verification. By searching the TCMSP, SEA and SwissTarget Prediction database, the main active ingredients and related targets were obtained. Utilizing Venny 2.1.0 String database and Cytoscape 3.7.2 to screened the intersection target and constructed protein–protein interaction (PPI) network diagram. Using R 4.0.4 software carried out the enrichment analysis of GO and KEGG. HPLC was carried out using LC-20A modular HPLC system to identify the bioactive compound brucine present in SS. Molecular docking was performed using Discovery 2019 software. The inhibition rate was detected by CCK8 method. Western blot was used to detect the expression levels of brucine anti-PTC related pathway proteins. 14 active components were screened out, of which 4 main components showed tight relationship with PTC. SS may play the anti-PTC role by acting on two main pathways (TNF signaling pathway and MAPK signaling pathway) and mediating various biological functions. HPLC analysis revealed that brucine was a suitable marker for standardization of the SS. 4 active components exhibit strong binding energy with core protein. Brucine could significantly reduce the activity of BCPAP cells compared with isobrucine, stigmasterol, (+)-catechin. Brucine may reduce the protein expression levels of IL-6, VEGFA, JUN, TP53, 1L1B, PTGS2, BCL2, CASP3, CASP8, and CASP9 while increase the protein expression levels of BAD, cleaved-CASP3, cleaved-CASP8, and cleaved-CASP9 in BCPAP cells, respectively. The active components of SS against PTC mainly include isobrucine, stigmasterol, (+)-catechin, brucine. Among them, brucine exhibits the strongest anti-PTC activity in BCPAP cells, which may reduce the PTC-related protein expression levels. Therefore, SS may exhibits the anti-PTC activities through multiple targets and pathways.