The present study investigated the insulin-like growth factors (IGFs) and their receptors and binding proteins among three pig breeds during weaning. Sixty Duroc (DR), Taoyuan black (TYB), and Xiangcun black (XCB) piglets (20 piglets per breed) were selected at 21 and 24 (3 days of post-weaning) days of age to analyze organ indices, plasma concentrations of IGF and IGF-binding proteins (IGFBPs) using ELISA kits, and gene expression of IGF-system-related components in different tissues. The plasma IGFBP-3 concentration in TYB piglets was higher (p > 0.05) than in the XCB and DR piglets at 21 days of age. At 21 days of age, compared with the DR piglets, the IGF-1 expression was lower (p < 0.05) in the kidney, but it was higher (p < 0.05) in the spleen of XCB and TYB piglets. At 24 days of age, the IGF-1 expression was higher (p < 0.05) in the kidney of TYB piglets than in the XCB and DR piglets, while IGFBP-3 in the stomach and IGFBP-4 in the liver of XCB and TYB piglets were lower (p < 0.05) compared with the DR piglets. Weaning down-regulated (p < 0.05) IGF-1 expression in the jejunum, spleen, and liver of piglets, while it up-regulated (p < 0.05) IGFBP-3 expression in the stomach, IGFBP-4 in the liver, IGFBP-5 in the ileum, and IGFBP-6 in the jejunum of DR piglets. Spearman’s correlation analysis showed a negative correlation (p < 0.05) between plasma IGFBP-2 and IGFBP-5 concentration and the organ indices of piglets. Collectively, there were significant differences in the IGF system components among the three pig breeds. The IGF system components were altered during weaning, which might be involved in weaning stress to decrease the growth of piglets.