To explore the effect of dietary fiber on growth performance and intestinal health in different pig breeds, forty Taoyuan and Duroc pigs (pure breeds) of 60 days of age were randomly divided into a 2 (diet) × 2 (breed) factorial experiment (n = 10), and fed with a basal diet (BD) or high-fiber diet (HFD). The trial lasted for 28 d, and results showed that the Taoyuan pigs had a higher average daily feed intake (ADFI) than the Duroc pigs (p < 0.05). The average daily gain (ADG) and digestibilities of gross energy (GE) and crude protein (CP) were higher in Taoyuan pigs than in the Duroc pigs under HFD feeding (p < 0.05). The HFD increased the superoxide dismutase (SOD) and catalase (CAT) activity in Taoyuan pigs (p < 0.05). Interestingly, Taoyuan pigs had a higher jejunal villus height and ratio of villus height to crypt depth (V/C) than the Duroc pigs. The HFD significantly improved the villus height and V/C ratio in duodenum and jejunum (p < 0.05). The HFD also increased the jejunal maltase and ileal sucrase activities in Duroc and Taoyuan pigs, respectively (p < 0.05). Taoyuan pigs had a higher expression level of duodenal fatty acid transport protein-1 (FATP-1) than the Duroc pigs (p < 0.05). Furthermore, the HFD acutely improved the expression levels of ileal SGLT-1 and GLUT-2, and the expression levels of jejunal occludin and claudin-1 in Taoyuan pigs (p < 0.05). Importantly, Taoyuan pigs had a higher colonic Bifidobacterium abundance than the Duroc pigs (p < 0.05). The HFD not only elevated the colonic Lactobacillus abundance and butyrate acid content in Taoyuan pigs, but also increased the acetic and propionic acid contents in both the pig breeds (p < 0.05). These results indicated a difference in dietary fiber (DF) utilization by the two pig breeds, and results may also suggest a beneficial character of DF in regulating intestinal health.