Most plant-origin fiber sources used in pig production contains a mixture of soluble and insoluble non-starch polysaccharides (NSP). The knowledge about effects of these sources of NSP on the gut microbiota and its fermentation products is still scarce. The aim of this study was to investigate effects of feeding diets with native sources of NSP on the ileal and fecal microbial composition and the dietary impact on the concentration of short-chain fatty acids (SCFA) and lactic acid. The experiment comprised four diets and four periods in a change-over design with seven post valve t-cecum cannulated growing pigs. The four diets were balanced to be similar in NSP content and included one of four fiber sources, two diets were rich in pectins, through inclusion of chicory forage (CFO) and sugar beet pulp, and two were rich in arabinoxylan, through inclusion of wheat bran (WB) and grass meal. The gut microbial composition was assessed with terminal restriction fragment (TRF) length polymorphism and the abundance of Lactobacillus spp., Enterobacteriaceae, Bacteroides-Prevotella-Porphyromonas and the β-xylosidase gene, xynB, were assessed with quantitative PCR. The gut microbiota did not cluster based on NSP structure (arabinoxylan or pectin) rather, the effect was to a high degree ingredient specific. In pigs fed diet CFO, three TRFs related to Prevotellaceae together consisted of more than 25% of the fecal microbiota, which is about 3 to 23 times higher ( P < 0.05) than in pigs fed the other diets. Whereas pigs fed diet WB had about 2 to 22 times higher abundance ( P < 0.05) of Megasphaera elsdenii in feces and about six times higher abundance ( P < 0.05) of Lactobacillus reuteri in ileal digesta than pigs fed the other diets. The total amount of digested NSP ( r = 0.57; P = 0.002), xylose ( r = 0.53; P = 0.004) and dietary fiber ( r = 0.60; P = 0.001) in ileal digesta were positively correlated with an increased abundance of Bacteroides-Prevotella-Porphyromonas. The effect on SCFA was correlated to specific neutral sugars where xylose increased the ileal butyric acid proportion, whereas arabinose increased the fecal butyric acid proportion. Moreover, chicory pectin increased the acetic acid proportion in both ileal digesta and feces.