The purpose of this work was to study the dose effects of fruit oligosaccharide (FOS) supplementation on rumen fermentation parameters, methane (CH4) production and skatole production. The rumen fluid of Hu sheep was collected through their fistula and immediately transferred to the laboratory for rumen fermentation in vitro. The experimental diet was supplemented with 0%, 0.2%, 0.8%, 1.2%, 1.8% and 2.4% FOS in the basal diet. Gas production (GP) and CH4 production were measured and recorded at 2, 4, 6, 8, 10, 12, 24, 36 and 48 h. After 48 h of fermentation, degradation rates of nutritional components, fermentation parameters and skatole content were determined. The results showed that the GP, the nutrient degradation rates and the fermentation parameters of rumen linearly increased with increasing doses of FOS supplementation (p < 0.05). There was a quadratic trend between FOS addition and CH4 production and skatole content in rumen fluid (p < 0.05). We also observed the CH4 production in the 1.2% FOS-treated group was significantly lower than the other FOS-treated groups. Skatole content of the 0.2%, 0.8% and 1.2% FOS-treated groups were significantly lower than the other FOS-treated groups (p < 0.05). Our findings indicated that the effect of FOS on rumen fermentation parameters, CH4 production and skatole production in vitro was dose-dependent. To improve the digestibility of nutrients and the fermentation parameters of rumen, a higher FOS dosage might be helpful. However, if CH4 and skatole production is a concern, a dose of FOS at 1.2% is recommended.