The effects of inulin and mannanoligosaccharide (MOS) on the growth performance and non-specific immunity of grass carp were studied. Two doses of prebiotic fiber with 0.2 or 2% of the fibers are being mixed into fish feed pellets. Fish growth as well as selected non-specific immune parameters of grass carp were tested in a feeding trial, which lasted for 8 weeks. Fish was fed at 2.5% body mass per day. INU02, INU2, and MOS2 significantly improved relative weight gain, specific growth rate, protein efficiency ratio, and food conversion ratio of grass carp fed with food waste-based diet. In terms of non-specific immune response, grass carp showed significant improvement in all three tested parameters (total serum immunoglobin, bactericidal activity, and anti-protease activity). Adding 2% of inulin (INU2) into food waste diets seemed to be more preferable than other supplemented experimental diets (INU02, MOS02, MOS2), as it could promote growth of grass carp as well as improving the non-specific immune systems of grass carp.