The use of lignocellulosic fillers in rigid polyurethane foams (RPUFs) has been receiving great attention due to their good mechanical and insulation properties and the high sustainable appeal of the obtained cellular polymers, although high water uptakes are found in most of these systems. To mitigate this detrimental effect, RPUFs filled with wood flour (2.5% wt) were fabricated with the addition of furfuryl alcohol (FA) to create a polymer grafted with the wood filler. Two concentrations of FA (10 wt% and 15 wt%) were investigated in relation to the wood flour, and the RPUFs were characterized for cell morphology, density, compressive properties, thermal stability, and water uptake. The introduction of wood flour as a filler decreased the cell size and increased the anisotropy index of the RPUFs and, in addition to that, the FA grafting increased these effects even more. In general, there were no significant changes in both mechanical and thermal properties ascribed to the incorporation of the fillers. On the other hand, a reduction of up to 200% in water uptake was ascribed to the FA-treated fillers.