There is currently a growing demand for more effective thermal insulation materials with the best performance properties. This research paper presents the investigation results on the influence of two types of filler on the structure and properties of rigid polyurethane foam composites. Fly ash as a product of coal combustion in power plants and microspheres of 5, 10, 15, and 20 wt.%, were used as rigid polyurethane foams modifiers. The results of thermal analysis, mechanical properties testing, and cellular structure investigation performed for polyurethane composites show that the addition of fly ash, up to 10 wt.%, significantly improved the majority of the tested parameters. The use of up to 20 wt.% of microspheres improves the mechanical and thermal properties and thermal stability of rigid polyurethane foams.