The effect of random quenched site dilution on the free energy of nearest-neighbor Ising models is considered. An exact relation between the distribution of local fields and the change in the free energy on dilution is derived. For frustrated systems at low temperatures, dilution leads to a lowering of the entropy, while for well-ordered systems dilution raises the internal energy.