Angular correlation of photons from positrons annihilating in the rare gases (helium, neon, argon, krypton and xenon) have been measured in order to investigate positronium formation in these gases at low pressures (0.1, 0.2, 0.4, 0.7 and 1.0atm for xenon and 0.2 and 1.0 atm for the other gases). A piece of silica aerogel was used to stop positrons in such a thin region that high-resolution angular correlation measurements could be performed with high statistics regardless of the density of the gases. Formation of parapositronium in xenon has been found to be higher than in the other gases under the present experimental conditions. The result, apparently contradictory to the low orthopositronium fraction observed in lifetime experiments, is consistent with the Ore model of the positronium formation and the measured positronium formation cross sections for the gases. By applying a static magnetic field, the fraction of orthopositronium in xenon has been also measured. It has been confirmed that xenon has a strong quenching effect on orthopositronium. This is consistent with the reported dearth of long-lived components in the positron lifetime spectra in xenon.