High sensitivity measurements of the dielectric constant of solid oxygen are reported for 4 Ͻ T Ͻ 54 K. The results show unexpectedly large hysteresis effects for the temperature dependence of the dielectric constant in the ␣ and  phases of oxygen on thermal cycling below 44 K. The behavior is compared to that observed for solid N 2 -Ar mixtures where the geometrical frustration of the molecular orientational ordering leads to pronounced memory effects. In contrast to solid N 2 -Ar where the effects of frustration and disorder combine to form an orientational glass, there is no disorder present for pure O 2 and the hystereses are attributed to the strong frustration of the interactions.