The absorption spectra of natural, colored fluorites (CaF2) are analyzed and compared with the presence of chemical impurities such as rare‐earth elements, yttrium, and sodium located within the fluorite structure. Mechanisms for charge compensation of monovalent and trivalent ions are shown to be provided by color centers and related substitutional or interstitial arrangements either remote or proximate to the ions. It is shown that the color‐center concentration of the 3050 Å absorption band of natural fluorites is directly related to rare‐earth element concentrations. In the visible‐region spectra, the color‐center concentration of the 5600 to 5900 Å absorption band of natural fluorites is shown to be a direct function of monovalent (Na+) ion concentration. The presence of bands along the boundary between the ultraviolet and visible regions is a function of the total concentrations of rare‐earth elements, yttrium, and sodium, with some contribution from F‐center aggregates. This indicates that natural radioactivity is important in the generation of coloration of the natural fluorites. These findings raise serious doubts in the use of absorption bands in natural fluorites in geological age determinations because these bands originate mainly from impurity‐related color centers.