For long-term performance chemically robust materials are desired for organic solar cells (OSCs). Illuminating neat films of OSC materials in air and tracking the rate of absorption loss, or photobleaching, can quickly screen a material's photo-chemical stability. In this report, we photobleach neat films of OSC materials including polymers, solution-processed oligomers, solution-processed small molecules, and vacuum-deposited small molecules. Across the materials we test, we observe photobleaching rates that span seven orders of magnitude. Furthermore, we find that the film morphology of any particular material impacts the observed photobleaching rate, and that amorphous films photobleach faster than crystalline ones. In an extreme case, films of amorphous rubrene photobleach at a rate 2500 times faster than polycrystalline films. When we compare density to photobleaching rate, we find that stability increases with density. We also investigate the relationship between backbone planarity and chemical reactivity. The polymer PBDTTPD is more photostable than its more twisted and less ordered furan derivitative, PBDFTPD. Finally, we relate our work to what is known about the chemical stability of structural polymers, organic pigments, and organic light emitting diode materials. For the highest chemical stability, planar materials that form dense, crystalline film morphologies should be designed for OSCs.