As the power conversion efficiency (PCE) of organic solar cells (OSCs)has surpassed the 17% baseline, the long-term stability of highly efficient OSCs is essential for the practical application of this photovoltaic technology. Here, the photostability and possible degradation mechanisms of three state-of-the-art polymer donors with a commonly used nonfullerene acceptor (NFA), IT-4F, are investigated. The active-layer materials show excellent intrinsic photostability. The initial morphology, in particular the mixed region, causes degradation predominantly in the fill factor (FF) under illumination. Electron traps are formed due to the reorganization of polymers and diffusion-limited aggregation of NFAs to assemble small isolated acceptor domains under illumination. These electron traps lead to losses mainly in FF, which is in contradistinction to the degradation mechanisms observed for fullerene-based OSCs. Control of the composition of NFAs close to the thermodynamic equilibrium limit while keeping adequate electron percolation and improving the initial polymer and NFA ordering are of the essence to stabilize the FF in NFA-based solar cells, which may be the key tactics to develop next-generation OSCs with high efficiency as well as excellent stability.