In recent years, carbon shells have garnered attention as possible protective layers that can be applied to oxygen evolution reaction (OER) electrocatalysts to prevent corrosion under alkaline conditions. However, thermodynamic considerations and experimental results indicate that these carbon shells are subject to corrosion themselves, limiting their applicability as protective coatings against oxidation. Herein, the thermodynamics of carbon corrosion are presented with spectrometric, spectroscopic, crystallographic, microscopy, and electrochemical measurements, emphasizing the inevitable degradation of carbon under alkaline OER conditions. Recent work focused on suppressing this carbon corrosion is then discussed alongside future directions for carbon shells in water oxidation research.