Photosystem II (PSII) is a membrane-spanning, multi-subunit pigment-protein complex responsible for the oxidation of water and the reduction of plastoquinone in oxygenic photosynthesis. In the present review, the recent explosive increase in available structural information about the PSII core complex based on X-ray crystallography and cryo-electron microscopy is described at a level of detail that is suitable for a future structure-based analysis of light-harvesting processes. This description includes a proposal for a consistent numbering scheme of protein-bound pigment cofactors across species. The structural survey is complemented by an overview of the state of affairs in structure-based modeling of excitation energy transfer in the PSII core complex with emphasis on electrostatic computations, optical properties of the reaction center, the assignment of long-wavelength chlorophylls, and energy trapping mechanisms.