Excessive daytime sleepiness (EDS) and fatigue increases with age. The aim of this study was to investigate the association between EDS and fatigue with cortical thickness and hippocampal volume in cognitively normal, late middle-aged and older adults. We performed a cross-sectional observational study of 1374 cognitively-normal subjects aged 50 years and older who had a structural MRI. Regional cortical thickness and hippocampal volume were measured. Multiple linear regression models were fit to explore associations between EDS and fatigue and structural MRI measures in different brain regions, adjusting for multiple covariates. EDS was defined as Epworth Sleepiness Scale ≥10. Fatigue severity was assessed with the Beck Depression Inventory-2. 208 participants had EDS, 27 had significant fatigue, and 11 had both. Participants with EDS or fatigue had significantly lower cognitive scores, more disturbed sleep, and medical comorbidities. The presence of EDS was associated with both global and regional atrophy, whereas fatigue was more associated with frontal and temporal changes. Cortical thinning predicted by EDS and fatigue was maximal in the temporal region with average reduction of 34.2 µm (95% CI, −54.1, −14.3; P=.001) and 90.2 µm (95% CI, −142.1, −38.2; P=.001), respectively. Fatigue was also associated with hippocampal volume reduction of −374.2 mm3 (95%CI, −670.8, −77.7; P=.013). Temporal cortical thinning predicted by presence of EDS and fatigue was equivalent to more than 3.5 and nine additional years of aging, respectively. EDS and fatigue were associated with cortical thickness reduction primarily in regions with increased age-susceptibility, which may indicate accelerated brain aging.