The aims of this study were to determine which cognitive control functions are most sensitive to cross‐sectional age differences and to identify neural features in different neuroimaging modalities that associated cognitive control function across the adult lifespan. We employed a joint independent component analysis (jICA) approach to obtain common networks among three different brain‐imaging modalities (i.e., structural MRI, resting‐state functional MRI, and diffusion tensor imaging) in relation to the cognitive control function. We differentiated three distinct cognitive constructs: one common (across inhibition, shifting, and updating) and two specific (shifting, updating) factors. These common/specific constructs were transformed from three original performance indexes: (a) stop‐signal reaction time, (b) switch‐cost, and (c) performance sensitivity collected from 156 individuals aged 20 to 78 years old. The current results show that the cross‐sectional age difference is associated with a wide spread of brain degeneration that is not limited to the frontal region. Crucially, these findings suggest there are some common and distinct joined multimodal components that correlate with the psychological constructs of common and discrete cognitive control functions, respectively. To support current findings, other fusion ICA models were also analyzed including, parallel ICA (para‐ICA) and multiset canonical correlation analysis with jICA (mCCA + jICA). Dynamic interactions among these brain features across different brain modalities could serve as possible developmental mechanisms associated with these age effects.