Some previous reports have suggested that hypertension is a risk factor for dementia and cognitive impairments. Using behavioral data from 1007 elderly human subjects (405 hypertensive patients) of Han ethnicity from Beijing, China, the present study aimed to assess the effects of hypertension on cognitive performance and explore related neuronal changes via advanced resting-state functional magnetic resonance imaging and diffusion tensor imaging data from 84 of these subjects (44 hypertensive patients). Cognitively, we found that patients with hypertension showed decreased executive functions and attention compared with those with normotension in the large sample. In magnetic resonance imaging scan sample, using independent component analysis to examine the functional connectivity difference between the two groups, we found that the frontoparietal networks in the hypertensive group exhibited altered patterns compared with the control group, mainly in the inferior parietal lobe, left inferior frontal lobe, and precuneus. Using tract-based spatial statistics to investigate the between-group structural difference, we found that the hypertensive group showed significantly reduced integrity of white matter in the bilateral superior longitudinal fasciculus. Importantly, using the mediation analysis, we found that the functional connectivity of the frontoparietal networks mediates the impact of white matter on executive function in the hypertensive group. The results demonstrate that hypertension targets a specific pattern of cognitive decline, possibly due to deficits in the white matter and functional connectivity in frontal and parietal lobes. Our findings highlight the importance of brain protection in hypertension.