Alzheimer’s disease (AD) is a debilitating neurodegenerative disease characterized by the accumulation of extracellular amyloid-β peptides (Aβ) within the cerebral parenchyma and vasculature, which is known as cerebral amyloid angiopathy (CAA). This study utilized confocal imaging to investigate heparan sulfate (HS) expression within the cerebrovasculature and its associations with Aβ, gender, and ApoE4 genotype in AD. Our investigation revealed elevated levels of HS in the cerebrovasculature of AD patients with severe CAA. Additionally, these patients exhibited higher HS colocalization with Aβ in the cerebrovasculature, including both endothelial and vascular smooth muscle cell compartments. Intriguingly, a reversal in the polarized expression of HS within the cerebrovasculature was detected in AD patients with severe CAA. Furthermore, male patients exhibited lower levels of both parenchymal and cerebrovascular HS. Additionally, ApoE4 carriers displayed heightened cerebrovascular Aβ expression and a tendency of elevated cerebrovascular HS levels in AD patients with severe CAA. Overall, these findings reveal potential intricate interplay between HS, Aβ, ApoE, and vascular pathology in AD, thereby underscoring the potential roles of cerebrovascular HS in CAA development and AD pathology. Further study of the underlying mechanisms may present novel therapeutic avenues for AD treatment.