In recent years, glial cells have been acknowledged as key players in the pathogenesis of Alzheimer’s disease (AD), a neurodegenerative condition in which an accumulation of intracellular neurofibrillary tangles and extracellular fibrillar amyloid beta is notably observed in the central nervous system. Genome-wide association studies have shown, both in microglia and astrocytes, an increase in gene variants associated with a higher risk of developing late-onset AD. Microglia, the resident innate immune cells of the brain, and astrocytes, glial cells crucial for vascular integrity and neuronal support, both agglomerate near amyloid beta plaques and dystrophic neurites where they participate in the elimination of these harmful parenchymal elements. However, their role in AD pathogenesis has been challenging to resolve due to the highly heterogeneous nature of these cell populations, i.e., their molecular, morphological, and ultrastructural diversity, together with their ever-changing responsiveness and functions throughout the pathological course of AD. With the recent expansions in the field of glial heterogeneity through innovative advances in state-of-the-art microscopy and -omics techniques, novel concepts and questions arose, notably pertaining to how the diverse microglial and astrocytic states interact with each other and with the AD hallmarks, and how their concerted efforts/actions impact the progression of the disease. In this review, we discuss the recent advances and findings on the topic of glial heterogeneity, particularly focusing on the relationships of these cells with AD hallmarks (e.g., amyloid beta plaques, neurofibrillary tangles, synaptic loss, and dystrophic neurites) in murine models of AD pathology and post-mortem brain samples of patients with AD.