The "gut-brain axis" is emerging as an important target in Alzheimer's disease (AD). However, immunological mechanisms underlying this axis remain poorly understood. Using single-cell RNA sequencing of the colon immune compartment in the 5XFAD amyloid-β (Aβ) mouse model, we uncovered AD-associated changes in ribosomal activity, oxidative stress, and BCR/plasma cell activity. Strikingly, levels of colon CXCR4+ antibody secreting cells (ASCs) were significantly reduced. This corresponded with accumulating CXCR4+ B cells and gut-specific IgA+ cells in the brain and dura mater, respectively. Consistently, a chemokine ligand for CXCR4, CXCL12, was expressed at higher levels in 5XFAD glial cells and in in silico analyzed human brain studies, supporting altered neuroimmune trafficking. An inulin prebiotic fiber diet attenuated AD markers including Aβ plaques and overall frailty. These changes corresponded to an expansion of gut IgA+ cells and rescued peripheral Tregs levels. Our study points to a key glia-gut axis and potential targets against AD.