Alzheimer's disease (AD) is a degenerative brain disease with complex clinical manifestations and pathogeneses such as abnormal deposition of beta-amyloid protein and inflammation caused by the excessive activation of microglia. CXC motif chemokine receptor type 4 (CXCR4) is a type of G protein-coupled receptor that binds to CXC motif ligand 12 (CXCL12) to activate downstream signaling pathways, such as the Janus kinase/signal transducer and activator of transcription and the renin-angiotensin system (Ras)/RAF proto-oncogene serine (Raf)/mitogen-activated protein kinase/extracellular-regulated protein kinase; most of these signaling pathways are involved in inflammatory responses. CXCR4 is highly expressed in the microglia and astrocytes; this might be one of the important causes of inflammation caused by microglia and astrocytes. In this review, we summarize the mechanism and therapeutics of AD, the structures of CXCR4 and the CXCL12 ligand, and the mechanisms of CXCR4/CXCL12 that are involved in the occurrence and development of AD.The possible treatment of AD through microglia and astrocytes is also discussed, with the aim of providing a new method for the treatment of AD.