This study aimed to investigate β-amyloid peptide (Aβ) plaques and changes of astroglia and microglia in mice with Alzheimer's disease (AD). In this study, 18 transgenic mice with amyloid precursor protein (APP) /presenilin-1 (PS1) were randomized into the Aβ3-10-KLH vaccine, Aβ1-42 vaccine, and phosphate-buffered saline (PBS) groups. The mice were injected at different time points. The Morris water maze test was used to identify the spatial learning and memory abilities of the mice. Immunohistochemistry was done to examine the Aβ, glial fibrillary acidic protein, and transmembrane protein 119 (TMEM119). Correspondingly, enzyme-linked immunosorbent assay (ELISA) was done to measure interleukin (IL) -1β and tumor necrosis factor (TNF) -α in the brain of transgenic mice. The Morris water maze results showed that both the Aβ3-10-KLH vaccine and the Aβ1-42 peptide vaccine could improve the cognitive function of APP/PS1 transgenic mice significantly. Aβ3-10-KLH and Aβ1-42 inoculations reduced Aβ load and suppressed astrocytes and microglia proliferation in the cortex compared with the PBS group. While there was no significant difference between the two groups, Aβ3-10-KLH and Aβ1-42 vaccines decreased the brain levels of IL-1β and TNF-α as compared with the PBS group, but without difference between the two vaccines. In conclusion, early immunotherapy with an Aβ vaccine reduces the activation of glial cells and deposition of Aβ plaque in the brain of transgenic mice.