Our previous studies demonstrated that vitamin A deficiency (VAD) can impair the postnatal cognitive function of rats by damaging the hippocampus. The present study examined the effects of retinoic acid (RA) on apoptosis induced by hypoxic-ischemic damage in vivo and in vitro, and investigated the possible signaling pathway involved in the neuroprotective anti-apoptotic effects of RA. Flow cytometry, immunofluorescence staining and behavioral tests were used to evaluate the neuroprotective and anti-apoptotic effects of RA. The protein and mRNA levels of RARα, PI3K, Akt, Bad, caspase-3, caspase-8, Bcl-2, Bax, and Bid were measured with western blotting and real-time PCR, respectively. We found impairments in learning and spatial memory in VAD group compared with vitamin A normal (VAN) and vitamin A supplemented (VAS) group. Additionally, we showed that hippocampal apoptosis was weaker in the VAN group than that in VAD group. Relative to the VAD group, the VAN group also had increased mRNA and protein levels of RARα and PI3K, and upregulated phosphorylated Akt/Bad levels in vivo. In vitro, excessively low or high RA signaling promoted apoptosis. Furthermore, the effects on apoptosis involved the mitochondrial membrane potential (MMP). These data support the idea that sustained VAD following hypoxic-ischemic brain damage (HIBD) inhibits RARα, which downregulates the PI3K/Akt/Bad and Bcl-2/Bax pathways and upregulates the caspase-8/Bid pathway to influence the MMP, ultimately producing deficits in learning and spatial memory in adolescence. This suggests that clinical interventions for HIBD should include suitable doses of VA.Electronic supplementary materialThe online version of this article (10.1186/s13041-018-0360-0) contains supplementary material, which is available to authorized users.