Background: Despite recent evidence demonstrating iron and folate supplementation reduces the risk of low birth weight and preterm births, synthesis of the evidence is not sufficient to understand their impacts in Africa. Method: MEDLINE, PsycINFO, Embase, Scopus, CHINAL, Web of Science, Cochrane databases, and Google Scholar were searched for the published and grey literature. Either iron-only, folate-only, or iron–folic acid (IFA) oral supplementation during pregnancy was the primary exposure/intervention. The focus of this review was low birth weight and preterm births in the African region. Qualitative synthesis, meta-analysis, and subgroup analysis were employed. Results: In the qualitative synthesis (n = 4), IFA supplementation showed a positive impact on reducing preterm birth. Additionally, the meta-analysis showed that IFA and iron-only supplementation reduced the odds of low birth weight by 63% (OR 0.37; 95% CI: 0.29, 0.48) and 68% (OR 0.32; 95% CI: 0.21 to 0.50), respectively. Conclusion: Both iron-only and IFA supplementation are effective in reducing the risk of low birth weight in Africa. There is also promising evidence suggesting a potential reduction in preterm births. Consequently, further research is needed, particularly targeting high-risk groups such as women residing in rural areas with limited support and low levels of literacy.