Chlorogenic acid (CA) is a phenolic compound commonly found in human plant-based diets. CA is the main component of many traditional Chinese medicine preparations, and in recent years, it has been found to have hypoglycemic, hypolipidemic, anti-inflammatory, antioxidant, and other pharmacological properties. Specifically, CA relieves the effects of, and prevents, diabetes mellitus (DM). In addition, CA is also beneficial against complications arising from DM, such as diabetic nephropathy (DN), diabetic retinopathy (DR), and diabetic peripheral neuropathy (DPN). Herein, we review the use of CA in the prevention and treatment of DM and its complications, providing a background for further research and medical uses.