The purpose of this study was to investigate whether the addition of chlorogenic acid (CGA) to a sheep semen extender could improve the quality of chilled sheep sperm. Ejaculates (n = 80) were collected from five Hu rams with an artificial vagina. The ejaculates were mixed and divided into five equal parts, diluted with a CGA-free Tris–egg yolk extender (control), or supplemented with 0.2, 0.4, 0.8, and 1.2 mg/mL. The sperm kinematic parameters (viability, progressive motility), functional integrity of plasma membrane and acrosome, adenosine triphosphate (ATP) concentration and antioxidant parameters (Catalase (CAT), Superoxide dismutase (SOD) activity, total antioxidant capacity (T-AOC), ROS level and Malondialdehyde (MDA) content) were evaluated during storage of the semen. The results indicated that: PM, plasmatic membrane integrity and acrosomal integrity in 0.8 mg/mL CGA were higher (p < 0.05) from day 1 to 5. The ROS level in CGA groups was lower than the control (p < 0.05). CAT, SOD, ATP, and T-AOC were highest at 0.8 mg/mL concentration within 1 to 5 days. The above results indicated that the right concentration of CGA improved the quality of Hu ram sperm during chilling storage.