Fiber-reinforced polymer (FRP) composites have been widely used to strengthen the deteriorated reinforced concrete structures due to their outstanding characteristics of light weight, high strength, as well as noncorrosion. A successful strengthening with the FRP composites would equip the existing structures with the prominent improvement in terms of the durability, ductility, and bearing capacity. Current studies indicate that a simple and reliable anchorage system for the FRP composites will help improve the performance of the strengthened structures both efficiently and economically. Up till now, various anchorage systems have been developed for the FRP composites. Therefore, it is necessary to select appropriate anchorage systems according to different needs and establish relevant design specifications. In view of the aforementioned objectives, this paper systematically summarizes the anchoring mechanism of anchorage systems for two commonly used FRP products (FRP laminates and FRP bars) in different strengthened systems. Additionally, a state-of-the-art review as well as the advantages and disadvantages of each anchorage system are presented. Finally, shortcomings in the current state of knowledge and recommendations beneficial to further study are put forward.