The use of hybrid energy storage systems (HESS) in renewable energy sources (RES) of photovoltaic (PV) power generation provides many advantages. These include increased balance between generation and demand, improvement in power quality, flattening PV intermittence, frequency, and voltage regulation in Microgrid (MG) operation. Ideally, HESS has one storage is dedicated for high energy storage (HES) and another storage for high power storage (HPS) purpose. HES is used to fulfill long-term energy demand, while HPS is used to handle power transients and fast load fluctuations. This paper examines HESS comprehensively for PV power generation and focuses on its ability to combine two storage technologies. The two storage technologies include high energy and high power. This paper also analyzes the important aspects of advance HESS in PV power generation in the context of capacity sizing, power converter topology and strategies management energy. Several capacity sizing methods were critically reviewed and tabulated. Power converter (PC) topologies are classified and briefly discussed regarding their advantages and disadvantages. Furthermore, energy management strategies with various control techniques are critically classified and evaluated for better future direction. In addition, the implementation of HESS on PV power plants in current real projects is presented and evaluated. Finally, this paper can be considered as useful guide for the use of HESS in PV power plants including features, limitations, and real applications.