For robot swarm applications, accurate positioning is one of the most important requirements for avoiding collisions and keeping formations and cooperation between individuals. However, in some worst cases, the GNSS (Global Navigation Satellite System) signals are weak due to the crowd being in a swarm or blocked by a forest, mountains, and high buildings in the environment. Thus, relative localization is an indispensable way to provide position information for the swarm. In this paper, we review the status and development of relative localization. It is first assessed that relative localization to obtain spatio-temporal relationships between individuals is necessary to achieve the stable operation of the group. After analyzing typical relative localization systems and algorithms from the perspective of functionality and practicality, this paper concludes that the UWB-based (ultra wideband) system is suitable for the relative localization of robots in large-scale applications. Finally, after analyzing the current challenges in the field of fully distributed localization for robotic swarms, a complete mechanism encompassing the relative localization process and the relationship between local and global localization that can be a possible direction for future research is proposed.