Unmanned Underwater Vehicles (UUVs) play a vital role in various underwater exploration and surveillance tasks. However, the effective navigation of UUVs in complex underwater environments poses significant challenges due to factors such as limited communication, dynamic currents, and other difficulties. Evolutionary optimization techniques have developed as promising tools for enhancing UUV navigation abilities. This review provides a brief overview of the application of evolutionary optimization algorithms, including genetic algorithms, evolutionary approaches, and particle swarm optimization, in the context of UUV navigation. The fundamental principles of these algorithms and their applications in path planning, path optimization, localization, obstacle avoidance, and mission planning for UUVs are discussed in brief. Through an analysis of existing literature and case studies, the use of evolutionary optimization in improving the navigation efficiency, accuracy, and robustness of UUVs is highlighted. Additionally, current challenges were identified, and future research directions to advance the integration of evolutionary optimization techniques in UUV navigation systems are also discussed. Overall, this aims to provide insights into the potential of evolutionary optimization for addressing the navigation challenges faced by unmanned underwater vehicles and promoting advancements in underwater exploration and surveillance technologies.