The goal of smart cities is to properly manage to expand urbanization, Reduce energy usage, Enhance the economic and quality of life of the locals while also preserving the environment conditions, and improve people's ability to use and adapt modern technology used in information and communication efficiently (ICT). Information and communication technology (ICT) is central to the concept of smart cities because it facilitates the development of policies, decision-making, implementation, and, eventually, the provision of useful services. This review's main objective is to examine how machine learning, deep reinforcement learning (DRL), and artificial intelligence are advancing smart cities. The previous strategies are effectively utilized to provide the best policies possible for a number of challenging issues relating to smart cities. The uses of the earlier methods are thoroughly discussed in this survey. in intelligent transportation systems (ITSs), Cybersecurity, as well as smart grid energy efficiency (SGs), ensuring the best 5G and beyond 5G (B5G) networking service, as well as a smart city with a smart health system, by effectively using unmanned aerial vehicles (UAVs). Finally, we list a number of the above-mentioned research problems and potential future directions approaches can be extremely helpful in bringing the idea of a smart city to life.