With the low latency, high transmission rate, and high reliability provided by the fifth-generation mobile communication network (5G), many applications requiring ultra-low latency and high reliability (uRLLC) have become a hot research topic. Among these issues, the most important is the Internet of Vehicles (IoV). To maintain the safety of vehicle drivers and road conditions, the IoV can transmit through sensors or infrastructure to maintain communication quality and transmission. However, because 5G uses millimeter waves for transmission, a large number of base stations (BS) or lightweight infrastructure will be built in 5G, which will make the overall environment more complex than 4G. The lightweight infrastructure also has to be considered together. For these reasons, in 5G, there are two mechanisms for handover, horizontal, and vertical handover; hence, it must be discussed how to handle handover to obtain the best performance for the whole network. In this paper, to address handover selection, we consider delay time, energy efficiency, load balancing, and energy consumption and formulate it as a multi-objective optimization (MOO) problem. At the same time, we propose the handover of the mobile management mechanism based on location prediction combined with heuristic algorithms. The results show that our proposed mechanism is better than the distance-based one for energy efficiency, load, and latency. It optimizes by more than about 20% at most.