Since the proposition of the concept of cloud computing in the year 2006, cloud computing has drawn lots of attention from both industry and academic area. Several technologies such as virtualization formed the basis of cloud computing, while some other technologies acts as system improvement strategies in cloud computing. Among the used technologies, Load balancing is indispensable and extremely important in improving system performance and maintaining users' experience. In this paper, we focus on load balancing algorithms commonly used in cloud computing. Through our analysis we proposed our improved online load balancing algorithm. We use several experimental results to show its power and efficiency. We use CloudSim as a simulator to verify our thoughts.