Cloud Computing is a term which is generally used in reference to Internet. The whole Internet can be viewed as a cloud. The cloud is quickly changing a worldwide network of computers into the largest single, "virtual" computer in the world. This includes sharing of resources which increases the load on single machine. Thus the overall performance degrades and this problem is named as load balancing. Load Balancing is one of the challenging issues now a day. To overcome from this problem be reassign the load by implementing various algorithms introduced for this problem. In this paper we study and compare various algorithms, techniques used to solve the problem of Load Balancing and Distributed Load Balancing.