Cloud computing had opened a new horizon for utilization of resources and their computing. But as accessibility of cloud increases, one of the most important factors to be considered would be availability of resources and load balancing. Fault tolerance is another issue to deal with while providing Quality of Service in cloud environment thus enhancing the performance. This paper investigates about fault-tolerance in load balancing schemes in distributed environment. There are some more parameters influencing QOS but our main focus is on fault tolerance and load balancing.