A membrane is a functional material that acts essentially as a barrier to certain species of ions, molecules, and particles but remains permeable to the rest of the species in a multicomponent system. Composite membranes can provide increased selectivity, separation efficiency, and improved properties (e.g. mechanical and thermal resistance) by using specific fillers. Among various fillers, carbon nanotubes (CNT) and graphene occupy a special place due to their remarkable properties, such as high mechanical and thermal resistance as well as high adsorption capacity at the surface. This article overviews synthesis, characterization, and performance of composite polymer membranes with CNT and graphite for water purification of any kind of pollutants – from dyes to heavy metals.