Ecological problems such as natural resource depletion and massive quantities of waste for disposal are now guiding progressive civilization towards sustainable construction. The reduction of natural resources and the discarding of debris into open landfills are the two main environmental concerns. As a result, managing these solid wastes is a major challenge worldwide. In comparison to disposal, insufficient landfills, ecological degradation and the economic load on the relevant agencies, recycling and reusing waste materials have a considerable influence. Waste fiber has been studied for use as a cement-based composite (CBC) ingredient. Recycling waste fibers not only makes the cement composite more cost-effective and long-lasting but also helps to reduce pollution. Plastics, carpets and steels are among the various types of waste fibers reviewed in this study for their applications in cement-based materials. The mechanical properties of CBCs with different kinds of recycled-waste fibers were explored, including their compressive, flexural and splitting tensile strength and durability properties. The use of recycled fibers in the construction industry can help to ensure sustainability from environmental, economic and social standpoints. As a result, additional scientific research is needed, as well as guidance for more researchers and experts in the construction sector to examine the unknown sustainability paths. The barriers to the effective implementation of waste fiber recycling techniques in the construction sector were reviewed, and various solutions were proposed to stimulate and ensure their use in CBCs. It was concluded that CBCs containing recycled fibers provide a long-term and cost-effective alternative for dealing with waste materials.