In order to investigate the issues of the recycling and remanufacturing of construction and demolition waste (C&D waste), this paper develops a closed-loop supply chain (CLSC) consisting of a manufacturer, a retailer, and a recycler, considering both the retailer’s fairness concern psychology and governmental regulations. Four mathematical models are developed for the calculations, and the models are solved through game theory. In both the decentralized and centralized scenarios, the members’ strategies are discussed and the optimal values of decision variables are determined. A numerical study is carried out for sensitivity analyses to verify the accuracy of the theoretical conclusions. The results reveal that retailer fairness concerns lead to a decrease in the wholesale price of building materials and negatively affect manufacturers’ profits. Additionally, governmental regulations can effectively increase the recycling amount and improve the utilization rate of C&D waste, and promote a virtuous cycle of the recycling and remanufacturing of C&D waste.