With rapid urban development, the “waste-free city” concept has emerged. Therefore, the accurate prediction of the amount of C&D waste is of great importance. However, many countries and regions, including China, have not yet established C&D waste databases and standard prediction methods. This study proposed a method using a weighted combination of the grey theory model (GM) and the autoregressive integrated moving average (ARIMA) model to predict the quantity of urban C&D waste in the future. Based on a case study in Guangzhou, this study compared the prediction results of three prediction models, namely the GM, the ARIMA, and the proposed weighted combined model of the GM and the ARIMA (GM-ARIMA). The results of this study proved that the proposed combined GM-ARIMA model had a better predictive performance than both the separated models. The mean absolute percentage errors (MAPE) of the GM and ARIMA models were 12.11% and 14.26%, respectively, whereas the proposed GM-ARIMA model had a lower MAPE (8.5%). This study found that the generation of C&D waste in Guangzhou will continue to grow steadily. From 2024 to 2035, the quantity of C&D waste is expected to reach 850 million tons cumulatively, with an annual growth rate of 7.1%.