Under construction industry upgrading and environmental protection requirements, promoting prefabricated buildings is very important, but its development varies significantly in different regions. For example, it only accounts for 20% of the new construction area in China, and the overall development level is low. The promotion of prefabricated buildings involves multiple interests. Then, how to encourage all stakeholders to work together to promote its development is a crucial issue. This study obtains an evolutionary game model among the government, developers, and purchasers. Then the stability strategies of the stakeholders are given conditions. Finally, numerical simulation is used to validate theoretical findings and determine the sensitivity of key parameters to a subject’s behavior. The results show that: (1) There are two key factors that restrict the cooperation of stakeholders to promote prefabricated buildings, including the lack of government subsidies and the weak demand of the purchasers; (2) The government’s overall subsidy should not be too high, exceeding the government’s expenditure on environmental protection, and the subsidies for developers and purchasers must be reasonably allocated to effectively compensate for development benefits and purchase costs under limited expenditures. (3) Improving the residential environment of prefabricated buildings can significantly enhance the vested interests of purchasers, make up for their purchase costs, increase their willingness to purchase, and thus reduce the sales risk of developers.